-- Logs begin at Sat 2022-02-19 20:01:15 UTC, end at Sat 2022-02-19 22:17:31 UTC. -- Feb 19 20:39:23.223272 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Feb 19 20:39:23.232179 ncdv-master-1 devstack@n-api.service[120387]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Feb 19 20:39:23 2022] *** Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: nodename: ncdv-master-1 Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: machine: x86_64 Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: clock source: unix Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: pcre jit disabled Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: detected number of CPU cores: 4 Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: current working directory: / Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: detected binary path: /usr/bin/uwsgi-core Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: your processes number limit is 47680 Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: your memory page size is 4096 bytes Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: detected max file descriptor number: 2048 Feb 19 20:39:23.234195 ncdv-master-1 devstack@n-api.service[120387]: lock engine: pthread robust mutexes Feb 19 20:39:23.234991 ncdv-master-1 devstack@n-api.service[120387]: thunder lock: enabled Feb 19 20:39:23.234991 ncdv-master-1 devstack@n-api.service[120387]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 19 20:39:23.234991 ncdv-master-1 devstack@n-api.service[120387]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 19 20:39:23.283933 ncdv-master-1 devstack@n-api.service[120387]: Python main interpreter initialized at 0x55be6e70f9c0 Feb 19 20:39:23.283933 ncdv-master-1 devstack@n-api.service[120387]: python threads support enabled Feb 19 20:39:23.283933 ncdv-master-1 devstack@n-api.service[120387]: your server socket listen backlog is limited to 100 connections Feb 19 20:39:23.283933 ncdv-master-1 devstack@n-api.service[120387]: your mercy for graceful operations on workers is 90 seconds Feb 19 20:39:23.284273 ncdv-master-1 devstack@n-api.service[120387]: mapped 403077 bytes (393 KB) for 2 cores Feb 19 20:39:23.284388 ncdv-master-1 devstack@n-api.service[120387]: *** Operational MODE: preforking *** Feb 19 20:39:23.284636 ncdv-master-1 devstack@n-api.service[120387]: *** uWSGI is running in multiple interpreter mode *** Feb 19 20:39:23.284636 ncdv-master-1 devstack@n-api.service[120387]: spawned uWSGI master process (pid: 120387) Feb 19 20:39:23.284843 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Feb 19 20:39:23.285901 ncdv-master-1 devstack@n-api.service[120387]: spawned uWSGI worker 1 (pid: 120390, cores: 1) Feb 19 20:39:23.285901 ncdv-master-1 devstack@n-api.service[120387]: spawned uWSGI worker 2 (pid: 120391, cores: 1) Feb 19 20:39:23.285901 ncdv-master-1 devstack@n-api.service[120387]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 19 20:39:25.206329 ncdv-master-1 devstack@n-api.service[120391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:39:25.206329 ncdv-master-1 devstack@n-api.service[120391]: from cryptography.utils import int_from_bytes Feb 19 20:39:25.207016 ncdv-master-1 devstack@n-api.service[120391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:39:25.207016 ncdv-master-1 devstack@n-api.service[120391]: from cryptography.utils import int_from_bytes Feb 19 20:39:25.209635 ncdv-master-1 devstack@n-api.service[120390]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:39:25.209635 ncdv-master-1 devstack@n-api.service[120390]: from cryptography.utils import int_from_bytes Feb 19 20:39:25.210109 ncdv-master-1 devstack@n-api.service[120390]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:39:25.210109 ncdv-master-1 devstack@n-api.service[120390]: from cryptography.utils import int_from_bytes Feb 19 20:39:27.757846 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 19 20:39:27.758323 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 19 20:39:27.758585 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 19 20:39:27.758947 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 19 20:39:27.759201 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 19 20:39:27.759585 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.759697 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 19 20:39:27.760055 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.760146 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 19 20:39:27.760227 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.760459 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 19 20:39:27.760567 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.760825 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 19 20:39:27.760969 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.761078 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 19 20:39:27.761172 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.761449 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.761570 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.761768 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.761855 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.762082 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.762170 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.762371 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.762459 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.762686 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.762772 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.763009 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.763106 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.763333 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.763430 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.763638 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.763732 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.763949 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.764055 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.764205 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.764291 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.764544 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.764643 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.764869 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.764969 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.765185 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.765278 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.765488 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.765689 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.765803 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.766876 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767022 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767134 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767265 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767358 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767524 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767654 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767745 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767825 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767825 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.767983 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.768083 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.768170 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.768249 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.768359 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.768593 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.768699 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.768897 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.768984 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.769229 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.769324 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.769539 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.769634 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.769860 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.769946 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.770168 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.770263 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.770489 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.770577 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.770797 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.770885 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.771179 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.771283 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.771492 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.771598 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.771802 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.771905 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.772109 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.772202 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.772460 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.772567 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.772784 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.772873 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.773105 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.773202 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.773427 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.773523 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.773730 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.773824 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.774038 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.774133 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.774348 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.774436 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.774667 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.774752 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.774969 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.775055 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.775275 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.775370 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.775528 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.775624 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.775835 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.775930 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.776157 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.776251 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.776499 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.776597 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.776805 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.776902 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.777061 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.777149 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.777312 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.777399 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.777631 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.777723 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.778919 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.779013 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.779716 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.779803 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.780046 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.780133 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.780306 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.780414 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.780586 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.780686 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.780913 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.781002 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.781243 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.781331 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.781560 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.781689 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.781875 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.781974 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.782187 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.782286 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.782499 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.782605 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.782808 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.782915 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.783117 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.783218 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.783424 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.783528 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.783733 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.783828 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.784052 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.784147 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.784371 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.784468 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.784703 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.784798 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.785014 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.785110 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.785318 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.785419 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.785640 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.785743 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.785956 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.786050 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.786260 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.786362 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.786569 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.786673 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.786877 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.786973 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.787195 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.787290 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.787515 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.787622 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.787822 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.787933 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.788073 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.788161 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.788392 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.788493 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.788701 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.788797 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.789021 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.789108 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.789325 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.789421 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.789630 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.789727 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.789902 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.789989 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.790209 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.790297 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.790513 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.790608 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.790819 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.790907 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.791123 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.791224 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.791428 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.791518 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.791730 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.791817 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.792033 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.792125 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.792370 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.792472 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.792666 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.793028 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.793230 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.793324 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.793587 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.794212 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.794395 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.794489 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.794701 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.794788 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.795008 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.795098 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.795316 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.795404 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.795623 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.795709 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.795945 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.796044 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.796257 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.796374 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.796591 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.796682 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.796898 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.796997 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.797205 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.797292 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.797516 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.797635 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.797836 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.797960 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.798140 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.798243 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.798442 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.798530 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.798761 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.798848 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.799060 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.799154 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.799364 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.799458 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.799681 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.799766 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.799987 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.800082 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.800294 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.800436 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.800621 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.800717 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.800923 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.801009 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.801226 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.801340 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.801533 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.801628 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.801836 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.801934 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.802140 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.802296 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.802446 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.802600 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.802750 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.803228 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.803419 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.803556 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.803734 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.803870 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.804138 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.804283 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.804475 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.804617 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.804782 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.804941 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.805103 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.805281 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.805424 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.805614 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.805737 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.805959 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.806045 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.806274 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.806369 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.806608 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.806695 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:39:27.806940 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.807027 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.807259 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.807347 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.807571 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.807664 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.807884 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.807981 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.808212 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.808315 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.808552 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.808640 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.808863 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.808949 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.809201 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.809293 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.809512 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.809598 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.809823 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.809908 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.810139 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.810227 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.810456 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.810541 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.810767 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.810875 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.811080 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.811182 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.811390 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.811477 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.811705 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.811802 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.812021 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.812127 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.812356 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.812465 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.812675 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.812775 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.812991 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.813156 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.813312 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.813453 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.813617 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.813764 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.813940 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.814087 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.814253 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.814393 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.814564 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.814711 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.814879 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.815018 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.815190 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.815339 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.815511 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.815662 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.815839 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.815977 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.816146 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.816290 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.816505 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.816598 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.816780 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.816869 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.817091 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.817177 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.817405 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.817507 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.817719 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.817856 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.818026 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.818121 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.818335 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.818432 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.818647 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.818735 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.818959 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.819054 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.819268 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.819356 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.819577 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.819670 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.819884 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.819970 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.820192 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.820281 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.820522 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.820610 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.820827 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.820923 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.821133 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.821228 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.821438 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.821532 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.821746 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.821842 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.822056 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.822208 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.822348 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.822485 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.822645 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.822788 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.822951 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.823090 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.823260 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.823399 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.823557 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.823705 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.823870 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.824008 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.824183 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.824321 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.824514 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.824603 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.824841 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.824927 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.825152 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.825239 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.825463 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.825552 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.825766 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.825852 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.826073 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.826159 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.826381 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.826470 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.826682 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.826775 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.826990 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.827076 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.827293 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.827381 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.827614 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.827743 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.827914 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.828028 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.828217 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.828362 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.828546 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.828634 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.828853 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.828949 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.829157 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.829244 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.829471 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.829559 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.829779 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.829874 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.830085 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.830170 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.830397 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.830483 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.830708 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.830803 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.831019 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.831104 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.831325 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.831410 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.831634 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.831723 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.831952 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.832040 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.832258 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.832429 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.832594 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.832682 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.832895 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.832980 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.833200 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.833293 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.833503 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.833598 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.833812 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.833898 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.834112 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.834197 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.834416 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.834527 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.834720 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.834836 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.835023 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.835139 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.835326 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.835447 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.835649 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.835744 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.835959 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.836054 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.836263 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.836370 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.836591 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.836678 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.836893 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.836992 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.837231 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.837318 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.837534 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.837620 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.837832 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.837928 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.838134 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.838231 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.838434 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.838521 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.838772 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.838861 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.839074 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.839161 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.839391 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.839476 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.839701 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.839789 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.840010 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.840104 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.840317 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.840953 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.841153 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.841243 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.841473 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.841568 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.841779 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.841865 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.842088 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.842179 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.842397 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.842495 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.842702 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.842798 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.843019 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.843105 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.843323 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.843414 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.843628 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.843723 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.843934 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.844020 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.844255 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.844588 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.844759 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.844906 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.845210 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.845303 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.845525 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.845640 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.845861 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.846025 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.846193 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.846281 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.846505 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.846600 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.846814 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.846909 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.847123 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.847209 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.847432 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.847525 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.847739 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.847828 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.848047 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.848172 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.848377 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.848507 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.848688 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.848789 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.848996 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.849094 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.849302 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.849399 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.849615 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.849728 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.849919 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.850015 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.850225 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.850311 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.850535 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.850623 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.850849 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.850937 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.851156 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.851258 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.851470 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.851558 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.851777 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.851866 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.852101 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.852210 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.852433 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.852524 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.852743 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.852842 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.853059 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.853156 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.853361 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.853456 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.853665 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.853778 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.853971 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.854066 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.854271 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.854360 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.854573 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.854660 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.854879 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.854973 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.855184 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.855272 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.855489 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.855575 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.855793 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.855881 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.856662 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.856774 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.856975 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.857063 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.857288 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.857377 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.857611 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.857706 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.857921 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.858012 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.858231 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.858390 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.858549 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.858683 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.858844 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.858931 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.859146 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.859235 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.859466 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.859562 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.859766 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.859865 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.860066 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.860152 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.860391 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.860481 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.860697 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.860797 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.861002 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.861089 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.861303 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.861390 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.861602 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.861697 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.861935 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.862022 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.862244 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.862330 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.862549 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.862662 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.862856 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.862943 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.863172 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.863259 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.863477 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.863565 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.863788 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.863874 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.864097 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.864184 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.864429 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.864522 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.864739 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.864825 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.865047 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.865140 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.865351 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.865439 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.865656 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.865749 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.865960 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.866046 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.866265 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.866353 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.866570 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.866656 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.866878 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.866972 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.867182 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.867269 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.867485 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.867571 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.867792 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.867886 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.868095 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.868383 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.868475 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.868717 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.868806 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.869032 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.869275 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.869366 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.869606 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.869692 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.869919 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.870014 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.870235 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.870323 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.870551 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.870639 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.870871 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.870960 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.871200 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.871288 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.871504 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.871599 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.871851 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.871956 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.872190 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.872353 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.872527 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.872680 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.872817 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.872905 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.873124 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.873223 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.873425 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.873518 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.873726 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.873813 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.874029 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.874124 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.874329 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.874415 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.874630 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.874715 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.874929 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.875017 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.875230 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.875324 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.875530 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.875624 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.875831 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.875925 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.876131 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.876217 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.876462 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.876553 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.876774 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.876863 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.877075 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.877160 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.877374 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.877469 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.877676 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.877763 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.877982 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.878075 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.878285 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.878380 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.878587 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.878684 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.878928 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.879024 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.879230 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.879326 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.879557 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.879642 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.879862 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.879958 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.880186 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.880275 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.880520 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.880609 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.880826 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.880913 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.881130 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.881219 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.881437 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.881530 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.881741 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.881835 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.882041 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.882128 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.882346 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.882479 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.882651 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.882771 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.882950 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.883039 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.883258 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.883344 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.883557 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.883651 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.883864 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.883950 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.884162 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.884247 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.884485 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.884590 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.884797 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.884890 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.885097 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.885184 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.885397 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.885500 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.885702 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.885790 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.886001 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.886087 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.886300 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.886395 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.886606 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.886692 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.886906 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.886993 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.887206 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.887842 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.888036 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.888127 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.888377 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.888470 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.888676 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.888773 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.888981 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.889068 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.889285 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.889374 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.889588 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.889677 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.889899 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.889985 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.890206 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.890310 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.890508 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.890604 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.890808 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.890896 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.891117 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.891204 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.891421 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.891641 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.891734 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.891815 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.892017 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.892114 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.892318 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.892432 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.892641 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.892739 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.892994 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.893094 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.893256 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.893343 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.893565 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.893652 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.893864 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.893960 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.894165 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.894252 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.894462 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.894548 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.894761 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.894848 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.895060 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.895146 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.895357 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.895449 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.895657 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.895744 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.895957 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.896043 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.896254 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.896401 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.896582 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.896673 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.896884 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.896972 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.897182 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.897269 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.897482 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.897570 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.897791 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.897876 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.898092 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.898187 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.898391 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.898479 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.898731 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.898828 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.899032 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.899193 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.899346 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.899433 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.899653 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.899741 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.899962 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.900058 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.900274 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.900381 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.900603 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.900699 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.900914 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.901014 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.901220 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.901306 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.901522 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.901609 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.901822 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.901917 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.902124 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.902212 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.902431 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.902520 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.902733 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.902825 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.903590 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.903689 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.903913 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.904009 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.904221 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.904312 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.904554 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.904642 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.904874 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.904961 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.905194 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.905283 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.905513 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.905607 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.905816 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.905903 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.906121 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.906209 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.906425 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.906511 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.906729 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.906825 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.907035 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.907121 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.907339 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.907425 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.907641 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.907735 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.907945 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.908038 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.908248 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.908356 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.908578 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.908677 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.908884 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.908980 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.909183 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.909270 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.909489 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.909597 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.909793 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.909887 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.910093 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.910180 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.910399 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.910488 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.910700 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.910787 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.911002 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.911088 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.911303 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.911398 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.911599 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.911731 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.911903 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.912038 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.912204 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.912367 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.912664 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.912810 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.912958 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.913136 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.913259 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.913350 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.913562 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.913649 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.913870 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.913965 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.914167 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.914261 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.914477 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.914565 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.914789 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.914885 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.915091 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.915186 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.915461 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.915548 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.915765 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.915860 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.916067 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.916191 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.916401 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.916505 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.916705 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.916802 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.917008 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.917102 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.917307 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.917393 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.917609 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.917705 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.918182 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.918274 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.918500 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.918585 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.918805 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.918892 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.919129 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.919276 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.919432 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.919564 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.919751 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.919890 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.920163 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.920296 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.920499 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.920599 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.920809 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.920898 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.921152 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.921245 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.921475 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.921570 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.921800 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.921895 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.922104 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.922191 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.922418 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.922513 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.922732 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.922848 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.923034 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.923144 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.923346 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.923454 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.923654 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.923780 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.923964 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.924060 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.924269 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.924402 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.924609 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.924715 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.924923 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.925029 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.925227 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.925325 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.925544 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.925650 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.925863 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.925960 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.926175 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.926274 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.926495 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.926607 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.926864 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.926965 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.927185 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.927297 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.927489 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.927588 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.927793 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.927894 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.928102 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.928200 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.928426 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.928525 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.928728 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.928817 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.929040 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.929191 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.929362 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.929507 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.929647 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.929783 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.929918 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.930065 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.930205 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.930342 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.930513 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.930682 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.930820 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.930963 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.931110 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.931252 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.931389 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.931525 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.931687 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.931838 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.932007 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.932146 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.932310 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.932417 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.932655 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.932754 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.932960 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.933059 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.933277 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.933367 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.933589 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.933677 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.933890 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.933996 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.934216 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.934305 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.934519 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.934609 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.934823 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.934909 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.935123 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.935220 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.935460 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.935549 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.935791 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.935882 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.936119 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.936206 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.936453 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.936554 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.936786 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.936878 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.937110 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.937205 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.937419 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.937509 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.937731 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.937824 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.938051 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.938151 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.938355 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.938450 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.938657 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.938746 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.938966 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.939099 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.939265 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.939354 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.939565 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.939651 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.939868 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.939965 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.940166 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.940253 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.940495 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.940586 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.940799 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.940889 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.941105 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.941193 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.941407 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.941494 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.941708 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.941808 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.942008 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.942096 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.942326 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.942421 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.942628 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.942717 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.942930 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.943080 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.943231 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.943326 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.943528 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.943616 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.943828 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.943916 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.944127 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.944227 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.944489 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.944582 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.944792 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.944880 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.945124 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.945224 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.945431 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.945518 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.945749 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.945835 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.946061 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.946204 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.946366 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.946469 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.946679 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.946778 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.946985 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.947081 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.947295 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.947381 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.947603 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.947689 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.947913 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.948002 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.948221 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.948307 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.948556 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.948646 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.948868 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.948958 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.949175 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.949310 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.949486 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.949690 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.950374 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.950527 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.950649 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.950844 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.951160 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.951254 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.951472 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.951561 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.951784 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.951873 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.952096 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.952195 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.952427 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.952518 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.952738 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.952836 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.953047 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.953182 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.953356 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.953443 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.953668 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.953758 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.953977 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.954076 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.954289 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.954378 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.954612 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.954706 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.954931 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.955019 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.955248 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.955336 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.955564 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.955660 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.955878 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.956003 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.956187 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.956311 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.956530 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.956629 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.956846 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.956947 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.957156 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.957243 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.957471 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.957568 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.957785 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.957909 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.958095 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.958181 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.958402 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.958491 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.958712 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.958798 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.959020 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.959108 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.959327 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.959421 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.959635 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.959761 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.959943 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.960032 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.960251 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.960412 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.960587 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.960676 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.960903 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.960991 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.961215 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.961305 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.961525 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.961613 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.961838 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.961935 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.962154 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.962241 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.962462 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.962667 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.962776 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.962984 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.963073 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.963316 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.963587 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.963675 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.963901 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.963997 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.964233 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.964321 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.964585 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.964673 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.964908 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.964996 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.965214 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.965301 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.966068 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.966167 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.966382 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.966473 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.966689 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.966783 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.966994 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.967093 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.967302 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.967390 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.967611 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.967697 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.967911 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.968005 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.968263 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.968374 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.968549 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.968651 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.968857 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.969076 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.969166 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.969424 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.969523 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.969738 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.969980 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.970082 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.970327 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.970417 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.970642 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.970737 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.970972 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.971074 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.971292 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.971378 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.971598 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.971686 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.971900 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.972004 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.972212 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.972298 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.972614 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.972704 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.972921 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.973022 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.973224 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.973312 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.973535 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.973633 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.973841 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.973937 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.974143 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.974230 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.974450 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.974536 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.974752 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.974840 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.975052 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.975138 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.975361 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.975449 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.975662 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.975761 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.975963 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.976050 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.976271 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.976392 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.976597 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.976695 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.976897 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.977000 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.977201 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.977309 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.977498 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.977587 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.977799 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.977888 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.978099 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.978195 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.978399 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.978487 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.978699 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.978786 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.978997 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.979093 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.979301 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.979398 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.979601 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.979687 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.979908 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.980039 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.980211 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.980299 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.980553 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.980642 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.980865 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.980953 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.981203 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.981302 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.981517 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.981604 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.981838 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.981927 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.982146 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.982245 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.982454 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.982541 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.982777 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.982868 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.983085 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.983173 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.983393 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.983613 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.983737 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.983956 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.984043 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.984279 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.984588 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.984688 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.984925 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.985014 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.985244 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.985331 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.985551 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.985647 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.985858 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.985954 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.986183 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.986271 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.986484 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.986582 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.986787 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.986883 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.987096 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.987200 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.987407 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.987507 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.987715 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.987802 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.988023 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.988109 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.988347 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.988434 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.988659 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.988746 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.988964 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.989062 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.989273 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.989368 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.989578 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.989702 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.989884 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.989982 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.990193 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.990304 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.990499 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.990596 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.990810 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.990909 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.991128 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.991215 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.991442 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.991529 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.991752 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.991858 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.992060 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.992149 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.992389 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.992481 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.992702 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.992799 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.993009 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.993099 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.993318 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.993415 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.993627 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.993717 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.993931 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.994017 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.994256 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.994344 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.994567 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.994656 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.994870 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.994959 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.995257 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.995352 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.995791 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.995919 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.996027 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.996116 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.996198 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.996288 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.996512 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.996629 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.996871 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.996959 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.997179 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.997281 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.997492 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.997583 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.997812 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.997900 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.998122 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.998212 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.998450 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.998538 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.998753 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.998848 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.999058 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.999147 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.999361 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.999449 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.999672 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.999796 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:27.999990 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.000080 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.000296 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.000454 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.000628 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.000760 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.000952 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.001049 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.001260 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.001357 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.001579 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.001676 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.001886 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.001973 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.002194 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.002290 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.002512 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.002610 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.002821 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.002908 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.003130 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.003219 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.003445 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.003541 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.003755 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.003852 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.004060 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.004148 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.004389 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.004507 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.004703 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.004804 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.005013 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.005120 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.005319 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.005420 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.005629 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.005728 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.005938 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.006045 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.006240 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.006338 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.006561 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.006658 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.006873 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.006970 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.007174 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.007271 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.007490 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.007601 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.007800 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.007913 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.008116 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.008215 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.008444 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.008553 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.008754 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.008860 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.009064 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.009174 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.009374 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.009472 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.009679 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.009785 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.009988 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.010084 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.010292 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.010395 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.010600 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.010691 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.010920 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.011010 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.011235 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.011325 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.011559 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.011650 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.011881 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.011969 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.012202 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.012898 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.013092 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.013227 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.013425 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.013515 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.013746 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.013901 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.014043 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.014142 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.014354 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.014442 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.014597 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 19 20:39:28.014698 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.014985 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.015291 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:39:28.015534 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 19 20:39:28.037502 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_db.sqlalchemy.engines [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:39:28.038545 ncdv-master-1 devstack@n-api.service[120390]: DEBUG oslo_db.sqlalchemy.engines [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:39:28.101413 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.context [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) {{(pid=120391) load_cells /opt/stack/nova/nova/context.py:464}} Feb 19 20:39:28.102128 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.context [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) {{(pid=120390) load_cells /opt/stack/nova/nova/context.py:464}} Feb 19 20:39:28.105617 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:39:28.106395 ncdv-master-1 devstack@n-api.service[120390]: DEBUG oslo_concurrency.lockutils [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:39:28.107228 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:39:28.107960 ncdv-master-1 devstack@n-api.service[120390]: DEBUG oslo_concurrency.lockutils [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:39:28.108053 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:39:28.108789 ncdv-master-1 devstack@n-api.service[120390]: DEBUG oslo_concurrency.lockutils [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:39:28.109981 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:39:28.110703 ncdv-master-1 devstack@n-api.service[120390]: DEBUG oslo_concurrency.lockutils [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:39:28.122340 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_db.sqlalchemy.engines [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:39:28.123181 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_db.sqlalchemy.engines [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:39:28.126371 ncdv-master-1 devstack@n-api.service[120390]: DEBUG oslo_db.sqlalchemy.engines [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:39:28.129192 ncdv-master-1 devstack@n-api.service[120390]: DEBUG oslo_db.sqlalchemy.engines [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:39:28.284497 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_db.sqlalchemy.engines [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:39:28.290939 ncdv-master-1 devstack@n-api.service[120390]: DEBUG oslo_db.sqlalchemy.engines [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:39:28.621032 ncdv-master-1 devstack@n-api.service[120391]: WARNING keystonemiddleware.auth_token [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 20:39:28.624272 ncdv-master-1 devstack@n-api.service[120390]: WARNING keystonemiddleware.auth_token [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 20:39:28.627612 ncdv-master-1 devstack@n-api.service[120391]: WARNING keystonemiddleware.auth_token [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 20:39:28.630899 ncdv-master-1 devstack@n-api.service[120390]: WARNING keystonemiddleware.auth_token [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 20:39:28.967724 ncdv-master-1 devstack@n-api.service[120391]: WARNING keystonemiddleware.auth_token [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 20:39:28.970193 ncdv-master-1 devstack@n-api.service[120390]: WARNING keystonemiddleware.auth_token [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 20:39:28.973017 ncdv-master-1 devstack@n-api.service[120391]: WARNING keystonemiddleware.auth_token [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 20:39:28.975468 ncdv-master-1 devstack@n-api.service[120390]: WARNING keystonemiddleware.auth_token [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 20:39:28.978151 ncdv-master-1 devstack@n-api.service[120391]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be6e70f9c0 pid: 120391 (default app) Feb 19 20:39:28.980203 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:39:28.980569 ncdv-master-1 devstack@n-api.service[120390]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be6e70f9c0 pid: 120390 (default app) Feb 19 20:39:28.981421 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-c9b68403-6c44-4bf7-a9c6-50bcb1ca5101 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001783 Feb 19 20:39:28.981830 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Sat Feb 19 20:39:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:40:51.525558 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:40:51.526807 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Feb 19 20:40:51.527200 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:40:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:40:51.974480 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3aa247e0-f4a8-454b-8b75-ff7e29be38fa admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:40:52.004790 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3aa247e0-f4a8-454b-8b75-ff7e29be38fa admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.471718 Feb 19 20:40:52.005710 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Feb 19 20:40:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:40:54.450721 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:40:54.451615 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-d2800b0d-f1bf-47a5-9192-0c3c837bb5a0 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Feb 19 20:40:54.452004 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 2/4] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:40:54.513989 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-97d9c680-69d3-49af-a64e-954be4031d63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "id": "c1"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:40:54.532589 ncdv-master-1 devstack@n-api.service[120391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:40:54.532589 ncdv-master-1 devstack@n-api.service[120391]: warnings.warn(msg) Feb 19 20:40:54.565186 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-97d9c680-69d3-49af-a64e-954be4031d63 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106081 Feb 19 20:40:54.566350 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 3/5] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:40:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:40:54.788598 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-5966661b-5f6e-4961-928c-d95326d6274a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:40:54.791049 ncdv-master-1 devstack@n-api.service[120390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:40:54.791049 ncdv-master-1 devstack@n-api.service[120390]: warnings.warn(msg) Feb 19 20:40:54.837231 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-5966661b-5f6e-4961-928c-d95326d6274a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262958 Feb 19 20:40:54.838094 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 3/6] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Feb 19 20:40:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:40:57.286235 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-97d9c680-69d3-49af-a64e-954be4031d63 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:40:57.287315 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-97d9c680-69d3-49af-a64e-954be4031d63 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Feb 19 20:40:57.287711 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 4/7] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:40:57.412321 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-a11180ab-c606-423d-a71b-6b4f84feeb79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "d1", "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:40:57.431842 ncdv-master-1 devstack@n-api.service[120390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:40:57.431842 ncdv-master-1 devstack@n-api.service[120390]: warnings.warn(msg) Feb 19 20:40:57.451813 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-a11180ab-c606-423d-a71b-6b4f84feeb79 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156192 Feb 19 20:40:57.452694 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 4/8] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:40:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 20:40:57.464528 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-60652560-aadb-45c0-923b-781edcfb427c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:40:57.465931 ncdv-master-1 devstack@n-api.service[120391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:40:57.465931 ncdv-master-1 devstack@n-api.service[120391]: warnings.warn(msg) Feb 19 20:40:57.501607 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-60652560-aadb-45c0-923b-781edcfb427c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040951 Feb 19 20:40:57.502203 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 5/9] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Feb 19 20:40:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:40:59.962307 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-a11180ab-c606-423d-a71b-6b4f84feeb79 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:40:59.964527 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-a11180ab-c606-423d-a71b-6b4f84feeb79 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Feb 19 20:40:59.965934 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:00.050673 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ab5b2bf7-244e-4851-a588-e7dee11b7acd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "name": "ds1G", "swap": 0, "ram": 1024}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:00.081311 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ab5b2bf7-244e-4851-a588-e7dee11b7acd admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.103824 Feb 19 20:41:00.094507 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-2091ceee-558c-42b5-9451-9849d8ddf487 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:00.101310 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 6/11] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:40:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:41:00.123385 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-2091ceee-558c-42b5-9451-9849d8ddf487 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032353 Feb 19 20:41:00.137292 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 6/12] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Feb 19 20:41:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:41:02.868279 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ab5b2bf7-244e-4851-a588-e7dee11b7acd admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:02.871527 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ab5b2bf7-244e-4851-a588-e7dee11b7acd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004015 Feb 19 20:41:02.872370 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 7/13] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:02.950015 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-eb7d816a-0b23-43c9-8886-7cfe046089eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:02.985087 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-eb7d816a-0b23-43c9-8886-7cfe046089eb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.102872 Feb 19 20:41:02.987391 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 7/14] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:41:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:41:02.999519 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-6f9371e5-dc0a-4231-bf0f-6bec264e933d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:03.039115 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-6f9371e5-dc0a-4231-bf0f-6bec264e933d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043070 Feb 19 20:41:03.040711 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 8/15] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Feb 19 20:41:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:41:05.597081 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-eb7d816a-0b23-43c9-8886-7cfe046089eb admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:05.598110 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-eb7d816a-0b23-43c9-8886-7cfe046089eb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Feb 19 20:41:05.598509 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 8/16] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:05.686734 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ef48fe74-3fec-4dc1-af7d-95e57e720e37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:05.707993 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ef48fe74-3fec-4dc1-af7d-95e57e720e37 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099771 Feb 19 20:41:05.708648 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 9/17] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:41:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:41:05.720782 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-cece6ac6-d06d-4972-988f-b554f9fc900c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:05.743880 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-cece6ac6-d06d-4972-988f-b554f9fc900c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026742 Feb 19 20:41:05.744526 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 9/18] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Feb 19 20:41:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:41:08.222513 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ef48fe74-3fec-4dc1-af7d-95e57e720e37 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:08.223516 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ef48fe74-3fec-4dc1-af7d-95e57e720e37 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Feb 19 20:41:08.223913 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 10/19] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:08.286716 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-b5ffe12a-8553-4b00-8974-6fc530738809 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:08.310649 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-b5ffe12a-8553-4b00-8974-6fc530738809 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080564 Feb 19 20:41:08.311365 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 10/20] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Feb 19 20:41:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:41:10.771418 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-ef48fe74-3fec-4dc1-af7d-95e57e720e37 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:10.773383 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-ef48fe74-3fec-4dc1-af7d-95e57e720e37 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Feb 19 20:41:10.773383 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 11/21] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:41:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:10.833171 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-998b496d-b4f2-453e-adc5-2a1281e30788 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "m1.tiny", "ram": 512, "disk": 1, "rxtx_factor": 1.0}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:10.852683 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-998b496d-b4f2-453e-adc5-2a1281e30788 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071504 Feb 19 20:41:10.853230 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 11/22] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:41:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 20:41:10.865561 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-428a16c5-1c09-44a3-97ee-05431918188d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:10.889166 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-428a16c5-1c09-44a3-97ee-05431918188d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027148 Feb 19 20:41:10.904367 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 12/23] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Feb 19 20:41:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:41:13.932007 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-998b496d-b4f2-453e-adc5-2a1281e30788 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:13.933374 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-998b496d-b4f2-453e-adc5-2a1281e30788 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001955 Feb 19 20:41:13.933916 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 12/24] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:41:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:13.995526 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-461f55e8-1954-4fdf-a4a4-b784ac15203a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "ram": 2048}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:14.014469 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-461f55e8-1954-4fdf-a4a4-b784ac15203a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073099 Feb 19 20:41:14.015045 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 13/25] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:41:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 20:41:14.027034 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-22dac8ae-56db-4e2c-9255-9b8b5054b5fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:14.053437 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-22dac8ae-56db-4e2c-9255-9b8b5054b5fa admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029904 Feb 19 20:41:14.054187 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 13/26] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Feb 19 20:41:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:41:16.580859 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-461f55e8-1954-4fdf-a4a4-b784ac15203a admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:16.581923 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-461f55e8-1954-4fdf-a4a4-b784ac15203a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Feb 19 20:41:16.582351 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 14/27] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:41:16.643538 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-15649963-0f4c-4a38-a2e0-3afff6b7a74c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:16.661420 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-15649963-0f4c-4a38-a2e0-3afff6b7a74c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071974 Feb 19 20:41:16.662045 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 14/28] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:41:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:41:16.674573 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f5eb7a06-24b2-4d58-9067-c248f4af8e24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:16.700716 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f5eb7a06-24b2-4d58-9067-c248f4af8e24 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029788 Feb 19 20:41:16.701644 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 15/29] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Feb 19 20:41:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:41:19.282733 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-15649963-0f4c-4a38-a2e0-3afff6b7a74c admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:19.283854 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-15649963-0f4c-4a38-a2e0-3afff6b7a74c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Feb 19 20:41:19.284383 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 15/30] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:41:19.343086 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-55bdca04-b8ed-424f-a026-e1a11c1d8224 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:19.360898 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-55bdca04-b8ed-424f-a026-e1a11c1d8224 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069363 Feb 19 20:41:19.361515 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 16/31] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:41:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:41:19.373399 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-157d43b6-09bf-4c34-8d81-6abeb7b792ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:19.396498 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-157d43b6-09bf-4c34-8d81-6abeb7b792ee admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027044 Feb 19 20:41:19.397025 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 16/32] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Feb 19 20:41:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:41:21.845128 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-55bdca04-b8ed-424f-a026-e1a11c1d8224 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:21.846796 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-55bdca04-b8ed-424f-a026-e1a11c1d8224 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002276 Feb 19 20:41:21.852837 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 17/33] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:41:21 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:21.912421 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-fbf8a9df-290e-4e2b-95c4-667bf41a4712 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "disk": 160, "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:21.930726 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-fbf8a9df-290e-4e2b-95c4-667bf41a4712 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075027 Feb 19 20:41:21.931501 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 17/34] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Feb 19 20:41:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:41:21.943110 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-9a2ffa22-2723-4320-8324-3e0849b3b88f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:21.968124 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-9a2ffa22-2723-4320-8324-3e0849b3b88f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028563 Feb 19 20:41:21.968728 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 18/35] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Feb 19 20:41:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:41:47.614353 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-fbf8a9df-290e-4e2b-95c4-667bf41a4712 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:47.615347 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-fbf8a9df-290e-4e2b-95c4-667bf41a4712 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Feb 19 20:41:47.615758 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 18/36] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:47.672646 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-e1515d4f-948c-4f15-9131-a3f5d52a04b1 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:47.689093 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-e1515d4f-948c-4f15-9131-a3f5d52a04b1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067472 Feb 19 20:41:47.689624 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 19/37] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Feb 19 20:41:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:41:49.170367 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-fbf8a9df-290e-4e2b-95c4-667bf41a4712 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:49.171353 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-fbf8a9df-290e-4e2b-95c4-667bf41a4712 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Feb 19 20:41:49.171744 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 19/38] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:41:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:49.419464 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-53700f31-a356-4d30-a848-54bbb305d14a admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:49.425234 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-53700f31-a356-4d30-a848-54bbb305d14a admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 19 20:41:49.425813 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-53700f31-a356-4d30-a848-54bbb305d14a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:41:49.426600 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-53700f31-a356-4d30-a848-54bbb305d14a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058110 Feb 19 20:41:49.427145 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 20/39] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:41:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:49.437030 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-e909f437-d409-4636-9d42-e74e7af0a701 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:49.458272 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-e909f437-d409-4636-9d42-e74e7af0a701 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024739 Feb 19 20:41:49.458807 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 20/40] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Feb 19 20:41:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:41:49.480581 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-14992d66-47eb-4f6c-9e08-21a274261df9 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:49.502553 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-14992d66-47eb-4f6c-9e08-21a274261df9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025442 Feb 19 20:41:49.503087 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 21/41] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Feb 19 20:41:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:41:49.512676 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-3565ce4c-5024-46d4-86c5-08c33267f98c admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:49.517993 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.wsgi [None req-3565ce4c-5024-46d4-86c5-08c33267f98c admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 19 20:41:49.518549 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-3565ce4c-5024-46d4-86c5-08c33267f98c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:41:49.519318 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-3565ce4c-5024-46d4-86c5-08c33267f98c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010850 Feb 19 20:41:49.519804 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 21/42] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:41:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:50.855329 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-14992d66-47eb-4f6c-9e08-21a274261df9 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:50.856377 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-14992d66-47eb-4f6c-9e08-21a274261df9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Feb 19 20:41:50.856774 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 22/43] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:51.051512 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-61950940-eda3-485f-91d7-779f07a5e409 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:51.057140 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.wsgi [None req-61950940-eda3-485f-91d7-779f07a5e409 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 19 20:41:51.057688 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-61950940-eda3-485f-91d7-779f07a5e409 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:41:51.058453 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-61950940-eda3-485f-91d7-779f07a5e409 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057338 Feb 19 20:41:51.058948 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 22/44] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:41:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:51.068031 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-31c8aa8f-8435-482e-85db-eb411b111a55 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:51.081265 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-31c8aa8f-8435-482e-85db-eb411b111a55 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016784 Feb 19 20:41:51.081789 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 23/45] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Feb 19 20:41:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:41:51.091322 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-c71d4660-7919-42f9-8880-21202c371673 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:51.106652 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-c71d4660-7919-42f9-8880-21202c371673 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019225 Feb 19 20:41:51.107175 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Feb 19 20:41:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:41:51.116144 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b1f7d326-c320-439e-afcc-7b77f9fcf4ab admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:51.121364 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-b1f7d326-c320-439e-afcc-7b77f9fcf4ab admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 19 20:41:51.121916 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-b1f7d326-c320-439e-afcc-7b77f9fcf4ab admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:41:51.122680 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-b1f7d326-c320-439e-afcc-7b77f9fcf4ab admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010008 Feb 19 20:41:51.123161 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 24/47] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:41:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:52.450200 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-c71d4660-7919-42f9-8880-21202c371673 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:52.451218 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-c71d4660-7919-42f9-8880-21202c371673 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Feb 19 20:41:52.451618 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 24/48] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:52.649481 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-81f366ed-23c5-49ae-9fd6-460a9378b07f admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:52.655221 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.wsgi [None req-81f366ed-23c5-49ae-9fd6-460a9378b07f admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 19 20:41:52.655766 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-81f366ed-23c5-49ae-9fd6-460a9378b07f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:41:52.656566 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-81f366ed-23c5-49ae-9fd6-460a9378b07f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058041 Feb 19 20:41:52.657071 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 25/49] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:41:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 19 20:41:52.666223 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-435504f6-7c5c-48af-811d-b8a33fd8726c admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:52.679969 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-435504f6-7c5c-48af-811d-b8a33fd8726c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017317 Feb 19 20:41:52.680517 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 25/50] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Feb 19 20:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:41:52.690248 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:52.703890 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017519 Feb 19 20:41:52.704448 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 26/51] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Feb 19 20:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:41:52.714280 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-747c32be-6e9b-4d21-a943-b659bf7eb77e admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:52.719483 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.wsgi [None req-747c32be-6e9b-4d21-a943-b659bf7eb77e admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 19 20:41:52.720031 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-747c32be-6e9b-4d21-a943-b659bf7eb77e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:41:52.720816 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-747c32be-6e9b-4d21-a943-b659bf7eb77e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010659 Feb 19 20:41:52.721300 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 26/52] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:41:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:41:54.043235 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:54.044224 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Feb 19 20:41:54.044643 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 27/53] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:54.239547 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-d137d989-01ec-45b7-92d9-2b9200787ff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:54.256644 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-d137d989-01ec-45b7-92d9-2b9200787ff6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067349 Feb 19 20:41:54.257170 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 27/54] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Feb 19 20:41:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:41:55.604407 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:55.605400 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002113 Feb 19 20:41:55.605801 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 28/55] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:41:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:55.804800 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-856fcd50-520f-4576-be90-ab95cc86de62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:55.821794 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-856fcd50-520f-4576-be90-ab95cc86de62 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069776 Feb 19 20:41:55.822848 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 28/56] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Feb 19 20:41:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:41:57.183435 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:57.184516 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Feb 19 20:41:57.184909 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 29/57] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:57.382303 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-56db94e2-8dfe-4a3e-94a0-7142f4fd33b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:57.401346 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-56db94e2-8dfe-4a3e-94a0-7142f4fd33b5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068720 Feb 19 20:41:57.401798 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 29/58] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Feb 19 20:41:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:41:58.773980 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:41:58.774977 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Feb 19 20:41:58.775396 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 30/59] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:41:58.970249 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-673df7c8-d4f9-4acd-9e49-2e47e17ffa78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:41:58.987822 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-673df7c8-d4f9-4acd-9e49-2e47e17ffa78 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068296 Feb 19 20:41:58.988383 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 30/60] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Feb 19 20:41:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:42:00.316170 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:42:00.317183 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Feb 19 20:42:00.317569 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 31/61] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:42:00.512145 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-8e3a7566-5f97-4c74-ae2c-6fcfd78568be admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:42:00.531247 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-8e3a7566-5f97-4c74-ae2c-6fcfd78568be admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069440 Feb 19 20:42:00.531707 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 31/62] 10.222.0.30 () {60 vars in 1202 bytes} [Sat Feb 19 20:42:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:42:53.048881 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:42:53.049868 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-979d6e87-6ca7-45a3-b23f-ca210e2ddac6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Feb 19 20:42:53.050263 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 32/63] 10.222.0.30 () {54 vars in 930 bytes} [Sat Feb 19 20:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:42:53.106712 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-2b96a8aa-47b7-4476-ac03-85bd0547d79b admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:42:53.125903 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-2b96a8aa-47b7-4476-ac03-85bd0547d79b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069745 Feb 19 20:42:53.126425 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 32/64] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Feb 19 20:42:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:42:53.148891 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-62326cbe-8a72-4520-ba78-66378dfeceba admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:42:53.156460 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-62326cbe-8a72-4520-ba78-66378dfeceba admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011745 Feb 19 20:42:53.156959 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 33/65] 10.222.0.30 () {60 vars in 1282 bytes} [Sat Feb 19 20:42:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:42:53.167751 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-b62ad0f9-d5ca-4a79-9aeb-06480f697d4f admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:42:53.175455 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-b62ad0f9-d5ca-4a79-9aeb-06480f697d4f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011135 Feb 19 20:42:53.175964 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 33/66] 10.222.0.30 () {60 vars in 1285 bytes} [Sat Feb 19 20:42:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:42:53.187012 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-880668dc-2b5d-44d6-8e8d-f5692ab1f05f admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:42:53.194399 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-880668dc-2b5d-44d6-8e8d-f5692ab1f05f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010705 Feb 19 20:42:53.194908 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 34/67] 10.222.0.30 () {60 vars in 1285 bytes} [Sat Feb 19 20:42:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:42:53.206291 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-d981fb5a-2b3d-4737-9db1-5526e08ce901 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:42:53.213659 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-d981fb5a-2b3d-4737-9db1-5526e08ce901 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010724 Feb 19 20:42:53.214164 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 34/68] 10.222.0.30 () {60 vars in 1282 bytes} [Sat Feb 19 20:42:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:44:34.646449 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-af3c2887-c3e7-4a45-88fc-47ef4bf20397 tempest-verify_tempest_config-1232162159 tempest-verify_tempest_config-1232162159-project] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:44:34.648673 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-af3c2887-c3e7-4a45-88fc-47ef4bf20397 tempest-verify_tempest_config-1232162159 tempest-verify_tempest_config-1232162159-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105245 Feb 19 20:44:34.649208 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 35/69] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Feb 19 20:44:34 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:48:38.960872 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-d981fb5a-2b3d-4737-9db1-5526e08ce901 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:48:38.961863 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-d981fb5a-2b3d-4737-9db1-5526e08ce901 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Feb 19 20:48:38.962253 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 35/70] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:48:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:48:39.226467 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-3fd15551-a9ee-45a8-8578-1d3499bf0d08 admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:48:39.227211 ncdv-master-1 devstack@n-api.service[120391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:48:39.227211 ncdv-master-1 devstack@n-api.service[120391]: warnings.warn(msg) Feb 19 20:48:39.228861 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3fd15551-a9ee-45a8-8578-1d3499bf0d08 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:48:39.229278 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3fd15551-a9ee-45a8-8578-1d3499bf0d08 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:48:39.230067 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3fd15551-a9ee-45a8-8578-1d3499bf0d08 admin admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:48:39.230491 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-3fd15551-a9ee-45a8-8578-1d3499bf0d08 admin admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:48:39.278468 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-3fd15551-a9ee-45a8-8578-1d3499bf0d08 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.168378 Feb 19 20:48:39.279384 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 36/71] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:48:39 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:48:40.617488 ncdv-master-1 devstack@n-api.service[120390]: DEBUG nova.api.openstack.wsgi [None req-d981fb5a-2b3d-4737-9db1-5526e08ce901 admin admin] Calling method '>' {{(pid=120390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:48:40.618515 ncdv-master-1 devstack@n-api.service[120390]: INFO nova.api.openstack.requestlog [None req-d981fb5a-2b3d-4737-9db1-5526e08ce901 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Feb 19 20:48:40.618938 ncdv-master-1 devstack@n-api.service[120390]: [pid: 120390|app: 0|req: 36/72] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Feb 19 20:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:48:40.815604 ncdv-master-1 devstack@n-api.service[120391]: DEBUG nova.api.openstack.wsgi [None req-f6b7ddf5-2007-434d-a54b-992fd910e0fc admin admin] Calling method '>' {{(pid=120391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:48:40.816798 ncdv-master-1 devstack@n-api.service[120391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:48:40.816798 ncdv-master-1 devstack@n-api.service[120391]: warnings.warn(msg) Feb 19 20:48:40.819080 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6b7ddf5-2007-434d-a54b-992fd910e0fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:48:40.819524 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6b7ddf5-2007-434d-a54b-992fd910e0fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:48:40.820370 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6b7ddf5-2007-434d-a54b-992fd910e0fc admin admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:48:40.820804 ncdv-master-1 devstack@n-api.service[120391]: DEBUG oslo_concurrency.lockutils [None req-f6b7ddf5-2007-434d-a54b-992fd910e0fc admin admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:48:40.842644 ncdv-master-1 devstack@n-api.service[120391]: INFO nova.api.openstack.requestlog [None req-f6b7ddf5-2007-434d-a54b-992fd910e0fc admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.077118 Feb 19 20:48:40.843122 ncdv-master-1 devstack@n-api.service[120391]: [pid: 120391|app: 0|req: 37/73] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:48:40 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:49:28.965686 ncdv-master-1 devstack@n-api.service[120387]: Sat Feb 19 20:49:28 2022 - graceful shutdown triggered... Feb 19 20:49:28.966212 ncdv-master-1 devstack@n-api.service[120390]: Gracefully killing worker 1 (pid: 120390)... Feb 19 20:49:28.965759 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Feb 19 20:49:28.967100 ncdv-master-1 devstack@n-api.service[120391]: Gracefully killing worker 2 (pid: 120391)... Feb 19 20:49:29.966810 ncdv-master-1 devstack@n-api.service[120387]: worker 1 buried after 1 seconds Feb 19 20:49:29.966810 ncdv-master-1 devstack@n-api.service[120387]: worker 2 buried after 1 seconds Feb 19 20:49:29.966810 ncdv-master-1 devstack@n-api.service[120387]: goodbye to uWSGI. Feb 19 20:49:29.968390 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Feb 19 20:49:29.969026 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Feb 19 20:49:29.971816 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Feb 19 20:49:30.013238 ncdv-master-1 devstack@n-api.service[136083]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 19 20:49:30.029566 ncdv-master-1 devstack@n-api.service[136083]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Feb 19 20:49:30 2022] *** Feb 19 20:49:30.030182 ncdv-master-1 devstack@n-api.service[136083]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 19 20:49:30.030326 ncdv-master-1 devstack@n-api.service[136083]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 19 20:49:30.030442 ncdv-master-1 devstack@n-api.service[136083]: nodename: ncdv-master-1 Feb 19 20:49:30.030551 ncdv-master-1 devstack@n-api.service[136083]: machine: x86_64 Feb 19 20:49:30.030668 ncdv-master-1 devstack@n-api.service[136083]: clock source: unix Feb 19 20:49:30.030777 ncdv-master-1 devstack@n-api.service[136083]: pcre jit disabled Feb 19 20:49:30.030908 ncdv-master-1 devstack@n-api.service[136083]: detected number of CPU cores: 4 Feb 19 20:49:30.031017 ncdv-master-1 devstack@n-api.service[136083]: current working directory: / Feb 19 20:49:30.031126 ncdv-master-1 devstack@n-api.service[136083]: detected binary path: /usr/bin/uwsgi-core Feb 19 20:49:30.031303 ncdv-master-1 devstack@n-api.service[136083]: your processes number limit is 47680 Feb 19 20:49:30.031480 ncdv-master-1 devstack@n-api.service[136083]: your memory page size is 4096 bytes Feb 19 20:49:30.031645 ncdv-master-1 devstack@n-api.service[136083]: detected max file descriptor number: 2048 Feb 19 20:49:30.031816 ncdv-master-1 devstack@n-api.service[136083]: lock engine: pthread robust mutexes Feb 19 20:49:30.032174 ncdv-master-1 devstack@n-api.service[136083]: thunder lock: enabled Feb 19 20:49:30.032433 ncdv-master-1 devstack@n-api.service[136083]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 19 20:49:30.032534 ncdv-master-1 devstack@n-api.service[136083]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 19 20:49:30.082109 ncdv-master-1 devstack@n-api.service[136083]: Python main interpreter initialized at 0x558e822f69c0 Feb 19 20:49:30.082109 ncdv-master-1 devstack@n-api.service[136083]: python threads support enabled Feb 19 20:49:30.082109 ncdv-master-1 devstack@n-api.service[136083]: your server socket listen backlog is limited to 100 connections Feb 19 20:49:30.082109 ncdv-master-1 devstack@n-api.service[136083]: your mercy for graceful operations on workers is 90 seconds Feb 19 20:49:30.082538 ncdv-master-1 devstack@n-api.service[136083]: mapped 403077 bytes (393 KB) for 2 cores Feb 19 20:49:30.082538 ncdv-master-1 devstack@n-api.service[136083]: *** Operational MODE: preforking *** Feb 19 20:49:30.082757 ncdv-master-1 devstack@n-api.service[136083]: *** uWSGI is running in multiple interpreter mode *** Feb 19 20:49:30.082757 ncdv-master-1 devstack@n-api.service[136083]: spawned uWSGI master process (pid: 136083) Feb 19 20:49:30.082959 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Feb 19 20:49:30.086061 ncdv-master-1 devstack@n-api.service[136083]: spawned uWSGI worker 1 (pid: 136094, cores: 1) Feb 19 20:49:30.086061 ncdv-master-1 devstack@n-api.service[136083]: spawned uWSGI worker 2 (pid: 136095, cores: 1) Feb 19 20:49:30.086061 ncdv-master-1 devstack@n-api.service[136083]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 19 20:49:32.088874 ncdv-master-1 devstack@n-api.service[136095]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:49:32.088874 ncdv-master-1 devstack@n-api.service[136095]: from cryptography.utils import int_from_bytes Feb 19 20:49:32.089610 ncdv-master-1 devstack@n-api.service[136095]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:49:32.089610 ncdv-master-1 devstack@n-api.service[136095]: from cryptography.utils import int_from_bytes Feb 19 20:49:32.122882 ncdv-master-1 devstack@n-api.service[136094]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:49:32.122882 ncdv-master-1 devstack@n-api.service[136094]: from cryptography.utils import int_from_bytes Feb 19 20:49:32.123485 ncdv-master-1 devstack@n-api.service[136094]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 20:49:32.123485 ncdv-master-1 devstack@n-api.service[136094]: from cryptography.utils import int_from_bytes Feb 19 20:49:34.483806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 19 20:49:34.484379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 19 20:49:34.484518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 19 20:49:34.484886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 19 20:49:34.485145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 19 20:49:34.485536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.485868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.486195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.486519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.486854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.487174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.487494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.487816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.488150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.488438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.488758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.489094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.489424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.489738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.490054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.490377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.490684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.491010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.491319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.491828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.492278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.492647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.492973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.493316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.493622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.493940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.494271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.494581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.494912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.495228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.495644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.495968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.496288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.496641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.497058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.497379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.497696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.498024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.498356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.498672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.499014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.499341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.499669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.499997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.500305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.500717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.501034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.501363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.501677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.501991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.502248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.502564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.502898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.503230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.503555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.503816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.504072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.504427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.504760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.505070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.505391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.505705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.506020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.506333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.506647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.506959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.507272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.507598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.507920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.508275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.508620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.508949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.509357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.509615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.509933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.510279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.510609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.510923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.511250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.511579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.511893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.512208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.512548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.512877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.513219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.513533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.513791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.514099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.514413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.514738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.515053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.515368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.515682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.515990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.516304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.516643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.516957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.517268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.517581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.517891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.518203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.518513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.518825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.519186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.519481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.519797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.520112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.520448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.520766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.521096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.521410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.521724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.522053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.522367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.522678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.523004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.523319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.523647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.524494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.524802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.525118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.525443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.525757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.526071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.526381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.526693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.527003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.527312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.527621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.527936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.528241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.528592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.528922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.529238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.529557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.529869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.530197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.530541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.530880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.531231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.531553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.531907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.532235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.532588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.532909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.533233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.533569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.533890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.534209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.534555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.534887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.535211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.535554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.535880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.536206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.536560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.536883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.537210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.537547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.537877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.538207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.538548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.538899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.539222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.540158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.540514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.540841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.541160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.541479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.541812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.542290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.542462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.542789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.543110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.543432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.543751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.544074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.544415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.544763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.545085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.545408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.545727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.546054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.546375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.546697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.547019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.547332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.547646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.547957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.548279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.548619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.548947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.549286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.549609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.549948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.550263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.550582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.551153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.551469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.551780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.552101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.552445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.552758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.553091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.553411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.553725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.554055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.554371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.554681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.555004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.555349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.555669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.555992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.556308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.556664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.556860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 19 20:49:34.557293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.557399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 19 20:49:34.557493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.557619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.557716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 19 20:49:34.557957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.558050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 19 20:49:34.558237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 19 20:49:34.558327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.558588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.558697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.558923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.559021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.559246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.559351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.559562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.559668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.559881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.559980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.560193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.560284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.560539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.560718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.560853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.560944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.561176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.561362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.561527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.561687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.561837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.561992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.562138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.562282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.562454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.562601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.562754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.562910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.563069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.563229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.563385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.563531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.563684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.563830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.563975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.564119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.564408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.564585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.564733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.564879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.565162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.565324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.565479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.565625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.565769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.565923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.566082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.566267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.566439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.566594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.566740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.566884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.567038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.567216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.567368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.567513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.567658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.567803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.567948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.568108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.568272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.568272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.568589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.568845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.569009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.569156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.569308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.569453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.569606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.569766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.569921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.570076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.570222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.570377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.570522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.571176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.571329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.571475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.571627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.571773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.571925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.572085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.572231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.572408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.572642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.572800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.572972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.573135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.573294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.573441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.573585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.573738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.573892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.574046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.574199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.574373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.574589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.574750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.574896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.575060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.575300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.575463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.575609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.575754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.575898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.576052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.576205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.576371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.576524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.576671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.576816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.576987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.577133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.577279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.577425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.577573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.577732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.577887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.578041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.578195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.578348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.578492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.578647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.578803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.579064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.579230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.579399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.579558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.579719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.579874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.580026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.580183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.580347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.580518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.580676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.580822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.580987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.581141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.581286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.581440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.581585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.581730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.581882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.582035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.582183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.582343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.582489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.582634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.582800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.582956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.583128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.583292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.583438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.583592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.583745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.583891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.584045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.584263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.584452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.584631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.584810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.584977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.585136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.585308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.585460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.585613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.585766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.585921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.586075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.586221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.586973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.587138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.587285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.587438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.587606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.587752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.587897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.588050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.588204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.588466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.588630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.588784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.588940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.589112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.589349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.589510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.589673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.589849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.590045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.590205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.590365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.590527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.590679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.590837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.590990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.591142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.591304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.591471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.591631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.591794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.591969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.592122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.592283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.592477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.592640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.592805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.592967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.593119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.593298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.593453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.593606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.593765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.593929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.594089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.594251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.594444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.594612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.594772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.594925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.595084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.595245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.595409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.595569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.595731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.595889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.595889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.596204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.596420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.596598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.596752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.596914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.597074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.597234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.597395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.597566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.597720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.597871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.598031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.598194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.598362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.598516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.598668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.598820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.598979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.599131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.599297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.599567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.599737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.599900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.600063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.600236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.600421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.600590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.600742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.600894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.601054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.601214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.601376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.601529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.601681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.601845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.602005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.602164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.602332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.602493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.602654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.602816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.602975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.603127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.603298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.603459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.603617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.603783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.603981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 19 20:49:34.604143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.604302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.604508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.604663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.604831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.604991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.605143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.605309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.605471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.605634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.605798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.605798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.606096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.606096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.606401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.606581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.606734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.606895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.607055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.607215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.607368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.607530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.607696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.607849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.608009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.608169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.608382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.608565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.608726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.608878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.609030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.609030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.609328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.609481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.609744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.609904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.610066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.610226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.610391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.610545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.610718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.610878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.611030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.611191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.611357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.611517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.611678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.611838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.611990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.612153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.612313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.612508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.612661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.612831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.612993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.613244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.613405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.613565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.613726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.613886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.614038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.614204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.614364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.614517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.614676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.614847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.615008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.615171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.615324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.615475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.615475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.615772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.615933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.616085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.616237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.616424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.616594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.616759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.616931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.617084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.617244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.617404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.617565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.617718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.617879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.618031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.618182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.618333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.618485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.618644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.618805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.618967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.619120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.619279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.619433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.619597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.619776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.620019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.620184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.620361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.620533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.620701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.620854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.621013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.621178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.621338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.621498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.621661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.621821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.621973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.622133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.622286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.622438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.622604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.622757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.622909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.623061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.623240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.623403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.623565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.623727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.623879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.624030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.624190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.624405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.624577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.624738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.624898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.625051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.625219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.625379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.625539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.625691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.625852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.626011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.626172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.626334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.626494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.626646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.626799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.626958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.627124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.627288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.627447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.627599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.627757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.627911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.628071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.628224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.628408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.628567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.628719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.628872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.629037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.629191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.629354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.629506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.629656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.629817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.629990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.630259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.630418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.630578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.630578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.630887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.631040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.631191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.631191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.631498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.631657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.631822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.631983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.632150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.632302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.632512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.632677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.632844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.633004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.633172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.633815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.633981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.634134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.634352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.634521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.634683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.634834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.634994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.635154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.635321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.635473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.635632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.635792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.635952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.636127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.636289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.636480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.636635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.636793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.636945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.637111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.637265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.637417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.637576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.637728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.637879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.638040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.638203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.638363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.638516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.638676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.638835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.638997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.639149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.639149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.639446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.639598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.639758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.639910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.640070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.640252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.640512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.640671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.640840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.640840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.641151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.641312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.641474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.641627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.641788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.641949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.642116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.642280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.642432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.642585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.642749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.642909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.643069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.643230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.643384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.643626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.643789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.643942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.644102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.644264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.644473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.644641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.644794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.644945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.645097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.645256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.645416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.645577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.645731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.645883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.646925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.647986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.648085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.648166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.648258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.648378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.648500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.648594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.648686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.648770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.649437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.649543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.649630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.649713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.649795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.649876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.649958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.650992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.651087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.651087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.651249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.651332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.651421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.651561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.651664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.651833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.652005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.652170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.652323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.652523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.652677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.652839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.653001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.653162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.653354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.653519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.653683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.653843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.654004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.654158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.654309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.654470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.654631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.654783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.654934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.655086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.655254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.655407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.655558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.655735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.655901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.656055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.656216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.656416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.656576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.656728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.656879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.657038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.657200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.657362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.657515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.657681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.657834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.657985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.658167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.658326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.658478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.658629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.658780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.658949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.659110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.659269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.659422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.659573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.659736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.659897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.660049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.660273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.660539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.660809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.660970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.661133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.661286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.661439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.661599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.661760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.661913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.662091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.662245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.662396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.662549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.662822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.662986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.663141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.663301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.663455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.663637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.663799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.663799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.664136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.664298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.664298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.664657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.664813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.664980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.665142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.665302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.665302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.665628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.665795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.665960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.666113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.666285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.666438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.666597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.666759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.666912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.667073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.667073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.667381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.667535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.667695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.667856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.668008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.668167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.668399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.668571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.668736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.668889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.669049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.669202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.669440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.669594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.669746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.669899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.670061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.670240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.670396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.670561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.670714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.671072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.671296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.671464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.671628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.671807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.671963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.672123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.672123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.672458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.672458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.672762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.672915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.673075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.673228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.673389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.673550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.673702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.673861 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.674022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.674184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.674345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.674497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.674649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.674812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.674963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.675124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.675284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.675437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.675603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.676021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.676179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.676389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.676551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.676715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.676868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.677021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.677193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.677359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.677520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.677673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.677824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.677985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.678146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.678307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.678459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.678617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.678778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.678937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.679117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.679279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.679473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.679678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.679833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.679985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.680178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.680354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.680526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.680701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.680924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.681213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.681376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.681557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.681712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.681865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.681865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.682176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.682338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.682491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.682650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.682810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.682978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.683141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.683293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.683464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.683617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.683768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.683933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.684085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.684236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.684474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.684645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.684798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.684997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.685164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.685317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.685489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.685651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.685823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.685997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.686160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.686321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.686474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.686640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.686801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.686967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.687121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.687280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.687433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.687635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.687815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.687973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.688167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.688375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.688558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.688714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.688875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.689028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.689188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.689348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.689510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.689664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.689829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.689981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.690159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.690366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.690533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.690687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.690848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.691001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.691001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.691314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.691482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.691637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.691801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.691953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.692113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.692376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.692556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.692711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.692873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.693027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.693180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.693376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.693541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.693704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.693865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.694031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.694184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.694347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.694501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.694501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.694791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.694791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.695111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.695279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.695441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.695595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.696282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.696766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.696960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.697590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.698592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.698592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.698592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.699051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.699211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.699520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.699847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.700166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.701189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.701809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.702108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.702281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.702490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.702660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.702839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.702994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.703153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.703315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.703503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.703663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.703852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.704048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.704201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.704405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.704567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.704776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.704946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.705106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.705260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.705427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.705599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.705753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.705906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.706057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.706218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.706400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.706555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.706707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.706874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.707041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.707205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.707367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.707520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.707679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.707843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.707996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.708158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.708311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.708506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.708662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.708813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.708966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.709146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.709300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.710937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.711020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.711235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.711350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.712191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.712296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.712535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.712640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.712876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.712980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.713180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.713310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.713503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.713697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.713869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.714026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.714190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.714354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.714562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.714721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.714883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.715049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.715212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.715373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.715526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.715690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.715864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.716026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.716188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.716457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.716633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.716796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.716950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.717102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.717269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.717422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.717422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.717729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.717889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.718063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.718225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.718378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.718529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.718690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.718842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.719008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.719161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.719322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.719484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.719645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.719797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.719959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.720123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.720275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.720453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.720618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.720793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.721001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.721167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.721320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.721472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.721624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.721791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.721945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.722129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.722503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.722660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.722813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.722976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.723160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.723324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.723487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.723662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.723827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.723990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.724152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.724314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.724515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.724677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.724845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.724845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.725140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.725292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.725445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.725597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.725761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.725914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.726067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.726226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.726391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.726543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.726706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.726859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.727051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.727208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.727361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.727361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.727670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.727824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.727979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.728132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.728300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.728601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.728760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.728914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.729067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.729235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.729395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.729569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.729723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.729875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.730028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.730180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.730332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.730506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.730667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.730828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.730982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.731134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.731301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.731301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.731602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.731763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.731916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.732068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.732230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.732573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.732749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.732876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.732997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.733110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.733212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.733318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.733406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.733489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.733581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.733792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.733970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.734110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.734235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.734447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.734532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.734771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.734905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.735110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.735450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.735653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.735825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.736065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.736224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.736405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.736581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.736752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.736916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.737084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.737238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.737391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.737551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.737704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.737865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.738039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.738200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.738361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.738523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.738676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.738854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.739019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.739173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.739326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.739479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.739640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.739807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.739979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.740145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.740306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.740484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.740639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.740820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.740975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.741129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.741281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.741433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.741595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.741749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.741915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.742076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.742238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.742392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.742761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.742925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.743090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.743270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.743441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.743596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.743797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.743965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.744143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.744303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.744539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.744710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.744873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.745026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.745211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.745371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.745532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.745695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.745856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.746009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.746169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.746331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.746484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.746645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.746808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.746969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.747122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.747285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.747454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.747636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.747790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.747790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.748108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.748261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.748450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.748615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.748777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.748941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.749095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.749247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 19 20:49:34.749442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.749442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.749745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.749922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.750226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.750554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.750875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.751200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.751528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.751856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.752555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.752934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.753221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.753547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.754210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.754400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.754848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.755067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.755391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.755829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.756158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.756710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.757055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.757440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.757794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.758131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.758987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.759315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.759643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.760015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.760366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.760688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.761016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.761342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.761669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.761996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.762320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.762644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.762980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.763296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.763616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.763957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.764266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.764646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.764991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.765325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.765650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.765973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.766299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.767158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.767621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.767929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.768177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.768538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.768872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.769203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.769545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.769863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.770179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.770501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.770821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.771138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.771473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.771796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.771931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_db.sqlalchemy.engines [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:49:34.772110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.772473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.772793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.773360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.773723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.774607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.774952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.775293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.775621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.775943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.776278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.776628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.776946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.777273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.777594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.777909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.778225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.778547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.778869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.779199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.779702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.780076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.780442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.780762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.781079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.781396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.781720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.782037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.782352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.782665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.782980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.783340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.783613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.783933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.784248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.784764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.785083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.785394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.785756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.786097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.786415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.786742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.787071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.787473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.787810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.788134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.788486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.788848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.789175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.789769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.790121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.790455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.790796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.791138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.791454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.791769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.792082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.792440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.792768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.793087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.793414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.793737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.794059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.794383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.794711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.795035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.795355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.795677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.795998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.796320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.796709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.797044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.797375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.797701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.798031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.798352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.798681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.798994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.799315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.799643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.799985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.800307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.800644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.801335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.801663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.801995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.802327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.802648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.802982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.803315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.803639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.804057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.804294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.804681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.805018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.805384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.805716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.806034 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.806349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.806670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.806991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.807332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.807676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.808003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.808353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.808699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.809035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.809360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.809855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.810245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.810651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.810896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.811238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.811727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.812216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.812575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.812902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.813226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.813615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.813896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.814238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.814557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.814964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.815224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.815557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.815886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.816212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.816591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.816918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.817241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.817570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.817894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.818218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.818547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.818877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.819215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.819553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.819892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.820233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.820620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.821470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.821831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.822173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.822498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.822826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.823142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 19 20:49:34.823395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 19 20:49:34.840839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.context [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) {{(pid=136095) load_cells /opt/stack/nova/nova/context.py:464}} Feb 19 20:49:34.845325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:49:34.846214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_db.sqlalchemy.engines [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:49:34.846838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:49:34.847662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:49:34.849662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:49:34.862293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_db.sqlalchemy.engines [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:49:34.863722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_db.sqlalchemy.engines [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:49:34.913701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.context [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) {{(pid=136094) load_cells /opt/stack/nova/nova/context.py:464}} Feb 19 20:49:34.918080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:49:34.919695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:49:34.920552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:49:34.922542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:49:34.934281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_db.sqlalchemy.engines [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:49:34.936562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_db.sqlalchemy.engines [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:49:35.030763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_db.sqlalchemy.engines [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:49:35.100241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_db.sqlalchemy.engines [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 19 20:49:35.354765 ncdv-master-1 devstack@n-api.service[136095]: WARNING keystonemiddleware.auth_token [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 20:49:35.426696 ncdv-master-1 devstack@n-api.service[136094]: WARNING keystonemiddleware.auth_token [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 20:49:35.433973 ncdv-master-1 devstack@n-api.service[136094]: WARNING keystonemiddleware.auth_token [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 20:49:35.474519 ncdv-master-1 devstack@n-api.service[136095]: WARNING keystonemiddleware.auth_token [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 20:49:35.702855 ncdv-master-1 devstack@n-api.service[136095]: WARNING keystonemiddleware.auth_token [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 20:49:35.708020 ncdv-master-1 devstack@n-api.service[136095]: WARNING keystonemiddleware.auth_token [None req-f6eb2b3e-c475-4975-9abd-205e2c8e9c0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 20:49:35.713411 ncdv-master-1 devstack@n-api.service[136095]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558e822f69c0 pid: 136095 (default app) Feb 19 20:49:35.773250 ncdv-master-1 devstack@n-api.service[136094]: WARNING keystonemiddleware.auth_token [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 20:49:35.778433 ncdv-master-1 devstack@n-api.service[136094]: WARNING keystonemiddleware.auth_token [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 20:49:35.783837 ncdv-master-1 devstack@n-api.service[136094]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558e822f69c0 pid: 136094 (default app) Feb 19 20:50:16.749175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:16.750481 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fb4b2bb1-e8e9-40d3-acff-9aeaf9c73c1d None None] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002679 Feb 19 20:50:16.751024 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1/1] 10.222.0.30 () {56 vars in 885 bytes} [Sat Feb 19 20:50:16 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Feb 19 20:50:17.317539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6cf7073d-b252-4155-95f3-1e8bed0fe2ce tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:17.319720 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:17.319720 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:17.321426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6cf7073d-b252-4155-95f3-1e8bed0fe2ce tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:17.321868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6cf7073d-b252-4155-95f3-1e8bed0fe2ce tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:17.322680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6cf7073d-b252-4155-95f3-1e8bed0fe2ce tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:17.323125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6cf7073d-b252-4155-95f3-1e8bed0fe2ce tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:17.364097 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6cf7073d-b252-4155-95f3-1e8bed0fe2ce tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.233861 Feb 19 20:50:17.364762 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1/2] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Feb 19 20:50:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:17.604785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57878bc8-2ef2-466c-bb8b-934f1fd4a963 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-161313021"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:17.616647 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:17.616647 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:17.618051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-57878bc8-2ef2-466c-bb8b-934f1fd4a963 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Generated uuid 7e9aeed2-eee2-46b3-a5b5-587ad96de82c for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:50:17.684033 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-57878bc8-2ef2-466c-bb8b-934f1fd4a963 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.309871 Feb 19 20:50:17.688473 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:50:17 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:50:17.696202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e2320216-c394-4cd3-9b38-f6d5c1f1a15f tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:17.697706 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:17.697706 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:17.714038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2320216-c394-4cd3-9b38-f6d5c1f1a15f tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:17.714489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2320216-c394-4cd3-9b38-f6d5c1f1a15f tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:18.047792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58b9be44-d7bf-4073-9716-7ca13d22e226 tempest-AZAdminNegativeTestJSON-521487062 tempest-AZAdminNegativeTestJSON-521487062-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:18.048730 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:18.048730 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:18.050372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-58b9be44-d7bf-4073-9716-7ca13d22e226 tempest-AZAdminNegativeTestJSON-521487062 tempest-AZAdminNegativeTestJSON-521487062-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c303f360668549d59b1ddc4ff675a67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce978d1edb7495f8cd3a785438db7cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:18.052473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58b9be44-d7bf-4073-9716-7ca13d22e226 tempest-AZAdminNegativeTestJSON-521487062 tempest-AZAdminNegativeTestJSON-521487062-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:18.053512 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-58b9be44-d7bf-4073-9716-7ca13d22e226 tempest-AZAdminNegativeTestJSON-521487062 tempest-AZAdminNegativeTestJSON-521487062-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.545733 Feb 19 20:50:18.054629 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Feb 19 20:50:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 547 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:50:18.419378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Calling method '.version_select at 0x7f64762a1a60>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:18.421390 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:18.421390 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:18.429061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) {{(pid=136095) load_cells /opt/stack/nova/nova/compute/api.py:304}} Feb 19 20:50:18.430561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:18.431238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:18.455979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:18.456451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:18.494580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:18.495031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:18.506891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:18.507667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:18.520927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:18.521590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:18.528660 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4bfb7961-349d-45ad-b04c-2e1821dbe42d tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.472638 Feb 19 20:50:18.529497 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3/5] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Feb 19 20:50:18 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:50:18.757307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e2320216-c394-4cd3-9b38-f6d5c1f1a15f tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 1.066258 Feb 19 20:50:18.758730 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3/6] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:50:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:18.775715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8df7303a-6090-41bf-ba98-461b0d889c09 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Calling method '.version_select at 0x7f647628bf70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:18.777177 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:18.777177 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:18.778673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8df7303a-6090-41bf-ba98-461b0d889c09 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:18.779109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8df7303a-6090-41bf-ba98-461b0d889c09 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:18.793284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8df7303a-6090-41bf-ba98-461b0d889c09 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:18.793731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8df7303a-6090-41bf-ba98-461b0d889c09 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:18.803912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8df7303a-6090-41bf-ba98-461b0d889c09 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:18.804907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8df7303a-6090-41bf-ba98-461b0d889c09 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:18.816607 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8df7303a-6090-41bf-ba98-461b0d889c09 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.285850 Feb 19 20:50:18.817325 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 4/7] 10.222.0.30 () {60 vars in 1207 bytes} [Sat Feb 19 20:50:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:50:19.039454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-569c1d2d-6fd6-4113-9835-a2068e546500 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-124426959", "id": 1267026774, "os-flavor-access:is_public": "True"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:19.058797 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.058797 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:19.097389 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-569c1d2d-6fd6-4113-9835-a2068e546500 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.278806 Feb 19 20:50:19.098203 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 5/8] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:18 2022] POST /compute/v2.1/flavors => generated 429 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:19.140982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8a6c5c66-2338-4cd2-9de0-8de944d30789 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Calling method '.version_select at 0x7f6474a4e430>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.142150 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.142150 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:19.155729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8a6c5c66-2338-4cd2-9de0-8de944d30789 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) {{(pid=136094) load_cells /opt/stack/nova/nova/compute/api.py:304}} Feb 19 20:50:19.156931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a6c5c66-2338-4cd2-9de0-8de944d30789 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.158423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a6c5c66-2338-4cd2-9de0-8de944d30789 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.182900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a6c5c66-2338-4cd2-9de0-8de944d30789 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.183350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a6c5c66-2338-4cd2-9de0-8de944d30789 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.203632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a6c5c66-2338-4cd2-9de0-8de944d30789 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.204882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a6c5c66-2338-4cd2-9de0-8de944d30789 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.212532 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8a6c5c66-2338-4cd2-9de0-8de944d30789 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.452232 Feb 19 20:50:19.213573 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 4/9] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Feb 19 20:50:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:19.219782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Calling method '.version_select at 0x7f6474a4e550>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.221549 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.221549 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:19.224649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.225637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.248638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.249090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.275791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a04e1315-d5df-4709-ba00-3acd2e405523 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '.version_select at 0x7f6476952940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.276794 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.276794 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:19.278620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a04e1315-d5df-4709-ba00-3acd2e405523 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.279217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a04e1315-d5df-4709-ba00-3acd2e405523 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.293281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.293730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.303510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a04e1315-d5df-4709-ba00-3acd2e405523 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.303940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.304442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.306279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a04e1315-d5df-4709-ba00-3acd2e405523 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.317436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.317866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.319447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a04e1315-d5df-4709-ba00-3acd2e405523 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.320217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a04e1315-d5df-4709-ba00-3acd2e405523 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.325471 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ac10428f-7346-4f85-9d7b-b655539bc884 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.110421 Feb 19 20:50:19.326246 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 5/10] 10.222.0.30 () {60 vars in 1221 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:19.327619 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a04e1315-d5df-4709-ba00-3acd2e405523 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.228244 Feb 19 20:50:19.337031 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:19.337031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-290586c0-ecce-44eb-95a6-3575ff636b97 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.337031 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.337031 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:19.337887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0d95f1ea-9e5c-4416-b35a-065fa4b96aec tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:19.339156 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.339156 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:19.348835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d95f1ea-9e5c-4416-b35a-065fa4b96aec tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.349496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d95f1ea-9e5c-4416-b35a-065fa4b96aec tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.380290 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-290586c0-ecce-44eb-95a6-3575ff636b97 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1267026774" status: 202 len: 0 microversion: 2.1 time: 0.050594 Feb 19 20:50:19.386464 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 7/12] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:19 2022] DELETE /compute/v2.1/flavors/1267026774 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:19.389400 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0d95f1ea-9e5c-4416-b35a-065fa4b96aec tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] HTTP exception thrown: Aggregate 1 already has host nch1-master-1. Feb 19 20:50:19.390026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0d95f1ea-9e5c-4416-b35a-065fa4b96aec tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Returning 409 to user: Aggregate 1 already has host nch1-master-1. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:19.390854 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0d95f1ea-9e5c-4416-b35a-065fa4b96aec tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.057863 Feb 19 20:50:19.391474 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 6/13] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:50:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Feb 19 20:50:19.391915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9cd4b2d0-af27-4bb8-97dc-6bcac3f35a04 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Calling method '.version_select at 0x7f64762563a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.393321 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.393321 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:19.397494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cd4b2d0-af27-4bb8-97dc-6bcac3f35a04 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.397975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cd4b2d0-af27-4bb8-97dc-6bcac3f35a04 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.398077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eb7fcea4-901e-4689-941a-c14e2248f698 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Calling method '.version_select at 0x7f64749689d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.399767 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.399767 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:19.402085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb7fcea4-901e-4689-941a-c14e2248f698 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.402735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb7fcea4-901e-4689-941a-c14e2248f698 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.424981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb7fcea4-901e-4689-941a-c14e2248f698 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.425441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cd4b2d0-af27-4bb8-97dc-6bcac3f35a04 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.426016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb7fcea4-901e-4689-941a-c14e2248f698 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.427200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cd4b2d0-af27-4bb8-97dc-6bcac3f35a04 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.436109 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eb7fcea4-901e-4689-941a-c14e2248f698 tempest-HypervisorAdminV253TestBase-833198098 tempest-HypervisorAdminV253TestBase-833198098-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/97583fca-f4b2-4bb7-b2cb-4e8a24a3ec96" status: 200 len: 791 microversion: 2.53 time: 0.040743 Feb 19 20:50:19.436109 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 7/14] 10.222.0.30 () {60 vars in 1297 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/os-hypervisors/97583fca-f4b2-4bb7-b2cb-4e8a24a3ec96 => generated 791 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:19.440080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2fabf87-d17a-4659-8923-cb5a4317431d tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.446958 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9cd4b2d0-af27-4bb8-97dc-6bcac3f35a04 tempest-HypervisorAdminV228Test-1382103462 tempest-HypervisorAdminV228Test-1382103462-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.061465 Feb 19 20:50:19.452371 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 8/15] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:19.452371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-780fc4e3-4e68-440a-a5e7-71c723a8f63f tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:19.453390 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.453390 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:19.478992 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2fabf87-d17a-4659-8923-cb5a4317431d tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043063 Feb 19 20:50:19.484467 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:19.494767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-780fc4e3-4e68-440a-a5e7-71c723a8f63f tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:19.495377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-780fc4e3-4e68-440a-a5e7-71c723a8f63f tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:19.496449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4058b483-03d8-450c-b1f0-fe6bfc22c862 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-477771753", "id": 1553423973, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:19.498189 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.498189 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:19.530492 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4058b483-03d8-450c-b1f0-fe6bfc22c862 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.038031 Feb 19 20:50:19.531345 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 9/17] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:19 2022] POST /compute/v2.1/flavors => generated 416 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:50:19.541854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-847b35c0-8029-42a6-ac88-fa5a45e8c15e tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.567502 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-847b35c0-8029-42a6-ac88-fa5a45e8c15e tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.029554 Feb 19 20:50:19.568549 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 10/18] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:19.583447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87dc4875-fa43-4405-ad24-74e15cf1ff9e tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.584230 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:19.584230 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:19.609881 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-87dc4875-fa43-4405-ad24-74e15cf1ff9e tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1553423973" status: 202 len: 0 microversion: 2.1 time: 0.029090 Feb 19 20:50:19.613303 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 11/19] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:19 2022] DELETE /compute/v2.1/flavors/1553423973 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:19.619632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b82ac83a-7e26-400b-8f56-716c4c5accd9 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.638933 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b82ac83a-7e26-400b-8f56-716c4c5accd9 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024435 Feb 19 20:50:19.639911 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 12/20] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:50:19.657431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-accec7f9-f54b-4fcd-887b-a269b20a6444 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1869251017", "id": 1545781241, "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:19.677474 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-accec7f9-f54b-4fcd-887b-a269b20a6444 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.023923 Feb 19 20:50:19.680382 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 13/21] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:19 2022] POST /compute/v2.1/flavors => generated 429 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:19.689953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-72446037-a277-4c24-98b1-8c2a0f4e4c29 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.711713 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-72446037-a277-4c24-98b1-8c2a0f4e4c29 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1545781241" status: 202 len: 0 microversion: 2.1 time: 0.025739 Feb 19 20:50:19.715576 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 14/22] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:19 2022] DELETE /compute/v2.1/flavors/1545781241 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:19.721459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-10cfec55-11c9-4088-b5e7-c42562ddb600 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.746626 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-10cfec55-11c9-4088-b5e7-c42562ddb600 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029871 Feb 19 20:50:19.748380 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 15/23] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:19.762623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-887be342-34d3-430a-89cf-ef02456c1699 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1156461249", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:19.779248 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-887be342-34d3-430a-89cf-ef02456c1699 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.020077 Feb 19 20:50:19.779931 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 16/24] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:19 2022] POST /compute/v2.1/flavors => generated 507 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:19.790713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8b0d483d-488a-4836-afd7-0194c426bbb6 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.809281 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8b0d483d-488a-4836-afd7-0194c426bbb6 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/b3e71e09-ac12-4881-b4c8-2dd60a289cf5" status: 202 len: 0 microversion: 2.1 time: 0.022613 Feb 19 20:50:19.810228 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 17/25] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:50:19 2022] DELETE /compute/v2.1/flavors/b3e71e09-ac12-4881-b4c8-2dd60a289cf5 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 20:50:19.817901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-24e11498-8b08-4323-b7d5-a5767069c36b tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.836322 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-24e11498-8b08-4323-b7d5-a5767069c36b tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021812 Feb 19 20:50:19.837386 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 18/26] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:19.852451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1e930000-17ec-4e76-96d6-a3811ca1b9d0 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-161897013", "id": "bac89e46-8579-40ca-be26-2ef28746d112", "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:19.869571 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1e930000-17ec-4e76-96d6-a3811ca1b9d0 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.021141 Feb 19 20:50:19.870146 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 19/27] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:19 2022] POST /compute/v2.1/flavors => generated 506 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:50:19.880876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4715a0db-4b51-460e-8c29-5189cec55663 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.899256 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4715a0db-4b51-460e-8c29-5189cec55663 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/bac89e46-8579-40ca-be26-2ef28746d112" status: 202 len: 0 microversion: 2.1 time: 0.021567 Feb 19 20:50:19.899821 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 20/28] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:50:19 2022] DELETE /compute/v2.1/flavors/bac89e46-8579-40ca-be26-2ef28746d112 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 20:50:19.907624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-da234a3a-3b44-4a32-ac2a-75791cf720ba tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.926286 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-da234a3a-3b44-4a32-ac2a-75791cf720ba tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022158 Feb 19 20:50:19.937486 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 21/29] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:19.942158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-59a5a212-fc4d-4232-936d-7fe7dfcad0c4 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-647499839", "id": 1783946439, "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:19.962752 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-59a5a212-fc4d-4232-936d-7fe7dfcad0c4 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.024026 Feb 19 20:50:19.968840 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 22/30] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:19 2022] POST /compute/v2.1/flavors => generated 413 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:19.973464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-11b07406-1a3a-43e6-b626-5fba7f8bb133 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:19.988357 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-11b07406-1a3a-43e6-b626-5fba7f8bb133 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1783946439" status: 200 len: 413 microversion: 2.1 time: 0.018493 Feb 19 20:50:19.995553 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 23/31] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/flavors/1783946439 => generated 413 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:20.246751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a24eba1f-f180-43a5-abcc-575d33a19988 tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.275735 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a24eba1f-f180-43a5-abcc-575d33a19988 tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.278966 Feb 19 20:50:20.276707 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 24/32] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:19 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:20.291626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-908b2fcc-54c1-4517-af5d-743563a083ed tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.311444 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-908b2fcc-54c1-4517-af5d-743563a083ed tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1783946439" status: 202 len: 0 microversion: 2.1 time: 0.024036 Feb 19 20:50:20.315509 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 25/33] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:20 2022] DELETE /compute/v2.1/flavors/1783946439 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:20.321506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f52d193-a833-45fc-b2c9-ae120c74ddd2 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.352740 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f52d193-a833-45fc-b2c9-ae120c74ddd2 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035995 Feb 19 20:50:20.353362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 26/34] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:20.372794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a8f53c3d-dbf8-484e-a961-3411472cd3a8 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1426844151", "id": 723540138, "os-flavor-access:is_public": "False"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:20.400303 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a8f53c3d-dbf8-484e-a961-3411472cd3a8 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.032188 Feb 19 20:50:20.407375 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 27/35] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:20 2022] POST /compute/v2.1/flavors => generated 427 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:20.412659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-594fc221-fa14-48a8-be6f-640d1393126a tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "723540138"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:20.437685 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-594fc221-fa14-48a8-be6f-640d1393126a tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] HTTP exception thrown: Flavor 723540138 could not be found. Feb 19 20:50:20.438664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-594fc221-fa14-48a8-be6f-640d1393126a tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] Returning 400 to user: Flavor 723540138 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:20.439798 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-594fc221-fa14-48a8-be6f-640d1393126a tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.031320 Feb 19 20:50:20.443622 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 28/36] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:20 2022] POST /compute/v2.1/servers => generated 80 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:20.451759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d17e71c7-1621-4345-8026-040cb3d98b46 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.474004 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d17e71c7-1621-4345-8026-040cb3d98b46 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/723540138" status: 202 len: 0 microversion: 2.1 time: 0.028995 Feb 19 20:50:20.474769 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 29/37] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 20:50:20 2022] DELETE /compute/v2.1/flavors/723540138 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:20.485351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d70a6c7c-8558-41d2-8cc2-8a46a05682fd tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.528741 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-780fc4e3-4e68-440a-a5e7-71c723a8f63f tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 1.079183 Feb 19 20:50:20.530905 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 9/38] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:50:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:20.537018 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d70a6c7c-8558-41d2-8cc2-8a46a05682fd tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056873 Feb 19 20:50:20.544236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dcd8f331-e857-41ec-9754-54e83dd77c25 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.546096 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:20.546096 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:20.549679 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 30/39] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:20.555673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-647619a4-a9e1-481c-9733-e5fbaab0c98e tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1926835234", "id": 1691564275, "os-flavor-access:is_public": "False"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:20.587879 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-647619a4-a9e1-481c-9733-e5fbaab0c98e tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.037040 Feb 19 20:50:20.590973 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dcd8f331-e857-41ec-9754-54e83dd77c25 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.053667 Feb 19 20:50:20.591563 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 10/40] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:50:20 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Feb 19 20:50:20.596875 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 31/41] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:20 2022] POST /compute/v2.1/flavors => generated 415 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:20.607865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f7cdf04d-f072-4d0b-8651-e36c82f93bc8 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2009343907", "id": 1840951413, "os-flavor-access:is_public": "True"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:20.612406 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:20.612406 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:20.615420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-692985d4-9d20-477c-a94d-fe7cae67435d tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1496350389"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:20.618948 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:20.618948 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:20.621210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-692985d4-9d20-477c-a94d-fe7cae67435d tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Generated uuid 328f2b74-4e32-4a52-8f03-47d2a90d7a63 for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:50:20.645807 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f7cdf04d-f072-4d0b-8651-e36c82f93bc8 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.044029 Feb 19 20:50:20.646696 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 11/42] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:20 2022] POST /compute/v2.1/flavors => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:20.657581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-00632242-a0d5-4b1b-bc94-13f440f68e95 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.659836 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-692985d4-9d20-477c-a94d-fe7cae67435d tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051664 Feb 19 20:50:20.660916 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 32/43] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:50:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:20.689305 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-00632242-a0d5-4b1b-bc94-13f440f68e95 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.035390 Feb 19 20:50:20.690457 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 12/44] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Feb 19 20:50:20 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:50:20.694892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4f45e062-ba2a-4004-9bad-203098b5e4a3 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-205748075"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:20.697172 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:20.697172 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:20.698793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.aggregate [None req-4f45e062-ba2a-4004-9bad-203098b5e4a3 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Generated uuid 167ffc6c-cb35-4949-a36a-26a043a8e29d for aggregate {{(pid=136095) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:50:20.749229 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4f45e062-ba2a-4004-9bad-203098b5e4a3 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.057557 Feb 19 20:50:20.754109 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 13/45] 10.222.0.30 () {62 vars in 1204 bytes} [Sat Feb 19 20:50:20 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:20.761822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-064532e7-7542-42e1-a9b2-7060874420f0 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.788104 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-064532e7-7542-42e1-a9b2-7060874420f0 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.031828 Feb 19 20:50:20.792474 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 14/46] 10.222.0.30 () {58 vars in 1176 bytes} [Sat Feb 19 20:50:20 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:20.804956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c43a82e-750e-414d-8aae-bac14186f2b7 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1024645931"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:20.890466 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:20.890466 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:20.925604 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c43a82e-750e-414d-8aae-bac14186f2b7 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.131861 Feb 19 20:50:20.926770 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 15/47] 10.222.0.30 () {62 vars in 1209 bytes} [Sat Feb 19 20:50:20 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:20.933066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f268d43f-9eaf-47d3-865c-3189054702fc tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.941731 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f268d43f-9eaf-47d3-865c-3189054702fc tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.013736 Feb 19 20:50:20.942287 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 16/48] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Feb 19 20:50:20 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:20.949435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c62fc457-5c30-4af7-b553-a3a06fdc1e37 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.950445 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:20.950445 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:20.958277 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c62fc457-5c30-4af7-b553-a3a06fdc1e37 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.012841 Feb 19 20:50:20.959182 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 17/49] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Feb 19 20:50:20 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:20.964357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8df25454-e249-4319-8d8f-78d26058c1b4 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:20.972666 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8df25454-e249-4319-8d8f-78d26058c1b4 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.012064 Feb 19 20:50:20.973220 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 18/50] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Feb 19 20:50:20 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:20.977912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-286c8d22-1ed4-4018-a0d7-b08018daac5a tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:20.979558 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:20.979558 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:20.994533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-286c8d22-1ed4-4018-a0d7-b08018daac5a tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:20.995087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-286c8d22-1ed4-4018-a0d7-b08018daac5a tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:21.095723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e648e2f5-bdd6-4670-a680-391d4840893b tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.097154 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.097154 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.098092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e648e2f5-bdd6-4670-a680-391d4840893b tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'cf8b6484328b4ae999dc8ccd44d4129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171eb8a081f74f8a89218e43e188c9b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:21.098732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e648e2f5-bdd6-4670-a680-391d4840893b tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:21.099562 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e648e2f5-bdd6-4670-a680-391d4840893b tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.431378 Feb 19 20:50:21.100009 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 33/51] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:50:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 433 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:21.105479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-acb7945a-90e4-42a6-9509-14f5cc916181 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.114148 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-286c8d22-1ed4-4018-a0d7-b08018daac5a tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.139922 Feb 19 20:50:21.115195 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 19/52] 10.222.0.30 () {62 vars in 1231 bytes} [Sat Feb 19 20:50:20 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:21.124512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-acb7945a-90e4-42a6-9509-14f5cc916181 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.023288 Feb 19 20:50:21.125358 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 34/53] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:21.135300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d084a879-45ab-468e-ad12-026a97b13afa tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.135300 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.135300 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:21.140380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-19817b13-4551-4fed-a057-1f1cf09a4d06 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.141827 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.141827 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.151008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19817b13-4551-4fed-a057-1f1cf09a4d06 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:21.151711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19817b13-4551-4fed-a057-1f1cf09a4d06 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:21.155967 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d084a879-45ab-468e-ad12-026a97b13afa tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.039256 Feb 19 20:50:21.161658 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 20/54] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:50:21.169798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5545a9ce-79ae-4582-b3f9-709c73d6a0ec tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.203013 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5545a9ce-79ae-4582-b3f9-709c73d6a0ec tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.039991 Feb 19 20:50:21.203757 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 21/55] 10.222.0.30 () {58 vars in 1174 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:21.209596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-460a366a-1dd2-4894-b017-fb2c25e60549 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1506420149"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.211508 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.211508 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:21.215684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.aggregate [None req-460a366a-1dd2-4894-b017-fb2c25e60549 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Generated uuid 21e4315b-e356-4fe4-8adc-3bfde50636ce for aggregate {{(pid=136095) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:50:21.253915 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-460a366a-1dd2-4894-b017-fb2c25e60549 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049020 Feb 19 20:50:21.255233 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 22/56] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:21.260380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-05ec64f4-c71c-458b-9835-9bea831fc242 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.281703 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-05ec64f4-c71c-458b-9835-9bea831fc242 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.024982 Feb 19 20:50:21.282357 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 23/57] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:21.296969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-be4ebd50-f92e-4d3b-bff8-1459aaf641d2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-274636050"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.301033 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.301033 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:21.306504 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-19817b13-4551-4fed-a057-1f1cf09a4d06 tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.167826 Feb 19 20:50:21.307720 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 35/58] 10.222.0.30 () {62 vars in 1231 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:21.314314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6d64f53f-6394-4b68-a5b6-cef0ac2b4951 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.315200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be4ebd50-f92e-4d3b-bff8-1459aaf641d2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:21.315657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be4ebd50-f92e-4d3b-bff8-1459aaf641d2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:21.323719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be4ebd50-f92e-4d3b-bff8-1459aaf641d2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:21.324218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be4ebd50-f92e-4d3b-bff8-1459aaf641d2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:21.334574 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-be4ebd50-f92e-4d3b-bff8-1459aaf641d2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-274636050 could not be found. Feb 19 20:50:21.335167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-be4ebd50-f92e-4d3b-bff8-1459aaf641d2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-274636050 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:21.336000 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-be4ebd50-f92e-4d3b-bff8-1459aaf641d2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.042743 Feb 19 20:50:21.336893 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 24/59] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:21.341363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-616d6b3e-acfe-47a6-bf27-40650a23fe4b tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.342054 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.342054 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:21.346709 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6d64f53f-6394-4b68-a5b6-cef0ac2b4951 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.036544 Feb 19 20:50:21.347310 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 36/60] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:21.353013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dac601c7-205a-4739-b712-d57597cd8874 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.353778 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.353778 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.385088 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-616d6b3e-acfe-47a6-bf27-40650a23fe4b tempest-AggregatesAdminTestV241-315341193 tempest-AggregatesAdminTestV241-315341193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.047122 Feb 19 20:50:21.385866 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 25/61] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:21.388774 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dac601c7-205a-4739-b712-d57597cd8874 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.037060 Feb 19 20:50:21.392980 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 37/62] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:50:21.395159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d0db58d5-c6b0-42d6-b6a2-f2822afa291b tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.396655 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.396655 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:21.400911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-03e03c25-50e5-43ff-ae99-4cb90bcc6e3d tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-883551298", "name": "tempest-test_aggregate-253621873"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.416624 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d0db58d5-c6b0-42d6-b6a2-f2822afa291b tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1840951413" status: 202 len: 0 microversion: 2.1 time: 0.028695 Feb 19 20:50:21.421112 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 26/63] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/flavors/1840951413 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:21.421291 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.421291 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.422795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-03e03c25-50e5-43ff-ae99-4cb90bcc6e3d tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Generated uuid fe952276-f1bf-40b7-b205-933a3807d81e for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:50:21.427964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2b336fe6-9fb2-4e8a-adbd-a5caa6595efc tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.430246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2b336fe6-9fb2-4e8a-adbd-a5caa6595efc tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:21.431716 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2b336fe6-9fb2-4e8a-adbd-a5caa6595efc tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.009372 Feb 19 20:50:21.432910 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 27/64] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:50:21.440351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6258d23c-435d-4445-8f1c-1dd78d801274 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.464057 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-03e03c25-50e5-43ff-ae99-4cb90bcc6e3d tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.068283 Feb 19 20:50:21.465016 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6258d23c-435d-4445-8f1c-1dd78d801274 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028307 Feb 19 20:50:21.465344 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 38/65] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:50:21.475489 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 28/66] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:21.480453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7eba7d13-8ad1-404a-bd86-4625ba250cba tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.481479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f63496aa-2567-4c70-968b-84c438bac359 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.482265 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.482265 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:21.483702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7eba7d13-8ad1-404a-bd86-4625ba250cba tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:21.485017 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7eba7d13-8ad1-404a-bd86-4625ba250cba tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.018272 Feb 19 20:50:21.486629 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 39/67] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:50:21.495203 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f63496aa-2567-4c70-968b-84c438bac359 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.017781 Feb 19 20:50:21.496220 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 29/68] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:21.496893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1e3e5785-639c-48b9-9b71-df3327d42166 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.501419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66a23aa0-84b2-4f2f-8ca6-8679f24d883c tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-826786428"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.502847 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.502847 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:21.507023 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.507023 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.507784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-66a23aa0-84b2-4f2f-8ca6-8679f24d883c tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'cf8b6484328b4ae999dc8ccd44d4129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171eb8a081f74f8a89218e43e188c9b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:21.508625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66a23aa0-84b2-4f2f-8ca6-8679f24d883c tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:21.509597 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-66a23aa0-84b2-4f2f-8ca6-8679f24d883c tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012334 Feb 19 20:50:21.510637 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 30/69] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:21.517468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-114c77b4-6461-46a6-8dd4-99c61df1ee04 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.518869 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.518869 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:21.528813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-114c77b4-6461-46a6-8dd4-99c61df1ee04 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:21.530322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-114c77b4-6461-46a6-8dd4-99c61df1ee04 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:21.547846 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1e3e5785-639c-48b9-9b71-df3327d42166 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1691564275" status: 202 len: 0 microversion: 2.1 time: 0.058427 Feb 19 20:50:21.548664 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 40/70] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/flavors/1691564275 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:21.556778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3d7980c-cdf3-47f0-9d50-15134e01e43e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1775646179"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.559029 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.559029 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.560992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-e3d7980c-cdf3-47f0-9d50-15134e01e43e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Generated uuid dc8a2bf3-aab4-4c42-a59f-6d75fad1e557 for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:50:21.605524 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e3d7980c-cdf3-47f0-9d50-15134e01e43e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055618 Feb 19 20:50:21.611878 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 41/71] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:21.616632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-03d6c8c7-9631-42d6-999a-440ab1620faa tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.638789 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-03d6c8c7-9631-42d6-999a-440ab1620faa tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025557 Feb 19 20:50:21.639722 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 42/72] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:21.644461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a4701db-bd30-44db-8c90-e2b2fa67116d tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1775646179"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.645809 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.645809 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.647039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-7a4701db-bd30-44db-8c90-e2b2fa67116d tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Generated uuid 88e88193-12d1-4830-aaa3-c973f254accd for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:50:21.661602 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-7a4701db-bd30-44db-8c90-e2b2fa67116d tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1775646179 already exists. Feb 19 20:50:21.662391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a4701db-bd30-44db-8c90-e2b2fa67116d tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1775646179 already exists. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:21.664755 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a4701db-bd30-44db-8c90-e2b2fa67116d tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.023325 Feb 19 20:50:21.668832 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 43/73] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 28 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:50:21.674725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-08552b40-702e-47c2-9923-c6e7719f42b2 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-507140670", "id": 1287691031, "os-flavor-access:is_public": "False"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.676763 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.676763 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.700771 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-08552b40-702e-47c2-9923-c6e7719f42b2 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.030637 Feb 19 20:50:21.701630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 44/74] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/flavors => generated 414 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:21.707033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eb772142-5385-4ce3-b096-11af8d1b6946 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.708234 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.708234 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.727980 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-114c77b4-6461-46a6-8dd4-99c61df1ee04 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 312 microversion: 2.1 time: 0.216174 Feb 19 20:50:21.730251 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 31/75] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates/5/action => generated 312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:21.745590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fee66cb5-4c19-4dfe-98ad-53fb718026c7 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.762345 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eb772142-5385-4ce3-b096-11af8d1b6946 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.058996 Feb 19 20:50:21.766481 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 45/76] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:50:21.778900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bfe8b094-b7dc-466c-af08-b4b4035241fd tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1026115461"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.780594 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fee66cb5-4c19-4dfe-98ad-53fb718026c7 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048870 Feb 19 20:50:21.780722 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.780722 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.782145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-bfe8b094-b7dc-466c-af08-b4b4035241fd tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Generated uuid 927fad8e-2647-4861-b0b5-bd17056f0da5 for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:50:21.792767 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 32/77] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:21.804231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b6381e9d-3c94-48a0-8e73-c2e429dd8366 tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.828109 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bfe8b094-b7dc-466c-af08-b4b4035241fd tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054500 Feb 19 20:50:21.830935 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 46/78] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:21.843775 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b6381e9d-3c94-48a0-8e73-c2e429dd8366 tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044954 Feb 19 20:50:21.844530 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 33/79] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:21.859639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a935abc3-bde4-48bd-afba-8d20af44cb8c tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.861646 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.861646 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.861646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a935abc3-bde4-48bd-afba-8d20af44cb8c tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'cf8b6484328b4ae999dc8ccd44d4129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171eb8a081f74f8a89218e43e188c9b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:21.862517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a935abc3-bde4-48bd-afba-8d20af44cb8c tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:21.863584 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a935abc3-bde4-48bd-afba-8d20af44cb8c tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.024595 Feb 19 20:50:21.867397 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 47/80] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:21.868983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d73d1f3e-e301-41fd-85b1-a043ec016758 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.870077 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.870077 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:21.875036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fde08547-7c7f-4e78-82d8-1b4131456ec2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.902576 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d73d1f3e-e301-41fd-85b1-a043ec016758 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1287691031" status: 202 len: 0 microversion: 2.1 time: 0.047135 Feb 19 20:50:21.904867 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 34/81] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/flavors/1287691031 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 20:50:21.922884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d9c8a1f1-2578-477f-a574-b856fdf2ff44 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.935801 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fde08547-7c7f-4e78-82d8-1b4131456ec2 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.065826 Feb 19 20:50:21.936841 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 48/82] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Feb 19 20:50:21.962268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5699570d-282b-4778-92ee-109f81071841 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:21.962821 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d9c8a1f1-2578-477f-a574-b856fdf2ff44 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052157 Feb 19 20:50:21.963364 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 35/83] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:21.964957 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.964957 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:21.987859 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-5699570d-282b-4778-92ee-109f81071841 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Feb 19 20:50:21.988944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5699570d-282b-4778-92ee-109f81071841 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:21.990086 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5699570d-282b-4778-92ee-109f81071841 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.038541 Feb 19 20:50:21.990835 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 49/84] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:50:21 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:50:21.991239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-00ec0324-70aa-4be9-9e2e-c6a24083327a tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1305973149", "id": 1098842785, "os-flavor-access:is_public": "True"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:21.993951 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:21.993951 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:22.016041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b675e40-9782-42a6-8ebd-9669c739e31e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1778411538"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:22.017709 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:22.017709 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:22.021127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-9b675e40-9782-42a6-8ebd-9669c739e31e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Generated uuid 7d24f315-7b8a-4f89-8a3f-853820af5e5a for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:50:22.026965 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-00ec0324-70aa-4be9-9e2e-c6a24083327a tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.045349 Feb 19 20:50:22.028009 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 36/85] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:21 2022] POST /compute/v2.1/flavors => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:22.040485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2af1fb6-79c2-4024-b136-0970aeb670bf tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:22.053733 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b675e40-9782-42a6-8ebd-9669c739e31e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046712 Feb 19 20:50:22.054807 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 50/86] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:50:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:22.067347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83fb572d-b7b6-42f9-a6e4-99b04498356e tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:22.068613 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:22.068613 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:22.070975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83fb572d-b7b6-42f9-a6e4-99b04498356e tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'cf8b6484328b4ae999dc8ccd44d4129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171eb8a081f74f8a89218e43e188c9b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:22.071846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83fb572d-b7b6-42f9-a6e4-99b04498356e tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:22.073604 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83fb572d-b7b6-42f9-a6e4-99b04498356e tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.011741 Feb 19 20:50:22.073604 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 51/87] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 20:50:22 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:22.082573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96cde286-831a-4259-87ff-ce4d32a8fe8a tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:22.083540 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:22.083540 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:22.092301 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2af1fb6-79c2-4024-b136-0970aeb670bf tempest-FlavorsAdminTestJSON-1719962350 tempest-FlavorsAdminTestJSON-1719962350-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.050461 Feb 19 20:50:22.093509 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 37/88] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:22 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:22.109254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-207e843a-b44e-4836-ad37-057d5a6d388c tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:22.123335 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96cde286-831a-4259-87ff-ce4d32a8fe8a tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.043659 Feb 19 20:50:22.128646 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 52/89] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:50:22 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:50:22.136916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e6527703-5d72-4f7a-9690-164ace061f59 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:22.138459 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:22.138459 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:22.144944 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e6527703-5d72-4f7a-9690-164ace061f59 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Feb 19 20:50:22.145609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e6527703-5d72-4f7a-9690-164ace061f59 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:22.146533 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e6527703-5d72-4f7a-9690-164ace061f59 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.016041 Feb 19 20:50:22.147204 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 53/90] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:50:22 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:50:22.154038 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-207e843a-b44e-4836-ad37-057d5a6d388c tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1098842785" status: 202 len: 0 microversion: 2.1 time: 0.048236 Feb 19 20:50:22.154720 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 38/91] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:22 2022] DELETE /compute/v2.1/flavors/1098842785 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:22.162129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c6e23334-3a3c-4171-aa1e-a82e752d68c4 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:22.162748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4506b266-8b0f-4287-8c0d-9d98cfb03dd2 tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:22.163425 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:22.163425 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:22.165332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4506b266-8b0f-4287-8c0d-9d98cfb03dd2 tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'cf8b6484328b4ae999dc8ccd44d4129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171eb8a081f74f8a89218e43e188c9b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:22.166038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4506b266-8b0f-4287-8c0d-9d98cfb03dd2 tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:22.167021 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4506b266-8b0f-4287-8c0d-9d98cfb03dd2 tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.014091 Feb 19 20:50:22.167800 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 54/92] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:50:22 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:50:22.190704 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c6e23334-3a3c-4171-aa1e-a82e752d68c4 tempest-FlavorsAdminTestJSON-1654662606 tempest-FlavorsAdminTestJSON-1654662606-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031920 Feb 19 20:50:22.191634 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 39/93] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:22.715372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2038156686", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "availability_zone": "tempest-test_az-883551298"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:22.728156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:22.728662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:22.729492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:22.729931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:23.396304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d16eca2c-a0c3-4348-82f4-6d4b52805a58 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Calling method '.version_select at 0x7f6474931e50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:23.400283 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:23.400283 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:23.402345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d16eca2c-a0c3-4348-82f4-6d4b52805a58 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:23.403005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d16eca2c-a0c3-4348-82f4-6d4b52805a58 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:23.405809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d16eca2c-a0c3-4348-82f4-6d4b52805a58 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:23.406256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d16eca2c-a0c3-4348-82f4-6d4b52805a58 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:23.442667 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d16eca2c-a0c3-4348-82f4-6d4b52805a58 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 400 microversion: 2.1 time: 0.372452 Feb 19 20:50:23.443374 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 40/94] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 20:50:23 2022] GET /compute/v2.1/os-hosts => generated 400 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:50:23.640201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:50:23.984598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:50:23.985181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:50:23.985666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:50:23.986085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:50:23.986501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:50:23.999935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:24.000673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:24.001842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:24.002417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:24.033454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7eb98fc2-91af-420f-8d77-483bdd56ab6f tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Calling method '.version_select at 0x7f64759950d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.034906 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:24.034906 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:24.035908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7eb98fc2-91af-420f-8d77-483bdd56ab6f tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '885b2316ba4c4753b4b40c764140ea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24084fe3ae3342fb98decf8e698ef38e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:24.036583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7eb98fc2-91af-420f-8d77-483bdd56ab6f tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.037386 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7eb98fc2-91af-420f-8d77-483bdd56ab6f tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.582402 Feb 19 20:50:24.044596 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 41/95] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 20:50:23 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 590 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:24.049470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a1b1053-c8e1-4eb4-96f6-6667ecd76c1c tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Calling method '.version_select at 0x7f647489f430>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.050684 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:24.050684 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:24.052823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Getting quotas for project 228f5017f5f74fbaa0f3b36b89acf4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:50:24.054491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1a1b1053-c8e1-4eb4-96f6-6667ecd76c1c tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '885b2316ba4c4753b4b40c764140ea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24084fe3ae3342fb98decf8e698ef38e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:24.055126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a1b1053-c8e1-4eb4-96f6-6667ecd76c1c tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.055919 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1a1b1053-c8e1-4eb4-96f6-6667ecd76c1c tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.010336 Feb 19 20:50:24.060438 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 42/96] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Feb 19 20:50:24 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:24.064256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Getting quotas for user a3685521a15b40c3a032b34a430be90f and project 228f5017f5f74fbaa0f3b36b89acf4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:50:24.066313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66503fe4-991a-4b53-89c3-e827ee2b1e5e tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Calling method '.version_select at 0x7f647628b4c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.076041 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-66503fe4-991a-4b53-89c3-e827ee2b1e5e tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 19 20:50:24.076933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66503fe4-991a-4b53-89c3-e827ee2b1e5e tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.077749 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-66503fe4-991a-4b53-89c3-e827ee2b1e5e tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.016161 Feb 19 20:50:24.078391 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 43/97] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Feb 19 20:50:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 19 20:50:24.088981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:50:24.092298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:50:24.093540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4fb2fb7-8ce7-461f-83a7-688f63687ec9 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Calling method '.version_select at 0x7f6474958700>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.096159 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:24.096159 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:24.097681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e4fb2fb7-8ce7-461f-83a7-688f63687ec9 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '885b2316ba4c4753b4b40c764140ea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24084fe3ae3342fb98decf8e698ef38e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:24.101098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4fb2fb7-8ce7-461f-83a7-688f63687ec9 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.103288 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e4fb2fb7-8ce7-461f-83a7-688f63687ec9 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.018369 Feb 19 20:50:24.104644 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 44/98] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Feb 19 20:50:24 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:24.114789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-afa069e7-1168-4e95-8b98-37c8b29c6ea9 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Calling method '.version_select at 0x7f647489f700>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.124855 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-afa069e7-1168-4e95-8b98-37c8b29c6ea9 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 19 20:50:24.125726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-afa069e7-1168-4e95-8b98-37c8b29c6ea9 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.126739 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-afa069e7-1168-4e95-8b98-37c8b29c6ea9 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016224 Feb 19 20:50:24.127433 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 45/99] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Feb 19 20:50:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 19 20:50:24.136880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa27d8b6-d56a-4701-8666-e56c0922c3b1 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Calling method '.version_select at 0x7f6474958c10>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.138033 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:24.138033 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:24.139660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa27d8b6-d56a-4701-8666-e56c0922c3b1 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '885b2316ba4c4753b4b40c764140ea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24084fe3ae3342fb98decf8e698ef38e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:24.140753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa27d8b6-d56a-4701-8666-e56c0922c3b1 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.141834 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa27d8b6-d56a-4701-8666-e56c0922c3b1 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009265 Feb 19 20:50:24.142643 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 46/100] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Feb 19 20:50:24 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:50:24.154024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3dec6d0f-b42d-48d6-9db8-9cb2cdf76d64 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Calling method '.version_select at 0x7f64759950d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.166742 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-3dec6d0f-b42d-48d6-9db8-9cb2cdf76d64 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 19 20:50:24.167687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3dec6d0f-b42d-48d6-9db8-9cb2cdf76d64 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.169288 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3dec6d0f-b42d-48d6-9db8-9cb2cdf76d64 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.019608 Feb 19 20:50:24.175160 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 47/101] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 20:50:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:50:24.178203 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e48ba9d5-52a7-40b9-844a-ac1fffc3ea2e tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.945420 Feb 19 20:50:24.178858 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 55/102] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:50:24.183965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ab14996e-2de2-4c9d-912b-20181be68b12 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Calling method '.version_select at 0x7f6474958ee0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.183965 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:24.183965 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:24.184215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ab14996e-2de2-4c9d-912b-20181be68b12 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '885b2316ba4c4753b4b40c764140ea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24084fe3ae3342fb98decf8e698ef38e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:24.185327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ab14996e-2de2-4c9d-912b-20181be68b12 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.186547 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ab14996e-2de2-4c9d-912b-20181be68b12 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.009819 Feb 19 20:50:24.191684 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 48/103] 10.222.0.30 () {58 vars in 1193 bytes} [Sat Feb 19 20:50:24 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:24.193122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-33005658-621a-40c3-93ed-31dbfd5db39a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.194314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-33005658-621a-40c3-93ed-31dbfd5db39a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:24.197177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-396b5b70-e123-46b7-b3f1-56ca68853f0b tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Calling method '.version_select at 0x7f647489f790>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:24.222913 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-396b5b70-e123-46b7-b3f1-56ca68853f0b tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 19 20:50:24.224088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-396b5b70-e123-46b7-b3f1-56ca68853f0b tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.225627 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-396b5b70-e123-46b7-b3f1-56ca68853f0b tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033029 Feb 19 20:50:24.231630 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 49/104] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Feb 19 20:50:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:50:24.245108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dcf6db70-5718-4cd4-9e5e-7e907b0c684d tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Action: 'update', calling method: .version_select at 0x7f6474958c10>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:24.246469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dcf6db70-5718-4cd4-9e5e-7e907b0c684d tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.247290 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dcf6db70-5718-4cd4-9e5e-7e907b0c684d tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.014359 Feb 19 20:50:24.248184 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 50/105] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Feb 19 20:50:24 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:50:24.264676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c69c465d-d11f-441c-9222-e203d1b5ee68 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Action: 'update', calling method: .version_select at 0x7f647489fa60>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:24.268197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c69c465d-d11f-441c-9222-e203d1b5ee68 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.269206 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c69c465d-d11f-441c-9222-e203d1b5ee68 tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.015403 Feb 19 20:50:24.270111 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 51/106] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Feb 19 20:50:24 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:50:24.284364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d0407ab9-7fda-4d7d-a167-f38c02fce7c8 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Action: 'update', calling method: .version_select at 0x7f6475995160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:24.285614 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:24.285614 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:24.286728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d0407ab9-7fda-4d7d-a167-f38c02fce7c8 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '885b2316ba4c4753b4b40c764140ea67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24084fe3ae3342fb98decf8e698ef38e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:24.297986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d0407ab9-7fda-4d7d-a167-f38c02fce7c8 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.298838 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d0407ab9-7fda-4d7d-a167-f38c02fce7c8 tempest-HostsAdminNegativeTestJSON-481920847 tempest-HostsAdminNegativeTestJSON-481920847-project] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.019535 Feb 19 20:50:24.299719 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 52/107] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Feb 19 20:50:24 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:24.315105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb5d3421-6ec1-4b07-bfd9-5a68b929a65a tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Action: 'update', calling method: .version_select at 0x7f647489f670>, body: {"status": null, "maintenance_mode": null} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:24.321214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb5d3421-6ec1-4b07-bfd9-5a68b929a65a tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.322595 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb5d3421-6ec1-4b07-bfd9-5a68b929a65a tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.015603 Feb 19 20:50:24.324493 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 53/108] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Feb 19 20:50:24 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:50:24.335470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61cb1b13-5aec-4be2-980a-b113cb8f3baa tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Action: 'update', calling method: .version_select at 0x7f647628b4c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:24.339182 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.hosts [None req-61cb1b13-5aec-4be2-980a-b113cb8f3baa tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Enabling host nonexistent_hostname. Feb 19 20:50:24.359477 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-61cb1b13-5aec-4be2-980a-b113cb8f3baa tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 19 20:50:24.360088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61cb1b13-5aec-4be2-980a-b113cb8f3baa tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:24.360948 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-61cb1b13-5aec-4be2-980a-b113cb8f3baa tempest-HostsAdminNegativeTestJSON-1128582719 tempest-HostsAdminNegativeTestJSON-1128582719-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.031991 Feb 19 20:50:24.366790 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 54/109] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Feb 19 20:50:24 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:50:24.391443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-33005658-621a-40c3-93ed-31dbfd5db39a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:24.417045 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-33005658-621a-40c3-93ed-31dbfd5db39a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1242 microversion: 2.1 time: 0.230472 Feb 19 20:50:24.417828 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 56/110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:24 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1242 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:25.434668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0ddc0610-e0c4-401c-bb05-026c0f2febdc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:25.435401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0ddc0610-e0c4-401c-bb05-026c0f2febdc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:26.712223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0ddc0610-e0c4-401c-bb05-026c0f2febdc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:26.739819 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0ddc0610-e0c4-401c-bb05-026c0f2febdc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1242 microversion: 2.1 time: 1.308527 Feb 19 20:50:26.741291 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 55/111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:25 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1242 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:27.759736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-64e703ab-1df3-4573-9d6d-425045d1db82 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:27.761134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-64e703ab-1df3-4573-9d6d-425045d1db82 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:27.774677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64e703ab-1df3-4573-9d6d-425045d1db82 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:27.776472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64e703ab-1df3-4573-9d6d-425045d1db82 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:27.779006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64e703ab-1df3-4573-9d6d-425045d1db82 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:27.779635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64e703ab-1df3-4573-9d6d-425045d1db82 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:28.160455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-64e703ab-1df3-4573-9d6d-425045d1db82 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:28.177687 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-64e703ab-1df3-4573-9d6d-425045d1db82 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1296 microversion: 2.1 time: 0.422499 Feb 19 20:50:28.181146 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 57/112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:27 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1296 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:29.194875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4392d3f7-39cd-4f43-9f59-e07aaee06831 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:29.195621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4392d3f7-39cd-4f43-9f59-e07aaee06831 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:29.202330 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4392d3f7-39cd-4f43-9f59-e07aaee06831 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:29.205912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4392d3f7-39cd-4f43-9f59-e07aaee06831 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:29.207052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4392d3f7-39cd-4f43-9f59-e07aaee06831 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:29.208890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4392d3f7-39cd-4f43-9f59-e07aaee06831 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:29.585595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4392d3f7-39cd-4f43-9f59-e07aaee06831 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:29.594839 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4392d3f7-39cd-4f43-9f59-e07aaee06831 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.404078 Feb 19 20:50:29.600556 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 58/113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:29 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:29.821453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-54497aab-4e78-4475-a259-a500b62a1429 tempest-NetworksTest-1852433194 tempest-NetworksTest-1852433194-project-admin] Calling method '.version_select at 0x7f647489f940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:30.275111 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-54497aab-4e78-4475-a259-a500b62a1429 tempest-NetworksTest-1852433194 tempest-NetworksTest-1852433194-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 2633 microversion: 2.1 time: 1.206422 Feb 19 20:50:30.275666 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 56/114] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:50:29 2022] GET /compute/v2.1/os-networks => generated 2633 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:30.285639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d310bcc3-bb50-4c00-adb8-0ed65173d329 tempest-NetworksTest-1852433194 tempest-NetworksTest-1852433194-project-admin] Calling method '.version_select at 0x7f64747801f0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:30.834607 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d310bcc3-bb50-4c00-adb8-0ed65173d329 tempest-NetworksTest-1852433194 tempest-NetworksTest-1852433194-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks/46539bba-6cad-4c87-80c0-0d2c8447156a" status: 200 len: 652 microversion: 2.1 time: 0.554399 Feb 19 20:50:30.839460 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 59/115] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 20:50:30 2022] GET /compute/v2.1/os-networks/46539bba-6cad-4c87-80c0-0d2c8447156a => generated 652 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:30.844206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-51f26ede-984d-409c-ab65-ae2488c983a5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:30.844898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-51f26ede-984d-409c-ab65-ae2488c983a5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:30.869176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-51f26ede-984d-409c-ab65-ae2488c983a5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:30.870088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-51f26ede-984d-409c-ab65-ae2488c983a5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:30.871477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-51f26ede-984d-409c-ab65-ae2488c983a5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:30.872073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-51f26ede-984d-409c-ab65-ae2488c983a5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:31.389395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-51f26ede-984d-409c-ab65-ae2488c983a5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:31.403740 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-51f26ede-984d-409c-ab65-ae2488c983a5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.566222 Feb 19 20:50:31.416714 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 60/116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:30 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:31.450068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-667e7e75-b781-4032-ab30-8c648ce3da2e tempest-NetworksTest-1852433194 tempest-NetworksTest-1852433194-project-admin] Calling method '.version_select at 0x7f64747b44c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:31.585185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-586fb439-a85f-4606-be17-191f14d5d1dd tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Action: 'update', calling method: .version_select at 0x7f64748619d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:31.589441 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:31.589441 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:31.848398 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-667e7e75-b781-4032-ab30-8c648ce3da2e tempest-NetworksTest-1852433194 tempest-NetworksTest-1852433194-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 2633 microversion: 2.1 time: 0.428652 Feb 19 20:50:31.849553 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 61/117] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:50:31 2022] GET /compute/v2.1/os-networks => generated 2633 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:32.756071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-586fb439-a85f-4606-be17-191f14d5d1dd tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:32.760557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-586fb439-a85f-4606-be17-191f14d5d1dd tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:32.764832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-586fb439-a85f-4606-be17-191f14d5d1dd tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:32.765668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-586fb439-a85f-4606-be17-191f14d5d1dd tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:33.024260 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-586fb439-a85f-4606-be17-191f14d5d1dd tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/1cda7aae8ee24953acb9549d72facb3a" status: 200 len: 240 microversion: 2.36 time: 2.615928 Feb 19 20:50:33.025308 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 57/118] 10.222.0.30 () {62 vars in 1302 bytes} [Sat Feb 19 20:50:30 2022] PUT /compute/v2.1/os-quota-sets/1cda7aae8ee24953acb9549d72facb3a => generated 240 bytes in 2622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:33.036573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8fb8fbde-985b-400e-b839-43c708e5f8eb tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:33.037461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8fb8fbde-985b-400e-b839-43c708e5f8eb tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:33.049790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fb8fbde-985b-400e-b839-43c708e5f8eb tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:33.050260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fb8fbde-985b-400e-b839-43c708e5f8eb tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:33.052423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fb8fbde-985b-400e-b839-43c708e5f8eb tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:33.054989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fb8fbde-985b-400e-b839-43c708e5f8eb tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:33.102249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-25d19b6c-ede9-4664-9de3-0cb1c8025e95 tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:33.104980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25d19b6c-ede9-4664-9de3-0cb1c8025e95 tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:33.105673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25d19b6c-ede9-4664-9de3-0cb1c8025e95 tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:33.109430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25d19b6c-ede9-4664-9de3-0cb1c8025e95 tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:33.110146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25d19b6c-ede9-4664-9de3-0cb1c8025e95 tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:33.177553 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-25d19b6c-ede9-4664-9de3-0cb1c8025e95 tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 1.159675 Feb 19 20:50:33.185276 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 62/119] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Feb 19 20:50:32 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:33.190892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-61b639a7-80c1-4e01-a418-476cf6ae233c tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Calling method '.version_select at 0x7f64747fcee0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:33.743660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8fb8fbde-985b-400e-b839-43c708e5f8eb tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:33.775445 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8fb8fbde-985b-400e-b839-43c708e5f8eb tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.747874 Feb 19 20:50:33.778170 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 58/120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:33 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:33.785811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-329e227a-3274-468f-9633-6956c68a708b tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:33.787309 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:33.787309 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:33.791618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-329e227a-3274-468f-9633-6956c68a708b tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:33.792646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-329e227a-3274-468f-9633-6956c68a708b tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:33.795263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-329e227a-3274-468f-9633-6956c68a708b tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:33.796400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-329e227a-3274-468f-9633-6956c68a708b tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:33.856317 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-329e227a-3274-468f-9633-6956c68a708b tempest-AZAdminV2TestJSON-1605696991 tempest-AZAdminV2TestJSON-1605696991-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.075208 Feb 19 20:50:33.857311 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 59/121] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Feb 19 20:50:33 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:34.430774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61b639a7-80c1-4e01-a418-476cf6ae233c tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:34.431835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61b639a7-80c1-4e01-a418-476cf6ae233c tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:34.432991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61b639a7-80c1-4e01-a418-476cf6ae233c tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:34.433700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61b639a7-80c1-4e01-a418-476cf6ae233c tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:34.490931 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-61b639a7-80c1-4e01-a418-476cf6ae233c tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/1cda7aae8ee24953acb9549d72facb3a/detail" status: 200 len: 672 microversion: 2.36 time: 1.303763 Feb 19 20:50:34.493630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 63/122] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Feb 19 20:50:33 2022] GET /compute/v2.1/os-quota-sets/1cda7aae8ee24953acb9549d72facb3a/detail => generated 672 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:34.694440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-386f1c18-240d-4342-82de-9c716a9781ff tempest-InstanceUsageAuditLogTestJSON-484501246 tempest-InstanceUsageAuditLogTestJSON-484501246-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:34.695590 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:34.695590 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:34.755194 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-386f1c18-240d-4342-82de-9c716a9781ff tempest-InstanceUsageAuditLogTestJSON-484501246 tempest-InstanceUsageAuditLogTestJSON-484501246-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-02-19 20:50:33" status: 200 len: 318 microversion: 2.1 time: 0.892725 Feb 19 20:50:34.762791 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 60/123] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 20:50:33 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-02-19%2020%3A50%3A33 => generated 318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:34.779246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f37fd2f-a9a1-4741-abf3-a38c1b2d46b6 tempest-InstanceUsageAuditLogTestJSON-484501246 tempest-InstanceUsageAuditLogTestJSON-484501246-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:34.780366 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:34.780366 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:34.828807 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f37fd2f-a9a1-4741-abf3-a38c1b2d46b6 tempest-InstanceUsageAuditLogTestJSON-484501246 tempest-InstanceUsageAuditLogTestJSON-484501246-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.064468 Feb 19 20:50:34.839143 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 61/124] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Feb 19 20:50:34 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:34.851015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d65132ac-0180-4ac1-8bf8-fab317397f4f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:34.851757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d65132ac-0180-4ac1-8bf8-fab317397f4f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:34.858984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d65132ac-0180-4ac1-8bf8-fab317397f4f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:34.859766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d65132ac-0180-4ac1-8bf8-fab317397f4f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:34.860893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d65132ac-0180-4ac1-8bf8-fab317397f4f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:34.861522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d65132ac-0180-4ac1-8bf8-fab317397f4f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:35.046744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b6a4da8e-1594-4100-8f30-ec53c8dafecb req-471efe1d-ec45-4d7c-afec-c12a5f24f1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b743c9bb-0af5-4b6e-9c8e-ce4dcb144931", "tag": "e518681b-fe3b-4228-801f-07d7dc238409"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:35.048629 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:35.048629 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:35.069537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b6a4da8e-1594-4100-8f30-ec53c8dafecb req-471efe1d-ec45-4d7c-afec-c12a5f24f1a4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:35.072117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b6a4da8e-1594-4100-8f30-ec53c8dafecb req-471efe1d-ec45-4d7c-afec-c12a5f24f1a4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:35.117011 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b6a4da8e-1594-4100-8f30-ec53c8dafecb req-471efe1d-ec45-4d7c-afec-c12a5f24f1a4 service nova] Creating event network-changed:e518681b-fe3b-4228-801f-07d7dc238409 for instance b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 on nch1-master-1 Feb 19 20:50:35.122383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b6a4da8e-1594-4100-8f30-ec53c8dafecb req-471efe1d-ec45-4d7c-afec-c12a5f24f1a4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=136094) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:50:35.125784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2a2511-4665-422d-960d-77ddf970fedf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:35.128595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2a2511-4665-422d-960d-77ddf970fedf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:35.129718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2a2511-4665-422d-960d-77ddf970fedf None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:35.131116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2a2511-4665-422d-960d-77ddf970fedf None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:35.160431 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.compute.rpcapi [None req-df2a2511-4665-422d-960d-77ddf970fedf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 19 20:50:35.161735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2a2511-4665-422d-960d-77ddf970fedf None None] Releasing lock "compute-rpcapi-router" {{(pid=136094) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:50:35.195975 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df2a2511-4665-422d-960d-77ddf970fedf None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.700584 Feb 19 20:50:35.199502 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 64/125] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:35.343524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d65132ac-0180-4ac1-8bf8-fab317397f4f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:35.355141 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d65132ac-0180-4ac1-8bf8-fab317397f4f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.514748 Feb 19 20:50:35.358936 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 62/126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:34 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:36.376168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1ef47c1d-6144-48f2-b1c9-c75f5aab025f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:36.377000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1ef47c1d-6144-48f2-b1c9-c75f5aab025f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:36.392168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1d-6144-48f2-b1c9-c75f5aab025f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:36.393172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1d-6144-48f2-b1c9-c75f5aab025f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:36.394207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1d-6144-48f2-b1c9-c75f5aab025f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:36.394651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1d-6144-48f2-b1c9-c75f5aab025f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:36.631240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Action: 'update', calling method: .version_select at 0x7f647480f4c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:36.636121 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:36.636121 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:37.610538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:37.612000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:37.615089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1ef47c1d-6144-48f2-b1c9-c75f5aab025f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:37.617450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:37.618931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:37.629012 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1ef47c1d-6144-48f2-b1c9-c75f5aab025f tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 1.256792 Feb 19 20:50:37.652736 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 65/127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:36 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:38.009637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:38.013348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:38.019231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:38.020890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:38.254188 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45ba28ba-5450-4785-a0fa-0796697186c1 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/1cda7aae8ee24953acb9549d72facb3a?user_id=d6658468b7a3437d96dfcd63a0a56f31" status: 200 len: 240 microversion: 2.36 time: 1.626528 Feb 19 20:50:38.257349 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 63/128] 10.222.0.30 () {62 vars in 1383 bytes} [Sat Feb 19 20:50:36 2022] PUT /compute/v2.1/os-quota-sets/1cda7aae8ee24953acb9549d72facb3a?user_id=d6658468b7a3437d96dfcd63a0a56f31 => generated 240 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 20:50:38.272091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c355c862-84d9-45c6-b1be-96eba9738f07 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] Calling method '.version_select at 0x7f64747d3790>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:38.275013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8b292b65-4351-479a-bb0c-9b1deecf58db tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Calling method '.version_select at 0x7f64747b4d30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:38.275916 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:38.275916 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:38.277264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8b292b65-4351-479a-bb0c-9b1deecf58db tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '4c8910f44217477cacf67f872ffeca8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad8c0a30d35416c8fc1e32a09e4e334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:38.277916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8b292b65-4351-479a-bb0c-9b1deecf58db tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:38.278717 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8b292b65-4351-479a-bb0c-9b1deecf58db tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.377647 Feb 19 20:50:38.279248 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 66/129] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Feb 19 20:50:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 379 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:50:38.303926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-91655cf6-d9c3-4393-8095-5d483359d265 tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Calling method '.version_select at 0x7f64746e1790>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:38.303926 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:38.303926 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:38.303926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-91655cf6-d9c3-4393-8095-5d483359d265 tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '4c8910f44217477cacf67f872ffeca8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad8c0a30d35416c8fc1e32a09e4e334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:38.321007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-91655cf6-d9c3-4393-8095-5d483359d265 tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:38.326629 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-91655cf6-d9c3-4393-8095-5d483359d265 tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.034651 Feb 19 20:50:38.328080 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 67/130] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:38 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:38.355174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e2b353c-355e-463c-b0e5-c7bc78f6d43e tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Calling method '.version_select at 0x7f64746e1430>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:38.359332 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:38.359332 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:38.363300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e2b353c-355e-463c-b0e5-c7bc78f6d43e tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '4c8910f44217477cacf67f872ffeca8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad8c0a30d35416c8fc1e32a09e4e334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:38.367884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e2b353c-355e-463c-b0e5-c7bc78f6d43e tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:38.372534 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5e2b353c-355e-463c-b0e5-c7bc78f6d43e tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.035905 Feb 19 20:50:38.379436 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 68/131] 10.222.0.30 () {58 vars in 1178 bytes} [Sat Feb 19 20:50:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:39.074372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c355c862-84d9-45c6-b1be-96eba9738f07 tempest-QuotasAdminTestV236-1116509981 tempest-QuotasAdminTestV236-1116509981-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/1cda7aae8ee24953acb9549d72facb3a?user_id=d6658468b7a3437d96dfcd63a0a56f31" status: 200 len: 282 microversion: 2.36 time: 0.809766 Feb 19 20:50:39.081340 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 64/132] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Feb 19 20:50:38 2022] GET /compute/v2.1/os-quota-sets/1cda7aae8ee24953acb9549d72facb3a?user_id=d6658468b7a3437d96dfcd63a0a56f31 => generated 282 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 20:50:39.091732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-91264b93-1f76-4bec-a0b0-7f0cdf88bf36 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:39.096533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-91264b93-1f76-4bec-a0b0-7f0cdf88bf36 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:39.136137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91264b93-1f76-4bec-a0b0-7f0cdf88bf36 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:39.158332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91264b93-1f76-4bec-a0b0-7f0cdf88bf36 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:39.159816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91264b93-1f76-4bec-a0b0-7f0cdf88bf36 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:39.160873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91264b93-1f76-4bec-a0b0-7f0cdf88bf36 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:39.322717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd4e91a1-e5d9-4162-b6de-82af40509708 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Calling method '.version_select at 0x7f6474795e50>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:39.325000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd4e91a1-e5d9-4162-b6de-82af40509708 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:39.325734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd4e91a1-e5d9-4162-b6de-82af40509708 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:39.372442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd4e91a1-e5d9-4162-b6de-82af40509708 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:39.372834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd4e91a1-e5d9-4162-b6de-82af40509708 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:39.412515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd4e91a1-e5d9-4162-b6de-82af40509708 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:39.412963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd4e91a1-e5d9-4162-b6de-82af40509708 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:39.425086 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd4e91a1-e5d9-4162-b6de-82af40509708 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.043615 Feb 19 20:50:39.429911 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 69/133] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:39.442723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-05be4c45-0a91-4df9-aabb-c71484f386ca tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Calling method '.version_select at 0x7f64747950d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:39.443772 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:39.443772 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:39.446007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-05be4c45-0a91-4df9-aabb-c71484f386ca tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '4c8910f44217477cacf67f872ffeca8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad8c0a30d35416c8fc1e32a09e4e334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:39.446568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-05be4c45-0a91-4df9-aabb-c71484f386ca tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:39.447694 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-05be4c45-0a91-4df9-aabb-c71484f386ca tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.008276 Feb 19 20:50:39.454996 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 70/134] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Feb 19 20:50:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:39.459974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1bc3371f-3c75-41e4-9fa1-bf5a57216501 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Calling method '.version_select at 0x7f64746e14c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:39.468385 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-1bc3371f-3c75-41e4-9fa1-bf5a57216501 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] HTTP exception thrown: Hypervisor with ID 'bb583195-9020-4cc0-b541-b2c71f84ae18' could not be found. Feb 19 20:50:39.469039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1bc3371f-3c75-41e4-9fa1-bf5a57216501 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Returning 404 to user: Hypervisor with ID 'bb583195-9020-4cc0-b541-b2c71f84ae18' could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:39.469882 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1bc3371f-3c75-41e4-9fa1-bf5a57216501 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/bb583195-9020-4cc0-b541-b2c71f84ae18/uptime" status: 404 len: 123 microversion: 2.1 time: 0.013768 Feb 19 20:50:39.480096 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 71/135] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Feb 19 20:50:39 2022] GET /compute/v2.1/os-hypervisors/bb583195-9020-4cc0-b541-b2c71f84ae18/uptime => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:39.490792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1bdd2b21-51e9-4fdb-a99b-4bcb254e3cf7 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Calling method '.version_select at 0x7f64747fcee0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:39.491752 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:39.491752 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:39.508150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bdd2b21-51e9-4fdb-a99b-4bcb254e3cf7 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:39.508880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bdd2b21-51e9-4fdb-a99b-4bcb254e3cf7 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:39.547401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bdd2b21-51e9-4fdb-a99b-4bcb254e3cf7 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:39.556162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bdd2b21-51e9-4fdb-a99b-4bcb254e3cf7 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:39.581887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bdd2b21-51e9-4fdb-a99b-4bcb254e3cf7 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:39.583633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bdd2b21-51e9-4fdb-a99b-4bcb254e3cf7 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:39.596944 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1bdd2b21-51e9-4fdb-a99b-4bcb254e3cf7 tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.115571 Feb 19 20:50:39.597946 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 72/136] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:39.610523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1e3f6f8-4d46-46cd-8cb7-38030e6e4407 tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Calling method '.version_select at 0x7f64747954c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:39.611729 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:39.611729 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:39.613393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b1e3f6f8-4d46-46cd-8cb7-38030e6e4407 tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '4c8910f44217477cacf67f872ffeca8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad8c0a30d35416c8fc1e32a09e4e334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:39.619292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1e3f6f8-4d46-46cd-8cb7-38030e6e4407 tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:39.620563 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b1e3f6f8-4d46-46cd-8cb7-38030e6e4407 tempest-HypervisorAdminNegativeTestJSON-922220201 tempest-HypervisorAdminNegativeTestJSON-922220201-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015548 Feb 19 20:50:39.621651 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 73/137] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:50:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:50:39.635569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4240690f-2050-483f-98ba-546b1a0ad1de tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Calling method '.version_select at 0x7f6474780ca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:39.641214 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-4240690f-2050-483f-98ba-546b1a0ad1de tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] HTTP exception thrown: Hypervisor with ID '8b9b5534-9589-412b-9aae-dc851e27b04c' could not be found. Feb 19 20:50:39.643531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4240690f-2050-483f-98ba-546b1a0ad1de tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] Returning 404 to user: Hypervisor with ID '8b9b5534-9589-412b-9aae-dc851e27b04c' could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:39.646010 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4240690f-2050-483f-98ba-546b1a0ad1de tempest-HypervisorAdminNegativeTestJSON-1310235316 tempest-HypervisorAdminNegativeTestJSON-1310235316-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/8b9b5534-9589-412b-9aae-dc851e27b04c" status: 404 len: 123 microversion: 2.1 time: 0.013934 Feb 19 20:50:39.647935 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 74/138] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 20:50:39 2022] GET /compute/v2.1/os-hypervisors/8b9b5534-9589-412b-9aae-dc851e27b04c => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:40.364570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91264b93-1f76-4bec-a0b0-7f0cdf88bf36 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:40.375234 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-91264b93-1f76-4bec-a0b0-7f0cdf88bf36 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 1.296154 Feb 19 20:50:40.376152 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 65/139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:39 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:41.393711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b1228ae-0fcf-479e-ae17-529dac26d1e0 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:41.394463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b1228ae-0fcf-479e-ae17-529dac26d1e0 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:41.403870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b1228ae-0fcf-479e-ae17-529dac26d1e0 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:41.404348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b1228ae-0fcf-479e-ae17-529dac26d1e0 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:41.405143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b1228ae-0fcf-479e-ae17-529dac26d1e0 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:41.405578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b1228ae-0fcf-479e-ae17-529dac26d1e0 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:41.688111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4b1228ae-0fcf-479e-ae17-529dac26d1e0 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:41.697941 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b1228ae-0fcf-479e-ae17-529dac26d1e0 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.308044 Feb 19 20:50:41.702400 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 75/140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:41 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:42.720730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3e440cc1-8f45-46c1-bcb8-535ffafdce3b tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:42.721492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3e440cc1-8f45-46c1-bcb8-535ffafdce3b tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:42.736429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e440cc1-8f45-46c1-bcb8-535ffafdce3b tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:42.736429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e440cc1-8f45-46c1-bcb8-535ffafdce3b tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:42.737350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e440cc1-8f45-46c1-bcb8-535ffafdce3b tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:42.737798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e440cc1-8f45-46c1-bcb8-535ffafdce3b tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:43.267048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3e440cc1-8f45-46c1-bcb8-535ffafdce3b tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:43.275813 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3e440cc1-8f45-46c1-bcb8-535ffafdce3b tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.560702 Feb 19 20:50:43.277094 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 66/141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:42 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:44.303715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-da0c5868-9b80-4678-a39f-9189efec1ac8 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:44.307414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-da0c5868-9b80-4678-a39f-9189efec1ac8 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:44.319764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da0c5868-9b80-4678-a39f-9189efec1ac8 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:44.320480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da0c5868-9b80-4678-a39f-9189efec1ac8 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:44.322575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da0c5868-9b80-4678-a39f-9189efec1ac8 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:44.325988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da0c5868-9b80-4678-a39f-9189efec1ac8 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:44.607465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-da0c5868-9b80-4678-a39f-9189efec1ac8 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:44.620606 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-da0c5868-9b80-4678-a39f-9189efec1ac8 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.328848 Feb 19 20:50:44.631956 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 76/142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:44 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:45.638926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ac401ea2-8ae6-499b-adaa-edcd33198e3d tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:45.647537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ac401ea2-8ae6-499b-adaa-edcd33198e3d tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:45.661314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac401ea2-8ae6-499b-adaa-edcd33198e3d tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:45.661880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac401ea2-8ae6-499b-adaa-edcd33198e3d tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:45.662834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac401ea2-8ae6-499b-adaa-edcd33198e3d tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:45.663458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac401ea2-8ae6-499b-adaa-edcd33198e3d tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:45.890300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ac401ea2-8ae6-499b-adaa-edcd33198e3d tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:45.897616 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ac401ea2-8ae6-499b-adaa-edcd33198e3d tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.262734 Feb 19 20:50:45.898834 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 67/143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:45 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:46.198426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab05c748-0d96-4735-9433-728d601de8fb tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Calling method '.version_select at 0x7f6474795160>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:46.300247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-05d87158-7d8f-41fa-85f7-54e030ed6114 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:46.318539 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-05d87158-7d8f-41fa-85f7-54e030ed6114 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.418663 Feb 19 20:50:46.319447 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 68/144] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:50:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:46.653870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45317fae-9507-4c27-9434-6d99a75fce24 tempest-InstanceUsageAuditLogNegativeTestJSON-88727003 tempest-InstanceUsageAuditLogNegativeTestJSON-88727003-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:46.654966 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:46.654966 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:46.656657 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-45317fae-9507-4c27-9434-6d99a75fce24 tempest-InstanceUsageAuditLogNegativeTestJSON-88727003 tempest-InstanceUsageAuditLogNegativeTestJSON-88727003-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Feb 19 20:50:46.657217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45317fae-9507-4c27-9434-6d99a75fce24 tempest-InstanceUsageAuditLogNegativeTestJSON-88727003 tempest-InstanceUsageAuditLogNegativeTestJSON-88727003-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:46.658041 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45317fae-9507-4c27-9434-6d99a75fce24 tempest-InstanceUsageAuditLogNegativeTestJSON-88727003 tempest-InstanceUsageAuditLogNegativeTestJSON-88727003-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.336886 Feb 19 20:50:46.658565 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 69/145] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Feb 19 20:50:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 339 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:50:46.716916 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab05c748-0d96-4735-9433-728d601de8fb tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/96cdbb4fc2394031a91a13c9a670d2f7" status: 200 len: 371 microversion: 2.1 time: 1.074029 Feb 19 20:50:46.723517 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 77/146] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 20:50:45 2022] GET /compute/v2.1/os-quota-sets/96cdbb4fc2394031a91a13c9a670d2f7 => generated 371 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:50:46.948159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e5d9b3a0-7ec7-41a8-862f-11118486d2f6 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:46.949413 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:46.949413 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:46.952056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e5d9b3a0-7ec7-41a8-862f-11118486d2f6 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f9c78cd5ae934fd1aeff3011fc187cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3d5a3b5d89480c90dd6e00ab650e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:46.953079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e5d9b3a0-7ec7-41a8-862f-11118486d2f6 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:46.954028 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e5d9b3a0-7ec7-41a8-862f-11118486d2f6 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.229523 Feb 19 20:50:46.955311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 78/147] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Feb 19 20:50:46 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:46.960968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71831e9f-3985-4b2f-8591-beeafbebdc8c tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-642217094", "id": 371833671, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:46.962682 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:46.962682 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:46.965063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9ad14ae9-27d1-49f7-8539-80bbae16dd9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Action: 'update', calling method: .version_select at 0x7f64747801f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:46.975365 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:46.975365 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:46.990206 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71831e9f-3985-4b2f-8591-beeafbebdc8c tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.326327 Feb 19 20:50:46.992664 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 70/148] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:46 2022] POST /compute/v2.1/flavors => generated 421 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:47.185832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ad14ae9-27d1-49f7-8539-80bbae16dd9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:47.186522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ad14ae9-27d1-49f7-8539-80bbae16dd9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:47.188155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ad14ae9-27d1-49f7-8539-80bbae16dd9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:47.189889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ad14ae9-27d1-49f7-8539-80bbae16dd9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:47.276161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-37684e45-ca82-4b0d-b5da-7e059d1291a3 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2130475584", "id": 1590535093, "os-flavor-access:is_public": "False"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:47.307328 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-37684e45-ca82-4b0d-b5da-7e059d1291a3 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.311635 Feb 19 20:50:47.310268 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 71/149] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:46 2022] POST /compute/v2.1/flavors => generated 431 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:47.320420 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9ad14ae9-27d1-49f7-8539-80bbae16dd9e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/96cdbb4fc2394031a91a13c9a670d2f7" status: 200 len: 328 microversion: 2.1 time: 0.360377 Feb 19 20:50:47.321596 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 79/150] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:50:46 2022] PUT /compute/v2.1/os-quota-sets/96cdbb4fc2394031a91a13c9a670d2f7 => generated 328 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:47.321755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bbbca1ac-5b28-4aff-96a1-ee5dee0fbaa1 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:47.322564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bbbca1ac-5b28-4aff-96a1-ee5dee0fbaa1 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:47.326753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f6ec151-d76b-4525-bc0e-579080d878c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:47.327710 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:47.327710 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:47.329180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1f6ec151-d76b-4525-bc0e-579080d878c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f9c78cd5ae934fd1aeff3011fc187cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3d5a3b5d89480c90dd6e00ab650e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:47.329924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f6ec151-d76b-4525-bc0e-579080d878c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:50:47.330682 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f6ec151-d76b-4525-bc0e-579080d878c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183 tempest-InstanceUsageAuditLogNegativeTestJSON-1492518183-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-02-19 20:50:46" status: 403 len: 128 microversion: 2.1 time: 0.008124 Feb 19 20:50:47.331640 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 80/151] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 20:50:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-02-19%2020%3A50%3A46 => generated 128 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:50:47.339965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9aa64586-43bb-4f0b-8d3f-28b751d3b6cf tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:47.342166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbbca1ac-5b28-4aff-96a1-ee5dee0fbaa1 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:47.342717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbbca1ac-5b28-4aff-96a1-ee5dee0fbaa1 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:47.343524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbbca1ac-5b28-4aff-96a1-ee5dee0fbaa1 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:47.343952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbbca1ac-5b28-4aff-96a1-ee5dee0fbaa1 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:47.351529 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9aa64586-43bb-4f0b-8d3f-28b751d3b6cf tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018035 Feb 19 20:50:47.356027 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 81/152] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Feb 19 20:50:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:50:47.360208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f19b545e-6a11-488b-90fa-a2148b8cd923 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b50489cd0f73467db1f8a88a07eb9166"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:47.361949 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:47.361949 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:47.612400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bbbca1ac-5b28-4aff-96a1-ee5dee0fbaa1 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:47.627167 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bbbca1ac-5b28-4aff-96a1-ee5dee0fbaa1 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.312990 Feb 19 20:50:47.638730 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 72/153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:47 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:47.643416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7799c22c-3759-4112-bce6-641f46ed6117 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:47.644660 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:47.644660 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:47.660653 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7799c22c-3759-4112-bce6-641f46ed6117 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-quota-sets/96cdbb4fc2394031a91a13c9a670d2f7" status: 202 len: 0 microversion: 2.1 time: 0.020549 Feb 19 20:50:47.662413 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 73/154] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 20:50:47 2022] DELETE /compute/v2.1/os-quota-sets/96cdbb4fc2394031a91a13c9a670d2f7 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:47.675489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b4fe0d81-c017-4f31-91b3-23634f249cf2 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1153671442", "id": 2045598703, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:47.681105 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:47.681105 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:47.714964 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b4fe0d81-c017-4f31-91b3-23634f249cf2 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.050364 Feb 19 20:50:47.726017 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 74/155] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:47 2022] POST /compute/v2.1/flavors => generated 425 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:47.736614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dd0d49ab-3436-4b90-9561-bcc7fcb58492 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Calling method '.version_select at 0x7f647472c040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:47.954351 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f19b545e-6a11-488b-90fa-a2148b8cd923 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1590535093/action" status: 200 len: 97 microversion: 2.1 time: 0.600696 Feb 19 20:50:47.958797 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 82/156] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Feb 19 20:50:47 2022] POST /compute/v2.1/flavors/1590535093/action => generated 97 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:50:47.981495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7d13eca3-482a-44ba-8577-3041b1a39021 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:47.995022 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7d13eca3-482a-44ba-8577-3041b1a39021 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029241 Feb 19 20:50:48.002550 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 83/157] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Feb 19 20:50:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:50:48.134870 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dd0d49ab-3436-4b90-9561-bcc7fcb58492 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/96cdbb4fc2394031a91a13c9a670d2f7" status: 200 len: 371 microversion: 2.1 time: 0.407478 Feb 19 20:50:48.135872 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 75/158] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 20:50:47 2022] GET /compute/v2.1/os-quota-sets/96cdbb4fc2394031a91a13c9a670d2f7 => generated 371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:48.141308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-806b3ec9-b3ba-4b12-89c8-cf0727021785 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Action: 'create', calling method: .version_select at 0x7f647473eee0>, body: {"keypair": {"name": "tempest-keypair-1148996651"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:48.173651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-806b3ec9-b3ba-4b12-89c8-cf0727021785 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Getting quotas for project 04d2b5b9a01e4133b1f4f7f351cf0c0a. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:50:48.186675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-806b3ec9-b3ba-4b12-89c8-cf0727021785 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Getting quotas for user 1fc7244fbf3b4298b92daf9e442fe669 and project 04d2b5b9a01e4133b1f4f7f351cf0c0a. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:50:48.347242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6631b2ee-dfd7-4060-bc60-f41b3d4ca0d6 tempest-FlavorsAccessTestJSON-1530462673 tempest-FlavorsAccessTestJSON-1530462673-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:48.399442 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6631b2ee-dfd7-4060-bc60-f41b3d4ca0d6 tempest-FlavorsAccessTestJSON-1530462673 tempest-FlavorsAccessTestJSON-1530462673-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6238 microversion: 2.1 time: 0.395125 Feb 19 20:50:48.400444 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 84/159] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:48 2022] GET /compute/v2.1/flavors/detail => generated 6238 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:48.416057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-95ced918-93f0-4846-a506-47a64ea05a5d tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b50489cd0f73467db1f8a88a07eb9166"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:48.417751 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:48.417751 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:48.508056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-806b3ec9-b3ba-4b12-89c8-cf0727021785 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Getting quotas for project 04d2b5b9a01e4133b1f4f7f351cf0c0a. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:50:48.512536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-806b3ec9-b3ba-4b12-89c8-cf0727021785 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Getting quotas for user 1fc7244fbf3b4298b92daf9e442fe669 and project 04d2b5b9a01e4133b1f4f7f351cf0c0a. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:50:48.529617 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-806b3ec9-b3ba-4b12-89c8-cf0727021785 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.392479 Feb 19 20:50:48.531140 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 76/160] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:50:48 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:48.613356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-feeceddc-8ae1-4fc0-9464-243d7edbba6e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Calling method '.version_select at 0x7f6474772d30>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:49.061913 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-95ced918-93f0-4846-a506-47a64ea05a5d tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1590535093/action" status: 200 len: 21 microversion: 2.1 time: 0.648566 Feb 19 20:50:49.063399 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 85/161] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Feb 19 20:50:48 2022] POST /compute/v2.1/flavors/1590535093/action => generated 21 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:50:49.074638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-60fc7c53-820a-47ab-8326-3729bf4ffd4a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:49.075947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-60fc7c53-820a-47ab-8326-3729bf4ffd4a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:49.083936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60fc7c53-820a-47ab-8326-3729bf4ffd4a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:49.084746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60fc7c53-820a-47ab-8326-3729bf4ffd4a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:49.086617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60fc7c53-820a-47ab-8326-3729bf4ffd4a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:49.087239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60fc7c53-820a-47ab-8326-3729bf4ffd4a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:49.366103 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-feeceddc-8ae1-4fc0-9464-243d7edbba6e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/fe4bbfdec74e4a09949381e5f539671d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.756908 Feb 19 20:50:49.368699 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 77/162] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 20:50:48 2022] GET /compute/v2.1/os-quota-sets/fe4bbfdec74e4a09949381e5f539671d/defaults => generated 371 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:50:49.374609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-83b08d8c-608a-444f-9f57-2863e74a8e81 tempest-FlavorsAccessTestJSON-1530462673 tempest-FlavorsAccessTestJSON-1530462673-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:49.444640 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-83b08d8c-608a-444f-9f57-2863e74a8e81 tempest-FlavorsAccessTestJSON-1530462673 tempest-FlavorsAccessTestJSON-1530462673-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.074473 Feb 19 20:50:49.454791 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 78/163] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:49 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:49.460803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-89300ead-8cf5-4c84-82dc-de8f5d767cb9 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:49.461601 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:49.461601 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:49.482458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-60fc7c53-820a-47ab-8326-3729bf4ffd4a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:49.496127 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-60fc7c53-820a-47ab-8326-3729bf4ffd4a tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.429231 Feb 19 20:50:49.496127 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 86/164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:49 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:49.498113 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-89300ead-8cf5-4c84-82dc-de8f5d767cb9 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1590535093" status: 202 len: 0 microversion: 2.1 time: 0.041880 Feb 19 20:50:49.498776 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 79/165] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:49 2022] DELETE /compute/v2.1/flavors/1590535093 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 20:50:49.506259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c95970cc-bf70-4fba-9b7c-7223d134df33 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:49.550441 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c95970cc-bf70-4fba-9b7c-7223d134df33 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.047504 Feb 19 20:50:49.566781 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 87/166] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:49 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:49.573309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0ff83da0-bb51-4d07-9636-50a344abaaf3 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-624181203", "id": 1339222601, "os-flavor-access:is_public": "False"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:49.579013 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:49.579013 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:49.609307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0ff83da0-bb51-4d07-9636-50a344abaaf3 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.041262 Feb 19 20:50:49.617058 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 88/167] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:49 2022] POST /compute/v2.1/flavors => generated 430 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:49.621967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ebf3a8ea-eb65-41e0-a1b6-8fa0ff0acb15 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:49.622804 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:49.622804 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:49.639480 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ebf3a8ea-eb65-41e0-a1b6-8fa0ff0acb15 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1339222601/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.021169 Feb 19 20:50:49.640082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 89/168] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 20:50:49 2022] GET /compute/v2.1/flavors/1339222601/os-flavor-access => generated 21 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:50:49.655888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f78f435f-eb1f-4f60-82f1-a6e87c33782b tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:49.657156 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:49.657156 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:49.682530 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f78f435f-eb1f-4f60-82f1-a6e87c33782b tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1339222601" status: 202 len: 0 microversion: 2.1 time: 0.031442 Feb 19 20:50:49.690631 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 90/169] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:50:49 2022] DELETE /compute/v2.1/flavors/1339222601 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:50:49.698444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-426678f4-e1bb-4c32-9354-63a4aa2874b4 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:49.761671 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-426678f4-e1bb-4c32-9354-63a4aa2874b4 tempest-FlavorsAccessTestJSON-1444143767 tempest-FlavorsAccessTestJSON-1444143767-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.069894 Feb 19 20:50:49.768492 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 91/170] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:50:49 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:50.124618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-917361404", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:50.242181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:50:50.615849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0a24bdbb-40d0-4236-8cfa-22af3fd3ad81 req-e7bf65f9-7d9b-48d4-af8d-8ac37d24f87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b743c9bb-0af5-4b6e-9c8e-ce4dcb144931", "name": "network-vif-plugged", "status": "completed", "tag": "e518681b-fe3b-4228-801f-07d7dc238409"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:50.619000 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:50.619000 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:50.636761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0a24bdbb-40d0-4236-8cfa-22af3fd3ad81 req-e7bf65f9-7d9b-48d4-af8d-8ac37d24f87a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:50.639670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0a24bdbb-40d0-4236-8cfa-22af3fd3ad81 req-e7bf65f9-7d9b-48d4-af8d-8ac37d24f87a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:50.660890 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0a24bdbb-40d0-4236-8cfa-22af3fd3ad81 req-e7bf65f9-7d9b-48d4-af8d-8ac37d24f87a service nova] Creating event network-vif-plugged:e518681b-fe3b-4228-801f-07d7dc238409 for instance b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 on nch1-master-1 Feb 19 20:50:50.664885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:50:50.665640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:50:50.666512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:50:50.667046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:50:50.667465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:50:50.679776 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0a24bdbb-40d0-4236-8cfa-22af3fd3ad81 req-e7bf65f9-7d9b-48d4-af8d-8ac37d24f87a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.735147 Feb 19 20:50:50.681492 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 92/171] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:50.690764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:50.691292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:50.692185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:50.692682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:50.694457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-edb6e244-0b14-471d-90ac-795f6b0149dc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:50.698670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-edb6e244-0b14-471d-90ac-795f6b0149dc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:50.711946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-edb6e244-0b14-471d-90ac-795f6b0149dc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:50.714004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-edb6e244-0b14-471d-90ac-795f6b0149dc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:50.715296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-edb6e244-0b14-471d-90ac-795f6b0149dc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:50.717830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-edb6e244-0b14-471d-90ac-795f6b0149dc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:50.753587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Getting quotas for project 12afb53ac3a94c5696b1f0bc7955cf96. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:50:50.762810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Getting quotas for user 5df681c4fec04b8cac9cc15e5cdb60e7 and project 12afb53ac3a94c5696b1f0bc7955cf96. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:50:50.809458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:50:50.824783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:50:50.939174 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc7d7e3e-d91a-45fb-b878-af8af0362fe0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391472 Feb 19 20:50:50.939843 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 80/172] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:50:50.953532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9aaa74d5-54e0-4938-a7f9-28cf92192d33 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Action: 'update', calling method: .version_select at 0x7f64747873a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:50.962063 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:50.962063 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:51.368672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9aaa74d5-54e0-4938-a7f9-28cf92192d33 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:51.369631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9aaa74d5-54e0-4938-a7f9-28cf92192d33 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:51.371322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9aaa74d5-54e0-4938-a7f9-28cf92192d33 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:51.371999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9aaa74d5-54e0-4938-a7f9-28cf92192d33 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:51.487341 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9aaa74d5-54e0-4938-a7f9-28cf92192d33 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a7e8f56d948e4cb58be8c81f044fe519" status: 200 len: 328 microversion: 2.1 time: 0.540679 Feb 19 20:50:51.487997 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 81/173] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:50:50 2022] PUT /compute/v2.1/os-quota-sets/a7e8f56d948e4cb58be8c81f044fe519 => generated 328 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:51.501483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-41662f98-17c5-415f-b813-3dee32c86ed6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:51.508109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-41662f98-17c5-415f-b813-3dee32c86ed6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:51.690681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-41662f98-17c5-415f-b813-3dee32c86ed6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:51.704791 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-41662f98-17c5-415f-b813-3dee32c86ed6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1222 microversion: 2.1 time: 0.213386 Feb 19 20:50:51.713889 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 82/174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:51 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:51.722801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9177262d-0ca5-4e9f-b632-257c126100a6 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Calling method '.version_select at 0x7f64759954c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:51.740754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-edb6e244-0b14-471d-90ac-795f6b0149dc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:51.765421 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-edb6e244-0b14-471d-90ac-795f6b0149dc tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 1.078152 Feb 19 20:50:51.767066 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 93/175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:50 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:51.789099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1155781992", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "2045598703", "adminPass": "***", "networks": [{"uuid": "7f07acd1-a33e-40a1-8d3a-c7dcdf49d4e0"}], "security_groups": [{"name": "tempest-securitygroup--1992221030"}], "key_name": "tempest-keypair-1148996651", "user_data": "}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:52.181726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9177262d-0ca5-4e9f-b632-257c126100a6 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:52.193734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9177262d-0ca5-4e9f-b632-257c126100a6 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:52.196446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9177262d-0ca5-4e9f-b632-257c126100a6 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:52.200847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9177262d-0ca5-4e9f-b632-257c126100a6 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:52.225195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] validate_networks() for [('7f07acd1-a33e-40a1-8d3a-c7dcdf49d4e0', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:50:52.250273 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9177262d-0ca5-4e9f-b632-257c126100a6 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/a7e8f56d948e4cb58be8c81f044fe519/detail" status: 200 len: 916 microversion: 2.1 time: 0.534826 Feb 19 20:50:52.251699 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 83/176] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:50:51 2022] GET /compute/v2.1/os-quota-sets/a7e8f56d948e4cb58be8c81f044fe519/detail => generated 916 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:52.512302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Action: 'update', calling method: .version_select at 0x7f647472c3a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:52.516070 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:52.516070 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:52.854252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:52.855594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:52.857151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:52.858075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:52.911259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:52.912118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:52.916117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:52.916975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:53.022345 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-69605efe-f9ed-4873-8997-56fcdf136578 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a7e8f56d948e4cb58be8c81f044fe519?user_id=be933a6b17414921b6b712dff647247b" status: 200 len: 328 microversion: 2.1 time: 0.516042 Feb 19 20:50:53.024039 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 84/177] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Feb 19 20:50:52 2022] PUT /compute/v2.1/os-quota-sets/a7e8f56d948e4cb58be8c81f044fe519?user_id=be933a6b17414921b6b712dff647247b => generated 328 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:53.043911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-423f2015-e0ab-4d51-953d-a41418d1b4ad tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:53.046263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-423f2015-e0ab-4d51-953d-a41418d1b4ad tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:53.057891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-423f2015-e0ab-4d51-953d-a41418d1b4ad tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:53.058579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-423f2015-e0ab-4d51-953d-a41418d1b4ad tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:53.059690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-423f2015-e0ab-4d51-953d-a41418d1b4ad tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:53.060360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-423f2015-e0ab-4d51-953d-a41418d1b4ad tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:53.157601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-423f2015-e0ab-4d51-953d-a41418d1b4ad tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:53.169602 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-423f2015-e0ab-4d51-953d-a41418d1b4ad tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1274 microversion: 2.1 time: 0.142089 Feb 19 20:50:53.170811 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 85/178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:53 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:53.182886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c429d69f-7975-4543-84b7-d67d8474a620 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:53.183514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c429d69f-7975-4543-84b7-d67d8474a620 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:53.197370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c429d69f-7975-4543-84b7-d67d8474a620 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:53.209628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c429d69f-7975-4543-84b7-d67d8474a620 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:53.210944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c429d69f-7975-4543-84b7-d67d8474a620 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:53.212751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c429d69f-7975-4543-84b7-d67d8474a620 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:53.687085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c429d69f-7975-4543-84b7-d67d8474a620 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:53.696718 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c429d69f-7975-4543-84b7-d67d8474a620 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1338 microversion: 2.1 time: 0.522696 Feb 19 20:50:53.697542 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 86/179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:53 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1338 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:53.713524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1f98061e-b892-4e94-817b-ddf4929e712e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Calling method '.version_select at 0x7f6474787dc0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:53.881791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:50:53.882682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:50:53.889090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:50:53.889716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:50:53.890148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:50:53.952881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:53.953362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:53.958106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:53.958727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:54.000193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Getting quotas for project 04d2b5b9a01e4133b1f4f7f351cf0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:50:54.013056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Getting quotas for user 1fc7244fbf3b4298b92daf9e442fe669 and project 04d2b5b9a01e4133b1f4f7f351cf0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:50:54.038351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:50:54.041493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:50:54.164929 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d24e20f6-e277-4c49-aebc-d4b0541e1409 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.393494 Feb 19 20:50:54.179463 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 94/180] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:50:54.187506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6b79e00a-5f13-47f4-ab48-12d75bd80a5f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:54.188122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6b79e00a-5f13-47f4-ab48-12d75bd80a5f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:54.193564 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1f98061e-b892-4e94-817b-ddf4929e712e tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/a7e8f56d948e4cb58be8c81f044fe519?user_id=be933a6b17414921b6b712dff647247b" status: 200 len: 370 microversion: 2.1 time: 0.493908 Feb 19 20:50:54.194181 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 87/181] 10.222.0.30 () {58 vars in 1322 bytes} [Sat Feb 19 20:50:53 2022] GET /compute/v2.1/os-quota-sets/a7e8f56d948e4cb58be8c81f044fe519?user_id=be933a6b17414921b6b712dff647247b => generated 370 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:54.216187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ea845578-0567-4817-b1b8-9870b665ec9e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:54.217444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ea845578-0567-4817-b1b8-9870b665ec9e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:54.225532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea845578-0567-4817-b1b8-9870b665ec9e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:54.226824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea845578-0567-4817-b1b8-9870b665ec9e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:54.227777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea845578-0567-4817-b1b8-9870b665ec9e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:54.228416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea845578-0567-4817-b1b8-9870b665ec9e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:54.522935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ea845578-0567-4817-b1b8-9870b665ec9e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:54.534158 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ea845578-0567-4817-b1b8-9870b665ec9e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1280 microversion: 2.1 time: 0.338118 Feb 19 20:50:54.534960 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 88/182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:54 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:54.555073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b79e00a-5f13-47f4-ab48-12d75bd80a5f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:54.571618 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6b79e00a-5f13-47f4-ab48-12d75bd80a5f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1265 microversion: 2.1 time: 0.390828 Feb 19 20:50:54.572251 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 95/183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:54 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1265 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:54.718168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5dde570-f846-4284-bab4-15ddebb1c169 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:54.718794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b5dde570-f846-4284-bab4-15ddebb1c169 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:54.729552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5dde570-f846-4284-bab4-15ddebb1c169 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:54.731114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5dde570-f846-4284-bab4-15ddebb1c169 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:54.732056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5dde570-f846-4284-bab4-15ddebb1c169 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:54.732616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5dde570-f846-4284-bab4-15ddebb1c169 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:54.965202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b5dde570-f846-4284-bab4-15ddebb1c169 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:54.972636 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b5dde570-f846-4284-bab4-15ddebb1c169 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1488 microversion: 2.1 time: 0.258805 Feb 19 20:50:54.973981 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 89/184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:54 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1488 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:54.993151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-48322958-96b5-4f50-a0b5-52312a5a33b3 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:54.994499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-48322958-96b5-4f50-a0b5-52312a5a33b3 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:55.002953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48322958-96b5-4f50-a0b5-52312a5a33b3 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:55.003690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48322958-96b5-4f50-a0b5-52312a5a33b3 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:55.004859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48322958-96b5-4f50-a0b5-52312a5a33b3 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:55.005445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48322958-96b5-4f50-a0b5-52312a5a33b3 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:55.198378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e31a5251-9099-4d8c-babd-f1dda01d5183 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Calling method '.version_select at 0x7f64746a4d30>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:55.511814 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e31a5251-9099-4d8c-babd-f1dda01d5183 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/fe4bbfdec74e4a09949381e5f539671d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.318141 Feb 19 20:50:55.512892 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 90/185] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 20:50:55 2022] GET /compute/v2.1/os-quota-sets/fe4bbfdec74e4a09949381e5f539671d/defaults => generated 371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:55.528350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d84f12f9-83ff-4bd2-b171-fbab0c17085d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Action: 'update', calling method: .version_select at 0x7f64746a49d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:55.531901 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:55.531901 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:55.685815 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-48322958-96b5-4f50-a0b5-52312a5a33b3 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1639 microversion: 2.1 time: 0.696915 Feb 19 20:50:55.686429 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 96/186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:54 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1639 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:55.699600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-31a34fe1-f190-4732-b808-bfd582e5a2e4 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:55.702348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-31a34fe1-f190-4732-b808-bfd582e5a2e4 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:55.714094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31a34fe1-f190-4732-b808-bfd582e5a2e4 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:55.714704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31a34fe1-f190-4732-b808-bfd582e5a2e4 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:55.715730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31a34fe1-f190-4732-b808-bfd582e5a2e4 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:55.716421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31a34fe1-f190-4732-b808-bfd582e5a2e4 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:55.792865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d84f12f9-83ff-4bd2-b171-fbab0c17085d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:55.794753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d84f12f9-83ff-4bd2-b171-fbab0c17085d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:55.798450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-31a34fe1-f190-4732-b808-bfd582e5a2e4 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:55.803236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d84f12f9-83ff-4bd2-b171-fbab0c17085d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:55.804314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d84f12f9-83ff-4bd2-b171-fbab0c17085d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:55.807944 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-31a34fe1-f190-4732-b808-bfd582e5a2e4 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1280 microversion: 2.1 time: 0.113654 Feb 19 20:50:55.809237 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 97/187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:55 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1280 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:55.813944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44de78ea-970f-4d2a-9f67-2aa9b725d8f2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:55.814795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-44de78ea-970f-4d2a-9f67-2aa9b725d8f2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:55.837386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44de78ea-970f-4d2a-9f67-2aa9b725d8f2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:55.838010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44de78ea-970f-4d2a-9f67-2aa9b725d8f2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:55.838898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44de78ea-970f-4d2a-9f67-2aa9b725d8f2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:55.840660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44de78ea-970f-4d2a-9f67-2aa9b725d8f2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:55.957723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44de78ea-970f-4d2a-9f67-2aa9b725d8f2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:55.972270 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44de78ea-970f-4d2a-9f67-2aa9b725d8f2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1269 microversion: 2.1 time: 0.159829 Feb 19 20:50:55.974297 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 98/188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:55 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:55.987507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-de7e7854-220b-4b69-bf74-e3a6c395b3b5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:55.989143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-de7e7854-220b-4b69-bf74-e3a6c395b3b5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:56.015835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de7e7854-220b-4b69-bf74-e3a6c395b3b5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:56.017227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de7e7854-220b-4b69-bf74-e3a6c395b3b5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:56.018822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de7e7854-220b-4b69-bf74-e3a6c395b3b5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:56.019801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de7e7854-220b-4b69-bf74-e3a6c395b3b5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:56.059231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-de7e7854-220b-4b69-bf74-e3a6c395b3b5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:50:56.233211 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d84f12f9-83ff-4bd2-b171-fbab0c17085d tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/fe4bbfdec74e4a09949381e5f539671d" status: 200 len: 329 microversion: 2.1 time: 0.711712 Feb 19 20:50:56.240365 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 91/189] 10.222.0.30 () {60 vars in 1262 bytes} [Sat Feb 19 20:50:55 2022] PUT /compute/v2.1/os-quota-sets/fe4bbfdec74e4a09949381e5f539671d => generated 329 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:56.251560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ed428fb7-b811-47bf-9c14-bcee7d9a7f13 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Action: 'update', calling method: .version_select at 0x7f64746d9af0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:56.275627 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-de7e7854-220b-4b69-bf74-e3a6c395b3b5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 204 len: 0 microversion: 2.1 time: 0.296859 Feb 19 20:50:56.276457 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 99/190] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:50:55 2022] DELETE /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:50:56.287105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cc109a35-66e4-43b5-b49e-cf19b370d439 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:56.287822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cc109a35-66e4-43b5-b49e-cf19b370d439 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:56.295815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc109a35-66e4-43b5-b49e-cf19b370d439 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:56.296534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc109a35-66e4-43b5-b49e-cf19b370d439 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:56.297837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc109a35-66e4-43b5-b49e-cf19b370d439 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:56.298299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc109a35-66e4-43b5-b49e-cf19b370d439 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:56.653077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed428fb7-b811-47bf-9c14-bcee7d9a7f13 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:56.653547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed428fb7-b811-47bf-9c14-bcee7d9a7f13 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:56.654351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed428fb7-b811-47bf-9c14-bcee7d9a7f13 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:56.654791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed428fb7-b811-47bf-9c14-bcee7d9a7f13 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:56.769906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cc109a35-66e4-43b5-b49e-cf19b370d439 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:56.782330 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cc109a35-66e4-43b5-b49e-cf19b370d439 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1494 microversion: 2.1 time: 0.501069 Feb 19 20:50:56.783425 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 100/191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:56 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1494 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:50:56.827524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5808d276-ea70-4808-8579-12d65ab81ddc tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:56.828359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5808d276-ea70-4808-8579-12d65ab81ddc tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:56.841483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5808d276-ea70-4808-8579-12d65ab81ddc tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:56.841694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5808d276-ea70-4808-8579-12d65ab81ddc tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:56.842432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5808d276-ea70-4808-8579-12d65ab81ddc tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:56.842950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5808d276-ea70-4808-8579-12d65ab81ddc tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:56.943658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5808d276-ea70-4808-8579-12d65ab81ddc tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:56.960802 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5808d276-ea70-4808-8579-12d65ab81ddc tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1280 microversion: 2.1 time: 0.136522 Feb 19 20:50:56.972177 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 101/192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:56 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:56.994100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a78285c-f4be-496b-b584-1550906a4a3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:56.995235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a78285c-f4be-496b-b584-1550906a4a3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:57.005780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a78285c-f4be-496b-b584-1550906a4a3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:57.006576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a78285c-f4be-496b-b584-1550906a4a3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:57.008319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a78285c-f4be-496b-b584-1550906a4a3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:57.009032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a78285c-f4be-496b-b584-1550906a4a3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:57.095042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a78285c-f4be-496b-b584-1550906a4a3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:57.103440 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a78285c-f4be-496b-b584-1550906a4a3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1269 microversion: 2.1 time: 0.116301 Feb 19 20:50:57.104639 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 102/193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:56 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:57.166285 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ed428fb7-b811-47bf-9c14-bcee7d9a7f13 tempest-QuotasAdminTestJSON-1505421329 tempest-QuotasAdminTestJSON-1505421329-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/fe4bbfdec74e4a09949381e5f539671d" status: 200 len: 329 microversion: 2.1 time: 0.924592 Feb 19 20:50:57.167281 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 92/194] 10.222.0.30 () {60 vars in 1262 bytes} [Sat Feb 19 20:50:56 2022] PUT /compute/v2.1/os-quota-sets/fe4bbfdec74e4a09949381e5f539671d => generated 329 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:50:57.399706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b9b157d5-b5ac-4ca3-9a57-f0e6bbd417ed tempest-FlavorsV255TestJSON-1002730300 tempest-FlavorsV255TestJSON-1002730300-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1434981042", "id": 458141148, "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:57.401801 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:57.401801 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:57.431353 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b9b157d5-b5ac-4ca3-9a57-f0e6bbd417ed tempest-FlavorsV255TestJSON-1002730300 tempest-FlavorsV255TestJSON-1002730300-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.319761 Feb 19 20:50:57.435547 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 103/195] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 20:50:57 2022] POST /compute/v2.1/flavors => generated 446 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:57.607110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-92279014", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "020891c0-689f-4c7c-a850-6c2b2dfe0076"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:57.678649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] validate_networks() for [('020891c0-689f-4c7c-a850-6c2b2dfe0076', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:50:57.804114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-34aa8bd5-f788-4794-8ab6-c13de89f144c tempest-FlavorsV255TestJSON-381464601 tempest-FlavorsV255TestJSON-381464601-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:57.815254 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-34aa8bd5-f788-4794-8ab6-c13de89f144c tempest-FlavorsV255TestJSON-381464601 tempest-FlavorsV255TestJSON-381464601-project] 10.222.0.30 "GET /compute/v2.1/flavors/458141148" status: 200 len: 446 microversion: 2.55 time: 0.373899 Feb 19 20:50:57.815946 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 104/196] 10.222.0.30 () {60 vars in 1195 bytes} [Sat Feb 19 20:50:57 2022] GET /compute/v2.1/flavors/458141148 => generated 446 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 20:50:57.823508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-79c5d5ff-9ac5-4c4f-9d5c-23a6282cb195 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:57.824415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-79c5d5ff-9ac5-4c4f-9d5c-23a6282cb195 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:57.832488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79c5d5ff-9ac5-4c4f-9d5c-23a6282cb195 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:57.833332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79c5d5ff-9ac5-4c4f-9d5c-23a6282cb195 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:57.834344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79c5d5ff-9ac5-4c4f-9d5c-23a6282cb195 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:57.834980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79c5d5ff-9ac5-4c4f-9d5c-23a6282cb195 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:58.216400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-79c5d5ff-9ac5-4c4f-9d5c-23a6282cb195 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:58.224104 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-79c5d5ff-9ac5-4c4f-9d5c-23a6282cb195 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1494 microversion: 2.1 time: 0.406934 Feb 19 20:50:58.234406 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 105/197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:57 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1494 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:58.240486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-099713a7-7c41-4691-a8d3-f0b98ae07192 tempest-FlavorsV255TestJSON-1002730300 tempest-FlavorsV255TestJSON-1002730300-project-admin] Action: 'update', calling method: .version_select at 0x7f64767d0dc0>, body: {"flavor": {"description": "new"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:58.250898 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:58.250898 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:58.284831 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-099713a7-7c41-4691-a8d3-f0b98ae07192 tempest-FlavorsV255TestJSON-1002730300 tempest-FlavorsV255TestJSON-1002730300-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/458141148" status: 200 len: 447 microversion: 2.55 time: 0.048975 Feb 19 20:50:58.286756 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 106/198] 10.222.0.30 () {62 vars in 1215 bytes} [Sat Feb 19 20:50:58 2022] PUT /compute/v2.1/flavors/458141148 => generated 447 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:50:58.297376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-be223923-1f38-48f2-b8f4-b5eeb350d3d2 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:58.298535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-be223923-1f38-48f2-b8f4-b5eeb350d3d2 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:58.307319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be223923-1f38-48f2-b8f4-b5eeb350d3d2 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:58.308021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be223923-1f38-48f2-b8f4-b5eeb350d3d2 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:58.309027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be223923-1f38-48f2-b8f4-b5eeb350d3d2 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:58.310296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be223923-1f38-48f2-b8f4-b5eeb350d3d2 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:58.404291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-be223923-1f38-48f2-b8f4-b5eeb350d3d2 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:58.417482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-be223923-1f38-48f2-b8f4-b5eeb350d3d2 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1280 microversion: 2.1 time: 0.127127 Feb 19 20:50:58.417482 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 107/199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:58 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:58.423483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2329964a-7ac6-4a43-bae4-7481527a8e83 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:58.424320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2329964a-7ac6-4a43-bae4-7481527a8e83 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:58.434144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2329964a-7ac6-4a43-bae4-7481527a8e83 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:58.434808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2329964a-7ac6-4a43-bae4-7481527a8e83 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:58.436355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2329964a-7ac6-4a43-bae4-7481527a8e83 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:58.437079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2329964a-7ac6-4a43-bae4-7481527a8e83 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:58.576154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2329964a-7ac6-4a43-bae4-7481527a8e83 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:58.590691 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2329964a-7ac6-4a43-bae4-7481527a8e83 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1269 microversion: 2.1 time: 0.170398 Feb 19 20:50:58.602913 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 108/200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:58 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:58.608626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8285c7d6-fd83-4d22-9500-20f7ba3df941 tempest-FlavorsV255TestJSON-381464601 tempest-FlavorsV255TestJSON-381464601-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:58.638509 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8285c7d6-fd83-4d22-9500-20f7ba3df941 tempest-FlavorsV255TestJSON-381464601 tempest-FlavorsV255TestJSON-381464601-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6590 microversion: 2.55 time: 0.033779 Feb 19 20:50:58.639641 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 109/201] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Feb 19 20:50:58 2022] GET /compute/v2.1/flavors/detail => generated 6590 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:50:58.657248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-52e0269d-beac-49b2-bc3c-8b064108259a tempest-FlavorsV255TestJSON-381464601 tempest-FlavorsV255TestJSON-381464601-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:58.687558 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-52e0269d-beac-49b2-bc3c-8b064108259a tempest-FlavorsV255TestJSON-381464601 tempest-FlavorsV255TestJSON-381464601-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.55 time: 0.033687 Feb 19 20:50:58.688588 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 110/202] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:50:58 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:50:58.707820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8eff74ed-ea8b-4d75-87c5-05b2e8631fbb tempest-FlavorsV255TestJSON-1002730300 tempest-FlavorsV255TestJSON-1002730300-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:58.709865 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:58.709865 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:50:58.745454 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8eff74ed-ea8b-4d75-87c5-05b2e8631fbb tempest-FlavorsV255TestJSON-1002730300 tempest-FlavorsV255TestJSON-1002730300-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/458141148" status: 202 len: 0 microversion: 2.55 time: 0.044035 Feb 19 20:50:58.746436 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 111/203] 10.222.0.30 () {60 vars in 1198 bytes} [Sat Feb 19 20:50:58 2022] DELETE /compute/v2.1/flavors/458141148 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:50:58.754851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5bb6e09d-20f0-477a-ad67-340d299f4f97 tempest-FlavorsV255TestJSON-1002730300 tempest-FlavorsV255TestJSON-1002730300-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:58.773274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:50:58.773835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:50:58.774536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:50:58.775126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:50:58.775713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:50:58.776254 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5bb6e09d-20f0-477a-ad67-340d299f4f97 tempest-FlavorsV255TestJSON-1002730300 tempest-FlavorsV255TestJSON-1002730300-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.025371 Feb 19 20:50:58.776944 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 112/204] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Feb 19 20:50:58 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:50:58.797685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:58.798137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:58.798944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:58.799374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:58.828693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Getting quotas for project a6f02f88286b49babe665db9d00787a2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:50:58.834081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Getting quotas for user ec1a2a2db19c41cca4342aa082770a96 and project a6f02f88286b49babe665db9d00787a2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:50:58.862281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:50:58.868167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:50:58.947701 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1b8eaab4-69fc-4d66-8956-19bf5a3b7618 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.776455 Feb 19 20:50:58.948463 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 93/205] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 20:50:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 20:50:58.959015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d76f1f4c-fe3d-4e8a-8222-b4ee0b3dc001 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:58.962425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d76f1f4c-fe3d-4e8a-8222-b4ee0b3dc001 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:59.005358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-1bdf5329-62d8-4742-a538-d37c84b16fd6 req-4b57e8bc-8bac-4b28-ab15-1e9900bb7048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b743c9bb-0af5-4b6e-9c8e-ce4dcb144931", "name": "network-vif-deleted", "tag": "e518681b-fe3b-4228-801f-07d7dc238409"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:50:59.007417 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:50:59.007417 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:50:59.034640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1bdf5329-62d8-4742-a538-d37c84b16fd6 req-4b57e8bc-8bac-4b28-ab15-1e9900bb7048 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.041681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1bdf5329-62d8-4742-a538-d37c84b16fd6 req-4b57e8bc-8bac-4b28-ab15-1e9900bb7048 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.106033 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-1bdf5329-62d8-4742-a538-d37c84b16fd6 req-4b57e8bc-8bac-4b28-ab15-1e9900bb7048 service nova] Creating event network-vif-deleted:e518681b-fe3b-4228-801f-07d7dc238409 for instance b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 on nch1-master-1 Feb 19 20:50:59.108736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1bdf5329-62d8-4742-a538-d37c84b16fd6 req-4b57e8bc-8bac-4b28-ab15-1e9900bb7048 service nova] Acquired lock "compute-rpcapi-router" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:50:59.110148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5de5f62d-646a-4290-a046-143df8ca8aed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.110607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5de5f62d-646a-4290-a046-143df8ca8aed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.111430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5de5f62d-646a-4290-a046-143df8ca8aed None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.116966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5de5f62d-646a-4290-a046-143df8ca8aed None None] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.130782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d76f1f4c-fe3d-4e8a-8222-b4ee0b3dc001 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:59.138414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d76f1f4c-fe3d-4e8a-8222-b4ee0b3dc001 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:59.142539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d76f1f4c-fe3d-4e8a-8222-b4ee0b3dc001 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:59.146101 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.compute.rpcapi [None req-5de5f62d-646a-4290-a046-143df8ca8aed None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 19 20:50:59.147525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5de5f62d-646a-4290-a046-143df8ca8aed None None] Releasing lock "compute-rpcapi-router" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:50:59.157601 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d76f1f4c-fe3d-4e8a-8222-b4ee0b3dc001 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1260 microversion: 2.25 time: 0.188699 Feb 19 20:50:59.158311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 113/206] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:50:58 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:50:59.196433 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5de5f62d-646a-4290-a046-143df8ca8aed None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195484 Feb 19 20:50:59.197257 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 94/207] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:50:59.243667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:59.245214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:59.258797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.259419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.260602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.261593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.308048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.308528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.308994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lazy-loading 'fault' on Instance uuid b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:50:59.415003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3685521a15b40c3a032b34a430be90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f5017f5f74fbaa0f3b36b89acf4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:59.428481 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3a4b6e2d-55e8-4d88-a76c-43c01a1d6a14 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 200 len: 1328 microversion: 2.1 time: 0.186915 Feb 19 20:50:59.436152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aecbdd37-eef3-434f-8aac-98ffdb17711a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:59.436960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aecbdd37-eef3-434f-8aac-98ffdb17711a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:59.439226 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 114/208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:59 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 1328 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:50:59.444858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aecbdd37-eef3-434f-8aac-98ffdb17711a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.445291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aecbdd37-eef3-434f-8aac-98ffdb17711a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.446095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aecbdd37-eef3-434f-8aac-98ffdb17711a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.446528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aecbdd37-eef3-434f-8aac-98ffdb17711a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.545356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aecbdd37-eef3-434f-8aac-98ffdb17711a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:59.555474 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aecbdd37-eef3-434f-8aac-98ffdb17711a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1280 microversion: 2.1 time: 0.124261 Feb 19 20:50:59.556209 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 95/209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:59 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:50:59.610022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-acbc5a19-9a5a-4f70-b228-a2c1dce21294 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:50:59.610854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-acbc5a19-9a5a-4f70-b228-a2c1dce21294 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:50:59.618713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-acbc5a19-9a5a-4f70-b228-a2c1dce21294 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.619157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-acbc5a19-9a5a-4f70-b228-a2c1dce21294 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.623680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-acbc5a19-9a5a-4f70-b228-a2c1dce21294 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:50:59.624177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-acbc5a19-9a5a-4f70-b228-a2c1dce21294 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:50:59.718673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-acbc5a19-9a5a-4f70-b228-a2c1dce21294 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:50:59.736079 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-acbc5a19-9a5a-4f70-b228-a2c1dce21294 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1269 microversion: 2.1 time: 0.128477 Feb 19 20:50:59.737823 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 115/210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:50:59 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1269 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:00.177418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:00.178019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:00.184543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.184984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.185749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.186342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.214168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-884057036", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:00.248943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:00.257396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:00.259455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:00.264352 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bce0da4c-fecc-482e-9b40-ae2b9398c653 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1264 microversion: 2.25 time: 0.090676 Feb 19 20:51:00.276121 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 116/211] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:00 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1264 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:00.284174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:51:00.451250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7567def5-6d3b-47d5-b98a-583256ac2509 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:00.451864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7567def5-6d3b-47d5-b98a-583256ac2509 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:00.461040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7567def5-6d3b-47d5-b98a-583256ac2509 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.462351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7567def5-6d3b-47d5-b98a-583256ac2509 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.464511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7567def5-6d3b-47d5-b98a-583256ac2509 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.465300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7567def5-6d3b-47d5-b98a-583256ac2509 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.490472 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-7567def5-6d3b-47d5-b98a-583256ac2509 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] HTTP exception thrown: Instance b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 could not be found. Feb 19 20:51:00.491505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7567def5-6d3b-47d5-b98a-583256ac2509 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Returning 404 to user: Instance b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:00.492574 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7567def5-6d3b-47d5-b98a-583256ac2509 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 404 len: 111 microversion: 2.1 time: 0.049736 Feb 19 20:51:00.493694 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 117/212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:00 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:51:00.504781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7b9d65e-00e7-47cc-898e-b7cc4b46947b tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:00.506633 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:00.506633 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:00.507388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:51:00.508005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:51:00.508438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:51:00.509085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:51:00.509567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:51:00.517493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7b9d65e-00e7-47cc-898e-b7cc4b46947b tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.518577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7b9d65e-00e7-47cc-898e-b7cc4b46947b tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.520274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.520834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.521890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.522409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.547764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:00.553271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for user c26bc5048c9849218cadd12475cd5fbe and project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:00.565544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:51:00.572423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:51:00.644693 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-83fb2e16-e433-490e-9c1d-82c89dc75054 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700310 Feb 19 20:51:00.645788 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 96/213] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:51:00.651190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-472036f9-23a1-4b2b-a589-71705890c4b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:00.652052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-472036f9-23a1-4b2b-a589-71705890c4b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:00.662587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-472036f9-23a1-4b2b-a589-71705890c4b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.663501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-472036f9-23a1-4b2b-a589-71705890c4b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.665190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-472036f9-23a1-4b2b-a589-71705890c4b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.665998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-472036f9-23a1-4b2b-a589-71705890c4b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.687782 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d7b9d65e-00e7-47cc-898e-b7cc4b46947b tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 297 microversion: 2.1 time: 0.188699 Feb 19 20:51:00.704852 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 118/214] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:51:00 2022] POST /compute/v2.1/os-aggregates/5/action => generated 297 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:00.711047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-624e9c85-d9d5-409e-9884-d9e30c4a47c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:00.711835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-624e9c85-d9d5-409e-9884-d9e30c4a47c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:00.809957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-472036f9-23a1-4b2b-a589-71705890c4b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:00.818511 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-472036f9-23a1-4b2b-a589-71705890c4b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1280 microversion: 2.1 time: 0.171642 Feb 19 20:51:00.819091 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 97/215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:00 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:00.824639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9472f484-717d-4b1d-b5ee-82cc20abfb96 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:00.826898 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:00.826898 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:00.827911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-624e9c85-d9d5-409e-9884-d9e30c4a47c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:00.836875 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-624e9c85-d9d5-409e-9884-d9e30c4a47c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1212 microversion: 2.1 time: 0.130488 Feb 19 20:51:00.837644 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 119/216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:00 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1212 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:00.842829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fc31665c-2588-42ca-a745-4d4a74070c6f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:00.843764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fc31665c-2588-42ca-a745-4d4a74070c6f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:00.850941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc31665c-2588-42ca-a745-4d4a74070c6f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.851827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc31665c-2588-42ca-a745-4d4a74070c6f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.853405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc31665c-2588-42ca-a745-4d4a74070c6f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.854555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc31665c-2588-42ca-a745-4d4a74070c6f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.867770 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9472f484-717d-4b1d-b5ee-82cc20abfb96 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.046878 Feb 19 20:51:00.870366 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 98/217] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:51:00 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:00.890016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5061ad5c-d89c-4c6c-b812-8e7c26dcde13 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-217338973"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:00.893227 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:00.893227 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:00.897007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.aggregate [None req-5061ad5c-d89c-4c6c-b812-8e7c26dcde13 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Generated uuid f8275603-b543-480a-b217-f09fbfd1fde3 for aggregate {{(pid=136095) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:00.947446 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5061ad5c-d89c-4c6c-b812-8e7c26dcde13 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.062940 Feb 19 20:51:00.951799 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 99/218] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:51:00 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:51:00.961001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71ae1c7f-7bb6-4da6-a155-990321539bbd tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:00.964988 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:00.964988 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:00.989017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71ae1c7f-7bb6-4da6-a155-990321539bbd tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:00.989597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71ae1c7f-7bb6-4da6-a155-990321539bbd tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:00.993651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fc31665c-2588-42ca-a745-4d4a74070c6f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:01.002719 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fc31665c-2588-42ca-a745-4d4a74070c6f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1269 microversion: 2.1 time: 0.163138 Feb 19 20:51:01.004021 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 120/219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:00 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:01.132285 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71ae1c7f-7bb6-4da6-a155-990321539bbd tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.174995 Feb 19 20:51:01.133050 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 100/220] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:51:00 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:51:01.143333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f1e33172-8fd8-4f31-8aef-b74e043b375b tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:01.144166 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:01.144166 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:01.154163 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f1e33172-8fd8-4f31-8aef-b74e043b375b tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.014952 Feb 19 20:51:01.155349 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 121/221] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 20:51:01 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:01.166154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cca1ac54-7e0c-4bbf-8fdc-897da619a95f tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:01.168446 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:01.168446 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:01.178090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cca1ac54-7e0c-4bbf-8fdc-897da619a95f tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:01.178538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cca1ac54-7e0c-4bbf-8fdc-897da619a95f tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:01.283577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:01.284768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:01.291808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:01.292539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:01.293329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:01.293788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:01.312208 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cca1ac54-7e0c-4bbf-8fdc-897da619a95f tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.150739 Feb 19 20:51:01.318182 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 101/222] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Feb 19 20:51:01 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:01.323770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-75fb16b7-5898-4917-8304-d73baf3090d6 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:01.324942 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:01.324942 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:01.350759 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-75fb16b7-5898-4917-8304-d73baf3090d6 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.030988 Feb 19 20:51:01.357479 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 102/223] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:51:01 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:01.364439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-931b1a5b-72c1-4d54-8dfc-6cadc740668d tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-274818927"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:01.367552 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:01.367552 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:01.369115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.aggregate [None req-931b1a5b-72c1-4d54-8dfc-6cadc740668d tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Generated uuid 5d216297-1536-46ac-8a78-3a20f8e23c14 for aggregate {{(pid=136095) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:01.400928 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-931b1a5b-72c1-4d54-8dfc-6cadc740668d tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039703 Feb 19 20:51:01.407602 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 103/224] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:51:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:01.413678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bc18f4d6-499c-4880-8202-7db7045ed1e6 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:01.415245 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:01.415245 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:01.425664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc18f4d6-499c-4880-8202-7db7045ed1e6 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:01.426357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc18f4d6-499c-4880-8202-7db7045ed1e6 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:01.431852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:01.443391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:01.446068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:01.450413 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c08fda4f-f60d-4445-863e-d560906d8939 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1264 microversion: 2.25 time: 0.167619 Feb 19 20:51:01.451211 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 122/225] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:01 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:01.602361 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc18f4d6-499c-4880-8202-7db7045ed1e6 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.193157 Feb 19 20:51:01.603024 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 104/226] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:51:01 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:01.613577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f2c29ca-43f1-4f57-8dbe-21abe8446972 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:01.614609 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:01.614609 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:01.640831 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f2c29ca-43f1-4f57-8dbe-21abe8446972 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.031312 Feb 19 20:51:01.641662 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 123/227] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:51:01 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:01.653204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c6d1f306-e6e4-42cd-a7c3-8f4ad3f0d9db tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:01.655047 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:01.655047 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:01.671722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d1f306-e6e4-42cd-a7c3-8f4ad3f0d9db tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:01.673244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d1f306-e6e4-42cd-a7c3-8f4ad3f0d9db tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:01.687282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41ee1c0c-f69e-4d83-b4c5-a5f16457f5af tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Calling method '.version_select at 0x7f64747000d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:01.759890 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41ee1c0c-f69e-4d83-b4c5-a5f16457f5af tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c" status: 200 len: 636 microversion: 2.1 time: 0.076417 Feb 19 20:51:01.761252 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 124/228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:51:01 2022] GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c => generated 636 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:01.777310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c682fb0-de35-4b44-aba9-8c89332fb412 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Action: 'update_all', calling method: .version_select at 0x7f64745b1280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:01.850207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8c682fb0-de35-4b44-aba9-8c89332fb412 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:01.859192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8c682fb0-de35-4b44-aba9-8c89332fb412 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for user bfad2c65daed40e38992dfc781535f97 and project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:01.872126 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c6d1f306-e6e4-42cd-a7c3-8f4ad3f0d9db tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.223040 Feb 19 20:51:01.873438 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 105/229] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:51:01 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:51:01.884106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5919dc58-dca5-4453-96fe-e3d9c7e6a50f tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:01.884755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5919dc58-dca5-4453-96fe-e3d9c7e6a50f tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:01.900974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5919dc58-dca5-4453-96fe-e3d9c7e6a50f tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:01.901448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5919dc58-dca5-4453-96fe-e3d9c7e6a50f tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:01.905342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5919dc58-dca5-4453-96fe-e3d9c7e6a50f tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:01.905785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5919dc58-dca5-4453-96fe-e3d9c7e6a50f tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:02.092796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5919dc58-dca5-4453-96fe-e3d9c7e6a50f tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:02.103946 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5919dc58-dca5-4453-96fe-e3d9c7e6a50f tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1280 microversion: 2.1 time: 0.222948 Feb 19 20:51:02.104803 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 106/230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:01 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:02.109866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bfdbb4be-3def-48e5-9622-0215ace10f84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:02.110748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bfdbb4be-3def-48e5-9622-0215ace10f84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:02.117513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bfdbb4be-3def-48e5-9622-0215ace10f84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:02.118206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bfdbb4be-3def-48e5-9622-0215ace10f84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:02.119360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bfdbb4be-3def-48e5-9622-0215ace10f84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:02.119947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bfdbb4be-3def-48e5-9622-0215ace10f84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:02.214482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bfdbb4be-3def-48e5-9622-0215ace10f84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:02.223513 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bfdbb4be-3def-48e5-9622-0215ace10f84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1272 microversion: 2.1 time: 0.117431 Feb 19 20:51:02.224097 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 107/231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:02 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:02.229903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0319e591-a04d-4794-9066-5e772fe82f2f tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:02.230823 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:02.230823 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:02.261991 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0319e591-a04d-4794-9066-5e772fe82f2f tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.036380 Feb 19 20:51:02.263363 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 108/232] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:02 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:02.272753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9e124b44-1a34-40a8-a43f-40caacc7658f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:02.274731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9e124b44-1a34-40a8-a43f-40caacc7658f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:02.283402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e124b44-1a34-40a8-a43f-40caacc7658f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:02.283850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e124b44-1a34-40a8-a43f-40caacc7658f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:02.284696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e124b44-1a34-40a8-a43f-40caacc7658f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:02.285124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e124b44-1a34-40a8-a43f-40caacc7658f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:02.363162 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c682fb0-de35-4b44-aba9-8c89332fb412 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.589365 Feb 19 20:51:02.368375 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 125/233] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:51:01 2022] PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 61 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:02.369628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-414f59f5-4df6-41e4-8405-c7b767f00f32 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1255421617"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:02.371152 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:02.371152 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:02.373111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-414f59f5-4df6-41e4-8405-c7b767f00f32 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Generated uuid 16321405-e436-470f-9ac1-590c4b5a0c6f for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:02.427663 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-414f59f5-4df6-41e4-8405-c7b767f00f32 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059334 Feb 19 20:51:02.427663 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 126/234] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:51:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:02.432729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b93f5481-75b9-4355-a924-4125070ab41b tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Calling method '.version_select at 0x7f647457ab80>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:02.578758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9e124b44-1a34-40a8-a43f-40caacc7658f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:02.588946 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9e124b44-1a34-40a8-a43f-40caacc7658f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1317 microversion: 2.1 time: 0.324412 Feb 19 20:51:02.593668 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 109/235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:02 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:02.617749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-215675bc-8d69-420f-ac5e-804ad95ad7e9 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:02.622444 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:02.622444 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:02.642725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-215675bc-8d69-420f-ac5e-804ad95ad7e9 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:02.643581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-215675bc-8d69-420f-ac5e-804ad95ad7e9 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:02.866154 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-215675bc-8d69-420f-ac5e-804ad95ad7e9 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.260289 Feb 19 20:51:02.867805 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 110/236] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:51:02 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:02.874415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:02.875061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:02.893459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:02.893989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:02.894812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:02.895249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:02.929092 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b93f5481-75b9-4355-a924-4125070ab41b tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "DELETE /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.502542 Feb 19 20:51:02.929792 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 127/237] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Feb 19 20:51:02 2022] DELETE /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata/os_version => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:51:02.937856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36bc88f2-a3d5-4b69-bd4e-ee3788af2036 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:02.939356 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:02.939356 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:02.960958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36bc88f2-a3d5-4b69-bd4e-ee3788af2036 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:02.964412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36bc88f2-a3d5-4b69-bd4e-ee3788af2036 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:03.109777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:03.121286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:03.136813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:03.144368 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36bc88f2-a3d5-4b69-bd4e-ee3788af2036 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.212543 Feb 19 20:51:03.148628 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 128/238] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:51:02 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:03.149389 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c4b6f51d-813b-4363-a8b7-13099c8535fd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1318 microversion: 2.25 time: 0.273340 Feb 19 20:51:03.151205 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 111/239] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:02 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:03.154277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-725ceeb3-f65a-465a-812b-490e57528be4 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Calling method '.version_select at 0x7f647455eee0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:03.204293 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-725ceeb3-f65a-465a-812b-490e57528be4 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.056553 Feb 19 20:51:03.205077 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 129/240] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:51:03 2022] GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 37 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:03.209824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9c96cb57-5fb0-40fe-a5da-e171e086259a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:03.211120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9c96cb57-5fb0-40fe-a5da-e171e086259a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:03.223712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c96cb57-5fb0-40fe-a5da-e171e086259a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:03.224307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c96cb57-5fb0-40fe-a5da-e171e086259a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:03.225451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c96cb57-5fb0-40fe-a5da-e171e086259a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:03.226609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c96cb57-5fb0-40fe-a5da-e171e086259a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:03.362232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9c96cb57-5fb0-40fe-a5da-e171e086259a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:03.374229 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9c96cb57-5fb0-40fe-a5da-e171e086259a tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1280 microversion: 2.1 time: 0.167880 Feb 19 20:51:03.386285 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 130/241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:03 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:03.392508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7da9ea34-2517-4f2d-a704-b3f55581708c tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:03.393623 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:03.393623 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:03.404369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e32ba6a2-6580-4dbc-b2d9-263d892dfcca tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] Action: 'create', calling method: .version_select at 0x7f64746d98b0>, body: {"security_group": {"name": "tempest-securitygroup-105295084", "description": "tempest-description-88618159"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:03.434400 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7da9ea34-2517-4f2d-a704-b3f55581708c tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.046460 Feb 19 20:51:03.435300 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 131/242] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:03 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:03.443973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0b8b85a2-8a6b-4cfc-8e73-a014fe527fa8 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Action: 'update_all', calling method: .version_select at 0x7f647457aca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:03.512997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0b8b85a2-8a6b-4cfc-8e73-a014fe527fa8 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:03.521384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0b8b85a2-8a6b-4cfc-8e73-a014fe527fa8 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for user bfad2c65daed40e38992dfc781535f97 and project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:03.931666 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0b8b85a2-8a6b-4cfc-8e73-a014fe527fa8 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.494993 Feb 19 20:51:03.936271 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 132/243] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:51:03 2022] PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 61 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:03.942062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f5104b21-efec-413c-bc1c-5414cfe5076e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:03.943418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f5104b21-efec-413c-bc1c-5414cfe5076e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:03.951142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5104b21-efec-413c-bc1c-5414cfe5076e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:03.951868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5104b21-efec-413c-bc1c-5414cfe5076e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:03.952958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5104b21-efec-413c-bc1c-5414cfe5076e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:03.953606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5104b21-efec-413c-bc1c-5414cfe5076e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:04.063717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f5104b21-efec-413c-bc1c-5414cfe5076e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:04.072090 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f5104b21-efec-413c-bc1c-5414cfe5076e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1270 microversion: 2.1 time: 0.134331 Feb 19 20:51:04.075445 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 133/244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:03 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:04.079960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-980a50b7-76eb-4d8f-b3db-d57105c71a69 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1214077908"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:04.082653 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:04.082653 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:04.085736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-980a50b7-76eb-4d8f-b3db-d57105c71a69 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Generated uuid 9ba1c130-5c5e-4373-8ad0-091d39471fbf for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:04.122891 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-980a50b7-76eb-4d8f-b3db-d57105c71a69 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045745 Feb 19 20:51:04.124159 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 134/245] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:51:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:04.131343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b029e67-f129-47a8-a22f-35b88cbb5d63 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-805365536"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:04.133979 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:04.133979 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:04.136155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-7b029e67-f129-47a8-a22f-35b88cbb5d63 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Generated uuid 116e3fdc-089d-42a8-9803-3660bc4f8375 for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:04.169817 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b029e67-f129-47a8-a22f-35b88cbb5d63 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043818 Feb 19 20:51:04.170553 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 135/246] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:51:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:04.176026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ef1f1fd4-2b03-4eb6-a8bb-5cf7453c8137 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:04.177182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ef1f1fd4-2b03-4eb6-a8bb-5cf7453c8137 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:04.184014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef1f1fd4-2b03-4eb6-a8bb-5cf7453c8137 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:04.184561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef1f1fd4-2b03-4eb6-a8bb-5cf7453c8137 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:04.185477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef1f1fd4-2b03-4eb6-a8bb-5cf7453c8137 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:04.186021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef1f1fd4-2b03-4eb6-a8bb-5cf7453c8137 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:04.298783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ef1f1fd4-2b03-4eb6-a8bb-5cf7453c8137 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:04.308924 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ef1f1fd4-2b03-4eb6-a8bb-5cf7453c8137 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1323 microversion: 2.1 time: 0.137079 Feb 19 20:51:04.310152 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 136/247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:04 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1323 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:04.314865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e364da50-40b8-46fd-a966-a6dabcb4b2a1 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Calling method '.version_select at 0x7f64745b1f70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:04.360114 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e364da50-40b8-46fd-a966-a6dabcb4b2a1 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.048638 Feb 19 20:51:04.360892 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 137/248] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Feb 19 20:51:04 2022] GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata/os_distro => generated 33 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:04.371326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c80f22c1-c844-4d5d-9e4c-ff141f876671 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:04.372202 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:04.372202 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:04.402687 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c80f22c1-c844-4d5d-9e4c-ff141f876671 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.034739 Feb 19 20:51:04.403378 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 138/249] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:04 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:04.409349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:04.410466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:04.420052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:04.421182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:04.422198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:04.422892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:04.594423 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e32ba6a2-6580-4dbc-b2d9-263d892dfcca tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 1.440770 Feb 19 20:51:04.595720 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 112/250] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 20:51:03 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:04.605161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b9ef41ac-c07b-4044-8bbb-774f7486c90e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:04.606571 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:04.606571 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:04.615683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9ef41ac-c07b-4044-8bbb-774f7486c90e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:04.616235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9ef41ac-c07b-4044-8bbb-774f7486c90e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:04.724089 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b9ef41ac-c07b-4044-8bbb-774f7486c90e tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.127263 Feb 19 20:51:04.730209 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 113/251] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:51:04 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:04.735234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ac7a506c-1fda-4315-ad1b-2ac112e6bb48 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Action: 'update_all', calling method: .version_select at 0x7f64746cbee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:04.789762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ac7a506c-1fda-4315-ad1b-2ac112e6bb48 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:04.793932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ac7a506c-1fda-4315-ad1b-2ac112e6bb48 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for user bfad2c65daed40e38992dfc781535f97 and project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:05.068874 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ac7a506c-1fda-4315-ad1b-2ac112e6bb48 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.337106 Feb 19 20:51:05.071699 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 114/252] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:51:04 2022] PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 61 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:05.084878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-72c067db-453b-4fdd-bfc5-d077a2ab51f6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:05.086293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-72c067db-453b-4fdd-bfc5-d077a2ab51f6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:05.100096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72c067db-453b-4fdd-bfc5-d077a2ab51f6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:05.100710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72c067db-453b-4fdd-bfc5-d077a2ab51f6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:05.102813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72c067db-453b-4fdd-bfc5-d077a2ab51f6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:05.103699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72c067db-453b-4fdd-bfc5-d077a2ab51f6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:05.119999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:05.132602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:05.145809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:05.146968 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d8e61c44-11e0-41b1-8b5c-7b79e8b2d745 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.742425 Feb 19 20:51:05.152522 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 139/253] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:04 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:05.161242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c543a388-f2ee-44dd-9a53-f9c497d238d4 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:05.162305 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:05.162305 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:05.169924 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-c543a388-f2ee-44dd-9a53-f9c497d238d4 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Feb 19 20:51:05.171404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c543a388-f2ee-44dd-9a53-f9c497d238d4 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:05.172488 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c543a388-f2ee-44dd-9a53-f9c497d238d4 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.018584 Feb 19 20:51:05.173255 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 140/254] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:51:05 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:51:05.178287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14b2b80f-7d3a-4658-8d06-4240f5b4e16c tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] Action: 'create', calling method: .version_select at 0x7f647457aaf0>, body: {"security_group": {"name": "tempest-securitygroup-701662325", "description": "tempest-description-1947526478"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:05.835908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-72c067db-453b-4fdd-bfc5-d077a2ab51f6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:05.847239 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-72c067db-453b-4fdd-bfc5-d077a2ab51f6 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1322 microversion: 2.1 time: 0.773590 Feb 19 20:51:05.847889 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 115/255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:05 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1322 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:05.853124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7769e6c8-6102-4572-a404-2b488f0c3144 tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:05.854404 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:05.854404 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:05.855375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7769e6c8-6102-4572-a404-2b488f0c3144 tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'cf8b6484328b4ae999dc8ccd44d4129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171eb8a081f74f8a89218e43e188c9b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:05.856371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7769e6c8-6102-4572-a404-2b488f0c3144 tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:05.857354 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7769e6c8-6102-4572-a404-2b488f0c3144 tempest-AggregatesAdminNegativeTestJSON-911130675 tempest-AggregatesAdminNegativeTestJSON-911130675-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.008505 Feb 19 20:51:05.857914 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 116/256] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:51:05 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:05.865231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-94550f71-bdc1-4b86-b155-386d7c262a98 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Calling method '.version_select at 0x7f647472c310>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:05.910468 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-94550f71-bdc1-4b86-b155-386d7c262a98 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.051300 Feb 19 20:51:05.911183 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 117/257] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:51:05 2022] GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 61 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:05.921099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-00614c64-3b96-4db8-9d45-d3551725c7c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:05.921981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-00614c64-3b96-4db8-9d45-d3551725c7c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:05.923531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14b2b80f-7d3a-4658-8d06-4240f5b4e16c tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.748660 Feb 19 20:51:05.924930 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 141/258] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 20:51:05 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:05.929774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00614c64-3b96-4db8-9d45-d3551725c7c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:05.930319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00614c64-3b96-4db8-9d45-d3551725c7c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:05.930458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4db9143d-89b8-4e7b-bd3b-225492222646 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:05.931229 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:05.931229 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:05.931741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00614c64-3b96-4db8-9d45-d3551725c7c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:05.932455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00614c64-3b96-4db8-9d45-d3551725c7c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:05.953683 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-4db9143d-89b8-4e7b-bd3b-225492222646 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Feb 19 20:51:05.954273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4db9143d-89b8-4e7b-bd3b-225492222646 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:05.955282 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4db9143d-89b8-4e7b-bd3b-225492222646 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.029281 Feb 19 20:51:05.956078 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 142/259] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:05 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:51:05.961658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a3036b2-1d75-43dc-b0c0-025e9b3d78a5 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:05.963048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a3036b2-1d75-43dc-b0c0-025e9b3d78a5 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:05.969358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a3036b2-1d75-43dc-b0c0-025e9b3d78a5 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:05.970226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a3036b2-1d75-43dc-b0c0-025e9b3d78a5 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:05.971238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a3036b2-1d75-43dc-b0c0-025e9b3d78a5 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:05.972086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a3036b2-1d75-43dc-b0c0-025e9b3d78a5 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:06.554931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1a3036b2-1d75-43dc-b0c0-025e9b3d78a5 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:06.562514 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1a3036b2-1d75-43dc-b0c0-025e9b3d78a5 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1391 microversion: 2.1 time: 0.605243 Feb 19 20:51:06.563097 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 143/260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:05 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1391 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:06.572513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-00614c64-3b96-4db8-9d45-d3551725c7c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:06.580755 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-00614c64-3b96-4db8-9d45-d3551725c7c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1312 microversion: 2.1 time: 0.668256 Feb 19 20:51:06.588719 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 118/261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:05 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1312 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:06.592759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5017c822-9fcf-4f8a-955c-716232be4111 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:06.594031 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:06.594031 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:06.603420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5017c822-9fcf-4f8a-955c-716232be4111 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:06.603971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5017c822-9fcf-4f8a-955c-716232be4111 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:06.644127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f4fc1aa6-6973-4bcf-8f1c-8f0d6b78e080 req-d88e8675-f65c-40ab-9989-f5c08230d0aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21faddc0-1890-48cc-8dcb-7d45cb05b516", "tag": "eee64491-7aff-40b6-840b-749933ebe597"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:06.645804 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:06.645804 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:06.653865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f4fc1aa6-6973-4bcf-8f1c-8f0d6b78e080 req-d88e8675-f65c-40ab-9989-f5c08230d0aa service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:06.654515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f4fc1aa6-6973-4bcf-8f1c-8f0d6b78e080 req-d88e8675-f65c-40ab-9989-f5c08230d0aa service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:06.666113 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f4fc1aa6-6973-4bcf-8f1c-8f0d6b78e080 req-d88e8675-f65c-40ab-9989-f5c08230d0aa service nova] Creating event network-changed:eee64491-7aff-40b6-840b-749933ebe597 for instance 21faddc0-1890-48cc-8dcb-7d45cb05b516 on nch2-master-1 Feb 19 20:51:06.676599 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f4fc1aa6-6973-4bcf-8f1c-8f0d6b78e080 req-d88e8675-f65c-40ab-9989-f5c08230d0aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112288 Feb 19 20:51:06.677629 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 144/262] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:06.685945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f76d36e-e7b0-4824-a295-d62527aa9191 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Action: 'update_all', calling method: .version_select at 0x7f64745a58b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:06.737135 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5017c822-9fcf-4f8a-955c-716232be4111 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.152910 Feb 19 20:51:06.738391 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 119/263] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:51:06 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:06.762184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-9f76d36e-e7b0-4824-a295-d62527aa9191 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:06.768728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-9f76d36e-e7b0-4824-a295-d62527aa9191 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for user bfad2c65daed40e38992dfc781535f97 and project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:06.802933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f5edb1ad-7eab-4810-83b0-af26815adb4c tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] Action: 'create', calling method: .version_select at 0x7f64746a4c10>, body: {"security_group": {"name": "tempest-securitygroup-697422667", "description": "tempest-description-599742131"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:07.098895 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f76d36e-e7b0-4824-a295-d62527aa9191 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.418114 Feb 19 20:51:07.101555 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 145/264] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:51:06 2022] PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 61 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:07.106832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0b39941-2dd5-48a0-a546-17f8e81fe65a tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-763405192", "name": "tempest-test_aggregate-352910109"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:07.108696 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:07.108696 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:07.111636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-e0b39941-2dd5-48a0-a546-17f8e81fe65a tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Generated uuid 1f0d5bab-ce6d-4428-9812-2921fba540c1 for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:07.159855 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0b39941-2dd5-48a0-a546-17f8e81fe65a tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.056860 Feb 19 20:51:07.161487 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 146/265] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Feb 19 20:51:07 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:07.171160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:07.172348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:07.182007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:07.182726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:07.184074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:07.184726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:07.930985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:07.939307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:07.940838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:07.941922 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2e66a59a-077c-4099-a358-b3bfe6c36b77 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.779325 Feb 19 20:51:07.942479 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 147/266] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:07 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:07.956358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d3e026a9-241c-4975-a1ad-b7814245c045 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:07.957283 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:07.957283 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:07.980653 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d3e026a9-241c-4975-a1ad-b7814245c045 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.036866 Feb 19 20:51:07.981462 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 148/267] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:07 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:07.986592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1b914957-d913-4ccd-a68e-60279053ff1b tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:07.987650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1b914957-d913-4ccd-a68e-60279053ff1b tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:07.994892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b914957-d913-4ccd-a68e-60279053ff1b tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:07.995349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b914957-d913-4ccd-a68e-60279053ff1b tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:07.996145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b914957-d913-4ccd-a68e-60279053ff1b tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:07.996613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b914957-d913-4ccd-a68e-60279053ff1b tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:08.266896 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f5edb1ad-7eab-4810-83b0-af26815adb4c tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.527364 Feb 19 20:51:08.267824 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 120/268] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 20:51:06 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:08.272441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-02b735a5-7cd4-4841-b12a-d8638756aaf3 req-195089f5-f7b7-4b6c-b548-222ec25b69cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da666172-5dd1-484f-aca0-a346a83ecec3", "tag": "8e715e53-af3f-4a70-b33f-5b5471d22747"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:08.274370 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:08.274370 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:08.281858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-02b735a5-7cd4-4841-b12a-d8638756aaf3 req-195089f5-f7b7-4b6c-b548-222ec25b69cc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:08.282312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-02b735a5-7cd4-4841-b12a-d8638756aaf3 req-195089f5-f7b7-4b6c-b548-222ec25b69cc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:08.299848 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-02b735a5-7cd4-4841-b12a-d8638756aaf3 req-195089f5-f7b7-4b6c-b548-222ec25b69cc service nova] Creating event network-changed:8e715e53-af3f-4a70-b33f-5b5471d22747 for instance da666172-5dd1-484f-aca0-a346a83ecec3 on nch2-master-1 Feb 19 20:51:08.306254 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-02b735a5-7cd4-4841-b12a-d8638756aaf3 req-195089f5-f7b7-4b6c-b548-222ec25b69cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037204 Feb 19 20:51:08.307039 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 121/269] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:08.313685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-96596457-5f4b-4592-b139-893a278612b3 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Action: 'update_all', calling method: .version_select at 0x7f64762a18b0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:08.375066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-96596457-5f4b-4592-b139-893a278612b3 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:08.379385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-96596457-5f4b-4592-b139-893a278612b3 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for user bfad2c65daed40e38992dfc781535f97 and project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:08.599801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1b914957-d913-4ccd-a68e-60279053ff1b tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:08.607943 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1b914957-d913-4ccd-a68e-60279053ff1b tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1322 microversion: 2.1 time: 0.625502 Feb 19 20:51:08.608713 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 149/270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:07 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:08.613380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5f2a78b-3a38-4263-b2fd-b309633afbf2 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:08.614141 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:08.614141 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:08.634846 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5f2a78b-3a38-4263-b2fd-b309633afbf2 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.024871 Feb 19 20:51:08.635429 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 150/271] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:08 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:08.642697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b5edb1c-f9c5-4583-9707-627d7aaece80 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:08.643679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9b5edb1c-f9c5-4583-9707-627d7aaece80 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:08.649854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b5edb1c-f9c5-4583-9707-627d7aaece80 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:08.650347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b5edb1c-f9c5-4583-9707-627d7aaece80 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:08.651175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b5edb1c-f9c5-4583-9707-627d7aaece80 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:08.651551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b5edb1c-f9c5-4583-9707-627d7aaece80 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:08.745296 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-96596457-5f4b-4592-b139-893a278612b3 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.436206 Feb 19 20:51:08.745893 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 122/272] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:51:08 2022] PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 64 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:08.750160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2b132a4-9685-463d-a2f2-effc0fc74308 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:08.750874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2b132a4-9685-463d-a2f2-effc0fc74308 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:08.757652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2b132a4-9685-463d-a2f2-effc0fc74308 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:08.758380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2b132a4-9685-463d-a2f2-effc0fc74308 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:08.759312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2b132a4-9685-463d-a2f2-effc0fc74308 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:08.759743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2b132a4-9685-463d-a2f2-effc0fc74308 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:09.341707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9b5edb1c-f9c5-4583-9707-627d7aaece80 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:09.348991 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b5edb1c-f9c5-4583-9707-627d7aaece80 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1391 microversion: 2.1 time: 0.712616 Feb 19 20:51:09.349563 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 151/273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:08 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1391 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:09.354521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5f7a9e0-307c-4567-be16-1ccb5b20c7a6 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1823143591"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:09.355869 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:09.355869 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:09.357522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-a5f7a9e0-307c-4567-be16-1ccb5b20c7a6 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Generated uuid 0ccb7a20-abcf-4733-aecb-f9574fbe0620 for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:09.376310 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a5f7a9e0-307c-4567-be16-1ccb5b20c7a6 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.025725 Feb 19 20:51:09.382464 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 152/274] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:51:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:09.387136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5c466b07-5208-4352-9d77-3498e0138a4a tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] Action: 'create', calling method: .version_select at 0x7f64747000d0>, body: {"security_group": {"name": "tempest-securitygroup-1301774406", "description": "tempest-description-1252317096"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:09.447389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2b132a4-9685-463d-a2f2-effc0fc74308 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:09.454703 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2b132a4-9685-463d-a2f2-effc0fc74308 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1312 microversion: 2.1 time: 0.707840 Feb 19 20:51:09.455292 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 123/275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:08 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1312 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:09.459772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9786f79c-b904-45b6-b97c-297e863bbae9 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:09.461142 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:09.461142 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:09.474221 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9786f79c-b904-45b6-b97c-297e863bbae9 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Feb 19 20:51:09.475095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9786f79c-b904-45b6-b97c-297e863bbae9 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:09.476635 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9786f79c-b904-45b6-b97c-297e863bbae9 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.019854 Feb 19 20:51:09.477200 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 124/276] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:51:09 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:51:09.484400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9bd916f4-ce90-4e05-b5ad-1633ed2169a9 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Calling method '.version_select at 0x7f647472ca60>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:09.525079 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9bd916f4-ce90-4e05-b5ad-1633ed2169a9 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.043917 Feb 19 20:51:09.526125 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 125/277] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:51:09 2022] GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 64 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:09.531258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:09.532010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:09.538806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:09.539249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:09.540035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:09.540505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:09.886197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:09.894536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:09.896161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:09.897397 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-48bc45f7-86c5-4fc2-bf46-348c47045438 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.370813 Feb 19 20:51:09.898353 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 126/278] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:09 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:09.902576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f415fdfd-f13f-400b-a5a7-382a3d774d42 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:09.903850 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:09.903850 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:09.919109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f415fdfd-f13f-400b-a5a7-382a3d774d42 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:09.919765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f415fdfd-f13f-400b-a5a7-382a3d774d42 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:09.924583 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5c466b07-5208-4352-9d77-3498e0138a4a tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.540370 Feb 19 20:51:09.925499 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 153/279] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 20:51:09 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:09.928436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f415fdfd-f13f-400b-a5a7-382a3d774d42 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:09.930123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f415fdfd-f13f-400b-a5a7-382a3d774d42 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:09.935035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e698247a-9dd8-42fe-befd-cc9ae632fc68 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:09.938356 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:09.938356 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:09.950972 ncdv-master-1 devstack@n-api.service[136095]: ERROR nova.api.openstack.compute.aggregates [None req-f415fdfd-f13f-400b-a5a7-382a3d774d42 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Feb 19 20:51:09.951902 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f415fdfd-f13f-400b-a5a7-382a3d774d42 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Feb 19 20:51:09.952445 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e698247a-9dd8-42fe-befd-cc9ae632fc68 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Feb 19 20:51:09.952859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f415fdfd-f13f-400b-a5a7-382a3d774d42 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:09.953341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e698247a-9dd8-42fe-befd-cc9ae632fc68 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:09.954100 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f415fdfd-f13f-400b-a5a7-382a3d774d42 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.054932 Feb 19 20:51:09.954318 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e698247a-9dd8-42fe-befd-cc9ae632fc68 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.027729 Feb 19 20:51:09.954715 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 127/280] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:51:09 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:51:09.955159 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 154/281] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:09 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:51:09.962956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5944aeaf-3826-4bb4-8bb5-480774a31716 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:09.963817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5944aeaf-3826-4bb4-8bb5-480774a31716 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:09.965664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b9e96247-cc6d-4c56-88f7-cd4474f33878 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Action: 'update_all', calling method: .version_select at 0x7f6474595a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:09.969850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5944aeaf-3826-4bb4-8bb5-480774a31716 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:09.970407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5944aeaf-3826-4bb4-8bb5-480774a31716 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:09.971272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5944aeaf-3826-4bb4-8bb5-480774a31716 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:09.971900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5944aeaf-3826-4bb4-8bb5-480774a31716 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:10.018382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b9e96247-cc6d-4c56-88f7-cd4474f33878 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:10.023329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b9e96247-cc6d-4c56-88f7-cd4474f33878 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for user bfad2c65daed40e38992dfc781535f97 and project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:10.119435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5944aeaf-3826-4bb4-8bb5-480774a31716 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:10.127913 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5944aeaf-3826-4bb4-8bb5-480774a31716 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1322 microversion: 2.1 time: 0.171660 Feb 19 20:51:10.128677 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 155/282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:09 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:10.133762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-337b41f8-3ddb-4c93-ac2e-f4fccacdf4ee tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] Calling method '.version_select at 0x7f64745b1e50>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:10.347061 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b9e96247-cc6d-4c56-88f7-cd4474f33878 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.387881 Feb 19 20:51:10.347669 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 128/283] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:51:09 2022] PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 61 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:10.352213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5234cb36-5f07-460e-af13-f8eff5600e7d tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-740721021"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:10.353502 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:10.353502 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:10.354685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.aggregate [None req-5234cb36-5f07-460e-af13-f8eff5600e7d tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Generated uuid 268444bd-8e31-4427-a7de-a5ea41c6588e for aggregate {{(pid=136095) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:10.374658 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5234cb36-5f07-460e-af13-f8eff5600e7d tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.025775 Feb 19 20:51:10.375450 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 129/284] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:51:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:10.380615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f4eb0069-e964-41be-9a21-da4c6a572493 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:10.381462 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:10.381462 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:10.403780 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f4eb0069-e964-41be-9a21-da4c6a572493 tempest-AggregatesAdminNegativeTestJSON-1939650307 tempest-AggregatesAdminNegativeTestJSON-1939650307-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.027202 Feb 19 20:51:10.404824 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 130/285] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:10 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:10.409460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-51db3ca3-cab7-427b-9576-aa343f9e8162 req-f0d9dcd9-efd7-4fd1-b7e2-93e5270796df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24d94c6-d921-42bf-affb-6f8556e5b76d", "tag": "99019bb9-0cfe-4900-a813-f2a3826c4aed"}, {"name": "network-changed", "server_uuid": "f4f05bec-0cf3-4c8d-adda-1f646f93100c", "tag": "283fa0ff-0c52-46c9-86d3-5ee439d6029b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:10.411111 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:10.411111 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:10.419204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-51db3ca3-cab7-427b-9576-aa343f9e8162 req-f0d9dcd9-efd7-4fd1-b7e2-93e5270796df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:10.419801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-51db3ca3-cab7-427b-9576-aa343f9e8162 req-f0d9dcd9-efd7-4fd1-b7e2-93e5270796df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:10.432937 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-51db3ca3-cab7-427b-9576-aa343f9e8162 req-f0d9dcd9-efd7-4fd1-b7e2-93e5270796df service nova] Creating event network-changed:99019bb9-0cfe-4900-a813-f2a3826c4aed for instance d24d94c6-d921-42bf-affb-6f8556e5b76d on nch1-master-1 Feb 19 20:51:10.433516 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-51db3ca3-cab7-427b-9576-aa343f9e8162 req-f0d9dcd9-efd7-4fd1-b7e2-93e5270796df service nova] Creating event network-changed:283fa0ff-0c52-46c9-86d3-5ee439d6029b for instance f4f05bec-0cf3-4c8d-adda-1f646f93100c on nch2-master-1 Feb 19 20:51:10.448069 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-51db3ca3-cab7-427b-9576-aa343f9e8162 req-f0d9dcd9-efd7-4fd1-b7e2-93e5270796df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041367 Feb 19 20:51:10.449851 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 131/286] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:10.454923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a4624ce4-18a3-4c45-81cc-66f433c89a0f tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Action: 'update', calling method: .version_select at 0x7f6474595550>, body: {"meta": {"os_version": "alt"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:10.513472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a4624ce4-18a3-4c45-81cc-66f433c89a0f tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:10.518610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a4624ce4-18a3-4c45-81cc-66f433c89a0f tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for user bfad2c65daed40e38992dfc781535f97 and project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:10.871023 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a4624ce4-18a3-4c45-81cc-66f433c89a0f tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.419793 Feb 19 20:51:10.871627 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 132/287] 10.222.0.30 () {60 vars in 1312 bytes} [Sat Feb 19 20:51:10 2022] PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata/os_version => generated 31 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:10.876915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-376a200d-5a3f-44f9-ba61-45fc11ce631c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:10.877645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-376a200d-5a3f-44f9-ba61-45fc11ce631c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:10.886172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-376a200d-5a3f-44f9-ba61-45fc11ce631c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:10.886549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-376a200d-5a3f-44f9-ba61-45fc11ce631c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:10.887344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-376a200d-5a3f-44f9-ba61-45fc11ce631c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:10.888020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-376a200d-5a3f-44f9-ba61-45fc11ce631c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:11.280222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-376a200d-5a3f-44f9-ba61-45fc11ce631c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:11.288312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-376a200d-5a3f-44f9-ba61-45fc11ce631c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1391 microversion: 2.1 time: 0.415693 Feb 19 20:51:11.289030 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 133/288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:10 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1391 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:11.303287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c93c7203-33bf-402d-9217-46ba0cdce382 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:11.304809 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:11.304809 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:11.314864 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c93c7203-33bf-402d-9217-46ba0cdce382 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.016654 Feb 19 20:51:11.315832 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 134/289] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:51:11 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:11.322425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f221c1ec-a044-4b71-837e-3d60e2d7cf30 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:11.323039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f221c1ec-a044-4b71-837e-3d60e2d7cf30 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:11.329401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f221c1ec-a044-4b71-837e-3d60e2d7cf30 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:11.329850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f221c1ec-a044-4b71-837e-3d60e2d7cf30 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:11.330640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f221c1ec-a044-4b71-837e-3d60e2d7cf30 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:11.331072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f221c1ec-a044-4b71-837e-3d60e2d7cf30 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:11.925070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f221c1ec-a044-4b71-837e-3d60e2d7cf30 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:11.935149 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f221c1ec-a044-4b71-837e-3d60e2d7cf30 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1312 microversion: 2.1 time: 0.617398 Feb 19 20:51:11.945631 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 135/290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:11 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:11.950757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7a56812b-1674-46b7-aa71-52362741705b tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Calling method '.version_select at 0x7f6474595a60>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:12.047306 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7a56812b-1674-46b7-aa71-52362741705b tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.100297 Feb 19 20:51:12.047979 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 136/291] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:51:11 2022] GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 58 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:12.055615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:12.059406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:12.068428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:12.069722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:12.072029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:12.072590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:12.300798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:12.309772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:12.311551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:12.312904 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1b74ca0c-a209-44af-9d73-fa9b05338a31 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.263998 Feb 19 20:51:12.313977 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 137/292] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:12 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:12.325336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ada54b30-6dbb-460d-a3c2-2c2e3ad8bb11 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:12.326035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ada54b30-6dbb-460d-a3c2-2c2e3ad8bb11 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:12.333112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ada54b30-6dbb-460d-a3c2-2c2e3ad8bb11 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:12.334026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ada54b30-6dbb-460d-a3c2-2c2e3ad8bb11 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:12.335397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ada54b30-6dbb-460d-a3c2-2c2e3ad8bb11 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:12.335883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ada54b30-6dbb-460d-a3c2-2c2e3ad8bb11 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:12.539104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ada54b30-6dbb-460d-a3c2-2c2e3ad8bb11 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:12.548511 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ada54b30-6dbb-460d-a3c2-2c2e3ad8bb11 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1322 microversion: 2.1 time: 0.233289 Feb 19 20:51:12.550121 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 138/293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:12 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:12.555184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-74bcc44e-d7e7-4e50-9e6a-378569e1df23 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:12.556694 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:12.556694 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:12.583122 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-74bcc44e-d7e7-4e50-9e6a-378569e1df23 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.031721 Feb 19 20:51:12.583906 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 139/294] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 20:51:12 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:12.589372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-96276373-4c8d-4a6d-acee-30c1a4043399 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Action: 'update_all', calling method: .version_select at 0x7f6474772280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:12.651509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-96276373-4c8d-4a6d-acee-30c1a4043399 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:12.657137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-96276373-4c8d-4a6d-acee-30c1a4043399 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for user bfad2c65daed40e38992dfc781535f97 and project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:12.933717 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-337b41f8-3ddb-4c93-ac2e-f4fccacdf4ee tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10367 microversion: 2.1 time: 2.803481 Feb 19 20:51:12.934307 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 156/295] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Feb 19 20:51:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10367 bytes in 2805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:51:12.938848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-600f8baf-5826-4677-aa59-440a8161f4a3 req-519c3896-71f0-4d9f-968b-3098de6043e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21faddc0-1890-48cc-8dcb-7d45cb05b516", "name": "network-vif-plugged", "status": "completed", "tag": "eee64491-7aff-40b6-840b-749933ebe597"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:12.940641 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:12.940641 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:12.949158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-600f8baf-5826-4677-aa59-440a8161f4a3 req-519c3896-71f0-4d9f-968b-3098de6043e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:12.952718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-600f8baf-5826-4677-aa59-440a8161f4a3 req-519c3896-71f0-4d9f-968b-3098de6043e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:12.973292 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-600f8baf-5826-4677-aa59-440a8161f4a3 req-519c3896-71f0-4d9f-968b-3098de6043e6 service nova] Creating event network-vif-plugged:eee64491-7aff-40b6-840b-749933ebe597 for instance 21faddc0-1890-48cc-8dcb-7d45cb05b516 on nch2-master-1 Feb 19 20:51:12.979311 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-600f8baf-5826-4677-aa59-440a8161f4a3 req-519c3896-71f0-4d9f-968b-3098de6043e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043758 Feb 19 20:51:12.980560 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 157/296] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:12.989745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46f3aab0-7538-44f9-904b-3fffcef898b2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:12.990546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-46f3aab0-7538-44f9-904b-3fffcef898b2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:12.998468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46f3aab0-7538-44f9-904b-3fffcef898b2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:12.999127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46f3aab0-7538-44f9-904b-3fffcef898b2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:13.000083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46f3aab0-7538-44f9-904b-3fffcef898b2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:13.000550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46f3aab0-7538-44f9-904b-3fffcef898b2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:13.030545 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-96276373-4c8d-4a6d-acee-30c1a4043399 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.445751 Feb 19 20:51:13.031254 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 140/297] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:51:12 2022] PUT /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 61 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:13.038448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7b0536f9-a982-4ca2-87f4-0554ab584d43 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:13.039509 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:13.039509 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:13.050449 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7b0536f9-a982-4ca2-87f4-0554ab584d43 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.017955 Feb 19 20:51:13.051368 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 141/298] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:51:13 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:13.065566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-af819cfa-4835-4a16-b5fe-6381b314ea45 tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] Calling method '.version_select at 0x7f6474595c10>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:13.291951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-46f3aab0-7538-44f9-904b-3fffcef898b2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:13.299423 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-46f3aab0-7538-44f9-904b-3fffcef898b2 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1391 microversion: 2.1 time: 0.317631 Feb 19 20:51:13.299997 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 158/299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:12 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:13.304878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-346b04e1-a0bc-486d-be14-c723b3afab8b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:13.305483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-346b04e1-a0bc-486d-be14-c723b3afab8b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:13.311027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-346b04e1-a0bc-486d-be14-c723b3afab8b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:13.311474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-346b04e1-a0bc-486d-be14-c723b3afab8b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:13.312245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-346b04e1-a0bc-486d-be14-c723b3afab8b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:13.312701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-346b04e1-a0bc-486d-be14-c723b3afab8b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:13.394372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-af819cfa-4835-4a16-b5fe-6381b314ea45 tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.341225 Feb 19 20:51:13.394967 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 142/300] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Feb 19 20:51:13 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:13.400401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ba5bc79c-b9df-4c37-8fe0-ac354e7a806c tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Action: 'create', calling method: .version_select at 0x7f64746d98b0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:13.448713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ba5bc79c-b9df-4c37-8fe0-ac354e7a806c tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:13.452403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ba5bc79c-b9df-4c37-8fe0-ac354e7a806c tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Getting quotas for user bfad2c65daed40e38992dfc781535f97 and project 2aca5c599959431ea7c78faa2f7abab2. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:13.465089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-346b04e1-a0bc-486d-be14-c723b3afab8b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:13.473488 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-346b04e1-a0bc-486d-be14-c723b3afab8b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1312 microversion: 2.1 time: 0.172221 Feb 19 20:51:13.479823 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 159/301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:13 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:13.479823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c1f4730-31cc-4fa7-ac9d-467c94009fb7 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:13.479823 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:13.479823 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:13.502482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c1f4730-31cc-4fa7-ac9d-467c94009fb7 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.027294 Feb 19 20:51:13.503134 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 160/302] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:13 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:13.621799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-282cabdf-bb22-4aee-8cca-c0028f474d4a tempest-FlavorMetadataValidation-2042516085 tempest-FlavorMetadataValidation-2042516085-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1535061168", "id": 388828842, "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:13.623328 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:13.623328 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:13.641071 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-282cabdf-bb22-4aee-8cca-c0028f474d4a tempest-FlavorMetadataValidation-2042516085 tempest-FlavorMetadataValidation-2042516085-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.136417 Feb 19 20:51:13.641718 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 161/303] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 20:51:13 2022] POST /compute/v2.1/flavors => generated 468 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:51:13.645862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:13.646528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:13.652955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:13.653392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:13.654146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:13.654572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:13.765965 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ba5bc79c-b9df-4c37-8fe0-ac354e7a806c tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "POST /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.369941 Feb 19 20:51:13.766572 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 143/304] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Feb 19 20:51:13 2022] POST /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 85 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:13.770857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5e7e3292-2632-44ce-a588-334bb6c70a91 tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] Calling method '.version_select at 0x7f64746a4f70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:13.817835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:13.826290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:13.827799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:13.828918 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aa34bbce-cd84-4f3a-92f3-9249a9a64e86 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.186250 Feb 19 20:51:13.829714 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 162/305] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:13 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:13.834090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aad751db-4bb9-4076-b37a-a96b02de2167 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1921654771", "availability_zone": "tempest-test_az-1862396764"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:13.835657 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:13.835657 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:13.836964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.aggregate [None req-aad751db-4bb9-4076-b37a-a96b02de2167 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Generated uuid 19768cf7-13a2-4670-a450-5ad8443d12b7 for aggregate {{(pid=136094) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:13.862258 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aad751db-4bb9-4076-b37a-a96b02de2167 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.031782 Feb 19 20:51:13.863518 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 163/306] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Feb 19 20:51:13 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:13.868919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b5e517b-da53-400e-a3a9-e80bc4d09f43 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:13.869514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b5e517b-da53-400e-a3a9-e80bc4d09f43 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:13.875422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b5e517b-da53-400e-a3a9-e80bc4d09f43 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:13.875871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b5e517b-da53-400e-a3a9-e80bc4d09f43 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:13.876806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b5e517b-da53-400e-a3a9-e80bc4d09f43 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:13.877225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b5e517b-da53-400e-a3a9-e80bc4d09f43 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:13.983324 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5e7e3292-2632-44ce-a588-334bb6c70a91 tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c6483ecc-3dd2-496b-9fb2-86d404ec7d2b" status: 202 len: 0 microversion: 2.1 time: 0.215678 Feb 19 20:51:13.984036 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 144/307] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:51:13 2022] DELETE /compute/v2.1/os-security-groups/c6483ecc-3dd2-496b-9fb2-86d404ec7d2b => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:13.991842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-201a3438-03cc-4078-a134-4cf948844493 tempest-FlavorMetadataValidation-2042516085 tempest-FlavorMetadataValidation-2042516085-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:13.993419 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:13.993419 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:14.049587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4b5e517b-da53-400e-a3a9-e80bc4d09f43 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:14.058123 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b5e517b-da53-400e-a3a9-e80bc4d09f43 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1322 microversion: 2.1 time: 0.193410 Feb 19 20:51:14.067514 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 164/308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:13 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:14.072897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-891cf4ae-1731-4e0a-b7e6-cee7e4937e35 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] Calling method '.version_select at 0x7f64746e18b0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.116779 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-891cf4ae-1731-4e0a-b7e6-cee7e4937e35 tempest-ImagesMetadataTestJSON-1255297605 tempest-ImagesMetadataTestJSON-1255297605-project] 10.222.0.30 "GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.047218 Feb 19 20:51:14.117464 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 165/309] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:51:14 2022] GET /compute/v2.1/images/b02fced0-0472-4cd0-b5ad-2a3eb8248a1c/metadata => generated 85 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:14.122504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ee86c2a8-fe2b-404a-8f29-37aefd051a31 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1921654771_new", "availability_zone": "tempest-test_az-1862396764_new"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:14.198999 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-201a3438-03cc-4078-a134-4cf948844493 tempest-FlavorMetadataValidation-2042516085 tempest-FlavorMetadataValidation-2042516085-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/388828842/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.213633 Feb 19 20:51:14.200535 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 145/310] 10.222.0.30 () {62 vars in 1261 bytes} [Sat Feb 19 20:51:13 2022] POST /compute/v2.1/flavors/388828842/os-extra_specs => generated 62 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:14.206099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-97ca97ae-86bd-4de9-8876-7b67213ce74f tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] Calling method '.version_select at 0x7f6474595dc0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.210297 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:14.210297 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:14.258247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee86c2a8-fe2b-404a-8f29-37aefd051a31 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:14.260687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee86c2a8-fe2b-404a-8f29-37aefd051a31 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:14.299448 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ee86c2a8-fe2b-404a-8f29-37aefd051a31 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.180367 Feb 19 20:51:14.300822 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 166/311] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Feb 19 20:51:14 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:14.308316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4aa3b71a-a9d6-475f-8028-d8489e501447 tempest-FlavorMetadataValidation-2042516085 tempest-FlavorMetadataValidation-2042516085-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.309426 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:14.309426 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:14.332097 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4aa3b71a-a9d6-475f-8028-d8489e501447 tempest-FlavorMetadataValidation-2042516085 tempest-FlavorMetadataValidation-2042516085-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/388828842" status: 202 len: 0 microversion: 2.86 time: 0.029905 Feb 19 20:51:14.334652 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 167/312] 10.222.0.30 () {60 vars in 1198 bytes} [Sat Feb 19 20:51:14 2022] DELETE /compute/v2.1/flavors/388828842 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:51:14.342564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3e81d805-c660-4848-828f-c324eefbc6e5 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.343325 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:14.343325 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:14.350080 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3e81d805-c660-4848-828f-c324eefbc6e5 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.011165 Feb 19 20:51:14.351373 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 168/313] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:51:14 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:14.356558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9a4fb891-deca-42d0-8a56-2c6dc9626e70 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.357855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9a4fb891-deca-42d0-8a56-2c6dc9626e70 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:14.365624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a4fb891-deca-42d0-8a56-2c6dc9626e70 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:14.366895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a4fb891-deca-42d0-8a56-2c6dc9626e70 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:14.367862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a4fb891-deca-42d0-8a56-2c6dc9626e70 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:14.368299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a4fb891-deca-42d0-8a56-2c6dc9626e70 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:14.466044 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-97ca97ae-86bd-4de9-8876-7b67213ce74f tempest-SecurityGroupsTestAdminJSON-1549933124 tempest-SecurityGroupsTestAdminJSON-1549933124-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/79e4c4d3-5b93-4010-99bd-bc9e5a8f4ddf" status: 202 len: 0 microversion: 2.1 time: 0.263847 Feb 19 20:51:14.466906 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 146/314] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:51:14 2022] DELETE /compute/v2.1/os-security-groups/79e4c4d3-5b93-4010-99bd-bc9e5a8f4ddf => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:14.473477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-889748cb-1e18-40c6-851c-10050f7d6a0b tempest-FlavorMetadataValidation-2042516085 tempest-FlavorMetadataValidation-2042516085-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.500572 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-889748cb-1e18-40c6-851c-10050f7d6a0b tempest-FlavorMetadataValidation-2042516085 tempest-FlavorMetadataValidation-2042516085-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6681 microversion: 2.86 time: 0.032246 Feb 19 20:51:14.501340 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 147/315] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Feb 19 20:51:14 2022] GET /compute/v2.1/flavors/detail => generated 6681 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:14.506456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c45dedb1-62e8-4baf-952e-253cb0705b2e tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.507404 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:14.507404 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:14.537278 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c45dedb1-62e8-4baf-952e-253cb0705b2e tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.034375 Feb 19 20:51:14.539175 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 148/316] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:14 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:14.544304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e45f9e08-9f57-43b9-9d24-0a2297a9b58a tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] Calling method '.version_select at 0x7f64746d9550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.612776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9a4fb891-deca-42d0-8a56-2c6dc9626e70 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:14.620226 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9a4fb891-deca-42d0-8a56-2c6dc9626e70 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1391 microversion: 2.1 time: 0.267575 Feb 19 20:51:14.625346 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 169/317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:14 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1391 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:14.632674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-556d2fd4-2471-4192-8ef7-724946128ddf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.633475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-556d2fd4-2471-4192-8ef7-724946128ddf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:14.645885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-556d2fd4-2471-4192-8ef7-724946128ddf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:14.646502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-556d2fd4-2471-4192-8ef7-724946128ddf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:14.647993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-556d2fd4-2471-4192-8ef7-724946128ddf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:14.648594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-556d2fd4-2471-4192-8ef7-724946128ddf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:14.884088 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e45f9e08-9f57-43b9-9d24-0a2297a9b58a tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/8b4d32bc-8958-43bc-bdd7-5d60238020d2" status: 202 len: 0 microversion: 2.1 time: 0.343451 Feb 19 20:51:14.884769 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 149/318] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:51:14 2022] DELETE /compute/v2.1/os-security-groups/8b4d32bc-8958-43bc-bdd7-5d60238020d2 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:14.893929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a1b2d809-05a8-4339-b62d-7ea5e54a247c tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-628792461"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:14.912469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-556d2fd4-2471-4192-8ef7-724946128ddf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:14.921549 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-556d2fd4-2471-4192-8ef7-724946128ddf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1312 microversion: 2.1 time: 0.295401 Feb 19 20:51:14.922486 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 170/319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:14 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:14.929065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:14.930260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:14.937894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:14.938625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:14.939668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:14.940371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:14.948412 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:14.948412 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:14.951141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.aggregate [None req-a1b2d809-05a8-4339-b62d-7ea5e54a247c tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Generated uuid bd4d472f-e999-40f0-b061-54ad9d2bbb30 for aggregate {{(pid=136095) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 20:51:14.992605 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a1b2d809-05a8-4339-b62d-7ea5e54a247c tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.102493 Feb 19 20:51:14.993224 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 150/320] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 20:51:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:15.011734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-785d638b-54e2-4f62-bab1-b6fa1d3c68bd tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] Calling method '.version_select at 0x7f64746d9940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:15.188501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:15.198243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:15.200247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:15.201566 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7aae0a0-09e9-44e5-bc67-5560d4c5eb4f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.277800 Feb 19 20:51:15.202981 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 171/321] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:14 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:15.208579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-137da22e-ddcb-4d4d-b73e-0e66954f0252 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:15.209610 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:15.209610 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:15.217293 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-137da22e-ddcb-4d4d-b73e-0e66954f0252 tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.013253 Feb 19 20:51:15.218040 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 172/322] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:51:15 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:15.223931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-85117481-3b17-4b7d-8dee-96a946e24fa2 req-dcde9742-3ff4-4be3-8b2d-edf263b4076c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24d94c6-d921-42bf-affb-6f8556e5b76d", "name": "network-vif-plugged", "status": "completed", "tag": "99019bb9-0cfe-4900-a813-f2a3826c4aed"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:15.225584 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:15.225584 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:15.233367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-85117481-3b17-4b7d-8dee-96a946e24fa2 req-dcde9742-3ff4-4be3-8b2d-edf263b4076c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.233865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-85117481-3b17-4b7d-8dee-96a946e24fa2 req-dcde9742-3ff4-4be3-8b2d-edf263b4076c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.245066 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-85117481-3b17-4b7d-8dee-96a946e24fa2 req-dcde9742-3ff4-4be3-8b2d-edf263b4076c service nova] Creating event network-vif-plugged:99019bb9-0cfe-4900-a813-f2a3826c4aed for instance d24d94c6-d921-42bf-affb-6f8556e5b76d on nch1-master-1 Feb 19 20:51:15.250376 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-85117481-3b17-4b7d-8dee-96a946e24fa2 req-dcde9742-3ff4-4be3-8b2d-edf263b4076c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030995 Feb 19 20:51:15.251213 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 173/323] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:15.257618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-70ce2687-2345-49f0-80f6-a39dd67f1a44 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:15.258651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-70ce2687-2345-49f0-80f6-a39dd67f1a44 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:15.265632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70ce2687-2345-49f0-80f6-a39dd67f1a44 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.266503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70ce2687-2345-49f0-80f6-a39dd67f1a44 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.267633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70ce2687-2345-49f0-80f6-a39dd67f1a44 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.268319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70ce2687-2345-49f0-80f6-a39dd67f1a44 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.382687 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-785d638b-54e2-4f62-bab1-b6fa1d3c68bd tempest-SecurityGroupsTestAdminJSON-1618561030 tempest-SecurityGroupsTestAdminJSON-1618561030-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/04f125f5-dc0c-4520-b11d-8641485e96c8" status: 202 len: 0 microversion: 2.1 time: 0.388393 Feb 19 20:51:15.387724 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 151/324] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:51:14 2022] DELETE /compute/v2.1/os-security-groups/04f125f5-dc0c-4520-b11d-8641485e96c8 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:15.393185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b81d2fa-52cc-492f-b724-39eca3e1fb3c tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:15.393959 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:15.393959 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:15.424142 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b81d2fa-52cc-492f-b724-39eca3e1fb3c tempest-AggregatesAdminTestJSON-1329742366 tempest-AggregatesAdminTestJSON-1329742366-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.034678 Feb 19 20:51:15.426192 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 152/325] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:51:15 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:15.439364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57c72393-4f1d-47ae-8225-5d925cdd1759 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:15.440043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57c72393-4f1d-47ae-8225-5d925cdd1759 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:15.462038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57c72393-4f1d-47ae-8225-5d925cdd1759 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.466822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57c72393-4f1d-47ae-8225-5d925cdd1759 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.467737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57c72393-4f1d-47ae-8225-5d925cdd1759 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.468190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57c72393-4f1d-47ae-8225-5d925cdd1759 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.486089 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-57c72393-4f1d-47ae-8225-5d925cdd1759 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] HTTP exception thrown: Instance b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 could not be found. Feb 19 20:51:15.486910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57c72393-4f1d-47ae-8225-5d925cdd1759 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Returning 404 to user: Instance b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:15.488220 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57c72393-4f1d-47ae-8225-5d925cdd1759 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 404 len: 111 microversion: 2.1 time: 0.054792 Feb 19 20:51:15.489850 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 153/326] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:51:15 2022] DELETE /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:15.502419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0f88415f-2ac7-423f-88ba-02c29d2a6dc5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:15.505884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0f88415f-2ac7-423f-88ba-02c29d2a6dc5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] [instance: b743c9bb-0af5-4b6e-9c8e-ce4dcb144931] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:15.519897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f88415f-2ac7-423f-88ba-02c29d2a6dc5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.520265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f88415f-2ac7-423f-88ba-02c29d2a6dc5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.521087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f88415f-2ac7-423f-88ba-02c29d2a6dc5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.521524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f88415f-2ac7-423f-88ba-02c29d2a6dc5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.553136 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-0f88415f-2ac7-423f-88ba-02c29d2a6dc5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] HTTP exception thrown: Instance b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 could not be found. Feb 19 20:51:15.554945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0f88415f-2ac7-423f-88ba-02c29d2a6dc5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] Returning 404 to user: Instance b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:15.555988 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0f88415f-2ac7-423f-88ba-02c29d2a6dc5 tempest-AggregatesAdminTestJSON-346508146 tempest-AggregatesAdminTestJSON-346508146-project] 10.222.0.30 "GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931" status: 404 len: 111 microversion: 2.1 time: 0.057312 Feb 19 20:51:15.557053 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 154/327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:15 2022] GET /compute/v2.1/servers/b743c9bb-0af5-4b6e-9c8e-ce4dcb144931 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:15.636801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-70ce2687-2345-49f0-80f6-a39dd67f1a44 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:15.644899 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-70ce2687-2345-49f0-80f6-a39dd67f1a44 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1322 microversion: 2.1 time: 0.392353 Feb 19 20:51:15.646105 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 174/328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:15 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:15.646372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c642f54-9871-4c7a-9a6d-de9dc30314af tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:15.646998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3c642f54-9871-4c7a-9a6d-de9dc30314af tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:15.657550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c642f54-9871-4c7a-9a6d-de9dc30314af tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.658337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c642f54-9871-4c7a-9a6d-de9dc30314af tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.659243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c642f54-9871-4c7a-9a6d-de9dc30314af tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.659684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c642f54-9871-4c7a-9a6d-de9dc30314af tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.871789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c642f54-9871-4c7a-9a6d-de9dc30314af tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:15.884357 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c642f54-9871-4c7a-9a6d-de9dc30314af tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1391 microversion: 2.1 time: 0.243591 Feb 19 20:51:15.885019 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 155/329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:15 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:15.939231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-13197861-0ef3-4a22-9494-7c09541df54d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:15.939826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-13197861-0ef3-4a22-9494-7c09541df54d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:15.946338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13197861-0ef3-4a22-9494-7c09541df54d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.946774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13197861-0ef3-4a22-9494-7c09541df54d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:15.947593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13197861-0ef3-4a22-9494-7c09541df54d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:15.948025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13197861-0ef3-4a22-9494-7c09541df54d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.110058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-13197861-0ef3-4a22-9494-7c09541df54d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:16.119349 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-13197861-0ef3-4a22-9494-7c09541df54d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1312 microversion: 2.1 time: 0.183896 Feb 19 20:51:16.119931 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 175/330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:15 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:16.221138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:16.222447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:16.229801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.230546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.231602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.232047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.441112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:16.452276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:16.457521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:16.459495 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7d39ab05-0fe8-48d7-b762-455627a22bb8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.243265 Feb 19 20:51:16.461302 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 156/331] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:16 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:16.662535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-feb2d9c6-a127-464a-8ba2-9f1dd9f7fc2c tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:16.663187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-feb2d9c6-a127-464a-8ba2-9f1dd9f7fc2c tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:16.669480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-feb2d9c6-a127-464a-8ba2-9f1dd9f7fc2c tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.669923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-feb2d9c6-a127-464a-8ba2-9f1dd9f7fc2c tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.670705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-feb2d9c6-a127-464a-8ba2-9f1dd9f7fc2c tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.671134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-feb2d9c6-a127-464a-8ba2-9f1dd9f7fc2c tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.884238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-feb2d9c6-a127-464a-8ba2-9f1dd9f7fc2c tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:16.892246 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-feb2d9c6-a127-464a-8ba2-9f1dd9f7fc2c tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1472 microversion: 2.1 time: 0.233699 Feb 19 20:51:16.897135 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 176/332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:16 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:16.905946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-03c4bfed-47cb-4268-b73e-a837a98a4e2c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:16.907367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-03c4bfed-47cb-4268-b73e-a837a98a4e2c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:16.913706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03c4bfed-47cb-4268-b73e-a837a98a4e2c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.914149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03c4bfed-47cb-4268-b73e-a837a98a4e2c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.915214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03c4bfed-47cb-4268-b73e-a837a98a4e2c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.915639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03c4bfed-47cb-4268-b73e-a837a98a4e2c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.916897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e8083f84-fb5c-4691-ba7e-549f392fa08e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:16.917439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e8083f84-fb5c-4691-ba7e-549f392fa08e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:16.924717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8083f84-fb5c-4691-ba7e-549f392fa08e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.925540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8083f84-fb5c-4691-ba7e-549f392fa08e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.926339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8083f84-fb5c-4691-ba7e-549f392fa08e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.926940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8083f84-fb5c-4691-ba7e-549f392fa08e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.959519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e8083f84-fb5c-4691-ba7e-549f392fa08e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:16.962411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e8083f84-fb5c-4691-ba7e-549f392fa08e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:16.963416 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e8083f84-fb5c-4691-ba7e-549f392fa08e tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.053132 Feb 19 20:51:16.968680 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 177/333] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:51:16 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516/diagnostics => generated 117 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:16.974003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd84887f-944e-4354-b57e-a8d48ee473b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:16.974464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cd84887f-944e-4354-b57e-a8d48ee473b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:16.981786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd84887f-944e-4354-b57e-a8d48ee473b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.982489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd84887f-944e-4354-b57e-a8d48ee473b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:16.983610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd84887f-944e-4354-b57e-a8d48ee473b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:16.984050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd84887f-944e-4354-b57e-a8d48ee473b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:17.013495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cd84887f-944e-4354-b57e-a8d48ee473b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:51:17.160375 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd84887f-944e-4354-b57e-a8d48ee473b0 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "DELETE /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 204 len: 0 microversion: 2.1 time: 0.190169 Feb 19 20:51:17.163792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-03c4bfed-47cb-4268-b73e-a837a98a4e2c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:17.171565 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 178/334] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:51:16 2022] DELETE /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:51:17.172881 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-03c4bfed-47cb-4268-b73e-a837a98a4e2c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1391 microversion: 2.1 time: 0.274078 Feb 19 20:51:17.178277 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 157/335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:16 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1391 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:17.188440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0d680117-6da7-4477-ba53-3ecbc9f5fc22 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:17.190907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0d680117-6da7-4477-ba53-3ecbc9f5fc22 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:17.198265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c9583d2-3911-400f-9bd7-40a5bfbd2287 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:17.199002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1c9583d2-3911-400f-9bd7-40a5bfbd2287 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:17.218557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c9583d2-3911-400f-9bd7-40a5bfbd2287 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:17.219172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c9583d2-3911-400f-9bd7-40a5bfbd2287 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:17.220198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c9583d2-3911-400f-9bd7-40a5bfbd2287 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:17.221039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c9583d2-3911-400f-9bd7-40a5bfbd2287 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:17.228862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d680117-6da7-4477-ba53-3ecbc9f5fc22 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:17.229634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d680117-6da7-4477-ba53-3ecbc9f5fc22 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:17.230476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d680117-6da7-4477-ba53-3ecbc9f5fc22 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:17.230918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d680117-6da7-4477-ba53-3ecbc9f5fc22 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:17.443267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c9583d2-3911-400f-9bd7-40a5bfbd2287 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:17.454810 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c9583d2-3911-400f-9bd7-40a5bfbd2287 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1461 microversion: 2.1 time: 0.281255 Feb 19 20:51:17.456480 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 179/336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:17 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1461 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:17.488872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0d680117-6da7-4477-ba53-3ecbc9f5fc22 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:17.499563 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0d680117-6da7-4477-ba53-3ecbc9f5fc22 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1478 microversion: 2.1 time: 0.319245 Feb 19 20:51:17.500486 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 158/337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:17 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1478 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:17.505092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:17.505807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:17.512782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:17.513348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:17.514275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:17.515027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:17.673541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:17.697541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:17.700008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:17.701460 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0041c61b-8964-46ed-b1dd-bfd4a4044dbf tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.199773 Feb 19 20:51:17.702217 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 159/338] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:17 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:17.777221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-85eb6ffe-1a4e-4e6f-8dd4-dffd76454d92 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:17.777834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-85eb6ffe-1a4e-4e6f-8dd4-dffd76454d92 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:17.783584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85eb6ffe-1a4e-4e6f-8dd4-dffd76454d92 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:17.784037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85eb6ffe-1a4e-4e6f-8dd4-dffd76454d92 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:17.784941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85eb6ffe-1a4e-4e6f-8dd4-dffd76454d92 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:17.785378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85eb6ffe-1a4e-4e6f-8dd4-dffd76454d92 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:18.034507 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-85eb6ffe-1a4e-4e6f-8dd4-dffd76454d92 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1612 microversion: 2.1 time: 0.563111 Feb 19 20:51:18.035090 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 180/339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:17 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1612 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:18.051524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:18.052781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:18.059685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:18.061035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:18.062160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:18.062801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:18.172102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '168c8aa254304f4097c3a3c75e3e423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407c70643b364ed8a2371acba506a19f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:18.172950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] flavor_id is None. Assuming migration. {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4073}} Feb 19 20:51:18.173451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 20:51:18.398082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1518674300", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:18.470579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:51:18.975645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:51:18.976232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:51:18.976649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:51:18.977191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:51:18.978254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:51:18.992929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:18.993694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:18.994871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:18.995649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:19.020749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Getting quotas for project 9809b88a7cf44fba908be3c1736b1f71. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:19.027448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Getting quotas for user 450a0144db174551aabee6fba0f5aa8d and project 9809b88a7cf44fba908be3c1736b1f71. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:19.039785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:51:19.043648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:51:19.081312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8e6a16da-dfc8-47ea-9376-4d18f4684ccd tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d/action" status: 202 len: 0 microversion: 2.1 time: 1.033913 Feb 19 20:51:19.082254 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 160/340] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:51:18 2022] POST /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d/action => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:19.093224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-90eecd78-e38a-4ac9-b086-bb5d3da2757b tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:19.097788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-90eecd78-e38a-4ac9-b086-bb5d3da2757b tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:19.107959 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f3d735d-de8b-4a3b-b690-e6593b407e45 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943407 Feb 19 20:51:19.116073 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 181/341] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 20:51:19.119048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90eecd78-e38a-4ac9-b086-bb5d3da2757b tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:19.122473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0437bf16-c4c4-4259-85d2-54e0b0317d38 req-157c5e40-e6ed-486b-b700-0e89d8f0ff86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f05bec-0cf3-4c8d-adda-1f646f93100c", "name": "network-vif-plugged", "status": "completed", "tag": "283fa0ff-0c52-46c9-86d3-5ee439d6029b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:19.123203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90eecd78-e38a-4ac9-b086-bb5d3da2757b tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:19.124018 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:19.124018 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:19.125166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90eecd78-e38a-4ac9-b086-bb5d3da2757b tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:19.127598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90eecd78-e38a-4ac9-b086-bb5d3da2757b tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:19.136371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0437bf16-c4c4-4259-85d2-54e0b0317d38 req-157c5e40-e6ed-486b-b700-0e89d8f0ff86 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:19.137329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0437bf16-c4c4-4259-85d2-54e0b0317d38 req-157c5e40-e6ed-486b-b700-0e89d8f0ff86 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:19.152940 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0437bf16-c4c4-4259-85d2-54e0b0317d38 req-157c5e40-e6ed-486b-b700-0e89d8f0ff86 service nova] Creating event network-vif-plugged:283fa0ff-0c52-46c9-86d3-5ee439d6029b for instance f4f05bec-0cf3-4c8d-adda-1f646f93100c on nch2-master-1 Feb 19 20:51:19.159870 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0437bf16-c4c4-4259-85d2-54e0b0317d38 req-157c5e40-e6ed-486b-b700-0e89d8f0ff86 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042966 Feb 19 20:51:19.161645 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 182/342] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:19.169707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-732c5362-5e41-4ad7-b0e7-92fa766167fe tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:19.171312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-732c5362-5e41-4ad7-b0e7-92fa766167fe tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:19.179873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-732c5362-5e41-4ad7-b0e7-92fa766167fe tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:19.180581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-732c5362-5e41-4ad7-b0e7-92fa766167fe tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:19.181688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-732c5362-5e41-4ad7-b0e7-92fa766167fe tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:19.182597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-732c5362-5e41-4ad7-b0e7-92fa766167fe tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:19.591326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-90eecd78-e38a-4ac9-b086-bb5d3da2757b tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:19.607992 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-90eecd78-e38a-4ac9-b086-bb5d3da2757b tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1391 microversion: 2.1 time: 0.524339 Feb 19 20:51:19.610033 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 161/343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:19 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1391 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:19.615613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:19.617214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:19.625276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:19.626196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:19.627432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:19.629152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:19.636911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-732c5362-5e41-4ad7-b0e7-92fa766167fe tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df681c4fec04b8cac9cc15e5cdb60e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12afb53ac3a94c5696b1f0bc7955cf96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:19.645354 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-732c5362-5e41-4ad7-b0e7-92fa766167fe tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 200 len: 1478 microversion: 2.1 time: 0.481426 Feb 19 20:51:19.657475 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 183/344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:19 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 1478 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:19.662186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-696ecf7d-4eb6-45db-9184-1924acd39fdd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:19.664916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-696ecf7d-4eb6-45db-9184-1924acd39fdd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:19.682905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-696ecf7d-4eb6-45db-9184-1924acd39fdd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:19.683921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-696ecf7d-4eb6-45db-9184-1924acd39fdd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:19.684206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-696ecf7d-4eb6-45db-9184-1924acd39fdd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:19.684629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-696ecf7d-4eb6-45db-9184-1924acd39fdd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.089298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:20.112928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:20.115490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:20.118570 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6e21a215-e208-4565-8a7f-7a87f2d21edb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.507208 Feb 19 20:51:20.119392 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 162/345] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:19 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:20.136142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-696ecf7d-4eb6-45db-9184-1924acd39fdd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:20.145073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-440e98db-a107-49f9-bd6d-482b1e8dda06 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:20.148608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-440e98db-a107-49f9-bd6d-482b1e8dda06 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:20.150332 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-696ecf7d-4eb6-45db-9184-1924acd39fdd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1470 microversion: 2.1 time: 0.489208 Feb 19 20:51:20.166227 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 184/346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:19 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1470 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:20.176758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-440e98db-a107-49f9-bd6d-482b1e8dda06 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.177734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-63ee7d40-6ddd-46db-b148-7699bbc895af req-17c7b71f-976b-407c-b880-a794b8941aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21faddc0-1890-48cc-8dcb-7d45cb05b516", "name": "network-vif-deleted", "tag": "eee64491-7aff-40b6-840b-749933ebe597"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:20.178983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-440e98db-a107-49f9-bd6d-482b1e8dda06 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.180869 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:20.180869 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:20.182034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-440e98db-a107-49f9-bd6d-482b1e8dda06 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.182741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-440e98db-a107-49f9-bd6d-482b1e8dda06 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.198799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-63ee7d40-6ddd-46db-b148-7699bbc895af req-17c7b71f-976b-407c-b880-a794b8941aa2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.207279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-63ee7d40-6ddd-46db-b148-7699bbc895af req-17c7b71f-976b-407c-b880-a794b8941aa2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.240358 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-63ee7d40-6ddd-46db-b148-7699bbc895af req-17c7b71f-976b-407c-b880-a794b8941aa2 service nova] Creating event network-vif-deleted:eee64491-7aff-40b6-840b-749933ebe597 for instance 21faddc0-1890-48cc-8dcb-7d45cb05b516 on nch2-master-1 Feb 19 20:51:20.268973 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-63ee7d40-6ddd-46db-b148-7699bbc895af req-17c7b71f-976b-407c-b880-a794b8941aa2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100673 Feb 19 20:51:20.269887 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 185/347] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:20.331306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-440e98db-a107-49f9-bd6d-482b1e8dda06 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:20.341452 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-440e98db-a107-49f9-bd6d-482b1e8dda06 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1212 microversion: 2.1 time: 0.218557 Feb 19 20:51:20.342104 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 163/348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:20 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1212 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:20.733458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31c2b83e-1db5-48c0-bfc1-5cc2bd92d0cc tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:20.734804 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:20.734804 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:20.736530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c2b83e-1db5-48c0-bfc1-5cc2bd92d0cc tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.736985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c2b83e-1db5-48c0-bfc1-5cc2bd92d0cc tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.737807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c2b83e-1db5-48c0-bfc1-5cc2bd92d0cc tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.739847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c2b83e-1db5-48c0-bfc1-5cc2bd92d0cc tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.811733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5c27e813-a701-41fb-b7b9-d10b8b2e3cfc tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1172866389", "ram": 512, "vcpus": 1, "disk": 10, "id": 892932251, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:20.813588 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:20.813588 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:20.815756 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-31c2b83e-1db5-48c0-bfc1-5cc2bd92d0cc tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.244040 Feb 19 20:51:20.824024 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 164/349] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:51:20 2022] GET /compute/v2.1/os-services => generated 947 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:20.829416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-91262252-188a-467e-8688-3945ece91233 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:20.830066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-91262252-188a-467e-8688-3945ece91233 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:20.844121 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5c27e813-a701-41fb-b7b9-d10b8b2e3cfc tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.398558 Feb 19 20:51:20.844842 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 186/350] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:20 2022] POST /compute/v2.1/flavors => generated 413 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:20.856671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df491a41-631a-407d-a25b-8417bf64ef47 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:20.860685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91262252-188a-467e-8688-3945ece91233 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.861141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91262252-188a-467e-8688-3945ece91233 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.862807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-df491a41-631a-407d-a25b-8417bf64ef47 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] [instance: 21faddc0-1890-48cc-8dcb-7d45cb05b516] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:20.863560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91262252-188a-467e-8688-3945ece91233 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.864066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91262252-188a-467e-8688-3945ece91233 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.877299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df491a41-631a-407d-a25b-8417bf64ef47 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.877981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df491a41-631a-407d-a25b-8417bf64ef47 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.878988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df491a41-631a-407d-a25b-8417bf64ef47 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.879650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df491a41-631a-407d-a25b-8417bf64ef47 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.896718 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-df491a41-631a-407d-a25b-8417bf64ef47 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] HTTP exception thrown: Instance 21faddc0-1890-48cc-8dcb-7d45cb05b516 could not be found. Feb 19 20:51:20.897806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df491a41-631a-407d-a25b-8417bf64ef47 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] Returning 404 to user: Instance 21faddc0-1890-48cc-8dcb-7d45cb05b516 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:20.898939 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df491a41-631a-407d-a25b-8417bf64ef47 tempest-ServerDiagnosticsNegativeTest-1966728143 tempest-ServerDiagnosticsNegativeTest-1966728143-project] 10.222.0.30 "GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516" status: 404 len: 111 microversion: 2.1 time: 0.045825 Feb 19 20:51:20.903844 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 187/351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:20 2022] GET /compute/v2.1/servers/21faddc0-1890-48cc-8dcb-7d45cb05b516 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:20.909304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7e0e00e1-34e6-435e-901e-6e39b5c55d17 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:20.910713 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:20.910713 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:20.912704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e0e00e1-34e6-435e-901e-6e39b5c55d17 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.913445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e0e00e1-34e6-435e-901e-6e39b5c55d17 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.914418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e0e00e1-34e6-435e-901e-6e39b5c55d17 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:20.915001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e0e00e1-34e6-435e-901e-6e39b5c55d17 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:20.955603 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7e0e00e1-34e6-435e-901e-6e39b5c55d17 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.050506 Feb 19 20:51:20.957238 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 188/352] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Feb 19 20:51:20 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:20.975596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-50cde299-ef9d-4fc3-8559-fa0398075027 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:20.982445 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:20.982445 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:21.041538 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-50cde299-ef9d-4fc3-8559-fa0398075027 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/892932251/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083039 Feb 19 20:51:21.049804 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 189/353] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Feb 19 20:51:20 2022] POST /compute/v2.1/flavors/892932251/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:21.057218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-19a37b19-5272-49b3-b6c4-f7ed14a8a62d tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:21.058379 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:21.058379 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:21.064987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19a37b19-5272-49b3-b6c4-f7ed14a8a62d tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.065539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19a37b19-5272-49b3-b6c4-f7ed14a8a62d tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.066274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19a37b19-5272-49b3-b6c4-f7ed14a8a62d tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.066712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19a37b19-5272-49b3-b6c4-f7ed14a8a62d tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.105701 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-19a37b19-5272-49b3-b6c4-f7ed14a8a62d tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.054718 Feb 19 20:51:21.106312 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 190/354] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/os-services => generated 947 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:21.147743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91262252-188a-467e-8688-3945ece91233 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:21.156425 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-91262252-188a-467e-8688-3945ece91233 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1391 microversion: 2.1 time: 0.330765 Feb 19 20:51:21.157011 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 165/355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:20 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1391 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:21.162354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3dcbe02c-83bc-4ba9-9e1f-875c0d15b2b6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:21.164369 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:21.164369 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:21.179345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dcbe02c-83bc-4ba9-9e1f-875c0d15b2b6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.179991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dcbe02c-83bc-4ba9-9e1f-875c0d15b2b6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.181166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dcbe02c-83bc-4ba9-9e1f-875c0d15b2b6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.181749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dcbe02c-83bc-4ba9-9e1f-875c0d15b2b6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.207264 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3dcbe02c-83bc-4ba9-9e1f-875c0d15b2b6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.049036 Feb 19 20:51:21.208107 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 166/356] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:21.212857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:21.213971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:21.219936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.220614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.221835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.222429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.383348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ba443f38-b9f2-4b15-8940-c49303cdfb08 tempest-FlavorsExtraSpecsTestJSON-54221303 tempest-FlavorsExtraSpecsTestJSON-54221303-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:21.394158 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ba443f38-b9f2-4b15-8940-c49303cdfb08 tempest-FlavorsExtraSpecsTestJSON-54221303 tempest-FlavorsExtraSpecsTestJSON-54221303-project] 10.222.0.30 "GET /compute/v2.1/flavors/892932251/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.286815 Feb 19 20:51:21.400072 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 191/357] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/flavors/892932251/os-extra_specs => generated 66 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:21.405361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-80e0784b-6522-4cba-8939-fb1813b5872d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:21.405970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-80e0784b-6522-4cba-8939-fb1813b5872d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:21.412632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80e0784b-6522-4cba-8939-fb1813b5872d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.413612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80e0784b-6522-4cba-8939-fb1813b5872d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.414399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80e0784b-6522-4cba-8939-fb1813b5872d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.414824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80e0784b-6522-4cba-8939-fb1813b5872d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.555627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:21.564937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:21.566600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:21.567889 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-31c25da4-ddd7-4916-b445-f70d9dec5c19 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 0.358717 Feb 19 20:51:21.568479 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 167/358] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:21.573235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2fe0d31c-f8db-4046-a5c3-111483eac37b req-ad276c2c-2ed4-4a0c-a7d1-34814cd8a811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da666172-5dd1-484f-aca0-a346a83ecec3", "name": "network-vif-plugged", "status": "completed", "tag": "8e715e53-af3f-4a70-b33f-5b5471d22747"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:21.574652 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:21.574652 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:21.581481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2fe0d31c-f8db-4046-a5c3-111483eac37b req-ad276c2c-2ed4-4a0c-a7d1-34814cd8a811 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.581928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2fe0d31c-f8db-4046-a5c3-111483eac37b req-ad276c2c-2ed4-4a0c-a7d1-34814cd8a811 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.594492 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2fe0d31c-f8db-4046-a5c3-111483eac37b req-ad276c2c-2ed4-4a0c-a7d1-34814cd8a811 service nova] Creating event network-vif-plugged:8e715e53-af3f-4a70-b33f-5b5471d22747 for instance da666172-5dd1-484f-aca0-a346a83ecec3 on nch2-master-1 Feb 19 20:51:21.599852 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2fe0d31c-f8db-4046-a5c3-111483eac37b req-ad276c2c-2ed4-4a0c-a7d1-34814cd8a811 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029804 Feb 19 20:51:21.601057 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 168/359] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:21.609673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9bc4aea8-9266-4e13-adbf-e7a5e67757d6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:21.611102 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:21.611102 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:21.613779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9bc4aea8-9266-4e13-adbf-e7a5e67757d6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.614403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9bc4aea8-9266-4e13-adbf-e7a5e67757d6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.615914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9bc4aea8-9266-4e13-adbf-e7a5e67757d6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.616385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9bc4aea8-9266-4e13-adbf-e7a5e67757d6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.658004 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9bc4aea8-9266-4e13-adbf-e7a5e67757d6 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.052831 Feb 19 20:51:21.666776 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 169/360] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/os-services => generated 947 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:21.671885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11fc4130-d90c-46e4-9e59-95db1d1862be tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:21.673126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11fc4130-d90c-46e4-9e59-95db1d1862be tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:21.686473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11fc4130-d90c-46e4-9e59-95db1d1862be tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.687276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11fc4130-d90c-46e4-9e59-95db1d1862be tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.688268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11fc4130-d90c-46e4-9e59-95db1d1862be tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.688686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11fc4130-d90c-46e4-9e59-95db1d1862be tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.848785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11fc4130-d90c-46e4-9e59-95db1d1862be tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:21.857866 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11fc4130-d90c-46e4-9e59-95db1d1862be tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1274 microversion: 2.1 time: 0.189052 Feb 19 20:51:21.860638 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 170/361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:21.867951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fb14e43c-54e1-481d-bc95-e3ed2b52bb04 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:21.871555 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:21.871555 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:21.877354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80e0784b-6522-4cba-8939-fb1813b5872d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:21.889801 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-80e0784b-6522-4cba-8939-fb1813b5872d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1470 microversion: 2.1 time: 0.488577 Feb 19 20:51:21.890842 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 192/362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1470 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:21.895407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-76cbace6-893c-413f-9e4c-7bd21f6e9075 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:21.900840 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:21.900840 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:21.902500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76cbace6-893c-413f-9e4c-7bd21f6e9075 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.902944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76cbace6-893c-413f-9e4c-7bd21f6e9075 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.908853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76cbace6-893c-413f-9e4c-7bd21f6e9075 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:21.913235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76cbace6-893c-413f-9e4c-7bd21f6e9075 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:21.926564 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fb14e43c-54e1-481d-bc95-e3ed2b52bb04 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/892932251/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064072 Feb 19 20:51:21.932177 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 171/363] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Feb 19 20:51:21 2022] POST /compute/v2.1/flavors/892932251/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:21.937794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-656a7937-6489-4af9-87aa-02f69aafcb4b tempest-FlavorsExtraSpecsTestJSON-54221303 tempest-FlavorsExtraSpecsTestJSON-54221303-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:21.950201 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-656a7937-6489-4af9-87aa-02f69aafcb4b tempest-FlavorsExtraSpecsTestJSON-54221303 tempest-FlavorsExtraSpecsTestJSON-54221303-project] 10.222.0.30 "GET /compute/v2.1/flavors/892932251/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016437 Feb 19 20:51:21.955492 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 172/364] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/flavors/892932251/os-extra_specs/hw:numa_nodes => generated 22 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 20:51:21.968991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ee0a93be-96f4-499d-bbd8-203f610fb395 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:21.978849 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-76cbace6-893c-413f-9e4c-7bd21f6e9075 tempest-ServicesAdminNegativeTestJSON-1722219420 tempest-ServicesAdminNegativeTestJSON-1722219420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.086669 Feb 19 20:51:21.979468 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 193/365] 10.222.0.30 () {58 vars in 1197 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:22.004426 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ee0a93be-96f4-499d-bbd8-203f610fb395 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/892932251/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046874 Feb 19 20:51:22.009478 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 173/366] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Feb 19 20:51:21 2022] POST /compute/v2.1/flavors/892932251/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:22.022986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5d435947-6669-4b05-b8be-b463872d440c tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.034734 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5d435947-6669-4b05-b8be-b463872d440c tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/892932251/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015290 Feb 19 20:51:22.035655 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 174/367] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Feb 19 20:51:22 2022] GET /compute/v2.1/flavors/892932251/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:22.053840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-da89c421-bf2a-4aab-b151-12b0bd9effe3 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:22.056393 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:22.056393 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:22.108262 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-da89c421-bf2a-4aab-b151-12b0bd9effe3 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/892932251/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.066043 Feb 19 20:51:22.111099 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 175/368] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:51:22 2022] PUT /compute/v2.1/flavors/892932251/os-extra_specs/hw:numa_nodes => generated 22 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:22.125560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d428e57f-edac-447c-be74-219c800821f1 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.138502 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d428e57f-edac-447c-be74-219c800821f1 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/892932251/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019342 Feb 19 20:51:22.139500 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 176/369] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Feb 19 20:51:22 2022] GET /compute/v2.1/flavors/892932251/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:22.151927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d34a8bf1-75d8-4d68-8266-3ff198e1f563 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.154902 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:22.154902 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:22.192937 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d34a8bf1-75d8-4d68-8266-3ff198e1f563 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/892932251/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.046922 Feb 19 20:51:22.195925 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 177/370] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 20:51:22 2022] DELETE /compute/v2.1/flavors/892932251/os-extra_specs/hw:numa_nodes => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:22.202882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f8ef3f30-ec4e-4eb2-a609-9315575e29ef tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.204003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f8ef3f30-ec4e-4eb2-a609-9315575e29ef tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:22.211211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8ef3f30-ec4e-4eb2-a609-9315575e29ef tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:22.212097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8ef3f30-ec4e-4eb2-a609-9315575e29ef tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:22.213177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8ef3f30-ec4e-4eb2-a609-9315575e29ef tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:22.213573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8ef3f30-ec4e-4eb2-a609-9315575e29ef tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:22.222803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d051b90-ade3-4a31-8a7e-02c55d2bf547 tempest-ServicesAdminNegativeTestJSON-763359449 tempest-ServicesAdminNegativeTestJSON-763359449-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.224046 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:22.224046 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:22.225889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d051b90-ade3-4a31-8a7e-02c55d2bf547 tempest-ServicesAdminNegativeTestJSON-763359449 tempest-ServicesAdminNegativeTestJSON-763359449-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '8721e88313a9416cb755fa1e964c1559', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0499eef3d6b4022a79cbf5f97f13a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:22.226703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d051b90-ade3-4a31-8a7e-02c55d2bf547 tempest-ServicesAdminNegativeTestJSON-763359449 tempest-ServicesAdminNegativeTestJSON-763359449-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:22.227665 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d051b90-ade3-4a31-8a7e-02c55d2bf547 tempest-ServicesAdminNegativeTestJSON-763359449 tempest-ServicesAdminNegativeTestJSON-763359449-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.240397 Feb 19 20:51:22.228359 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 194/371] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:51:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 242 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:22.238095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bb8f5008-8ae0-4d6a-96dc-057141618fc7 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.239307 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:22.239307 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:22.268506 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bb8f5008-8ae0-4d6a-96dc-057141618fc7 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/892932251/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.038052 Feb 19 20:51:22.269505 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 195/372] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 20:51:22 2022] DELETE /compute/v2.1/flavors/892932251/os-extra_specs/hw:cpu_policy => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 20:51:22.286815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ff14d978-106d-42cb-952b-c27116b0374f tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.313560 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ff14d978-106d-42cb-952b-c27116b0374f tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/892932251/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.038727 Feb 19 20:51:22.315130 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 196/373] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Feb 19 20:51:22 2022] GET /compute/v2.1/flavors/892932251/os-extra_specs => generated 19 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:22.328667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0fa79fe-576c-4743-b352-68314471a0ad tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.329552 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:22.329552 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:22.359539 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d0fa79fe-576c-4743-b352-68314471a0ad tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/892932251" status: 202 len: 0 microversion: 2.1 time: 0.035844 Feb 19 20:51:22.360778 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 197/374] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 20:51:22 2022] DELETE /compute/v2.1/flavors/892932251 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:22.391619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2a81e827-77b3-433e-9c86-371d398ca060 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.449409 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2a81e827-77b3-433e-9c86-371d398ca060 tempest-FlavorsExtraSpecsTestJSON-55245982 tempest-FlavorsExtraSpecsTestJSON-55245982-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.083249 Feb 19 20:51:22.450322 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 198/375] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:22 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:22.585910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.586848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:22.608077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:22.608269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f8ef3f30-ec4e-4eb2-a609-9315575e29ef tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:22.609816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:22.617246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:22.617822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:22.627971 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f8ef3f30-ec4e-4eb2-a609-9315575e29ef tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1590 microversion: 2.1 time: 0.425196 Feb 19 20:51:22.640991 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 178/376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:22 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1590 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:22.646850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f2fc6486-4b68-44f0-9bbd-d54f6243b1ca tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:22.647807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f2fc6486-4b68-44f0-9bbd-d54f6243b1ca tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:22.655194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2fc6486-4b68-44f0-9bbd-d54f6243b1ca tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:22.655865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2fc6486-4b68-44f0-9bbd-d54f6243b1ca tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:22.656876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2fc6486-4b68-44f0-9bbd-d54f6243b1ca tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:22.657457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2fc6486-4b68-44f0-9bbd-d54f6243b1ca tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:23.187582 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f2fc6486-4b68-44f0-9bbd-d54f6243b1ca tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.544528 Feb 19 20:51:23.190071 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 179/377] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 20:51:22 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c/os-interface => generated 284 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:23.204655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1f0e147c-074e-4b31-a086-21ed8b220b1f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:23.206970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1f0e147c-074e-4b31-a086-21ed8b220b1f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:23.226929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f0e147c-074e-4b31-a086-21ed8b220b1f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:23.227751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f0e147c-074e-4b31-a086-21ed8b220b1f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:23.230754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f0e147c-074e-4b31-a086-21ed8b220b1f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:23.231640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f0e147c-074e-4b31-a086-21ed8b220b1f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:23.747623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:23.758842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:23.760648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:23.763072 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-57bf9095-538b-40bc-a231-7e5022552e55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1360 microversion: 2.25 time: 1.181156 Feb 19 20:51:23.764347 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 199/378] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:22 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1360 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:23.769661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a681462-68a2-44b5-a2d4-658e1e109eb8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:23.770553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a681462-68a2-44b5-a2d4-658e1e109eb8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:23.779401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a681462-68a2-44b5-a2d4-658e1e109eb8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:23.780274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a681462-68a2-44b5-a2d4-658e1e109eb8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:23.781308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a681462-68a2-44b5-a2d4-658e1e109eb8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:23.781939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a681462-68a2-44b5-a2d4-658e1e109eb8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:24.284499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f0e147c-074e-4b31-a086-21ed8b220b1f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:24.293957 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1f0e147c-074e-4b31-a086-21ed8b220b1f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1316 microversion: 2.1 time: 1.102397 Feb 19 20:51:24.298877 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 180/379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:23 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1316 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:24.781611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:24.782277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:24.791072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:24.791523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:24.792314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:24.792780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:25.026841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1a681462-68a2-44b5-a2d4-658e1e109eb8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:25.034431 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1a681462-68a2-44b5-a2d4-658e1e109eb8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1470 microversion: 2.1 time: 1.268903 Feb 19 20:51:25.040752 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 200/380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:23 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1470 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:25.310742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8396a634-8db6-4217-a24f-4dd612c3c267 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:25.311705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8396a634-8db6-4217-a24f-4dd612c3c267 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:25.317731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8396a634-8db6-4217-a24f-4dd612c3c267 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:25.318444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8396a634-8db6-4217-a24f-4dd612c3c267 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:25.320253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8396a634-8db6-4217-a24f-4dd612c3c267 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:25.320935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8396a634-8db6-4217-a24f-4dd612c3c267 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:25.439656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:25.449261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:25.451180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:25.453382 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b7ce1b88-70a4-48e5-8016-741d8bf65ee8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1557 microversion: 2.25 time: 0.675468 Feb 19 20:51:25.454629 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 181/381] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:24 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1557 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:51:25.789919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8396a634-8db6-4217-a24f-4dd612c3c267 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:25.801336 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8396a634-8db6-4217-a24f-4dd612c3c267 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1316 microversion: 2.1 time: 0.494047 Feb 19 20:51:25.817700 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 201/382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:25 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:51:25.861039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6828bfa9-af4e-4b4c-a7f8-c6e71d6f688d req-a94abad6-b398-4d44-9e75-cf9fa78de8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1103dc8-5f12-42e9-93f9-ea4d34f90d2a", "tag": "7e9d6e32-ae0b-4fc9-8189-fc82708e3a33"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:25.866998 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:25.866998 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:25.896181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6828bfa9-af4e-4b4c-a7f8-c6e71d6f688d req-a94abad6-b398-4d44-9e75-cf9fa78de8f4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:25.896807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6828bfa9-af4e-4b4c-a7f8-c6e71d6f688d req-a94abad6-b398-4d44-9e75-cf9fa78de8f4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:25.896943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6c6903e8-ba09-4394-80c1-32e6b2697e16 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:25.898403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6c6903e8-ba09-4394-80c1-32e6b2697e16 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:25.905935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c6903e8-ba09-4394-80c1-32e6b2697e16 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:25.909314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c6903e8-ba09-4394-80c1-32e6b2697e16 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:25.914605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c6903e8-ba09-4394-80c1-32e6b2697e16 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:25.915351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c6903e8-ba09-4394-80c1-32e6b2697e16 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:25.916467 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6828bfa9-af4e-4b4c-a7f8-c6e71d6f688d req-a94abad6-b398-4d44-9e75-cf9fa78de8f4 service nova] Creating event network-changed:7e9d6e32-ae0b-4fc9-8189-fc82708e3a33 for instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a on nch1-master-1 Feb 19 20:51:25.925767 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6828bfa9-af4e-4b4c-a7f8-c6e71d6f688d req-a94abad6-b398-4d44-9e75-cf9fa78de8f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105634 Feb 19 20:51:25.940863 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 202/383] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:26.056120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-86c6c82b-c87d-4fb5-9ff4-3218460b48d2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:26.058369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-86c6c82b-c87d-4fb5-9ff4-3218460b48d2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:26.069677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86c6c82b-c87d-4fb5-9ff4-3218460b48d2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:26.070147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86c6c82b-c87d-4fb5-9ff4-3218460b48d2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:26.071153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86c6c82b-c87d-4fb5-9ff4-3218460b48d2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:26.071694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86c6c82b-c87d-4fb5-9ff4-3218460b48d2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:26.523891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-6c6903e8-ba09-4394-80c1-32e6b2697e16 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid da666172-5dd1-484f-aca0-a346a83ecec3 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:51:26.554854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-86c6c82b-c87d-4fb5-9ff4-3218460b48d2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:26.566218 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-86c6c82b-c87d-4fb5-9ff4-3218460b48d2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 0.516521 Feb 19 20:51:26.568030 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 203/384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:26 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:26.602725 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6c6903e8-ba09-4394-80c1-32e6b2697e16 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 2048 microversion: 2.25 time: 1.133991 Feb 19 20:51:26.612751 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 182/385] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:25 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 2048 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:51:26.621062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1399fa60-0197-45ed-9239-70ea3f5ea4f0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:26.621947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1399fa60-0197-45ed-9239-70ea3f5ea4f0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:26.629678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1399fa60-0197-45ed-9239-70ea3f5ea4f0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:26.630118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1399fa60-0197-45ed-9239-70ea3f5ea4f0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:26.631263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1399fa60-0197-45ed-9239-70ea3f5ea4f0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:26.632789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1399fa60-0197-45ed-9239-70ea3f5ea4f0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:26.881624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-567002031", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:26.952522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:51:27.199282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-1399fa60-0197-45ed-9239-70ea3f5ea4f0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid da666172-5dd1-484f-aca0-a346a83ecec3 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:51:27.236936 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1399fa60-0197-45ed-9239-70ea3f5ea4f0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 2048 microversion: 2.25 time: 0.619818 Feb 19 20:51:27.240009 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 183/386] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:26 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 2048 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:27.255804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e86b997-8c33-4618-9e5d-62d525187ce5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:27.257157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e86b997-8c33-4618-9e5d-62d525187ce5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:27.266760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e86b997-8c33-4618-9e5d-62d525187ce5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:27.268571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e86b997-8c33-4618-9e5d-62d525187ce5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:27.270308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e86b997-8c33-4618-9e5d-62d525187ce5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:27.271013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e86b997-8c33-4618-9e5d-62d525187ce5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:27.456288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:51:27.457748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:51:27.458379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:51:27.459150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:51:27.459881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:51:27.481282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:27.482389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:27.487847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:27.488715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:27.538205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Getting quotas for project 6d9ffdaf1d654c9bbbda43ed9214c964. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:27.544607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Getting quotas for user caca1da9a52c4a2080682b2458fa1e4f and project 6d9ffdaf1d654c9bbbda43ed9214c964. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:27.558542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:51:27.561660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:51:27.646635 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ecd655a7-0a7e-4aa3-b2be-ba1dceab8dc3 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077333 Feb 19 20:51:27.660185 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 204/387] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:51:27.667483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1e03ab4-a6ab-4571-93a6-bf01a7b7a4f9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:27.668384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b1e03ab4-a6ab-4571-93a6-bf01a7b7a4f9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:27.681209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e03ab4-a6ab-4571-93a6-bf01a7b7a4f9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:27.681983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e03ab4-a6ab-4571-93a6-bf01a7b7a4f9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:27.682989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e03ab4-a6ab-4571-93a6-bf01a7b7a4f9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:27.684417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e03ab4-a6ab-4571-93a6-bf01a7b7a4f9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:27.987610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8e86b997-8c33-4618-9e5d-62d525187ce5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:28.003284 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8e86b997-8c33-4618-9e5d-62d525187ce5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1316 microversion: 2.1 time: 0.758206 Feb 19 20:51:28.016731 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 184/388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:27 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1316 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:28.214288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b1e03ab4-a6ab-4571-93a6-bf01a7b7a4f9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:28.223919 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b1e03ab4-a6ab-4571-93a6-bf01a7b7a4f9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 200 len: 1590 microversion: 2.1 time: 0.562305 Feb 19 20:51:28.236707 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 205/389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:27 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 1590 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:28.251008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c03952e-ff35-4cac-9007-6d1873abc8a8 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:28.253080 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:28.253080 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:28.254834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c03952e-ff35-4cac-9007-6d1873abc8a8 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:28.255530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c03952e-ff35-4cac-9007-6d1873abc8a8 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:28.256940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c03952e-ff35-4cac-9007-6d1873abc8a8 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:28.257569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c03952e-ff35-4cac-9007-6d1873abc8a8 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:28.325962 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c03952e-ff35-4cac-9007-6d1873abc8a8 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.087808 Feb 19 20:51:28.335189 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 206/390] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Feb 19 20:51:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:51:28.345957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c6dffccf-c5cb-49e0-926b-9e7c24b3ef87 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:28.348180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c6dffccf-c5cb-49e0-926b-9e7c24b3ef87 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:28.353430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c559bf4d-dd69-4695-a1c4-bc4783ab9228 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-859504452", "id": 156349722, "os-flavor-access:is_public": "False"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:28.356022 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:28.356022 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:28.368082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6dffccf-c5cb-49e0-926b-9e7c24b3ef87 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:28.370497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6dffccf-c5cb-49e0-926b-9e7c24b3ef87 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:28.371554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6dffccf-c5cb-49e0-926b-9e7c24b3ef87 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:28.374286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6dffccf-c5cb-49e0-926b-9e7c24b3ef87 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:28.406355 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c559bf4d-dd69-4695-a1c4-bc4783ab9228 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.387839 Feb 19 20:51:28.406986 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 185/391] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:28 2022] POST /compute/v2.1/flavors => generated 435 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:28.432217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-583346689", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:28.529281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:51:28.877090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c6dffccf-c5cb-49e0-926b-9e7c24b3ef87 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:28.890813 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c6dffccf-c5cb-49e0-926b-9e7c24b3ef87 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 0.554399 Feb 19 20:51:28.901039 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 207/392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:28 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:28.906527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-22be8b1b-3509-457f-bfba-c87596e36d27 req-2db75881-61e3-4051-a8d1-67a5232a0f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f05bec-0cf3-4c8d-adda-1f646f93100c", "tag": "283fa0ff-0c52-46c9-86d3-5ee439d6029b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:28.908135 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:28.908135 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:28.915940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-22be8b1b-3509-457f-bfba-c87596e36d27 req-2db75881-61e3-4051-a8d1-67a5232a0f4a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:28.916493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-22be8b1b-3509-457f-bfba-c87596e36d27 req-2db75881-61e3-4051-a8d1-67a5232a0f4a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:28.927856 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-22be8b1b-3509-457f-bfba-c87596e36d27 req-2db75881-61e3-4051-a8d1-67a5232a0f4a service nova] Creating event network-changed:283fa0ff-0c52-46c9-86d3-5ee439d6029b for instance f4f05bec-0cf3-4c8d-adda-1f646f93100c on nch2-master-1 Feb 19 20:51:28.933509 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-22be8b1b-3509-457f-bfba-c87596e36d27 req-2db75881-61e3-4051-a8d1-67a5232a0f4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030937 Feb 19 20:51:28.934477 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 208/393] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:28.939724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd8567a9-9bba-438d-a5da-436acb810205 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:28.941189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cd8567a9-9bba-438d-a5da-436acb810205 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:28.947606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd8567a9-9bba-438d-a5da-436acb810205 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:28.948390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd8567a9-9bba-438d-a5da-436acb810205 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:28.949416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd8567a9-9bba-438d-a5da-436acb810205 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:28.950078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd8567a9-9bba-438d-a5da-436acb810205 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:28.981203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:51:28.981613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:51:28.982090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:51:28.982699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:51:28.983118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:51:28.996179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:28.998027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:28.999257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:28.999911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:29.026266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Getting quotas for project 6d9ffdaf1d654c9bbbda43ed9214c964. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:29.034013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Getting quotas for user caca1da9a52c4a2080682b2458fa1e4f and project 6d9ffdaf1d654c9bbbda43ed9214c964. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:29.061562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:51:29.066431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-cd8567a9-9bba-438d-a5da-436acb810205 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'flavor' on Instance uuid da666172-5dd1-484f-aca0-a346a83ecec3 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:51:29.069946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:51:29.160117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cd8567a9-9bba-438d-a5da-436acb810205 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Going to try to live migrate instance to nch1-master-1 {{(pid=136094) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 20:51:29.184492 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1a804140-2888-4d1f-bcba-188519d94094 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768687 Feb 19 20:51:29.185969 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 186/394] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:51:29.194907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d9879518-33f8-4446-80e4-838ce6781cc3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7f8a9d38db7e4dd9ae36791c4ad7508d"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:29.197759 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:29.197759 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:29.653850 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d9879518-33f8-4446-80e4-838ce6781cc3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/156349722/action" status: 200 len: 96 microversion: 2.1 time: 0.466543 Feb 19 20:51:29.654457 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 187/395] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Feb 19 20:51:29 2022] POST /compute/v2.1/flavors/156349722/action => generated 96 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:29.786174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7a61079b-92c6-4610-a4ab-de8ce593eb0a tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Calling method '.version_select at 0x7f6474639dc0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:29.787101 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:29.787101 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:29.790330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a61079b-92c6-4610-a4ab-de8ce593eb0a tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:29.790807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a61079b-92c6-4610-a4ab-de8ce593eb0a tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:29.819717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a61079b-92c6-4610-a4ab-de8ce593eb0a tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:29.820401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a61079b-92c6-4610-a4ab-de8ce593eb0a tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:29.837417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a61079b-92c6-4610-a4ab-de8ce593eb0a tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:29.838098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a61079b-92c6-4610-a4ab-de8ce593eb0a tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:29.852155 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7a61079b-92c6-4610-a4ab-de8ce593eb0a tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.189259 Feb 19 20:51:29.859632 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 188/396] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:29.861062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b29daa44-4b60-4c1b-8a85-1f35837105a6 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:29.861837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b29daa44-4b60-4c1b-8a85-1f35837105a6 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:29.881341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b29daa44-4b60-4c1b-8a85-1f35837105a6 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:29.885636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b29daa44-4b60-4c1b-8a85-1f35837105a6 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:29.901306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b29daa44-4b60-4c1b-8a85-1f35837105a6 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:29.917277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b29daa44-4b60-4c1b-8a85-1f35837105a6 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:30.576384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b29daa44-4b60-4c1b-8a85-1f35837105a6 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:30.585310 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b29daa44-4b60-4c1b-8a85-1f35837105a6 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1316 microversion: 2.1 time: 0.730348 Feb 19 20:51:30.587519 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 189/397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:29 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:30.591892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a908fccf-fa05-4631-b76e-f0c7de4e102b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:30.606350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a908fccf-fa05-4631-b76e-f0c7de4e102b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:30.612733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a908fccf-fa05-4631-b76e-f0c7de4e102b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:30.613538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a908fccf-fa05-4631-b76e-f0c7de4e102b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:30.614544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a908fccf-fa05-4631-b76e-f0c7de4e102b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:30.615181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a908fccf-fa05-4631-b76e-f0c7de4e102b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:30.853603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a908fccf-fa05-4631-b76e-f0c7de4e102b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:30.866025 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a908fccf-fa05-4631-b76e-f0c7de4e102b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1265 microversion: 2.1 time: 0.277016 Feb 19 20:51:30.870884 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 190/398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:30 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:30.884292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f8be5cc0-cd58-49cd-8181-a679f08ec522 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7f8a9d38db7e4dd9ae36791c4ad7508d"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:30.891714 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:30.891714 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:31.007450 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f8be5cc0-cd58-49cd-8181-a679f08ec522 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project 7f8a9d38db7e4dd9ae36791c4ad7508d combination. Feb 19 20:51:31.008294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f8be5cc0-cd58-49cd-8181-a679f08ec522 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project 7f8a9d38db7e4dd9ae36791c4ad7508d combination. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:31.009492 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f8be5cc0-cd58-49cd-8181-a679f08ec522 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/156349722/action" status: 409 len: 152 microversion: 2.1 time: 0.137341 Feb 19 20:51:31.010625 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 191/399] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Feb 19 20:51:30 2022] POST /compute/v2.1/flavors/156349722/action => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:51:31.053917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5181ae83-211f-4c38-a837-cfd1a3bbbf4e tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Calling method '.version_select at 0x7f6474931f70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:31.054898 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:31.054898 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:31.067044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5181ae83-211f-4c38-a837-cfd1a3bbbf4e tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:31.068745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5181ae83-211f-4c38-a837-cfd1a3bbbf4e tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:31.124710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5181ae83-211f-4c38-a837-cfd1a3bbbf4e tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:31.125160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5181ae83-211f-4c38-a837-cfd1a3bbbf4e tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:31.174075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5181ae83-211f-4c38-a837-cfd1a3bbbf4e tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:31.174541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5181ae83-211f-4c38-a837-cfd1a3bbbf4e tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:31.195099 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5181ae83-211f-4c38-a837-cfd1a3bbbf4e tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.181154 Feb 19 20:51:31.207131 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 192/400] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Feb 19 20:51:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:31.222215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5c4887c4-337a-4a9f-9674-4cdc72fb634f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:31.225244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5c4887c4-337a-4a9f-9674-4cdc72fb634f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:31.241393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c4887c4-337a-4a9f-9674-4cdc72fb634f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:31.242118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c4887c4-337a-4a9f-9674-4cdc72fb634f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:31.245314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c4887c4-337a-4a9f-9674-4cdc72fb634f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:31.246391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c4887c4-337a-4a9f-9674-4cdc72fb634f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:31.859422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5c4887c4-337a-4a9f-9674-4cdc72fb634f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:31.870752 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5c4887c4-337a-4a9f-9674-4cdc72fb634f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 0.661711 Feb 19 20:51:31.873952 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 193/401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:31 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:31.884232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61251e66-57ca-469f-849d-2d5a2e0a9c5a tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7f8a9d38db7e4dd9ae36791c4ad7508d"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:31.889626 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:31.889626 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:32.048126 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-61251e66-57ca-469f-849d-2d5a2e0a9c5a tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/156349722/action" status: 200 len: 21 microversion: 2.1 time: 0.171759 Feb 19 20:51:32.049080 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 194/402] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Feb 19 20:51:31 2022] POST /compute/v2.1/flavors/156349722/action => generated 21 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:32.056988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0055c362-5b1b-4c1d-a9c1-f0fa9572ae4d tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Calling method '.version_select at 0x7f6474551160>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:32.057788 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:32.057788 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:32.066804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0055c362-5b1b-4c1d-a9c1-f0fa9572ae4d tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.067263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0055c362-5b1b-4c1d-a9c1-f0fa9572ae4d tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.103175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0055c362-5b1b-4c1d-a9c1-f0fa9572ae4d tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.105832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0055c362-5b1b-4c1d-a9c1-f0fa9572ae4d tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.155967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0055c362-5b1b-4c1d-a9c1-f0fa9572ae4d tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.158058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0055c362-5b1b-4c1d-a9c1-f0fa9572ae4d tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.183811 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0055c362-5b1b-4c1d-a9c1-f0fa9572ae4d tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.133153 Feb 19 20:51:32.193197 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 195/403] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:32.207627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13d709ca-b9bb-427f-bdab-912bc4a79fe7 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:32.209213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-13d709ca-b9bb-427f-bdab-912bc4a79fe7 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:32.225780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13d709ca-b9bb-427f-bdab-912bc4a79fe7 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.227122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13d709ca-b9bb-427f-bdab-912bc4a79fe7 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.231110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13d709ca-b9bb-427f-bdab-912bc4a79fe7 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.233392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13d709ca-b9bb-427f-bdab-912bc4a79fe7 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.354992 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd8567a9-9bba-438d-a5da-436acb810205 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3/action" status: 202 len: 0 microversion: 2.25 time: 3.418985 Feb 19 20:51:32.355776 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 209/404] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 20:51:28 2022] POST /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3/action => generated 0 bytes in 3420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:51:32.362048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f1f5791-5ebb-4a4f-9ee8-b96d93b4c1f4 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:32.363398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3f1f5791-5ebb-4a4f-9ee8-b96d93b4c1f4 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:32.407736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f1f5791-5ebb-4a4f-9ee8-b96d93b4c1f4 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.409448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f1f5791-5ebb-4a4f-9ee8-b96d93b4c1f4 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.410671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f1f5791-5ebb-4a4f-9ee8-b96d93b4c1f4 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.412308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f1f5791-5ebb-4a4f-9ee8-b96d93b4c1f4 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.634372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3f1f5791-5ebb-4a4f-9ee8-b96d93b4c1f4 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:32.648556 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f1f5791-5ebb-4a4f-9ee8-b96d93b4c1f4 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1271 microversion: 2.1 time: 0.287615 Feb 19 20:51:32.649714 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 210/405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:32 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:32.659067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f448b2f-cc0d-461f-968a-fba2bcf91885 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:32.662243 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:32.662243 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:32.712874 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f448b2f-cc0d-461f-968a-fba2bcf91885 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/156349722" status: 202 len: 0 microversion: 2.1 time: 0.061457 Feb 19 20:51:32.715130 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 211/406] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 20:51:32 2022] DELETE /compute/v2.1/flavors/156349722 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:32.736192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df57854b-3261-4195-b75b-fc96132b7dce tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Calling method '.version_select at 0x7f64745a54c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:32.739047 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:32.739047 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:32.741806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df57854b-3261-4195-b75b-fc96132b7dce tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.746684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df57854b-3261-4195-b75b-fc96132b7dce tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.764934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df57854b-3261-4195-b75b-fc96132b7dce tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.765588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df57854b-3261-4195-b75b-fc96132b7dce tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.772935 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df57854b-3261-4195-b75b-fc96132b7dce tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.055889 Feb 19 20:51:32.775199 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 212/407] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:51:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:32.780110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:32.780947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:32.789050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.789810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:32.790785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:32.792186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:33.023519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13d709ca-b9bb-427f-bdab-912bc4a79fe7 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:33.038322 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13d709ca-b9bb-427f-bdab-912bc4a79fe7 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1316 microversion: 2.1 time: 0.842542 Feb 19 20:51:33.041675 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 196/408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:32 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1316 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:33.055580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-27a09d3a-de5f-4c7f-9b90-dbdd0d6e2b49 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:33.095528 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-27a09d3a-de5f-4c7f-9b90-dbdd0d6e2b49 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.043580 Feb 19 20:51:33.096627 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 197/409] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:33 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:33.117511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f49468a2-2005-4f76-861d-8cec186b4a3f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Calling method '.version_select at 0x7f6474419e50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:33.118844 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:33.118844 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:33.120587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f49468a2-2005-4f76-861d-8cec186b4a3f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:33.121269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f49468a2-2005-4f76-861d-8cec186b4a3f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:33.154603 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f49468a2-2005-4f76-861d-8cec186b4a3f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.041971 Feb 19 20:51:33.156471 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 198/410] 10.222.0.30 () {58 vars in 1178 bytes} [Sat Feb 19 20:51:33 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:33.167116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2eb2a425-9613-41dc-acd6-2d2b86707f4b req-799be652-bb6a-41f4-953d-e25423558526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1103dc8-5f12-42e9-93f9-ea4d34f90d2a", "name": "network-vif-plugged", "status": "completed", "tag": "7e9d6e32-ae0b-4fc9-8189-fc82708e3a33"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:33.170601 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:33.170601 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:33.181692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2eb2a425-9613-41dc-acd6-2d2b86707f4b req-799be652-bb6a-41f4-953d-e25423558526 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:33.183249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2eb2a425-9613-41dc-acd6-2d2b86707f4b req-799be652-bb6a-41f4-953d-e25423558526 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:33.202648 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2eb2a425-9613-41dc-acd6-2d2b86707f4b req-799be652-bb6a-41f4-953d-e25423558526 service nova] Creating event network-vif-plugged:7e9d6e32-ae0b-4fc9-8189-fc82708e3a33 for instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a on nch1-master-1 Feb 19 20:51:33.207979 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2eb2a425-9613-41dc-acd6-2d2b86707f4b req-799be652-bb6a-41f4-953d-e25423558526 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050419 Feb 19 20:51:33.209194 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 199/411] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:33.216373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-053ad9d4-726e-429b-8ff6-113a3521df0d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:33.217433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-053ad9d4-726e-429b-8ff6-113a3521df0d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:33.224485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-053ad9d4-726e-429b-8ff6-113a3521df0d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:33.224931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-053ad9d4-726e-429b-8ff6-113a3521df0d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:33.225816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-053ad9d4-726e-429b-8ff6-113a3521df0d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:33.230201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-053ad9d4-726e-429b-8ff6-113a3521df0d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:33.515618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:33.527982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:33.537797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:33.539224 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a3d5af7-6d40-4b10-964c-86cd14a00b7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1567 microversion: 2.25 time: 0.762720 Feb 19 20:51:33.540498 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 213/412] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:32 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1567 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:33.545506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-055e5112-2969-4b8d-9a41-aa52f34b6e0f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-819347010", "id": 1734569940, "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:33.548095 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:33.548095 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:33.581692 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-055e5112-2969-4b8d-9a41-aa52f34b6e0f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.039974 Feb 19 20:51:33.582353 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 214/413] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:33 2022] POST /compute/v2.1/flavors => generated 437 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:33.598144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4e76b292-02f8-4d2f-a941-e9cd0bde5533 tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Calling method '.version_select at 0x7f6474404430>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:33.599271 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:33.599271 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:33.601999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e76b292-02f8-4d2f-a941-e9cd0bde5533 tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:33.623726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e76b292-02f8-4d2f-a941-e9cd0bde5533 tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:33.641734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e76b292-02f8-4d2f-a941-e9cd0bde5533 tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:33.642191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e76b292-02f8-4d2f-a941-e9cd0bde5533 tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:33.674327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e76b292-02f8-4d2f-a941-e9cd0bde5533 tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:33.680487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e76b292-02f8-4d2f-a941-e9cd0bde5533 tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:33.698526 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4e76b292-02f8-4d2f-a941-e9cd0bde5533 tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.105308 Feb 19 20:51:33.699795 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 215/414] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:33.760908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-996f8ca1-ab55-4838-9974-8623e124ecae tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:33.761811 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:33.761811 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:33.789830 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-996f8ca1-ab55-4838-9974-8623e124ecae tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] HTTP exception thrown: Access list not available for public flavors. Feb 19 20:51:33.790659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-996f8ca1-ab55-4838-9974-8623e124ecae tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:33.791526 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-996f8ca1-ab55-4838-9974-8623e124ecae tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1734569940/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.090422 Feb 19 20:51:33.792111 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 216/415] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 20:51:33 2022] GET /compute/v2.1/flavors/1734569940/os-flavor-access => generated 91 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:51:33.798048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-735aaaa6-342f-43f4-b630-ab3ca8d6f189 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:33.798657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-735aaaa6-342f-43f4-b630-ab3ca8d6f189 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:33.811267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-735aaaa6-342f-43f4-b630-ab3ca8d6f189 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:33.811729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-735aaaa6-342f-43f4-b630-ab3ca8d6f189 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:33.822805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-735aaaa6-342f-43f4-b630-ab3ca8d6f189 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:33.823467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-735aaaa6-342f-43f4-b630-ab3ca8d6f189 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:34.318504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-053ad9d4-726e-429b-8ff6-113a3521df0d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:34.333773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-053ad9d4-726e-429b-8ff6-113a3521df0d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 1.122209 Feb 19 20:51:34.342090 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 200/416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:33 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:34.349337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1741d226-e2fc-492a-b9cc-aecc8605756b tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Calling method '.version_select at 0x7f64762a18b0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:34.350773 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:34.350773 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:34.354784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1741d226-e2fc-492a-b9cc-aecc8605756b tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:34.356259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1741d226-e2fc-492a-b9cc-aecc8605756b tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:34.377970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1741d226-e2fc-492a-b9cc-aecc8605756b tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:34.378528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1741d226-e2fc-492a-b9cc-aecc8605756b tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:34.386569 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1741d226-e2fc-492a-b9cc-aecc8605756b tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.042027 Feb 19 20:51:34.387183 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 201/417] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:51:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:34.393050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45c391fe-eb73-4db0-8006-908bfdd61230 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:34.394637 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:34.394637 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:34.417005 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45c391fe-eb73-4db0-8006-908bfdd61230 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1734569940" status: 202 len: 0 microversion: 2.1 time: 0.028463 Feb 19 20:51:34.421684 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 202/418] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:51:34 2022] DELETE /compute/v2.1/flavors/1734569940 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:34.429442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-20bfe8c7-2766-4e97-8f8d-f2d2736ac7b4 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:34.430210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-20bfe8c7-2766-4e97-8f8d-f2d2736ac7b4 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:34.437325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20bfe8c7-2766-4e97-8f8d-f2d2736ac7b4 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:34.437958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20bfe8c7-2766-4e97-8f8d-f2d2736ac7b4 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:34.438924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20bfe8c7-2766-4e97-8f8d-f2d2736ac7b4 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:34.439427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20bfe8c7-2766-4e97-8f8d-f2d2736ac7b4 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:34.680860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-735aaaa6-342f-43f4-b630-ab3ca8d6f189 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:34.696226 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-735aaaa6-342f-43f4-b630-ab3ca8d6f189 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1313 microversion: 2.1 time: 0.901928 Feb 19 20:51:34.697470 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 217/419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:33 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1313 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:34.714931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d850de0-e956-4b62-9b8a-1f4e89ce299f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Calling method '.version_select at 0x7f6474404a60>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:34.716301 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:34.716301 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:34.720132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d850de0-e956-4b62-9b8a-1f4e89ce299f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:34.720698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d850de0-e956-4b62-9b8a-1f4e89ce299f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:34.742372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d850de0-e956-4b62-9b8a-1f4e89ce299f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:34.743068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d850de0-e956-4b62-9b8a-1f4e89ce299f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:34.751718 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d850de0-e956-4b62-9b8a-1f4e89ce299f tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.042158 Feb 19 20:51:34.752916 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 218/420] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 20:51:34 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:34.758635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-967276dc-569b-46e7-a2b3-cc82cdaa89c6 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:34.784027 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-967276dc-569b-46e7-a2b3-cc82cdaa89c6 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.029222 Feb 19 20:51:34.785107 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 219/421] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:34 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:34.790712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:34.791348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:34.797647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:34.798093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:34.799077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:34.799668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:35.105183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-20bfe8c7-2766-4e97-8f8d-f2d2736ac7b4 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:35.116555 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-20bfe8c7-2766-4e97-8f8d-f2d2736ac7b4 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1316 microversion: 2.1 time: 0.692293 Feb 19 20:51:35.117517 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 203/422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:34 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1316 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:35.129734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-edad05ac-4623-4c05-8c78-3436626574ba tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Calling method '.version_select at 0x7f6474595b80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:35.131186 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:35.131186 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:35.133906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edad05ac-4623-4c05-8c78-3436626574ba tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:35.134363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edad05ac-4623-4c05-8c78-3436626574ba tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:35.152031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edad05ac-4623-4c05-8c78-3436626574ba tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:35.153670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edad05ac-4623-4c05-8c78-3436626574ba tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:35.165336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edad05ac-4623-4c05-8c78-3436626574ba tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:35.165851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edad05ac-4623-4c05-8c78-3436626574ba tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:35.198208 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-edad05ac-4623-4c05-8c78-3436626574ba tempest-HypervisorAdminTestJSON-1969495239 tempest-HypervisorAdminTestJSON-1969495239-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.078857 Feb 19 20:51:35.199732 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 204/423] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Feb 19 20:51:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:35.207136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5946067a-d2ec-48ea-ac6f-3b2a24ccae0a tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-927889160", "id": 1697122631, "os-flavor-access:is_public": "False"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:35.210759 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:35.210759 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:35.246357 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5946067a-d2ec-48ea-ac6f-3b2a24ccae0a tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.044696 Feb 19 20:51:35.252387 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 205/424] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:35 2022] POST /compute/v2.1/flavors => generated 438 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:35.371773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:35.381322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:35.383264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:35.384456 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-60237165-7397-4c10-b5c8-7d6238665616 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1567 microversion: 2.25 time: 0.598219 Feb 19 20:51:35.385263 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 220/425] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:34 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1567 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:35.391982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a42d031-132a-411c-bb5c-b333e7d194d4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:35.393003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a42d031-132a-411c-bb5c-b333e7d194d4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:35.399500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a42d031-132a-411c-bb5c-b333e7d194d4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:35.400437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a42d031-132a-411c-bb5c-b333e7d194d4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:35.401433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a42d031-132a-411c-bb5c-b333e7d194d4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:35.402119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a42d031-132a-411c-bb5c-b333e7d194d4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:35.523484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66814aa5-95b5-4988-bcfc-2a45333c3fd5 tempest-FlavorsAccessNegativeTestJSON-731552268 tempest-FlavorsAccessNegativeTestJSON-731552268-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7f8a9d38db7e4dd9ae36791c4ad7508d"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:35.526829 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:35.526829 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:35.526829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-66814aa5-95b5-4988-bcfc-2a45333c3fd5 tempest-FlavorsAccessNegativeTestJSON-731552268 tempest-FlavorsAccessNegativeTestJSON-731552268-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '5fdc6f4482de487b825316c486cd3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8a9d38db7e4dd9ae36791c4ad7508d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:35.526829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66814aa5-95b5-4988-bcfc-2a45333c3fd5 tempest-FlavorsAccessNegativeTestJSON-731552268 tempest-FlavorsAccessNegativeTestJSON-731552268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:35.527198 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-66814aa5-95b5-4988-bcfc-2a45333c3fd5 tempest-FlavorsAccessNegativeTestJSON-731552268 tempest-FlavorsAccessNegativeTestJSON-731552268-project] 10.222.0.30 "POST /compute/v2.1/flavors/1697122631/action" status: 403 len: 130 microversion: 2.1 time: 0.265418 Feb 19 20:51:35.529210 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 206/426] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Feb 19 20:51:35 2022] POST /compute/v2.1/flavors/1697122631/action => generated 130 bytes in 269 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:35.538374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fe8963f0-c6d6-4675-80e0-68eba38ac3e4 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:35.544984 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:35.544984 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:35.573701 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fe8963f0-c6d6-4675-80e0-68eba38ac3e4 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1697122631" status: 202 len: 0 microversion: 2.1 time: 0.041516 Feb 19 20:51:35.577828 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 207/427] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:51:35 2022] DELETE /compute/v2.1/flavors/1697122631 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:35.585558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19ea47e1-b3c1-4091-9e4e-7a0ede26f1f3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:35.609975 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-19ea47e1-b3c1-4091-9e4e-7a0ede26f1f3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.030581 Feb 19 20:51:35.610709 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 208/428] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:35 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:35.635345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1d3ae347-fff9-48fc-986e-3bb155f0aa84 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1237463038", "id": 1066746206, "os-flavor-access:is_public": "False"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:35.665313 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1d3ae347-fff9-48fc-986e-3bb155f0aa84 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.038115 Feb 19 20:51:35.679666 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 209/429] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:35 2022] POST /compute/v2.1/flavors => generated 439 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:35.689636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e9cb4eec-f32d-46eb-a864-1e527cba72ef req-1cd61484-fe23-4924-9da8-8ec1eca83241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e81722-edd5-49d7-ab7d-41e73614b6aa", "tag": "3604b765-b301-4875-991d-4d4190639b69"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:35.691377 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:35.691377 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:35.723856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e9cb4eec-f32d-46eb-a864-1e527cba72ef req-1cd61484-fe23-4924-9da8-8ec1eca83241 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:35.728501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e9cb4eec-f32d-46eb-a864-1e527cba72ef req-1cd61484-fe23-4924-9da8-8ec1eca83241 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:35.775590 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e9cb4eec-f32d-46eb-a864-1e527cba72ef req-1cd61484-fe23-4924-9da8-8ec1eca83241 service nova] Creating event network-changed:3604b765-b301-4875-991d-4d4190639b69 for instance 18e81722-edd5-49d7-ab7d-41e73614b6aa on nch1-master-1 Feb 19 20:51:35.789395 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e9cb4eec-f32d-46eb-a864-1e527cba72ef req-1cd61484-fe23-4924-9da8-8ec1eca83241 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108371 Feb 19 20:51:35.792527 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 210/430] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:35.806381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-090fa80b-2005-4c5d-8fe2-66d0d4c186b3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7f8a9d38db7e4dd9ae36791c4ad7508d"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:35.808586 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:35.808586 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:36.199318 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-090fa80b-2005-4c5d-8fe2-66d0d4c186b3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1066746206/action" status: 200 len: 97 microversion: 2.1 time: 0.404341 Feb 19 20:51:36.206882 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 211/431] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Feb 19 20:51:35 2022] POST /compute/v2.1/flavors/1066746206/action => generated 97 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:36.211938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a42d031-132a-411c-bb5c-b333e7d194d4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:36.216353 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a42d031-132a-411c-bb5c-b333e7d194d4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 0.829716 Feb 19 20:51:36.219842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a66bbd1-1574-4f55-a648-7ea531a4dd51 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:36.220797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a66bbd1-1574-4f55-a648-7ea531a4dd51 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:36.220933 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 221/432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:35 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:36.230541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c4d0a38d-333d-4cd8-aa9b-f75ed0c933bc tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:36.231269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c4d0a38d-333d-4cd8-aa9b-f75ed0c933bc tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:36.238941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a66bbd1-1574-4f55-a648-7ea531a4dd51 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:36.239390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a66bbd1-1574-4f55-a648-7ea531a4dd51 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:36.240185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a66bbd1-1574-4f55-a648-7ea531a4dd51 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:36.240670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a66bbd1-1574-4f55-a648-7ea531a4dd51 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:36.242489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4d0a38d-333d-4cd8-aa9b-f75ed0c933bc tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:36.242948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4d0a38d-333d-4cd8-aa9b-f75ed0c933bc tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:36.243739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4d0a38d-333d-4cd8-aa9b-f75ed0c933bc tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:36.244173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4d0a38d-333d-4cd8-aa9b-f75ed0c933bc tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:37.284705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c4d0a38d-333d-4cd8-aa9b-f75ed0c933bc tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:37.301094 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c4d0a38d-333d-4cd8-aa9b-f75ed0c933bc tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1465 microversion: 2.1 time: 1.079047 Feb 19 20:51:37.301710 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 222/433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:36 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1465 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:37.306685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a1d5e247-1408-4ffe-ba66-c88172ecbd4f tempest-FlavorsAccessNegativeTestJSON-731552268 tempest-FlavorsAccessNegativeTestJSON-731552268-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7f8a9d38db7e4dd9ae36791c4ad7508d"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:37.308599 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:37.308599 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:37.309803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a1d5e247-1408-4ffe-ba66-c88172ecbd4f tempest-FlavorsAccessNegativeTestJSON-731552268 tempest-FlavorsAccessNegativeTestJSON-731552268-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '5fdc6f4482de487b825316c486cd3cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8a9d38db7e4dd9ae36791c4ad7508d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:37.310613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a1d5e247-1408-4ffe-ba66-c88172ecbd4f tempest-FlavorsAccessNegativeTestJSON-731552268 tempest-FlavorsAccessNegativeTestJSON-731552268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:37.311623 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a1d5e247-1408-4ffe-ba66-c88172ecbd4f tempest-FlavorsAccessNegativeTestJSON-731552268 tempest-FlavorsAccessNegativeTestJSON-731552268-project] 10.222.0.30 "POST /compute/v2.1/flavors/1066746206/action" status: 403 len: 133 microversion: 2.1 time: 0.008548 Feb 19 20:51:37.312659 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 223/434] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Feb 19 20:51:37 2022] POST /compute/v2.1/flavors/1066746206/action => generated 133 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:37.319569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:37.320556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:37.328309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:37.329064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:37.330401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:37.331009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:37.364534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9a66bbd1-1574-4f55-a648-7ea531a4dd51 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:37.389134 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a66bbd1-1574-4f55-a648-7ea531a4dd51 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1313 microversion: 2.1 time: 1.175480 Feb 19 20:51:37.392403 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 212/435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:36 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1313 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:37.416002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4f512ef8-cfe8-47b5-ada1-586841c149b3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:37.416662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4f512ef8-cfe8-47b5-ada1-586841c149b3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:37.428816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f512ef8-cfe8-47b5-ada1-586841c149b3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:37.429266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f512ef8-cfe8-47b5-ada1-586841c149b3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:37.430806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f512ef8-cfe8-47b5-ada1-586841c149b3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:37.431840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f512ef8-cfe8-47b5-ada1-586841c149b3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:38.175243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:38.189726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:38.191898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:38.193989 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1e3a6387-2279-47c3-ad6e-4e7c2e99c50c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1567 microversion: 2.25 time: 0.880085 Feb 19 20:51:38.206531 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 224/436] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:37 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1567 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:38.212921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d933c28c-1418-4d04-b021-42fe66232ab2 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:38.213914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d933c28c-1418-4d04-b021-42fe66232ab2 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:38.230891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d933c28c-1418-4d04-b021-42fe66232ab2 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:38.231932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d933c28c-1418-4d04-b021-42fe66232ab2 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:38.233031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d933c28c-1418-4d04-b021-42fe66232ab2 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:38.233700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d933c28c-1418-4d04-b021-42fe66232ab2 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:38.305088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d933c28c-1418-4d04-b021-42fe66232ab2 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:51:38.355966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4f512ef8-cfe8-47b5-ada1-586841c149b3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:38.365713 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4f512ef8-cfe8-47b5-ada1-586841c149b3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 0.971879 Feb 19 20:51:38.369032 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 213/437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:37 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:38.393289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ec2dc990-d3e1-4c3b-a05b-51673be02055 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7f8a9d38db7e4dd9ae36791c4ad7508d"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:38.403868 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:38.403868 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:38.541282 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d933c28c-1418-4d04-b021-42fe66232ab2 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 204 len: 0 microversion: 2.1 time: 0.333097 Feb 19 20:51:38.541942 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 225/438] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:51:38 2022] DELETE /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:51:38.556730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-894467f1-88c5-475c-8442-5aad718b434c req-38800562-4ec6-402d-aa68-33b563f6be71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da666172-5dd1-484f-aca0-a346a83ecec3", "name": "network-vif-unplugged", "status": "completed", "tag": "8e715e53-af3f-4a70-b33f-5b5471d22747"}, {"name": "network-changed", "server_uuid": "29bbfea3-acce-4b4e-93c6-6b92a5d9196d", "tag": "3e5ba4a3-0cca-4c2c-a2d7-c425af1ec4cf"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:38.563932 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:38.563932 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:38.606560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-894467f1-88c5-475c-8442-5aad718b434c req-38800562-4ec6-402d-aa68-33b563f6be71 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:38.609770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-894467f1-88c5-475c-8442-5aad718b434c req-38800562-4ec6-402d-aa68-33b563f6be71 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:38.649528 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-894467f1-88c5-475c-8442-5aad718b434c req-38800562-4ec6-402d-aa68-33b563f6be71 service nova] Creating event network-vif-unplugged:8e715e53-af3f-4a70-b33f-5b5471d22747 for instance da666172-5dd1-484f-aca0-a346a83ecec3 on nch2-master-1 Feb 19 20:51:38.650286 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-894467f1-88c5-475c-8442-5aad718b434c req-38800562-4ec6-402d-aa68-33b563f6be71 service nova] Creating event network-changed:3e5ba4a3-0cca-4c2c-a2d7-c425af1ec4cf for instance 29bbfea3-acce-4b4e-93c6-6b92a5d9196d on nch2-master-1 Feb 19 20:51:38.667988 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-894467f1-88c5-475c-8442-5aad718b434c req-38800562-4ec6-402d-aa68-33b563f6be71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.123578 Feb 19 20:51:38.673062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 226/439] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:38.684741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c0005c47-58dc-4156-9fda-e552d245afd0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:38.687689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c0005c47-58dc-4156-9fda-e552d245afd0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:38.713939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0005c47-58dc-4156-9fda-e552d245afd0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:38.714706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0005c47-58dc-4156-9fda-e552d245afd0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:38.719065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0005c47-58dc-4156-9fda-e552d245afd0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:38.719670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0005c47-58dc-4156-9fda-e552d245afd0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:39.055585 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ec2dc990-d3e1-4c3b-a05b-51673be02055 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1066746206/action" status: 200 len: 21 microversion: 2.1 time: 0.684709 Feb 19 20:51:39.061827 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 214/440] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Feb 19 20:51:38 2022] POST /compute/v2.1/flavors/1066746206/action => generated 21 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:39.067565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9780243a-05a1-403e-b5ed-7cec8e79cc80 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:39.068545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9780243a-05a1-403e-b5ed-7cec8e79cc80 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:39.076836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9780243a-05a1-403e-b5ed-7cec8e79cc80 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:39.077628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9780243a-05a1-403e-b5ed-7cec8e79cc80 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:39.078657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9780243a-05a1-403e-b5ed-7cec8e79cc80 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:39.079310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9780243a-05a1-403e-b5ed-7cec8e79cc80 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:39.715419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c0005c47-58dc-4156-9fda-e552d245afd0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:39.727367 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c0005c47-58dc-4156-9fda-e552d245afd0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1313 microversion: 2.1 time: 1.052912 Feb 19 20:51:39.732320 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 227/441] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:38 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1313 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:39.742273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2214aa2-c2b3-4bb0-9cb0-7550741b0fe3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:39.749389 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:39.749389 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:39.787016 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2214aa2-c2b3-4bb0-9cb0-7550741b0fe3 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1066746206" status: 202 len: 0 microversion: 2.1 time: 0.052732 Feb 19 20:51:39.788212 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 228/442] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:51:39 2022] DELETE /compute/v2.1/flavors/1066746206 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:39.794643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:39.795466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:39.802932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:39.803723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:39.804778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:39.805425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:39.809901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9780243a-05a1-403e-b5ed-7cec8e79cc80 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:39.820535 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9780243a-05a1-403e-b5ed-7cec8e79cc80 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1471 microversion: 2.1 time: 0.757027 Feb 19 20:51:39.821131 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 215/443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:39 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1471 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:40.059207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ac2c16f4-d9e1-4cbf-91d3-578bb17e0907 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Calling method '.version_select at 0x7f647428d3a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:40.059962 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:40.059962 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:40.063280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac2c16f4-d9e1-4cbf-91d3-578bb17e0907 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.064314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac2c16f4-d9e1-4cbf-91d3-578bb17e0907 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.083504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac2c16f4-d9e1-4cbf-91d3-578bb17e0907 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.092110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac2c16f4-d9e1-4cbf-91d3-578bb17e0907 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.114134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac2c16f4-d9e1-4cbf-91d3-578bb17e0907 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.114589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac2c16f4-d9e1-4cbf-91d3-578bb17e0907 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.124625 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ac2c16f4-d9e1-4cbf-91d3-578bb17e0907 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.296952 Feb 19 20:51:40.125231 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 216/444] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:40.133584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-22191ac6-3f4e-4c3b-ba08-6aed30571c2c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:40.134517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-22191ac6-3f4e-4c3b-ba08-6aed30571c2c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:40.143657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22191ac6-3f4e-4c3b-ba08-6aed30571c2c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.148586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22191ac6-3f4e-4c3b-ba08-6aed30571c2c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.149626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22191ac6-3f4e-4c3b-ba08-6aed30571c2c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.150069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22191ac6-3f4e-4c3b-ba08-6aed30571c2c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.438913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:40.455481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:40.457429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:40.459487 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5595cc4b-e7c5-4ea5-bdef-dbc9b660cce7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1567 microversion: 2.25 time: 0.669793 Feb 19 20:51:40.469107 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 229/445] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:39 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1567 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:40.482184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14da99ad-14ba-4cdb-827e-8150a94d4ad1 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:40.573818 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14da99ad-14ba-4cdb-827e-8150a94d4ad1 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.101981 Feb 19 20:51:40.574440 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 230/446] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:40 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:40.592194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-63ec524b-ed88-49f6-a8dc-e9c56715a0d2 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Calling method '.version_select at 0x7f647435f160>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:40.593045 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:40.593045 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:40.594554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63ec524b-ed88-49f6-a8dc-e9c56715a0d2 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.595000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63ec524b-ed88-49f6-a8dc-e9c56715a0d2 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.630474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63ec524b-ed88-49f6-a8dc-e9c56715a0d2 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.630932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63ec524b-ed88-49f6-a8dc-e9c56715a0d2 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.690862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63ec524b-ed88-49f6-a8dc-e9c56715a0d2 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.693222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63ec524b-ed88-49f6-a8dc-e9c56715a0d2 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.708169 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-63ec524b-ed88-49f6-a8dc-e9c56715a0d2 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 354 microversion: 2.1 time: 0.132658 Feb 19 20:51:40.718277 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 231/447] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Feb 19 20:51:40 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:40.741256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3e4aa3d-6780-4eb3-97b7-7675940e488a tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-847817400", "id": 2069624267, "os-flavor-access:is_public": "False"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:40.747863 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:40.747863 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:40.787504 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e3e4aa3d-6780-4eb3-97b7-7675940e488a tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.062260 Feb 19 20:51:40.789961 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 232/448] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:40 2022] POST /compute/v2.1/flavors => generated 438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:40.796005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-90b82809-ee8c-4afe-b677-345faac0d207 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Calling method '.version_select at 0x7f6474404280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:40.797201 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:40.797201 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:40.800621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90b82809-ee8c-4afe-b677-345faac0d207 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.801322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90b82809-ee8c-4afe-b677-345faac0d207 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.822615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90b82809-ee8c-4afe-b677-345faac0d207 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.823347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90b82809-ee8c-4afe-b677-345faac0d207 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.838459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90b82809-ee8c-4afe-b677-345faac0d207 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.839521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90b82809-ee8c-4afe-b677-345faac0d207 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.852636 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-90b82809-ee8c-4afe-b677-345faac0d207 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061283 Feb 19 20:51:40.853852 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 233/449] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:40.860385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3fe3fae2-d0c5-4166-831a-5289137f055c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:40.861385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3fe3fae2-d0c5-4166-831a-5289137f055c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:40.870136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe3fae2-d0c5-4166-831a-5289137f055c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.871077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe3fae2-d0c5-4166-831a-5289137f055c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.872291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe3fae2-d0c5-4166-831a-5289137f055c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:40.873027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe3fae2-d0c5-4166-831a-5289137f055c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:40.997778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-22191ac6-3f4e-4c3b-ba08-6aed30571c2c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:41.005537 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-22191ac6-3f4e-4c3b-ba08-6aed30571c2c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 0.879137 Feb 19 20:51:41.006809 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 217/450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:40 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:41.011525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2467add2-a874-410f-819b-877fcb8c8e92 req-77528538-9708-4be7-80ae-306bba5833a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da666172-5dd1-484f-aca0-a346a83ecec3", "tag": "8e715e53-af3f-4a70-b33f-5b5471d22747"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:41.021150 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:41.021150 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:41.052879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2467add2-a874-410f-819b-877fcb8c8e92 req-77528538-9708-4be7-80ae-306bba5833a8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:41.053421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2467add2-a874-410f-819b-877fcb8c8e92 req-77528538-9708-4be7-80ae-306bba5833a8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:41.065182 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2467add2-a874-410f-819b-877fcb8c8e92 req-77528538-9708-4be7-80ae-306bba5833a8 service nova] Creating event network-changed:8e715e53-af3f-4a70-b33f-5b5471d22747 for instance da666172-5dd1-484f-aca0-a346a83ecec3 on nch2-master-1 Feb 19 20:51:41.072148 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2467add2-a874-410f-819b-877fcb8c8e92 req-77528538-9708-4be7-80ae-306bba5833a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063907 Feb 19 20:51:41.073387 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 218/451] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:41.078968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-89ee7acb-1e3d-4ed1-be32-88fb816b3651 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3ac3d148f3e14ea9a52e492597f8f54d"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:41.080512 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:41.080512 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:41.279637 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-89ee7acb-1e3d-4ed1-be32-88fb816b3651 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] HTTP exception thrown: Flavor access not found for 37 / 3ac3d148f3e14ea9a52e492597f8f54d combination. Feb 19 20:51:41.280250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-89ee7acb-1e3d-4ed1-be32-88fb816b3651 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Returning 404 to user: Flavor access not found for 37 / 3ac3d148f3e14ea9a52e492597f8f54d combination. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:41.281157 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-89ee7acb-1e3d-4ed1-be32-88fb816b3651 tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/2069624267/action" status: 404 len: 124 microversion: 2.1 time: 0.206514 Feb 19 20:51:41.281742 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 219/452] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Feb 19 20:51:41 2022] POST /compute/v2.1/flavors/2069624267/action => generated 124 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:41.295893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-48d7891f-13af-4491-9609-b2e702475425 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:41.297351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-48d7891f-13af-4491-9609-b2e702475425 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:41.305719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48d7891f-13af-4491-9609-b2e702475425 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:41.306261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48d7891f-13af-4491-9609-b2e702475425 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:41.307149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48d7891f-13af-4491-9609-b2e702475425 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:41.307661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48d7891f-13af-4491-9609-b2e702475425 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:41.712881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3fe3fae2-d0c5-4166-831a-5289137f055c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:41.721440 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3fe3fae2-d0c5-4166-831a-5289137f055c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1313 microversion: 2.1 time: 0.865768 Feb 19 20:51:41.735237 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 234/453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:40 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1313 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:41.749966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d1d736fb-0813-4c49-ae50-3ff10ba33181 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Calling method '.version_select at 0x7f64744bc670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:41.750983 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:41.750983 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:41.752785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1d736fb-0813-4c49-ae50-3ff10ba33181 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:41.753449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1d736fb-0813-4c49-ae50-3ff10ba33181 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:41.791047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1d736fb-0813-4c49-ae50-3ff10ba33181 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:41.791767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1d736fb-0813-4c49-ae50-3ff10ba33181 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:41.810308 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d1d736fb-0813-4c49-ae50-3ff10ba33181 tempest-HypervisorAdminUnderV252Test-973382642 tempest-HypervisorAdminUnderV252Test-973382642-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.063977 Feb 19 20:51:41.811046 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 235/454] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 20:51:41 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:41.819659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2e146dc5-9a1c-48ab-a01b-9cc24355473d tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:41.824021 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:41.824021 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:41.872736 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2e146dc5-9a1c-48ab-a01b-9cc24355473d tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2069624267" status: 202 len: 0 microversion: 2.1 time: 0.059773 Feb 19 20:51:41.874018 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 236/455] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:51:41 2022] DELETE /compute/v2.1/flavors/2069624267 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:41.879413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:41.880790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:41.887961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:41.889390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:41.890637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:41.892661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:42.539345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-48d7891f-13af-4491-9609-b2e702475425 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450a0144db174551aabee6fba0f5aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9809b88a7cf44fba908be3c1736b1f71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:42.555057 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-48d7891f-13af-4491-9609-b2e702475425 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 200 len: 1471 microversion: 2.1 time: 1.265961 Feb 19 20:51:42.556221 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 220/456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:41 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 1471 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:42.567719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1d05c9e6-c8e3-4736-986a-7e439b8b660f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:42.595677 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1d05c9e6-c8e3-4736-986a-7e439b8b660f tempest-FlavorsAccessNegativeTestJSON-440644769 tempest-FlavorsAccessNegativeTestJSON-440644769-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.036098 Feb 19 20:51:42.622114 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 221/457] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:42 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:42.629472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0cbaf647-0b61-4f23-9440-c61edb7e821a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:42.632749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0cbaf647-0b61-4f23-9440-c61edb7e821a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:42.652214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cbaf647-0b61-4f23-9440-c61edb7e821a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:42.652706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cbaf647-0b61-4f23-9440-c61edb7e821a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:42.653506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cbaf647-0b61-4f23-9440-c61edb7e821a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:42.665141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cbaf647-0b61-4f23-9440-c61edb7e821a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:42.812498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:42.836070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:42.837924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:42.843317 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3d881f03-d54e-41a8-a2ab-b0cc88022374 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1567 microversion: 2.25 time: 0.966220 Feb 19 20:51:42.854927 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 237/458] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:41 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1567 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:42.856439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3683dd55-eaca-4043-8b04-f014a684563e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:42.857268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3683dd55-eaca-4043-8b04-f014a684563e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:42.872679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3683dd55-eaca-4043-8b04-f014a684563e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:42.873047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3683dd55-eaca-4043-8b04-f014a684563e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:42.873850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3683dd55-eaca-4043-8b04-f014a684563e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:42.874294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3683dd55-eaca-4043-8b04-f014a684563e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.208049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0cbaf647-0b61-4f23-9440-c61edb7e821a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:43.223189 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0cbaf647-0b61-4f23-9440-c61edb7e821a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 0.599956 Feb 19 20:51:43.235616 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 222/459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:42 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:43.338678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3683dd55-eaca-4043-8b04-f014a684563e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:43.349828 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3683dd55-eaca-4043-8b04-f014a684563e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1313 microversion: 2.1 time: 0.504015 Feb 19 20:51:43.353523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-51608139-98de-4c51-9b02-d2f3c2141375 req-fb31a8c0-c028-49ae-a88d-881da8c00d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1103dc8-5f12-42e9-93f9-ea4d34f90d2a", "name": "network-vif-deleted", "tag": "7e9d6e32-ae0b-4fc9-8189-fc82708e3a33"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:43.354997 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:43.354997 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:43.355886 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 238/460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:42 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:43.368000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-51608139-98de-4c51-9b02-d2f3c2141375 req-fb31a8c0-c028-49ae-a88d-881da8c00d5e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.372108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-51608139-98de-4c51-9b02-d2f3c2141375 req-fb31a8c0-c028-49ae-a88d-881da8c00d5e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.393842 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-51608139-98de-4c51-9b02-d2f3c2141375 req-fb31a8c0-c028-49ae-a88d-881da8c00d5e service nova] Creating event network-vif-deleted:7e9d6e32-ae0b-4fc9-8189-fc82708e3a33 for instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a on nch1-master-1 Feb 19 20:51:43.399326 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-51608139-98de-4c51-9b02-d2f3c2141375 req-fb31a8c0-c028-49ae-a88d-881da8c00d5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050474 Feb 19 20:51:43.400101 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 223/461] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:51:43.580621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-526a83fc-9f18-4ee3-ab15-b69764045ee5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:43.581244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-526a83fc-9f18-4ee3-ab15-b69764045ee5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:43.596798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-526a83fc-9f18-4ee3-ab15-b69764045ee5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.597839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-526a83fc-9f18-4ee3-ab15-b69764045ee5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.599098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-526a83fc-9f18-4ee3-ab15-b69764045ee5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.600830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-526a83fc-9f18-4ee3-ab15-b69764045ee5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.643218 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-526a83fc-9f18-4ee3-ab15-b69764045ee5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] HTTP exception thrown: Instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a could not be found. Feb 19 20:51:43.644089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-526a83fc-9f18-4ee3-ab15-b69764045ee5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Returning 404 to user: Instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:43.645964 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-526a83fc-9f18-4ee3-ab15-b69764045ee5 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 404 len: 111 microversion: 2.1 time: 0.071690 Feb 19 20:51:43.648004 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 239/462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:43 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:43.658561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-14801c0c-6dba-4992-91a3-64e988450e2f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1357398046", "metadata": {"image_type": "test"}}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:43.659508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-14801c0c-6dba-4992-91a3-64e988450e2f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:43.670004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14801c0c-6dba-4992-91a3-64e988450e2f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.670458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14801c0c-6dba-4992-91a3-64e988450e2f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.671253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14801c0c-6dba-4992-91a3-64e988450e2f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.671691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14801c0c-6dba-4992-91a3-64e988450e2f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.712360 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-14801c0c-6dba-4992-91a3-64e988450e2f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] HTTP exception thrown: Instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a could not be found. Feb 19 20:51:43.712969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-14801c0c-6dba-4992-91a3-64e988450e2f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Returning 404 to user: Instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:43.714402 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-14801c0c-6dba-4992-91a3-64e988450e2f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "POST /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a/action" status: 404 len: 111 microversion: 2.1 time: 0.059802 Feb 19 20:51:43.716311 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 224/463] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Feb 19 20:51:43 2022] POST /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:43.728158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a3faca9a-0944-4560-a11d-9a3530ac9f4f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1747953073", "metadata": {"image_type": "test"}}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:43.729913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a3faca9a-0944-4560-a11d-9a3530ac9f4f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Failed to fetch instance by id tempest-invalid-450817153 {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2871}} Feb 19 20:51:43.730596 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a3faca9a-0944-4560-a11d-9a3530ac9f4f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] HTTP exception thrown: Instance tempest-invalid-450817153 could not be found. Feb 19 20:51:43.731286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a3faca9a-0944-4560-a11d-9a3530ac9f4f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Returning 404 to user: Instance tempest-invalid-450817153 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:43.732646 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a3faca9a-0944-4560-a11d-9a3530ac9f4f tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "POST /compute/v2.1/servers/tempest-invalid-450817153/action" status: 404 len: 100 microversion: 2.1 time: 0.009462 Feb 19 20:51:43.733671 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 240/464] 10.222.0.30 () {60 vars in 1245 bytes} [Sat Feb 19 20:51:43 2022] POST /compute/v2.1/servers/tempest-invalid-450817153/action => generated 100 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:43.743565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7906c5bc-c3ba-4014-ad40-ceea56c09c54 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1092414394"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:43.744597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7906c5bc-c3ba-4014-ad40-ceea56c09c54 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2871}} Feb 19 20:51:43.745236 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-7906c5bc-c3ba-4014-ad40-ceea56c09c54 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Feb 19 20:51:43.745868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7906c5bc-c3ba-4014-ad40-ceea56c09c54 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:43.746809 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7906c5bc-c3ba-4014-ad40-ceea56c09c54 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.007868 Feb 19 20:51:43.747357 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 225/465] 10.222.0.30 () {60 vars in 1274 bytes} [Sat Feb 19 20:51:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:43.759004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0d9f64f6-a5b1-4c26-ae5e-cd1924c1c44e tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-133479680"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:43.760095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0d9f64f6-a5b1-4c26-ae5e-cd1924c1c44e tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2871}} Feb 19 20:51:43.760797 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0d9f64f6-a5b1-4c26-ae5e-cd1924c1c44e tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Feb 19 20:51:43.761347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0d9f64f6-a5b1-4c26-ae5e-cd1924c1c44e tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:43.762138 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0d9f64f6-a5b1-4c26-ae5e-cd1924c1c44e tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.009189 Feb 19 20:51:43.763976 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 241/466] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Feb 19 20:51:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:43.776145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8da46e6f-4b8a-4d17-b5c2-fc6610856b3b tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:43.776943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8da46e6f-4b8a-4d17-b5c2-fc6610856b3b tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:43.791814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8da46e6f-4b8a-4d17-b5c2-fc6610856b3b tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.792270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8da46e6f-4b8a-4d17-b5c2-fc6610856b3b tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.793094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8da46e6f-4b8a-4d17-b5c2-fc6610856b3b tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.793535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8da46e6f-4b8a-4d17-b5c2-fc6610856b3b tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.814916 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8da46e6f-4b8a-4d17-b5c2-fc6610856b3b tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] HTTP exception thrown: Instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a could not be found. Feb 19 20:51:43.815545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8da46e6f-4b8a-4d17-b5c2-fc6610856b3b tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Returning 404 to user: Instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:43.816391 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8da46e6f-4b8a-4d17-b5c2-fc6610856b3b tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 404 len: 111 microversion: 2.1 time: 0.046655 Feb 19 20:51:43.824216 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 226/467] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:51:43 2022] DELETE /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:43.829448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3f51a7a-0820-492e-b041-7f03530e6e11 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:43.830102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e3f51a7a-0820-492e-b041-7f03530e6e11 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] [instance: d1103dc8-5f12-42e9-93f9-ea4d34f90d2a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:43.850677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3f51a7a-0820-492e-b041-7f03530e6e11 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.851143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3f51a7a-0820-492e-b041-7f03530e6e11 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.851961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3f51a7a-0820-492e-b041-7f03530e6e11 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.852426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3f51a7a-0820-492e-b041-7f03530e6e11 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.888211 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e3f51a7a-0820-492e-b041-7f03530e6e11 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] HTTP exception thrown: Instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a could not be found. Feb 19 20:51:43.890593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3f51a7a-0820-492e-b041-7f03530e6e11 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] Returning 404 to user: Instance d1103dc8-5f12-42e9-93f9-ea4d34f90d2a could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:43.911851 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e3f51a7a-0820-492e-b041-7f03530e6e11 tempest-ImagesNegativeTestJSON-1965061510 tempest-ImagesNegativeTestJSON-1965061510-project] 10.222.0.30 "GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a" status: 404 len: 111 microversion: 2.1 time: 0.065718 Feb 19 20:51:43.919548 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 242/468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:43 2022] GET /compute/v2.1/servers/d1103dc8-5f12-42e9-93f9-ea4d34f90d2a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:43.930232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:43.930899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:43.953779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.956403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:43.959772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:43.963746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:44.148264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:44.159669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:44.161336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:44.163095 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff72657e-e2e3-4808-80b4-01c1adb0d630 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1567 microversion: 2.25 time: 0.298971 Feb 19 20:51:44.163656 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 227/469] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:43 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:44.243272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5f1d3e7-71a0-457e-8804-27cdab84be81 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:44.243872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d5f1d3e7-71a0-457e-8804-27cdab84be81 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:44.250128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5f1d3e7-71a0-457e-8804-27cdab84be81 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:44.250576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5f1d3e7-71a0-457e-8804-27cdab84be81 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:44.251523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5f1d3e7-71a0-457e-8804-27cdab84be81 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:44.252202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5f1d3e7-71a0-457e-8804-27cdab84be81 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:44.372596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7eab228b-35fc-4485-bfe1-31b549edb406 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:44.373635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7eab228b-35fc-4485-bfe1-31b549edb406 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:44.389412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7eab228b-35fc-4485-bfe1-31b549edb406 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:44.390168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7eab228b-35fc-4485-bfe1-31b549edb406 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:44.391835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7eab228b-35fc-4485-bfe1-31b549edb406 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:44.393193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7eab228b-35fc-4485-bfe1-31b549edb406 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:44.451917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d5f1d3e7-71a0-457e-8804-27cdab84be81 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:44.467156 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5f1d3e7-71a0-457e-8804-27cdab84be81 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 0.227935 Feb 19 20:51:44.468362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 243/470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:44 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:44.665456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7eab228b-35fc-4485-bfe1-31b549edb406 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:44.675174 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7eab228b-35fc-4485-bfe1-31b549edb406 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1313 microversion: 2.1 time: 0.307104 Feb 19 20:51:44.675782 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 228/471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:44 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:51:44.866742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-de132e81-2651-4910-bb9d-7d624c762411 req-09834436-a1be-4eaa-b94b-98a3c183bd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e81722-edd5-49d7-ab7d-41e73614b6aa", "name": "network-vif-plugged", "status": "completed", "tag": "3604b765-b301-4875-991d-4d4190639b69"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:44.872756 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:44.872756 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:44.902512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-de132e81-2651-4910-bb9d-7d624c762411 req-09834436-a1be-4eaa-b94b-98a3c183bd77 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:44.908968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-de132e81-2651-4910-bb9d-7d624c762411 req-09834436-a1be-4eaa-b94b-98a3c183bd77 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:44.970997 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-de132e81-2651-4910-bb9d-7d624c762411 req-09834436-a1be-4eaa-b94b-98a3c183bd77 service nova] Creating event network-vif-plugged:3604b765-b301-4875-991d-4d4190639b69 for instance 18e81722-edd5-49d7-ab7d-41e73614b6aa on nch1-master-1 Feb 19 20:51:44.992018 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-de132e81-2651-4910-bb9d-7d624c762411 req-09834436-a1be-4eaa-b94b-98a3c183bd77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135509 Feb 19 20:51:44.996093 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 244/472] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:51:45.198659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:45.204316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:45.233235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:45.234860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:45.240137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:45.250864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:45.486791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7e4b40cd-b439-49e6-b3a5-a5405d5955d0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:45.487504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7e4b40cd-b439-49e6-b3a5-a5405d5955d0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:45.498864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e4b40cd-b439-49e6-b3a5-a5405d5955d0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:45.499313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e4b40cd-b439-49e6-b3a5-a5405d5955d0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:45.500119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e4b40cd-b439-49e6-b3a5-a5405d5955d0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:45.500586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e4b40cd-b439-49e6-b3a5-a5405d5955d0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:46.196306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:46.210432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:46.212318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:46.216066 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4e6757f8-f7ad-4afb-a41c-ac387892b549 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1567 microversion: 2.25 time: 1.028250 Feb 19 20:51:46.231766 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 229/473] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:45 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1567 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:51:46.237818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-001926c5-39fe-4fe7-ae96-203fe758d8db tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:46.238919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-001926c5-39fe-4fe7-ae96-203fe758d8db tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:46.247774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-001926c5-39fe-4fe7-ae96-203fe758d8db tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:46.248950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-001926c5-39fe-4fe7-ae96-203fe758d8db tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:46.249770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-001926c5-39fe-4fe7-ae96-203fe758d8db tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:46.250209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-001926c5-39fe-4fe7-ae96-203fe758d8db tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:46.288401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7e4b40cd-b439-49e6-b3a5-a5405d5955d0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:46.298329 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7e4b40cd-b439-49e6-b3a5-a5405d5955d0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 0.816430 Feb 19 20:51:46.316489 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 245/474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:45 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:46.861996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-001926c5-39fe-4fe7-ae96-203fe758d8db tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:46.875065 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-001926c5-39fe-4fe7-ae96-203fe758d8db tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1313 microversion: 2.1 time: 0.642033 Feb 19 20:51:46.887335 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 230/475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:46 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1313 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:47.239291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:47.241135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:47.251128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:47.252347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:47.254671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:47.255113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:47.323167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b2031acf-3da4-454c-8a20-11b3622c4d08 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:47.324570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b2031acf-3da4-454c-8a20-11b3622c4d08 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:47.335103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2031acf-3da4-454c-8a20-11b3622c4d08 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:47.335554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2031acf-3da4-454c-8a20-11b3622c4d08 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:47.341336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2031acf-3da4-454c-8a20-11b3622c4d08 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:47.341877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2031acf-3da4-454c-8a20-11b3622c4d08 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:48.204616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:48.235528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b2031acf-3da4-454c-8a20-11b3622c4d08 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:48.335874 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b2031acf-3da4-454c-8a20-11b3622c4d08 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1475 microversion: 2.1 time: 1.016622 Feb 19 20:51:48.359912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:48.371009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:48.384829 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fb86ddae-9c21-4fd5-818d-1ac5ed1d73a4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1567 microversion: 2.25 time: 1.147670 Feb 19 20:51:48.401835 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 246/476] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:47 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1567 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:48.402234 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 231/477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:47 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1475 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:48.407414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98ed8020-7fbc-44ab-b86a-8f1d9e6f7b4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:48.408500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98ed8020-7fbc-44ab-b86a-8f1d9e6f7b4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:48.417831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98ed8020-7fbc-44ab-b86a-8f1d9e6f7b4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:48.418698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98ed8020-7fbc-44ab-b86a-8f1d9e6f7b4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:48.419735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98ed8020-7fbc-44ab-b86a-8f1d9e6f7b4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:48.420409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98ed8020-7fbc-44ab-b86a-8f1d9e6f7b4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:48.895413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-98ed8020-7fbc-44ab-b86a-8f1d9e6f7b4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:48.910240 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-98ed8020-7fbc-44ab-b86a-8f1d9e6f7b4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1313 microversion: 2.1 time: 0.500942 Feb 19 20:51:48.924079 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 247/478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:48 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:49.406677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c90a6b5c-bd34-4e11-9d4a-48abf8fb9688 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:49.407450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c90a6b5c-bd34-4e11-9d4a-48abf8fb9688 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:49.408817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:49.411698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:49.422101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c90a6b5c-bd34-4e11-9d4a-48abf8fb9688 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:49.425645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c90a6b5c-bd34-4e11-9d4a-48abf8fb9688 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:49.427457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:49.428579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:49.430031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:49.430497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c90a6b5c-bd34-4e11-9d4a-48abf8fb9688 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:49.431699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c90a6b5c-bd34-4e11-9d4a-48abf8fb9688 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:49.432845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:50.070664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:50.082367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:50.086346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:50.090703 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7563de36-26f3-4d0d-a374-713cb697d363 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1557 microversion: 2.25 time: 0.682861 Feb 19 20:51:50.097597 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 248/479] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:49 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1557 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:50.122200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8ea00273-4b3e-47f2-824e-b521ffbf05ba req-7724e9e6-23f1-4d09-b2b0-748cc10440cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bbfea3-acce-4b4e-93c6-6b92a5d9196d", "name": "network-vif-plugged", "status": "completed", "tag": "3e5ba4a3-0cca-4c2c-a2d7-c425af1ec4cf"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:50.124189 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:50.124189 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:50.141569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8ea00273-4b3e-47f2-824e-b521ffbf05ba req-7724e9e6-23f1-4d09-b2b0-748cc10440cc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:50.142022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8ea00273-4b3e-47f2-824e-b521ffbf05ba req-7724e9e6-23f1-4d09-b2b0-748cc10440cc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:50.173295 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8ea00273-4b3e-47f2-824e-b521ffbf05ba req-7724e9e6-23f1-4d09-b2b0-748cc10440cc service nova] Creating event network-vif-plugged:3e5ba4a3-0cca-4c2c-a2d7-c425af1ec4cf for instance 29bbfea3-acce-4b4e-93c6-6b92a5d9196d on nch2-master-1 Feb 19 20:51:50.184177 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8ea00273-4b3e-47f2-824e-b521ffbf05ba req-7724e9e6-23f1-4d09-b2b0-748cc10440cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085383 Feb 19 20:51:50.187905 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 249/480] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:50.204527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-59db1d9d-8cb7-4b05-b4a0-e836215ee03b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:50.205261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-59db1d9d-8cb7-4b05-b4a0-e836215ee03b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:50.219723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59db1d9d-8cb7-4b05-b4a0-e836215ee03b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:50.220179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59db1d9d-8cb7-4b05-b4a0-e836215ee03b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:50.224344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59db1d9d-8cb7-4b05-b4a0-e836215ee03b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:50.226504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59db1d9d-8cb7-4b05-b4a0-e836215ee03b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:50.632992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c90a6b5c-bd34-4e11-9d4a-48abf8fb9688 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:50.653401 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c90a6b5c-bd34-4e11-9d4a-48abf8fb9688 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1474 microversion: 2.1 time: 1.244795 Feb 19 20:51:50.655175 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 232/481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:49 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1474 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:50.710084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8b18cdaa-c4c5-46cd-b9eb-935853dc33a1 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '.version_select at 0x7f6474551ca0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:50.711750 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:50.711750 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:50.722418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b18cdaa-c4c5-46cd-b9eb-935853dc33a1 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:50.746971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b18cdaa-c4c5-46cd-b9eb-935853dc33a1 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:50.799302 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8b18cdaa-c4c5-46cd-b9eb-935853dc33a1 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1109 microversion: 2.25 time: 0.139965 Feb 19 20:51:50.800486 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 233/482] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Feb 19 20:51:50 2022] GET /compute/v2.1/os-migrations => generated 1109 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:51.124819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-59db1d9d-8cb7-4b05-b4a0-e836215ee03b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:51.142171 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-59db1d9d-8cb7-4b05-b4a0-e836215ee03b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1313 microversion: 2.1 time: 0.946681 Feb 19 20:51:51.155938 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 250/483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:50 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1313 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:51.187251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5ceca5c0-8ecb-4d5e-bdd1-c49f697138e5 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:51.195480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5ceca5c0-8ecb-4d5e-bdd1-c49f697138e5 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:51.214889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ceca5c0-8ecb-4d5e-bdd1-c49f697138e5 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:51.217711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ceca5c0-8ecb-4d5e-bdd1-c49f697138e5 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:51.221080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ceca5c0-8ecb-4d5e-bdd1-c49f697138e5 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:51.229948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ceca5c0-8ecb-4d5e-bdd1-c49f697138e5 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:51.877639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7d9f81ad-6060-461b-bfb1-759d20a8e3ac tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Action: 'create', calling method: .version_select at 0x7f64743ea9d0>, body: {"keypair": {"name": "tempest-keypair-1841182230", "type": "ssh", "user_id": "e3c6ec50f5ca4bbeac3f1204394291eb"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:51.942673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7d9f81ad-6060-461b-bfb1-759d20a8e3ac tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:51.954132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7d9f81ad-6060-461b-bfb1-759d20a8e3ac tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for user 5608e63a5941422f8082a017b5b3998f and project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:52.245333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7d9f81ad-6060-461b-bfb1-759d20a8e3ac tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:52.249864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-5ceca5c0-8ecb-4d5e-bdd1-c49f697138e5 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid da666172-5dd1-484f-aca0-a346a83ecec3 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:51:52.257539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7d9f81ad-6060-461b-bfb1-759d20a8e3ac tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for user 5608e63a5941422f8082a017b5b3998f and project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:52.289711 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7d9f81ad-6060-461b-bfb1-759d20a8e3ac tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.10 time: 1.488019 Feb 19 20:51:52.292717 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 234/484] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Feb 19 20:51:50 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1491 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:51:52.305158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8f87ba9a-188c-4eb1-96ea-392150cd7128 req-8fe4986b-bcdf-4c2f-b6ce-d10d02ed6921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24d94c6-d921-42bf-affb-6f8556e5b76d", "name": "network-vif-unplugged", "status": "completed", "tag": "99019bb9-0cfe-4900-a813-f2a3826c4aed"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:52.306946 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:52.306946 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:52.320628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8f87ba9a-188c-4eb1-96ea-392150cd7128 req-8fe4986b-bcdf-4c2f-b6ce-d10d02ed6921 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:52.321504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8f87ba9a-188c-4eb1-96ea-392150cd7128 req-8fe4986b-bcdf-4c2f-b6ce-d10d02ed6921 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:52.337172 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8f87ba9a-188c-4eb1-96ea-392150cd7128 req-8fe4986b-bcdf-4c2f-b6ce-d10d02ed6921 service nova] Creating event network-vif-unplugged:99019bb9-0cfe-4900-a813-f2a3826c4aed for instance d24d94c6-d921-42bf-affb-6f8556e5b76d on nch2-master-1 Feb 19 20:51:52.346600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-8f87ba9a-188c-4eb1-96ea-392150cd7128 req-8fe4986b-bcdf-4c2f-b6ce-d10d02ed6921 service nova] Instance d24d94c6-d921-42bf-affb-6f8556e5b76d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:51:52.367719 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8f87ba9a-188c-4eb1-96ea-392150cd7128 req-8fe4986b-bcdf-4c2f-b6ce-d10d02ed6921 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073284 Feb 19 20:51:52.369077 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 235/485] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:52.409221 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5ceca5c0-8ecb-4d5e-bdd1-c49f697138e5 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 2048 microversion: 2.25 time: 1.251857 Feb 19 20:51:52.425913 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 251/486] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:51 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 2048 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:52.487714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8b8ca497-fba8-4104-9f12-e950a4cedcf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:52.489998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8b8ca497-fba8-4104-9f12-e950a4cedcf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:52.528011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b8ca497-fba8-4104-9f12-e950a4cedcf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:52.534344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b8ca497-fba8-4104-9f12-e950a4cedcf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:52.536960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b8ca497-fba8-4104-9f12-e950a4cedcf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:52.537683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b8ca497-fba8-4104-9f12-e950a4cedcf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:52.816021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cd8f5290-c4a5-4743-9453-77342b6261c5 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f647428dca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1315134339", "description": "tempest-description-1634090777"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:52.967426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8b8ca497-fba8-4104-9f12-e950a4cedcf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:52.976531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8b8ca497-fba8-4104-9f12-e950a4cedcf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1474 microversion: 2.1 time: 0.531084 Feb 19 20:51:52.983912 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 252/487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:52 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1474 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:52.988809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b0f3ddd3-1299-486a-a4b2-f326eac6ef0e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:52.989780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b0f3ddd3-1299-486a-a4b2-f326eac6ef0e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:52.996383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0f3ddd3-1299-486a-a4b2-f326eac6ef0e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:52.997180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0f3ddd3-1299-486a-a4b2-f326eac6ef0e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:52.998341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0f3ddd3-1299-486a-a4b2-f326eac6ef0e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:53.000126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0f3ddd3-1299-486a-a4b2-f326eac6ef0e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:53.161943 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cd8f5290-c4a5-4743-9453-77342b6261c5 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.791472 Feb 19 20:51:53.162601 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 236/488] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 20:51:52 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:53.167546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c8f076f-06d6-446e-9d22-6fce5967a691 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Action: 'create', calling method: .version_select at 0x7f64746d9c10>, body: {"keypair": {"name": "tempest-keypair-1478387977", "type": "ssh", "user_id": "e3c6ec50f5ca4bbeac3f1204394291eb"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:53.183943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-4c8f076f-06d6-446e-9d22-6fce5967a691 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:53.194311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-4c8f076f-06d6-446e-9d22-6fce5967a691 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for user 5608e63a5941422f8082a017b5b3998f and project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:53.252592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b0f3ddd3-1299-486a-a4b2-f326eac6ef0e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:53.262610 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b0f3ddd3-1299-486a-a4b2-f326eac6ef0e tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1463 microversion: 2.1 time: 0.283849 Feb 19 20:51:53.264921 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 253/489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:52 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1463 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:53.343167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1b520aea-b46d-46db-bcc6-8cdd26dba3b7 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-944574471", "ram": 512, "vcpus": 1, "disk": 10, "id": 1836753613, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:53.345089 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:53.345089 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:53.361799 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1b520aea-b46d-46db-bcc6-8cdd26dba3b7 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.092964 Feb 19 20:51:53.362536 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 254/490] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:53 2022] POST /compute/v2.1/flavors => generated 415 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:53.367648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-739189913", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "020891c0-689f-4c7c-a850-6c2b2dfe0076"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:53.425382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] validate_networks() for [('020891c0-689f-4c7c-a850-6c2b2dfe0076', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:51:53.493704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-4c8f076f-06d6-446e-9d22-6fce5967a691 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:53.497769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-4c8f076f-06d6-446e-9d22-6fce5967a691 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for user 5608e63a5941422f8082a017b5b3998f and project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:53.514559 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c8f076f-06d6-446e-9d22-6fce5967a691 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.350665 Feb 19 20:51:53.520740 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 237/491] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Feb 19 20:51:53 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 352 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:51:53.520740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ef97a6e0-7573-473b-9315-e5f91b41ba3c tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f6474347d30>, body: {"security_group_rule": {"parent_group_id": "dcc26d45-dc4f-4516-b2cf-c476080034d0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:53.822851 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ef97a6e0-7573-473b-9315-e5f91b41ba3c tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.306165 Feb 19 20:51:53.823458 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 238/492] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 20:51:53 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:53.832494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bac322c5-e732-4f03-9e0e-222bcb941f36 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:53.833444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bac322c5-e732-4f03-9e0e-222bcb941f36 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:53.842865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac322c5-e732-4f03-9e0e-222bcb941f36 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:53.843376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac322c5-e732-4f03-9e0e-222bcb941f36 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:53.844184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac322c5-e732-4f03-9e0e-222bcb941f36 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:53.844813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac322c5-e732-4f03-9e0e-222bcb941f36 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:54.020631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:51:54.021151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:51:54.022467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:51:54.022980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:51:54.023522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:51:54.033812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:54.034405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:54.035220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:54.035649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:54.052507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Getting quotas for project a6f02f88286b49babe665db9d00787a2. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:54.057384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bac322c5-e732-4f03-9e0e-222bcb941f36 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:54.057554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Getting quotas for user ec1a2a2db19c41cca4342aa082770a96 and project a6f02f88286b49babe665db9d00787a2. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:54.065629 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bac322c5-e732-4f03-9e0e-222bcb941f36 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1463 microversion: 2.1 time: 0.241130 Feb 19 20:51:54.066452 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 239/493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:53 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1463 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:54.076029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:51:54.078392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:51:54.152890 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0fbf4021-c6ce-4725-ad4f-15d737477b5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.789014 Feb 19 20:51:54.154400 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 255/494] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 20:51:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 20:51:54.159797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b510975d-d90b-4331-bf29-262095de741c tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Calling method '.version_select at 0x7f64743f80d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:54.170395 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b510975d-d90b-4331-bf29-262095de741c tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1841182230?user_id=e3c6ec50f5ca4bbeac3f1204394291eb" status: 200 len: 706 microversion: 2.10 time: 0.014525 Feb 19 20:51:54.172885 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 256/495] 10.222.0.30 () {60 vars in 1339 bytes} [Sat Feb 19 20:51:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1841182230?user_id=e3c6ec50f5ca4bbeac3f1204394291eb => generated 706 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:51:54.179141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b43f324-9458-4a93-aef0-545733faf697 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f6474396f70>, body: {"security_group_rule": {"parent_group_id": "dcc26d45-dc4f-4516-b2cf-c476080034d0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:54.252710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61e1138d-6a20-4f2f-a212-24614ad18da1 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:54.262082 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-4b43f324-9458-4a93-aef0-545733faf697 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] HTTP exception thrown: This rule already exists in group dcc26d45-dc4f-4516-b2cf-c476080034d0 Feb 19 20:51:54.262676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b43f324-9458-4a93-aef0-545733faf697 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Returning 400 to user: This rule already exists in group dcc26d45-dc4f-4516-b2cf-c476080034d0 {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:54.263490 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b43f324-9458-4a93-aef0-545733faf697 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.089395 Feb 19 20:51:54.267512 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 257/496] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 20:51:54 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:51:54.268529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6526e0cd-568d-4615-8550-bececd18ac7b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:54.269176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6526e0cd-568d-4615-8550-bececd18ac7b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:54.275319 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-61e1138d-6a20-4f2f-a212-24614ad18da1 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] HTTP exception thrown: Flavor 1836753613 has no extra specs with key hw:cpu_thread_policy. Feb 19 20:51:54.276089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6526e0cd-568d-4615-8550-bececd18ac7b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:54.276666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6526e0cd-568d-4615-8550-bececd18ac7b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:54.277001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61e1138d-6a20-4f2f-a212-24614ad18da1 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Returning 404 to user: Flavor 1836753613 has no extra specs with key hw:cpu_thread_policy. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:54.277404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6526e0cd-568d-4615-8550-bececd18ac7b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:54.277839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6526e0cd-568d-4615-8550-bececd18ac7b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:54.279189 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-61e1138d-6a20-4f2f-a212-24614ad18da1 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] 10.222.0.30 "GET /compute/v2.1/flavors/1836753613/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.211752 Feb 19 20:51:54.279981 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 240/497] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 20:51:54 2022] GET /compute/v2.1/flavors/1836753613/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:54.285395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d5ee3c17-ffb2-41d0-9d41-bee9ccda8ca3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:54.286280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d5ee3c17-ffb2-41d0-9d41-bee9ccda8ca3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:54.366198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d5ee3c17-ffb2-41d0-9d41-bee9ccda8ca3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:54.384126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d5ee3c17-ffb2-41d0-9d41-bee9ccda8ca3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:54.386154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d5ee3c17-ffb2-41d0-9d41-bee9ccda8ca3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:54.388254 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d5ee3c17-ffb2-41d0-9d41-bee9ccda8ca3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1261 microversion: 2.25 time: 0.106368 Feb 19 20:51:54.389865 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 241/498] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:54 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1261 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:54.399652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-09ab268e-ad93-4a8e-a7f4-7664f16ed3df tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Action: 'create', calling method: .version_select at 0x7f6474232670>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-526501246", "type": "ssh"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:54.426179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-09ab268e-ad93-4a8e-a7f4-7664f16ed3df tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:54.434312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-09ab268e-ad93-4a8e-a7f4-7664f16ed3df tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for user 5608e63a5941422f8082a017b5b3998f and project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:54.529732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6526e0cd-568d-4615-8550-bececd18ac7b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:54.539590 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6526e0cd-568d-4615-8550-bececd18ac7b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1472 microversion: 2.1 time: 0.274519 Feb 19 20:51:54.541010 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 258/499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:54 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:54.545993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-473157692", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "18e81722-edd5-49d7-ab7d-41e73614b6aa"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:54.614988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:51:54.663330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-09ab268e-ad93-4a8e-a7f4-7664f16ed3df tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:54.667739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-09ab268e-ad93-4a8e-a7f4-7664f16ed3df tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Getting quotas for user 5608e63a5941422f8082a017b5b3998f and project 36233fa44d35474f80063230c496d496. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:54.688177 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-09ab268e-ad93-4a8e-a7f4-7664f16ed3df tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.10 time: 0.295427 Feb 19 20:51:54.706758 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 242/500] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Feb 19 20:51:54 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 299 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:51:54.706758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae068de5-fab4-4d7b-88cf-f2f5a6183793 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Calling method '.version_select at 0x7f647421d1f0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:55.167572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:51:55.168108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:51:55.168891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:51:55.169520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:51:55.170159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:51:55.179497 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae068de5-fab4-4d7b-88cf-f2f5a6183793 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/90cf6817-8732-4e58-a72f-ad7d524023bd" status: 202 len: 0 microversion: 2.1 time: 0.488570 Feb 19 20:51:55.186150 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 243/501] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Feb 19 20:51:54 2022] DELETE /compute/v2.1/os-security-group-rules/90cf6817-8732-4e58-a72f-ad7d524023bd => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:55.186456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:55.190596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-00ce32ee-ce4f-4e62-a319-f951bcc9c4e7 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:55.192067 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:55.192067 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:55.193106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-00ce32ee-ce4f-4e62-a319-f951bcc9c4e7 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'fe8fb48fff6c43558394e6c253e5a86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e42ff7200a14509af26780bb5d8e586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:55.193873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-00ce32ee-ce4f-4e62-a319-f951bcc9c4e7 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:55.195292 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-00ce32ee-ce4f-4e62-a319-f951bcc9c4e7 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] 10.222.0.30 "POST /compute/v2.1/flavors/1836753613/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.013432 Feb 19 20:51:55.195292 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 244/502] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Feb 19 20:51:55 2022] POST /compute/v2.1/flavors/1836753613/os-extra_specs => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:55.196205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:55.199872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:55.200417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:55.211913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-fc9e575b-8823-4301-ac53-7251983cd07e req-2923480e-cee6-4bd4-b0e2-b2749c792042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24d94c6-d921-42bf-affb-6f8556e5b76d", "tag": "99019bb9-0cfe-4900-a813-f2a3826c4aed"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:55.213348 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:55.213348 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:55.221501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fc9e575b-8823-4301-ac53-7251983cd07e req-2923480e-cee6-4bd4-b0e2-b2749c792042 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:55.222084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fc9e575b-8823-4301-ac53-7251983cd07e req-2923480e-cee6-4bd4-b0e2-b2749c792042 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:55.227764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Getting quotas for project 6d9ffdaf1d654c9bbbda43ed9214c964. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:51:55.231648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Getting quotas for user caca1da9a52c4a2080682b2458fa1e4f and project 6d9ffdaf1d654c9bbbda43ed9214c964. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:51:55.235079 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fc9e575b-8823-4301-ac53-7251983cd07e req-2923480e-cee6-4bd4-b0e2-b2749c792042 service nova] Creating event network-changed:99019bb9-0cfe-4900-a813-f2a3826c4aed for instance d24d94c6-d921-42bf-affb-6f8556e5b76d on nch2-master-1 Feb 19 20:51:55.241605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-fc9e575b-8823-4301-ac53-7251983cd07e req-2923480e-cee6-4bd4-b0e2-b2749c792042 service nova] Instance d24d94c6-d921-42bf-affb-6f8556e5b76d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:51:55.243113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:51:55.245416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:51:55.253132 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-fc9e575b-8823-4301-ac53-7251983cd07e req-2923480e-cee6-4bd4-b0e2-b2749c792042 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055807 Feb 19 20:51:55.254672 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 245/503] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:55.261520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a4284f03-cd7b-47b8-a042-b6bac759c055 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Calling method '.version_select at 0x7f647421d9d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:55.264404 ncdv-master-1 devstack@n-api.service[136095]: WARNING oslo_db.sqlalchemy.utils [None req-a4284f03-cd7b-47b8-a042-b6bac759c055 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Feb 19 20:51:55.292354 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a4284f03-cd7b-47b8-a042-b6bac759c055 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs?user_id=e3c6ec50f5ca4bbeac3f1204394291eb" status: 200 len: 1114 microversion: 2.10 time: 0.018890 Feb 19 20:51:55.292354 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 246/504] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Feb 19 20:51:55 2022] GET /compute/v2.1/os-keypairs?user_id=e3c6ec50f5ca4bbeac3f1204394291eb => generated 1114 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:55.305374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c3ffb53a-c565-42b5-965a-06a85339dc5b tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f6474347310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-515076817", "description": "tempest-description-1926561769"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:55.313778 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d090040-857f-4add-8ca7-0773f03bcd34 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771160 Feb 19 20:51:55.314838 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 259/505] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:51:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:51:55.323801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-40793a6a-957f-4e99-9e9b-85c3d058b0ea tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:55.325778 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:55.325778 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:55.358410 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-40793a6a-957f-4e99-9e9b-85c3d058b0ea tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1836753613/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041904 Feb 19 20:51:55.359925 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 260/506] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Feb 19 20:51:55 2022] POST /compute/v2.1/flavors/1836753613/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:55.365706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d6bfe08-e703-4746-87a6-eeb6b62ebc06 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Calling method '.version_select at 0x7f6474902280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:55.389723 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d6bfe08-e703-4746-87a6-eeb6b62ebc06 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-526501246" status: 204 len: 0 microversion: 2.10 time: 0.028232 Feb 19 20:51:55.394446 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 261/507] 10.222.0.30 () {60 vars in 1321 bytes} [Sat Feb 19 20:51:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-526501246 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:51:55.401309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe8cc0fa-00a9-43b2-87c8-9aab88b4a78b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:55.402309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fe8cc0fa-00a9-43b2-87c8-9aab88b4a78b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:55.509374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe8cc0fa-00a9-43b2-87c8-9aab88b4a78b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:55.520736 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fe8cc0fa-00a9-43b2-87c8-9aab88b4a78b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1213 microversion: 2.1 time: 0.124672 Feb 19 20:51:55.524321 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 262/508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:55 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:55.536307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4e5a408c-43c1-4c1f-b4d5-deac43863afc tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:55.537985 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:55.537985 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:55.539119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4e5a408c-43c1-4c1f-b4d5-deac43863afc tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'fe8fb48fff6c43558394e6c253e5a86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e42ff7200a14509af26780bb5d8e586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:55.539661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4e5a408c-43c1-4c1f-b4d5-deac43863afc tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:55.542687 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4e5a408c-43c1-4c1f-b4d5-deac43863afc tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] 10.222.0.30 "DELETE /compute/v2.1/flavors/1836753613/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017208 Feb 19 20:51:55.543233 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 263/509] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 20:51:55 2022] DELETE /compute/v2.1/flavors/1836753613/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:55.579799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b158eecf-da10-4386-ab0d-48d7f47bca11 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Calling method '.version_select at 0x7f647435fd30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:55.653509 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b158eecf-da10-4386-ab0d-48d7f47bca11 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478387977?user_id=e3c6ec50f5ca4bbeac3f1204394291eb" status: 204 len: 0 microversion: 2.10 time: 0.107145 Feb 19 20:51:55.654872 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 264/510] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Feb 19 20:51:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478387977?user_id=e3c6ec50f5ca4bbeac3f1204394291eb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:51:55.666242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:55.669201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:55.690493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:55.694827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:55.698425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:55.701063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:55.898125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:55.928834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:55.930905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:55.932928 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8dec3e67-6359-4539-a50d-7b8055f9b124 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1331 microversion: 2.25 time: 0.274683 Feb 19 20:51:55.933731 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 265/511] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:55 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1331 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:55.948438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83d7db0e-6ab2-4ed6-9101-c07ec35bcb25 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:55.949794 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:55.949794 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:55.984131 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83d7db0e-6ab2-4ed6-9101-c07ec35bcb25 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1836753613/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040772 Feb 19 20:51:56.001264 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 266/512] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Feb 19 20:51:55 2022] POST /compute/v2.1/flavors/1836753613/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:51:56.005625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-084eda04-0082-4074-98e4-aaabcd18070f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:56.006791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-084eda04-0082-4074-98e4-aaabcd18070f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:56.019908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-084eda04-0082-4074-98e4-aaabcd18070f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:56.021001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-084eda04-0082-4074-98e4-aaabcd18070f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:56.022234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-084eda04-0082-4074-98e4-aaabcd18070f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:56.023767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-084eda04-0082-4074-98e4-aaabcd18070f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:56.159604 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c3ffb53a-c565-42b5-965a-06a85339dc5b tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.881870 Feb 19 20:51:56.160783 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 247/513] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 20:51:55 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:56.171982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ebb2415-2b6c-4977-9ef2-773979a52063 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] Calling method '.version_select at 0x7f6474347af0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:56.202428 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ebb2415-2b6c-4977-9ef2-773979a52063 tempest-KeyPairsV210TestJSON-405280913 tempest-KeyPairsV210TestJSON-405280913-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841182230?user_id=e3c6ec50f5ca4bbeac3f1204394291eb" status: 204 len: 0 microversion: 2.10 time: 0.036211 Feb 19 20:51:56.203714 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 248/514] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Feb 19 20:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841182230?user_id=e3c6ec50f5ca4bbeac3f1204394291eb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:51:56.247465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dc71c6c0-95e8-4b03-8fb4-c24be6d9f1b9 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:56.258100 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:56.258100 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:56.261196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dc71c6c0-95e8-4b03-8fb4-c24be6d9f1b9 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'fe8fb48fff6c43558394e6c253e5a86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e42ff7200a14509af26780bb5d8e586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:56.262965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dc71c6c0-95e8-4b03-8fb4-c24be6d9f1b9 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:56.266234 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dc71c6c0-95e8-4b03-8fb4-c24be6d9f1b9 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013 tempest-FlavorsExtraSpecsNegativeTestJSON-928139013-project] 10.222.0.30 "PUT /compute/v2.1/flavors/1836753613/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.060615 Feb 19 20:51:56.295654 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 249/515] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Feb 19 20:51:56 2022] PUT /compute/v2.1/flavors/1836753613/os-extra_specs/hw:numa_nodes => generated 124 bytes in 91 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:56.318406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-44c333ff-26ca-4b38-81c5-4958c063caf4 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f6474595b80>, body: {"security_group_rule": {"parent_group_id": "3fb5744a-a17b-416d-9c5f-dc2e2caf4503", "ip_protocol": "tcp", "from_port": 1945001934, "to_port": 22}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:56.564924 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-44c333ff-26ca-4b38-81c5-4958c063caf4 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] HTTP exception thrown: Invalid port range 1945001934:22. Former value cannot be greater than the later Feb 19 20:51:56.565676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-44c333ff-26ca-4b38-81c5-4958c063caf4 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Returning 400 to user: Invalid port range 1945001934:22. Former value cannot be greater than the later {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:56.566817 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-44c333ff-26ca-4b38-81c5-4958c063caf4 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.269634 Feb 19 20:51:56.600622 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 250/516] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 20:51:56 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 304 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:51:56.611989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-884fd39f-fe7c-42d9-af9f-ad6ceca02732 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:56.613833 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:56.613833 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:56.638391 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-884fd39f-fe7c-42d9-af9f-ad6ceca02732 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] HTTP exception thrown: Flavor 1836753613 has no extra specs with key hw:cpu_thread_policy. Feb 19 20:51:56.639210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-884fd39f-fe7c-42d9-af9f-ad6ceca02732 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Returning 404 to user: Flavor 1836753613 has no extra specs with key hw:cpu_thread_policy. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:56.640286 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-884fd39f-fe7c-42d9-af9f-ad6ceca02732 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1836753613/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.038251 Feb 19 20:51:56.641039 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 251/517] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 20:51:56 2022] DELETE /compute/v2.1/flavors/1836753613/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:51:56.647145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-78aa9266-51bf-4346-a77d-d41d7701d315 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:56.648170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-78aa9266-51bf-4346-a77d-d41d7701d315 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:56.667093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78aa9266-51bf-4346-a77d-d41d7701d315 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:56.667955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78aa9266-51bf-4346-a77d-d41d7701d315 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:56.669140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78aa9266-51bf-4346-a77d-d41d7701d315 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:56.669731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78aa9266-51bf-4346-a77d-d41d7701d315 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:56.726824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-084eda04-0082-4074-98e4-aaabcd18070f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:56.757531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-084eda04-0082-4074-98e4-aaabcd18070f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1472 microversion: 2.1 time: 0.754078 Feb 19 20:51:56.763362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 267/518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:56 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1472 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:56.774386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d44964ab-b775-4d73-9a80-fa737f57b11a tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f6474396940>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-567984039", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:56.779534 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-d44964ab-b775-4d73-9a80-fa737f57b11a tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] HTTP exception thrown: Security group id should be uuid Feb 19 20:51:56.792991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d44964ab-b775-4d73-9a80-fa737f57b11a tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Returning 400 to user: Security group id should be uuid {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:56.794000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d44964ab-b775-4d73-9a80-fa737f57b11a tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.023794 Feb 19 20:51:56.803602 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 268/519] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 20:51:56 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:56.822322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aba6aedb-c7dd-4280-899b-11d306b0bb27 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:56.826595 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:56.826595 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:51:56.828549 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-aba6aedb-c7dd-4280-899b-11d306b0bb27 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] HTTP exception thrown: Request body and URI mismatch Feb 19 20:51:56.829462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aba6aedb-c7dd-4280-899b-11d306b0bb27 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:56.830431 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aba6aedb-c7dd-4280-899b-11d306b0bb27 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1836753613/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.025847 Feb 19 20:51:56.837567 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 269/520] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Feb 19 20:51:56 2022] PUT /compute/v2.1/flavors/1836753613/os-extra_specs/hw:numa_nodes => generated 73 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:51:56.845437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bec90de7-d716-4b25-a8f1-0d1d22587d5e tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f64743f2790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1634860201", "description": "tempest-description-49712631"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:57.066296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-78aa9266-51bf-4346-a77d-d41d7701d315 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:57.078115 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-78aa9266-51bf-4346-a77d-d41d7701d315 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1265 microversion: 2.1 time: 0.435837 Feb 19 20:51:57.079320 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 252/521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:56 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1265 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:57.096662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f495457d-b83d-4949-b76e-93bf06737424 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:57.099398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f495457d-b83d-4949-b76e-93bf06737424 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:57.101308 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f495457d-b83d-4949-b76e-93bf06737424 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1836753613/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.020535 Feb 19 20:51:57.102292 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 253/522] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Feb 19 20:51:57 2022] PUT /compute/v2.1/flavors/1836753613/os-extra_specs/hw:numa_nodes => generated 117 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:51:57.111241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:57.112146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:57.124137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:57.124765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:57.125651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:57.126691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:57.391050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:57.404251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:57.406067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:57.407416 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-19e0b0ce-9dc0-4f8d-ab54-9fb104c779b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1319 microversion: 2.25 time: 0.304506 Feb 19 20:51:57.419428 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 254/523] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:57 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:57.423497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4830c04b-e21b-46c3-9f76-8113d75b305d tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:57.424849 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:51:57.424849 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:51:57.470651 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4830c04b-e21b-46c3-9f76-8113d75b305d tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1836753613" status: 202 len: 0 microversion: 2.1 time: 0.055278 Feb 19 20:51:57.471220 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 255/524] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:51:57 2022] DELETE /compute/v2.1/flavors/1836753613 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:51:57.484370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2f707d1a-3b44-405e-8302-a8215a7509f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:57.524590 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2f707d1a-3b44-405e-8302-a8215a7509f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512 tempest-FlavorsExtraSpecsNegativeTestJSON-1593256512-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.047817 Feb 19 20:51:57.525809 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 256/525] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:51:57 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:57.777841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6624df64-e0a8-4682-9be0-ce0eaaf03c16 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:57.779210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6624df64-e0a8-4682-9be0-ce0eaaf03c16 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:57.788108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6624df64-e0a8-4682-9be0-ce0eaaf03c16 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:57.788907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6624df64-e0a8-4682-9be0-ce0eaaf03c16 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:57.790269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6624df64-e0a8-4682-9be0-ce0eaaf03c16 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:57.791007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6624df64-e0a8-4682-9be0-ce0eaaf03c16 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:58.033421 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bec90de7-d716-4b25-a8f1-0d1d22587d5e tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.194190 Feb 19 20:51:58.034639 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 270/526] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 20:51:56 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:51:58.045564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cccb26fa-c355-412f-b370-8b2c287b6feb tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f64743f81f0>, body: {"security_group_rule": {"parent_group_id": "98d93fdf-59f2-43e6-bd36-c7e012c68742", "ip_protocol": "tempest-999-1985869028", "from_port": 22, "to_port": 22}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:58.580798 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-cccb26fa-c355-412f-b370-8b2c287b6feb tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] HTTP exception thrown: Invalid IP protocol tempest-999-1985869028. Feb 19 20:51:58.581388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cccb26fa-c355-412f-b370-8b2c287b6feb tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Returning 400 to user: Invalid IP protocol tempest-999-1985869028. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:51:58.582224 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cccb26fa-c355-412f-b370-8b2c287b6feb tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.540684 Feb 19 20:51:58.582786 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 271/527] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 20:51:58 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 542 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Feb 19 20:51:58.588835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fa228fec-14a8-462c-bc52-c56c0f3d19fe tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:58.589637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa228fec-14a8-462c-bc52-c56c0f3d19fe tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:58.597822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa228fec-14a8-462c-bc52-c56c0f3d19fe tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:58.598450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa228fec-14a8-462c-bc52-c56c0f3d19fe tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:58.599596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa228fec-14a8-462c-bc52-c56c0f3d19fe tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:58.600258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa228fec-14a8-462c-bc52-c56c0f3d19fe tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:59.083633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fa228fec-14a8-462c-bc52-c56c0f3d19fe tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:59.097844 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fa228fec-14a8-462c-bc52-c56c0f3d19fe tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1271 microversion: 2.1 time: 0.510537 Feb 19 20:51:59.101857 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 272/528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:58 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1271 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:59.122350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:59.124980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:59.142207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:59.143325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:59.144658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:59.144953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:59.187452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6624df64-e0a8-4682-9be0-ce0eaaf03c16 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:59.199273 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6624df64-e0a8-4682-9be0-ce0eaaf03c16 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1469 microversion: 2.1 time: 1.425740 Feb 19 20:51:59.200263 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 257/529] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:57 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1469 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:51:59.223461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e41cc5a-3899-425a-81d3-409d243ecdc4 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f647428d670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-731517357", "description": "tempest-description-1696064110"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:59.317292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:59.330577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:59.340726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:51:59.343028 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d971bba4-f295-4ca7-b551-e2a345b7944e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1319 microversion: 2.25 time: 0.239803 Feb 19 20:51:59.345288 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 273/530] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:51:59 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:51:59.351840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-701a1133-2951-42a4-ba71-9931d3bf5689 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:51:59.352661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-701a1133-2951-42a4-ba71-9931d3bf5689 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:59.367659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-701a1133-2951-42a4-ba71-9931d3bf5689 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:59.368611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-701a1133-2951-42a4-ba71-9931d3bf5689 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:59.369790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-701a1133-2951-42a4-ba71-9931d3bf5689 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:59.370680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-701a1133-2951-42a4-ba71-9931d3bf5689 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:59.494456 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-701a1133-2951-42a4-ba71-9931d3bf5689 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d/action" status: 204 len: 0 microversion: 2.1 time: 0.147097 Feb 19 20:51:59.495993 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 274/531] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:51:59 2022] POST /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d/action => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:51:59.529649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-734fbd4a-c6d2-4968-8fd3-c2adc6d59eda tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:51:59.530824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-734fbd4a-c6d2-4968-8fd3-c2adc6d59eda tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:51:59.572765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-734fbd4a-c6d2-4968-8fd3-c2adc6d59eda tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:59.573526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-734fbd4a-c6d2-4968-8fd3-c2adc6d59eda tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:51:59.574564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-734fbd4a-c6d2-4968-8fd3-c2adc6d59eda tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:51:59.575676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-734fbd4a-c6d2-4968-8fd3-c2adc6d59eda tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:00.253366 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8e41cc5a-3899-425a-81d3-409d243ecdc4 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.051770 Feb 19 20:52:00.254789 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 258/532] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 20:51:59 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:00.264536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-598f5667-cfd5-48f7-a3da-18c8a118c737 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:00.265410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-598f5667-cfd5-48f7-a3da-18c8a118c737 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:00.276114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-598f5667-cfd5-48f7-a3da-18c8a118c737 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:00.276774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-598f5667-cfd5-48f7-a3da-18c8a118c737 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:00.277729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-598f5667-cfd5-48f7-a3da-18c8a118c737 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:00.278334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-598f5667-cfd5-48f7-a3da-18c8a118c737 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:00.508111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-734fbd4a-c6d2-4968-8fd3-c2adc6d59eda tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:00.530756 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-734fbd4a-c6d2-4968-8fd3-c2adc6d59eda tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1469 microversion: 2.1 time: 1.028582 Feb 19 20:52:00.536245 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 275/533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:51:59 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1469 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:00.547117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-18f98c59-f61e-4f01-977e-260daa068c27 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f64743f8430>, body: {"security_group_rule": {"parent_group_id": "156705b3-61f8-449a-9855-721b01b6eef8", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:00.872640 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-18f98c59-f61e-4f01-977e-260daa068c27 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Feb 19 20:52:00.879126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-18f98c59-f61e-4f01-977e-260daa068c27 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:00.880836 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-18f98c59-f61e-4f01-977e-260daa068c27 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.343260 Feb 19 20:52:00.888249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 276/534] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 20:52:00 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:52:00.904115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:00.910431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:00.943233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:00.944645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:00.947521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:00.964445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:01.271032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-598f5667-cfd5-48f7-a3da-18c8a118c737 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:01.289613 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-598f5667-cfd5-48f7-a3da-18c8a118c737 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1313 microversion: 2.1 time: 1.030865 Feb 19 20:52:01.296667 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 259/535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:00 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1313 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:01.301360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-411a14a2-5194-4547-80d5-e5fb9481e8f9 req-9b251b3c-f7be-4eb8-991b-2b3ed7395fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24d94c6-d921-42bf-affb-6f8556e5b76d", "name": "network-vif-plugged", "status": "completed", "tag": "99019bb9-0cfe-4900-a813-f2a3826c4aed"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:01.303675 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:01.303675 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:01.317824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-411a14a2-5194-4547-80d5-e5fb9481e8f9 req-9b251b3c-f7be-4eb8-991b-2b3ed7395fbf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:01.320092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-411a14a2-5194-4547-80d5-e5fb9481e8f9 req-9b251b3c-f7be-4eb8-991b-2b3ed7395fbf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:01.347636 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-411a14a2-5194-4547-80d5-e5fb9481e8f9 req-9b251b3c-f7be-4eb8-991b-2b3ed7395fbf service nova] Creating event network-vif-plugged:99019bb9-0cfe-4900-a813-f2a3826c4aed for instance d24d94c6-d921-42bf-affb-6f8556e5b76d on nch2-master-1 Feb 19 20:52:01.364656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-411a14a2-5194-4547-80d5-e5fb9481e8f9 req-9b251b3c-f7be-4eb8-991b-2b3ed7395fbf service nova] Instance d24d94c6-d921-42bf-affb-6f8556e5b76d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:52:01.390277 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-411a14a2-5194-4547-80d5-e5fb9481e8f9 req-9b251b3c-f7be-4eb8-991b-2b3ed7395fbf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092297 Feb 19 20:52:01.391214 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 260/536] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:01.396174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-357c499f-5beb-4d53-9114-052c6fe9397f tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f64741fd1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1201513501", "description": "tempest-description-1037515055"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:01.888264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:01.901007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:01.909314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:01.911836 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fd3257a0-2b27-4fec-a860-232dece15cd4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1361 microversion: 2.25 time: 1.021056 Feb 19 20:52:01.923013 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 277/537] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:00 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1361 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:01.934087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2c0b90ad-ce49-44d5-8adc-b3d7ce3572fb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:01.936050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2c0b90ad-ce49-44d5-8adc-b3d7ce3572fb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:01.946632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c0b90ad-ce49-44d5-8adc-b3d7ce3572fb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:01.954921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c0b90ad-ce49-44d5-8adc-b3d7ce3572fb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:01.955888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c0b90ad-ce49-44d5-8adc-b3d7ce3572fb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:01.956536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c0b90ad-ce49-44d5-8adc-b3d7ce3572fb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:02.290951 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-357c499f-5beb-4d53-9114-052c6fe9397f tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.898083 Feb 19 20:52:02.293715 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 261/538] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 20:52:01 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:02.613329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2c0b90ad-ce49-44d5-8adc-b3d7ce3572fb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:02.621994 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2c0b90ad-ce49-44d5-8adc-b3d7ce3572fb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1469 microversion: 2.1 time: 0.706448 Feb 19 20:52:02.625014 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 278/539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:01 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1469 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:02.658168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1beca3b4-0bc8-4c9b-a3ba-8814f709c7ae tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:02.659113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1beca3b4-0bc8-4c9b-a3ba-8814f709c7ae tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:02.668101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1beca3b4-0bc8-4c9b-a3ba-8814f709c7ae tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:02.668814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1beca3b4-0bc8-4c9b-a3ba-8814f709c7ae tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:02.669293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b757cd7-ccc0-4593-9cf3-148048cbc572 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Action: 'update', calling method: .version_select at 0x7f647421da60>, body: {"quota_set": {"ram": "5120"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:02.670100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1beca3b4-0bc8-4c9b-a3ba-8814f709c7ae tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:02.670695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1beca3b4-0bc8-4c9b-a3ba-8814f709c7ae tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:02.671831 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:02.671831 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:03.086688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b757cd7-ccc0-4593-9cf3-148048cbc572 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.087602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b757cd7-ccc0-4593-9cf3-148048cbc572 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.088618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b757cd7-ccc0-4593-9cf3-148048cbc572 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.089354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b757cd7-ccc0-4593-9cf3-148048cbc572 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.153550 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b757cd7-ccc0-4593-9cf3-148048cbc572 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/0b59a556e35f4fb392ef697be3410bb6" status: 200 len: 148 microversion: 2.57 time: 0.858319 Feb 19 20:52:03.154599 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 262/540] 10.222.0.30 () {62 vars in 1302 bytes} [Sat Feb 19 20:52:02 2022] PUT /compute/v2.1/os-quota-sets/0b59a556e35f4fb392ef697be3410bb6 => generated 148 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:52:03.163428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-84802387-cdb6-4b61-9bd6-e9e403f2e28e tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f647428d820>, body: {"security_group_rule": {"parent_group_id": "4b6050e5-8774-4a16-a5ac-2091189e90e2", "ip_protocol": "tcp", "from_port": 22, "to_port": 2038755258}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:03.166489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1beca3b4-0bc8-4c9b-a3ba-8814f709c7ae tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:03.182107 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1beca3b4-0bc8-4c9b-a3ba-8814f709c7ae tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1313 microversion: 2.1 time: 0.544629 Feb 19 20:52:03.196559 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 279/541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:02 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:03.202393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:03.203011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:03.210750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.211869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.212963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.213628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.279564 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-84802387-cdb6-4b61-9bd6-e9e403f2e28e tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] HTTP exception thrown: Invalid port range 22:2038755258. Valid TCP ports should be between 1-65535 Feb 19 20:52:03.280173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-84802387-cdb6-4b61-9bd6-e9e403f2e28e tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Returning 400 to user: Invalid port range 22:2038755258. Valid TCP ports should be between 1-65535 {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:03.282609 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-84802387-cdb6-4b61-9bd6-e9e403f2e28e tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.125521 Feb 19 20:52:03.283223 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 263/542] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 20:52:03 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:52:03.486291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3571610a-0f57-4455-a167-f9a12f1cbd1f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Calling method '.version_select at 0x7f64741fd4c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:03.487501 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:03.487501 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:03.491127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3571610a-0f57-4455-a167-f9a12f1cbd1f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.491581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3571610a-0f57-4455-a167-f9a12f1cbd1f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.492831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3571610a-0f57-4455-a167-f9a12f1cbd1f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.502387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3571610a-0f57-4455-a167-f9a12f1cbd1f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.548561 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3571610a-0f57-4455-a167-f9a12f1cbd1f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.252316 Feb 19 20:52:03.549483 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 264/543] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 20:52:03 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:03.566694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4d7ff137-38ad-42b3-b0bc-966f35502fa9 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Calling method '.version_select at 0x7f647428d550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:03.655077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d7ff137-38ad-42b3-b0bc-966f35502fa9 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.656442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d7ff137-38ad-42b3-b0bc-966f35502fa9 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.657589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d7ff137-38ad-42b3-b0bc-966f35502fa9 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.658216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d7ff137-38ad-42b3-b0bc-966f35502fa9 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.716369 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4d7ff137-38ad-42b3-b0bc-966f35502fa9 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/0b59a556e35f4fb392ef697be3410bb6/detail" status: 200 len: 463 microversion: 2.57 time: 0.147815 Feb 19 20:52:03.716675 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 265/544] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Feb 19 20:52:03 2022] GET /compute/v2.1/os-quota-sets/0b59a556e35f4fb392ef697be3410bb6/detail => generated 463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:52:03.735938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-751648b1-09a0-48bb-9e16-43dde4933f3a req-b18a6911-29c3-4e9e-a14b-9d65a3b47579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "470c141a-60d6-46e9-bd5f-08ce9c6a7f99", "tag": "8fa16ec0-665d-486a-8609-c23482d79a71"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:03.744918 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:03.744918 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:03.763178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-751648b1-09a0-48bb-9e16-43dde4933f3a req-b18a6911-29c3-4e9e-a14b-9d65a3b47579 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.764750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-751648b1-09a0-48bb-9e16-43dde4933f3a req-b18a6911-29c3-4e9e-a14b-9d65a3b47579 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.779545 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-751648b1-09a0-48bb-9e16-43dde4933f3a req-b18a6911-29c3-4e9e-a14b-9d65a3b47579 service nova] Creating event network-changed:8fa16ec0-665d-486a-8609-c23482d79a71 for instance 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 on nch2-master-1 Feb 19 20:52:03.788966 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-751648b1-09a0-48bb-9e16-43dde4933f3a req-b18a6911-29c3-4e9e-a14b-9d65a3b47579 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070060 Feb 19 20:52:03.789866 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 266/545] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:03.795082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5bd964b-07ac-4f60-824d-b691f05ff31f tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Action: 'create', calling method: .version_select at 0x7f6474551f70>, body: {"security_group_rule": {"parent_group_id": "8d04d4d7-2879-4592-ba16-7ab458099330", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:03.873188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-b5bd964b-07ac-4f60-824d-b691f05ff31f tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8d04d4d7-2879-4592-ba16-7ab458099330 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:52:03.874046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-b5bd964b-07ac-4f60-824d-b691f05ff31f tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Neutron security group 8d04d4d7-2879-4592-ba16-7ab458099330 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 20:52:03.874768 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-b5bd964b-07ac-4f60-824d-b691f05ff31f tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] HTTP exception thrown: Security group 8d04d4d7-2879-4592-ba16-7ab458099330 does not exist Feb 19 20:52:03.874768 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-c9e980a5-5b7c-4aa7-ab88-5a5cdfaadee9'] Feb 19 20:52:03.875628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5bd964b-07ac-4f60-824d-b691f05ff31f tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Returning 404 to user: Security group 8d04d4d7-2879-4592-ba16-7ab458099330 does not exist Feb 19 20:52:03.875628 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-c9e980a5-5b7c-4aa7-ab88-5a5cdfaadee9'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:03.877233 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b5bd964b-07ac-4f60-824d-b691f05ff31f tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.086239 Feb 19 20:52:03.878031 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 267/546] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 20:52:03 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:03.885495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d8c873bc-2fdf-44f3-8b3b-9333a9f94fbf tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Calling method '.version_select at 0x7f647421d040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:03.892251 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:03.892251 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:03.895033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c873bc-2fdf-44f3-8b3b-9333a9f94fbf tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.895746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c873bc-2fdf-44f3-8b3b-9333a9f94fbf tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.897147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c873bc-2fdf-44f3-8b3b-9333a9f94fbf tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.897908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c873bc-2fdf-44f3-8b3b-9333a9f94fbf tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.957677 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d8c873bc-2fdf-44f3-8b3b-9333a9f94fbf tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.078240 Feb 19 20:52:03.963985 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 268/547] 10.222.0.30 () {58 vars in 1138 bytes} [Sat Feb 19 20:52:03 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:03.969979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a3260d1-41a3-42a9-8d11-1cf3147e8790 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:03.971034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1a3260d1-41a3-42a9-8d11-1cf3147e8790 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:03.985499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a3260d1-41a3-42a9-8d11-1cf3147e8790 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.985979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a3260d1-41a3-42a9-8d11-1cf3147e8790 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:03.989044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a3260d1-41a3-42a9-8d11-1cf3147e8790 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:03.989501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a3260d1-41a3-42a9-8d11-1cf3147e8790 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:04.194414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:04.202893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:04.204481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:04.205580 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-93d56be0-4468-44e8-bb68-4f64d09d70b6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1361 microversion: 2.25 time: 1.007650 Feb 19 20:52:04.214425 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 280/548] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:03 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1361 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:04.219357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74b3d422-5587-452b-9488-3d8a05bc2805 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Calling method '.version_select at 0x7f64744f5b80>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:04.338362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG neutronclient.v2_0.client [None req-74b3d422-5587-452b-9488-3d8a05bc2805 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7315547c-23f1-4209-8d24-fea8af096c18 does not exist", "detail": ""}} {{(pid=136094) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:52:04.340517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.security_group_api [None req-74b3d422-5587-452b-9488-3d8a05bc2805 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Neutron security group rule 7315547c-23f1-4209-8d24-fea8af096c18 not found {{(pid=136094) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Feb 19 20:52:04.345172 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-74b3d422-5587-452b-9488-3d8a05bc2805 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] HTTP exception thrown: Security group rule 7315547c-23f1-4209-8d24-fea8af096c18 does not exist Feb 19 20:52:04.345172 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-2d54110e-bbad-42df-8343-41f0221f8692'] Feb 19 20:52:04.347823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74b3d422-5587-452b-9488-3d8a05bc2805 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Returning 404 to user: Security group rule 7315547c-23f1-4209-8d24-fea8af096c18 does not exist Feb 19 20:52:04.347823 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-2d54110e-bbad-42df-8343-41f0221f8692'] {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:04.352512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-74b3d422-5587-452b-9488-3d8a05bc2805 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/7315547c-23f1-4209-8d24-fea8af096c18" status: 404 len: 199 microversion: 2.1 time: 0.133249 Feb 19 20:52:04.354414 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 281/549] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Feb 19 20:52:04 2022] DELETE /compute/v2.1/os-security-group-rules/7315547c-23f1-4209-8d24-fea8af096c18 => generated 199 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:04.364822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a0c938e0-2e29-4cea-85fc-42469c873376 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Calling method '.version_select at 0x7f6474307430>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:04.368922 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:04.368922 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:04.371059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0c938e0-2e29-4cea-85fc-42469c873376 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:04.371838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0c938e0-2e29-4cea-85fc-42469c873376 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:04.372893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0c938e0-2e29-4cea-85fc-42469c873376 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:04.373514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0c938e0-2e29-4cea-85fc-42469c873376 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:04.408474 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a0c938e0-2e29-4cea-85fc-42469c873376 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.051888 Feb 19 20:52:04.409081 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 282/550] 10.222.0.30 () {58 vars in 1144 bytes} [Sat Feb 19 20:52:04 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:52:04.415973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Action: 'update', calling method: .version_select at 0x7f647435faf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:04.415973 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:04.415973 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:04.512012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:04.512513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:04.513608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:04.514266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:04.557920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:04.558602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:04.561200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:04.561881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:04.636871 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a722f789-626f-4b3c-b323-31e5a6cedef8 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/0b59a556e35f4fb392ef697be3410bb6?user_id=0e2c1e7e33854ec9abd0dc2bc8afb26c" status: 200 len: 148 microversion: 2.57 time: 0.226632 Feb 19 20:52:04.638178 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 283/551] 10.222.0.30 () {62 vars in 1383 bytes} [Sat Feb 19 20:52:04 2022] PUT /compute/v2.1/os-quota-sets/0b59a556e35f4fb392ef697be3410bb6?user_id=0e2c1e7e33854ec9abd0dc2bc8afb26c => generated 148 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:52:04.643152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d8293540-f544-4a0a-a717-15d2eb70598c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:04.644057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8293540-f544-4a0a-a717-15d2eb70598c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:04.652545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8293540-f544-4a0a-a717-15d2eb70598c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:04.653120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8293540-f544-4a0a-a717-15d2eb70598c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:04.653992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8293540-f544-4a0a-a717-15d2eb70598c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:04.654508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8293540-f544-4a0a-a717-15d2eb70598c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:04.666768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1a3260d1-41a3-42a9-8d11-1cf3147e8790 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:04.675374 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1a3260d1-41a3-42a9-8d11-1cf3147e8790 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1461 microversion: 2.1 time: 0.715761 Feb 19 20:52:04.679806 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 269/552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:03 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1461 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:04.684513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-59286cce-8f00-4e67-80f0-4f101be2ab35 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Calling method '.version_select at 0x7f64743ea9d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:05.216956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8293540-f544-4a0a-a717-15d2eb70598c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:05.224208 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d8293540-f544-4a0a-a717-15d2eb70598c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1313 microversion: 2.1 time: 0.584800 Feb 19 20:52:05.235494 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 284/553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:04 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:05.242618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3fb12eb9-f8f4-4e45-9553-f6d958a03a13 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Calling method '.version_select at 0x7f64743075e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:05.243912 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:05.243912 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:05.245550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fb12eb9-f8f4-4e45-9553-f6d958a03a13 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:05.246073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fb12eb9-f8f4-4e45-9553-f6d958a03a13 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:05.246963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fb12eb9-f8f4-4e45-9553-f6d958a03a13 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:05.247468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fb12eb9-f8f4-4e45-9553-f6d958a03a13 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:05.275322 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3fb12eb9-f8f4-4e45-9553-f6d958a03a13 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.047369 Feb 19 20:52:05.278746 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 285/554] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 20:52:05 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:05.286080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-867b6f4b-f7db-4247-8fd4-86b34b1dc403 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] Calling method '.version_select at 0x7f647429c4c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:05.373077 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-867b6f4b-f7db-4247-8fd4-86b34b1dc403 tempest-QuotasAdminTestV257-1978723376 tempest-QuotasAdminTestV257-1978723376-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/0b59a556e35f4fb392ef697be3410bb6?user_id=0e2c1e7e33854ec9abd0dc2bc8afb26c" status: 200 len: 190 microversion: 2.57 time: 0.093568 Feb 19 20:52:05.374062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 286/555] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Feb 19 20:52:05 2022] GET /compute/v2.1/os-quota-sets/0b59a556e35f4fb392ef697be3410bb6?user_id=0e2c1e7e33854ec9abd0dc2bc8afb26c => generated 190 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:52:05.394493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-25649f0f-132f-4e89-b1f6-1d18b44f4253 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:05.395964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-25649f0f-132f-4e89-b1f6-1d18b44f4253 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:05.411937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25649f0f-132f-4e89-b1f6-1d18b44f4253 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:05.412468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25649f0f-132f-4e89-b1f6-1d18b44f4253 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:05.415297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25649f0f-132f-4e89-b1f6-1d18b44f4253 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:05.415769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25649f0f-132f-4e89-b1f6-1d18b44f4253 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:05.561421 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-59286cce-8f00-4e67-80f0-4f101be2ab35 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4b6050e5-8774-4a16-a5ac-2091189e90e2" status: 202 len: 0 microversion: 2.1 time: 0.880313 Feb 19 20:52:05.562397 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 270/556] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:52:04 2022] DELETE /compute/v2.1/os-security-groups/4b6050e5-8774-4a16-a5ac-2091189e90e2 => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:52:05.570536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:05.571113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:05.586621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:05.587313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:05.589119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:05.589761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:05.921114 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-25649f0f-132f-4e89-b1f6-1d18b44f4253 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1612 microversion: 2.1 time: 0.545779 Feb 19 20:52:05.922032 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 287/557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:05 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1612 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:05.927461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e968dda3-8285-4544-ba46-57eb1b90a47f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Calling method '.version_select at 0x7f647429c8b0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:05.929784 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:05.929784 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:05.937731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e968dda3-8285-4544-ba46-57eb1b90a47f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:05.938745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e968dda3-8285-4544-ba46-57eb1b90a47f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:05.940152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e968dda3-8285-4544-ba46-57eb1b90a47f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:05.941019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e968dda3-8285-4544-ba46-57eb1b90a47f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:05.982587 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e968dda3-8285-4544-ba46-57eb1b90a47f tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.059061 Feb 19 20:52:05.990471 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 288/558] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:52:05 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:05.997345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-38bc0ff0-efb5-484c-8404-af3b31d356c6 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Calling method '.version_select at 0x7f647429ca60>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:06.383155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:06.391860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:06.395889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:06.400222 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b7539db-56d5-43d7-a06f-092a92d75f55 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1361 microversion: 2.25 time: 0.834142 Feb 19 20:52:06.401376 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 271/559] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:05 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1361 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:06.422016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d2749a81-c9ac-4b5e-b40a-172a9578a45a req-acaad0cd-9353-4e09-a97f-2a4783b3f534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b664ff-b2ee-4815-9cc7-5a1895e092a2", "tag": "a7ef59b7-3a86-414d-98e0-dccf483c634e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:06.423883 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:06.423883 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:06.444909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d2749a81-c9ac-4b5e-b40a-172a9578a45a req-acaad0cd-9353-4e09-a97f-2a4783b3f534 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:06.447715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d2749a81-c9ac-4b5e-b40a-172a9578a45a req-acaad0cd-9353-4e09-a97f-2a4783b3f534 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:06.460847 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d2749a81-c9ac-4b5e-b40a-172a9578a45a req-acaad0cd-9353-4e09-a97f-2a4783b3f534 service nova] Creating event network-changed:a7ef59b7-3a86-414d-98e0-dccf483c634e for instance 77b664ff-b2ee-4815-9cc7-5a1895e092a2 on nch1-master-1 Feb 19 20:52:06.479064 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d2749a81-c9ac-4b5e-b40a-172a9578a45a req-acaad0cd-9353-4e09-a97f-2a4783b3f534 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076000 Feb 19 20:52:06.479944 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 272/560] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:06.484917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0bdc1c15-17ea-418b-9f9d-c6cec5220743 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '.version_select at 0x7f6474248e50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:06.486391 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:06.486391 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:06.498163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bdc1c15-17ea-418b-9f9d-c6cec5220743 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:06.500720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bdc1c15-17ea-418b-9f9d-c6cec5220743 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:06.510158 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0bdc1c15-17ea-418b-9f9d-c6cec5220743 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.028871 Feb 19 20:52:06.525490 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 273/561] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:52:06 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:06.531590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c8b350d-887d-4a95-bd55-bbadccfd6241 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Calling method '.version_select at 0x7f6474347280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:06.533085 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:06.533085 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:06.535202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c8b350d-887d-4a95-bd55-bbadccfd6241 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:06.536011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c8b350d-887d-4a95-bd55-bbadccfd6241 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:06.537154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c8b350d-887d-4a95-bd55-bbadccfd6241 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:06.537836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c8b350d-887d-4a95-bd55-bbadccfd6241 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:06.583657 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c8b350d-887d-4a95-bd55-bbadccfd6241 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.055811 Feb 19 20:52:06.591339 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 274/562] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 20:52:06 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:06.598696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4a0dffe3-e609-4b3f-8d22-993c88a1b169 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:06.603439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4a0dffe3-e609-4b3f-8d22-993c88a1b169 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:06.616194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a0dffe3-e609-4b3f-8d22-993c88a1b169 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:06.618185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a0dffe3-e609-4b3f-8d22-993c88a1b169 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:06.623014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a0dffe3-e609-4b3f-8d22-993c88a1b169 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:06.623662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a0dffe3-e609-4b3f-8d22-993c88a1b169 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:07.012599 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-38bc0ff0-efb5-484c-8404-af3b31d356c6 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/156705b3-61f8-449a-9855-721b01b6eef8" status: 202 len: 0 microversion: 2.1 time: 1.020645 Feb 19 20:52:07.016408 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 289/563] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:52:05 2022] DELETE /compute/v2.1/os-security-groups/156705b3-61f8-449a-9855-721b01b6eef8 => generated 0 bytes in 1022 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:52:07.019518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8fddc9aa-5183-4f63-9d8c-fa5b607117a4 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Calling method '.version_select at 0x7f647429c160>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:07.020765 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:07.020765 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:07.038011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fddc9aa-5183-4f63-9d8c-fa5b607117a4 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:07.041524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fddc9aa-5183-4f63-9d8c-fa5b607117a4 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:07.086546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fddc9aa-5183-4f63-9d8c-fa5b607117a4 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:07.092985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fddc9aa-5183-4f63-9d8c-fa5b607117a4 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:07.106548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4a0dffe3-e609-4b3f-8d22-993c88a1b169 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:07.117328 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4a0dffe3-e609-4b3f-8d22-993c88a1b169 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1313 microversion: 2.1 time: 0.524664 Feb 19 20:52:07.117833 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8fddc9aa-5183-4f63-9d8c-fa5b607117a4 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 598 microversion: 2.1 time: 0.102873 Feb 19 20:52:07.119010 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 290/564] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Feb 19 20:52:07 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 598 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:07.123057 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 275/565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:06 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:07.126890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-897306254", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:07.138108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9dbdf513-aaf1-4972-931e-c1a83f9d1373 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Calling method '.version_select at 0x7f64745513a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:07.199019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:07.709835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:07.710274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:07.710749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:07.711161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:07.711626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:07.733746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:07.734457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:07.735447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:07.735889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:07.770585 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9dbdf513-aaf1-4972-931e-c1a83f9d1373 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/98d93fdf-59f2-43e6-bd36-c7e012c68742" status: 202 len: 0 microversion: 2.1 time: 0.645195 Feb 19 20:52:07.771192 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 276/566] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:52:07 2022] DELETE /compute/v2.1/os-security-groups/98d93fdf-59f2-43e6-bd36-c7e012c68742 => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:52:07.779579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-42cab668-c464-4ee0-b8b7-01c82c87aba9 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Calling method '.version_select at 0x7f6474248820>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:07.780454 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:07.780454 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:07.782523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:07.788944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for user c26bc5048c9849218cadd12475cd5fbe and project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:07.792862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42cab668-c464-4ee0-b8b7-01c82c87aba9 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:07.797335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42cab668-c464-4ee0-b8b7-01c82c87aba9 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:07.820362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:52:07.825392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42cab668-c464-4ee0-b8b7-01c82c87aba9 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:07.826129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42cab668-c464-4ee0-b8b7-01c82c87aba9 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:07.834318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:52:07.855990 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-42cab668-c464-4ee0-b8b7-01c82c87aba9 tempest-HostsAdminTestJSON-1206539232 tempest-HostsAdminTestJSON-1206539232-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 860 microversion: 2.1 time: 0.080381 Feb 19 20:52:07.856973 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 277/567] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Feb 19 20:52:07 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 860 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:07.871665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:07.877469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:07.892479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:07.893652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:07.894871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:07.896216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:07.926049 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c9079c6e-45b5-4ace-bf76-e07358537172 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805137 Feb 19 20:52:07.926938 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 291/568] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:52:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:52:07.937688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-deef6811-6501-4942-8b41-b29bcd1bf525 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Calling method '.version_select at 0x7f64742f1c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:08.231221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:08.255655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:08.259243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:08.260712 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5766d8c1-2d68-420f-b3ea-3164743dc44a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1361 microversion: 2.25 time: 0.402502 Feb 19 20:52:08.262323 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 278/569] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:07 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1361 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:08.267947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d0d06f77-4dce-45da-89b9-a4f4cf006e99 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:08.269660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d0d06f77-4dce-45da-89b9-a4f4cf006e99 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:08.358784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d0d06f77-4dce-45da-89b9-a4f4cf006e99 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:08.370123 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-deef6811-6501-4942-8b41-b29bcd1bf525 tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/3fb5744a-a17b-416d-9c5f-dc2e2caf4503" status: 202 len: 0 microversion: 2.1 time: 0.436855 Feb 19 20:52:08.373751 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 292/570] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:52:07 2022] DELETE /compute/v2.1/os-security-groups/3fb5744a-a17b-416d-9c5f-dc2e2caf4503 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:52:08.377864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2c46642f-1f04-4d75-9bf7-45e0086d3cf6 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:08.378398 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d0d06f77-4dce-45da-89b9-a4f4cf006e99 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1212 microversion: 2.1 time: 0.106120 Feb 19 20:52:08.379305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2c46642f-1f04-4d75-9bf7-45e0086d3cf6 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:08.380147 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 279/571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:08 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1212 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:08.397987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c989662-9cdb-42d9-a9ce-72a87b5ae09d tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] Calling method '.version_select at 0x7f64741fd940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:08.412857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c46642f-1f04-4d75-9bf7-45e0086d3cf6 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:08.413292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c46642f-1f04-4d75-9bf7-45e0086d3cf6 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:08.414714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c46642f-1f04-4d75-9bf7-45e0086d3cf6 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:08.415089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c46642f-1f04-4d75-9bf7-45e0086d3cf6 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:08.737973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2c46642f-1f04-4d75-9bf7-45e0086d3cf6 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:08.748817 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2c46642f-1f04-4d75-9bf7-45e0086d3cf6 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1313 microversion: 2.1 time: 0.376949 Feb 19 20:52:08.750558 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 293/572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:08 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:08.879595 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c989662-9cdb-42d9-a9ce-72a87b5ae09d tempest-SecurityGroupRulesNegativeTestJSON-1125767113 tempest-SecurityGroupRulesNegativeTestJSON-1125767113-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/dcc26d45-dc4f-4516-b2cf-c476080034d0" status: 202 len: 0 microversion: 2.1 time: 0.496241 Feb 19 20:52:08.882594 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 280/573] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:52:08 2022] DELETE /compute/v2.1/os-security-groups/dcc26d45-dc4f-4516-b2cf-c476080034d0 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:52:09.281285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:09.281867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:09.293323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:09.295131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:09.297785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:09.299489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:09.396928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e6d0e49f-2902-4128-909d-41f26d20ce1d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:09.397581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e6d0e49f-2902-4128-909d-41f26d20ce1d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:09.413293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d0e49f-2902-4128-909d-41f26d20ce1d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:09.419469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d0e49f-2902-4128-909d-41f26d20ce1d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:09.420523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d0e49f-2902-4128-909d-41f26d20ce1d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:09.421030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d0e49f-2902-4128-909d-41f26d20ce1d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:09.616488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e6d0e49f-2902-4128-909d-41f26d20ce1d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:09.637513 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e6d0e49f-2902-4128-909d-41f26d20ce1d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1272 microversion: 2.1 time: 0.242163 Feb 19 20:52:09.649944 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 281/574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:09 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:09.767253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5bee28a4-030a-453c-8c92-8a0de7e63cfb tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:09.768364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5bee28a4-030a-453c-8c92-8a0de7e63cfb tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:09.778652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bee28a4-030a-453c-8c92-8a0de7e63cfb tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:09.785367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bee28a4-030a-453c-8c92-8a0de7e63cfb tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:09.786649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bee28a4-030a-453c-8c92-8a0de7e63cfb tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:09.789485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bee28a4-030a-453c-8c92-8a0de7e63cfb tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:10.147494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:10.156422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:10.157942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:10.159626 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f0b033b9-b6f5-48c1-b197-845a3e225681 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1361 microversion: 2.25 time: 0.883772 Feb 19 20:52:10.159626 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 294/575] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:09 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1361 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:10.344147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5bee28a4-030a-453c-8c92-8a0de7e63cfb tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:10.353832 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5bee28a4-030a-453c-8c92-8a0de7e63cfb tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1313 microversion: 2.1 time: 0.590900 Feb 19 20:52:10.360384 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 282/576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:09 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:10.658145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dd200afb-81a2-4454-b0ca-9c2c840cee4c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:10.659003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dd200afb-81a2-4454-b0ca-9c2c840cee4c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:10.668109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd200afb-81a2-4454-b0ca-9c2c840cee4c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:10.670069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd200afb-81a2-4454-b0ca-9c2c840cee4c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:10.673607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd200afb-81a2-4454-b0ca-9c2c840cee4c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:10.676664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd200afb-81a2-4454-b0ca-9c2c840cee4c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:10.797320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dd200afb-81a2-4454-b0ca-9c2c840cee4c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:10.809326 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dd200afb-81a2-4454-b0ca-9c2c840cee4c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1270 microversion: 2.1 time: 0.155500 Feb 19 20:52:10.819010 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 283/577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:10 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:11.000894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c70a6cf5-5735-4123-a9a7-6bfade2968f7 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Calling method '.version_select at 0x7f647429c820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:11.177671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:11.179038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:11.186407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:11.194524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:11.195578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:11.196202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:11.738487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:11.749880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:11.751672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:11.759010 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-80807622-364c-4e36-b6ed-03021a55423e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1361 microversion: 2.25 time: 0.579767 Feb 19 20:52:11.772225 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 284/578] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:11 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1361 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:11.779485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2f866e9a-c2a9-43a9-ab99-4f7057be5de4 req-b3f716ec-00c5-4b9f-aadd-40698cb61e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b664ff-b2ee-4815-9cc7-5a1895e092a2", "name": "network-vif-plugged", "status": "completed", "tag": "a7ef59b7-3a86-414d-98e0-dccf483c634e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:11.782626 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:11.782626 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:11.797265 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c70a6cf5-5735-4123-a9a7-6bfade2968f7 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 200 len: 371 microversion: 2.1 time: 1.153327 Feb 19 20:52:11.798297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2f866e9a-c2a9-43a9-ab99-4f7057be5de4 req-b3f716ec-00c5-4b9f-aadd-40698cb61e3f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:11.799223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2f866e9a-c2a9-43a9-ab99-4f7057be5de4 req-b3f716ec-00c5-4b9f-aadd-40698cb61e3f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:11.806212 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 295/579] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 20:52:10 2022] GET /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 371 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:11.815841 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2f866e9a-c2a9-43a9-ab99-4f7057be5de4 req-b3f716ec-00c5-4b9f-aadd-40698cb61e3f service nova] Creating event network-vif-plugged:a7ef59b7-3a86-414d-98e0-dccf483c634e for instance 77b664ff-b2ee-4815-9cc7-5a1895e092a2 on nch1-master-1 Feb 19 20:52:11.824654 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2f866e9a-c2a9-43a9-ab99-4f7057be5de4 req-b3f716ec-00c5-4b9f-aadd-40698cb61e3f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048533 Feb 19 20:52:11.826859 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 285/580] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:11.832653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab404c84-aeff-49dd-8e2d-00c903cc8f7a tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:11.833340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ab404c84-aeff-49dd-8e2d-00c903cc8f7a tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:11.854869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-648ea07f-9854-4544-a2b0-a3c7630bd21b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Action: 'update', calling method: .version_select at 0x7f6474347310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:11.857831 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:11.857831 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:11.869663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab404c84-aeff-49dd-8e2d-00c903cc8f7a tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:11.877924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab404c84-aeff-49dd-8e2d-00c903cc8f7a tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:11.879176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab404c84-aeff-49dd-8e2d-00c903cc8f7a tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:11.883152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab404c84-aeff-49dd-8e2d-00c903cc8f7a tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:12.298940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-648ea07f-9854-4544-a2b0-a3c7630bd21b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:12.301227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-648ea07f-9854-4544-a2b0-a3c7630bd21b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:12.302626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-648ea07f-9854-4544-a2b0-a3c7630bd21b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:12.305434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-648ea07f-9854-4544-a2b0-a3c7630bd21b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:12.391854 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-648ea07f-9854-4544-a2b0-a3c7630bd21b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 200 len: 328 microversion: 2.1 time: 0.563571 Feb 19 20:52:12.404447 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 286/581] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:52:11 2022] PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 328 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:12.412106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b2ac442e-11bd-40df-a39e-5e6162b352c1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:12.413577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b2ac442e-11bd-40df-a39e-5e6162b352c1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:12.425447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2ac442e-11bd-40df-a39e-5e6162b352c1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:12.426484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2ac442e-11bd-40df-a39e-5e6162b352c1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:12.429036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2ac442e-11bd-40df-a39e-5e6162b352c1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:12.430083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2ac442e-11bd-40df-a39e-5e6162b352c1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:12.638140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ab404c84-aeff-49dd-8e2d-00c903cc8f7a tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:12.647854 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab404c84-aeff-49dd-8e2d-00c903cc8f7a tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1313 microversion: 2.1 time: 0.839121 Feb 19 20:52:12.652529 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 296/582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:11 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:12.849357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b2ac442e-11bd-40df-a39e-5e6162b352c1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:12.858737 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b2ac442e-11bd-40df-a39e-5e6162b352c1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1312 microversion: 2.1 time: 0.464527 Feb 19 20:52:12.859326 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 287/583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:12 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:12.869845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:12.870688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:12.882631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:12.885650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:12.888423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:12.889059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:13.002212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2019053124", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:13.081527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:13.660102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:13.675219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:13.676779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:13.678232 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c2d526d2-939d-4202-854e-eacbafbb1098 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1361 microversion: 2.25 time: 0.817667 Feb 19 20:52:13.688201 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 288/584] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:12 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1361 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:13.693451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2780098-040c-4875-b921-e20843caa421 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:13.695952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2780098-040c-4875-b921-e20843caa421 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:13.711069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2780098-040c-4875-b921-e20843caa421 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:13.711526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2780098-040c-4875-b921-e20843caa421 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:13.712356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2780098-040c-4875-b921-e20843caa421 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:13.712793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2780098-040c-4875-b921-e20843caa421 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:13.868168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:13.868803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:13.869272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:13.869679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:13.870083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:13.889347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:13.889794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:13.890611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:13.891042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:13.932498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Getting quotas for project 4e8808e5cb7f49c7b1f2022d423fee73. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:13.942684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Getting quotas for user bb5c1d90fa4f4e36ba82527497b2cbd7 and project 4e8808e5cb7f49c7b1f2022d423fee73. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:13.969299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.utils [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] cores quota exceeded for 4e8808e5cb7f49c7b1f2022d423fee73, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136094) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Feb 19 20:52:13.970387 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Feb 19 20:52:13.978906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:13.980000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-46d8bfe6-1756-4486-9495-413eeeadddfc tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.326512 Feb 19 20:52:13.984510 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 297/585] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:52:12 2022] POST /compute/v2.1/servers => generated 111 bytes in 1331 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:13.993393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7ee9bf58-0e32-4471-bd1b-5905a9464338 req-5f30a3a5-364f-40e3-9d05-8cf02a19fe46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af34c3d-efca-4de5-94a6-7bdb97d068fd", "tag": "45bff999-b4bd-48a5-8654-55e37f10072d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:13.996606 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:13.996606 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:14.012293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7ee9bf58-0e32-4471-bd1b-5905a9464338 req-5f30a3a5-364f-40e3-9d05-8cf02a19fe46 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.023614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7ee9bf58-0e32-4471-bd1b-5905a9464338 req-5f30a3a5-364f-40e3-9d05-8cf02a19fe46 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:14.040113 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7ee9bf58-0e32-4471-bd1b-5905a9464338 req-5f30a3a5-364f-40e3-9d05-8cf02a19fe46 service nova] Creating event network-changed:45bff999-b4bd-48a5-8654-55e37f10072d for instance 5af34c3d-efca-4de5-94a6-7bdb97d068fd on nch1-master-1 Feb 19 20:52:14.047670 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7ee9bf58-0e32-4471-bd1b-5905a9464338 req-5f30a3a5-364f-40e3-9d05-8cf02a19fe46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060392 Feb 19 20:52:14.048934 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 298/586] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:14.072103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0a9e132-6da2-4446-924f-240e83347619 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:14.074613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d0a9e132-6da2-4446-924f-240e83347619 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:14.089538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0a9e132-6da2-4446-924f-240e83347619 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.090137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0a9e132-6da2-4446-924f-240e83347619 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:14.091167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0a9e132-6da2-4446-924f-240e83347619 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.093621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0a9e132-6da2-4446-924f-240e83347619 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:14.360192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2780098-040c-4875-b921-e20843caa421 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:14.379338 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2780098-040c-4875-b921-e20843caa421 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1463 microversion: 2.1 time: 0.685157 Feb 19 20:52:14.381001 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 289/587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:13 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1463 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:14.401412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0dabf8f7-6f15-4853-96bc-0a877884c877 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Action: 'update', calling method: .version_select at 0x7f6474551160>, body: {"quota_set": {"cores": 20}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:14.408932 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:14.408932 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:14.598890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d0a9e132-6da2-4446-924f-240e83347619 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:14.611120 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d0a9e132-6da2-4446-924f-240e83347619 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1312 microversion: 2.1 time: 0.550343 Feb 19 20:52:14.613522 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 299/588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:14 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1312 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:14.721617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-faa9749d-3162-4b2d-89da-f5242e88ae0d tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Calling method '.version_select at 0x7f64747800d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:14.722913 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:14.722913 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:14.733157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faa9749d-3162-4b2d-89da-f5242e88ae0d tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.733794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faa9749d-3162-4b2d-89da-f5242e88ae0d tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:14.757900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faa9749d-3162-4b2d-89da-f5242e88ae0d tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.758623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faa9749d-3162-4b2d-89da-f5242e88ae0d tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:14.778719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faa9749d-3162-4b2d-89da-f5242e88ae0d tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.779618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faa9749d-3162-4b2d-89da-f5242e88ae0d tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:14.793358 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-faa9749d-3162-4b2d-89da-f5242e88ae0d tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.177732 Feb 19 20:52:14.795126 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 300/589] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:52:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:14.814531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0dabf8f7-6f15-4853-96bc-0a877884c877 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.814981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0dabf8f7-6f15-4853-96bc-0a877884c877 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:14.816556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0dabf8f7-6f15-4853-96bc-0a877884c877 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.817008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0dabf8f7-6f15-4853-96bc-0a877884c877 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:14.921213 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0dabf8f7-6f15-4853-96bc-0a877884c877 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 200 len: 329 microversion: 2.1 time: 0.538933 Feb 19 20:52:14.928615 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 290/590] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:52:14 2022] PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 329 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:14.936841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:14.939734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:14.953203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.955564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:14.956411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:14.960623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:15.021211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5abd3167-ffea-4263-bf0b-724b5d81bb37 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:15.024769 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:15.024769 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:15.026494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5abd3167-ffea-4263-bf0b-724b5d81bb37 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Searching by: {'deleted': False, 'project_id': '85fb7ac785b04495b0aebd17fa4efb4a'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:52:15.040322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5abd3167-ffea-4263-bf0b-724b5d81bb37 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:15.041033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5abd3167-ffea-4263-bf0b-724b5d81bb37 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:15.042610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5abd3167-ffea-4263-bf0b-724b5d81bb37 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:15.043837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5abd3167-ffea-4263-bf0b-724b5d81bb37 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:15.158216 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5abd3167-ffea-4263-bf0b-724b5d81bb37 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.361846 Feb 19 20:52:15.159330 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 301/591] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:52:14 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:52:15.172297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a9144331-4f01-4a98-81a4-b938d653ee85 req-286d8534-27bb-42cf-b1ae-4f90bf94c15c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470c141a-60d6-46e9-bd5f-08ce9c6a7f99", "name": "network-vif-plugged", "status": "completed", "tag": "8fa16ec0-665d-486a-8609-c23482d79a71"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:15.173978 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:15.173978 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:15.181492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a9144331-4f01-4a98-81a4-b938d653ee85 req-286d8534-27bb-42cf-b1ae-4f90bf94c15c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:15.182073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a9144331-4f01-4a98-81a4-b938d653ee85 req-286d8534-27bb-42cf-b1ae-4f90bf94c15c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:15.194829 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a9144331-4f01-4a98-81a4-b938d653ee85 req-286d8534-27bb-42cf-b1ae-4f90bf94c15c service nova] Creating event network-vif-plugged:8fa16ec0-665d-486a-8609-c23482d79a71 for instance 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 on nch2-master-1 Feb 19 20:52:15.200763 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a9144331-4f01-4a98-81a4-b938d653ee85 req-286d8534-27bb-42cf-b1ae-4f90bf94c15c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040095 Feb 19 20:52:15.201956 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 302/592] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:15.235628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:15.248937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:15.252808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:15.261013 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e20748da-807c-4bf3-ab5a-afe18ea754f3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1361 microversion: 2.25 time: 0.332927 Feb 19 20:52:15.262372 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 291/593] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:14 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:15.271037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-73ad9757-1f9e-4de7-ada4-83f984e8617e tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Calling method '.version_select at 0x7f6474212af0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:15.382233 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-73ad9757-1f9e-4de7-ada4-83f984e8617e tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 200 len: 371 microversion: 2.1 time: 0.118630 Feb 19 20:52:15.383917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-18809941-c4ae-4b9c-a6e2-ed8bb0cdbde1 tempest-HypervisorAdminNegativeUnderV252Test-198404216 tempest-HypervisorAdminNegativeUnderV252Test-198404216-project] Calling method '.version_select at 0x7f647435f820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:15.384677 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 292/594] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 20:52:15 2022] GET /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:15.385062 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:15.385062 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:15.386618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-18809941-c4ae-4b9c-a6e2-ed8bb0cdbde1 tempest-HypervisorAdminNegativeUnderV252Test-198404216 tempest-HypervisorAdminNegativeUnderV252Test-198404216-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '926dd891723346f8b2969d5e53e65563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a90d1f7954107a473d8484490c2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:15.387444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-18809941-c4ae-4b9c-a6e2-ed8bb0cdbde1 tempest-HypervisorAdminNegativeUnderV252Test-198404216 tempest-HypervisorAdminNegativeUnderV252Test-198404216-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:15.388423 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-18809941-c4ae-4b9c-a6e2-ed8bb0cdbde1 tempest-HypervisorAdminNegativeUnderV252Test-198404216 tempest-HypervisorAdminNegativeUnderV252Test-198404216-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.185215 Feb 19 20:52:15.395239 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 303/595] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 20:52:15 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 192 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:15.400190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:15.408145 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:15.408145 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:15.409536 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:15.409536 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:15.413471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Searching by: {'deleted': False} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:52:15.437753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:15.438453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:15.439422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:15.440037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:15.468490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-87088423", "imageRef": "05e1c90e-98d3-4f56-97e8-108b9541cc87", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "065326d1-f4ad-4311-843c-e3f82557ad7a"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:15.560989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] validate_networks() for [('065326d1-f4ad-4311-843c-e3f82557ad7a', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:15.607248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:52:15.770328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:15.771057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.394396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:16.394861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:16.395292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:16.395709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:16.398555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:16.418321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.418854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.420125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.420673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.432736 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a2747095-599f-4ff8-9205-e7f04fb8f01d tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12854 microversion: 2.1 time: 1.036124 Feb 19 20:52:16.449413 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 304/596] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Feb 19 20:52:15 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12854 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:52:16.451202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Getting quotas for project 76afd67dfef14c3db64ccbd812036427. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:16.456125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Getting quotas for user 08781c2dd21c4011b5eebde0436042c2 and project 76afd67dfef14c3db64ccbd812036427. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:16.462109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e569fc15-041c-4443-b837-258d4c73d3e8 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Action: 'update', calling method: .version_select at 0x7f64743769d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:16.464036 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:16.464036 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:16.469900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:52:16.472617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05e1c90e-98d3-4f56-97e8-108b9541cc87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:52:16.529583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e569fc15-041c-4443-b837-258d4c73d3e8 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.530033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e569fc15-041c-4443-b837-258d4c73d3e8 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.530852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e569fc15-041c-4443-b837-258d4c73d3e8 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.531297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e569fc15-041c-4443-b837-258d4c73d3e8 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.538692 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4bd547cb-ef6b-42b5-8346-cee27efed114 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150895 Feb 19 20:52:16.539687 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 293/597] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:52:16.545631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8c4df96-2c94-4091-bddf-c7d85a1931fb tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Calling method '.version_select at 0x7f647421de50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:16.547098 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:16.547098 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:16.549358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8c4df96-2c94-4091-bddf-c7d85a1931fb tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.550044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8c4df96-2c94-4091-bddf-c7d85a1931fb tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.567660 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-e8c4df96-2c94-4091-bddf-c7d85a1931fb tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Feb 19 20:52:16.571765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8c4df96-2c94-4091-bddf-c7d85a1931fb tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:16.572879 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e8c4df96-2c94-4091-bddf-c7d85a1931fb tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.032039 Feb 19 20:52:16.574702 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 294/598] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 20:52:16 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:16.582742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e9304a6a-98a6-4f99-9111-ccce5bbe358c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:16.583444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e9304a6a-98a6-4f99-9111-ccce5bbe358c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:16.592922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9304a6a-98a6-4f99-9111-ccce5bbe358c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.593477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9304a6a-98a6-4f99-9111-ccce5bbe358c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.594352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9304a6a-98a6-4f99-9111-ccce5bbe358c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.595932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9304a6a-98a6-4f99-9111-ccce5bbe358c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.654541 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e569fc15-041c-4443-b837-258d4c73d3e8 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 200 len: 328 microversion: 2.1 time: 0.203844 Feb 19 20:52:16.664550 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 305/599] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:52:16 2022] PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 328 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:16.675202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:16.675963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:16.691839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.692303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.693786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.694392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.932199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e9304a6a-98a6-4f99-9111-ccce5bbe358c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:16.941973 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e9304a6a-98a6-4f99-9111-ccce5bbe358c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1312 microversion: 2.1 time: 0.364844 Feb 19 20:52:16.944474 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 295/600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:16 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1312 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:16.952234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8cabf9f4-a57f-4286-8780-b48b39420230 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:16.959103 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:16.959103 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:16.965306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8cabf9f4-a57f-4286-8780-b48b39420230 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Searching by: {'deleted': False, 'project_id': '85fb7ac785b04495b0aebd17fa4efb4a'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:52:16.988234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8cabf9f4-a57f-4286-8780-b48b39420230 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.988724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8cabf9f4-a57f-4286-8780-b48b39420230 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:16.993832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8cabf9f4-a57f-4286-8780-b48b39420230 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:16.994434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8cabf9f4-a57f-4286-8780-b48b39420230 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.110183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:17.112087 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8cabf9f4-a57f-4286-8780-b48b39420230 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?tenant_id=6d9ffdaf1d654c9bbbda43ed9214c964" status: 200 len: 15 microversion: 2.1 time: 0.166549 Feb 19 20:52:17.113360 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 296/601] 10.222.0.30 () {58 vars in 1230 bytes} [Sat Feb 19 20:52:16 2022] GET /compute/v2.1/servers/detail?tenant_id=6d9ffdaf1d654c9bbbda43ed9214c964 => generated 15 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:52:17.119165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:17.120244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b354784a-7666-4c51-81ec-20d251ae9148 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:17.120702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:17.120913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b354784a-7666-4c51-81ec-20d251ae9148 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:17.121798 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-77432dca-5bd4-4007-901d-af064e7339ef tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1361 microversion: 2.25 time: 0.465721 Feb 19 20:52:17.133494 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 306/602] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:16 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1361 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:17.137646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e7014d59-34f2-4bd5-8964-b9e395cf2bfa tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Calling method '.version_select at 0x7f64742ab940>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:17.138437 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:17.138437 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:17.146173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7014d59-34f2-4bd5-8964-b9e395cf2bfa tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.150026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7014d59-34f2-4bd5-8964-b9e395cf2bfa tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.196165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7014d59-34f2-4bd5-8964-b9e395cf2bfa tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.205115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7014d59-34f2-4bd5-8964-b9e395cf2bfa tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.218577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b354784a-7666-4c51-81ec-20d251ae9148 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:17.233168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7014d59-34f2-4bd5-8964-b9e395cf2bfa tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.233581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7014d59-34f2-4bd5-8964-b9e395cf2bfa tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.234191 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b354784a-7666-4c51-81ec-20d251ae9148 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1220 microversion: 2.1 time: 0.115838 Feb 19 20:52:17.234823 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 297/603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:17 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1220 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:17.242560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1798970684", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:17.256308 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e7014d59-34f2-4bd5-8964-b9e395cf2bfa tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.123785 Feb 19 20:52:17.257591 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 307/604] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:52:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:17.262603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:17.275632 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:17.275632 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:17.276950 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:17.276950 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:17.278248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Searching by: {'tenant_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'deleted': False} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:52:17.283584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.285463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.287010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.289946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.345947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:52:17.351254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:17.437436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.437968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.773042 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-884a6b14-5f66-475c-9fa4-ae992e169487 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6d9ffdaf1d654c9bbbda43ed9214c964" status: 200 len: 4825 microversion: 2.1 time: 0.514080 Feb 19 20:52:17.774202 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 308/605] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 20:52:17 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6d9ffdaf1d654c9bbbda43ed9214c964 => generated 4825 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:17.778828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46651158-74c6-4510-9870-6bc33ea2a51d tempest-HypervisorAdminNegativeUnderV252Test-198404216 tempest-HypervisorAdminNegativeUnderV252Test-198404216-project] Calling method '.version_select at 0x7f64740e7dc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:17.779845 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:17.779845 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:17.781456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-46651158-74c6-4510-9870-6bc33ea2a51d tempest-HypervisorAdminNegativeUnderV252Test-198404216 tempest-HypervisorAdminNegativeUnderV252Test-198404216-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '926dd891723346f8b2969d5e53e65563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521a90d1f7954107a473d8484490c2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:17.782109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46651158-74c6-4510-9870-6bc33ea2a51d tempest-HypervisorAdminNegativeUnderV252Test-198404216 tempest-HypervisorAdminNegativeUnderV252Test-198404216-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:17.782911 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-46651158-74c6-4510-9870-6bc33ea2a51d tempest-HypervisorAdminNegativeUnderV252Test-198404216 tempest-HypervisorAdminNegativeUnderV252Test-198404216-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.007719 Feb 19 20:52:17.799405 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 309/606] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Feb 19 20:52:17 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:17.799405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b0c12b03-1c1d-4615-81b5-840cc0f24688 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:17.811807 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:17.811807 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:17.826805 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:17.826805 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:17.829934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b0c12b03-1c1d-4615-81b5-840cc0f24688 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Searching by: {'tenant_id': '85fb7ac785b04495b0aebd17fa4efb4a', 'deleted': False} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:52:17.841338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0c12b03-1c1d-4615-81b5-840cc0f24688 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.842044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0c12b03-1c1d-4615-81b5-840cc0f24688 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.843049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0c12b03-1c1d-4615-81b5-840cc0f24688 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.843648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0c12b03-1c1d-4615-81b5-840cc0f24688 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.853508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:17.854513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:17.855455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:17.856040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:17.856498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:17.873715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.874173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.874997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.875451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.910132 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b0c12b03-1c1d-4615-81b5-840cc0f24688 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=85fb7ac785b04495b0aebd17fa4efb4a" status: 200 len: 15 microversion: 2.1 time: 0.116502 Feb 19 20:52:17.913053 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 310/607] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 20:52:17 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=85fb7ac785b04495b0aebd17fa4efb4a => generated 15 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:52:17.916357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Getting quotas for project 4e8808e5cb7f49c7b1f2022d423fee73. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:17.920864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5c89114-2d6a-448c-a862-1fa5d53f7cd4 tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Calling method '.version_select at 0x7f64742ab820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:17.923058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5c89114-2d6a-448c-a862-1fa5d53f7cd4 tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:17.926530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Getting quotas for user bb5c1d90fa4f4e36ba82527497b2cbd7 and project 4e8808e5cb7f49c7b1f2022d423fee73. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:17.928949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5c89114-2d6a-448c-a862-1fa5d53f7cd4 tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:17.941154 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a5c89114-2d6a-448c-a862-1fa5d53f7cd4 tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] HTTP exception thrown: No hypervisor matching 'c48b7ec8-0b23-4fca-96bf-0bcd864e8a80' could be found. Feb 19 20:52:17.945068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5c89114-2d6a-448c-a862-1fa5d53f7cd4 tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] Returning 404 to user: No hypervisor matching 'c48b7ec8-0b23-4fca-96bf-0bcd864e8a80' could be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:17.945999 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a5c89114-2d6a-448c-a862-1fa5d53f7cd4 tempest-HypervisorAdminNegativeUnderV252Test-1275718454 tempest-HypervisorAdminNegativeUnderV252Test-1275718454-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/c48b7ec8-0b23-4fca-96bf-0bcd864e8a80/servers" status: 404 len: 123 microversion: 2.1 time: 0.031992 Feb 19 20:52:17.950778 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 311/608] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Feb 19 20:52:17 2022] GET /compute/v2.1/os-hypervisors/c48b7ec8-0b23-4fca-96bf-0bcd864e8a80/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:17.950919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.utils [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] instances quota exceeded for 4e8808e5cb7f49c7b1f2022d423fee73, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136095) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Feb 19 20:52:17.950919 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Feb 19 20:52:17.967644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f20b9a90-2390-42da-aee1-3caf1d2abd52 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:17.971882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:17.972866 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3a7638e3-e0db-4791-bce0-6f2dca9f6289 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.737073 Feb 19 20:52:17.975266 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 298/609] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:52:17 2022] POST /compute/v2.1/servers => generated 119 bytes in 740 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:17.986913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bf464970-021a-4dbb-b860-f71fc40e91d8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:17.987532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bf464970-021a-4dbb-b860-f71fc40e91d8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:17.990298 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f20b9a90-2390-42da-aee1-3caf1d2abd52 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.027382 Feb 19 20:52:17.990857 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 312/610] 10.222.0.30 () {58 vars in 1188 bytes} [Sat Feb 19 20:52:17 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:52:17.997517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fbdbd36b-ed7a-409e-b79d-a09f0dbca02b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Action: 'update', calling method: .version_select at 0x7f64740c95e0>, body: {"quota_set": {"instances": 10}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:17.999087 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:17.999087 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:18.013426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf464970-021a-4dbb-b860-f71fc40e91d8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.013888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf464970-021a-4dbb-b860-f71fc40e91d8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.014697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf464970-021a-4dbb-b860-f71fc40e91d8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.015146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf464970-021a-4dbb-b860-f71fc40e91d8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.161988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbdbd36b-ed7a-409e-b79d-a09f0dbca02b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.163141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbdbd36b-ed7a-409e-b79d-a09f0dbca02b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.164161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbdbd36b-ed7a-409e-b79d-a09f0dbca02b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.166190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbdbd36b-ed7a-409e-b79d-a09f0dbca02b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.272125 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fbdbd36b-ed7a-409e-b79d-a09f0dbca02b tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 200 len: 329 microversion: 2.1 time: 0.277326 Feb 19 20:52:18.272761 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 313/611] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:52:17 2022] PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 329 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:18.285961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00be35ed-aa8b-4b68-b5d9-26eea13988ea tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:18.291296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-00be35ed-aa8b-4b68-b5d9-26eea13988ea tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:18.307991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00be35ed-aa8b-4b68-b5d9-26eea13988ea tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.314445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00be35ed-aa8b-4b68-b5d9-26eea13988ea tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.316157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00be35ed-aa8b-4b68-b5d9-26eea13988ea tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.320895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00be35ed-aa8b-4b68-b5d9-26eea13988ea tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.464832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bf464970-021a-4dbb-b860-f71fc40e91d8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:18.471815 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-00be35ed-aa8b-4b68-b5d9-26eea13988ea tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action" status: 202 len: 0 microversion: 2.1 time: 0.193715 Feb 19 20:52:18.472996 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 314/612] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:52:18 2022] POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:52:18.480741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:18.481364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:18.481974 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bf464970-021a-4dbb-b860-f71fc40e91d8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1312 microversion: 2.1 time: 0.498390 Feb 19 20:52:18.483191 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 299/613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:17 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1312 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:18.495282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3dae1e5a-0171-451f-a1bf-843a81896885 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:18.496434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3dae1e5a-0171-451f-a1bf-843a81896885 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:18.496753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.497209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.498102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.498485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.507731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dae1e5a-0171-451f-a1bf-843a81896885 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.509140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dae1e5a-0171-451f-a1bf-843a81896885 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.510564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dae1e5a-0171-451f-a1bf-843a81896885 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.511229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dae1e5a-0171-451f-a1bf-843a81896885 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.708015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3dae1e5a-0171-451f-a1bf-843a81896885 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:18.715999 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3dae1e5a-0171-451f-a1bf-843a81896885 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1278 microversion: 2.1 time: 0.231525 Feb 19 20:52:18.720073 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 300/614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:18 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:18.738246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d80985cb-8902-4fdf-84c6-c027203714ce tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Calling method '.version_select at 0x7f647428d550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:18.886193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:18.899890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:18.902876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:18.909140 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a902f490-1db2-4674-8c06-2def52316920 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1558 microversion: 2.25 time: 0.433936 Feb 19 20:52:18.911403 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 315/615] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:18 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1558 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:18.917972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ed92eb41-945c-426a-91ce-4ee3a68e0cb2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:18.922176 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:18.922176 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:18.924063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ed92eb41-945c-426a-91ce-4ee3a68e0cb2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:18.925259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ed92eb41-945c-426a-91ce-4ee3a68e0cb2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:52:18.932681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ed92eb41-945c-426a-91ce-4ee3a68e0cb2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.933423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ed92eb41-945c-426a-91ce-4ee3a68e0cb2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:18.935042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ed92eb41-945c-426a-91ce-4ee3a68e0cb2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:18.935822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ed92eb41-945c-426a-91ce-4ee3a68e0cb2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:19.071904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-ed92eb41-945c-426a-91ce-4ee3a68e0cb2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:52:19.141040 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ed92eb41-945c-426a-91ce-4ee3a68e0cb2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.227341 Feb 19 20:52:19.142318 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 316/616] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Feb 19 20:52:18 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:19.147697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3caec9b0-b4b6-4acc-897a-88f20a94ba34 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:19.148735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3caec9b0-b4b6-4acc-897a-88f20a94ba34 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:19.156294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3caec9b0-b4b6-4acc-897a-88f20a94ba34 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:19.157717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3caec9b0-b4b6-4acc-897a-88f20a94ba34 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:19.162607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3caec9b0-b4b6-4acc-897a-88f20a94ba34 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:19.163484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3caec9b0-b4b6-4acc-897a-88f20a94ba34 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:19.303275 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d80985cb-8902-4fdf-84c6-c027203714ce tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 200 len: 371 microversion: 2.1 time: 0.581425 Feb 19 20:52:19.310042 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 301/617] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 20:52:18 2022] GET /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 371 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:19.328701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce1bd7cf-4fb5-4f3f-88de-57920625f1fd tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:19.333225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ce1bd7cf-4fb5-4f3f-88de-57920625f1fd tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:19.354931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce1bd7cf-4fb5-4f3f-88de-57920625f1fd tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:19.357802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce1bd7cf-4fb5-4f3f-88de-57920625f1fd tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:19.361214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce1bd7cf-4fb5-4f3f-88de-57920625f1fd tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:19.362970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce1bd7cf-4fb5-4f3f-88de-57920625f1fd tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:19.790436 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ce1bd7cf-4fb5-4f3f-88de-57920625f1fd tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action" status: 202 len: 0 microversion: 2.1 time: 0.485460 Feb 19 20:52:19.794664 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 302/618] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:52:19 2022] POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:52:19.807942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6aafae2b-0d82-433d-ae45-f10fecfdd25f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Action: 'update', calling method: .version_select at 0x7f6474212d30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:19.813168 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:19.813168 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:19.952998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6aafae2b-0d82-433d-ae45-f10fecfdd25f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:19.954752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6aafae2b-0d82-433d-ae45-f10fecfdd25f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:19.957214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6aafae2b-0d82-433d-ae45-f10fecfdd25f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:19.957664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6aafae2b-0d82-433d-ae45-f10fecfdd25f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:19.969078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-3caec9b0-b4b6-4acc-897a-88f20a94ba34 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:52:20.031947 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3caec9b0-b4b6-4acc-897a-88f20a94ba34 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 2050 microversion: 2.25 time: 0.884856 Feb 19 20:52:20.049830 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 317/619] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:19 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 2050 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:20.071018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8699f8fc-c099-458f-a5ce-15978a91c224 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:20.072952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8699f8fc-c099-458f-a5ce-15978a91c224 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:20.098593 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6aafae2b-0d82-433d-ae45-f10fecfdd25f tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 200 len: 325 microversion: 2.1 time: 0.300290 Feb 19 20:52:20.103309 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 303/620] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:52:19 2022] PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:20.120041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8699f8fc-c099-458f-a5ce-15978a91c224 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:20.122438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8699f8fc-c099-458f-a5ce-15978a91c224 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:20.123371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ee7a6a67-37b9-4c61-960c-d103b3fbc8a7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:20.127657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ee7a6a67-37b9-4c61-960c-d103b3fbc8a7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:20.128318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8699f8fc-c099-458f-a5ce-15978a91c224 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:20.129005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8699f8fc-c099-458f-a5ce-15978a91c224 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:20.157919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee7a6a67-37b9-4c61-960c-d103b3fbc8a7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:20.159719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee7a6a67-37b9-4c61-960c-d103b3fbc8a7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:20.163912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee7a6a67-37b9-4c61-960c-d103b3fbc8a7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:20.165622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee7a6a67-37b9-4c61-960c-d103b3fbc8a7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:21.563109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8699f8fc-c099-458f-a5ce-15978a91c224 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:21.580688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ee7a6a67-37b9-4c61-960c-d103b3fbc8a7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:21.593390 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ee7a6a67-37b9-4c61-960c-d103b3fbc8a7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 1.486610 Feb 19 20:52:21.594286 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 304/621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:20 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:21.606144 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8699f8fc-c099-458f-a5ce-15978a91c224 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1312 microversion: 2.1 time: 1.555068 Feb 19 20:52:21.610124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-17644bdf-231b-44ac-a79d-ea96cfa8d030 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:21.613786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-17644bdf-231b-44ac-a79d-ea96cfa8d030 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:21.614709 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 318/622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:20 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1312 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:21.635211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17644bdf-231b-44ac-a79d-ea96cfa8d030 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:21.636964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17644bdf-231b-44ac-a79d-ea96cfa8d030 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:21.644318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17644bdf-231b-44ac-a79d-ea96cfa8d030 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:21.644952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17644bdf-231b-44ac-a79d-ea96cfa8d030 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:21.647608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d8376732-af96-427c-8bbb-d7d04f6e8808 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:21.660190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8376732-af96-427c-8bbb-d7d04f6e8808 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:21.695795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8376732-af96-427c-8bbb-d7d04f6e8808 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:21.705242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8376732-af96-427c-8bbb-d7d04f6e8808 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:21.711179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8376732-af96-427c-8bbb-d7d04f6e8808 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:21.716791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8376732-af96-427c-8bbb-d7d04f6e8808 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:23.269866 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-17644bdf-231b-44ac-a79d-ea96cfa8d030 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1614 microversion: 2.1 time: 1.673324 Feb 19 20:52:23.273700 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 305/623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:21 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1614 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:23.288300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1088493258", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:23.300406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-d8376732-af96-427c-8bbb-d7d04f6e8808 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:52:23.366315 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d8376732-af96-427c-8bbb-d7d04f6e8808 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 2050 microversion: 2.25 time: 1.736638 Feb 19 20:52:23.375026 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 319/624] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:21 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 2050 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:23.394279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:23.405838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d02c6d89-7399-48e7-aeed-60e11dec9f09 req-1c473cd3-4120-4155-8caf-8fd265cc0a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af34c3d-efca-4de5-94a6-7bdb97d068fd", "name": "network-vif-plugged", "status": "completed", "tag": "45bff999-b4bd-48a5-8654-55e37f10072d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:23.409240 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:23.409240 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:23.436268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d02c6d89-7399-48e7-aeed-60e11dec9f09 req-1c473cd3-4120-4155-8caf-8fd265cc0a5c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:23.437020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d02c6d89-7399-48e7-aeed-60e11dec9f09 req-1c473cd3-4120-4155-8caf-8fd265cc0a5c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:23.463190 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d02c6d89-7399-48e7-aeed-60e11dec9f09 req-1c473cd3-4120-4155-8caf-8fd265cc0a5c service nova] Creating event network-vif-plugged:45bff999-b4bd-48a5-8654-55e37f10072d for instance 5af34c3d-efca-4de5-94a6-7bdb97d068fd on nch1-master-1 Feb 19 20:52:23.472742 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d02c6d89-7399-48e7-aeed-60e11dec9f09 req-1c473cd3-4120-4155-8caf-8fd265cc0a5c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093595 Feb 19 20:52:23.473914 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 320/625] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:23.481005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a30de2bd-c9e1-4bf8-bfda-2f36b9fb0f37 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:23.482072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a30de2bd-c9e1-4bf8-bfda-2f36b9fb0f37 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:23.490595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a30de2bd-c9e1-4bf8-bfda-2f36b9fb0f37 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:23.492316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a30de2bd-c9e1-4bf8-bfda-2f36b9fb0f37 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:23.493837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a30de2bd-c9e1-4bf8-bfda-2f36b9fb0f37 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:23.495488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a30de2bd-c9e1-4bf8-bfda-2f36b9fb0f37 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:23.955827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:23.956307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:23.956991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:23.957788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:23.958412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:23.975942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:23.977913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:23.979058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:23.980621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:24.045549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Getting quotas for project 4e8808e5cb7f49c7b1f2022d423fee73. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:24.059817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Getting quotas for user bb5c1d90fa4f4e36ba82527497b2cbd7 and project 4e8808e5cb7f49c7b1f2022d423fee73. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:24.091113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.utils [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] ram quota exceeded for 4e8808e5cb7f49c7b1f2022d423fee73, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136095) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Feb 19 20:52:24.091828 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Feb 19 20:52:24.092613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:24.093680 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a6718048-967a-46fc-bc19-96a37fb73bf3 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.818829 Feb 19 20:52:24.094422 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 306/626] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:52:23 2022] POST /compute/v2.1/servers => generated 110 bytes in 820 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:24.099213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8bc8a49d-aa4d-4c5c-963e-bf28fa54fbeb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:24.100413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8bc8a49d-aa4d-4c5c-963e-bf28fa54fbeb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:24.107574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bc8a49d-aa4d-4c5c-963e-bf28fa54fbeb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:24.117848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bc8a49d-aa4d-4c5c-963e-bf28fa54fbeb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:24.118999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bc8a49d-aa4d-4c5c-963e-bf28fa54fbeb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:24.119605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bc8a49d-aa4d-4c5c-963e-bf28fa54fbeb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:24.596970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a30de2bd-c9e1-4bf8-bfda-2f36b9fb0f37 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:24.609589 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a30de2bd-c9e1-4bf8-bfda-2f36b9fb0f37 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 1.133704 Feb 19 20:52:24.618955 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 321/627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:23 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:24.628975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f3149a1-53f4-475b-9c77-6220e527dcc6 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:24.631117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f3149a1-53f4-475b-9c77-6220e527dcc6 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:24.649648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f3149a1-53f4-475b-9c77-6220e527dcc6 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:24.650479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f3149a1-53f4-475b-9c77-6220e527dcc6 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:24.653458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f3149a1-53f4-475b-9c77-6220e527dcc6 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:24.654164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f3149a1-53f4-475b-9c77-6220e527dcc6 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:24.897204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8bc8a49d-aa4d-4c5c-963e-bf28fa54fbeb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:24.908939 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8bc8a49d-aa4d-4c5c-963e-bf28fa54fbeb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1312 microversion: 2.1 time: 0.813053 Feb 19 20:52:24.912226 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 307/628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:24 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1312 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:24.929994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e522607b-94d9-4e28-8bda-6f0735b5a616 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:24.931733 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:24.931733 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:24.936483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e522607b-94d9-4e28-8bda-6f0735b5a616 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:24.939671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e522607b-94d9-4e28-8bda-6f0735b5a616 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:24.942228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e522607b-94d9-4e28-8bda-6f0735b5a616 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:24.942885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e522607b-94d9-4e28-8bda-6f0735b5a616 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:25.033524 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e522607b-94d9-4e28-8bda-6f0735b5a616 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.120001 Feb 19 20:52:25.041289 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 308/629] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Feb 19 20:52:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:52:25.055103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2750a96-683b-484b-bbae-a8479611d7e3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Action: 'update', calling method: .version_select at 0x7f6474117d30>, body: {"quota_set": {"ram": 51200}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:25.064090 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:25.064090 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:25.230912 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f3149a1-53f4-475b-9c77-6220e527dcc6 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1614 microversion: 2.1 time: 0.609908 Feb 19 20:52:25.233786 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 322/630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:24 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1614 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:25.248775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f0bcecff-56cd-40ac-be8b-c72fb8e9c172 req-7ef9d1d1-f40e-4a4c-9217-21d775d1e45b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e4abb8-c615-460f-bc5c-702410f99b8b", "tag": "fa1b9c05-479c-4d37-8deb-82dad67025e6"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:25.251829 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:25.251829 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:25.267952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f0bcecff-56cd-40ac-be8b-c72fb8e9c172 req-7ef9d1d1-f40e-4a4c-9217-21d775d1e45b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:25.268701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f0bcecff-56cd-40ac-be8b-c72fb8e9c172 req-7ef9d1d1-f40e-4a4c-9217-21d775d1e45b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:25.281750 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f0bcecff-56cd-40ac-be8b-c72fb8e9c172 req-7ef9d1d1-f40e-4a4c-9217-21d775d1e45b service nova] Creating event network-changed:fa1b9c05-479c-4d37-8deb-82dad67025e6 for instance 64e4abb8-c615-460f-bc5c-702410f99b8b on nch2-master-1 Feb 19 20:52:25.288954 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f0bcecff-56cd-40ac-be8b-c72fb8e9c172 req-7ef9d1d1-f40e-4a4c-9217-21d775d1e45b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052854 Feb 19 20:52:25.296168 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 323/631] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:25.302325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a27fcc14-f6f8-4d90-a7e1-b7095b134b7b tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:25.304104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a27fcc14-f6f8-4d90-a7e1-b7095b134b7b tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:25.312049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a27fcc14-f6f8-4d90-a7e1-b7095b134b7b tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:25.312827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a27fcc14-f6f8-4d90-a7e1-b7095b134b7b tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:25.313841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a27fcc14-f6f8-4d90-a7e1-b7095b134b7b tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:25.314492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a27fcc14-f6f8-4d90-a7e1-b7095b134b7b tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:25.450955 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a27fcc14-f6f8-4d90-a7e1-b7095b134b7b tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99/action" status: 202 len: 0 microversion: 2.25 time: 0.152674 Feb 19 20:52:25.454634 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 324/632] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 20:52:25 2022] POST /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:52:25.465004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-15bd38d6-b4dd-423d-a793-6e67336820fe tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:25.475982 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:25.475982 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:25.477788 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:25.477788 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:25.479871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-15bd38d6-b4dd-423d-a793-6e67336820fe tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:52:25.496933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15bd38d6-b4dd-423d-a793-6e67336820fe tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:25.499619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15bd38d6-b4dd-423d-a793-6e67336820fe tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:25.500613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15bd38d6-b4dd-423d-a793-6e67336820fe tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:25.504009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15bd38d6-b4dd-423d-a793-6e67336820fe tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:25.671992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-15bd38d6-b4dd-423d-a793-6e67336820fe tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:52:25.811137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2750a96-683b-484b-bbae-a8479611d7e3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:25.811588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2750a96-683b-484b-bbae-a8479611d7e3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:25.812431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2750a96-683b-484b-bbae-a8479611d7e3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:25.812872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2750a96-683b-484b-bbae-a8479611d7e3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:26.012871 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c2750a96-683b-484b-bbae-a8479611d7e3 tempest-QuotasAdminNegativeTest-1129861331 tempest-QuotasAdminNegativeTest-1129861331-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 200 len: 329 microversion: 2.1 time: 0.969911 Feb 19 20:52:26.017717 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 309/633] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:52:25 2022] PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 329 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:26.030797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a75632b-e47e-44ff-ba8c-5c2740f9e352 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:26.031429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3a75632b-e47e-44ff-ba8c-5c2740f9e352 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:26.058449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a75632b-e47e-44ff-ba8c-5c2740f9e352 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:26.059707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a75632b-e47e-44ff-ba8c-5c2740f9e352 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:26.063266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a75632b-e47e-44ff-ba8c-5c2740f9e352 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:26.063909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a75632b-e47e-44ff-ba8c-5c2740f9e352 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:26.277034 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-15bd38d6-b4dd-423d-a793-6e67336820fe tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1321 microversion: 2.1 time: 0.820926 Feb 19 20:52:26.277659 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 325/634] 10.222.0.30 () {58 vars in 1189 bytes} [Sat Feb 19 20:52:25 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1321 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:26.301351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-874ec743-b52f-4b8e-857a-43b9ce3b1f52 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:26.302467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-874ec743-b52f-4b8e-857a-43b9ce3b1f52 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:26.318431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-874ec743-b52f-4b8e-857a-43b9ce3b1f52 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:26.321454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-874ec743-b52f-4b8e-857a-43b9ce3b1f52 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:26.322294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-874ec743-b52f-4b8e-857a-43b9ce3b1f52 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:26.322732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-874ec743-b52f-4b8e-857a-43b9ce3b1f52 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:26.543419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-3a75632b-e47e-44ff-ba8c-5c2740f9e352 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:52:26.573242 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3a75632b-e47e-44ff-ba8c-5c2740f9e352 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 2035 microversion: 2.25 time: 0.554231 Feb 19 20:52:26.577074 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 310/635] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:26 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 2035 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:26.592131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-12e2b99c-de0f-431a-8c9a-cf07c4943e8d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:26.593151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-12e2b99c-de0f-431a-8c9a-cf07c4943e8d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:26.604487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12e2b99c-de0f-431a-8c9a-cf07c4943e8d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:26.605509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12e2b99c-de0f-431a-8c9a-cf07c4943e8d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:26.606600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12e2b99c-de0f-431a-8c9a-cf07c4943e8d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:26.610529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12e2b99c-de0f-431a-8c9a-cf07c4943e8d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:26.859723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-874ec743-b52f-4b8e-857a-43b9ce3b1f52 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:26.868059 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-874ec743-b52f-4b8e-857a-43b9ce3b1f52 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 0.589395 Feb 19 20:52:26.872222 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 326/636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:26 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:26.878216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d4c7c3fc-4908-44de-9b64-9b664b0ea869 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Action: 'update', calling method: .version_select at 0x7f6474396ca0>, body: {"quota_set": {"ram": 0}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:26.892953 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:26.892953 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:26.894361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d4c7c3fc-4908-44de-9b64-9b664b0ea869 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'bb5c1d90fa4f4e36ba82527497b2cbd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8808e5cb7f49c7b1f2022d423fee73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:26.895571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d4c7c3fc-4908-44de-9b64-9b664b0ea869 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:26.897215 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d4c7c3fc-4908-44de-9b64-9b664b0ea869 tempest-QuotasAdminNegativeTest-242312167 tempest-QuotasAdminNegativeTest-242312167-project] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73" status: 403 len: 116 microversion: 2.1 time: 0.023422 Feb 19 20:52:26.905374 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 327/637] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:52:26 2022] PUT /compute/v2.1/os-quota-sets/4e8808e5cb7f49c7b1f2022d423fee73 => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:52:26.922853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d70dbbce-cbc9-4c2c-9d15-bf796b4e7565 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:26.926853 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:26.926853 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:26.933184 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:26.933184 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:26.934778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d70dbbce-cbc9-4c2c-9d15-bf796b4e7565 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:52:26.949724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d70dbbce-cbc9-4c2c-9d15-bf796b4e7565 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:26.954544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d70dbbce-cbc9-4c2c-9d15-bf796b4e7565 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:26.955689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d70dbbce-cbc9-4c2c-9d15-bf796b4e7565 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:26.956361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d70dbbce-cbc9-4c2c-9d15-bf796b4e7565 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:27.001961 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d70dbbce-cbc9-4c2c-9d15-bf796b4e7565 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.092884 Feb 19 20:52:27.005195 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 328/638] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Feb 19 20:52:26 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:52:27.019374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-12e2b99c-de0f-431a-8c9a-cf07c4943e8d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:27.030777 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-12e2b99c-de0f-431a-8c9a-cf07c4943e8d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1461 microversion: 2.1 time: 0.452419 Feb 19 20:52:27.033837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b69d459-afcf-49a0-9085-9ce506e6241a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:27.040961 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 311/639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:26 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1461 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:27.044047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b69d459-afcf-49a0-9085-9ce506e6241a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:27.062173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b69d459-afcf-49a0-9085-9ce506e6241a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:27.063016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b69d459-afcf-49a0-9085-9ce506e6241a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:27.064113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b69d459-afcf-49a0-9085-9ce506e6241a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:27.064899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b69d459-afcf-49a0-9085-9ce506e6241a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:27.138443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-4b69d459-afcf-49a0-9085-9ce506e6241a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'flavor' on Instance uuid 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:52:27.185885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b69d459-afcf-49a0-9085-9ce506e6241a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Going to try to live migrate instance to nch1-master-1 {{(pid=136094) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 20:52:27.324493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2065869147", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:27.459207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:28.237832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:28.238965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:28.239633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:28.241368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:28.241975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:28.315204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:28.316898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:28.322059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:28.331186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:28.389138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Getting quotas for project 81e756cebb9c45ddb687ea373d7ddaa3. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:28.400045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Getting quotas for user 05654d818a474f378f6cc02850b57e1b and project 81e756cebb9c45ddb687ea373d7ddaa3. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:28.437670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:52:28.441050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:52:28.531000 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-569221f5-eb4d-4f84-b3ac-9c89fca8773d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.488278 Feb 19 20:52:28.534595 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 312/640] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:52:28.547149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c86719bc-6132-415c-93d9-85e598642dd9 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:28.548962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c86719bc-6132-415c-93d9-85e598642dd9 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:28.559033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c86719bc-6132-415c-93d9-85e598642dd9 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:28.559656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c86719bc-6132-415c-93d9-85e598642dd9 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:28.561468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c86719bc-6132-415c-93d9-85e598642dd9 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:28.562219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c86719bc-6132-415c-93d9-85e598642dd9 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:28.719444 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c86719bc-6132-415c-93d9-85e598642dd9 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action" status: 202 len: 0 microversion: 2.1 time: 0.176863 Feb 19 20:52:28.731888 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 313/641] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:52:28 2022] POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:52:28.738108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:28.739465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:28.748576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:28.749459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:28.751285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:28.752585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:29.001623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:29.011140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Old instance type m1.heat2, new instance type m1.heat {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 20:52:29.064687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:29.065171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:29.065657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:29.066076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:29.071215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:29.692890 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-50e4bcd4-a663-4859-a31c-f8185b6d5897 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd/action" status: 202 len: 0 microversion: 2.1 time: 0.959316 Feb 19 20:52:29.699175 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 314/642] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:52:28 2022] POST /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:52:29.726622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b15eab0f-b890-4f6d-b90f-3a2e95578474 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:29.727397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b15eab0f-b890-4f6d-b90f-3a2e95578474 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:29.769171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b15eab0f-b890-4f6d-b90f-3a2e95578474 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:29.769645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b15eab0f-b890-4f6d-b90f-3a2e95578474 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:29.779114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b15eab0f-b890-4f6d-b90f-3a2e95578474 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:29.783031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b15eab0f-b890-4f6d-b90f-3a2e95578474 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:30.406028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b15eab0f-b890-4f6d-b90f-3a2e95578474 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:30.414524 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b15eab0f-b890-4f6d-b90f-3a2e95578474 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 0.714434 Feb 19 20:52:30.415118 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 315/643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:29 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:30.426429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f4177a05-2764-4962-a59e-366b39c186f0 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:30.429596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f4177a05-2764-4962-a59e-366b39c186f0 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:30.451902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4177a05-2764-4962-a59e-366b39c186f0 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:30.455718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4177a05-2764-4962-a59e-366b39c186f0 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:30.457011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4177a05-2764-4962-a59e-366b39c186f0 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:30.459364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4177a05-2764-4962-a59e-366b39c186f0 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:30.785032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f4177a05-2764-4962-a59e-366b39c186f0 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:30.796926 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f4177a05-2764-4962-a59e-366b39c186f0 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1271 microversion: 2.1 time: 0.380044 Feb 19 20:52:30.803001 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 316/644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:30 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1271 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:30.822586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f75529b9-2911-475e-b974-4af06053c17c"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:30.824152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:30.850269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:30.850742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:30.851558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:30.856687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:31.167055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:31.167920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:31.174925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:31.176799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:31.179804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:31.349020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:31.363094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:31.363983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:31.365752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:31.366654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:31.418262 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d8c18174-99b7-4d3e-9cfd-2c7ec9a63e48 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action" status: 202 len: 1067 microversion: 2.1 time: 0.613731 Feb 19 20:52:31.419616 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 317/645] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:52:30 2022] POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action => generated 1067 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 19 20:52:31.434577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-db2d8194-6f7c-4090-9155-f8efd89a9a5f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:31.435763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-db2d8194-6f7c-4090-9155-f8efd89a9a5f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:31.457506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-db2d8194-6f7c-4090-9155-f8efd89a9a5f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:31.458128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-db2d8194-6f7c-4090-9155-f8efd89a9a5f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:31.459883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-db2d8194-6f7c-4090-9155-f8efd89a9a5f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:31.460665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-db2d8194-6f7c-4090-9155-f8efd89a9a5f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:32.179107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-db2d8194-6f7c-4090-9155-f8efd89a9a5f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:32.188050 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-db2d8194-6f7c-4090-9155-f8efd89a9a5f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1470 microversion: 2.1 time: 0.767234 Feb 19 20:52:32.192470 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 318/646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:31 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1470 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:32.231112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5c72f0c1-b4c7-4617-ab10-ac1795e6d014 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:32.233087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5c72f0c1-b4c7-4617-ab10-ac1795e6d014 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:32.258788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c72f0c1-b4c7-4617-ab10-ac1795e6d014 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:32.263347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c72f0c1-b4c7-4617-ab10-ac1795e6d014 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:32.266480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c72f0c1-b4c7-4617-ab10-ac1795e6d014 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:32.267438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c72f0c1-b4c7-4617-ab10-ac1795e6d014 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:33.120946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5c72f0c1-b4c7-4617-ab10-ac1795e6d014 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:33.131903 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b69d459-afcf-49a0-9085-9ce506e6241a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99/action" status: 202 len: 0 microversion: 2.25 time: 6.118657 Feb 19 20:52:33.131903 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 329/647] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 20:52:27 2022] POST /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99/action => generated 0 bytes in 6120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:52:33.135972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d75cc627-ca1f-4935-bafc-389baecb2a81 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:33.136975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d75cc627-ca1f-4935-bafc-389baecb2a81 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:33.142275 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5c72f0c1-b4c7-4617-ab10-ac1795e6d014 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 0.946341 Feb 19 20:52:33.145044 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 319/648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:32 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:33.151684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b2f89f79-fc04-4a80-94e5-34724742fa1e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:33.152289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b2f89f79-fc04-4a80-94e5-34724742fa1e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:33.160668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2f89f79-fc04-4a80-94e5-34724742fa1e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:33.163821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d75cc627-ca1f-4935-bafc-389baecb2a81 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:33.165344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d75cc627-ca1f-4935-bafc-389baecb2a81 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:33.167552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d75cc627-ca1f-4935-bafc-389baecb2a81 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:33.169325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d75cc627-ca1f-4935-bafc-389baecb2a81 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:33.201889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2f89f79-fc04-4a80-94e5-34724742fa1e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:33.204954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2f89f79-fc04-4a80-94e5-34724742fa1e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:33.205439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2f89f79-fc04-4a80-94e5-34724742fa1e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:33.318382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b2f89f79-fc04-4a80-94e5-34724742fa1e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:33.327227 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b2f89f79-fc04-4a80-94e5-34724742fa1e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1277 microversion: 2.1 time: 0.179776 Feb 19 20:52:33.330854 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 320/649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:33 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:33.357966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:33.360924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:33.369480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:33.370052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:33.370971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:33.371616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:33.754551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d75cc627-ca1f-4935-bafc-389baecb2a81 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:33.762678 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d75cc627-ca1f-4935-bafc-389baecb2a81 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1471 microversion: 2.1 time: 0.630144 Feb 19 20:52:33.764112 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 330/650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:33 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1471 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:33.778664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-61bce242-786b-4c54-956e-c13505abb2dc tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:33.780310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-61bce242-786b-4c54-956e-c13505abb2dc tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:33.797383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61bce242-786b-4c54-956e-c13505abb2dc tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:33.798121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61bce242-786b-4c54-956e-c13505abb2dc tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:33.798965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61bce242-786b-4c54-956e-c13505abb2dc tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:33.799404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61bce242-786b-4c54-956e-c13505abb2dc tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:33.818728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:33.834908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:33.838781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:33.841953 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-38ee8d2a-9059-484c-adf6-6c991772ebf5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1568 microversion: 2.25 time: 0.506756 Feb 19 20:52:33.844644 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 321/651] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:33 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1568 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:34.136422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-61bce242-786b-4c54-956e-c13505abb2dc tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:34.144391 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-61bce242-786b-4c54-956e-c13505abb2dc tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1470 microversion: 2.1 time: 0.375710 Feb 19 20:52:34.145206 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 331/652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:33 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:34.166763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1f74a247-5699-44f2-b49d-36392a218dc4 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:34.167043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1f74a247-5699-44f2-b49d-36392a218dc4 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:34.174474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f74a247-5699-44f2-b49d-36392a218dc4 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:34.174956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f74a247-5699-44f2-b49d-36392a218dc4 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:34.175854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f74a247-5699-44f2-b49d-36392a218dc4 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:34.176292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f74a247-5699-44f2-b49d-36392a218dc4 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:34.350567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a4942aae-6dbd-497f-81b2-959ccbe96587 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:34.351200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a4942aae-6dbd-497f-81b2-959ccbe96587 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:34.372832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4942aae-6dbd-497f-81b2-959ccbe96587 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:34.373379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4942aae-6dbd-497f-81b2-959ccbe96587 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:34.378404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4942aae-6dbd-497f-81b2-959ccbe96587 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:34.378860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4942aae-6dbd-497f-81b2-959ccbe96587 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:35.026805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f74a247-5699-44f2-b49d-36392a218dc4 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:35.038692 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1f74a247-5699-44f2-b49d-36392a218dc4 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 0.876783 Feb 19 20:52:35.048695 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 322/653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:34 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:35.054723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0b88e938-5e5b-421f-b21b-4cc6ddf71182 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:35.055344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0b88e938-5e5b-421f-b21b-4cc6ddf71182 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:35.064021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b88e938-5e5b-421f-b21b-4cc6ddf71182 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:35.064940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b88e938-5e5b-421f-b21b-4cc6ddf71182 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:35.067103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b88e938-5e5b-421f-b21b-4cc6ddf71182 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:35.068230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b88e938-5e5b-421f-b21b-4cc6ddf71182 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:35.173109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a4942aae-6dbd-497f-81b2-959ccbe96587 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:35.181315 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a4942aae-6dbd-497f-81b2-959ccbe96587 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1319 microversion: 2.1 time: 0.837959 Feb 19 20:52:35.181892 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 332/654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:34 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1319 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:35.191789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:35.204500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:35.211255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:35.211703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:35.214933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:35.215380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:35.690358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0b88e938-5e5b-421f-b21b-4cc6ddf71182 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:35.707720 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0b88e938-5e5b-421f-b21b-4cc6ddf71182 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1471 microversion: 2.1 time: 0.657859 Feb 19 20:52:35.710163 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 323/655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:35 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1471 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:35.717148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c181667f-7690-42b9-b7ff-7e6661d51e32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:35.718027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c181667f-7690-42b9-b7ff-7e6661d51e32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:35.731620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c181667f-7690-42b9-b7ff-7e6661d51e32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:35.732475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c181667f-7690-42b9-b7ff-7e6661d51e32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:35.734004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c181667f-7690-42b9-b7ff-7e6661d51e32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:35.737125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c181667f-7690-42b9-b7ff-7e6661d51e32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:35.790298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:35.803856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:35.808366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:35.813038 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cf581c81-f897-435b-864b-969c36e2452b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1568 microversion: 2.25 time: 0.630178 Feb 19 20:52:35.815358 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 333/656] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:35 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1568 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:36.056477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-368702b3-710c-418c-9f10-0e6b6a73eed6 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:36.057020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-368702b3-710c-418c-9f10-0e6b6a73eed6 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:36.070082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-368702b3-710c-418c-9f10-0e6b6a73eed6 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:36.071239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-368702b3-710c-418c-9f10-0e6b6a73eed6 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:36.072700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-368702b3-710c-418c-9f10-0e6b6a73eed6 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:36.074387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-368702b3-710c-418c-9f10-0e6b6a73eed6 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:36.866014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c181667f-7690-42b9-b7ff-7e6661d51e32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:36.876176 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c181667f-7690-42b9-b7ff-7e6661d51e32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1470 microversion: 2.1 time: 1.163621 Feb 19 20:52:36.881496 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 324/657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:35 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1470 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:36.897797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-253951a4-6eb9-4372-aafd-81e3112be413 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:36.906158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-253951a4-6eb9-4372-aafd-81e3112be413 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:36.922679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-253951a4-6eb9-4372-aafd-81e3112be413 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:36.923487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-253951a4-6eb9-4372-aafd-81e3112be413 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:36.925746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-253951a4-6eb9-4372-aafd-81e3112be413 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:36.933122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-253951a4-6eb9-4372-aafd-81e3112be413 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:37.135007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-368702b3-710c-418c-9f10-0e6b6a73eed6 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:37.147019 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-368702b3-710c-418c-9f10-0e6b6a73eed6 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 1.095710 Feb 19 20:52:37.149563 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 334/658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:36 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:37.165871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d60312cd-0d0d-4513-a0f9-9ebca624e866 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:37.169431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d60312cd-0d0d-4513-a0f9-9ebca624e866 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:37.192126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d60312cd-0d0d-4513-a0f9-9ebca624e866 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:37.194476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d60312cd-0d0d-4513-a0f9-9ebca624e866 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:37.196200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d60312cd-0d0d-4513-a0f9-9ebca624e866 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:37.200845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d60312cd-0d0d-4513-a0f9-9ebca624e866 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:37.315456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-253951a4-6eb9-4372-aafd-81e3112be413 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:37.335544 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-253951a4-6eb9-4372-aafd-81e3112be413 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1319 microversion: 2.1 time: 0.449542 Feb 19 20:52:37.339812 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 325/659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:36 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:37.344605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:37.350879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:37.376787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:37.377546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:37.379161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:37.379783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:37.858627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d60312cd-0d0d-4513-a0f9-9ebca624e866 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:37.872666 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d60312cd-0d0d-4513-a0f9-9ebca624e866 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1471 microversion: 2.1 time: 0.718518 Feb 19 20:52:37.875259 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 335/660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:37 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1471 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:37.927033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ae4065f7-3c68-452c-805d-d03aeda9068b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:37.934955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae4065f7-3c68-452c-805d-d03aeda9068b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:37.972010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:37.981145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:37.982038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae4065f7-3c68-452c-805d-d03aeda9068b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:37.983046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae4065f7-3c68-452c-805d-d03aeda9068b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:37.986936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae4065f7-3c68-452c-805d-d03aeda9068b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:37.990909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae4065f7-3c68-452c-805d-d03aeda9068b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:37.993486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:37.994897 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8debd0ff-ea2f-4011-99d9-33ff6963d12e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1568 microversion: 2.25 time: 0.653890 Feb 19 20:52:37.995958 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 326/661] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:37 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1568 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:38.008561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5f6a12cc-c8e6-48d6-a1aa-be12c7b0a9d1 req-8a005bcf-eba7-4b39-bcb5-d9b770be0484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a832621d-69be-4201-acf6-2f3ca91a42ed", "tag": "48461d06-c79b-4c2b-8608-01b6aa1c3b24"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:38.010313 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:38.010313 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:38.026806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5f6a12cc-c8e6-48d6-a1aa-be12c7b0a9d1 req-8a005bcf-eba7-4b39-bcb5-d9b770be0484 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:38.027679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5f6a12cc-c8e6-48d6-a1aa-be12c7b0a9d1 req-8a005bcf-eba7-4b39-bcb5-d9b770be0484 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:38.053556 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5f6a12cc-c8e6-48d6-a1aa-be12c7b0a9d1 req-8a005bcf-eba7-4b39-bcb5-d9b770be0484 service nova] Creating event network-changed:48461d06-c79b-4c2b-8608-01b6aa1c3b24 for instance a832621d-69be-4201-acf6-2f3ca91a42ed on nch1-master-1 Feb 19 20:52:38.080463 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5f6a12cc-c8e6-48d6-a1aa-be12c7b0a9d1 req-8a005bcf-eba7-4b39-bcb5-d9b770be0484 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082968 Feb 19 20:52:38.081843 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 327/662] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:38.166021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-792cb331-ca43-493b-9127-01b1dc4eaea3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:38.166744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-792cb331-ca43-493b-9127-01b1dc4eaea3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:38.179311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-792cb331-ca43-493b-9127-01b1dc4eaea3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:38.179780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-792cb331-ca43-493b-9127-01b1dc4eaea3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:38.180645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-792cb331-ca43-493b-9127-01b1dc4eaea3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:38.181090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-792cb331-ca43-493b-9127-01b1dc4eaea3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:38.571843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ae4065f7-3c68-452c-805d-d03aeda9068b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:38.584542 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ae4065f7-3c68-452c-805d-d03aeda9068b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.690063 Feb 19 20:52:38.596383 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 336/663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:37 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:38.608218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c8db3c3-f990-448f-8c4b-54e04df1c169 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:38.621203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1c8db3c3-f990-448f-8c4b-54e04df1c169 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:38.636893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c8db3c3-f990-448f-8c4b-54e04df1c169 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:38.637637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c8db3c3-f990-448f-8c4b-54e04df1c169 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:38.640240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c8db3c3-f990-448f-8c4b-54e04df1c169 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:38.640795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c8db3c3-f990-448f-8c4b-54e04df1c169 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:38.685899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-792cb331-ca43-493b-9127-01b1dc4eaea3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:38.700948 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-792cb331-ca43-493b-9127-01b1dc4eaea3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 0.532246 Feb 19 20:52:38.704091 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 328/664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:38 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:38.894562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-39d1fb64-053b-4e91-af56-52c5aab0ddb9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:38.895188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-39d1fb64-053b-4e91-af56-52c5aab0ddb9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:38.901854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39d1fb64-053b-4e91-af56-52c5aab0ddb9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:38.902627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39d1fb64-053b-4e91-af56-52c5aab0ddb9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:38.903865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39d1fb64-053b-4e91-af56-52c5aab0ddb9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:38.904722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39d1fb64-053b-4e91-af56-52c5aab0ddb9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:39.329025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c8db3c3-f990-448f-8c4b-54e04df1c169 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:39.338180 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c8db3c3-f990-448f-8c4b-54e04df1c169 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1319 microversion: 2.1 time: 0.739459 Feb 19 20:52:39.353478 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 337/665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:38 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1319 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:39.361905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:39.368857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:39.383405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:39.384154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:39.387745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:39.388407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:39.840540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-39d1fb64-053b-4e91-af56-52c5aab0ddb9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:39.850092 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-39d1fb64-053b-4e91-af56-52c5aab0ddb9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1471 microversion: 2.1 time: 0.960600 Feb 19 20:52:39.854397 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 329/666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:38 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1471 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:39.862749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0337c33e-4750-497a-a5fb-e6b0f33759e4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:39.864210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0337c33e-4750-497a-a5fb-e6b0f33759e4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:39.893085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0337c33e-4750-497a-a5fb-e6b0f33759e4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:39.894252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0337c33e-4750-497a-a5fb-e6b0f33759e4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:39.895502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0337c33e-4750-497a-a5fb-e6b0f33759e4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:39.896500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0337c33e-4750-497a-a5fb-e6b0f33759e4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:40.495568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:40.507300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:40.510345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:40.513652 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-280137a4-01d8-4716-b365-27417753686e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1568 microversion: 2.25 time: 1.158792 Feb 19 20:52:40.517316 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 338/667] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:39 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1568 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:40.533566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f2b91c92-1c7a-4ad5-b650-875137fe311b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:40.534465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f2b91c92-1c7a-4ad5-b650-875137fe311b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:40.549214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2b91c92-1c7a-4ad5-b650-875137fe311b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:40.549982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2b91c92-1c7a-4ad5-b650-875137fe311b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:40.553511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2b91c92-1c7a-4ad5-b650-875137fe311b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:40.558400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2b91c92-1c7a-4ad5-b650-875137fe311b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:40.929168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0337c33e-4750-497a-a5fb-e6b0f33759e4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:40.939825 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0337c33e-4750-497a-a5fb-e6b0f33759e4 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 1.083004 Feb 19 20:52:40.944595 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 330/668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:39 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:40.954472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c5425e6f-fc17-4be4-9ec9-d322342bf01c req-a682e50e-1177-4668-b2a0-61655e8a661f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470c141a-60d6-46e9-bd5f-08ce9c6a7f99", "name": "network-vif-unplugged", "status": "completed", "tag": "8fa16ec0-665d-486a-8609-c23482d79a71"}, {"name": "network-changed", "server_uuid": "470c141a-60d6-46e9-bd5f-08ce9c6a7f99", "tag": "8fa16ec0-665d-486a-8609-c23482d79a71"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:40.956786 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:40.956786 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:40.979107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c5425e6f-fc17-4be4-9ec9-d322342bf01c req-a682e50e-1177-4668-b2a0-61655e8a661f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:40.979795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c5425e6f-fc17-4be4-9ec9-d322342bf01c req-a682e50e-1177-4668-b2a0-61655e8a661f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:41.002916 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c5425e6f-fc17-4be4-9ec9-d322342bf01c req-a682e50e-1177-4668-b2a0-61655e8a661f service nova] Creating event network-vif-unplugged:8fa16ec0-665d-486a-8609-c23482d79a71 for instance 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 on nch2-master-1 Feb 19 20:52:41.003780 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c5425e6f-fc17-4be4-9ec9-d322342bf01c req-a682e50e-1177-4668-b2a0-61655e8a661f service nova] Creating event network-changed:8fa16ec0-665d-486a-8609-c23482d79a71 for instance 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 on nch2-master-1 Feb 19 20:52:41.009855 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c5425e6f-fc17-4be4-9ec9-d322342bf01c req-a682e50e-1177-4668-b2a0-61655e8a661f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.063844 Feb 19 20:52:41.016724 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 331/669] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:41.022698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45641e9b-0b52-4f06-aa4e-881b16b56441 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:41.037220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-45641e9b-0b52-4f06-aa4e-881b16b56441 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:41.055430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45641e9b-0b52-4f06-aa4e-881b16b56441 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:41.056376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45641e9b-0b52-4f06-aa4e-881b16b56441 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:41.057467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45641e9b-0b52-4f06-aa4e-881b16b56441 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:41.061076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45641e9b-0b52-4f06-aa4e-881b16b56441 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:41.679236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f2b91c92-1c7a-4ad5-b650-875137fe311b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:41.687112 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f2b91c92-1c7a-4ad5-b650-875137fe311b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 1.167219 Feb 19 20:52:41.687704 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 339/670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:40 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:41.708479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-467954fe-b724-45ae-ad20-8aab31df1ee9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:41.709352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-467954fe-b724-45ae-ad20-8aab31df1ee9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:41.728095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-467954fe-b724-45ae-ad20-8aab31df1ee9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:41.731636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-467954fe-b724-45ae-ad20-8aab31df1ee9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:41.734591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-467954fe-b724-45ae-ad20-8aab31df1ee9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:41.735471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-467954fe-b724-45ae-ad20-8aab31df1ee9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:42.207885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-45641e9b-0b52-4f06-aa4e-881b16b56441 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:42.219448 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45641e9b-0b52-4f06-aa4e-881b16b56441 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1319 microversion: 2.1 time: 1.199256 Feb 19 20:52:42.223101 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 332/671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:41 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1319 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:42.232103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:42.236659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:42.254591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:42.257559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:42.258888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:42.261606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:42.651212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-467954fe-b724-45ae-ad20-8aab31df1ee9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:42.664747 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-467954fe-b724-45ae-ad20-8aab31df1ee9 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1471 microversion: 2.1 time: 0.971728 Feb 19 20:52:42.675219 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 340/672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:41 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1471 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:42.675219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-31dac5a0-b561-4ebf-a62f-f3c1c1349c54 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:42.683633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-31dac5a0-b561-4ebf-a62f-f3c1c1349c54 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:42.697843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31dac5a0-b561-4ebf-a62f-f3c1c1349c54 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:42.698310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31dac5a0-b561-4ebf-a62f-f3c1c1349c54 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:42.700694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31dac5a0-b561-4ebf-a62f-f3c1c1349c54 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:42.701161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31dac5a0-b561-4ebf-a62f-f3c1c1349c54 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:42.970781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:42.985658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:42.988062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:42.989379 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-da3124fa-6b83-4a61-bbc0-6e04ad9df8f4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1568 microversion: 2.25 time: 0.765221 Feb 19 20:52:42.990412 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 333/673] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:42 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1568 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:43.047418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-31dac5a0-b561-4ebf-a62f-f3c1c1349c54 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:43.056353 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-31dac5a0-b561-4ebf-a62f-f3c1c1349c54 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.386564 Feb 19 20:52:43.056939 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 341/674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:42 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:43.072585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c8334cbe-3b07-4e1a-b052-240775fd49f0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:43.073251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c8334cbe-3b07-4e1a-b052-240775fd49f0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:43.084858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8334cbe-3b07-4e1a-b052-240775fd49f0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:43.085325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8334cbe-3b07-4e1a-b052-240775fd49f0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:43.087210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8334cbe-3b07-4e1a-b052-240775fd49f0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:43.087665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8334cbe-3b07-4e1a-b052-240775fd49f0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:43.202428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-987398744", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "b5f73a2d-e0db-4f8e-b90f-72b9e4b05653"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:43.282090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c8334cbe-3b07-4e1a-b052-240775fd49f0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:43.299821 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c8334cbe-3b07-4e1a-b052-240775fd49f0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 0.234200 Feb 19 20:52:43.300810 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 342/675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:43 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:43.307104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-50ccf6e9-a41d-430b-9376-c059cc8228e8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:43.307723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-50ccf6e9-a41d-430b-9376-c059cc8228e8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:43.308740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] validate_networks() for [('b5f73a2d-e0db-4f8e-b90f-72b9e4b05653', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:43.323307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50ccf6e9-a41d-430b-9376-c059cc8228e8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:43.324575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50ccf6e9-a41d-430b-9376-c059cc8228e8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:43.326108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50ccf6e9-a41d-430b-9376-c059cc8228e8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:43.327258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50ccf6e9-a41d-430b-9376-c059cc8228e8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:43.697056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-50ccf6e9-a41d-430b-9376-c059cc8228e8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:43.708549 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-50ccf6e9-a41d-430b-9376-c059cc8228e8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1319 microversion: 2.1 time: 0.406176 Feb 19 20:52:43.710984 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 343/676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:43 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:43.721571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ac9cb127-a50e-4d3c-a7ae-3d39350ce638 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:43.722523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ac9cb127-a50e-4d3c-a7ae-3d39350ce638 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:43.736387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac9cb127-a50e-4d3c-a7ae-3d39350ce638 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:43.737109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac9cb127-a50e-4d3c-a7ae-3d39350ce638 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:43.737935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac9cb127-a50e-4d3c-a7ae-3d39350ce638 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:43.738473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac9cb127-a50e-4d3c-a7ae-3d39350ce638 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:43.876290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:43.876858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:43.877718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:43.878503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:43.879104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:43.910716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:43.911635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:43.912647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:43.913421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:43.929128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ac9cb127-a50e-4d3c-a7ae-3d39350ce638 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:43.936896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Getting quotas for project 869a0cf6b5604ec89af633eb5012ff5b. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:43.939313 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ac9cb127-a50e-4d3c-a7ae-3d39350ce638 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1471 microversion: 2.1 time: 0.227120 Feb 19 20:52:43.941718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Getting quotas for user d0a4a7cd3a234092987f7fb637c91e38 and project 869a0cf6b5604ec89af633eb5012ff5b. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:43.943241 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 344/677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:43 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:43.967510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:52:43.970305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:52:44.009929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:44.010709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:44.017699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.018478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:44.020009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.022131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:44.025727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0f683415-5041-456c-acf0-00e20077d0ce tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034195 Feb 19 20:52:44.026937 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 334/678] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:52:44.039140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ea3540c6-90f3-4b1d-a690-d9577643e864 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:44.040683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ea3540c6-90f3-4b1d-a690-d9577643e864 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:44.137237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ea3540c6-90f3-4b1d-a690-d9577643e864 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:44.145105 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ea3540c6-90f3-4b1d-a690-d9577643e864 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1223 microversion: 2.1 time: 0.112204 Feb 19 20:52:44.156013 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 335/679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:44 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:44.164762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-753bacb8-71b7-4dc6-b0a1-0ad45dd305e0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:44.169847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-753bacb8-71b7-4dc6-b0a1-0ad45dd305e0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:44.183849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-753bacb8-71b7-4dc6-b0a1-0ad45dd305e0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.184434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-753bacb8-71b7-4dc6-b0a1-0ad45dd305e0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:44.189579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-753bacb8-71b7-4dc6-b0a1-0ad45dd305e0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.190309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-753bacb8-71b7-4dc6-b0a1-0ad45dd305e0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:44.267834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:44.280109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:44.285068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:44.286275 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-678216eb-9abb-4fdd-a493-9aa9bb0c4bfe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1568 microversion: 2.25 time: 0.282007 Feb 19 20:52:44.291033 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 345/680] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:44 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:44.316859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d328c0af-b65b-41d8-a5a1-20966e4e35d3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:44.318499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d328c0af-b65b-41d8-a5a1-20966e4e35d3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:44.325000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d328c0af-b65b-41d8-a5a1-20966e4e35d3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.325679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d328c0af-b65b-41d8-a5a1-20966e4e35d3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:44.326654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d328c0af-b65b-41d8-a5a1-20966e4e35d3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.327344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d328c0af-b65b-41d8-a5a1-20966e4e35d3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:44.551823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-753bacb8-71b7-4dc6-b0a1-0ad45dd305e0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:44.563526 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-753bacb8-71b7-4dc6-b0a1-0ad45dd305e0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.405162 Feb 19 20:52:44.564857 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 336/681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:44 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:44.712624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d328c0af-b65b-41d8-a5a1-20966e4e35d3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:44.724586 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d328c0af-b65b-41d8-a5a1-20966e4e35d3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 0.407216 Feb 19 20:52:44.725229 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 346/682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:44 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:44.737207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fddc362a-2b9f-4ee9-8541-b9ffb545de2b tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:44.745213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fddc362a-2b9f-4ee9-8541-b9ffb545de2b tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:44.757027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fddc362a-2b9f-4ee9-8541-b9ffb545de2b tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.758741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fddc362a-2b9f-4ee9-8541-b9ffb545de2b tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:44.761483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fddc362a-2b9f-4ee9-8541-b9ffb545de2b tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.762076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fddc362a-2b9f-4ee9-8541-b9ffb545de2b tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:44.962418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8e2d597e-76cf-4803-a902-0c23cc6776b2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:44.963507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8e2d597e-76cf-4803-a902-0c23cc6776b2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:44.980189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e2d597e-76cf-4803-a902-0c23cc6776b2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.980976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e2d597e-76cf-4803-a902-0c23cc6776b2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:44.981942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e2d597e-76cf-4803-a902-0c23cc6776b2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:44.982823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e2d597e-76cf-4803-a902-0c23cc6776b2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:45.136858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fddc362a-2b9f-4ee9-8541-b9ffb545de2b tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:45.151217 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fddc362a-2b9f-4ee9-8541-b9ffb545de2b tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1319 microversion: 2.1 time: 0.426202 Feb 19 20:52:45.154167 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 337/683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:44 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:45.159204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-24aa783a-135e-4bbd-84d6-131e99ebf2e5 req-b010048d-0a1d-4111-aed7-10adae7f3173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e4abb8-c615-460f-bc5c-702410f99b8b", "name": "network-vif-plugged", "status": "completed", "tag": "fa1b9c05-479c-4d37-8deb-82dad67025e6"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:45.161090 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:45.161090 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:45.183760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-24aa783a-135e-4bbd-84d6-131e99ebf2e5 req-b010048d-0a1d-4111-aed7-10adae7f3173 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:45.184773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-24aa783a-135e-4bbd-84d6-131e99ebf2e5 req-b010048d-0a1d-4111-aed7-10adae7f3173 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:45.212254 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-24aa783a-135e-4bbd-84d6-131e99ebf2e5 req-b010048d-0a1d-4111-aed7-10adae7f3173 service nova] Creating event network-vif-plugged:fa1b9c05-479c-4d37-8deb-82dad67025e6 for instance 64e4abb8-c615-460f-bc5c-702410f99b8b on nch2-master-1 Feb 19 20:52:45.219519 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-24aa783a-135e-4bbd-84d6-131e99ebf2e5 req-b010048d-0a1d-4111-aed7-10adae7f3173 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063418 Feb 19 20:52:45.221001 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 338/684] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:45.231588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e50ab71d-9133-42bb-a220-403115f912f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:45.232593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e50ab71d-9133-42bb-a220-403115f912f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:45.240003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e50ab71d-9133-42bb-a220-403115f912f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:45.247439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e50ab71d-9133-42bb-a220-403115f912f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:45.248618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e50ab71d-9133-42bb-a220-403115f912f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:45.262449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e50ab71d-9133-42bb-a220-403115f912f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:45.364459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8e2d597e-76cf-4803-a902-0c23cc6776b2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:45.381385 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8e2d597e-76cf-4803-a902-0c23cc6776b2 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1477 microversion: 2.1 time: 0.421461 Feb 19 20:52:45.382944 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 347/685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:44 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:45.390247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:45.391563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:45.394253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e50ab71d-9133-42bb-a220-403115f912f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:45.404364 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e50ab71d-9133-42bb-a220-403115f912f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1275 microversion: 2.1 time: 0.181942 Feb 19 20:52:45.404926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:45.405553 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 339/686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:45 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:45.414886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:45.414886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:45.414886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:45.582361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f0541f19-5419-47a2-ab8f-8e6a69c34887 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:45.584260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f0541f19-5419-47a2-ab8f-8e6a69c34887 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:45.598143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0541f19-5419-47a2-ab8f-8e6a69c34887 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:45.604873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0541f19-5419-47a2-ab8f-8e6a69c34887 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:45.610575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0541f19-5419-47a2-ab8f-8e6a69c34887 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:45.611516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0541f19-5419-47a2-ab8f-8e6a69c34887 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:46.212640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:46.226450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:46.228983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:46.233330 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a685bfc4-b9a0-4663-bcbe-12ba0ea1945b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1568 microversion: 2.25 time: 0.848421 Feb 19 20:52:46.233863 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 348/687] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:45 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1568 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:46.245125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7d54a9c6-e5ba-4863-86e4-1b048bd5c09e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:46.245743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7d54a9c6-e5ba-4863-86e4-1b048bd5c09e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:46.260854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d54a9c6-e5ba-4863-86e4-1b048bd5c09e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:46.261307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d54a9c6-e5ba-4863-86e4-1b048bd5c09e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:46.262113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d54a9c6-e5ba-4863-86e4-1b048bd5c09e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:46.262538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d54a9c6-e5ba-4863-86e4-1b048bd5c09e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:46.403358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0541f19-5419-47a2-ab8f-8e6a69c34887 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:46.412092 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f0541f19-5419-47a2-ab8f-8e6a69c34887 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.833839 Feb 19 20:52:46.413285 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 340/688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:45 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:46.420098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fed87325-0040-448c-bcc8-d8b38656eb65 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:46.421832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fed87325-0040-448c-bcc8-d8b38656eb65 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:46.431456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fed87325-0040-448c-bcc8-d8b38656eb65 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:46.431908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fed87325-0040-448c-bcc8-d8b38656eb65 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:46.432741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fed87325-0040-448c-bcc8-d8b38656eb65 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:46.433361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fed87325-0040-448c-bcc8-d8b38656eb65 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:46.939980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fed87325-0040-448c-bcc8-d8b38656eb65 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:46.953769 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fed87325-0040-448c-bcc8-d8b38656eb65 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1319 microversion: 2.1 time: 0.539197 Feb 19 20:52:46.964005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7d54a9c6-e5ba-4863-86e4-1b048bd5c09e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:46.967634 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 341/689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:46 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:46.973891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-001820a1-6360-4849-9708-b590ebc0a807 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:46.974731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-001820a1-6360-4849-9708-b590ebc0a807 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:46.982032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-001820a1-6360-4849-9708-b590ebc0a807 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:46.982725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-001820a1-6360-4849-9708-b590ebc0a807 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:46.983962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-001820a1-6360-4849-9708-b590ebc0a807 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:46.984599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-001820a1-6360-4849-9708-b590ebc0a807 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:46.987839 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7d54a9c6-e5ba-4863-86e4-1b048bd5c09e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1320 microversion: 2.1 time: 0.746054 Feb 19 20:52:46.990062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 349/690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:46 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1320 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:47.015208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-241a8213-b2ba-40aa-ab06-31aeee472e8a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:47.015828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-241a8213-b2ba-40aa-ab06-31aeee472e8a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:47.026160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-241a8213-b2ba-40aa-ab06-31aeee472e8a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:47.026628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-241a8213-b2ba-40aa-ab06-31aeee472e8a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:47.027436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-241a8213-b2ba-40aa-ab06-31aeee472e8a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:47.027878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-241a8213-b2ba-40aa-ab06-31aeee472e8a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:47.167531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-241a8213-b2ba-40aa-ab06-31aeee472e8a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:47.178181 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-241a8213-b2ba-40aa-ab06-31aeee472e8a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1281 microversion: 2.1 time: 0.187025 Feb 19 20:52:47.188974 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 350/691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:46 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:47.246717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f584f541-6410-4ab6-8fec-0f9cd430a3b8 req-2d4ab695-f257-4dab-8660-4196f1cd1604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a832621d-69be-4201-acf6-2f3ca91a42ed", "name": "network-vif-plugged", "status": "completed", "tag": "48461d06-c79b-4c2b-8608-01b6aa1c3b24"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:47.253427 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:47.253427 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:47.263804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f584f541-6410-4ab6-8fec-0f9cd430a3b8 req-2d4ab695-f257-4dab-8660-4196f1cd1604 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:47.264583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f584f541-6410-4ab6-8fec-0f9cd430a3b8 req-2d4ab695-f257-4dab-8660-4196f1cd1604 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:47.278247 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f584f541-6410-4ab6-8fec-0f9cd430a3b8 req-2d4ab695-f257-4dab-8660-4196f1cd1604 service nova] Creating event network-vif-plugged:48461d06-c79b-4c2b-8608-01b6aa1c3b24 for instance a832621d-69be-4201-acf6-2f3ca91a42ed on nch1-master-1 Feb 19 20:52:47.286492 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f584f541-6410-4ab6-8fec-0f9cd430a3b8 req-2d4ab695-f257-4dab-8660-4196f1cd1604 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045459 Feb 19 20:52:47.288387 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 351/692] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:47.296174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:47.297237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:47.308429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:47.309331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:47.310450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:47.311089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:47.574666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-001820a1-6360-4849-9708-b590ebc0a807 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:47.598547 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-001820a1-6360-4849-9708-b590ebc0a807 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1477 microversion: 2.1 time: 0.628628 Feb 19 20:52:47.601652 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 342/693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:46 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1477 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:47.608284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2e64d9f-5586-44c7-9a96-588956fa8760 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:47.609265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2e64d9f-5586-44c7-9a96-588956fa8760 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:47.636144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2e64d9f-5586-44c7-9a96-588956fa8760 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:47.637134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2e64d9f-5586-44c7-9a96-588956fa8760 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:47.638199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2e64d9f-5586-44c7-9a96-588956fa8760 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:47.638915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2e64d9f-5586-44c7-9a96-588956fa8760 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:47.849468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:47.858863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:47.860880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:47.862161 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c1487094-801b-4ab2-bcc9-0a46526cfbdb tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1568 microversion: 2.25 time: 0.572066 Feb 19 20:52:47.862967 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 352/694] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:47 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1568 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:47.970923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1fc9a74-1907-4d98-bdf6-e7415d16fd13 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:47.971530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b1fc9a74-1907-4d98-bdf6-e7415d16fd13 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:47.978901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1fc9a74-1907-4d98-bdf6-e7415d16fd13 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:47.979479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1fc9a74-1907-4d98-bdf6-e7415d16fd13 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:47.980369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1fc9a74-1907-4d98-bdf6-e7415d16fd13 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:47.980848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1fc9a74-1907-4d98-bdf6-e7415d16fd13 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:47.988067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2e64d9f-5586-44c7-9a96-588956fa8760 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:47.997296 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2e64d9f-5586-44c7-9a96-588956fa8760 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.393885 Feb 19 20:52:48.000234 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 343/695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:47 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:48.006491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5745753d-5549-406a-ba81-3640c0b9438d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:48.007239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5745753d-5549-406a-ba81-3640c0b9438d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:48.020627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5745753d-5549-406a-ba81-3640c0b9438d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:48.021237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5745753d-5549-406a-ba81-3640c0b9438d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:48.022049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5745753d-5549-406a-ba81-3640c0b9438d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:48.028622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5745753d-5549-406a-ba81-3640c0b9438d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:48.462977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b1fc9a74-1907-4d98-bdf6-e7415d16fd13 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:48.471859 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b1fc9a74-1907-4d98-bdf6-e7415d16fd13 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1319 microversion: 2.1 time: 0.504331 Feb 19 20:52:48.483952 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 353/696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:47 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:48.498610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-932d527a-1f2f-46ac-905f-118b3cd053b6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:48.501210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-932d527a-1f2f-46ac-905f-118b3cd053b6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:48.510513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5745753d-5549-406a-ba81-3640c0b9438d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:48.511933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-932d527a-1f2f-46ac-905f-118b3cd053b6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:48.513457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-932d527a-1f2f-46ac-905f-118b3cd053b6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:48.517925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-932d527a-1f2f-46ac-905f-118b3cd053b6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:48.518382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-932d527a-1f2f-46ac-905f-118b3cd053b6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:48.521455 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5745753d-5549-406a-ba81-3640c0b9438d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1504 microversion: 2.1 time: 0.517771 Feb 19 20:52:48.523679 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 344/697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:48 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:48.617020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3aade316-6776-4eda-b9c9-bd363b6f106b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:48.617864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3aade316-6776-4eda-b9c9-bd363b6f106b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:48.627046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aade316-6776-4eda-b9c9-bd363b6f106b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:48.629731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aade316-6776-4eda-b9c9-bd363b6f106b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:48.631136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aade316-6776-4eda-b9c9-bd363b6f106b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:48.636423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aade316-6776-4eda-b9c9-bd363b6f106b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:49.165744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3aade316-6776-4eda-b9c9-bd363b6f106b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:49.182726 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3aade316-6776-4eda-b9c9-bd363b6f106b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1477 microversion: 2.1 time: 0.568167 Feb 19 20:52:49.184511 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 345/698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:48 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1477 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:49.190807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:49.191666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:49.193912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-932d527a-1f2f-46ac-905f-118b3cd053b6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:49.201974 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-932d527a-1f2f-46ac-905f-118b3cd053b6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1323 microversion: 2.1 time: 0.716303 Feb 19 20:52:49.202898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:49.204480 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 354/699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:48 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1323 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:49.214114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:49.215974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:49.217874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:49.222927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-957ba9dc-0065-4910-8338-788e1796f3ad tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:49.223703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-957ba9dc-0065-4910-8338-788e1796f3ad tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:49.238217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-957ba9dc-0065-4910-8338-788e1796f3ad tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:49.238974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-957ba9dc-0065-4910-8338-788e1796f3ad tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:49.242828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-957ba9dc-0065-4910-8338-788e1796f3ad tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:49.246482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-957ba9dc-0065-4910-8338-788e1796f3ad tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:49.940044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-957ba9dc-0065-4910-8338-788e1796f3ad tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:49.951715 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-957ba9dc-0065-4910-8338-788e1796f3ad tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.743165 Feb 19 20:52:49.954970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:49.956790 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 355/700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:49 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:49.962690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b44fb3ce-d8d1-4c42-b0a8-f13fd42d1984 req-00e6f0a2-c218-43fb-87a9-cafb57073d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e81722-edd5-49d7-ab7d-41e73614b6aa", "name": "network-vif-plugged", "status": "completed", "tag": "3604b765-b301-4875-991d-4d4190639b69"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:49.964571 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:49.964571 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:49.971782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:49.973345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b44fb3ce-d8d1-4c42-b0a8-f13fd42d1984 req-00e6f0a2-c218-43fb-87a9-cafb57073d1b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:49.975022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:49.976224 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0356a494-fde0-43f1-b418-2305b2d8262c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1543 microversion: 2.25 time: 0.789935 Feb 19 20:52:49.977076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b44fb3ce-d8d1-4c42-b0a8-f13fd42d1984 req-00e6f0a2-c218-43fb-87a9-cafb57073d1b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:49.985705 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 346/701] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:49 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1543 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:49.993401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-df0de0ca-a6b9-481f-b3fb-43ffd5e05f9d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:49.994004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-df0de0ca-a6b9-481f-b3fb-43ffd5e05f9d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:50.001374 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b44fb3ce-d8d1-4c42-b0a8-f13fd42d1984 req-00e6f0a2-c218-43fb-87a9-cafb57073d1b service nova] Creating event network-vif-plugged:3604b765-b301-4875-991d-4d4190639b69 for instance 18e81722-edd5-49d7-ab7d-41e73614b6aa on nch1-master-1 Feb 19 20:52:50.003621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df0de0ca-a6b9-481f-b3fb-43ffd5e05f9d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.004070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df0de0ca-a6b9-481f-b3fb-43ffd5e05f9d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.004949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df0de0ca-a6b9-481f-b3fb-43ffd5e05f9d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.006130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df0de0ca-a6b9-481f-b3fb-43ffd5e05f9d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.007392 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b44fb3ce-d8d1-4c42-b0a8-f13fd42d1984 req-00e6f0a2-c218-43fb-87a9-cafb57073d1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049224 Feb 19 20:52:50.008411 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 356/702] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:50.023649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5d169cff-fc7b-4fe3-ab86-3b80a4ae7422 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '.version_select at 0x7f647429cca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:50.025450 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:50.025450 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:52:50.027874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d169cff-fc7b-4fe3-ab86-3b80a4ae7422 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.028358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d169cff-fc7b-4fe3-ab86-3b80a4ae7422 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.053812 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5d169cff-fc7b-4fe3-ab86-3b80a4ae7422 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1701 microversion: 2.25 time: 0.043514 Feb 19 20:52:50.054434 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 357/703] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Feb 19 20:52:50 2022] GET /compute/v2.1/os-migrations => generated 1701 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:50.072483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-279b78e0-63e0-4574-bd4e-ef83327c038c tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:50.074608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-279b78e0-63e0-4574-bd4e-ef83327c038c tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:50.081714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-279b78e0-63e0-4574-bd4e-ef83327c038c tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.082214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-279b78e0-63e0-4574-bd4e-ef83327c038c tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.083365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-279b78e0-63e0-4574-bd4e-ef83327c038c tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.084535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-279b78e0-63e0-4574-bd4e-ef83327c038c tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.375245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-df0de0ca-a6b9-481f-b3fb-43ffd5e05f9d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:50.386951 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-df0de0ca-a6b9-481f-b3fb-43ffd5e05f9d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1468 microversion: 2.1 time: 0.397047 Feb 19 20:52:50.400764 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 347/704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:49 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1468 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:50.409654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d876c145-83a3-4b7a-a387-a92370c1b763 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:50.410628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d876c145-83a3-4b7a-a387-a92370c1b763 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:50.419850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d876c145-83a3-4b7a-a387-a92370c1b763 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.420579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d876c145-83a3-4b7a-a387-a92370c1b763 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.421858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d876c145-83a3-4b7a-a387-a92370c1b763 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.422491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d876c145-83a3-4b7a-a387-a92370c1b763 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.506165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-279b78e0-63e0-4574-bd4e-ef83327c038c tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:52:50.528810 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-279b78e0-63e0-4574-bd4e-ef83327c038c tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 2035 microversion: 2.25 time: 0.466004 Feb 19 20:52:50.529807 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 358/705] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:50 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 2035 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:50.535512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aa45b2f8-dcf8-4155-8e46-750a08e964f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:50.536291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aa45b2f8-dcf8-4155-8e46-750a08e964f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:50.543082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa45b2f8-dcf8-4155-8e46-750a08e964f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.543826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa45b2f8-dcf8-4155-8e46-750a08e964f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.544846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa45b2f8-dcf8-4155-8e46-750a08e964f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.545441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa45b2f8-dcf8-4155-8e46-750a08e964f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.783853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d876c145-83a3-4b7a-a387-a92370c1b763 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:50.794780 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d876c145-83a3-4b7a-a387-a92370c1b763 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1477 microversion: 2.1 time: 0.391060 Feb 19 20:52:50.795663 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 348/706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:50 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1477 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:50.800768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-63cfb755-96b1-4d7f-a04d-4ade2b5ce0b4 req-1547d907-5c94-4eeb-9afc-e78a06ffa273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2c4005-033c-4df6-978e-8ec53d9ac654", "tag": "4313e698-6c12-4d1e-b019-f8d0163bad53"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:50.802856 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:52:50.802856 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:52:50.810174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-63cfb755-96b1-4d7f-a04d-4ade2b5ce0b4 req-1547d907-5c94-4eeb-9afc-e78a06ffa273 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.810600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-63cfb755-96b1-4d7f-a04d-4ade2b5ce0b4 req-1547d907-5c94-4eeb-9afc-e78a06ffa273 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.823591 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-63cfb755-96b1-4d7f-a04d-4ade2b5ce0b4 req-1547d907-5c94-4eeb-9afc-e78a06ffa273 service nova] Creating event network-changed:4313e698-6c12-4d1e-b019-f8d0163bad53 for instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 on nch2-master-1 Feb 19 20:52:50.829434 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-63cfb755-96b1-4d7f-a04d-4ade2b5ce0b4 req-1547d907-5c94-4eeb-9afc-e78a06ffa273 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032388 Feb 19 20:52:50.830251 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 349/707] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:50.855939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa45b2f8-dcf8-4155-8e46-750a08e964f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:50.867223 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aa45b2f8-dcf8-4155-8e46-750a08e964f6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1323 microversion: 2.1 time: 0.336177 Feb 19 20:52:50.875403 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 359/708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:50 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:50.883458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-189c00b1-cce2-4102-bf0d-65e70def25d7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9fcd7d0-8aeb-4999-b678-f46415ddf214"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:50.885773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-189c00b1-cce2-4102-bf0d-65e70def25d7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:50.898430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-189c00b1-cce2-4102-bf0d-65e70def25d7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.899405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-189c00b1-cce2-4102-bf0d-65e70def25d7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.901063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-189c00b1-cce2-4102-bf0d-65e70def25d7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.901704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-189c00b1-cce2-4102-bf0d-65e70def25d7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.962461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-853335642", "block_migration": true, "disk_over_commit": false}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:50.963908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:50.970822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.971274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:50.972072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:50.972609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:51.049140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lazy-loading 'flavor' on Instance uuid a832621d-69be-4201-acf6-2f3ca91a42ed {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:52:51.129791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Going to try to live migrate instance to tempest-host-853335642 {{(pid=136095) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 20:52:51.140269 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] HTTP exception thrown: Compute host tempest-host-853335642 could not be found. Feb 19 20:52:51.141449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Returning 400 to user: Compute host tempest-host-853335642 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:52:51.142307 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-750f2e9f-49b8-4bd5-9c32-8d483e245486 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed/action" status: 400 len: 99 microversion: 2.1 time: 0.310844 Feb 19 20:52:51.142903 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 350/709] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Feb 19 20:52:50 2022] POST /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed/action => generated 99 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:52:51.150628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1476353658", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "020891c0-689f-4c7c-a850-6c2b2dfe0076"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:51.213260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] validate_networks() for [('020891c0-689f-4c7c-a850-6c2b2dfe0076', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:51.338305 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-189c00b1-cce2-4102-bf0d-65e70def25d7 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "POST /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461299 Feb 19 20:52:51.340523 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 360/710] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 20:52:50 2022] POST /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:51.356112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c3873380-247d-4263-be0b-da5a21c3d1c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:51.356876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c3873380-247d-4263-be0b-da5a21c3d1c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:51.367191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3873380-247d-4263-be0b-da5a21c3d1c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:51.367966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3873380-247d-4263-be0b-da5a21c3d1c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:51.369086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3873380-247d-4263-be0b-da5a21c3d1c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:51.370892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3873380-247d-4263-be0b-da5a21c3d1c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:51.734303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c3873380-247d-4263-be0b-da5a21c3d1c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:51.742528 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c3873380-247d-4263-be0b-da5a21c3d1c6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.400597 Feb 19 20:52:51.743427 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 361/711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:51 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:51.766450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d431c309-c538-473f-9b8b-e04ca67a4d16 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:51.767201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d431c309-c538-473f-9b8b-e04ca67a4d16 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:51.774755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d431c309-c538-473f-9b8b-e04ca67a4d16 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:51.775333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d431c309-c538-473f-9b8b-e04ca67a4d16 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:51.776449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d431c309-c538-473f-9b8b-e04ca67a4d16 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:51.777118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d431c309-c538-473f-9b8b-e04ca67a4d16 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:52.043805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:52.044829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:52.045807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:52.046697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:52.047313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:52.059089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:52.060113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:52.061918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:52.063219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:52.088435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Getting quotas for project a6f02f88286b49babe665db9d00787a2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:52.096055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Getting quotas for user ec1a2a2db19c41cca4342aa082770a96 and project a6f02f88286b49babe665db9d00787a2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:52.116554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:52:52.119271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:52:52.143133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d431c309-c538-473f-9b8b-e04ca67a4d16 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:52.151674 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d431c309-c538-473f-9b8b-e04ca67a4d16 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1468 microversion: 2.1 time: 0.397484 Feb 19 20:52:52.165169 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 362/712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:51 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1468 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:52.177883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ef8540b7-24d9-4482-b3a0-be17108b3ced tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:52.177883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ef8540b7-24d9-4482-b3a0-be17108b3ced tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:52.200656 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c6f92067-1599-487a-937a-b75043c1b45a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.055108 Feb 19 20:52:52.202071 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 351/713] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 20:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 20:52:52.210710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef8540b7-24d9-4482-b3a0-be17108b3ced tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:52.211993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef8540b7-24d9-4482-b3a0-be17108b3ced tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:52.212122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fac07314-07a1-4570-ae8c-6ede22b60559 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:52.212235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef8540b7-24d9-4482-b3a0-be17108b3ced tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:52.212721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fac07314-07a1-4570-ae8c-6ede22b60559 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:52.222488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef8540b7-24d9-4482-b3a0-be17108b3ced tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:52.223457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fac07314-07a1-4570-ae8c-6ede22b60559 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:52.223457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fac07314-07a1-4570-ae8c-6ede22b60559 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:52.223848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fac07314-07a1-4570-ae8c-6ede22b60559 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:52.224457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fac07314-07a1-4570-ae8c-6ede22b60559 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:52.594602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ef8540b7-24d9-4482-b3a0-be17108b3ced tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:52.613096 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ef8540b7-24d9-4482-b3a0-be17108b3ced tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1463 microversion: 2.1 time: 0.446474 Feb 19 20:52:52.613671 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 363/714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:52 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1463 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:52.629356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-58b198d4-febb-44ac-aef3-170485ccb109 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:52.630813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-58b198d4-febb-44ac-aef3-170485ccb109 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:52.647558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fac07314-07a1-4570-ae8c-6ede22b60559 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:52.667616 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fac07314-07a1-4570-ae8c-6ede22b60559 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1323 microversion: 2.1 time: 0.464164 Feb 19 20:52:52.668977 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 352/715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:52 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:52.673878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2064505726", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:52.747460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-58b198d4-febb-44ac-aef3-170485ccb109 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:52.759286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-58b198d4-febb-44ac-aef3-170485ccb109 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:52.761584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-58b198d4-febb-44ac-aef3-170485ccb109 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:52.764203 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-58b198d4-febb-44ac-aef3-170485ccb109 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1262 microversion: 2.25 time: 0.148470 Feb 19 20:52:52.765342 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 364/716] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:52 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:52.770003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:52.771731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-31276dc7-d04b-40b2-b8f3-6068605946e0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:52.773500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-31276dc7-d04b-40b2-b8f3-6068605946e0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:52.783032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31276dc7-d04b-40b2-b8f3-6068605946e0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:52.783751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31276dc7-d04b-40b2-b8f3-6068605946e0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:52.784879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31276dc7-d04b-40b2-b8f3-6068605946e0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:52.785300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31276dc7-d04b-40b2-b8f3-6068605946e0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.053755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-31276dc7-d04b-40b2-b8f3-6068605946e0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:53.065852 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-31276dc7-d04b-40b2-b8f3-6068605946e0 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1463 microversion: 2.1 time: 0.298711 Feb 19 20:52:53.067093 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 365/717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:52 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1463 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:53.072627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0f44d7ac-5ce7-4054-84d0-46a212756ca2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:53.073350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0f44d7ac-5ce7-4054-84d0-46a212756ca2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:53.091201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f44d7ac-5ce7-4054-84d0-46a212756ca2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.091750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f44d7ac-5ce7-4054-84d0-46a212756ca2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.102186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:53.102673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:53.103071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:53.103484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:53.103901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:53.107335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f44d7ac-5ce7-4054-84d0-46a212756ca2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.107784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f44d7ac-5ce7-4054-84d0-46a212756ca2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.118264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.119135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.120090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.120703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.142713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Getting quotas for project 81e756cebb9c45ddb687ea373d7ddaa3. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:53.150428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Getting quotas for user 05654d818a474f378f6cc02850b57e1b and project 81e756cebb9c45ddb687ea373d7ddaa3. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:53.163457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:52:53.165690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:52:53.225305 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-524a7fb7-aeec-4e5e-81bc-9c07e73032bb tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553809 Feb 19 20:52:53.226141 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 353/718] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:52:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:52:53.236933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f75529b9-2911-475e-b974-4af06053c17c"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:53.238453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:53.256273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.257008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.259409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.259695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.305394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0f44d7ac-5ce7-4054-84d0-46a212756ca2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:53.314185 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0f44d7ac-5ce7-4054-84d0-46a212756ca2 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.245286 Feb 19 20:52:53.314869 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 366/719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:53 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:53.329400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-76eeeab0-e136-411c-98d9-693f4e9c8c0c tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:53.330109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-76eeeab0-e136-411c-98d9-693f4e9c8c0c tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:53.392377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-76eeeab0-e136-411c-98d9-693f4e9c8c0c tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:53.399759 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-76eeeab0-e136-411c-98d9-693f4e9c8c0c tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1219 microversion: 2.1 time: 0.074128 Feb 19 20:52:53.400362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 367/720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:53 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:53.519360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:53.519786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:53.522519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:53.522519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:53.522519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:53.592087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:53.598518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.599445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.600262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.600820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.628793 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06a62431-9538-46fc-a97d-0909a761deef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action" status: 202 len: 1067 microversion: 2.1 time: 0.396242 Feb 19 20:52:53.629603 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 354/721] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:52:53 2022] POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action => generated 1067 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 19 20:52:53.642964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3fe89593-62f0-416a-8326-972640f58cb8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:53.643559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3fe89593-62f0-416a-8326-972640f58cb8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:53.651056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe89593-62f0-416a-8326-972640f58cb8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.651921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe89593-62f0-416a-8326-972640f58cb8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.652927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe89593-62f0-416a-8326-972640f58cb8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.653546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe89593-62f0-416a-8326-972640f58cb8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.688712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7bb18213-a5ea-48d6-804d-64de456630a9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:53.689357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7bb18213-a5ea-48d6-804d-64de456630a9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:53.712409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bb18213-a5ea-48d6-804d-64de456630a9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.713025 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bb18213-a5ea-48d6-804d-64de456630a9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.713974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bb18213-a5ea-48d6-804d-64de456630a9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:53.714551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bb18213-a5ea-48d6-804d-64de456630a9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:53.975614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7bb18213-a5ea-48d6-804d-64de456630a9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:53.987372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7bb18213-a5ea-48d6-804d-64de456630a9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1323 microversion: 2.1 time: 0.302800 Feb 19 20:52:53.988608 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 355/722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:53 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:53.993898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:53.996114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:54.002969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3fe89593-62f0-416a-8326-972640f58cb8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:54.007408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:54.008297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:54.009367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:54.010028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:54.010704 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3fe89593-62f0-416a-8326-972640f58cb8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.371294 Feb 19 20:52:54.011367 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 368/723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:53 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:54.331519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e557d338-8894-461f-bbce-ed102363a120 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:54.332470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e557d338-8894-461f-bbce-ed102363a120 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:54.337822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:54.340156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e557d338-8894-461f-bbce-ed102363a120 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:54.340622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e557d338-8894-461f-bbce-ed102363a120 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:54.341567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e557d338-8894-461f-bbce-ed102363a120 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:54.342151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e557d338-8894-461f-bbce-ed102363a120 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:54.373290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:54.381129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:54.381804 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11986741-2227-40dc-8362-4ea94cd2d0ab tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1322 microversion: 2.25 time: 0.390953 Feb 19 20:52:54.383507 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 356/724] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:53 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:54.418113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ec0768f3-9608-4085-a4e2-dbc44cd08155 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:54.418969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ec0768f3-9608-4085-a4e2-dbc44cd08155 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:54.425374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec0768f3-9608-4085-a4e2-dbc44cd08155 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:54.426271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec0768f3-9608-4085-a4e2-dbc44cd08155 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:54.427335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec0768f3-9608-4085-a4e2-dbc44cd08155 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:54.427919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec0768f3-9608-4085-a4e2-dbc44cd08155 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:54.539847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ec0768f3-9608-4085-a4e2-dbc44cd08155 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:54.548516 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ec0768f3-9608-4085-a4e2-dbc44cd08155 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1271 microversion: 2.1 time: 0.134572 Feb 19 20:52:54.549356 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 357/725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:54 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:54.620706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e557d338-8894-461f-bbce-ed102363a120 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:54.631561 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e557d338-8894-461f-bbce-ed102363a120 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.303614 Feb 19 20:52:54.632256 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 369/726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:54 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:55.004749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2182c40b-f776-40b7-b9f1-1314200a1cfa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:55.005795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2182c40b-f776-40b7-b9f1-1314200a1cfa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:55.011859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2182c40b-f776-40b7-b9f1-1314200a1cfa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.012318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2182c40b-f776-40b7-b9f1-1314200a1cfa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.013151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2182c40b-f776-40b7-b9f1-1314200a1cfa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.013601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2182c40b-f776-40b7-b9f1-1314200a1cfa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.027568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3583ecaa-c251-411e-8e9a-5628d38f286b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:55.028147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3583ecaa-c251-411e-8e9a-5628d38f286b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:55.034255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3583ecaa-c251-411e-8e9a-5628d38f286b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.034922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3583ecaa-c251-411e-8e9a-5628d38f286b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.035886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3583ecaa-c251-411e-8e9a-5628d38f286b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.036599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3583ecaa-c251-411e-8e9a-5628d38f286b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.464198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2182c40b-f776-40b7-b9f1-1314200a1cfa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:55.477501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3583ecaa-c251-411e-8e9a-5628d38f286b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:55.487553 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2182c40b-f776-40b7-b9f1-1314200a1cfa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1323 microversion: 2.1 time: 0.484799 Feb 19 20:52:55.488559 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3583ecaa-c251-411e-8e9a-5628d38f286b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.463853 Feb 19 20:52:55.488727 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 358/727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:54 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1323 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:55.500954 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 370/728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:55 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:55.503978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b315cae7-c50a-4234-b6d3-c7a6969505e8 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:55.504716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b315cae7-c50a-4234-b6d3-c7a6969505e8 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:55.506253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:55.506994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:55.511884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b315cae7-c50a-4234-b6d3-c7a6969505e8 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.512611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b315cae7-c50a-4234-b6d3-c7a6969505e8 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.513590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b315cae7-c50a-4234-b6d3-c7a6969505e8 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.514725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.515019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b315cae7-c50a-4234-b6d3-c7a6969505e8 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.515384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.516271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.516805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.544675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b315cae7-c50a-4234-b6d3-c7a6969505e8 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:52:55.655608 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b315cae7-c50a-4234-b6d3-c7a6969505e8 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 204 len: 0 microversion: 2.1 time: 0.154610 Feb 19 20:52:55.655608 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 359/729] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:52:55 2022] DELETE /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:52:55.661172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-620cd220-e3c8-422c-80eb-5824251d421e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:55.662931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-620cd220-e3c8-422c-80eb-5824251d421e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:55.674274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-620cd220-e3c8-422c-80eb-5824251d421e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.674734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-620cd220-e3c8-422c-80eb-5824251d421e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.675535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-620cd220-e3c8-422c-80eb-5824251d421e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.676123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-620cd220-e3c8-422c-80eb-5824251d421e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.799992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-620cd220-e3c8-422c-80eb-5824251d421e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:55.810264 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-620cd220-e3c8-422c-80eb-5824251d421e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1277 microversion: 2.1 time: 0.152865 Feb 19 20:52:55.810958 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 360/730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:55 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:55.823823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b016b06c-0dc9-4970-bb6e-b99a1bcd6f78 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:55.824545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b016b06c-0dc9-4970-bb6e-b99a1bcd6f78 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:55.830641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b016b06c-0dc9-4970-bb6e-b99a1bcd6f78 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.831082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b016b06c-0dc9-4970-bb6e-b99a1bcd6f78 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.831878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b016b06c-0dc9-4970-bb6e-b99a1bcd6f78 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:55.832323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b016b06c-0dc9-4970-bb6e-b99a1bcd6f78 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:55.872725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:55.881747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:55.883406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:55.884881 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2848e605-cf2b-45fa-85eb-abbdedf650cd tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1362 microversion: 2.25 time: 0.382521 Feb 19 20:52:55.885847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 371/731] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:55 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:55.890839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2003454089", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "371833671", "adminPass": "***", "networks": [{"uuid": "7f07acd1-a33e-40a1-8d3a-c7dcdf49d4e0"}], "security_groups": [{"name": "tempest-securitygroup--1992221030"}], "key_name": "tempest-keypair-1148996651", "user_data": "}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:52:56.244628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] validate_networks() for [('7f07acd1-a33e-40a1-8d3a-c7dcdf49d4e0', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:52:56.384580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b016b06c-0dc9-4970-bb6e-b99a1bcd6f78 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:56.391877 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b016b06c-0dc9-4970-bb6e-b99a1bcd6f78 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1475 microversion: 2.1 time: 0.577981 Feb 19 20:52:56.394485 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 361/732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:55 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:56.507117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-94e49cab-8d7d-40f7-8461-75cb67d096ad tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:56.507877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-94e49cab-8d7d-40f7-8461-75cb67d096ad tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:56.514724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94e49cab-8d7d-40f7-8461-75cb67d096ad tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:56.515435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94e49cab-8d7d-40f7-8461-75cb67d096ad tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:56.517553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94e49cab-8d7d-40f7-8461-75cb67d096ad tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:56.518195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94e49cab-8d7d-40f7-8461-75cb67d096ad tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:57.258505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-94e49cab-8d7d-40f7-8461-75cb67d096ad tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:57.268054 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-94e49cab-8d7d-40f7-8461-75cb67d096ad tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1323 microversion: 2.1 time: 0.766781 Feb 19 20:52:57.268683 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 362/733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:56 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1323 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:52:57.285350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4d7b97a-54bc-4b25-9594-026e948bdd54 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:57.286312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c4d7b97a-54bc-4b25-9594-026e948bdd54 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:57.300060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4d7b97a-54bc-4b25-9594-026e948bdd54 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:57.300823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4d7b97a-54bc-4b25-9594-026e948bdd54 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:57.301789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4d7b97a-54bc-4b25-9594-026e948bdd54 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:57.302442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4d7b97a-54bc-4b25-9594-026e948bdd54 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:57.729481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:52:57.730635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:52:57.734343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:52:57.735393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:52:57.735965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:52:57.748124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:57.748852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:57.749787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:57.750478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:57.769342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Getting quotas for project 04d2b5b9a01e4133b1f4f7f351cf0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:52:57.773552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Getting quotas for user 1fc7244fbf3b4298b92daf9e442fe669 and project 04d2b5b9a01e4133b1f4f7f351cf0c0a. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:52:57.785988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:52:57.788866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:52:57.796955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4d7b97a-54bc-4b25-9594-026e948bdd54 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:57.808238 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c4d7b97a-54bc-4b25-9594-026e948bdd54 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.526627 Feb 19 20:52:57.812952 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 363/734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:57 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:57.823241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e60fdb00-a8b1-4a0d-83ad-85648823dce5 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:57.844446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e60fdb00-a8b1-4a0d-83ad-85648823dce5 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:57.867814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e60fdb00-a8b1-4a0d-83ad-85648823dce5 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:57.875849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e60fdb00-a8b1-4a0d-83ad-85648823dce5 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:57.877214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e60fdb00-a8b1-4a0d-83ad-85648823dce5 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:57.877877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e60fdb00-a8b1-4a0d-83ad-85648823dce5 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:57.987380 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-097ed5b2-0424-454a-bcd8-359abf75bc77 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.097724 Feb 19 20:52:57.992949 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 372/735] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:52:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:52:57.998652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:58.001496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:58.010656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:58.011366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:58.012396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:58.013064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:59.064928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e60fdb00-a8b1-4a0d-83ad-85648823dce5 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:59.078288 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e60fdb00-a8b1-4a0d-83ad-85648823dce5 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1319 microversion: 2.1 time: 1.263938 Feb 19 20:52:59.088257 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 364/736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:57 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1319 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:59.093019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a2afa0a-bda3-4698-a9f8-a63f21d733c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:59.093647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a2afa0a-bda3-4698-a9f8-a63f21d733c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:59.113037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2afa0a-bda3-4698-a9f8-a63f21d733c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:59.113506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2afa0a-bda3-4698-a9f8-a63f21d733c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:59.114351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2afa0a-bda3-4698-a9f8-a63f21d733c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:59.115316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2afa0a-bda3-4698-a9f8-a63f21d733c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:59.351015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:59.364218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:59.368122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:59.375204 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-140501d9-3a94-4354-873e-a02beec0bb5f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1362 microversion: 2.25 time: 1.380873 Feb 19 20:52:59.377480 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 373/737] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:52:57 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1362 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:52:59.393453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2ac7b058-186e-482a-b2ea-87a8cf4cac48 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:59.397932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2ac7b058-186e-482a-b2ea-87a8cf4cac48 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:59.408703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ac7b058-186e-482a-b2ea-87a8cf4cac48 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:59.409612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ac7b058-186e-482a-b2ea-87a8cf4cac48 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:59.410774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ac7b058-186e-482a-b2ea-87a8cf4cac48 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:59.411980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ac7b058-186e-482a-b2ea-87a8cf4cac48 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:59.680517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2ac7b058-186e-482a-b2ea-87a8cf4cac48 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:52:59.688832 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2ac7b058-186e-482a-b2ea-87a8cf4cac48 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1323 microversion: 2.1 time: 0.308673 Feb 19 20:52:59.689636 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 374/738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:59 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1323 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:52:59.694779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f6afe501-eeae-49a3-803f-2969c982fb7e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:59.696047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f6afe501-eeae-49a3-803f-2969c982fb7e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:59.704789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6afe501-eeae-49a3-803f-2969c982fb7e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:59.705545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6afe501-eeae-49a3-803f-2969c982fb7e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:59.707191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6afe501-eeae-49a3-803f-2969c982fb7e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:59.707794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6afe501-eeae-49a3-803f-2969c982fb7e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:59.747560 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f6afe501-eeae-49a3-803f-2969c982fb7e tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056708 Feb 19 20:52:59.748463 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 375/739] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 20:52:59 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:52:59.753708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e2b90ef5-f3e4-4ced-90e1-dba78760bbb9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:52:59.754776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e2b90ef5-f3e4-4ced-90e1-dba78760bbb9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:52:59.761408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2b90ef5-f3e4-4ced-90e1-dba78760bbb9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:59.762146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2b90ef5-f3e4-4ced-90e1-dba78760bbb9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:52:59.763186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2b90ef5-f3e4-4ced-90e1-dba78760bbb9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:52:59.763840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2b90ef5-f3e4-4ced-90e1-dba78760bbb9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:00.284509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9a2afa0a-bda3-4698-a9f8-a63f21d733c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:00.296942 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a2afa0a-bda3-4698-a9f8-a63f21d733c0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1474 microversion: 2.1 time: 1.205845 Feb 19 20:53:00.298564 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 365/740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:59 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1474 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:00.311581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2eac4a02-9238-4532-a97c-390b350d9081 req-c474d342-b2a5-4fcf-b427-883429b12c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2c4005-033c-4df6-978e-8ec53d9ac654", "name": "network-vif-plugged", "status": "completed", "tag": "4313e698-6c12-4d1e-b019-f8d0163bad53"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:00.313300 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:00.313300 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:00.331932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2eac4a02-9238-4532-a97c-390b350d9081 req-c474d342-b2a5-4fcf-b427-883429b12c05 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:00.332766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2eac4a02-9238-4532-a97c-390b350d9081 req-c474d342-b2a5-4fcf-b427-883429b12c05 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:00.349640 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2eac4a02-9238-4532-a97c-390b350d9081 req-c474d342-b2a5-4fcf-b427-883429b12c05 service nova] Creating event network-vif-plugged:4313e698-6c12-4d1e-b019-f8d0163bad53 for instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 on nch2-master-1 Feb 19 20:53:00.354948 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2eac4a02-9238-4532-a97c-390b350d9081 req-c474d342-b2a5-4fcf-b427-883429b12c05 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055189 Feb 19 20:53:00.355851 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 366/741] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:00.365761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b1d3f009-18e9-405c-8b90-49dc55e33f57 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:00.366697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b1d3f009-18e9-405c-8b90-49dc55e33f57 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:00.386630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b1d3f009-18e9-405c-8b90-49dc55e33f57 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:00.387267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b1d3f009-18e9-405c-8b90-49dc55e33f57 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:00.388318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b1d3f009-18e9-405c-8b90-49dc55e33f57 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:00.388956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b1d3f009-18e9-405c-8b90-49dc55e33f57 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:01.579639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e2b90ef5-f3e4-4ced-90e1-dba78760bbb9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:01.620073 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e2b90ef5-f3e4-4ced-90e1-dba78760bbb9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1323 microversion: 2.1 time: 1.870100 Feb 19 20:53:01.623391 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 376/742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:52:59 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1323 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:01.640738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-00de58c7-93de-43d5-8514-b210a0d5e1fe req-52918936-4201-431f-9099-b10aa2df3432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab7828d-f679-4460-9a84-3648c980318c", "tag": "e07ea5eb-6c87-400c-888d-a30ece794d66"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:01.646938 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:01.646938 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:01.672603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-00de58c7-93de-43d5-8514-b210a0d5e1fe req-52918936-4201-431f-9099-b10aa2df3432 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:01.673674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-00de58c7-93de-43d5-8514-b210a0d5e1fe req-52918936-4201-431f-9099-b10aa2df3432 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:01.710302 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-00de58c7-93de-43d5-8514-b210a0d5e1fe req-52918936-4201-431f-9099-b10aa2df3432 service nova] Creating event network-changed:e07ea5eb-6c87-400c-888d-a30ece794d66 for instance aab7828d-f679-4460-9a84-3648c980318c on nch2-master-1 Feb 19 20:53:01.724725 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-00de58c7-93de-43d5-8514-b210a0d5e1fe req-52918936-4201-431f-9099-b10aa2df3432 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098612 Feb 19 20:53:01.737333 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 377/743] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:01.744107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2823c641-d0e3-4632-85e6-997f65701adc tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:01.744822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2823c641-d0e3-4632-85e6-997f65701adc tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:01.756059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2823c641-d0e3-4632-85e6-997f65701adc tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:01.759215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2823c641-d0e3-4632-85e6-997f65701adc tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:01.760088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2823c641-d0e3-4632-85e6-997f65701adc tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:01.760667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2823c641-d0e3-4632-85e6-997f65701adc tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:01.972068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-2823c641-d0e3-4632-85e6-997f65701adc tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lazy-loading 'services' on Instance uuid 64e4abb8-c615-460f-bc5c-702410f99b8b {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:53:02.155737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b1d3f009-18e9-405c-8b90-49dc55e33f57 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:02.169963 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b1d3f009-18e9-405c-8b90-49dc55e33f57 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 1.802823 Feb 19 20:53:02.170648 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 367/744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:00 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:02.188082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-7e5de8d1-d305-4690-8526-61891eeb936a req-80a1e823-a0b8-4c37-b09b-1c2595a2a94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f05bec-0cf3-4c8d-adda-1f646f93100c", "name": "network-vif-deleted", "tag": "283fa0ff-0c52-46c9-86d3-5ee439d6029b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:02.189866 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:02.189866 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:02.227364 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2823c641-d0e3-4632-85e6-997f65701adc tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments/b9fcd7d0-8aeb-4999-b678-f46415ddf214" status: 202 len: 0 microversion: 2.1 time: 0.487867 Feb 19 20:53:02.229034 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 378/745] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 20:53:01 2022] DELETE /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments/b9fcd7d0-8aeb-4999-b678-f46415ddf214 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:53:02.230778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7e5de8d1-d305-4690-8526-61891eeb936a req-80a1e823-a0b8-4c37-b09b-1c2595a2a94f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:02.232620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7e5de8d1-d305-4690-8526-61891eeb936a req-80a1e823-a0b8-4c37-b09b-1c2595a2a94f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:02.246226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d477cab7-d1da-4235-9a63-216a0b9d6cf4 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:02.253765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d477cab7-d1da-4235-9a63-216a0b9d6cf4 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:02.277895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d477cab7-d1da-4235-9a63-216a0b9d6cf4 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:02.278424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d477cab7-d1da-4235-9a63-216a0b9d6cf4 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:02.282977 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-7e5de8d1-d305-4690-8526-61891eeb936a req-80a1e823-a0b8-4c37-b09b-1c2595a2a94f service nova] Creating event network-vif-deleted:283fa0ff-0c52-46c9-86d3-5ee439d6029b for instance f4f05bec-0cf3-4c8d-adda-1f646f93100c on nch2-master-1 Feb 19 20:53:02.285095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d477cab7-d1da-4235-9a63-216a0b9d6cf4 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:02.285682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d477cab7-d1da-4235-9a63-216a0b9d6cf4 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:02.306783 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-7e5de8d1-d305-4690-8526-61891eeb936a req-80a1e823-a0b8-4c37-b09b-1c2595a2a94f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134790 Feb 19 20:53:02.312294 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 368/746] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:02.352013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:02.352995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:02.373869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:02.388864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:02.393491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:02.394014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:02.927779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d477cab7-d1da-4235-9a63-216a0b9d6cf4 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:02.935136 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d477cab7-d1da-4235-9a63-216a0b9d6cf4 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1319 microversion: 2.1 time: 0.704756 Feb 19 20:53:02.944484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:02.948744 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 379/747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:02 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1319 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:02.951765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:02.953359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9bdf3845-513f-4540-a906-8f1fbefeddea tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:02.953504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:02.954532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9bdf3845-513f-4540-a906-8f1fbefeddea tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:02.954663 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d3fb6503-449d-492a-9fb7-9db56c0703b3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1362 microversion: 2.25 time: 0.638721 Feb 19 20:53:02.959753 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 369/748] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:02 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:02.964782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d10d352a-a2a6-442f-a60d-3a51f33b28e1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:02.967967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bdf3845-513f-4540-a906-8f1fbefeddea tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:02.968488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bdf3845-513f-4540-a906-8f1fbefeddea tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:02.969233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bdf3845-513f-4540-a906-8f1fbefeddea tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:02.969667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bdf3845-513f-4540-a906-8f1fbefeddea tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:02.970133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d10d352a-a2a6-442f-a60d-3a51f33b28e1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:02.990925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d10d352a-a2a6-442f-a60d-3a51f33b28e1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:02.991633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d10d352a-a2a6-442f-a60d-3a51f33b28e1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:02.992848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d10d352a-a2a6-442f-a60d-3a51f33b28e1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:02.993514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d10d352a-a2a6-442f-a60d-3a51f33b28e1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:03.193689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9bdf3845-513f-4540-a906-8f1fbefeddea tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:03.203876 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9bdf3845-513f-4540-a906-8f1fbefeddea tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1321 microversion: 2.1 time: 0.253948 Feb 19 20:53:03.205309 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 380/749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:02 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:03.214735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c2935eef-54cc-4e29-89b6-84ea0cbe0017 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:03.215787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c2935eef-54cc-4e29-89b6-84ea0cbe0017 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:03.223570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2935eef-54cc-4e29-89b6-84ea0cbe0017 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:03.226072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2935eef-54cc-4e29-89b6-84ea0cbe0017 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:03.227204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2935eef-54cc-4e29-89b6-84ea0cbe0017 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:03.227845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2935eef-54cc-4e29-89b6-84ea0cbe0017 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:03.700205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c2935eef-54cc-4e29-89b6-84ea0cbe0017 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:03.704079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d10d352a-a2a6-442f-a60d-3a51f33b28e1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:03.706464 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c2935eef-54cc-4e29-89b6-84ea0cbe0017 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1520 microversion: 2.1 time: 0.499890 Feb 19 20:53:03.707358 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 381/750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:03 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:03.713061 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d10d352a-a2a6-442f-a60d-3a51f33b28e1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1472 microversion: 2.1 time: 0.751779 Feb 19 20:53:03.719474 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 370/751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:02 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1472 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:03.723496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8e7e6bea-ab65-484c-b2ef-9042d4377a62 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:03.725251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8e7e6bea-ab65-484c-b2ef-9042d4377a62 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:03.726392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-93b9bc4e-4d8e-4a15-9807-c1eac1ec76dd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Action: 'create', calling method: .version_select at 0x7f6474143280>, body: {"pool": null} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:03.734368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e7e6bea-ab65-484c-b2ef-9042d4377a62 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:03.734900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e7e6bea-ab65-484c-b2ef-9042d4377a62 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:03.735788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e7e6bea-ab65-484c-b2ef-9042d4377a62 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:03.736487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e7e6bea-ab65-484c-b2ef-9042d4377a62 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:04.696447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8e7e6bea-ab65-484c-b2ef-9042d4377a62 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:04.708635 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8e7e6bea-ab65-484c-b2ef-9042d4377a62 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.988946 Feb 19 20:53:04.716516 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 382/752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:03 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:04.721767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e92b8449-6419-4941-87d1-f2a93a958b88 req-80261ae6-de65-4ca8-a1cd-01baf4470169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa53378c-0deb-40cc-a2a5-bc55778f6146", "tag": "a926fff0-c109-4640-adbe-9f6dd047f15f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:04.724361 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:04.724361 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:04.745176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e92b8449-6419-4941-87d1-f2a93a958b88 req-80261ae6-de65-4ca8-a1cd-01baf4470169 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:04.745783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e92b8449-6419-4941-87d1-f2a93a958b88 req-80261ae6-de65-4ca8-a1cd-01baf4470169 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:04.759737 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e92b8449-6419-4941-87d1-f2a93a958b88 req-80261ae6-de65-4ca8-a1cd-01baf4470169 service nova] Creating event network-changed:a926fff0-c109-4640-adbe-9f6dd047f15f for instance fa53378c-0deb-40cc-a2a5-bc55778f6146 on nch2-master-1 Feb 19 20:53:04.764982 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e92b8449-6419-4941-87d1-f2a93a958b88 req-80261ae6-de65-4ca8-a1cd-01baf4470169 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047175 Feb 19 20:53:04.766231 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 383/753] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:04.772054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5fbd1947-7732-44b1-b439-bc82299d84c6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:04.773142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5fbd1947-7732-44b1-b439-bc82299d84c6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:04.780452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fbd1947-7732-44b1-b439-bc82299d84c6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:04.781180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fbd1947-7732-44b1-b439-bc82299d84c6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:04.782153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fbd1947-7732-44b1-b439-bc82299d84c6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:04.782795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fbd1947-7732-44b1-b439-bc82299d84c6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:05.269774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5fbd1947-7732-44b1-b439-bc82299d84c6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:05.281812 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5fbd1947-7732-44b1-b439-bc82299d84c6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1319 microversion: 2.1 time: 0.513926 Feb 19 20:53:05.283071 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 384/754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:04 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:05.291325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:05.292684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:05.299909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:05.300726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:05.302663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:05.303288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:06.016673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:06.035261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:06.037317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:06.039092 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d8a9cf01-4133-4093-a8e4-7b6fee6d7590 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1362 microversion: 2.25 time: 0.754800 Feb 19 20:53:06.039916 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 385/755] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:05 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1362 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:06.044667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5b5b6ca-94e1-4b32-892a-6c14776c3797 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:06.045267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d5b5b6ca-94e1-4b32-892a-6c14776c3797 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:06.052132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5b5b6ca-94e1-4b32-892a-6c14776c3797 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:06.052912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5b5b6ca-94e1-4b32-892a-6c14776c3797 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:06.054307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5b5b6ca-94e1-4b32-892a-6c14776c3797 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:06.054903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5b5b6ca-94e1-4b32-892a-6c14776c3797 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:06.795986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d5b5b6ca-94e1-4b32-892a-6c14776c3797 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:06.805414 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5b5b6ca-94e1-4b32-892a-6c14776c3797 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1389 microversion: 2.1 time: 0.764313 Feb 19 20:53:06.806071 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 386/756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:06 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1389 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:06.816728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-889ababd-b1d4-4c25-ae52-cda7518af9c4 req-37c8b2ed-80a3-4acd-9bc7-8bb698be0156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af34c3d-efca-4de5-94a6-7bdb97d068fd", "name": "network-vif-unplugged", "status": "completed", "tag": "45bff999-b4bd-48a5-8654-55e37f10072d"}, {"name": "network-changed", "server_uuid": "5af34c3d-efca-4de5-94a6-7bdb97d068fd", "tag": "45bff999-b4bd-48a5-8654-55e37f10072d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:06.819265 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:06.819265 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:06.846794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-889ababd-b1d4-4c25-ae52-cda7518af9c4 req-37c8b2ed-80a3-4acd-9bc7-8bb698be0156 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:06.853977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-889ababd-b1d4-4c25-ae52-cda7518af9c4 req-37c8b2ed-80a3-4acd-9bc7-8bb698be0156 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:06.871386 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-889ababd-b1d4-4c25-ae52-cda7518af9c4 req-37c8b2ed-80a3-4acd-9bc7-8bb698be0156 service nova] Creating event network-vif-unplugged:45bff999-b4bd-48a5-8654-55e37f10072d for instance 5af34c3d-efca-4de5-94a6-7bdb97d068fd on nch2-master-1 Feb 19 20:53:06.871386 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-889ababd-b1d4-4c25-ae52-cda7518af9c4 req-37c8b2ed-80a3-4acd-9bc7-8bb698be0156 service nova] Creating event network-changed:45bff999-b4bd-48a5-8654-55e37f10072d for instance 5af34c3d-efca-4de5-94a6-7bdb97d068fd on nch2-master-1 Feb 19 20:53:06.881045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-889ababd-b1d4-4c25-ae52-cda7518af9c4 req-37c8b2ed-80a3-4acd-9bc7-8bb698be0156 service nova] Instance 5af34c3d-efca-4de5-94a6-7bdb97d068fd is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:53:06.894489 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-889ababd-b1d4-4c25-ae52-cda7518af9c4 req-37c8b2ed-80a3-4acd-9bc7-8bb698be0156 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.081586 Feb 19 20:53:06.895107 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 387/757] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:06.902396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9476f71a-a995-44e0-92d0-7e7d160d93c0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:06.904147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9476f71a-a995-44e0-92d0-7e7d160d93c0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:06.916730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9476f71a-a995-44e0-92d0-7e7d160d93c0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:06.917607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9476f71a-a995-44e0-92d0-7e7d160d93c0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:06.918625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9476f71a-a995-44e0-92d0-7e7d160d93c0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:06.919317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9476f71a-a995-44e0-92d0-7e7d160d93c0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:06.974676 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9476f71a-a995-44e0-92d0-7e7d160d93c0 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076881 Feb 19 20:53:06.975943 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 388/758] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 20:53:06 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:53:06.986053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6baf02da-a3da-42a6-a010-2c3480d8abf9 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:06.989910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6baf02da-a3da-42a6-a010-2c3480d8abf9 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:07.015678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6baf02da-a3da-42a6-a010-2c3480d8abf9 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:07.016453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6baf02da-a3da-42a6-a010-2c3480d8abf9 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:07.018205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6baf02da-a3da-42a6-a010-2c3480d8abf9 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:07.025680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6baf02da-a3da-42a6-a010-2c3480d8abf9 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:07.833815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6baf02da-a3da-42a6-a010-2c3480d8abf9 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:07.845273 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6baf02da-a3da-42a6-a010-2c3480d8abf9 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1472 microversion: 2.1 time: 0.867809 Feb 19 20:53:07.846268 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 389/759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:06 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1472 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:07.851800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a7e38b5b-3a11-4c89-b09d-b00b44a616a1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:07.852431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a7e38b5b-3a11-4c89-b09d-b00b44a616a1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:07.859913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7e38b5b-3a11-4c89-b09d-b00b44a616a1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:07.860527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7e38b5b-3a11-4c89-b09d-b00b44a616a1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:07.861768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7e38b5b-3a11-4c89-b09d-b00b44a616a1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:07.862214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7e38b5b-3a11-4c89-b09d-b00b44a616a1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:08.859785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a7e38b5b-3a11-4c89-b09d-b00b44a616a1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:08.869770 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a7e38b5b-3a11-4c89-b09d-b00b44a616a1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 1.022058 Feb 19 20:53:08.871113 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 390/760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:07 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:08.876509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-29b7d1d2-5bc8-48b5-8e9b-9e13d7e7f97f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:08.877376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-29b7d1d2-5bc8-48b5-8e9b-9e13d7e7f97f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:08.884735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29b7d1d2-5bc8-48b5-8e9b-9e13d7e7f97f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:08.885878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29b7d1d2-5bc8-48b5-8e9b-9e13d7e7f97f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:08.886885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29b7d1d2-5bc8-48b5-8e9b-9e13d7e7f97f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:08.887535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29b7d1d2-5bc8-48b5-8e9b-9e13d7e7f97f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.318776 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-93b9bc4e-4d8e-4a15-9807-c1eac1ec76dd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.597726 Feb 19 20:53:09.319452 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 371/761] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:53:03 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:09.324144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:09.324587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:09.330986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:09.331527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.333529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:09.333529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.416858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29b7d1d2-5bc8-48b5-8e9b-9e13d7e7f97f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:09.424281 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-29b7d1d2-5bc8-48b5-8e9b-9e13d7e7f97f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1319 microversion: 2.1 time: 0.551982 Feb 19 20:53:09.425121 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 391/762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:08 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:09.430172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b33bd3c4-8374-43d5-ae49-de678191ea72 req-c6d07c69-2726-45e8-9497-5d75e189292f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae68ed7f-2390-4238-aa17-0cc5a0fc1791", "tag": "8ac53ea3-5b94-4d4e-a851-73b51c046686"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:09.431689 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:09.431689 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:09.438830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b33bd3c4-8374-43d5-ae49-de678191ea72 req-c6d07c69-2726-45e8-9497-5d75e189292f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:09.439267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b33bd3c4-8374-43d5-ae49-de678191ea72 req-c6d07c69-2726-45e8-9497-5d75e189292f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.450737 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b33bd3c4-8374-43d5-ae49-de678191ea72 req-c6d07c69-2726-45e8-9497-5d75e189292f service nova] Creating event network-changed:8ac53ea3-5b94-4d4e-a851-73b51c046686 for instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 on nch1-master-1 Feb 19 20:53:09.455661 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b33bd3c4-8374-43d5-ae49-de678191ea72 req-c6d07c69-2726-45e8-9497-5d75e189292f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029441 Feb 19 20:53:09.456252 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 392/763] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:09.461531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-49b0968d-7359-489b-ac72-45ee1bbb4579 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:09.462500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-49b0968d-7359-489b-ac72-45ee1bbb4579 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:09.470074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49b0968d-7359-489b-ac72-45ee1bbb4579 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:09.470703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49b0968d-7359-489b-ac72-45ee1bbb4579 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.471655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49b0968d-7359-489b-ac72-45ee1bbb4579 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:09.472204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49b0968d-7359-489b-ac72-45ee1bbb4579 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.503656 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-49b0968d-7359-489b-ac72-45ee1bbb4579 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045819 Feb 19 20:53:09.504434 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 393/764] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 20:53:09 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:53:09.510652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7ba703e8-4a20-4955-bbea-97e546255698 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:09.511466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7ba703e8-4a20-4955-bbea-97e546255698 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:09.518356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ba703e8-4a20-4955-bbea-97e546255698 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:09.518818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ba703e8-4a20-4955-bbea-97e546255698 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.519615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ba703e8-4a20-4955-bbea-97e546255698 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:09.520058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ba703e8-4a20-4955-bbea-97e546255698 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.664851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:09.673925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:09.675529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:09.677352 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7581156c-7bca-420d-a434-ebf3e292a3d2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1362 microversion: 2.25 time: 0.356208 Feb 19 20:53:09.678165 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 372/765] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:09 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:09.682663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a15d06d-9e8a-4fb2-b49c-e4c76ea57c8c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:09.683276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a15d06d-9e8a-4fb2-b49c-e4c76ea57c8c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:09.692592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a15d06d-9e8a-4fb2-b49c-e4c76ea57c8c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:09.693080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a15d06d-9e8a-4fb2-b49c-e4c76ea57c8c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.694135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a15d06d-9e8a-4fb2-b49c-e4c76ea57c8c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:09.694807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a15d06d-9e8a-4fb2-b49c-e4c76ea57c8c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:09.841022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7ba703e8-4a20-4955-bbea-97e546255698 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:09.851242 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7ba703e8-4a20-4955-bbea-97e546255698 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1389 microversion: 2.1 time: 0.344520 Feb 19 20:53:09.852436 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 394/766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:09 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1389 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:09.856912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1291092025", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "b5f73a2d-e0db-4f8e-b90f-72b9e4b05653"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:09.914097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] validate_networks() for [('b5f73a2d-e0db-4f8e-b90f-72b9e4b05653', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:53:10.049170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9a15d06d-9e8a-4fb2-b49c-e4c76ea57c8c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:10.057454 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a15d06d-9e8a-4fb2-b49c-e4c76ea57c8c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1469 microversion: 2.1 time: 0.378061 Feb 19 20:53:10.069207 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 373/767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:09 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1469 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:10.069207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-667b1938-5454-4658-b658-70a20913df4d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:10.069207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-667b1938-5454-4658-b658-70a20913df4d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:10.069207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667b1938-5454-4658-b658-70a20913df4d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.069650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667b1938-5454-4658-b658-70a20913df4d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.070066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667b1938-5454-4658-b658-70a20913df4d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.070495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667b1938-5454-4658-b658-70a20913df4d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.095935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-667b1938-5454-4658-b658-70a20913df4d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:53:10.174876 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-667b1938-5454-4658-b658-70a20913df4d tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 204 len: 0 microversion: 2.1 time: 0.115478 Feb 19 20:53:10.175543 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 374/768] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:53:10 2022] DELETE /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:53:10.183327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e616b01b-d78e-4345-9b77-f2157ccb5031 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:10.184023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e616b01b-d78e-4345-9b77-f2157ccb5031 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:10.190011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e616b01b-d78e-4345-9b77-f2157ccb5031 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.190466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e616b01b-d78e-4345-9b77-f2157ccb5031 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.191270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e616b01b-d78e-4345-9b77-f2157ccb5031 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.191697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e616b01b-d78e-4345-9b77-f2157ccb5031 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.539178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e616b01b-d78e-4345-9b77-f2157ccb5031 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:10.546550 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e616b01b-d78e-4345-9b77-f2157ccb5031 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.369920 Feb 19 20:53:10.547123 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 375/769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:10 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:10.551592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dea6eee1-4d0d-4df3-ad5b-e178495cf926 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:10.552111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dea6eee1-4d0d-4df3-ad5b-e178495cf926 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:10.562665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dea6eee1-4d0d-4df3-ad5b-e178495cf926 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.562763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dea6eee1-4d0d-4df3-ad5b-e178495cf926 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.563677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dea6eee1-4d0d-4df3-ad5b-e178495cf926 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.564259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dea6eee1-4d0d-4df3-ad5b-e178495cf926 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.593888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:53:10.594920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:53:10.595693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:53:10.596775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:53:10.597779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:53:10.608020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.608530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.609352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.609785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.627084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Getting quotas for project 869a0cf6b5604ec89af633eb5012ff5b. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:53:10.631348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Getting quotas for user d0a4a7cd3a234092987f7fb637c91e38 and project 869a0cf6b5604ec89af633eb5012ff5b. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:53:10.635891 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dea6eee1-4d0d-4df3-ad5b-e178495cf926 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd/action" status: 204 len: 0 microversion: 2.1 time: 0.086768 Feb 19 20:53:10.636786 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 376/770] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:10 2022] POST /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:53:10.644241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b832f400-c08e-464c-bfc5-8abc1fd00321 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:10.645208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b832f400-c08e-464c-bfc5-8abc1fd00321 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:10.646689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:53:10.649090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:53:10.654450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b832f400-c08e-464c-bfc5-8abc1fd00321 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.655186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b832f400-c08e-464c-bfc5-8abc1fd00321 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.656207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b832f400-c08e-464c-bfc5-8abc1fd00321 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.656924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b832f400-c08e-464c-bfc5-8abc1fd00321 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.737852 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-90f9c7a8-9cd1-4502-8389-0c673677dd17 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883770 Feb 19 20:53:10.738049 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 395/771] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:53:10.743237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e7b713f6-a216-4f82-bd19-41724cfabb1d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:10.744021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e7b713f6-a216-4f82-bd19-41724cfabb1d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:10.758970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7b713f6-a216-4f82-bd19-41724cfabb1d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.759495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7b713f6-a216-4f82-bd19-41724cfabb1d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.760540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7b713f6-a216-4f82-bd19-41724cfabb1d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:10.761044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7b713f6-a216-4f82-bd19-41724cfabb1d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:10.963838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b832f400-c08e-464c-bfc5-8abc1fd00321 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:10.974491 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b832f400-c08e-464c-bfc5-8abc1fd00321 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1510 microversion: 2.1 time: 0.335701 Feb 19 20:53:10.975392 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 377/772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:10 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:10.998207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57d11fd9-3e28-496d-8ec9-d8861f747dbb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:10.998786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57d11fd9-3e28-496d-8ec9-d8861f747dbb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:11.015428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57d11fd9-3e28-496d-8ec9-d8861f747dbb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.016123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57d11fd9-3e28-496d-8ec9-d8861f747dbb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.017167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57d11fd9-3e28-496d-8ec9-d8861f747dbb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.019450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57d11fd9-3e28-496d-8ec9-d8861f747dbb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.046316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e7b713f6-a216-4f82-bd19-41724cfabb1d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:11.064343 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e7b713f6-a216-4f82-bd19-41724cfabb1d tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1319 microversion: 2.1 time: 0.323420 Feb 19 20:53:11.065615 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 396/773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:10 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:11.073631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:11.074744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:11.081398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.081845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.082626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.083703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.593559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-57d11fd9-3e28-496d-8ec9-d8861f747dbb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:11.605063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:11.605432 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57d11fd9-3e28-496d-8ec9-d8861f747dbb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1469 microversion: 2.1 time: 0.611788 Feb 19 20:53:11.606214 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 378/774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:10 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1469 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:11.610397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ed1d5020-3777-4c18-bfa0-661f1906e2b0 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:11.611003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ed1d5020-3777-4c18-bfa0-661f1906e2b0 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:11.618088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:11.619690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:11.620887 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9296b7a4-9259-4b80-901a-252c4e54827c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1362 microversion: 2.25 time: 0.553578 Feb 19 20:53:11.621549 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 397/775] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:11 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:11.622610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed1d5020-3777-4c18-bfa0-661f1906e2b0 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.623572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed1d5020-3777-4c18-bfa0-661f1906e2b0 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.624420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed1d5020-3777-4c18-bfa0-661f1906e2b0 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.624868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed1d5020-3777-4c18-bfa0-661f1906e2b0 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.625792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-47712254-9715-4799-b0ab-953168d7cca0 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:11.626585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-47712254-9715-4799-b0ab-953168d7cca0 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:11.633289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47712254-9715-4799-b0ab-953168d7cca0 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.633972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47712254-9715-4799-b0ab-953168d7cca0 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.634769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47712254-9715-4799-b0ab-953168d7cca0 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.635404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47712254-9715-4799-b0ab-953168d7cca0 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.751265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ed1d5020-3777-4c18-bfa0-661f1906e2b0 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:11.759965 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ed1d5020-3777-4c18-bfa0-661f1906e2b0 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1276 microversion: 2.1 time: 0.152934 Feb 19 20:53:11.769546 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 379/776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:11 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:11.774227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae0e5e22-c147-49e9-8907-344b75630cef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:11.775045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae0e5e22-c147-49e9-8907-344b75630cef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:11.781607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae0e5e22-c147-49e9-8907-344b75630cef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.782068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae0e5e22-c147-49e9-8907-344b75630cef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.782974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae0e5e22-c147-49e9-8907-344b75630cef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:11.783438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae0e5e22-c147-49e9-8907-344b75630cef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:11.969475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-47712254-9715-4799-b0ab-953168d7cca0 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:11.978583 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-47712254-9715-4799-b0ab-953168d7cca0 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1389 microversion: 2.1 time: 0.355968 Feb 19 20:53:11.979308 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 398/777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:11 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1389 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:11.993551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-befa40a7-7d4d-4a04-97af-0c63540c254a tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:11.994635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-befa40a7-7d4d-4a04-97af-0c63540c254a tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:12.002243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-befa40a7-7d4d-4a04-97af-0c63540c254a tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:12.002913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-befa40a7-7d4d-4a04-97af-0c63540c254a tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:12.003818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-befa40a7-7d4d-4a04-97af-0c63540c254a tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:12.004489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-befa40a7-7d4d-4a04-97af-0c63540c254a tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:12.224549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae0e5e22-c147-49e9-8907-344b75630cef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:12.235329 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae0e5e22-c147-49e9-8907-344b75630cef tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.464283 Feb 19 20:53:12.246219 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 380/778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:11 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:12.251628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c01984fc-1bc2-49d0-8b2d-0411d5815ad8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:12.252478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c01984fc-1bc2-49d0-8b2d-0411d5815ad8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:12.258780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c01984fc-1bc2-49d0-8b2d-0411d5815ad8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:12.259239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c01984fc-1bc2-49d0-8b2d-0411d5815ad8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:12.261543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c01984fc-1bc2-49d0-8b2d-0411d5815ad8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:12.262138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c01984fc-1bc2-49d0-8b2d-0411d5815ad8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:12.450400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-befa40a7-7d4d-4a04-97af-0c63540c254a tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:12.459104 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-befa40a7-7d4d-4a04-97af-0c63540c254a tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1510 microversion: 2.1 time: 0.470854 Feb 19 20:53:12.459884 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 399/779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:11 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1510 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:12.623806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-81a43732-d19c-43e1-b435-0823f51f7b13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:12.624739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-81a43732-d19c-43e1-b435-0823f51f7b13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:12.636236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c01984fc-1bc2-49d0-8b2d-0411d5815ad8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:12.640738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81a43732-d19c-43e1-b435-0823f51f7b13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:12.641391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81a43732-d19c-43e1-b435-0823f51f7b13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:12.643132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81a43732-d19c-43e1-b435-0823f51f7b13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:12.643727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81a43732-d19c-43e1-b435-0823f51f7b13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:12.650033 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c01984fc-1bc2-49d0-8b2d-0411d5815ad8 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1319 microversion: 2.1 time: 0.400325 Feb 19 20:53:12.652151 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 381/780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:12 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:12.669534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:12.670624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:12.678394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:12.681574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:12.684868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:12.686321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.023906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:13.032740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:13.034591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:13.036002 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f0ba8795-2b21-4034-9a5c-056c3d25c3c9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1362 microversion: 2.25 time: 0.382615 Feb 19 20:53:13.037141 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 382/781] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:12 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:13.042106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-868dc4f6-8c80-4d76-83e0-277c705292e9 req-3fad88ca-2a71-4b9e-bb7a-24205dc3004e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa53378c-0deb-40cc-a2a5-bc55778f6146", "name": "network-vif-plugged", "status": "completed", "tag": "a926fff0-c109-4640-adbe-9f6dd047f15f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:13.044080 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:13.044080 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:13.055126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-868dc4f6-8c80-4d76-83e0-277c705292e9 req-3fad88ca-2a71-4b9e-bb7a-24205dc3004e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.061027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-868dc4f6-8c80-4d76-83e0-277c705292e9 req-3fad88ca-2a71-4b9e-bb7a-24205dc3004e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.063734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-81a43732-d19c-43e1-b435-0823f51f7b13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:13.076257 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-81a43732-d19c-43e1-b435-0823f51f7b13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1469 microversion: 2.1 time: 0.456058 Feb 19 20:53:13.077347 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 400/782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:12 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1469 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:53:13.083318 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-868dc4f6-8c80-4d76-83e0-277c705292e9 req-3fad88ca-2a71-4b9e-bb7a-24205dc3004e service nova] Creating event network-vif-plugged:a926fff0-c109-4640-adbe-9f6dd047f15f for instance fa53378c-0deb-40cc-a2a5-bc55778f6146 on nch2-master-1 Feb 19 20:53:13.084435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f538d10-fbd4-4c4f-a925-546e518aa3aa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:13.085287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f538d10-fbd4-4c4f-a925-546e518aa3aa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:13.094128 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-868dc4f6-8c80-4d76-83e0-277c705292e9 req-3fad88ca-2a71-4b9e-bb7a-24205dc3004e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055461 Feb 19 20:53:13.094748 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 383/783] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:13.095239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f538d10-fbd4-4c4f-a925-546e518aa3aa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.104167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0ce38a18-0955-4982-b3d6-cab2a5a35059 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:13.104897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0ce38a18-0955-4982-b3d6-cab2a5a35059 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:13.108367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f538d10-fbd4-4c4f-a925-546e518aa3aa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.110031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f538d10-fbd4-4c4f-a925-546e518aa3aa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.111063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f538d10-fbd4-4c4f-a925-546e518aa3aa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.112565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ce38a18-0955-4982-b3d6-cab2a5a35059 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.117930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ce38a18-0955-4982-b3d6-cab2a5a35059 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.118808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ce38a18-0955-4982-b3d6-cab2a5a35059 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.122372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ce38a18-0955-4982-b3d6-cab2a5a35059 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.684002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0ce38a18-0955-4982-b3d6-cab2a5a35059 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:13.696039 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0ce38a18-0955-4982-b3d6-cab2a5a35059 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1389 microversion: 2.1 time: 0.592314 Feb 19 20:53:13.700010 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 384/784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:13 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1389 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:13.710120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-09530055-1d8b-4771-b858-b8678acfb47c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:13.716177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-09530055-1d8b-4771-b858-b8678acfb47c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:13.730602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09530055-1d8b-4771-b858-b8678acfb47c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.732004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09530055-1d8b-4771-b858-b8678acfb47c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.735350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09530055-1d8b-4771-b858-b8678acfb47c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.736551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09530055-1d8b-4771-b858-b8678acfb47c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.785971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f538d10-fbd4-4c4f-a925-546e518aa3aa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:13.799316 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f538d10-fbd4-4c4f-a925-546e518aa3aa tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1324 microversion: 2.1 time: 0.717654 Feb 19 20:53:13.809887 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 401/785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:13 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1324 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:13.809887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4d6ab5c8-c022-48c0-95c6-92e806ff5d14 req-d4fe7cef-c303-42ba-8b72-a3fc87927a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e4abb8-c615-460f-bc5c-702410f99b8b", "name": "network-vif-deleted", "tag": "fa1b9c05-479c-4d37-8deb-82dad67025e6"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:13.809887 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:13.809887 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:13.816446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4d6ab5c8-c022-48c0-95c6-92e806ff5d14 req-d4fe7cef-c303-42ba-8b72-a3fc87927a4c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.816999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4d6ab5c8-c022-48c0-95c6-92e806ff5d14 req-d4fe7cef-c303-42ba-8b72-a3fc87927a4c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.829966 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4d6ab5c8-c022-48c0-95c6-92e806ff5d14 req-d4fe7cef-c303-42ba-8b72-a3fc87927a4c service nova] Creating event network-vif-deleted:fa1b9c05-479c-4d37-8deb-82dad67025e6 for instance 64e4abb8-c615-460f-bc5c-702410f99b8b on nch2-master-1 Feb 19 20:53:13.837531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4d6ab5c8-c022-48c0-95c6-92e806ff5d14 req-d4fe7cef-c303-42ba-8b72-a3fc87927a4c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035155 Feb 19 20:53:13.848531 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 402/786] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:13.853676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:13.854388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:13.860931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.861544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.862594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.863078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.900532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:13.900909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:13.901463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lazy-loading 'fault' on Instance uuid 64e4abb8-c615-460f-bc5c-702410f99b8b {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:53:13.976364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08781c2dd21c4011b5eebde0436042c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76afd67dfef14c3db64ccbd812036427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:13.985818 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d14f91db-4cab-4edd-b148-929d2ab2bcbd tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 200 len: 1306 microversion: 2.1 time: 0.135988 Feb 19 20:53:13.987226 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 403/787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:13 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 1306 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:13.994051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bba539ba-4bcc-4045-9520-1f3bca822ea6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:13.995062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bba539ba-4bcc-4045-9520-1f3bca822ea6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:13.999533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-09530055-1d8b-4771-b858-b8678acfb47c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:14.007464 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-09530055-1d8b-4771-b858-b8678acfb47c tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.303152 Feb 19 20:53:14.016874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bba539ba-4bcc-4045-9520-1f3bca822ea6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.016874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bba539ba-4bcc-4045-9520-1f3bca822ea6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:14.016874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bba539ba-4bcc-4045-9520-1f3bca822ea6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.016874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bba539ba-4bcc-4045-9520-1f3bca822ea6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:14.017352 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 385/788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:13 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:14.056287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:14.057073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:14.064360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.064870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:14.065669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.066115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:14.432109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bba539ba-4bcc-4045-9520-1f3bca822ea6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:14.449768 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bba539ba-4bcc-4045-9520-1f3bca822ea6 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1319 microversion: 2.1 time: 0.460952 Feb 19 20:53:14.450734 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 404/789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:13 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:14.452865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:14.456102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-81dc2a17-3318-4452-a827-c2f2dab6ab22 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:14.456990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-81dc2a17-3318-4452-a827-c2f2dab6ab22 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:14.463516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:14.463677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81dc2a17-3318-4452-a827-c2f2dab6ab22 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.464124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81dc2a17-3318-4452-a827-c2f2dab6ab22 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:14.465319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:14.465784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81dc2a17-3318-4452-a827-c2f2dab6ab22 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.466592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81dc2a17-3318-4452-a827-c2f2dab6ab22 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:14.468253 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0df72e73-7893-4ca7-9288-e63253c9c52f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1362 microversion: 2.25 time: 0.415625 Feb 19 20:53:14.471217 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 386/790] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:14 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:14.720704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-81dc2a17-3318-4452-a827-c2f2dab6ab22 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:14.723009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9cc4e2a6-45b0-473e-a307-4291d95662a3 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:14.725341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9cc4e2a6-45b0-473e-a307-4291d95662a3 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:14.732536 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-81dc2a17-3318-4452-a827-c2f2dab6ab22 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1461 microversion: 2.1 time: 0.280346 Feb 19 20:53:14.734640 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 405/791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:14 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1461 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:14.735886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cc4e2a6-45b0-473e-a307-4291d95662a3 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.737697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cc4e2a6-45b0-473e-a307-4291d95662a3 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:14.738814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cc4e2a6-45b0-473e-a307-4291d95662a3 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.739991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cc4e2a6-45b0-473e-a307-4291d95662a3 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:14.749143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4d43a809-2f0e-44c2-a126-3c473e18b894 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:14.749820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4d43a809-2f0e-44c2-a126-3c473e18b894 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:14.757544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d43a809-2f0e-44c2-a126-3c473e18b894 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.758419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d43a809-2f0e-44c2-a126-3c473e18b894 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:14.759590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d43a809-2f0e-44c2-a126-3c473e18b894 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:14.760529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d43a809-2f0e-44c2-a126-3c473e18b894 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.127677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4d43a809-2f0e-44c2-a126-3c473e18b894 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:15.141420 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4d43a809-2f0e-44c2-a126-3c473e18b894 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1461 microversion: 2.1 time: 0.395970 Feb 19 20:53:15.151866 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 406/792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:14 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1461 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:15.151866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a50023e0-3bc4-4904-8ddd-e5ecb0cd311a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:15.151866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a50023e0-3bc4-4904-8ddd-e5ecb0cd311a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:15.161834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a50023e0-3bc4-4904-8ddd-e5ecb0cd311a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.162424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a50023e0-3bc4-4904-8ddd-e5ecb0cd311a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.164993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a50023e0-3bc4-4904-8ddd-e5ecb0cd311a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.165555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a50023e0-3bc4-4904-8ddd-e5ecb0cd311a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.191015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9cc4e2a6-45b0-473e-a307-4291d95662a3 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:15.203023 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9cc4e2a6-45b0-473e-a307-4291d95662a3 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1389 microversion: 2.1 time: 0.488902 Feb 19 20:53:15.204117 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 387/793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:14 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1389 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:53:15.211682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ab19cf1c-8308-489d-bbc0-d79ef3ee157f tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:15.212709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ab19cf1c-8308-489d-bbc0-d79ef3ee157f tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:15.223090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab19cf1c-8308-489d-bbc0-d79ef3ee157f tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.225001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab19cf1c-8308-489d-bbc0-d79ef3ee157f tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.226703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab19cf1c-8308-489d-bbc0-d79ef3ee157f tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.228623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab19cf1c-8308-489d-bbc0-d79ef3ee157f tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.247971 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-ab19cf1c-8308-489d-bbc0-d79ef3ee157f tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] HTTP exception thrown: Instance 64e4abb8-c615-460f-bc5c-702410f99b8b could not be found. Feb 19 20:53:15.249156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ab19cf1c-8308-489d-bbc0-d79ef3ee157f tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Returning 404 to user: Instance 64e4abb8-c615-460f-bc5c-702410f99b8b could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:53:15.250270 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ab19cf1c-8308-489d-bbc0-d79ef3ee157f tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 404 len: 111 microversion: 2.1 time: 0.043551 Feb 19 20:53:15.251095 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 388/794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:15 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:53:15.256183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2efdd14a-ccc7-43d6-b0ef-9cd1b83ee284 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:15.258188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2efdd14a-ccc7-43d6-b0ef-9cd1b83ee284 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:15.264841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2efdd14a-ccc7-43d6-b0ef-9cd1b83ee284 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.265488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2efdd14a-ccc7-43d6-b0ef-9cd1b83ee284 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.266473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2efdd14a-ccc7-43d6-b0ef-9cd1b83ee284 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.267217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2efdd14a-ccc7-43d6-b0ef-9cd1b83ee284 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.667570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a50023e0-3bc4-4904-8ddd-e5ecb0cd311a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:15.683848 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a50023e0-3bc4-4904-8ddd-e5ecb0cd311a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1324 microversion: 2.1 time: 0.539785 Feb 19 20:53:15.688086 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 407/795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:15 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:15.691910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2efdd14a-ccc7-43d6-b0ef-9cd1b83ee284 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:15.699888 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2efdd14a-ccc7-43d6-b0ef-9cd1b83ee284 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.447304 Feb 19 20:53:15.704499 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 389/796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:15 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:15.716947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-30a927b8-eb26-467b-9c9e-af74a040c8ad req-ac2f1c4d-d834-415b-a9f3-0fb023379325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af34c3d-efca-4de5-94a6-7bdb97d068fd", "name": "network-vif-plugged", "status": "completed", "tag": "45bff999-b4bd-48a5-8654-55e37f10072d"}, {"server_uuid": "aab7828d-f679-4460-9a84-3648c980318c", "name": "network-vif-plugged", "status": "completed", "tag": "e07ea5eb-6c87-400c-888d-a30ece794d66"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:15.719415 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:15.719415 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:15.732716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f902610-3d99-47f8-aa1b-05860b7349f8 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '.version_select at 0x7f6467dcfca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:15.736727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-30a927b8-eb26-467b-9c9e-af74a040c8ad req-ac2f1c4d-d834-415b-a9f3-0fb023379325 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.737290 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:15.737290 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:15.740454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-30a927b8-eb26-467b-9c9e-af74a040c8ad req-ac2f1c4d-d834-415b-a9f3-0fb023379325 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.742220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f902610-3d99-47f8-aa1b-05860b7349f8 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.742678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f902610-3d99-47f8-aa1b-05860b7349f8 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.773773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-30a927b8-eb26-467b-9c9e-af74a040c8ad req-ac2f1c4d-d834-415b-a9f3-0fb023379325 service nova] Creating event network-vif-plugged:45bff999-b4bd-48a5-8654-55e37f10072d for instance 5af34c3d-efca-4de5-94a6-7bdb97d068fd on nch2-master-1 Feb 19 20:53:15.774400 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-30a927b8-eb26-467b-9c9e-af74a040c8ad req-ac2f1c4d-d834-415b-a9f3-0fb023379325 service nova] Creating event network-vif-plugged:e07ea5eb-6c87-400c-888d-a30ece794d66 for instance aab7828d-f679-4460-9a84-3648c980318c on nch2-master-1 Feb 19 20:53:15.776645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f902610-3d99-47f8-aa1b-05860b7349f8 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.086639 Feb 19 20:53:15.785225 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 408/797] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:53:15 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:15.804064 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-30a927b8-eb26-467b-9c9e-af74a040c8ad req-ac2f1c4d-d834-415b-a9f3-0fb023379325 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095269 Feb 19 20:53:15.804606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f071f8a6-ee04-47a9-a9eb-b5b34fcc1a06 req-3c704c45-39cf-44ba-a81b-a813462188b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "097ae8b7-1df3-4788-b5e3-5580b215bf98", "tag": "bbd45217-6a8e-439f-89c7-dd438e2032fd"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:15.804733 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 390/798] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:15.806976 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:15.806976 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:15.810763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e8273fc-90dc-4875-af55-4533d52af858 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:15.811475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1e8273fc-90dc-4875-af55-4533d52af858 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:15.819113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e8273fc-90dc-4875-af55-4533d52af858 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.819569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e8273fc-90dc-4875-af55-4533d52af858 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.823349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f071f8a6-ee04-47a9-a9eb-b5b34fcc1a06 req-3c704c45-39cf-44ba-a81b-a813462188b8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.826588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f071f8a6-ee04-47a9-a9eb-b5b34fcc1a06 req-3c704c45-39cf-44ba-a81b-a813462188b8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.836623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e8273fc-90dc-4875-af55-4533d52af858 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.837092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e8273fc-90dc-4875-af55-4533d52af858 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.860836 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f071f8a6-ee04-47a9-a9eb-b5b34fcc1a06 req-3c704c45-39cf-44ba-a81b-a813462188b8 service nova] Creating event network-changed:bbd45217-6a8e-439f-89c7-dd438e2032fd for instance 097ae8b7-1df3-4788-b5e3-5580b215bf98 on nch2-master-1 Feb 19 20:53:15.871230 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f071f8a6-ee04-47a9-a9eb-b5b34fcc1a06 req-3c704c45-39cf-44ba-a81b-a813462188b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082177 Feb 19 20:53:15.874154 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 409/799] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:15.887910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:15.891274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:15.905188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.909185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:15.910528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:15.912547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:16.822673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1e8273fc-90dc-4875-af55-4533d52af858 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:16.835772 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e8273fc-90dc-4875-af55-4533d52af858 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1319 microversion: 2.1 time: 1.029521 Feb 19 20:53:16.838890 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 391/800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:15 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1319 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:16.842770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7522ff3b-a9c5-4263-9cb5-54b3f74abe1d tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:16.871726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:16.878739 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7522ff3b-a9c5-4263-9cb5-54b3f74abe1d tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017517 Feb 19 20:53:16.889611 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 392/801] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:53:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:16.894292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:16.897755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:16.899460 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-440cef89-8228-4108-8b2f-c593fa43db8c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1558 microversion: 2.25 time: 1.024161 Feb 19 20:53:16.900288 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 410/802] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:15 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1558 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:16.904971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ed0c08bb-2433-4ada-8487-9ce6c9d1190f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:16.905482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bc67f08e-11a5-471e-9872-50fdd7b5882a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:16.906606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ed0c08bb-2433-4ada-8487-9ce6c9d1190f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:16.908010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bc67f08e-11a5-471e-9872-50fdd7b5882a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:16.917545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc67f08e-11a5-471e-9872-50fdd7b5882a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:16.918375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc67f08e-11a5-471e-9872-50fdd7b5882a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:16.919681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc67f08e-11a5-471e-9872-50fdd7b5882a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:16.920391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc67f08e-11a5-471e-9872-50fdd7b5882a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:16.935519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed0c08bb-2433-4ada-8487-9ce6c9d1190f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:16.938088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed0c08bb-2433-4ada-8487-9ce6c9d1190f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:16.939142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed0c08bb-2433-4ada-8487-9ce6c9d1190f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:16.940580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed0c08bb-2433-4ada-8487-9ce6c9d1190f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:17.313322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bc67f08e-11a5-471e-9872-50fdd7b5882a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:17.326649 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bc67f08e-11a5-471e-9872-50fdd7b5882a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1324 microversion: 2.1 time: 0.424866 Feb 19 20:53:17.336742 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 411/803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:16 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1324 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:17.347406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8a236ef6-361c-4260-83d5-ba630566ca4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:17.348612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8a236ef6-361c-4260-83d5-ba630566ca4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:17.362881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a236ef6-361c-4260-83d5-ba630566ca4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:17.365851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a236ef6-361c-4260-83d5-ba630566ca4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:17.370450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a236ef6-361c-4260-83d5-ba630566ca4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:17.371866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a236ef6-361c-4260-83d5-ba630566ca4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:17.372145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ed0c08bb-2433-4ada-8487-9ce6c9d1190f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:17.383315 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ed0c08bb-2433-4ada-8487-9ce6c9d1190f tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1389 microversion: 2.1 time: 0.492408 Feb 19 20:53:17.383926 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 393/804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:16 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1389 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:17.431354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e6e935a1-8c4e-4e77-b8ba-7da1a92b598c tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1094324066", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:17.433890 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:17.433890 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:17.490065 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e6e935a1-8c4e-4e77-b8ba-7da1a92b598c tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.091502 Feb 19 20:53:17.497798 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 394/805] 10.222.0.30 () {60 vars in 1145 bytes} [Sat Feb 19 20:53:17 2022] POST /compute/v2.1/flavors => generated 499 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:17.512041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58d68c66-a09a-4719-a220-c2ae2e60f9c0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:17.513170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-58d68c66-a09a-4719-a220-c2ae2e60f9c0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:17.528597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58d68c66-a09a-4719-a220-c2ae2e60f9c0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:17.530763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58d68c66-a09a-4719-a220-c2ae2e60f9c0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:17.531960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58d68c66-a09a-4719-a220-c2ae2e60f9c0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:17.532856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58d68c66-a09a-4719-a220-c2ae2e60f9c0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:17.830096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8a236ef6-361c-4260-83d5-ba630566ca4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:17.839894 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8a236ef6-361c-4260-83d5-ba630566ca4b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.500182 Feb 19 20:53:17.841382 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 412/806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:17 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:17.850337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5ad87ba1-cfe7-4d82-a142-9c2e63cb2c02 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:17.862050 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5ad87ba1-cfe7-4d82-a142-9c2e63cb2c02 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019165 Feb 19 20:53:17.863342 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 413/807] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Feb 19 20:53:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:53:17.868675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b6643da0-75ad-4911-a89c-4e5f8e436ca3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:17.869880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b6643da0-75ad-4911-a89c-4e5f8e436ca3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:17.877833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6643da0-75ad-4911-a89c-4e5f8e436ca3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:17.879013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6643da0-75ad-4911-a89c-4e5f8e436ca3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:17.881280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6643da0-75ad-4911-a89c-4e5f8e436ca3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:17.881886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6643da0-75ad-4911-a89c-4e5f8e436ca3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:17.898638 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-b6643da0-75ad-4911-a89c-4e5f8e436ca3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] HTTP exception thrown: Instance 64e4abb8-c615-460f-bc5c-702410f99b8b could not be found. Feb 19 20:53:17.899791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b6643da0-75ad-4911-a89c-4e5f8e436ca3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Returning 404 to user: Instance 64e4abb8-c615-460f-bc5c-702410f99b8b could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:53:17.901058 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b6643da0-75ad-4911-a89c-4e5f8e436ca3 tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 404 len: 111 microversion: 2.1 time: 0.036376 Feb 19 20:53:17.901782 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 414/808] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:53:17 2022] DELETE /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:53:17.906938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-02134c67-afb7-47fe-8228-890952902d5f tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Action: 'create', calling method: .version_select at 0x7f6467dcf5e0>, body: {"keypair": {"name": "tempest-keypair-1519020627"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:17.931561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-02134c67-afb7-47fe-8228-890952902d5f tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Getting quotas for project a0981190244846a18036aa20dce2dc60. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:53:17.940080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-02134c67-afb7-47fe-8228-890952902d5f tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Getting quotas for user 72ce9a80c4b444259dda1f6a63e6fe49 and project a0981190244846a18036aa20dce2dc60. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:53:18.022694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-58d68c66-a09a-4719-a220-c2ae2e60f9c0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid fa53378c-0deb-40cc-a2a5-bc55778f6146 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:53:18.053363 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-58d68c66-a09a-4719-a220-c2ae2e60f9c0 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 2051 microversion: 2.25 time: 0.553377 Feb 19 20:53:18.055314 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 395/809] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:17 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 2051 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:18.072856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9c47ebd-c88e-4e2f-8518-7cb51a837220 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:18.073602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9c47ebd-c88e-4e2f-8518-7cb51a837220 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:18.080645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9c47ebd-c88e-4e2f-8518-7cb51a837220 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:18.081217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9c47ebd-c88e-4e2f-8518-7cb51a837220 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:18.082165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9c47ebd-c88e-4e2f-8518-7cb51a837220 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:18.083522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9c47ebd-c88e-4e2f-8518-7cb51a837220 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:18.186444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-02134c67-afb7-47fe-8228-890952902d5f tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Getting quotas for project a0981190244846a18036aa20dce2dc60. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:53:18.191021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-02134c67-afb7-47fe-8228-890952902d5f tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Getting quotas for user 72ce9a80c4b444259dda1f6a63e6fe49 and project a0981190244846a18036aa20dce2dc60. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:53:18.212037 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-02134c67-afb7-47fe-8228-890952902d5f tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.42 time: 0.308891 Feb 19 20:53:18.213749 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 415/810] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Feb 19 20:53:17 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 311 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:53:18.221343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9250852d-ab4c-4e0b-8ec8-2d5f9cc1566b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:18.222339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9250852d-ab4c-4e0b-8ec8-2d5f9cc1566b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] [instance: 64e4abb8-c615-460f-bc5c-702410f99b8b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:18.231268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9250852d-ab4c-4e0b-8ec8-2d5f9cc1566b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:18.232176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9250852d-ab4c-4e0b-8ec8-2d5f9cc1566b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:18.233311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9250852d-ab4c-4e0b-8ec8-2d5f9cc1566b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:18.234045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9250852d-ab4c-4e0b-8ec8-2d5f9cc1566b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:18.257787 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-9250852d-ab4c-4e0b-8ec8-2d5f9cc1566b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] HTTP exception thrown: Instance 64e4abb8-c615-460f-bc5c-702410f99b8b could not be found. Feb 19 20:53:18.258807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9250852d-ab4c-4e0b-8ec8-2d5f9cc1566b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] Returning 404 to user: Instance 64e4abb8-c615-460f-bc5c-702410f99b8b could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:53:18.260106 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9250852d-ab4c-4e0b-8ec8-2d5f9cc1566b tempest-AttachSCSIVolumeTestJSON-1784177744 tempest-AttachSCSIVolumeTestJSON-1784177744-project] 10.222.0.30 "GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b" status: 404 len: 111 microversion: 2.1 time: 0.044697 Feb 19 20:53:18.263256 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 416/811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:18 2022] GET /compute/v2.1/servers/64e4abb8-c615-460f-bc5c-702410f99b8b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:53:18.274698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-969d51d9-9a76-4722-82bd-3c3893e5d280 req-4ee17e49-c009-4d0b-9150-2a6cea2a2db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae68ed7f-2390-4238-aa17-0cc5a0fc1791", "name": "network-vif-plugged", "status": "completed", "tag": "8ac53ea3-5b94-4d4e-a851-73b51c046686"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:18.277346 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:18.277346 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:18.289037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-969d51d9-9a76-4722-82bd-3c3893e5d280 req-4ee17e49-c009-4d0b-9150-2a6cea2a2db7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:18.289765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-969d51d9-9a76-4722-82bd-3c3893e5d280 req-4ee17e49-c009-4d0b-9150-2a6cea2a2db7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:18.315881 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-969d51d9-9a76-4722-82bd-3c3893e5d280 req-4ee17e49-c009-4d0b-9150-2a6cea2a2db7 service nova] Creating event network-vif-plugged:8ac53ea3-5b94-4d4e-a851-73b51c046686 for instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 on nch1-master-1 Feb 19 20:53:18.322395 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-969d51d9-9a76-4722-82bd-3c3893e5d280 req-4ee17e49-c009-4d0b-9150-2a6cea2a2db7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057096 Feb 19 20:53:18.323579 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 417/812] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:18.331086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1445266770", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "095b66d7-d6c5-4c13-8884-b31217056c4e"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:18.403680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:53:18.866631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a9c47ebd-c88e-4e2f-8518-7cb51a837220 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:18.883014 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9c47ebd-c88e-4e2f-8518-7cb51a837220 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1319 microversion: 2.1 time: 0.813714 Feb 19 20:53:18.895921 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 396/813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:18 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1319 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:18.905210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-67c7cd92-c976-4994-a78b-69304779ca24 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:18.907142 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:18.907142 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:18.917369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-67c7cd92-c976-4994-a78b-69304779ca24 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:18.920099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-67c7cd92-c976-4994-a78b-69304779ca24 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:18.922150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-67c7cd92-c976-4994-a78b-69304779ca24 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:18.925955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-67c7cd92-c976-4994-a78b-69304779ca24 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:18.976520 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-67c7cd92-c976-4994-a78b-69304779ca24 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.078930 Feb 19 20:53:18.977266 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 397/814] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Feb 19 20:53:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:53:18.988690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98e88b62-150a-4640-b5f1-eb92ab96054a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:18.990517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-98e88b62-150a-4640-b5f1-eb92ab96054a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:18.998569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98e88b62-150a-4640-b5f1-eb92ab96054a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:18.999405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98e88b62-150a-4640-b5f1-eb92ab96054a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:19.000561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98e88b62-150a-4640-b5f1-eb92ab96054a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:19.001575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98e88b62-150a-4640-b5f1-eb92ab96054a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:19.480101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:53:19.480680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:53:19.481776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:53:19.482142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:53:19.482555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:53:19.495603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:19.496142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:19.501900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:19.502388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:19.523361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:53:19.545586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for user c26bc5048c9849218cadd12475cd5fbe and project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:53:19.564566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:53:19.570223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:53:19.574121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98e88b62-150a-4640-b5f1-eb92ab96054a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:19.583629 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98e88b62-150a-4640-b5f1-eb92ab96054a tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1324 microversion: 2.1 time: 0.598797 Feb 19 20:53:19.591425 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 398/815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:18 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1324 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:19.622348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-01f8390f-2721-4ece-a55d-80e3c864fb3c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:19.622984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-01f8390f-2721-4ece-a55d-80e3c864fb3c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:19.642771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01f8390f-2721-4ece-a55d-80e3c864fb3c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:19.643234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01f8390f-2721-4ece-a55d-80e3c864fb3c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:19.644053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01f8390f-2721-4ece-a55d-80e3c864fb3c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:19.644526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01f8390f-2721-4ece-a55d-80e3c864fb3c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:19.711789 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-156bb361-a477-413a-9a99-339659f848f6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.386158 Feb 19 20:53:19.712601 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 418/816] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:53:19.717259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44ecc327-e357-4020-9e20-5db06f91b2ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:19.718111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-44ecc327-e357-4020-9e20-5db06f91b2ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:19.725684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44ecc327-e357-4020-9e20-5db06f91b2ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:19.726439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44ecc327-e357-4020-9e20-5db06f91b2ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:19.727466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44ecc327-e357-4020-9e20-5db06f91b2ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:19.728130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44ecc327-e357-4020-9e20-5db06f91b2ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:20.354346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-01f8390f-2721-4ece-a55d-80e3c864fb3c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:20.362718 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-01f8390f-2721-4ece-a55d-80e3c864fb3c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1389 microversion: 2.1 time: 0.753269 Feb 19 20:53:20.363317 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 399/817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:19 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1389 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:20.369339 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d92f90ae-c134-412b-b0b8-43d804eaf51c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:20.370049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d92f90ae-c134-412b-b0b8-43d804eaf51c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:20.376008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d92f90ae-c134-412b-b0b8-43d804eaf51c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:20.376594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d92f90ae-c134-412b-b0b8-43d804eaf51c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:20.377588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d92f90ae-c134-412b-b0b8-43d804eaf51c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:20.378102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d92f90ae-c134-412b-b0b8-43d804eaf51c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:20.402001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44ecc327-e357-4020-9e20-5db06f91b2ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:20.414399 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44ecc327-e357-4020-9e20-5db06f91b2ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.700293 Feb 19 20:53:20.415053 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 419/818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:19 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:20.420831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2b1bf5cc-8ed9-4ca4-ba1f-f22d004e4559 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:20.421735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2b1bf5cc-8ed9-4ca4-ba1f-f22d004e4559 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:20.430467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b1bf5cc-8ed9-4ca4-ba1f-f22d004e4559 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:20.431248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b1bf5cc-8ed9-4ca4-ba1f-f22d004e4559 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:20.432140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b1bf5cc-8ed9-4ca4-ba1f-f22d004e4559 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:20.432836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b1bf5cc-8ed9-4ca4-ba1f-f22d004e4559 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:20.502685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d92f90ae-c134-412b-b0b8-43d804eaf51c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:20.522184 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d92f90ae-c134-412b-b0b8-43d804eaf51c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1275 microversion: 2.1 time: 0.156857 Feb 19 20:53:20.528451 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 400/819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:20 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:20.536846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1612549615", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c36e6964-b1c5-4d15-8ff3-6ec34911167e"}, {"port": "e1552338-247f-46d8-ba3c-0852bc6b82e8", "tag": "port-1"}, {"port": "6290f8b3-0737-4492-8de5-f27de84a5a1e", "tag": "port-2"}, {"uuid": "3a65eeba-09aa-46e7-a378-b06f5822655f", "tag": "net-1"}, {"uuid": "3a65eeba-09aa-46e7-a378-b06f5822655f"}, {"uuid": "29f753c7-df02-4765-94b5-9df128b873af", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "29f753c7-df02-4765-94b5-9df128b873af", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "03b5535c-cf30-4b6c-9466-5ea912a33e71", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "91cde230-36d5-44fb-bc24-28cbcdf3779b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e724d0d7-1022-4767-910f-d215fc344365", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--547029311"}], "key_name": "tempest-keypair-1519020627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:20.729602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] validate_networks() for [('c36e6964-b1c5-4d15-8ff3-6ec34911167e', None, None, None, None, None), (None, None, 'e1552338-247f-46d8-ba3c-0852bc6b82e8', None, None, None), (None, None, '6290f8b3-0737-4492-8de5-f27de84a5a1e', None, None, None), ('3a65eeba-09aa-46e7-a378-b06f5822655f', None, None, None, None, None), ('3a65eeba-09aa-46e7-a378-b06f5822655f', None, None, None, None, None), ('29f753c7-df02-4765-94b5-9df128b873af', '10.2.2.100', None, None, None, None), ('29f753c7-df02-4765-94b5-9df128b873af', '10.2.2.200', None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:53:20.747546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2b1bf5cc-8ed9-4ca4-ba1f-f22d004e4559 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:20.756021 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2b1bf5cc-8ed9-4ca4-ba1f-f22d004e4559 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1468 microversion: 2.1 time: 0.339693 Feb 19 20:53:20.757020 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 420/820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:20 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1468 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:20.770909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-916a3ab8-0225-4cb7-86ba-77fde7211240 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39ca1219-a5f8-409e-8ab8-06e2e1d77c8c", "device": "/dev/xvdb"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:20.772284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-916a3ab8-0225-4cb7-86ba-77fde7211240 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:20.779048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-916a3ab8-0225-4cb7-86ba-77fde7211240 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:20.779500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-916a3ab8-0225-4cb7-86ba-77fde7211240 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:20.780292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-916a3ab8-0225-4cb7-86ba-77fde7211240 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:20.781015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-916a3ab8-0225-4cb7-86ba-77fde7211240 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:21.050319 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-916a3ab8-0225-4cb7-86ba-77fde7211240 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "POST /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.291885 Feb 19 20:53:21.056549 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 421/821] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Feb 19 20:53:20 2022] POST /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:53:21.058618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9adda897-c7b6-4bed-b919-669cae1c4db6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:21.059347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9adda897-c7b6-4bed-b919-669cae1c4db6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:21.075957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9adda897-c7b6-4bed-b919-669cae1c4db6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:21.076401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9adda897-c7b6-4bed-b919-669cae1c4db6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:21.078030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9adda897-c7b6-4bed-b919-669cae1c4db6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:21.078481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9adda897-c7b6-4bed-b919-669cae1c4db6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:21.641640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9adda897-c7b6-4bed-b919-669cae1c4db6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:21.649169 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9adda897-c7b6-4bed-b919-669cae1c4db6 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1324 microversion: 2.1 time: 0.596261 Feb 19 20:53:21.650159 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 422/822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:21 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1324 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:21.654933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0151476-076c-437f-9164-29b647d4ae26 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:21.655725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0151476-076c-437f-9164-29b647d4ae26 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:21.663398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0151476-076c-437f-9164-29b647d4ae26 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:21.663873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0151476-076c-437f-9164-29b647d4ae26 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:21.664738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0151476-076c-437f-9164-29b647d4ae26 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:21.665169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0151476-076c-437f-9164-29b647d4ae26 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:21.691960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-e0151476-076c-437f-9164-29b647d4ae26 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lazy-loading 'flavor' on Instance uuid aab7828d-f679-4460-9a84-3648c980318c {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:53:21.792888 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0151476-076c-437f-9164-29b647d4ae26 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c/action" status: 202 len: 0 microversion: 2.1 time: 0.140779 Feb 19 20:53:21.794852 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 423/823] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:21 2022] POST /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:53:21.811529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-07052957-0d22-4e03-80e8-22eb6a45e10e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:21.814574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-07052957-0d22-4e03-80e8-22eb6a45e10e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:21.824956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07052957-0d22-4e03-80e8-22eb6a45e10e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:21.825726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07052957-0d22-4e03-80e8-22eb6a45e10e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:21.826729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07052957-0d22-4e03-80e8-22eb6a45e10e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:21.827242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07052957-0d22-4e03-80e8-22eb6a45e10e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:22.592007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-07052957-0d22-4e03-80e8-22eb6a45e10e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:22.600297 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-07052957-0d22-4e03-80e8-22eb6a45e10e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1588 microversion: 2.1 time: 0.803236 Feb 19 20:53:22.600909 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 424/824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:21 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1588 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:22.605160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9cfb357a-2cf7-4fb1-bcb8-4b8d39c4ee37 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:22.605762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9cfb357a-2cf7-4fb1-bcb8-4b8d39c4ee37 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:22.612739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cfb357a-2cf7-4fb1-bcb8-4b8d39c4ee37 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:22.613315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cfb357a-2cf7-4fb1-bcb8-4b8d39c4ee37 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:22.614916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cfb357a-2cf7-4fb1-bcb8-4b8d39c4ee37 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:22.615632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cfb357a-2cf7-4fb1-bcb8-4b8d39c4ee37 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:23.111405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9cfb357a-2cf7-4fb1-bcb8-4b8d39c4ee37 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:23.123651 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9cfb357a-2cf7-4fb1-bcb8-4b8d39c4ee37 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.521636 Feb 19 20:53:23.124267 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 425/825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:22 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:23.128546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6c663675-6173-4843-a650-2e95e9e98704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:23.130036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6c663675-6173-4843-a650-2e95e9e98704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:23.137158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c663675-6173-4843-a650-2e95e9e98704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:23.137603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c663675-6173-4843-a650-2e95e9e98704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:23.138382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c663675-6173-4843-a650-2e95e9e98704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:23.138812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c663675-6173-4843-a650-2e95e9e98704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:23.678196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6c663675-6173-4843-a650-2e95e9e98704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:23.686963 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6c663675-6173-4843-a650-2e95e9e98704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1379 microversion: 2.1 time: 0.561654 Feb 19 20:53:23.697658 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 426/826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:23 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1379 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:23.697658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ba256d28-f7aa-4698-a4b6-19e82543abd9 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:23.697658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ba256d28-f7aa-4698-a4b6-19e82543abd9 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:23.700273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ba256d28-f7aa-4698-a4b6-19e82543abd9 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:23.700860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ba256d28-f7aa-4698-a4b6-19e82543abd9 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:23.702177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ba256d28-f7aa-4698-a4b6-19e82543abd9 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:23.702177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ba256d28-f7aa-4698-a4b6-19e82543abd9 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:24.188545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ba256d28-f7aa-4698-a4b6-19e82543abd9 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:24.201550 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ba256d28-f7aa-4698-a4b6-19e82543abd9 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1459 microversion: 2.1 time: 0.511975 Feb 19 20:53:24.203668 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 427/827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:23 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1459 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:24.210798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d247ae0a-e884-434a-a0ca-93736401c20d tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:24.211495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d247ae0a-e884-434a-a0ca-93736401c20d tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:24.221062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d247ae0a-e884-434a-a0ca-93736401c20d tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:24.221939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d247ae0a-e884-434a-a0ca-93736401c20d tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:24.224069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d247ae0a-e884-434a-a0ca-93736401c20d tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:24.224889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d247ae0a-e884-434a-a0ca-93736401c20d tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:24.722765 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d247ae0a-e884-434a-a0ca-93736401c20d tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.517500 Feb 19 20:53:24.724549 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 428/828] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 20:53:24 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791/os-interface => generated 284 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:24.737625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3db1db81-a53b-4b75-a434-20b2db30879e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:24.738751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3db1db81-a53b-4b75-a434-20b2db30879e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:24.746857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3db1db81-a53b-4b75-a434-20b2db30879e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:24.747509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3db1db81-a53b-4b75-a434-20b2db30879e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:24.748786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3db1db81-a53b-4b75-a434-20b2db30879e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:24.749585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3db1db81-a53b-4b75-a434-20b2db30879e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:25.324141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3db1db81-a53b-4b75-a434-20b2db30879e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:25.332101 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3db1db81-a53b-4b75-a434-20b2db30879e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1324 microversion: 2.1 time: 0.605042 Feb 19 20:53:25.344709 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 429/829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:24 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1324 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:25.350254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d94f161f-89ae-4cd7-834a-382456c030e1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:25.351074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d94f161f-89ae-4cd7-834a-382456c030e1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:25.357412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d94f161f-89ae-4cd7-834a-382456c030e1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:25.358124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d94f161f-89ae-4cd7-834a-382456c030e1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:25.359110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d94f161f-89ae-4cd7-834a-382456c030e1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:25.359711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d94f161f-89ae-4cd7-834a-382456c030e1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:25.905655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d94f161f-89ae-4cd7-834a-382456c030e1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:25.914637 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d94f161f-89ae-4cd7-834a-382456c030e1 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1472 microversion: 2.1 time: 0.568592 Feb 19 20:53:25.915338 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 430/830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:25 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1472 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:25.920010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-138fd18e-4895-4bfa-a2e5-e07adf685657 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:25.920900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-138fd18e-4895-4bfa-a2e5-e07adf685657 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:25.927592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-138fd18e-4895-4bfa-a2e5-e07adf685657 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:25.928408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-138fd18e-4895-4bfa-a2e5-e07adf685657 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:25.929733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-138fd18e-4895-4bfa-a2e5-e07adf685657 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:25.930275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-138fd18e-4895-4bfa-a2e5-e07adf685657 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:27.399303 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-138fd18e-4895-4bfa-a2e5-e07adf685657 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1610 microversion: 2.1 time: 1.482524 Feb 19 20:53:27.400425 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 431/831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:25 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1610 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:27.404936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2640c9eb-f33f-4a0c-b98e-e373de6d5fda tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:27.405648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2640c9eb-f33f-4a0c-b98e-e373de6d5fda tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:27.412962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2640c9eb-f33f-4a0c-b98e-e373de6d5fda tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:27.413487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2640c9eb-f33f-4a0c-b98e-e373de6d5fda tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:27.414346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2640c9eb-f33f-4a0c-b98e-e373de6d5fda tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:27.414862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2640c9eb-f33f-4a0c-b98e-e373de6d5fda tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:27.549014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:53:27.549495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:53:27.550087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:53:27.550571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:53:27.551062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:53:27.561059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:27.561502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:27.562322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:27.562761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:27.579964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Getting quotas for project a0981190244846a18036aa20dce2dc60. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:53:27.584032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Getting quotas for user 72ce9a80c4b444259dda1f6a63e6fe49 and project a0981190244846a18036aa20dce2dc60. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:53:27.750497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:53:27.754199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='03b5535c-cf30-4b6c-9466-5ea912a33e71',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='91cde230-36d5-44fb-bc24-28cbcdf3779b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e724d0d7-1022-4767-910f-d215fc344365',volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:53:27.849900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-2640c9eb-f33f-4a0c-b98e-e373de6d5fda tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid fa53378c-0deb-40cc-a2a5-bc55778f6146 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:53:27.863944 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2640c9eb-f33f-4a0c-b98e-e373de6d5fda tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 2129 microversion: 2.25 time: 0.462375 Feb 19 20:53:27.865269 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 432/832] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:27 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 2129 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:27.870099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad893a35-b788-4a38-8ae2-4e52d6331f1e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:27.870893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ad893a35-b788-4a38-8ae2-4e52d6331f1e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:27.877644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad893a35-b788-4a38-8ae2-4e52d6331f1e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:27.878452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad893a35-b788-4a38-8ae2-4e52d6331f1e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:27.880432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad893a35-b788-4a38-8ae2-4e52d6331f1e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:27.880841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad893a35-b788-4a38-8ae2-4e52d6331f1e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.086969 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-962e1745-2bb2-43c3-8b6f-69adae2ac70a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 7.561170 Feb 19 20:53:28.088580 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 401/833] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Feb 19 20:53:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 7563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 20:53:28.093648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c03813d4-a89b-4e0f-a871-2b4b754e132a req-2116db97-8b26-41f7-873f-ae9591989ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de", "tag": "191fbf35-b9ce-44cc-bb60-5039a7b3f93f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:28.095901 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:28.095901 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:28.104868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c03813d4-a89b-4e0f-a871-2b4b754e132a req-2116db97-8b26-41f7-873f-ae9591989ad7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.105537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c03813d4-a89b-4e0f-a871-2b4b754e132a req-2116db97-8b26-41f7-873f-ae9591989ad7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.120403 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c03813d4-a89b-4e0f-a871-2b4b754e132a req-2116db97-8b26-41f7-873f-ae9591989ad7 service nova] Creating event network-changed:191fbf35-b9ce-44cc-bb60-5039a7b3f93f for instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de on nch1-master-1 Feb 19 20:53:28.128832 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c03813d4-a89b-4e0f-a871-2b4b754e132a req-2116db97-8b26-41f7-873f-ae9591989ad7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039681 Feb 19 20:53:28.130209 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 402/834] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:28.136743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bd7ad753-65c6-4826-be2a-53e0e9c86157 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:28.137465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bd7ad753-65c6-4826-be2a-53e0e9c86157 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:28.147153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd7ad753-65c6-4826-be2a-53e0e9c86157 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.147616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd7ad753-65c6-4826-be2a-53e0e9c86157 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.148663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd7ad753-65c6-4826-be2a-53e0e9c86157 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.149113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd7ad753-65c6-4826-be2a-53e0e9c86157 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.227357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ad893a35-b788-4a38-8ae2-4e52d6331f1e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:28.237274 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ad893a35-b788-4a38-8ae2-4e52d6331f1e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1379 microversion: 2.1 time: 0.370367 Feb 19 20:53:28.241999 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 433/835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:27 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1379 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:28.249632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-29f0ddca-163a-4c3e-9aa1-78dd9a62a990 req-027743c7-1924-4eec-bcb7-b8611d36ed1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097ae8b7-1df3-4788-b5e3-5580b215bf98", "name": "network-vif-plugged", "status": "completed", "tag": "bbd45217-6a8e-439f-89c7-dd438e2032fd"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:28.251461 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:28.251461 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:28.260045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-29f0ddca-163a-4c3e-9aa1-78dd9a62a990 req-027743c7-1924-4eec-bcb7-b8611d36ed1c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.262295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-29f0ddca-163a-4c3e-9aa1-78dd9a62a990 req-027743c7-1924-4eec-bcb7-b8611d36ed1c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.274167 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-29f0ddca-163a-4c3e-9aa1-78dd9a62a990 req-027743c7-1924-4eec-bcb7-b8611d36ed1c service nova] Creating event network-vif-plugged:bbd45217-6a8e-439f-89c7-dd438e2032fd for instance 097ae8b7-1df3-4788-b5e3-5580b215bf98 on nch2-master-1 Feb 19 20:53:28.279231 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-29f0ddca-163a-4c3e-9aa1-78dd9a62a990 req-027743c7-1924-4eec-bcb7-b8611d36ed1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035815 Feb 19 20:53:28.279843 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 434/836] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:28.284800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f0572a95-e18f-45cf-ae6d-efc9dc1ca48d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:28.285491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f0572a95-e18f-45cf-ae6d-efc9dc1ca48d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:28.292187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0572a95-e18f-45cf-ae6d-efc9dc1ca48d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.292784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0572a95-e18f-45cf-ae6d-efc9dc1ca48d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.293569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0572a95-e18f-45cf-ae6d-efc9dc1ca48d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.295008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0572a95-e18f-45cf-ae6d-efc9dc1ca48d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.790861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bd7ad753-65c6-4826-be2a-53e0e9c86157 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:28.800279 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bd7ad753-65c6-4826-be2a-53e0e9c86157 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1324 microversion: 2.1 time: 0.668678 Feb 19 20:53:28.811442 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 403/837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:28 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1324 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:28.817678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c5285c55-704a-478b-a720-0141374f74e0 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:28.820575 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:28.820575 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:28.822692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5285c55-704a-478b-a720-0141374f74e0 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.823319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5285c55-704a-478b-a720-0141374f74e0 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.824448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5285c55-704a-478b-a720-0141374f74e0 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.825047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5285c55-704a-478b-a720-0141374f74e0 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.855203 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c5285c55-704a-478b-a720-0141374f74e0 tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042262 Feb 19 20:53:28.855921 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 404/838] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Feb 19 20:53:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:28.864885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff6ee662-966b-4c10-b860-0cf2b7503897 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:28.865974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff6ee662-966b-4c10-b860-0cf2b7503897 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:28.873017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff6ee662-966b-4c10-b860-0cf2b7503897 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.873468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff6ee662-966b-4c10-b860-0cf2b7503897 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.874249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff6ee662-966b-4c10-b860-0cf2b7503897 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:28.874860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff6ee662-966b-4c10-b860-0cf2b7503897 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:28.906448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-ff6ee662-966b-4c10-b860-0cf2b7503897 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'flavor' on Instance uuid fa53378c-0deb-40cc-a2a5-bc55778f6146 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:53:28.933664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff6ee662-966b-4c10-b860-0cf2b7503897 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Going to try to live migrate instance to nch1-master-1 {{(pid=136095) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 20:53:28.990934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0572a95-e18f-45cf-ae6d-efc9dc1ca48d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:29.000380 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f0572a95-e18f-45cf-ae6d-efc9dc1ca48d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1478 microversion: 2.1 time: 0.719147 Feb 19 20:53:29.012234 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 435/839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:28 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1478 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:29.020782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bbab0bc2-e7a3-4990-9072-95636494a6d9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:29.021416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bbab0bc2-e7a3-4990-9072-95636494a6d9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:29.027981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bbab0bc2-e7a3-4990-9072-95636494a6d9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:29.029001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bbab0bc2-e7a3-4990-9072-95636494a6d9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:29.030714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bbab0bc2-e7a3-4990-9072-95636494a6d9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:29.035346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bbab0bc2-e7a3-4990-9072-95636494a6d9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:29.499119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bbab0bc2-e7a3-4990-9072-95636494a6d9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:29.517622 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bbab0bc2-e7a3-4990-9072-95636494a6d9 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1588 microversion: 2.1 time: 0.503866 Feb 19 20:53:29.533194 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 436/840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:29 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1588 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:29.549313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:29.549953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:29.560772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:29.561659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:29.562624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:29.563052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:29.761996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:29.774239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:29.776224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:29.777435 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-809469d1-5cac-467b-a6a1-357a99c1f502 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1576 microversion: 2.42 time: 0.243192 Feb 19 20:53:29.784182 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 437/841] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:29 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:29.790378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:29.791777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:29.798695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:29.799384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:29.800374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:29.801004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:29.832194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Lazy-loading 'flavor' on Instance uuid aab7828d-f679-4460-9a84-3648c980318c {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:53:29.862108 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance aab7828d-f679-4460-9a84-3648c980318c while it is in vm_state suspended Feb 19 20:53:29.875029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance aab7828d-f679-4460-9a84-3648c980318c while it is in vm_state suspended {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:53:29.877520 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a6db4e8-dca7-4d52-b1fc-995e004a82cf tempest-LiveMigrationNegativeTest-1300925375 tempest-LiveMigrationNegativeTest-1300925375-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c/action" status: 409 len: 155 microversion: 2.1 time: 0.091462 Feb 19 20:53:29.879157 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 438/842] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:29 2022] POST /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c/action => generated 155 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:53:29.891824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df4c4541-5dca-44c0-920a-8d89e5b32fd6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:29.892964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-df4c4541-5dca-44c0-920a-8d89e5b32fd6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:29.906948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df4c4541-5dca-44c0-920a-8d89e5b32fd6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:29.907812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df4c4541-5dca-44c0-920a-8d89e5b32fd6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:29.909106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df4c4541-5dca-44c0-920a-8d89e5b32fd6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:29.909712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df4c4541-5dca-44c0-920a-8d89e5b32fd6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:30.526248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df4c4541-5dca-44c0-920a-8d89e5b32fd6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:30.539358 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df4c4541-5dca-44c0-920a-8d89e5b32fd6 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1379 microversion: 2.1 time: 0.657002 Feb 19 20:53:30.560814 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 439/843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:29 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1379 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:30.570150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f2de153-af2a-4b1a-bd7b-1f9c293e1cea tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:30.571509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f2de153-af2a-4b1a-bd7b-1f9c293e1cea tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:30.578629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f2de153-af2a-4b1a-bd7b-1f9c293e1cea tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:30.579482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f2de153-af2a-4b1a-bd7b-1f9c293e1cea tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:30.580499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f2de153-af2a-4b1a-bd7b-1f9c293e1cea tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:30.581505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f2de153-af2a-4b1a-bd7b-1f9c293e1cea tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.302310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1f2de153-af2a-4b1a-bd7b-1f9c293e1cea tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:31.315081 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f2de153-af2a-4b1a-bd7b-1f9c293e1cea tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1324 microversion: 2.1 time: 0.749886 Feb 19 20:53:31.330781 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 440/844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:30 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1324 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:31.338312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff6ee662-966b-4c10-b860-0cf2b7503897 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146/action" status: 202 len: 0 microversion: 2.25 time: 2.480998 Feb 19 20:53:31.339501 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 405/845] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 20:53:28 2022] POST /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146/action => generated 0 bytes in 2483 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:53:31.345790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-21b0fd47-d81d-47ff-9e3f-c48153a0b67f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:31.346469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-21b0fd47-d81d-47ff-9e3f-c48153a0b67f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:31.350826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bf2f4384-87bc-4b31-9ad8-719f6bb2f221 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:31.352269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bf2f4384-87bc-4b31-9ad8-719f6bb2f221 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:31.353242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21b0fd47-d81d-47ff-9e3f-c48153a0b67f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.353850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21b0fd47-d81d-47ff-9e3f-c48153a0b67f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.354811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21b0fd47-d81d-47ff-9e3f-c48153a0b67f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.355390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21b0fd47-d81d-47ff-9e3f-c48153a0b67f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.374344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf2f4384-87bc-4b31-9ad8-719f6bb2f221 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.381172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf2f4384-87bc-4b31-9ad8-719f6bb2f221 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.386085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf2f4384-87bc-4b31-9ad8-719f6bb2f221 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.386260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf2f4384-87bc-4b31-9ad8-719f6bb2f221 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.458055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-21b0fd47-d81d-47ff-9e3f-c48153a0b67f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:53:31.669222 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-21b0fd47-d81d-47ff-9e3f-c48153a0b67f tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 204 len: 0 microversion: 2.1 time: 0.336157 Feb 19 20:53:31.675340 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 441/846] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:53:31 2022] DELETE /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:53:31.681940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-19f50315-f2b2-4d01-a4be-124af2101583 req-7343a7ad-8a47-4749-a023-48d8280a00e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae68ed7f-2390-4238-aa17-0cc5a0fc1791", "tag": "8ac53ea3-5b94-4d4e-a851-73b51c046686"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:31.683713 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:31.683713 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:31.692006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-19f50315-f2b2-4d01-a4be-124af2101583 req-7343a7ad-8a47-4749-a023-48d8280a00e8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.692899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-19f50315-f2b2-4d01-a4be-124af2101583 req-7343a7ad-8a47-4749-a023-48d8280a00e8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.711228 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-19f50315-f2b2-4d01-a4be-124af2101583 req-7343a7ad-8a47-4749-a023-48d8280a00e8 service nova] Creating event network-changed:8ac53ea3-5b94-4d4e-a851-73b51c046686 for instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 on nch1-master-1 Feb 19 20:53:31.718664 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-19f50315-f2b2-4d01-a4be-124af2101583 req-7343a7ad-8a47-4749-a023-48d8280a00e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040931 Feb 19 20:53:31.720151 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 442/847] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:31.733458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ad0cefac-4135-4d70-9897-286ef4108a46 req-ecfe595d-31b3-4ad7-bfe8-79e43dc1e4fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e81722-edd5-49d7-ab7d-41e73614b6aa", "name": "network-vif-unplugged", "status": "completed", "tag": "3604b765-b301-4875-991d-4d4190639b69"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:31.744746 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:31.744746 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:31.753699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ad0cefac-4135-4d70-9897-286ef4108a46 req-ecfe595d-31b3-4ad7-bfe8-79e43dc1e4fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.754601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ad0cefac-4135-4d70-9897-286ef4108a46 req-ecfe595d-31b3-4ad7-bfe8-79e43dc1e4fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.767591 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ad0cefac-4135-4d70-9897-286ef4108a46 req-ecfe595d-31b3-4ad7-bfe8-79e43dc1e4fe service nova] Creating event network-vif-unplugged:3604b765-b301-4875-991d-4d4190639b69 for instance 18e81722-edd5-49d7-ab7d-41e73614b6aa on nch1-master-1 Feb 19 20:53:31.774158 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ad0cefac-4135-4d70-9897-286ef4108a46 req-ecfe595d-31b3-4ad7-bfe8-79e43dc1e4fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052102 Feb 19 20:53:31.775385 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 443/848] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:31.781653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:31.782607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:31.790978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.791691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.792884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.793510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.843610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bf2f4384-87bc-4b31-9ad8-719f6bb2f221 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:31.852299 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bf2f4384-87bc-4b31-9ad8-719f6bb2f221 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1478 microversion: 2.1 time: 0.511520 Feb 19 20:53:31.862910 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 406/849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:31 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1478 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:31.869329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:31.870302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:31.877639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.878341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.879314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:31.880659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:31.969674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:31.980499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:31.986023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:31.992365 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f3cdd20-2a2d-4ee7-82fa-6b30409337b8 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1594 microversion: 2.42 time: 0.215602 Feb 19 20:53:31.993165 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 444/850] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:31 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1594 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:32.003363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8aa6f379-6c92-4109-ab0d-c4cac6a7fffe tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:32.004233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8aa6f379-6c92-4109-ab0d-c4cac6a7fffe tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:32.014091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8aa6f379-6c92-4109-ab0d-c4cac6a7fffe tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:32.017524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8aa6f379-6c92-4109-ab0d-c4cac6a7fffe tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:32.018536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8aa6f379-6c92-4109-ab0d-c4cac6a7fffe tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:32.019161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8aa6f379-6c92-4109-ab0d-c4cac6a7fffe tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:32.624071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8aa6f379-6c92-4109-ab0d-c4cac6a7fffe tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:32.631953 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8aa6f379-6c92-4109-ab0d-c4cac6a7fffe tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1379 microversion: 2.1 time: 0.637624 Feb 19 20:53:32.632558 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 445/851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:31 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1379 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:32.639787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6bd91291-e18a-4581-9eb1-30b793ec412a tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:32.640677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6bd91291-e18a-4581-9eb1-30b793ec412a tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:32.646881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6bd91291-e18a-4581-9eb1-30b793ec412a tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:32.647604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6bd91291-e18a-4581-9eb1-30b793ec412a tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:32.648698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6bd91291-e18a-4581-9eb1-30b793ec412a tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:32.649353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6bd91291-e18a-4581-9eb1-30b793ec412a tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:32.675285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:32.694668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:32.697077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:32.698512 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-801b0460-7c2b-4632-82c6-1317615db304 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1646 microversion: 2.25 time: 0.833415 Feb 19 20:53:32.699672 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 407/852] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:31 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1646 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:32.711946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3ffc3925-58d8-482f-b410-b12c18777927 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:32.712621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3ffc3925-58d8-482f-b410-b12c18777927 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:32.718764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ffc3925-58d8-482f-b410-b12c18777927 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:32.719229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ffc3925-58d8-482f-b410-b12c18777927 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:32.720007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ffc3925-58d8-482f-b410-b12c18777927 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:32.720485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ffc3925-58d8-482f-b410-b12c18777927 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:33.425756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6bd91291-e18a-4581-9eb1-30b793ec412a tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:33.438767 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6bd91291-e18a-4581-9eb1-30b793ec412a tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1465 microversion: 2.1 time: 0.802245 Feb 19 20:53:33.449667 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 446/853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:32 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1465 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:33.454774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e3b1c52-aeeb-4a68-abd8-7aca6f78ae8d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:33.455599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e3b1c52-aeeb-4a68-abd8-7aca6f78ae8d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:33.462776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e3b1c52-aeeb-4a68-abd8-7aca6f78ae8d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:33.463454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e3b1c52-aeeb-4a68-abd8-7aca6f78ae8d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:33.464502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e3b1c52-aeeb-4a68-abd8-7aca6f78ae8d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:33.465099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e3b1c52-aeeb-4a68-abd8-7aca6f78ae8d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:33.607541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3ffc3925-58d8-482f-b410-b12c18777927 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:33.618532 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3ffc3925-58d8-482f-b410-b12c18777927 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 200 len: 1520 microversion: 2.1 time: 0.917475 Feb 19 20:53:33.622156 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 408/854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:32 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 1520 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:33.631104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:33.635001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:33.643010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:33.643654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:33.647198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:33.647956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:34.199423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6e3b1c52-aeeb-4a68-abd8-7aca6f78ae8d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:34.209347 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6e3b1c52-aeeb-4a68-abd8-7aca6f78ae8d tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1478 microversion: 2.1 time: 0.758031 Feb 19 20:53:34.210712 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 447/855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:33 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1478 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:34.217405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Action: 'action', calling method: .version_select at 0x7f6476880d30>, body: {"addFloatingIp": {"address": "172.35.2.72"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:34.221964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:34.233130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:34.233839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:34.234643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:34.235083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:34.333998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Acquired lock "refresh_cache-8d2c4005-033c-4df6-978e-8ec53d9ac654" {{(pid=136094) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:53:34.660491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:34.675558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:34.679182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:34.681572 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cf71eb1c-b480-4e8c-9f3a-9d9395caa535 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1661 microversion: 2.42 time: 1.058224 Feb 19 20:53:34.682909 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 409/856] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:33 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1661 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:34.690066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa94e827-0a14-46d8-9ac4-2f5238c3b1eb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:34.691131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aa94e827-0a14-46d8-9ac4-2f5238c3b1eb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:34.704243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa94e827-0a14-46d8-9ac4-2f5238c3b1eb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:34.706055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa94e827-0a14-46d8-9ac4-2f5238c3b1eb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:34.707119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa94e827-0a14-46d8-9ac4-2f5238c3b1eb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:34.708213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa94e827-0a14-46d8-9ac4-2f5238c3b1eb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:35.306040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa94e827-0a14-46d8-9ac4-2f5238c3b1eb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:35.319442 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa94e827-0a14-46d8-9ac4-2f5238c3b1eb tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1379 microversion: 2.1 time: 0.635257 Feb 19 20:53:35.326424 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 410/857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:34 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1379 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:35.332894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:35.333700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:35.342455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:35.344596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:35.350074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:35.350746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:35.919691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:35.933266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:35.934829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:35.935990 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d99b7e3-f8f5-464e-8c53-89381609d39e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1646 microversion: 2.25 time: 0.607460 Feb 19 20:53:35.936640 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 411/858] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:35 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1646 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:35.942045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-75769268-2567-41df-9168-2f4a872f0da0 req-393e701e-ef08-41af-855b-a0b1756a2c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e81722-edd5-49d7-ab7d-41e73614b6aa", "name": "network-vif-plugged", "status": "completed", "tag": "3604b765-b301-4875-991d-4d4190639b69"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:35.944484 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:35.944484 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:35.954315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-75769268-2567-41df-9168-2f4a872f0da0 req-393e701e-ef08-41af-855b-a0b1756a2c89 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:35.954764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-75769268-2567-41df-9168-2f4a872f0da0 req-393e701e-ef08-41af-855b-a0b1756a2c89 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:35.969801 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-75769268-2567-41df-9168-2f4a872f0da0 req-393e701e-ef08-41af-855b-a0b1756a2c89 service nova] Creating event network-vif-plugged:3604b765-b301-4875-991d-4d4190639b69 for instance 18e81722-edd5-49d7-ab7d-41e73614b6aa on nch1-master-1 Feb 19 20:53:35.975333 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-75769268-2567-41df-9168-2f4a872f0da0 req-393e701e-ef08-41af-855b-a0b1756a2c89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Feb 19 20:53:35.976052 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 412/859] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:35.981329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f475b26e-364b-45ad-80c5-73c4fcb9eb62 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:35.982027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f475b26e-364b-45ad-80c5-73c4fcb9eb62 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:35.988626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f475b26e-364b-45ad-80c5-73c4fcb9eb62 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:35.989654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f475b26e-364b-45ad-80c5-73c4fcb9eb62 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:35.990672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f475b26e-364b-45ad-80c5-73c4fcb9eb62 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:35.991114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f475b26e-364b-45ad-80c5-73c4fcb9eb62 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:36.792763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f475b26e-364b-45ad-80c5-73c4fcb9eb62 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:36.800953 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f475b26e-364b-45ad-80c5-73c4fcb9eb62 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 200 len: 1465 microversion: 2.1 time: 0.823401 Feb 19 20:53:36.811392 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 413/860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:35 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 1465 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:36.817398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1ada6e46-7088-4302-98c2-11cc97f52453 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:36.818227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1ada6e46-7088-4302-98c2-11cc97f52453 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:36.826871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ada6e46-7088-4302-98c2-11cc97f52453 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:36.827527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ada6e46-7088-4302-98c2-11cc97f52453 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:36.828684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ada6e46-7088-4302-98c2-11cc97f52453 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:36.829121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ada6e46-7088-4302-98c2-11cc97f52453 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:37.209004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1ada6e46-7088-4302-98c2-11cc97f52453 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:37.217367 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1ada6e46-7088-4302-98c2-11cc97f52453 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1478 microversion: 2.1 time: 0.404431 Feb 19 20:53:37.218512 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 414/861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:36 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1478 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:37.223137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:37.224423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:37.230336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:37.230804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:37.231581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:37.232039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:37.555166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:37.571734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:37.573376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:37.574582 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-829dfcca-9ac1-477e-889b-c377e221da23 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1695 microversion: 2.42 time: 0.355102 Feb 19 20:53:37.575225 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 415/862] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:37 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1695 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:37.632480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Building network info cache for instance {{(pid=136094) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 20:53:37.748189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f079cd9-22b2-4d25-a14d-2bf73362aa8c tempest-FlavorsV2NegativeTest-1726481676 tempest-FlavorsV2NegativeTest-1726481676-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:37.761731 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f079cd9-22b2-4d25-a14d-2bf73362aa8c tempest-FlavorsV2NegativeTest-1726481676 tempest-FlavorsV2NegativeTest-1726481676-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.185248 Feb 19 20:53:37.763018 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 416/863] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:53:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:37.775602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f2135e80-63a1-4bde-8e74-0aa37184d640 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:37.777087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f2135e80-63a1-4bde-8e74-0aa37184d640 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:37.797350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2135e80-63a1-4bde-8e74-0aa37184d640 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:37.799941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2135e80-63a1-4bde-8e74-0aa37184d640 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:37.802130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2135e80-63a1-4bde-8e74-0aa37184d640 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:37.802928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2135e80-63a1-4bde-8e74-0aa37184d640 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:38.245979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f2135e80-63a1-4bde-8e74-0aa37184d640 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:38.260295 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f2135e80-63a1-4bde-8e74-0aa37184d640 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1379 microversion: 2.1 time: 0.495906 Feb 19 20:53:38.261470 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 417/864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:37 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1379 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:38.266450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f07a7d2a-d520-4ab2-b9ef-55d61262725b req-e2b3f707-8e15-4936-a032-64734b313ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab7828d-f679-4460-9a84-3648c980318c", "name": "network-vif-deleted", "tag": "e07ea5eb-6c87-400c-888d-a30ece794d66"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:38.267975 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:38.267975 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:38.277919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f07a7d2a-d520-4ab2-b9ef-55d61262725b req-e2b3f707-8e15-4936-a032-64734b313ea8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:38.278458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f07a7d2a-d520-4ab2-b9ef-55d61262725b req-e2b3f707-8e15-4936-a032-64734b313ea8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:38.290940 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f07a7d2a-d520-4ab2-b9ef-55d61262725b req-e2b3f707-8e15-4936-a032-64734b313ea8 service nova] Creating event network-vif-deleted:e07ea5eb-6c87-400c-888d-a30ece794d66 for instance aab7828d-f679-4460-9a84-3648c980318c on nch2-master-1 Feb 19 20:53:38.296514 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f07a7d2a-d520-4ab2-b9ef-55d61262725b req-e2b3f707-8e15-4936-a032-64734b313ea8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033317 Feb 19 20:53:38.297141 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 418/865] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:38.303746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:38.305357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:38.314236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:38.314690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:38.315681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:38.316289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:38.811050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:38.820295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:38.821952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:38.823363 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4956032a-cbbe-44e1-9294-45abaa7b0d25 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1646 microversion: 2.25 time: 0.524405 Feb 19 20:53:38.824016 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 419/866] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:38 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1646 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:38.828741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c1866396-f896-42a0-93b5-46982f911b11 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:38.829643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c1866396-f896-42a0-93b5-46982f911b11 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: aab7828d-f679-4460-9a84-3648c980318c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:38.836320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1866396-f896-42a0-93b5-46982f911b11 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:38.837127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1866396-f896-42a0-93b5-46982f911b11 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:38.838274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1866396-f896-42a0-93b5-46982f911b11 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:38.838865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1866396-f896-42a0-93b5-46982f911b11 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:38.858051 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c1866396-f896-42a0-93b5-46982f911b11 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] HTTP exception thrown: Instance aab7828d-f679-4460-9a84-3648c980318c could not be found. Feb 19 20:53:38.858807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c1866396-f896-42a0-93b5-46982f911b11 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Returning 404 to user: Instance aab7828d-f679-4460-9a84-3648c980318c could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:53:38.859947 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c1866396-f896-42a0-93b5-46982f911b11 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c" status: 404 len: 111 microversion: 2.1 time: 0.034568 Feb 19 20:53:38.860683 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 420/867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:38 2022] GET /compute/v2.1/servers/aab7828d-f679-4460-9a84-3648c980318c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:53:38.868906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-27fc8f19-1e44-4e66-9980-58d7ecf81895 req-58d34e00-45f0-4e77-aff0-a60c799a0a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de", "name": "network-vif-plugged", "status": "completed", "tag": "191fbf35-b9ce-44cc-bb60-5039a7b3f93f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:38.870922 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:38.870922 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:38.878140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-27fc8f19-1e44-4e66-9980-58d7ecf81895 req-58d34e00-45f0-4e77-aff0-a60c799a0a78 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:38.878587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-27fc8f19-1e44-4e66-9980-58d7ecf81895 req-58d34e00-45f0-4e77-aff0-a60c799a0a78 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:38.891369 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-27fc8f19-1e44-4e66-9980-58d7ecf81895 req-58d34e00-45f0-4e77-aff0-a60c799a0a78 service nova] Creating event network-vif-plugged:191fbf35-b9ce-44cc-bb60-5039a7b3f93f for instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de on nch1-master-1 Feb 19 20:53:38.897019 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-27fc8f19-1e44-4e66-9980-58d7ecf81895 req-58d34e00-45f0-4e77-aff0-a60c799a0a78 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031739 Feb 19 20:53:38.897957 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 421/868] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:38.902910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a676cbc-f771-44bf-80e4-605e1c6619cd tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:38.903613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a676cbc-f771-44bf-80e4-605e1c6619cd tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:38.916811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a676cbc-f771-44bf-80e4-605e1c6619cd tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:38.917368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a676cbc-f771-44bf-80e4-605e1c6619cd tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:38.918295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a676cbc-f771-44bf-80e4-605e1c6619cd tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:38.919556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a676cbc-f771-44bf-80e4-605e1c6619cd tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:39.268217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Updating instance_info_cache with network_info: [{"id": "4313e698-6c12-4d1e-b019-f8d0163bad53", "address": "fa:16:3e:aa:50:ab", "network": {"id": "b5f73a2d-e0db-4f8e-b90f-72b9e4b05653", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1092693618-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "869a0cf6b5604ec89af633eb5012ff5b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4313e698-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136094) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 20:53:39.283212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Releasing lock "refresh_cache-8d2c4005-033c-4df6-978e-8ec53d9ac654" {{(pid=136094) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:53:39.284203 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2a8c3a7-2bb9-4a0d-8d5b-e8a13f3efadd tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "POST /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654/action" status: 202 len: 0 microversion: 2.1 time: 5.072214 Feb 19 20:53:39.288008 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 448/869] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:34 2022] POST /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654/action => generated 0 bytes in 5073 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 20:53:39.291568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3cc8bd23-9cc8-4380-bd85-041479b4aaf9 tempest-FlavorsV2NegativeTest-1726481676 tempest-FlavorsV2NegativeTest-1726481676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-774495070", "imageRef": "8635ce36-c351-41b4-addd-dc68f771fa7a", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:39.344166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-3cc8bd23-9cc8-4380-bd85-041479b4aaf9 tempest-FlavorsV2NegativeTest-1726481676 tempest-FlavorsV2NegativeTest-1726481676-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:53:39.539815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5a676cbc-f771-44bf-80e4-605e1c6619cd tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:39.547204 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5a676cbc-f771-44bf-80e4-605e1c6619cd tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1463 microversion: 2.1 time: 0.648122 Feb 19 20:53:39.547782 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 422/870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:38 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1463 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:39.552731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:39.553441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:39.564508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:39.564971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:39.565834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:39.566282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:39.878582 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-3cc8bd23-9cc8-4380-bd85-041479b4aaf9 tempest-FlavorsV2NegativeTest-1726481676 tempest-FlavorsV2NegativeTest-1726481676-project] HTTP exception thrown: Flavor's memory is too small for requested image. Feb 19 20:53:39.880359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3cc8bd23-9cc8-4380-bd85-041479b4aaf9 tempest-FlavorsV2NegativeTest-1726481676 tempest-FlavorsV2NegativeTest-1726481676-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:53:39.881226 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3cc8bd23-9cc8-4380-bd85-041479b4aaf9 tempest-FlavorsV2NegativeTest-1726481676 tempest-FlavorsV2NegativeTest-1726481676-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.595124 Feb 19 20:53:39.881819 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 449/871] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:53:39 2022] POST /compute/v2.1/servers => generated 93 bytes in 596 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:53:39.887927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-30e9e198-bdb4-461d-ab22-406f726b7394 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:39.888465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30e9e198-bdb4-461d-ab22-406f726b7394 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:39.899723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30e9e198-bdb4-461d-ab22-406f726b7394 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:39.900184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30e9e198-bdb4-461d-ab22-406f726b7394 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:39.901161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30e9e198-bdb4-461d-ab22-406f726b7394 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:39.901607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30e9e198-bdb4-461d-ab22-406f726b7394 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:39.935350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30e9e198-bdb4-461d-ab22-406f726b7394 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:53:40.029229 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-30e9e198-bdb4-461d-ab22-406f726b7394 tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 204 len: 0 microversion: 2.1 time: 0.143700 Feb 19 20:53:40.031200 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 450/872] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:53:39 2022] DELETE /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:53:40.052476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-90c26bb6-ed7b-42b4-beab-3ade0ec2d1a3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:40.053732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-90c26bb6-ed7b-42b4-beab-3ade0ec2d1a3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:40.058408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:40.063975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90c26bb6-ed7b-42b4-beab-3ade0ec2d1a3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:40.064973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90c26bb6-ed7b-42b4-beab-3ade0ec2d1a3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:40.066883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90c26bb6-ed7b-42b4-beab-3ade0ec2d1a3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:40.067307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:40.067631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90c26bb6-ed7b-42b4-beab-3ade0ec2d1a3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:40.068842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:40.081425 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-018311f0-0d36-4348-8f32-7df7d37704f3 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1787 microversion: 2.42 time: 0.532561 Feb 19 20:53:40.082040 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 423/873] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:39 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1787 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:40.087095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Action: 'action', calling method: .version_select at 0x7f64766d1700>, body: {"addFloatingIp": {"address": "172.35.2.72"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:40.088211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:40.103997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:40.105059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:40.106256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:40.107630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:40.175361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Acquired lock "refresh_cache-097ae8b7-1df3-4788-b5e3-5580b215bf98" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:53:40.598621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-90c26bb6-ed7b-42b4-beab-3ade0ec2d1a3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:40.608602 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-90c26bb6-ed7b-42b4-beab-3ade0ec2d1a3 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1379 microversion: 2.1 time: 0.576015 Feb 19 20:53:40.609329 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 451/874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:40 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1379 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:40.623892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c45db79f-357d-46cb-b160-d678afcc247c tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:40.625221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c45db79f-357d-46cb-b160-d678afcc247c tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:40.631956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c45db79f-357d-46cb-b160-d678afcc247c tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:40.632528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c45db79f-357d-46cb-b160-d678afcc247c tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:40.633387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c45db79f-357d-46cb-b160-d678afcc247c tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:40.634031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c45db79f-357d-46cb-b160-d678afcc247c tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:40.751994 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c45db79f-357d-46cb-b160-d678afcc247c tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action" status: 202 len: 0 microversion: 2.1 time: 0.131483 Feb 19 20:53:40.756395 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 452/875] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:40 2022] POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:53:40.765435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:40.766103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:40.773795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:40.774260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:40.775823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:40.776267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:41.663925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:41.672661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:41.674171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:41.675337 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1600b946-c1fb-4eed-97c9-86bbd93eb170 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1646 microversion: 2.25 time: 0.921065 Feb 19 20:53:41.696748 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 453/876] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:40 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1646 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:41.705021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-92c80342-7808-455f-a823-a68a882bb86e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:41.706182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-92c80342-7808-455f-a823-a68a882bb86e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:41.720085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92c80342-7808-455f-a823-a68a882bb86e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:41.720903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92c80342-7808-455f-a823-a68a882bb86e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:41.721862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92c80342-7808-455f-a823-a68a882bb86e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:41.722470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92c80342-7808-455f-a823-a68a882bb86e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:42.321753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-92c80342-7808-455f-a823-a68a882bb86e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05654d818a474f378f6cc02850b57e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e756cebb9c45ddb687ea373d7ddaa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:42.330422 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-92c80342-7808-455f-a823-a68a882bb86e tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 200 len: 1474 microversion: 2.1 time: 0.632325 Feb 19 20:53:42.334495 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 454/877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:41 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 1474 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:42.341573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4a6eb70e-970d-4aa7-98f1-9dfe793d915c req-8838ecd4-6641-4222-998b-2d956adcbff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2c4005-033c-4df6-978e-8ec53d9ac654", "tag": "4313e698-6c12-4d1e-b019-f8d0163bad53"}, {"server_uuid": "fa53378c-0deb-40cc-a2a5-bc55778f6146", "name": "network-vif-unplugged", "status": "completed", "tag": "a926fff0-c109-4640-adbe-9f6dd047f15f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:42.343981 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:42.343981 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:42.354997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4a6eb70e-970d-4aa7-98f1-9dfe793d915c req-8838ecd4-6641-4222-998b-2d956adcbff9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:42.355804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4a6eb70e-970d-4aa7-98f1-9dfe793d915c req-8838ecd4-6641-4222-998b-2d956adcbff9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:42.374514 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4a6eb70e-970d-4aa7-98f1-9dfe793d915c req-8838ecd4-6641-4222-998b-2d956adcbff9 service nova] Creating event network-changed:4313e698-6c12-4d1e-b019-f8d0163bad53 for instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 on nch2-master-1 Feb 19 20:53:42.376054 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4a6eb70e-970d-4aa7-98f1-9dfe793d915c req-8838ecd4-6641-4222-998b-2d956adcbff9 service nova] Creating event network-vif-unplugged:a926fff0-c109-4640-adbe-9f6dd047f15f for instance fa53378c-0deb-40cc-a2a5-bc55778f6146 on nch2-master-1 Feb 19 20:53:42.385412 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4a6eb70e-970d-4aa7-98f1-9dfe793d915c req-8838ecd4-6641-4222-998b-2d956adcbff9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.047964 Feb 19 20:53:42.386959 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 455/878] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:42.399292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:42.400776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:42.414104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:42.414850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:42.416702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:42.417313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:42.470049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:42.470609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:42.471211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lazy-loading 'fault' on Instance uuid 18e81722-edd5-49d7-ab7d-41e73614b6aa {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:53:43.091541 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b31235f9-dc19-41d2-8c54-4607d1c55e26 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1597 microversion: 2.1 time: 0.702687 Feb 19 20:53:43.105471 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 456/879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:42 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1597 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:43.111351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:43.112606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:43.123304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:43.124245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:43.125572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:43.126251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:44.108433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:44.122994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:44.125312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:44.126753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-555b6a04-6470-42e2-8df6-548b27b0ea62 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1833 microversion: 2.42 time: 1.019148 Feb 19 20:53:44.139855 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 457/880] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:43 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1833 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:44.146836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f601a7c7-9b8e-4daf-a199-6d3c25a23602 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:44.147683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f601a7c7-9b8e-4daf-a199-6d3c25a23602 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:44.155849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f601a7c7-9b8e-4daf-a199-6d3c25a23602 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:44.156600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f601a7c7-9b8e-4daf-a199-6d3c25a23602 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:44.157596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f601a7c7-9b8e-4daf-a199-6d3c25a23602 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:44.158199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f601a7c7-9b8e-4daf-a199-6d3c25a23602 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:44.824053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f601a7c7-9b8e-4daf-a199-6d3c25a23602 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:44.841931 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f601a7c7-9b8e-4daf-a199-6d3c25a23602 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1529 microversion: 2.1 time: 0.699926 Feb 19 20:53:44.843547 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 458/881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:44 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1529 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:44.859358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:44.863285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:44.875797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:44.877989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:44.880358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:44.884170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:45.328212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:45.344017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:45.346109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:45.347330 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e3894be6-cb3c-404f-98af-8d70244b5ce0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1646 microversion: 2.25 time: 0.500918 Feb 19 20:53:45.352683 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 459/882] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:44 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1646 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:45.365731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e534b222-80be-48f1-a0e8-b3b8deb0cdbc tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:45.366972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e534b222-80be-48f1-a0e8-b3b8deb0cdbc tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:45.377493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e534b222-80be-48f1-a0e8-b3b8deb0cdbc tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:45.383599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e534b222-80be-48f1-a0e8-b3b8deb0cdbc tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:45.386691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e534b222-80be-48f1-a0e8-b3b8deb0cdbc tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:45.387344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e534b222-80be-48f1-a0e8-b3b8deb0cdbc tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:45.525058 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e534b222-80be-48f1-a0e8-b3b8deb0cdbc tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action" status: 202 len: 0 microversion: 2.1 time: 0.167733 Feb 19 20:53:45.529643 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 460/883] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:45 2022] POST /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:53:45.535765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-69d798f3-58f3-4b68-a76d-c839f84366bd tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:45.537068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-69d798f3-58f3-4b68-a76d-c839f84366bd tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] [instance: a832621d-69be-4201-acf6-2f3ca91a42ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:45.546010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69d798f3-58f3-4b68-a76d-c839f84366bd tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:45.548380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69d798f3-58f3-4b68-a76d-c839f84366bd tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:45.550887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69d798f3-58f3-4b68-a76d-c839f84366bd tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:45.553014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69d798f3-58f3-4b68-a76d-c839f84366bd tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:45.579477 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-69d798f3-58f3-4b68-a76d-c839f84366bd tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] HTTP exception thrown: Instance a832621d-69be-4201-acf6-2f3ca91a42ed could not be found. Feb 19 20:53:45.580526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-69d798f3-58f3-4b68-a76d-c839f84366bd tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] Returning 404 to user: Instance a832621d-69be-4201-acf6-2f3ca91a42ed could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:53:45.582253 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-69d798f3-58f3-4b68-a76d-c839f84366bd tempest-LiveMigrationNegativeTest-1122703229 tempest-LiveMigrationNegativeTest-1122703229-project] 10.222.0.30 "GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed" status: 404 len: 111 microversion: 2.1 time: 0.050931 Feb 19 20:53:45.583295 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 461/884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:45 2022] GET /compute/v2.1/servers/a832621d-69be-4201-acf6-2f3ca91a42ed => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:53:45.591030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7d50fc06-8710-4a0c-9a32-87c4eb8f419f req-b523cbc1-fb5a-4e70-bbeb-05a1960d784a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa53378c-0deb-40cc-a2a5-bc55778f6146", "tag": "a926fff0-c109-4640-adbe-9f6dd047f15f"}, {"server_uuid": "a832621d-69be-4201-acf6-2f3ca91a42ed", "name": "network-vif-deleted", "tag": "48461d06-c79b-4c2b-8608-01b6aa1c3b24"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:45.593423 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:45.593423 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:45.604090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7d50fc06-8710-4a0c-9a32-87c4eb8f419f req-b523cbc1-fb5a-4e70-bbeb-05a1960d784a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:45.605622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7d50fc06-8710-4a0c-9a32-87c4eb8f419f req-b523cbc1-fb5a-4e70-bbeb-05a1960d784a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:45.627667 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7d50fc06-8710-4a0c-9a32-87c4eb8f419f req-b523cbc1-fb5a-4e70-bbeb-05a1960d784a service nova] Creating event network-changed:a926fff0-c109-4640-adbe-9f6dd047f15f for instance fa53378c-0deb-40cc-a2a5-bc55778f6146 on nch2-master-1 Feb 19 20:53:45.629052 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7d50fc06-8710-4a0c-9a32-87c4eb8f419f req-b523cbc1-fb5a-4e70-bbeb-05a1960d784a service nova] Creating event network-vif-deleted:48461d06-c79b-4c2b-8608-01b6aa1c3b24 for instance a832621d-69be-4201-acf6-2f3ca91a42ed on nch1-master-1 Feb 19 20:53:45.643443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7d50fc06-8710-4a0c-9a32-87c4eb8f419f req-b523cbc1-fb5a-4e70-bbeb-05a1960d784a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058678 Feb 19 20:53:45.645096 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 462/885] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:45.652620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df56e638-0fb6-41b3-9890-0a67f2f1fdca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:45.653760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-df56e638-0fb6-41b3-9890-0a67f2f1fdca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:45.666101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df56e638-0fb6-41b3-9890-0a67f2f1fdca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:45.667404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df56e638-0fb6-41b3-9890-0a67f2f1fdca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:45.669066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df56e638-0fb6-41b3-9890-0a67f2f1fdca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:45.671268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df56e638-0fb6-41b3-9890-0a67f2f1fdca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:45.681878 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.network.neutron [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] re-assign floating IP 172.35.2.72 from instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 Feb 19 20:53:45.768062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Building network info cache for instance {{(pid=136095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 20:53:46.930794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df56e638-0fb6-41b3-9890-0a67f2f1fdca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:46.940983 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df56e638-0fb6-41b3-9890-0a67f2f1fdca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1529 microversion: 2.1 time: 1.294106 Feb 19 20:53:46.941915 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 463/886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:45 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1529 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:46.950662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:46.957144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:46.975009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:46.975741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:46.978510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:46.979125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:47.565836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:47.604621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:47.606349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:47.607694 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1a2e3ec8-3290-4bba-85cb-1973b5df4041 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1833 microversion: 2.42 time: 0.664480 Feb 19 20:53:47.609037 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 464/887] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:46 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1833 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:47.613481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f1eae1b8-360f-4901-ae1f-3a1096a9c9e1 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:47.614701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f1eae1b8-360f-4901-ae1f-3a1096a9c9e1 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:47.628079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1eae1b8-360f-4901-ae1f-3a1096a9c9e1 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:47.628236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1eae1b8-360f-4901-ae1f-3a1096a9c9e1 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:47.630582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1eae1b8-360f-4901-ae1f-3a1096a9c9e1 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:47.631467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1eae1b8-360f-4901-ae1f-3a1096a9c9e1 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:48.092533 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f1eae1b8-360f-4901-ae1f-3a1096a9c9e1 tempest-ServersAdminTestJSON-1180764052 tempest-ServersAdminTestJSON-1180764052-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1614 microversion: 2.1 time: 0.482322 Feb 19 20:53:48.093168 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 465/888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:47 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1614 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:48.097458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:48.098780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:48.117767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:48.118221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:48.119033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:48.119478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:48.152642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Updating instance_info_cache with network_info: [{"id": "4313e698-6c12-4d1e-b019-f8d0163bad53", "address": "fa:16:3e:aa:50:ab", "network": {"id": "b5f73a2d-e0db-4f8e-b90f-72b9e4b05653", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1092693618-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "869a0cf6b5604ec89af633eb5012ff5b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4313e698-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 20:53:48.162565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Building network info cache for instance {{(pid=136095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 20:53:48.610758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:48.632772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:48.634998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:48.636667 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4ac7c983-4a3a-4d0e-b7b5-d06f24dc27a3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1646 microversion: 2.25 time: 0.542589 Feb 19 20:53:48.637421 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 466/889] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:48 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1646 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:48.649079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-702b4c8a-ad4e-4ae8-91c3-88b45f04cac0 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:48.651033 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:48.651033 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:48.697106 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-702b4c8a-ad4e-4ae8-91c3-88b45f04cac0 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/095b66d7-d6c5-4c13-8884-b31217056c4e" status: 202 len: 0 microversion: 2.1 time: 0.058203 Feb 19 20:53:48.707190 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 467/890] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:53:48 2022] DELETE /compute/v2.1/flavors/095b66d7-d6c5-4c13-8884-b31217056c4e => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:53:49.094726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b741456b-b73a-46cf-a530-c10a8f7b5015 tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Action: 'create', calling method: .version_select at 0x7f6467ed7160>, body: {"pool": null} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:50.163540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Updating instance_info_cache with network_info: [{"id": "bbd45217-6a8e-439f-89c7-dd438e2032fd", "address": "fa:16:3e:69:1b:9f", "network": {"id": "b5f73a2d-e0db-4f8e-b90f-72b9e4b05653", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1092693618-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "869a0cf6b5604ec89af633eb5012ff5b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbbd45217-6a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 20:53:50.181248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Releasing lock "refresh_cache-097ae8b7-1df3-4788-b5e3-5580b215bf98" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:53:50.182477 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-df51efea-7e29-46ff-8281-c2e7d79e6dd7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "POST /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98/action" status: 202 len: 0 microversion: 2.1 time: 10.098833 Feb 19 20:53:50.186766 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 424/891] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:40 2022] POST /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98/action => generated 0 bytes in 10101 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 20:53:50.194230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2a41c320-cf0f-40c6-b594-fa72a7492934 req-3613b182-73c0-469b-9237-36d35d1741ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2c4005-033c-4df6-978e-8ec53d9ac654", "tag": "4313e698-6c12-4d1e-b019-f8d0163bad53"}, {"name": "network-changed", "server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "tag": "a5a05223-8669-4696-8f96-528bee454543"}, {"name": "network-changed", "server_uuid": "097ae8b7-1df3-4788-b5e3-5580b215bf98", "tag": "bbd45217-6a8e-439f-89c7-dd438e2032fd"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:50.196047 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:50.196047 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:53:50.206083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2a41c320-cf0f-40c6-b594-fa72a7492934 req-3613b182-73c0-469b-9237-36d35d1741ed service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:50.206603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2a41c320-cf0f-40c6-b594-fa72a7492934 req-3613b182-73c0-469b-9237-36d35d1741ed service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:50.223629 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2a41c320-cf0f-40c6-b594-fa72a7492934 req-3613b182-73c0-469b-9237-36d35d1741ed service nova] Creating event network-changed:4313e698-6c12-4d1e-b019-f8d0163bad53 for instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 on nch2-master-1 Feb 19 20:53:50.224113 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2a41c320-cf0f-40c6-b594-fa72a7492934 req-3613b182-73c0-469b-9237-36d35d1741ed service nova] Creating event network-changed:a5a05223-8669-4696-8f96-528bee454543 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:53:50.224832 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2a41c320-cf0f-40c6-b594-fa72a7492934 req-3613b182-73c0-469b-9237-36d35d1741ed service nova] Creating event network-changed:bbd45217-6a8e-439f-89c7-dd438e2032fd for instance 097ae8b7-1df3-4788-b5e3-5580b215bf98 on nch2-master-1 Feb 19 20:53:50.233251 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2a41c320-cf0f-40c6-b594-fa72a7492934 req-3613b182-73c0-469b-9237-36d35d1741ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.044177 Feb 19 20:53:50.233987 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 425/892] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:50.240156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e08d1f2c-73a1-4ad8-a4c4-eb85c7f8a65b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:50.240947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e08d1f2c-73a1-4ad8-a4c4-eb85c7f8a65b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:50.247207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e08d1f2c-73a1-4ad8-a4c4-eb85c7f8a65b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:50.248674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e08d1f2c-73a1-4ad8-a4c4-eb85c7f8a65b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:50.249823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e08d1f2c-73a1-4ad8-a4c4-eb85c7f8a65b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:50.250433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e08d1f2c-73a1-4ad8-a4c4-eb85c7f8a65b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:50.286512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e08d1f2c-73a1-4ad8-a4c4-eb85c7f8a65b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:53:50.475917 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e08d1f2c-73a1-4ad8-a4c4-eb85c7f8a65b tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "DELETE /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 204 len: 0 microversion: 2.1 time: 0.240114 Feb 19 20:53:50.476995 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 426/893] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:53:50 2022] DELETE /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:53:50.482373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:50.483610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:50.490589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:50.491243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:50.492206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:50.493324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:51.119076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:51.145123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:51.147129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:51.149200 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-59ba1496-d118-47d3-a296-71f332e33c49 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.670992 Feb 19 20:53:51.162683 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 427/894] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:50 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:51.186507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a67a41e5-2359-456e-b24e-5aa837467ba7 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:51.213639 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a67a41e5-2359-456e-b24e-5aa837467ba7 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.049479 Feb 19 20:53:51.225346 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 428/895] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:53:51 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:51.230399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:51.231137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:51.239908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:51.240499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:51.241411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:51.241941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:51.864809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:51.878439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:51.880590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:51.882059 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f1a38e98-46f9-487a-8e13-37347c84aa1f tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1646 microversion: 2.25 time: 0.655240 Feb 19 20:53:51.900906 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 429/896] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:51 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1646 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:51.906823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4e6ab529-6209-4a16-820f-4d322c2aab55 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Action: 'action', calling method: .version_select at 0x7f647667e790>, body: {"removeFloatingIp": {"address": "172.35.2.72"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:52.341427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4e6ab529-6209-4a16-820f-4d322c2aab55 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:52.348754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e6ab529-6209-4a16-820f-4d322c2aab55 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:52.349435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e6ab529-6209-4a16-820f-4d322c2aab55 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:52.350425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e6ab529-6209-4a16-820f-4d322c2aab55 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:52.354094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e6ab529-6209-4a16-820f-4d322c2aab55 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:53.293633 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-4e6ab529-6209-4a16-820f-4d322c2aab55 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] HTTP exception thrown: Floating IP 172.35.2.72 is not associated with instance 8d2c4005-033c-4df6-978e-8ec53d9ac654. Feb 19 20:53:53.294229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4e6ab529-6209-4a16-820f-4d322c2aab55 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Returning 409 to user: Floating IP 172.35.2.72 is not associated with instance 8d2c4005-033c-4df6-978e-8ec53d9ac654. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:53:53.295074 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4e6ab529-6209-4a16-820f-4d322c2aab55 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "POST /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654/action" status: 409 len: 145 microversion: 2.1 time: 1.392725 Feb 19 20:53:53.295922 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 430/897] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:51 2022] POST /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654/action => generated 145 bytes in 1394 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:53:53.303943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-852b86ff-3eec-49cc-adb5-1433d4fed969 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:53.305011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-852b86ff-3eec-49cc-adb5-1433d4fed969 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:53.314481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-852b86ff-3eec-49cc-adb5-1433d4fed969 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:53.318435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-852b86ff-3eec-49cc-adb5-1433d4fed969 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:53.319479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-852b86ff-3eec-49cc-adb5-1433d4fed969 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:53.319839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-852b86ff-3eec-49cc-adb5-1433d4fed969 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:54.021581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-852b86ff-3eec-49cc-adb5-1433d4fed969 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:54.033138 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-852b86ff-3eec-49cc-adb5-1433d4fed969 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 200 len: 1469 microversion: 2.1 time: 0.735619 Feb 19 20:53:54.034129 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 431/898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:53 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 1469 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:54.039261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:54.040716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:54.050100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:54.050801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:54.052048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:54.052820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:54.107189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:54.114477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Old instance type tempest-test_resize_flavor_-1094324066, new instance type m1.heat {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 20:53:54.122406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:53:54.122841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:53:54.123315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:53:54.123726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:53:54.124369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:53:54.214789 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b8f42a65-11fe-4c0e-8f79-ebc1ec2b8aca tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de/action" status: 202 len: 0 microversion: 2.1 time: 0.179298 Feb 19 20:53:54.218241 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 432/899] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:54 2022] POST /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:53:54.222148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:54.223433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:54.236368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:54.236966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:54.238553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:54.239583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:54.422535 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b741456b-b73a-46cf-a530-c10a8f7b5015 tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.713253 Feb 19 20:53:54.424545 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 468/900] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:53:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:54.433604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-37612d78-e766-4fcc-8f93-47d116b7cefa req-ceb1bcb6-0d19-4668-b5b8-f02624276cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "tag": "e1552338-247f-46d8-ba3c-0852bc6b82e8"}, {"name": "network-changed", "server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "tag": "6290f8b3-0737-4492-8de5-f27de84a5a1e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:54.435567 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:54.435567 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:54.443714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-37612d78-e766-4fcc-8f93-47d116b7cefa req-ceb1bcb6-0d19-4668-b5b8-f02624276cd8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:54.444781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-37612d78-e766-4fcc-8f93-47d116b7cefa req-ceb1bcb6-0d19-4668-b5b8-f02624276cd8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:54.460794 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-37612d78-e766-4fcc-8f93-47d116b7cefa req-ceb1bcb6-0d19-4668-b5b8-f02624276cd8 service nova] Creating event network-changed:e1552338-247f-46d8-ba3c-0852bc6b82e8 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:53:54.461615 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-37612d78-e766-4fcc-8f93-47d116b7cefa req-ceb1bcb6-0d19-4668-b5b8-f02624276cd8 service nova] Creating event network-changed:6290f8b3-0737-4492-8de5-f27de84a5a1e for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:53:54.467983 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-37612d78-e766-4fcc-8f93-47d116b7cefa req-ceb1bcb6-0d19-4668-b5b8-f02624276cd8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042126 Feb 19 20:53:54.469046 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 469/901] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:54.476053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:54.477040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:54.484597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:54.485666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:54.486789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:54.487875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:55.136109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:55.146080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:55.147611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:55.148801 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-64286dbf-f9b1-4ef6-911e-8ebff5c3c612 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.932107 Feb 19 20:53:55.157890 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 433/902] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:54 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:55.175670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.72"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:55.350018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:55.358953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:55.370302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:55.371511 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df683adb-bf8b-47cb-9009-7da46de543c6 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1646 microversion: 2.25 time: 0.900973 Feb 19 20:53:55.372597 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 470/903] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:54 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1646 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:55.377243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00514170-f6e9-4024-8b88-52127057a836 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:55.387863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-00514170-f6e9-4024-8b88-52127057a836 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:55.403650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00514170-f6e9-4024-8b88-52127057a836 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:55.404096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00514170-f6e9-4024-8b88-52127057a836 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:55.404934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00514170-f6e9-4024-8b88-52127057a836 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:55.405372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00514170-f6e9-4024-8b88-52127057a836 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:55.560772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:55.567609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:55.568058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:55.568903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:55.569347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:56.032932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-00514170-f6e9-4024-8b88-52127057a836 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:56.041658 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-00514170-f6e9-4024-8b88-52127057a836 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1538 microversion: 2.1 time: 0.667886 Feb 19 20:53:56.046629 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 471/904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:55 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1538 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:53:56.051751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d23cd090-0ea4-43fb-a50b-86abff491f69 tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Calling method '.version_select at 0x7f6467c6fc10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:56.710813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Acquired lock "refresh_cache-097ae8b7-1df3-4788-b5e3-5580b215bf98" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:53:57.042523 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d23cd090-0ea4-43fb-a50b-86abff491f69 tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/16146d0d-6abf-4703-a4e4-fdb86e67af5c" status: 200 len: 141 microversion: 2.1 time: 0.994447 Feb 19 20:53:57.049275 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 472/905] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:53:56 2022] GET /compute/v2.1/os-floating-ips/16146d0d-6abf-4703-a4e4-fdb86e67af5c => generated 141 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:57.049275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bf3409e7-814e-4e36-802a-0c78e6e6c53f tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:57.049275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bf3409e7-814e-4e36-802a-0c78e6e6c53f tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 77b664ff-b2ee-4815-9cc7-5a1895e092a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:57.069679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf3409e7-814e-4e36-802a-0c78e6e6c53f tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:57.070535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf3409e7-814e-4e36-802a-0c78e6e6c53f tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:57.071947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf3409e7-814e-4e36-802a-0c78e6e6c53f tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:57.072511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf3409e7-814e-4e36-802a-0c78e6e6c53f tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:57.093453 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-bf3409e7-814e-4e36-802a-0c78e6e6c53f tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] HTTP exception thrown: Instance 77b664ff-b2ee-4815-9cc7-5a1895e092a2 could not be found. Feb 19 20:53:57.109546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bf3409e7-814e-4e36-802a-0c78e6e6c53f tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Returning 404 to user: Instance 77b664ff-b2ee-4815-9cc7-5a1895e092a2 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:53:57.114890 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bf3409e7-814e-4e36-802a-0c78e6e6c53f tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2" status: 404 len: 111 microversion: 2.1 time: 0.067229 Feb 19 20:53:57.115954 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 473/906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:57 2022] GET /compute/v2.1/servers/77b664ff-b2ee-4815-9cc7-5a1895e092a2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:53:57.122339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:57.124203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:57.131168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:57.132543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:57.133646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:57.134325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:57.938757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:57.948698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:57.965463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:57.967684 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0c626ebe-60b2-47a9-83da-cfed7237da32 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.850164 Feb 19 20:53:57.968466 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 474/907] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:57 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:57.973446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:57.974216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:57.987093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:57.989518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:57.990489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:57.997375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:58.864625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:58.882612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:58.886210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:53:58.888365 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9a414c61-facb-4447-a151-796140adbc5a tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1636 microversion: 2.25 time: 0.918800 Feb 19 20:53:58.892431 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 475/908] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:53:57 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1636 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:53:58.904125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-2957157e-7df9-44e7-947d-5682801e48e6 req-76b5c1c0-6560-4039-9b15-cfa892168561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "tag": "1e1241d9-ddbc-426c-9df0-86c2c9670f97"}, {"server_uuid": "77b664ff-b2ee-4815-9cc7-5a1895e092a2", "name": "network-vif-deleted", "tag": "a7ef59b7-3a86-414d-98e0-dccf483c634e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:53:58.909689 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:53:58.909689 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:53:58.924137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2957157e-7df9-44e7-947d-5682801e48e6 req-76b5c1c0-6560-4039-9b15-cfa892168561 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:58.925059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2957157e-7df9-44e7-947d-5682801e48e6 req-76b5c1c0-6560-4039-9b15-cfa892168561 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:58.959007 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-2957157e-7df9-44e7-947d-5682801e48e6 req-76b5c1c0-6560-4039-9b15-cfa892168561 service nova] Creating event network-changed:1e1241d9-ddbc-426c-9df0-86c2c9670f97 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:53:58.965264 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-2957157e-7df9-44e7-947d-5682801e48e6 req-76b5c1c0-6560-4039-9b15-cfa892168561 service nova] Creating event network-vif-deleted:a7ef59b7-3a86-414d-98e0-dccf483c634e for instance 77b664ff-b2ee-4815-9cc7-5a1895e092a2 on nch1-master-1 Feb 19 20:53:58.989960 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-2957157e-7df9-44e7-947d-5682801e48e6 req-76b5c1c0-6560-4039-9b15-cfa892168561 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.093666 Feb 19 20:53:58.991811 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 476/909] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:59.001007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2ff7034-b6ae-4746-9220-efd4be969635 tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Calling method '.version_select at 0x7f6467cd6790>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:59.603563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Building network info cache for instance {{(pid=136095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 20:53:59.733556 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2ff7034-b6ae-4746-9220-efd4be969635 tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.738422 Feb 19 20:53:59.734633 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 477/910] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 20:53:58 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:53:59.740350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a66f3003-c4d2-4339-9683-d6c5b52bac98 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:53:59.741518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a66f3003-c4d2-4339-9683-d6c5b52bac98 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:53:59.761704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a66f3003-c4d2-4339-9683-d6c5b52bac98 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:59.764000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a66f3003-c4d2-4339-9683-d6c5b52bac98 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:53:59.766030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a66f3003-c4d2-4339-9683-d6c5b52bac98 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:53:59.767463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a66f3003-c4d2-4339-9683-d6c5b52bac98 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:00.430455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a66f3003-c4d2-4339-9683-d6c5b52bac98 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:00.440492 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a66f3003-c4d2-4339-9683-d6c5b52bac98 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1543 microversion: 2.1 time: 0.704675 Feb 19 20:54:00.442281 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 478/911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:53:59 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1543 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:00.453851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-358193da-7a79-434a-9bc0-d7525cc32432 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:00.454748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-358193da-7a79-434a-9bc0-d7525cc32432 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:00.462632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-358193da-7a79-434a-9bc0-d7525cc32432 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:00.463362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-358193da-7a79-434a-9bc0-d7525cc32432 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:00.464510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-358193da-7a79-434a-9bc0-d7525cc32432 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:00.465106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-358193da-7a79-434a-9bc0-d7525cc32432 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:00.508511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-358193da-7a79-434a-9bc0-d7525cc32432 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:54:00.713500 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-358193da-7a79-434a-9bc0-d7525cc32432 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "DELETE /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 204 len: 0 microversion: 2.1 time: 0.268680 Feb 19 20:54:00.715327 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 479/912] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:00 2022] DELETE /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:54:00.727332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1df3b93a-265d-4200-b19b-c6ae5bb166ef tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '.version_select at 0x7f6467dcfdc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:00.729339 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:00.729339 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:00.733271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1df3b93a-265d-4200-b19b-c6ae5bb166ef tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:00.734317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1df3b93a-265d-4200-b19b-c6ae5bb166ef tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:00.768115 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1df3b93a-265d-4200-b19b-c6ae5bb166ef tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2542 microversion: 2.25 time: 0.051387 Feb 19 20:54:00.769511 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 480/913] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Feb 19 20:54:00 2022] GET /compute/v2.1/os-migrations => generated 2542 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:00.775357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:00.776296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:00.784309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:00.784998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:00.786856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:00.787483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:01.778248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:01.788111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:01.789642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:01.790777 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14d0c40e-668c-4973-a30e-f022e9abb609 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 1.019510 Feb 19 20:54:01.791330 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 481/914] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:00 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:01.795676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4d43d64f-aeac-4500-a1f8-cd5b85e9ffee tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Calling method '.version_select at 0x7f6467cb0ca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:01.975404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Updating instance_info_cache with network_info: [{"id": "bbd45217-6a8e-439f-89c7-dd438e2032fd", "address": "fa:16:3e:69:1b:9f", "network": {"id": "b5f73a2d-e0db-4f8e-b90f-72b9e4b05653", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1092693618-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "869a0cf6b5604ec89af633eb5012ff5b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbbd45217-6a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 20:54:01.987292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Releasing lock "refresh_cache-097ae8b7-1df3-4788-b5e3-5580b215bf98" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:54:01.988154 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ee473b68-b3ab-4590-be79-661b2a3965b1 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "POST /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98/action" status: 202 len: 0 microversion: 2.1 time: 6.829778 Feb 19 20:54:01.990549 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 434/915] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:53:55 2022] POST /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98/action => generated 0 bytes in 6833 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 20:54:01.995653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c0829ddf-50f2-4572-a00d-4041d2377495 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:01.996271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c0829ddf-50f2-4572-a00d-4041d2377495 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:02.002143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0829ddf-50f2-4572-a00d-4041d2377495 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:02.002595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0829ddf-50f2-4572-a00d-4041d2377495 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:02.003419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0829ddf-50f2-4572-a00d-4041d2377495 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:02.003858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0829ddf-50f2-4572-a00d-4041d2377495 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:02.413738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c0829ddf-50f2-4572-a00d-4041d2377495 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:02.425334 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c0829ddf-50f2-4572-a00d-4041d2377495 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1469 microversion: 2.1 time: 0.433519 Feb 19 20:54:02.426691 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 435/916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:01 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1469 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:02.431796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1af8f8fe-7f61-44d9-b016-4e8e09c36cf3 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:02.432658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1af8f8fe-7f61-44d9-b016-4e8e09c36cf3 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:02.440684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1af8f8fe-7f61-44d9-b016-4e8e09c36cf3 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:02.441488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1af8f8fe-7f61-44d9-b016-4e8e09c36cf3 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:02.442481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1af8f8fe-7f61-44d9-b016-4e8e09c36cf3 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:02.443124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1af8f8fe-7f61-44d9-b016-4e8e09c36cf3 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:02.775898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-1af8f8fe-7f61-44d9-b016-4e8e09c36cf3 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid fa53378c-0deb-40cc-a2a5-bc55778f6146 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:54:02.791462 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1af8f8fe-7f61-44d9-b016-4e8e09c36cf3 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 2129 microversion: 2.25 time: 0.363398 Feb 19 20:54:02.792157 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 436/917] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:02 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 2129 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:02.805991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-fbf73134-aad0-4f4c-9801-c6ace2d03c8d req-9daf437e-e1b7-4df8-9da2-7121e1fea8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "tag": "8bb1ce04-77ae-47cb-af1b-16718979fb14"}, {"name": "network-changed", "server_uuid": "097ae8b7-1df3-4788-b5e3-5580b215bf98", "tag": "bbd45217-6a8e-439f-89c7-dd438e2032fd"}, {"name": "network-changed", "server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "tag": "2bd27571-334d-4e5a-a015-91dd528ffb9f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:02.808107 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:02.808107 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:02.816278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fbf73134-aad0-4f4c-9801-c6ace2d03c8d req-9daf437e-e1b7-4df8-9da2-7121e1fea8ca service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:02.817364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fbf73134-aad0-4f4c-9801-c6ace2d03c8d req-9daf437e-e1b7-4df8-9da2-7121e1fea8ca service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:02.830009 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fbf73134-aad0-4f4c-9801-c6ace2d03c8d req-9daf437e-e1b7-4df8-9da2-7121e1fea8ca service nova] Creating event network-changed:8bb1ce04-77ae-47cb-af1b-16718979fb14 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:02.830516 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fbf73134-aad0-4f4c-9801-c6ace2d03c8d req-9daf437e-e1b7-4df8-9da2-7121e1fea8ca service nova] Creating event network-changed:bbd45217-6a8e-439f-89c7-dd438e2032fd for instance 097ae8b7-1df3-4788-b5e3-5580b215bf98 on nch2-master-1 Feb 19 20:54:02.831194 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fbf73134-aad0-4f4c-9801-c6ace2d03c8d req-9daf437e-e1b7-4df8-9da2-7121e1fea8ca service nova] Creating event network-changed:2bd27571-334d-4e5a-a015-91dd528ffb9f for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:02.840987 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-fbf73134-aad0-4f4c-9801-c6ace2d03c8d req-9daf437e-e1b7-4df8-9da2-7121e1fea8ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.046818 Feb 19 20:54:02.842056 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 437/918] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:03.084356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1377045563", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "e1715c46-c90a-49c7-8aa3-a86a06453327"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:03.187608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] validate_networks() for [('e1715c46-c90a-49c7-8aa3-a86a06453327', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:54:03.750828 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4d43d64f-aeac-4500-a1f8-cd5b85e9ffee tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/16146d0d-6abf-4703-a4e4-fdb86e67af5c" status: 202 len: 0 microversion: 2.1 time: 1.958437 Feb 19 20:54:03.757503 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 482/919] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:54:01 2022] DELETE /compute/v2.1/os-floating-ips/16146d0d-6abf-4703-a4e4-fdb86e67af5c => generated 0 bytes in 1965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:54:03.762438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d53cf9b1-b23b-4f45-b67c-48c3c82ddaf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:03.763287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d53cf9b1-b23b-4f45-b67c-48c3c82ddaf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:03.780109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d53cf9b1-b23b-4f45-b67c-48c3c82ddaf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:03.780620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d53cf9b1-b23b-4f45-b67c-48c3c82ddaf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:03.781432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d53cf9b1-b23b-4f45-b67c-48c3c82ddaf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:03.781869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d53cf9b1-b23b-4f45-b67c-48c3c82ddaf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:04.414411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d53cf9b1-b23b-4f45-b67c-48c3c82ddaf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:04.422490 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d53cf9b1-b23b-4f45-b67c-48c3c82ddaf5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1543 microversion: 2.1 time: 0.663651 Feb 19 20:54:04.423501 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 483/920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:03 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1543 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:04.428820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e334ed5-3add-4a10-a2a8-ca5859b7c1e3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:04.429673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5e334ed5-3add-4a10-a2a8-ca5859b7c1e3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:04.435795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e334ed5-3add-4a10-a2a8-ca5859b7c1e3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:04.436851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e334ed5-3add-4a10-a2a8-ca5859b7c1e3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:04.437860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e334ed5-3add-4a10-a2a8-ca5859b7c1e3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:04.438630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e334ed5-3add-4a10-a2a8-ca5859b7c1e3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:04.478006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5e334ed5-3add-4a10-a2a8-ca5859b7c1e3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:54:04.497564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:54:04.499434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:54:04.500765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:54:04.501407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:54:04.502144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:54:04.528891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:04.529374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:04.530654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:04.531110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:04.596882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Getting quotas for project 8a274e94e3e643c4b814892e2429db0e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:04.615698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Getting quotas for user d05e321d65ab4c218cebea855d1aad86 and project 8a274e94e3e643c4b814892e2429db0e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:04.643014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:54:04.645452 ncdv-master-1 devstack@n-api.service[136095]: WARNING nova.utils [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1377045563 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-137704556 Feb 19 20:54:04.646520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:54:04.654081 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5e334ed5-3add-4a10-a2a8-ca5859b7c1e3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "DELETE /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 204 len: 0 microversion: 2.1 time: 0.229008 Feb 19 20:54:04.668533 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 484/921] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:04 2022] DELETE /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:54:04.686460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:04.690385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:04.707475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:04.707922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:04.714324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:04.716248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:04.766476 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-41f08a4a-f585-40f9-a8b8-a78650a468dc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.922794 Feb 19 20:54:04.767865 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 438/922] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:54:04.778632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0f3a8481-6076-4e61-a4e7-67e1d25cb090 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:04.779630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0f3a8481-6076-4e61-a4e7-67e1d25cb090 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:04.790976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f3a8481-6076-4e61-a4e7-67e1d25cb090 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:04.791448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f3a8481-6076-4e61-a4e7-67e1d25cb090 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:04.792260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f3a8481-6076-4e61-a4e7-67e1d25cb090 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:04.792740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f3a8481-6076-4e61-a4e7-67e1d25cb090 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:05.563262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-0f3a8481-6076-4e61-a4e7-67e1d25cb090 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid fa53378c-0deb-40cc-a2a5-bc55778f6146 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:54:05.586745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:05.590969 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0f3a8481-6076-4e61-a4e7-67e1d25cb090 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 2129 microversion: 2.25 time: 0.821841 Feb 19 20:54:05.591814 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 439/923] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:04 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 2129 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:05.596883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:05.597489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:05.606589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:05.607573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:05.611583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:05.618992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:05.632828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:05.641393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:05.648727 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-306fdc0e-48dc-42c0-9d38-1cb2d1563dd9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.969488 Feb 19 20:54:05.650817 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 485/924] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:04 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:05.661445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1ee3075-5c6d-4737-9fe5-9d9f62a10e0b tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Action: 'create', calling method: .version_select at 0x7f6467c3dd30>, body: {"pool": null} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:05.690531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:05.690989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:05.691444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lazy-loading 'fault' on Instance uuid 29bbfea3-acce-4b4e-93c6-6b92a5d9196d {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:54:05.794921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:05.803469 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e6a0042e-5c07-4c46-9e7e-1dee111c5675 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 200 len: 1303 microversion: 2.1 time: 0.209951 Feb 19 20:54:05.804116 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 440/925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:05 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:05.809543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d6dd4770-1fc7-4b64-90b4-80c93bbebc35 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:05.810308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d6dd4770-1fc7-4b64-90b4-80c93bbebc35 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:05.817585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6dd4770-1fc7-4b64-90b4-80c93bbebc35 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:05.818369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6dd4770-1fc7-4b64-90b4-80c93bbebc35 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:05.819362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6dd4770-1fc7-4b64-90b4-80c93bbebc35 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:05.819945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6dd4770-1fc7-4b64-90b4-80c93bbebc35 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:05.846371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d6dd4770-1fc7-4b64-90b4-80c93bbebc35 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:54:05.944317 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d6dd4770-1fc7-4b64-90b4-80c93bbebc35 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 204 len: 0 microversion: 2.1 time: 0.138370 Feb 19 20:54:05.946906 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 441/926] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:05 2022] DELETE /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:54:05.954190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.72"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:05.955437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:05.962241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:05.962691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:05.964283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:05.964900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:05.996299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Acquired lock "refresh_cache-8d2c4005-033c-4df6-978e-8ec53d9ac654" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:54:09.704245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Building network info cache for instance {{(pid=136095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 20:54:09.839515 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b1ee3075-5c6d-4737-9fe5-9d9f62a10e0b tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.185714 Feb 19 20:54:09.842057 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 486/927] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:54:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:09.854348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ae85ac5b-208b-47e9-97bc-41e3cdd27c25 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:09.855482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae85ac5b-208b-47e9-97bc-41e3cdd27c25 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:09.866243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae85ac5b-208b-47e9-97bc-41e3cdd27c25 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:09.866800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae85ac5b-208b-47e9-97bc-41e3cdd27c25 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:09.867771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae85ac5b-208b-47e9-97bc-41e3cdd27c25 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:09.868485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae85ac5b-208b-47e9-97bc-41e3cdd27c25 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:10.480779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ae85ac5b-208b-47e9-97bc-41e3cdd27c25 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:10.493782 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ae85ac5b-208b-47e9-97bc-41e3cdd27c25 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1332 microversion: 2.1 time: 0.650270 Feb 19 20:54:10.499174 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 487/928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:09 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1332 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:10.504836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-37d50fef-a831-4c7c-903a-540e2bfe2f0d req-083b47b5-e841-4f4b-9163-869bb0e0930c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "tag": "72bb29c9-1a0c-4c88-a3aa-9aed178a43cc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:10.510109 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:10.510109 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:10.517622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-37d50fef-a831-4c7c-903a-540e2bfe2f0d req-083b47b5-e841-4f4b-9163-869bb0e0930c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:10.518066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-37d50fef-a831-4c7c-903a-540e2bfe2f0d req-083b47b5-e841-4f4b-9163-869bb0e0930c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:10.530515 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-37d50fef-a831-4c7c-903a-540e2bfe2f0d req-083b47b5-e841-4f4b-9163-869bb0e0930c service nova] Creating event network-changed:72bb29c9-1a0c-4c88-a3aa-9aed178a43cc for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:10.536777 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-37d50fef-a831-4c7c-903a-540e2bfe2f0d req-083b47b5-e841-4f4b-9163-869bb0e0930c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036325 Feb 19 20:54:10.537382 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 488/929] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:10.542820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7f851dbd-e17d-48ef-a65a-4ce6566e589c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:10.543525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7f851dbd-e17d-48ef-a65a-4ce6566e589c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:10.551527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f851dbd-e17d-48ef-a65a-4ce6566e589c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:10.551987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f851dbd-e17d-48ef-a65a-4ce6566e589c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:10.552888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f851dbd-e17d-48ef-a65a-4ce6566e589c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:10.553495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f851dbd-e17d-48ef-a65a-4ce6566e589c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:11.161750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7f851dbd-e17d-48ef-a65a-4ce6566e589c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:11.168996 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7f851dbd-e17d-48ef-a65a-4ce6566e589c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1543 microversion: 2.1 time: 0.630019 Feb 19 20:54:11.169562 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 489/930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:10 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1543 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:11.174689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c6bf0be2-1426-4611-a0a5-70932420fe48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:11.174885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c6bf0be2-1426-4611-a0a5-70932420fe48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:11.180810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6bf0be2-1426-4611-a0a5-70932420fe48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:11.181607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6bf0be2-1426-4611-a0a5-70932420fe48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:11.182031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6bf0be2-1426-4611-a0a5-70932420fe48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:11.182463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6bf0be2-1426-4611-a0a5-70932420fe48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:11.261240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-c6bf0be2-1426-4611-a0a5-70932420fe48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lazy-loading 'services' on Instance uuid fa53378c-0deb-40cc-a2a5-bc55778f6146 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:54:11.330513 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c6bf0be2-1426-4611-a0a5-70932420fe48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146/os-volume_attachments/39ca1219-a5f8-409e-8ab8-06e2e1d77c8c" status: 202 len: 0 microversion: 2.25 time: 0.159535 Feb 19 20:54:11.331089 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 490/931] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Feb 19 20:54:11 2022] DELETE /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146/os-volume_attachments/39ca1219-a5f8-409e-8ab8-06e2e1d77c8c => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:54:11.336791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8d2ab8f4-277f-4602-8139-9081999b3836 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:11.337517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8d2ab8f4-277f-4602-8139-9081999b3836 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:11.344934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d2ab8f4-277f-4602-8139-9081999b3836 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:11.345390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d2ab8f4-277f-4602-8139-9081999b3836 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:11.346396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d2ab8f4-277f-4602-8139-9081999b3836 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:11.346611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d2ab8f4-277f-4602-8139-9081999b3836 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:11.474292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8d2ab8f4-277f-4602-8139-9081999b3836 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc7244fbf3b4298b92daf9e442fe669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d2b5b9a01e4133b1f4f7f351cf0c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:11.489538 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8d2ab8f4-277f-4602-8139-9081999b3836 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 200 len: 1645 microversion: 2.1 time: 0.157033 Feb 19 20:54:11.490354 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 491/932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:11 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 1645 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:11.505703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:11.506595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:11.519334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:11.520902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:11.521908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:11.522510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:11.851005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Updating instance_info_cache with network_info: [{"id": "4313e698-6c12-4d1e-b019-f8d0163bad53", "address": "fa:16:3e:aa:50:ab", "network": {"id": "b5f73a2d-e0db-4f8e-b90f-72b9e4b05653", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1092693618-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "869a0cf6b5604ec89af633eb5012ff5b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4313e698-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 20:54:11.865874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Releasing lock "refresh_cache-8d2c4005-033c-4df6-978e-8ec53d9ac654" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:54:11.866957 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e7eabc4d-e0be-4172-acb3-5c082a7ef369 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "POST /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654/action" status: 202 len: 0 microversion: 2.1 time: 5.918692 Feb 19 20:54:11.871188 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 442/933] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:54:05 2022] POST /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654/action => generated 0 bytes in 5924 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 20:54:11.876144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-78a63071-0899-4930-a0cb-f86d03f52fd8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:11.877042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-78a63071-0899-4930-a0cb-f86d03f52fd8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 29bbfea3-acce-4b4e-93c6-6b92a5d9196d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:11.884268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78a63071-0899-4930-a0cb-f86d03f52fd8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:11.884835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78a63071-0899-4930-a0cb-f86d03f52fd8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:11.885716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78a63071-0899-4930-a0cb-f86d03f52fd8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:11.886214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78a63071-0899-4930-a0cb-f86d03f52fd8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:11.905748 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-78a63071-0899-4930-a0cb-f86d03f52fd8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] HTTP exception thrown: Instance 29bbfea3-acce-4b4e-93c6-6b92a5d9196d could not be found. Feb 19 20:54:11.907401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-78a63071-0899-4930-a0cb-f86d03f52fd8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Returning 404 to user: Instance 29bbfea3-acce-4b4e-93c6-6b92a5d9196d could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:11.908543 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-78a63071-0899-4930-a0cb-f86d03f52fd8 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d" status: 404 len: 111 microversion: 2.1 time: 0.036266 Feb 19 20:54:11.911857 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 443/934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:11 2022] GET /compute/v2.1/servers/29bbfea3-acce-4b4e-93c6-6b92a5d9196d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:11.931238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6587bb44-6f43-4269-9a63-9802f2cb8e34 tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Calling method '.version_select at 0x7f6467e2faf0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:12.483123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:12.492791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:12.494314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:12.495524 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f783b951-68c0-4b81-9268-0fe2c86988ed tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 1.003898 Feb 19 20:54:12.507784 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 492/935] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:11 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:12.507784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e194d613-19c3-481c-b09a-bc5e60332512 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:12.507784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e194d613-19c3-481c-b09a-bc5e60332512 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:12.509685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e194d613-19c3-481c-b09a-bc5e60332512 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:12.510137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e194d613-19c3-481c-b09a-bc5e60332512 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:12.510940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e194d613-19c3-481c-b09a-bc5e60332512 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:12.511379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e194d613-19c3-481c-b09a-bc5e60332512 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:12.546857 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e194d613-19c3-481c-b09a-bc5e60332512 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.049141 Feb 19 20:54:12.547763 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 493/936] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Feb 19 20:54:12 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:12.558894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7894b7b-5b07-492b-b85b-ca5b9a2ae0cc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:12.559218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d7894b7b-5b07-492b-b85b-ca5b9a2ae0cc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:12.565377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7894b7b-5b07-492b-b85b-ca5b9a2ae0cc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:12.565818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7894b7b-5b07-492b-b85b-ca5b9a2ae0cc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:12.567463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7894b7b-5b07-492b-b85b-ca5b9a2ae0cc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:12.568092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7894b7b-5b07-492b-b85b-ca5b9a2ae0cc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.017870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d7894b7b-5b07-492b-b85b-ca5b9a2ae0cc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:13.027185 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d7894b7b-5b07-492b-b85b-ca5b9a2ae0cc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1332 microversion: 2.1 time: 0.478238 Feb 19 20:54:13.027777 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 494/937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:12 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1332 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:13.032611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2b87aa43-3469-42b6-ad5f-7bc261bc9c4e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '.version_select at 0x7f6467c41ee0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:13.404984 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2b87aa43-3469-42b6-ad5f-7bc261bc9c4e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/b90011d6-eb0b-4824-b727-f7f6c8bc7ec0" status: 200 len: 184 microversion: 2.1 time: 0.375891 Feb 19 20:54:13.406084 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 495/938] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:54:13 2022] GET /compute/v2.1/os-floating-ips/b90011d6-eb0b-4824-b727-f7f6c8bc7ec0 => generated 184 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:13.410891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a0224668-c118-47af-81d2-8fb7ac1e7b26 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:13.411462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a0224668-c118-47af-81d2-8fb7ac1e7b26 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:13.418729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0224668-c118-47af-81d2-8fb7ac1e7b26 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:13.419267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0224668-c118-47af-81d2-8fb7ac1e7b26 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.420145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0224668-c118-47af-81d2-8fb7ac1e7b26 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:13.420673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0224668-c118-47af-81d2-8fb7ac1e7b26 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.451207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a0224668-c118-47af-81d2-8fb7ac1e7b26 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:54:13.533377 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a0224668-c118-47af-81d2-8fb7ac1e7b26 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "DELETE /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 204 len: 0 microversion: 2.1 time: 0.125278 Feb 19 20:54:13.533868 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 496/939] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:13 2022] DELETE /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:54:13.539920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-63d3656d-0389-4114-924e-42a4d240a35a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:13.540721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-63d3656d-0389-4114-924e-42a4d240a35a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:13.547572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63d3656d-0389-4114-924e-42a4d240a35a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:13.548115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63d3656d-0389-4114-924e-42a4d240a35a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.549109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63d3656d-0389-4114-924e-42a4d240a35a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:13.549591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63d3656d-0389-4114-924e-42a4d240a35a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.607522 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6587bb44-6f43-4269-9a63-9802f2cb8e34 tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/cdea55bf-a7bf-4f88-90b2-83f4c9469f8b" status: 202 len: 0 microversion: 2.1 time: 1.693975 Feb 19 20:54:13.608214 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 444/940] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:54:11 2022] DELETE /compute/v2.1/os-floating-ips/cdea55bf-a7bf-4f88-90b2-83f4c9469f8b => generated 0 bytes in 1696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:54:13.613923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-122d02c0-3f77-4c5d-bb7c-77d8de16960c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:13.614622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-122d02c0-3f77-4c5d-bb7c-77d8de16960c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:13.620857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-122d02c0-3f77-4c5d-bb7c-77d8de16960c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:13.621424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-122d02c0-3f77-4c5d-bb7c-77d8de16960c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.622284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-122d02c0-3f77-4c5d-bb7c-77d8de16960c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:13.622796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-122d02c0-3f77-4c5d-bb7c-77d8de16960c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.635902 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-122d02c0-3f77-4c5d-bb7c-77d8de16960c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] HTTP exception thrown: Instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 could not be found. Feb 19 20:54:13.636550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-122d02c0-3f77-4c5d-bb7c-77d8de16960c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Returning 404 to user: Instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:13.637384 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-122d02c0-3f77-4c5d-bb7c-77d8de16960c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 404 len: 111 microversion: 2.1 time: 0.027966 Feb 19 20:54:13.637933 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 445/941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:13 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:13.642868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-058f3117-194e-46ab-b562-b05104fe7059 req-03bf6590-9281-4592-bd7b-df9635c944b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bbfea3-acce-4b4e-93c6-6b92a5d9196d", "name": "network-vif-deleted", "tag": "3e5ba4a3-0cca-4c2c-a2d7-c425af1ec4cf"}, {"name": "network-changed", "server_uuid": "8d2c4005-033c-4df6-978e-8ec53d9ac654", "tag": "4313e698-6c12-4d1e-b019-f8d0163bad53"}, {"server_uuid": "097ae8b7-1df3-4788-b5e3-5580b215bf98", "name": "network-vif-deleted", "tag": "bbd45217-6a8e-439f-89c7-dd438e2032fd"}, {"server_uuid": "ae68ed7f-2390-4238-aa17-0cc5a0fc1791", "name": "network-vif-deleted", "tag": "8ac53ea3-5b94-4d4e-a851-73b51c046686"}, {"name": "network-changed", "server_uuid": "258092fb-1cd7-47c9-88f4-d92fafb344ef", "tag": "3c2d56ee-dcf8-4145-a7ce-83aa6441cb22"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:13.644966 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:13.644966 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:13.655193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-058f3117-194e-46ab-b562-b05104fe7059 req-03bf6590-9281-4592-bd7b-df9635c944b7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:13.655640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-058f3117-194e-46ab-b562-b05104fe7059 req-03bf6590-9281-4592-bd7b-df9635c944b7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.672792 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-058f3117-194e-46ab-b562-b05104fe7059 req-03bf6590-9281-4592-bd7b-df9635c944b7 service nova] Creating event network-vif-deleted:3e5ba4a3-0cca-4c2c-a2d7-c425af1ec4cf for instance 29bbfea3-acce-4b4e-93c6-6b92a5d9196d on nch2-master-1 Feb 19 20:54:13.673298 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-058f3117-194e-46ab-b562-b05104fe7059 req-03bf6590-9281-4592-bd7b-df9635c944b7 service nova] Creating event network-changed:4313e698-6c12-4d1e-b019-f8d0163bad53 for instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 on nch2-master-1 Feb 19 20:54:13.673798 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-058f3117-194e-46ab-b562-b05104fe7059 req-03bf6590-9281-4592-bd7b-df9635c944b7 service nova] Creating event network-vif-deleted:bbd45217-6a8e-439f-89c7-dd438e2032fd for instance 097ae8b7-1df3-4788-b5e3-5580b215bf98 on nch2-master-1 Feb 19 20:54:13.674293 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-058f3117-194e-46ab-b562-b05104fe7059 req-03bf6590-9281-4592-bd7b-df9635c944b7 service nova] Creating event network-vif-deleted:8ac53ea3-5b94-4d4e-a851-73b51c046686 for instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 on nch1-master-1 Feb 19 20:54:13.674785 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-058f3117-194e-46ab-b562-b05104fe7059 req-03bf6590-9281-4592-bd7b-df9635c944b7 service nova] Creating event network-changed:3c2d56ee-dcf8-4145-a7ce-83aa6441cb22 for instance 258092fb-1cd7-47c9-88f4-d92fafb344ef on nch2-master-1 Feb 19 20:54:13.688115 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-058f3117-194e-46ab-b562-b05104fe7059 req-03bf6590-9281-4592-bd7b-df9635c944b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 859 microversion: 2.1 time: 0.049085 Feb 19 20:54:13.688779 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 446/942] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 859 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:13.693655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.72"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:13.703590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-63d3656d-0389-4114-924e-42a4d240a35a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:13.711426 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-63d3656d-0389-4114-924e-42a4d240a35a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1543 microversion: 2.1 time: 0.176558 Feb 19 20:54:13.712016 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 497/943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:13 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1543 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:13.716287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:13.716904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:13.723144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:13.723684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.724516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:13.724951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:13.993315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:14.000990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:14.001737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:14.002674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:14.003141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:14.109424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:14.120618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:14.122197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:14.123385 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e85a5d88-fcb1-40de-a0a2-2c52462f9f46 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.410424 Feb 19 20:54:14.125153 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 498/944] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:13 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:14.131452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-01e38164-f809-44ab-9d26-0e806d5bd666 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:14.132121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-01e38164-f809-44ab-9d26-0e806d5bd666 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:14.140189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01e38164-f809-44ab-9d26-0e806d5bd666 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:14.140681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01e38164-f809-44ab-9d26-0e806d5bd666 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:14.141462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01e38164-f809-44ab-9d26-0e806d5bd666 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:14.141894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01e38164-f809-44ab-9d26-0e806d5bd666 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:14.388976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Acquired lock "refresh_cache-8d2c4005-033c-4df6-978e-8ec53d9ac654" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:54:14.518882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-01e38164-f809-44ab-9d26-0e806d5bd666 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caca1da9a52c4a2080682b2458fa1e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9ffdaf1d654c9bbbda43ed9214c964', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:14.526938 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-01e38164-f809-44ab-9d26-0e806d5bd666 tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 200 len: 1469 microversion: 2.1 time: 0.400515 Feb 19 20:54:14.527592 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 499/945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:14 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 1469 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:14.532072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f89a8055-5dd2-4400-98b7-eae2e3bd86ac tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Calling method '.version_select at 0x7f6467c3da60>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:14.914747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG neutronclient.v2_0.client [None req-f89a8055-5dd2-4400-98b7-eae2e3bd86ac tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cdea55bf-a7bf-4f88-90b2-83f4c9469f8b could not be found", "detail": ""}} {{(pid=136094) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:54:14.916020 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-f89a8055-5dd2-4400-98b7-eae2e3bd86ac tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] HTTP exception thrown: Floating IP not found for ID cdea55bf-a7bf-4f88-90b2-83f4c9469f8b Feb 19 20:54:14.916784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f89a8055-5dd2-4400-98b7-eae2e3bd86ac tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Returning 404 to user: Floating IP not found for ID cdea55bf-a7bf-4f88-90b2-83f4c9469f8b {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:14.917810 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f89a8055-5dd2-4400-98b7-eae2e3bd86ac tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/cdea55bf-a7bf-4f88-90b2-83f4c9469f8b" status: 404 len: 111 microversion: 2.1 time: 0.389035 Feb 19 20:54:14.918565 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 500/946] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:54:14 2022] GET /compute/v2.1/os-floating-ips/cdea55bf-a7bf-4f88-90b2-83f4c9469f8b => generated 111 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:14.923661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c0e2b08-4210-4ed9-b4d6-cecc65fe8f33 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:14.924485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3c0e2b08-4210-4ed9-b4d6-cecc65fe8f33 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:14.933781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c0e2b08-4210-4ed9-b4d6-cecc65fe8f33 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:14.934243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c0e2b08-4210-4ed9-b4d6-cecc65fe8f33 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:14.935189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c0e2b08-4210-4ed9-b4d6-cecc65fe8f33 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:14.935704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c0e2b08-4210-4ed9-b4d6-cecc65fe8f33 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:14.950338 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-3c0e2b08-4210-4ed9-b4d6-cecc65fe8f33 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] HTTP exception thrown: Instance f4f05bec-0cf3-4c8d-adda-1f646f93100c could not be found. Feb 19 20:54:14.950949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c0e2b08-4210-4ed9-b4d6-cecc65fe8f33 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Returning 404 to user: Instance f4f05bec-0cf3-4c8d-adda-1f646f93100c could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:14.952094 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3c0e2b08-4210-4ed9-b4d6-cecc65fe8f33 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 404 len: 111 microversion: 2.1 time: 0.032439 Feb 19 20:54:14.952681 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 501/947] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:14 2022] DELETE /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:14.958015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-441bd7c3-9047-49e3-b88f-4812f4435abb tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:14.958623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-441bd7c3-9047-49e3-b88f-4812f4435abb tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:14.964795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-441bd7c3-9047-49e3-b88f-4812f4435abb tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:14.965251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-441bd7c3-9047-49e3-b88f-4812f4435abb tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:14.966040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-441bd7c3-9047-49e3-b88f-4812f4435abb tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:14.966480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-441bd7c3-9047-49e3-b88f-4812f4435abb tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:15.462958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-441bd7c3-9047-49e3-b88f-4812f4435abb tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:15.470300 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-441bd7c3-9047-49e3-b88f-4812f4435abb tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1332 microversion: 2.1 time: 0.516451 Feb 19 20:54:15.470878 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 502/948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:14 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1332 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:15.475410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1979029083", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "020891c0-689f-4c7c-a850-6c2b2dfe0076"}], "block_device_mapping_v2": [{"uuid": "90669fb9-9d09-48c0-b541-6b2f12bb6671", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:15.531888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] validate_networks() for [('020891c0-689f-4c7c-a850-6c2b2dfe0076', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:54:16.558897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Building network info cache for instance {{(pid=136095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 20:54:17.271902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:54:17.272411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:54:17.272887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:54:17.273685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:54:17.274245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:54:17.286284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:17.286841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:17.288083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:17.288619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:17.309122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Getting quotas for project a6f02f88286b49babe665db9d00787a2. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:17.313475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Getting quotas for user ec1a2a2db19c41cca4342aa082770a96 and project a6f02f88286b49babe665db9d00787a2. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:17.406748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:54:17.409481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90669fb9-9d09-48c0-b541-6b2f12bb6671',volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:54:17.615158 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d98a3b82-a777-48d4-904b-c67559eeb8e7 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.143236 Feb 19 20:54:17.621311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 503/949] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 20:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 20:54:17.626014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bb9183ad-1b44-47b6-8bae-41fc76ff6350 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:17.626889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bb9183ad-1b44-47b6-8bae-41fc76ff6350 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:17.633367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb9183ad-1b44-47b6-8bae-41fc76ff6350 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:17.634113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb9183ad-1b44-47b6-8bae-41fc76ff6350 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:17.635121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb9183ad-1b44-47b6-8bae-41fc76ff6350 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:17.635767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb9183ad-1b44-47b6-8bae-41fc76ff6350 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.061711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bb9183ad-1b44-47b6-8bae-41fc76ff6350 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:18.074915 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bb9183ad-1b44-47b6-8bae-41fc76ff6350 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1542 microversion: 2.1 time: 0.452291 Feb 19 20:54:18.076663 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 504/950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:17 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1542 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:18.082595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5fe5fb59-5bd2-414a-9d39-7d229eecf89c tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Calling method '.version_select at 0x7f6467c28d30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:18.166607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG neutronclient.v2_0.client [None req-5fe5fb59-5bd2-414a-9d39-7d229eecf89c tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cdea55bf-a7bf-4f88-90b2-83f4c9469f8b could not be found", "detail": ""}} {{(pid=136094) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:54:18.167344 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-5fe5fb59-5bd2-414a-9d39-7d229eecf89c tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] HTTP exception thrown: Floating IP not found for ID cdea55bf-a7bf-4f88-90b2-83f4c9469f8b Feb 19 20:54:18.167878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5fe5fb59-5bd2-414a-9d39-7d229eecf89c tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] Returning 404 to user: Floating IP not found for ID cdea55bf-a7bf-4f88-90b2-83f4c9469f8b {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:18.168728 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5fe5fb59-5bd2-414a-9d39-7d229eecf89c tempest-FloatingIPsTestJSON-1343524602 tempest-FloatingIPsTestJSON-1343524602-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/cdea55bf-a7bf-4f88-90b2-83f4c9469f8b" status: 404 len: 111 microversion: 2.1 time: 0.090424 Feb 19 20:54:18.174803 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 505/951] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:54:18 2022] DELETE /compute/v2.1/os-floating-ips/cdea55bf-a7bf-4f88-90b2-83f4c9469f8b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:18.181129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-da68fd05-ca1f-4f89-8a75-de5d0910a297 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:18.181997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-da68fd05-ca1f-4f89-8a75-de5d0910a297 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:18.189699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da68fd05-ca1f-4f89-8a75-de5d0910a297 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.190439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da68fd05-ca1f-4f89-8a75-de5d0910a297 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.191964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da68fd05-ca1f-4f89-8a75-de5d0910a297 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.192673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da68fd05-ca1f-4f89-8a75-de5d0910a297 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.201935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Updating instance_info_cache with network_info: [{"id": "4313e698-6c12-4d1e-b019-f8d0163bad53", "address": "fa:16:3e:aa:50:ab", "network": {"id": "b5f73a2d-e0db-4f8e-b90f-72b9e4b05653", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1092693618-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "869a0cf6b5604ec89af633eb5012ff5b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4313e698-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 20:54:18.223713 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-da68fd05-ca1f-4f89-8a75-de5d0910a297 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] HTTP exception thrown: Instance f4f05bec-0cf3-4c8d-adda-1f646f93100c could not be found. Feb 19 20:54:18.224365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-da68fd05-ca1f-4f89-8a75-de5d0910a297 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Returning 404 to user: Instance f4f05bec-0cf3-4c8d-adda-1f646f93100c could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:18.225223 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-da68fd05-ca1f-4f89-8a75-de5d0910a297 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 404 len: 111 microversion: 2.1 time: 0.049250 Feb 19 20:54:18.225701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Releasing lock "refresh_cache-8d2c4005-033c-4df6-978e-8ec53d9ac654" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:54:18.226237 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 506/952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:18 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:18.227306 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57f69f00-081f-40e6-833f-966b14b813d9 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "POST /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654/action" status: 202 len: 0 microversion: 2.1 time: 4.537258 Feb 19 20:54:18.228416 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 447/953] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:54:13 2022] POST /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654/action => generated 0 bytes in 4539 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 20:54:18.238451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb8ab42e-3fd1-47fe-ad2f-58ff609f54ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:18.240963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb8ab42e-3fd1-47fe-ad2f-58ff609f54ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] [instance: 18e81722-edd5-49d7-ab7d-41e73614b6aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:18.248891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:18.248891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:18.254940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.255433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.256172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.256639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.266830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb8ab42e-3fd1-47fe-ad2f-58ff609f54ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.270058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb8ab42e-3fd1-47fe-ad2f-58ff609f54ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.271024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb8ab42e-3fd1-47fe-ad2f-58ff609f54ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.274193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb8ab42e-3fd1-47fe-ad2f-58ff609f54ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.311244 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-cb8ab42e-3fd1-47fe-ad2f-58ff609f54ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] HTTP exception thrown: Instance 18e81722-edd5-49d7-ab7d-41e73614b6aa could not be found. Feb 19 20:54:18.311880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb8ab42e-3fd1-47fe-ad2f-58ff609f54ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] Returning 404 to user: Instance 18e81722-edd5-49d7-ab7d-41e73614b6aa could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:18.314981 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb8ab42e-3fd1-47fe-ad2f-58ff609f54ad tempest-ServersAdminTestJSON-1223233838 tempest-ServersAdminTestJSON-1223233838-project] 10.222.0.30 "GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa" status: 404 len: 111 microversion: 2.1 time: 0.083039 Feb 19 20:54:18.315951 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 448/954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:18 2022] GET /compute/v2.1/servers/18e81722-edd5-49d7-ab7d-41e73614b6aa => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:18.335674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f198bb4f-b69b-450a-88bc-a8e8c6762d7f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:18.336321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f198bb4f-b69b-450a-88bc-a8e8c6762d7f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:18.358740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f198bb4f-b69b-450a-88bc-a8e8c6762d7f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.361328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f198bb4f-b69b-450a-88bc-a8e8c6762d7f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.362353 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f198bb4f-b69b-450a-88bc-a8e8c6762d7f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.366332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f198bb4f-b69b-450a-88bc-a8e8c6762d7f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.783946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:18.807768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:18.811522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:18.817189 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83acf226-9703-44b6-bc7e-b291eea146ba tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.584436 Feb 19 20:54:18.818082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 507/955] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:18 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:18.824240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-41d5d5dc-d423-4405-86ed-dfbc2e111c45 req-5d7fe78d-277a-4f0a-be25-4de8ec428d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2c4005-033c-4df6-978e-8ec53d9ac654", "tag": "4313e698-6c12-4d1e-b019-f8d0163bad53"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:18.826729 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:18.826729 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:18.848256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-41d5d5dc-d423-4405-86ed-dfbc2e111c45 req-5d7fe78d-277a-4f0a-be25-4de8ec428d8e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.848981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-41d5d5dc-d423-4405-86ed-dfbc2e111c45 req-5d7fe78d-277a-4f0a-be25-4de8ec428d8e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.871383 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-41d5d5dc-d423-4405-86ed-dfbc2e111c45 req-5d7fe78d-277a-4f0a-be25-4de8ec428d8e service nova] Creating event network-changed:4313e698-6c12-4d1e-b019-f8d0163bad53 for instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 on nch2-master-1 Feb 19 20:54:18.877192 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-41d5d5dc-d423-4405-86ed-dfbc2e111c45 req-5d7fe78d-277a-4f0a-be25-4de8ec428d8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057382 Feb 19 20:54:18.878092 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 508/956] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:18.886626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:18.897412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:18.913763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.917012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.918037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:18.918664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:18.924685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f198bb4f-b69b-450a-88bc-a8e8c6762d7f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:18.932689 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f198bb4f-b69b-450a-88bc-a8e8c6762d7f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1332 microversion: 2.1 time: 0.615889 Feb 19 20:54:18.939919 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 449/957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:18 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1332 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:18.957659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-115f06bc-9e64-4581-aa77-fc9e4c7e3acd tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '.version_select at 0x7f6467cda790>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:18.992311 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-115f06bc-9e64-4581-aa77-fc9e4c7e3acd tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148996651" status: 202 len: 0 microversion: 2.1 time: 0.050888 Feb 19 20:54:18.993615 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 450/958] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 20:54:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148996651 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:54:19.000747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-416b3e55-c19b-4ba7-9bbe-cc7f2ef79183 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:19.001310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-416b3e55-c19b-4ba7-9bbe-cc7f2ef79183 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:19.009092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-416b3e55-c19b-4ba7-9bbe-cc7f2ef79183 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:19.009792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-416b3e55-c19b-4ba7-9bbe-cc7f2ef79183 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:19.010820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-416b3e55-c19b-4ba7-9bbe-cc7f2ef79183 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:19.011469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-416b3e55-c19b-4ba7-9bbe-cc7f2ef79183 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:19.026954 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-416b3e55-c19b-4ba7-9bbe-cc7f2ef79183 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] HTTP exception thrown: Instance 097ae8b7-1df3-4788-b5e3-5580b215bf98 could not be found. Feb 19 20:54:19.028108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-416b3e55-c19b-4ba7-9bbe-cc7f2ef79183 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Returning 404 to user: Instance 097ae8b7-1df3-4788-b5e3-5580b215bf98 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:19.029227 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-416b3e55-c19b-4ba7-9bbe-cc7f2ef79183 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "DELETE /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 404 len: 111 microversion: 2.1 time: 0.034323 Feb 19 20:54:19.033218 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 451/959] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:18 2022] DELETE /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:19.039886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e319823c-e7a3-48d5-b10c-783cd1fa48a7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:19.040736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e319823c-e7a3-48d5-b10c-783cd1fa48a7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 097ae8b7-1df3-4788-b5e3-5580b215bf98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:19.048632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e319823c-e7a3-48d5-b10c-783cd1fa48a7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:19.049276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e319823c-e7a3-48d5-b10c-783cd1fa48a7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:19.050266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e319823c-e7a3-48d5-b10c-783cd1fa48a7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:19.051577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e319823c-e7a3-48d5-b10c-783cd1fa48a7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:19.070077 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-e319823c-e7a3-48d5-b10c-783cd1fa48a7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] HTTP exception thrown: Instance 097ae8b7-1df3-4788-b5e3-5580b215bf98 could not be found. Feb 19 20:54:19.071131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e319823c-e7a3-48d5-b10c-783cd1fa48a7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Returning 404 to user: Instance 097ae8b7-1df3-4788-b5e3-5580b215bf98 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:19.072137 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e319823c-e7a3-48d5-b10c-783cd1fa48a7 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98" status: 404 len: 111 microversion: 2.1 time: 0.037769 Feb 19 20:54:19.076894 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 452/960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:19 2022] GET /compute/v2.1/servers/097ae8b7-1df3-4788-b5e3-5580b215bf98 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:19.083074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6950e42b-4cb3-4c89-811e-251e10a229ac tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '.version_select at 0x7f6467e2faf0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:19.196977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:19.207845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:19.209404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:19.210533 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-67456dec-76fd-43b7-b171-bf4ad5d5d557 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1241 microversion: 2.25 time: 0.330101 Feb 19 20:54:19.226225 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 509/961] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:18 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1241 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:19.240869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ef1889cb-1e56-4ca6-8172-b87453c3cb1a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:19.241755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ef1889cb-1e56-4ca6-8172-b87453c3cb1a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:19.248124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef1889cb-1e56-4ca6-8172-b87453c3cb1a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:19.248841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef1889cb-1e56-4ca6-8172-b87453c3cb1a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:19.249797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef1889cb-1e56-4ca6-8172-b87453c3cb1a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:19.250389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef1889cb-1e56-4ca6-8172-b87453c3cb1a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:20.891412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ef1889cb-1e56-4ca6-8172-b87453c3cb1a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:20.906038 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ef1889cb-1e56-4ca6-8172-b87453c3cb1a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1474 microversion: 2.1 time: 1.667453 Feb 19 20:54:20.907518 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 510/962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:19 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1474 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:20.916934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f7c85b27-db81-4d17-8cdb-e771b45fbf5c req-17b428d8-771a-4d98-9c34-3c81c3287115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de", "name": "network-vif-unplugged", "status": "completed", "tag": "191fbf35-b9ce-44cc-bb60-5039a7b3f93f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:20.919629 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:20.919629 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:20.931899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f7c85b27-db81-4d17-8cdb-e771b45fbf5c req-17b428d8-771a-4d98-9c34-3c81c3287115 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:20.932958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f7c85b27-db81-4d17-8cdb-e771b45fbf5c req-17b428d8-771a-4d98-9c34-3c81c3287115 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:20.950473 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f7c85b27-db81-4d17-8cdb-e771b45fbf5c req-17b428d8-771a-4d98-9c34-3c81c3287115 service nova] Creating event network-vif-unplugged:191fbf35-b9ce-44cc-bb60-5039a7b3f93f for instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de on nch1-master-1 Feb 19 20:54:20.960392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-f7c85b27-db81-4d17-8cdb-e771b45fbf5c req-17b428d8-771a-4d98-9c34-3c81c3287115 service nova] Instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:54:20.976281 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f7c85b27-db81-4d17-8cdb-e771b45fbf5c req-17b428d8-771a-4d98-9c34-3c81c3287115 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065398 Feb 19 20:54:20.983000 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 511/963] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:20.999876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:21.004557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:21.020927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:21.021973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:21.025742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:21.026880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:21.820303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:21.839093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:21.842872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:21.845368 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f92eca5a-7cee-4b37-9ef7-0c5433d14af1 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.859550 Feb 19 20:54:21.846646 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 512/964] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:20 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:21.851863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6c7b52ea-1b8c-4957-8509-480407b5e7d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:21.852676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6c7b52ea-1b8c-4957-8509-480407b5e7d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:21.863011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c7b52ea-1b8c-4957-8509-480407b5e7d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:21.863694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c7b52ea-1b8c-4957-8509-480407b5e7d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:21.866556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c7b52ea-1b8c-4957-8509-480407b5e7d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:21.867358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c7b52ea-1b8c-4957-8509-480407b5e7d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:22.475689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6c7b52ea-1b8c-4957-8509-480407b5e7d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:22.483806 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6c7b52ea-1b8c-4957-8509-480407b5e7d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1332 microversion: 2.1 time: 0.635924 Feb 19 20:54:22.486970 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 513/965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:21 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1332 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:22.496107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:22.501174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:22.512855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:22.516966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:22.518018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:22.518632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:22.873164 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6950e42b-4cb3-4c89-811e-251e10a229ac tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/b90011d6-eb0b-4824-b727-f7f6c8bc7ec0" status: 202 len: 0 microversion: 2.1 time: 3.794309 Feb 19 20:54:22.874638 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 453/966] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:54:19 2022] DELETE /compute/v2.1/os-floating-ips/b90011d6-eb0b-4824-b727-f7f6c8bc7ec0 => generated 0 bytes in 3796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:54:22.881783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a4988beb-6ef6-4eaa-98e3-81a33e86c72e req-af3036ab-b11d-4436-a8af-4bbf1dae91ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e81722-edd5-49d7-ab7d-41e73614b6aa", "name": "network-vif-deleted", "tag": "3604b765-b301-4875-991d-4d4190639b69"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:22.883350 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:22.883350 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:22.895669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a4988beb-6ef6-4eaa-98e3-81a33e86c72e req-af3036ab-b11d-4436-a8af-4bbf1dae91ec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:22.896407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a4988beb-6ef6-4eaa-98e3-81a33e86c72e req-af3036ab-b11d-4436-a8af-4bbf1dae91ec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:22.908198 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a4988beb-6ef6-4eaa-98e3-81a33e86c72e req-af3036ab-b11d-4436-a8af-4bbf1dae91ec service nova] Creating event network-vif-deleted:3604b765-b301-4875-991d-4d4190639b69 for instance 18e81722-edd5-49d7-ab7d-41e73614b6aa on nch1-master-1 Feb 19 20:54:22.915694 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a4988beb-6ef6-4eaa-98e3-81a33e86c72e req-af3036ab-b11d-4436-a8af-4bbf1dae91ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039438 Feb 19 20:54:22.917376 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 454/967] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:22.925197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d6637f1-0aa6-407c-9b4e-ad56139bb9e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:22.933035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d6637f1-0aa6-407c-9b4e-ad56139bb9e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:22.944219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6637f1-0aa6-407c-9b4e-ad56139bb9e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:22.945246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6637f1-0aa6-407c-9b4e-ad56139bb9e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:22.946065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6637f1-0aa6-407c-9b4e-ad56139bb9e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:22.946664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6637f1-0aa6-407c-9b4e-ad56139bb9e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.026907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:23.048685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:23.059175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:23.061429 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-131b2368-e7d8-4c06-921f-7d911afce704 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1281 microversion: 2.25 time: 0.573138 Feb 19 20:54:23.066313 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 514/968] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:22 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1281 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:23.073405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bb847b2e-3d66-48a2-a854-0392809d5d76 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:23.077713 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:23.077713 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:23.119082 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bb847b2e-3d66-48a2-a854-0392809d5d76 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2045598703" status: 202 len: 0 microversion: 2.1 time: 0.048891 Feb 19 20:54:23.122290 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 515/969] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:54:23 2022] DELETE /compute/v2.1/flavors/2045598703 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:54:23.136135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:23.137318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:23.152727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.153554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.155269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.160839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.429336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8d6637f1-0aa6-407c-9b4e-ad56139bb9e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:23.439272 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d6637f1-0aa6-407c-9b4e-ad56139bb9e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1471 microversion: 2.1 time: 0.520467 Feb 19 20:54:23.439878 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 455/970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:22 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1471 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:23.454641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-937f985f-c5bb-4735-9a33-df64cb2c8cb8 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:23.455234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-937f985f-c5bb-4735-9a33-df64cb2c8cb8 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:23.470320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-937f985f-c5bb-4735-9a33-df64cb2c8cb8 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.471316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-937f985f-c5bb-4735-9a33-df64cb2c8cb8 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.472154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-937f985f-c5bb-4735-9a33-df64cb2c8cb8 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.472717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-937f985f-c5bb-4735-9a33-df64cb2c8cb8 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.529977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-937f985f-c5bb-4735-9a33-df64cb2c8cb8 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:54:23.642814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:23.658102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:23.660866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:23.663069 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-612a38eb-88a4-47b8-8162-60a2d5a4f566 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.537251 Feb 19 20:54:23.677543 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 516/971] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:23 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:23.696064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b9b92d7a-1aae-4e37-924d-9585e837b7dc req-f3f1670f-e6dd-4a2a-ae02-005983a8405b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-plugged", "status": "completed", "tag": "a5a05223-8669-4696-8f96-528bee454543"}, {"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-plugged", "status": "completed", "tag": "e1552338-247f-46d8-ba3c-0852bc6b82e8"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:23.697916 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:23.697916 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:23.712552 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-937f985f-c5bb-4735-9a33-df64cb2c8cb8 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 204 len: 0 microversion: 2.1 time: 0.268761 Feb 19 20:54:23.713471 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 456/972] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:23 2022] DELETE /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:54:23.719324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b9b92d7a-1aae-4e37-924d-9585e837b7dc req-f3f1670f-e6dd-4a2a-ae02-005983a8405b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.719810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b9b92d7a-1aae-4e37-924d-9585e837b7dc req-f3f1670f-e6dd-4a2a-ae02-005983a8405b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.725620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a0e0e028-9db2-40de-8f50-46ca037b1fa0 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:23.746102 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b9b92d7a-1aae-4e37-924d-9585e837b7dc req-f3f1670f-e6dd-4a2a-ae02-005983a8405b service nova] Creating event network-vif-plugged:a5a05223-8669-4696-8f96-528bee454543 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:23.747038 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b9b92d7a-1aae-4e37-924d-9585e837b7dc req-f3f1670f-e6dd-4a2a-ae02-005983a8405b service nova] Creating event network-vif-plugged:e1552338-247f-46d8-ba3c-0852bc6b82e8 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:23.755900 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b9b92d7a-1aae-4e37-924d-9585e837b7dc req-f3f1670f-e6dd-4a2a-ae02-005983a8405b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073783 Feb 19 20:54:23.757132 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 517/973] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:23.763435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:23.764270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:23.771183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.772054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.773050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.773650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.773814 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a0e0e028-9db2-40de-8f50-46ca037b1fa0 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.058659 Feb 19 20:54:23.774440 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 457/974] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:54:23 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:23.788016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f086b077-7b1b-476a-be5b-9127424cfaa8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:23.788784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f086b077-7b1b-476a-be5b-9127424cfaa8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:23.803801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f086b077-7b1b-476a-be5b-9127424cfaa8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.804279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f086b077-7b1b-476a-be5b-9127424cfaa8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.812103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f086b077-7b1b-476a-be5b-9127424cfaa8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.812589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f086b077-7b1b-476a-be5b-9127424cfaa8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.815362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.815821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.817214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:23.817821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:23.845643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:23.850561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for user c26bc5048c9849218cadd12475cd5fbe and project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:23.971654 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-706bc65d-fd36-48cc-85dd-37ea0d4d1bf7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de/action" status: 202 len: 0 microversion: 2.1 time: 0.212830 Feb 19 20:54:23.972995 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 518/975] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:54:23 2022] POST /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:54:24.108427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f086b077-7b1b-476a-be5b-9127424cfaa8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:24.116235 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f086b077-7b1b-476a-be5b-9127424cfaa8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1332 microversion: 2.1 time: 0.340720 Feb 19 20:54:24.116847 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 458/976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:23 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1332 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:24.121831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a6a0630-84bd-4871-96a8-f2572bf4737e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:24.123046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3a6a0630-84bd-4871-96a8-f2572bf4737e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:24.130567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a6a0630-84bd-4871-96a8-f2572bf4737e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:24.131485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a6a0630-84bd-4871-96a8-f2572bf4737e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:24.132543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a6a0630-84bd-4871-96a8-f2572bf4737e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:24.133265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a6a0630-84bd-4871-96a8-f2572bf4737e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:24.283492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1989781401", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:24.345594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:54:24.819790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3a6a0630-84bd-4871-96a8-f2572bf4737e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:24.828555 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3a6a0630-84bd-4871-96a8-f2572bf4737e tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1526 microversion: 2.1 time: 0.710507 Feb 19 20:54:24.829261 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 459/977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:24 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1526 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:24.836082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a0ef0287-d50d-4fe1-aaad-3e8f670b5c72 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:24.837303 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:24.837303 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:24.862460 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a0ef0287-d50d-4fe1-aaad-3e8f670b5c72 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/371833671" status: 202 len: 0 microversion: 2.1 time: 0.031519 Feb 19 20:54:24.868107 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 460/978] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 20:54:24 2022] DELETE /compute/v2.1/flavors/371833671 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:54:24.874692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3bd99ee1-0f6a-40e6-9e17-2f7d2688295c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:24.875774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3bd99ee1-0f6a-40e6-9e17-2f7d2688295c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:24.884624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bd99ee1-0f6a-40e6-9e17-2f7d2688295c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:24.885460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bd99ee1-0f6a-40e6-9e17-2f7d2688295c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:24.886796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bd99ee1-0f6a-40e6-9e17-2f7d2688295c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:24.887748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bd99ee1-0f6a-40e6-9e17-2f7d2688295c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:25.134432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:54:25.134973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:54:25.135490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:54:25.135962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:54:25.136625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:54:25.147186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:25.147725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:25.148664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:25.149168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:25.169032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:25.173964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:25.187361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:54:25.189759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:54:25.235909 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-72cb69e7-c06f-454b-9d94-e8039ad02aa2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258657 Feb 19 20:54:25.237307 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 519/979] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:54:25.247897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:25.248809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:25.255796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:25.256242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:25.257065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:25.257494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:25.390742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3bd99ee1-0f6a-40e6-9e17-2f7d2688295c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:25.399546 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3bd99ee1-0f6a-40e6-9e17-2f7d2688295c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1470 microversion: 2.1 time: 0.529402 Feb 19 20:54:25.400363 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 461/980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:24 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1470 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:25.415321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:25.415939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:25.421923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:25.422409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:25.423209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:25.423652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:25.692746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:25.710216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:25.711356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:25.712529 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c35d0526-5023-445f-b883-7d275a022bf0 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1281 microversion: 2.25 time: 0.473975 Feb 19 20:54:25.713082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 520/981] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:25 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:25.717549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ff5dc5df-52cb-4a5d-8edd-86d31f493931 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:25.760904 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ff5dc5df-52cb-4a5d-8edd-86d31f493931 tempest-ServersWithSpecificFlavorTestJSON-1322757301 tempest-ServersWithSpecificFlavorTestJSON-1322757301-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046292 Feb 19 20:54:25.761847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 521/982] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:54:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:25.775941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1fc742b5-4299-4a60-bc17-7f217bd0eb04 req-20abc918-f09c-487b-b9b2-43174c47a1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016b6ece-713e-4a2d-ba16-6de26f2479cb", "tag": "8a66314a-6be0-4ed3-85c0-e29d46b221c9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:25.780629 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:25.780629 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:25.788182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1fc742b5-4299-4a60-bc17-7f217bd0eb04 req-20abc918-f09c-487b-b9b2-43174c47a1e1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:25.788662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1fc742b5-4299-4a60-bc17-7f217bd0eb04 req-20abc918-f09c-487b-b9b2-43174c47a1e1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:25.801761 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1fc742b5-4299-4a60-bc17-7f217bd0eb04 req-20abc918-f09c-487b-b9b2-43174c47a1e1 service nova] Creating event network-changed:8a66314a-6be0-4ed3-85c0-e29d46b221c9 for instance 016b6ece-713e-4a2d-ba16-6de26f2479cb on nch1-master-1 Feb 19 20:54:25.807813 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1fc742b5-4299-4a60-bc17-7f217bd0eb04 req-20abc918-f09c-487b-b9b2-43174c47a1e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044342 Feb 19 20:54:25.810638 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 522/983] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:25.948290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:25.972062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:25.972732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-382acfe3-bfc7-4b3c-9518-63b941ce6d67 tempest-ListImageFiltersNegativeTestJSON-1418464678 tempest-ListImageFiltersNegativeTestJSON-1418464678-project] Calling method '.version_select at 0x7f6467c66f70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:25.974792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:25.977350 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6f5a5265-d8e2-461e-ab02-305821dc6d68 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.565448 Feb 19 20:54:25.978978 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 462/984] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:25 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:25.986855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ab9e2a0c-2e23-4a39-876c-9e0579bd62e5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:25.988648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ab9e2a0c-2e23-4a39-876c-9e0579bd62e5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:25.997182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab9e2a0c-2e23-4a39-876c-9e0579bd62e5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:25.997682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab9e2a0c-2e23-4a39-876c-9e0579bd62e5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:25.998637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab9e2a0c-2e23-4a39-876c-9e0579bd62e5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:25.999067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab9e2a0c-2e23-4a39-876c-9e0579bd62e5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.008235 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-382acfe3-bfc7-4b3c-9518-63b941ce6d67 tempest-ListImageFiltersNegativeTestJSON-1418464678 tempest-ListImageFiltersNegativeTestJSON-1418464678-project] HTTP exception thrown: Image not found. Feb 19 20:54:26.008922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-382acfe3-bfc7-4b3c-9518-63b941ce6d67 tempest-ListImageFiltersNegativeTestJSON-1418464678 tempest-ListImageFiltersNegativeTestJSON-1418464678-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:26.010241 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-382acfe3-bfc7-4b3c-9518-63b941ce6d67 tempest-ListImageFiltersNegativeTestJSON-1418464678 tempest-ListImageFiltersNegativeTestJSON-1418464678-project] 10.222.0.30 "GET /compute/v2.1/images/134d4f6b-831e-415c-8b01-6ae4f643575c" status: 404 len: 62 microversion: 2.1 time: 0.200700 Feb 19 20:54:26.011168 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 523/985] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:25 2022] GET /compute/v2.1/images/134d4f6b-831e-415c-8b01-6ae4f643575c => generated 62 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:54:26.017835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-efd7fdd1-609e-410e-921c-b72f3935b770 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:26.018930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-efd7fdd1-609e-410e-921c-b72f3935b770 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:26.026173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efd7fdd1-609e-410e-921c-b72f3935b770 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.026758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efd7fdd1-609e-410e-921c-b72f3935b770 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.027630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efd7fdd1-609e-410e-921c-b72f3935b770 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.028148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efd7fdd1-609e-410e-921c-b72f3935b770 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.204251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-efd7fdd1-609e-410e-921c-b72f3935b770 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:26.214232 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-efd7fdd1-609e-410e-921c-b72f3935b770 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1269 microversion: 2.1 time: 0.201553 Feb 19 20:54:26.215827 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 524/986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:26 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:26.221705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2bcbe715-11e6-4039-9ae8-a5be76a5b6c6 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:26.223097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2bcbe715-11e6-4039-9ae8-a5be76a5b6c6 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:26.230503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2bcbe715-11e6-4039-9ae8-a5be76a5b6c6 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.231360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2bcbe715-11e6-4039-9ae8-a5be76a5b6c6 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.232369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2bcbe715-11e6-4039-9ae8-a5be76a5b6c6 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.233003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2bcbe715-11e6-4039-9ae8-a5be76a5b6c6 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.249043 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-2bcbe715-11e6-4039-9ae8-a5be76a5b6c6 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] HTTP exception thrown: Instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 could not be found. Feb 19 20:54:26.250199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2bcbe715-11e6-4039-9ae8-a5be76a5b6c6 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Returning 404 to user: Instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:26.251901 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2bcbe715-11e6-4039-9ae8-a5be76a5b6c6 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 404 len: 111 microversion: 2.1 time: 0.034282 Feb 19 20:54:26.253512 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 525/987] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:26 2022] DELETE /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:26.263632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-010e259b-1da3-4e86-8044-9bbc88fbb67b req-fdd0c118-ba2b-4383-86c8-4e9a5ee2349d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de", "name": "network-vif-plugged", "status": "completed", "tag": "191fbf35-b9ce-44cc-bb60-5039a7b3f93f"}, {"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-plugged", "status": "completed", "tag": "6290f8b3-0737-4492-8de5-f27de84a5a1e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:26.266116 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:26.266116 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:26.278558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-010e259b-1da3-4e86-8044-9bbc88fbb67b req-fdd0c118-ba2b-4383-86c8-4e9a5ee2349d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.279528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-010e259b-1da3-4e86-8044-9bbc88fbb67b req-fdd0c118-ba2b-4383-86c8-4e9a5ee2349d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.299621 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-010e259b-1da3-4e86-8044-9bbc88fbb67b req-fdd0c118-ba2b-4383-86c8-4e9a5ee2349d service nova] Creating event network-vif-plugged:191fbf35-b9ce-44cc-bb60-5039a7b3f93f for instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de on nch1-master-1 Feb 19 20:54:26.302174 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-010e259b-1da3-4e86-8044-9bbc88fbb67b req-fdd0c118-ba2b-4383-86c8-4e9a5ee2349d service nova] Creating event network-vif-plugged:6290f8b3-0737-4492-8de5-f27de84a5a1e for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:26.315231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-010e259b-1da3-4e86-8044-9bbc88fbb67b req-fdd0c118-ba2b-4383-86c8-4e9a5ee2349d service nova] Instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:54:26.330741 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-010e259b-1da3-4e86-8044-9bbc88fbb67b req-fdd0c118-ba2b-4383-86c8-4e9a5ee2349d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071694 Feb 19 20:54:26.331465 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 526/988] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:26.340579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82731232-e402-410f-b965-427e66a07bbc tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:26.341467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-82731232-e402-410f-b965-427e66a07bbc tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:26.348651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82731232-e402-410f-b965-427e66a07bbc tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.349433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82731232-e402-410f-b965-427e66a07bbc tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.349873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82731232-e402-410f-b965-427e66a07bbc tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.350305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82731232-e402-410f-b965-427e66a07bbc tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.589374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ab9e2a0c-2e23-4a39-876c-9e0579bd62e5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:26.598789 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ab9e2a0c-2e23-4a39-876c-9e0579bd62e5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1332 microversion: 2.1 time: 0.618196 Feb 19 20:54:26.606199 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 463/989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:25 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1332 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:26.606199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-631de6ac-0114-4713-950b-7ac34888400c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:26.606199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-631de6ac-0114-4713-950b-7ac34888400c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: ae68ed7f-2390-4238-aa17-0cc5a0fc1791] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:26.612615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-631de6ac-0114-4713-950b-7ac34888400c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.613073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-631de6ac-0114-4713-950b-7ac34888400c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.613872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-631de6ac-0114-4713-950b-7ac34888400c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.614323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-631de6ac-0114-4713-950b-7ac34888400c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.642582 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-631de6ac-0114-4713-950b-7ac34888400c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] HTTP exception thrown: Instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 could not be found. Feb 19 20:54:26.643473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-631de6ac-0114-4713-950b-7ac34888400c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Returning 404 to user: Instance ae68ed7f-2390-4238-aa17-0cc5a0fc1791 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:26.644856 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-631de6ac-0114-4713-950b-7ac34888400c tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791" status: 404 len: 111 microversion: 2.1 time: 0.043186 Feb 19 20:54:26.645430 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 464/990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:26 2022] GET /compute/v2.1/servers/ae68ed7f-2390-4238-aa17-0cc5a0fc1791 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:26.653376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-895eec96-4c0b-4062-8fe2-993113b687c7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:26.654000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-895eec96-4c0b-4062-8fe2-993113b687c7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:26.660535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-895eec96-4c0b-4062-8fe2-993113b687c7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.661244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-895eec96-4c0b-4062-8fe2-993113b687c7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:26.662219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-895eec96-4c0b-4062-8fe2-993113b687c7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:26.662826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-895eec96-4c0b-4062-8fe2-993113b687c7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:27.240710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-82731232-e402-410f-b965-427e66a07bbc tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:27.251056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-82731232-e402-410f-b965-427e66a07bbc tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1526 microversion: 2.1 time: 0.915146 Feb 19 20:54:27.252965 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 527/991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:26 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1526 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:27.266154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7d90f5f7-1a0c-494e-a4d7-31d6c5736575 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:27.268434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7d90f5f7-1a0c-494e-a4d7-31d6c5736575 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:27.279730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d90f5f7-1a0c-494e-a4d7-31d6c5736575 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:27.282253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d90f5f7-1a0c-494e-a4d7-31d6c5736575 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:27.283570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d90f5f7-1a0c-494e-a4d7-31d6c5736575 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:27.284018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d90f5f7-1a0c-494e-a4d7-31d6c5736575 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:27.303633 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-7d90f5f7-1a0c-494e-a4d7-31d6c5736575 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] HTTP exception thrown: Instance f4f05bec-0cf3-4c8d-adda-1f646f93100c could not be found. Feb 19 20:54:27.304863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7d90f5f7-1a0c-494e-a4d7-31d6c5736575 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Returning 404 to user: Instance f4f05bec-0cf3-4c8d-adda-1f646f93100c could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:27.306078 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7d90f5f7-1a0c-494e-a4d7-31d6c5736575 tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 404 len: 111 microversion: 2.1 time: 0.051895 Feb 19 20:54:27.306882 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 528/992] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:27 2022] DELETE /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:27.314390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:27.315583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:27.324440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:27.325078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:27.326045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:27.326646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:27.549932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-895eec96-4c0b-4062-8fe2-993113b687c7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:27.558448 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-895eec96-4c0b-4062-8fe2-993113b687c7 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1470 microversion: 2.1 time: 0.908562 Feb 19 20:54:27.559343 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 465/993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:26 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1470 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:27.563816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:27.564474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:27.570832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:27.571481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:27.572615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:27.573055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:27.824371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:27.837339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:27.839577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:27.841637 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d1e88539-051d-41e9-966a-5e6c25f6c71e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1281 microversion: 2.25 time: 0.533148 Feb 19 20:54:27.842456 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 529/994] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:27 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1281 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:27.849853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dab563f1-9c7c-40b5-8916-4b4717e16926 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:27.852985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dab563f1-9c7c-40b5-8916-4b4717e16926 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:27.875645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dab563f1-9c7c-40b5-8916-4b4717e16926 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:27.876091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dab563f1-9c7c-40b5-8916-4b4717e16926 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:27.877539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dab563f1-9c7c-40b5-8916-4b4717e16926 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:27.879632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dab563f1-9c7c-40b5-8916-4b4717e16926 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:27.998164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dab563f1-9c7c-40b5-8916-4b4717e16926 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:28.007748 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dab563f1-9c7c-40b5-8916-4b4717e16926 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1275 microversion: 2.1 time: 0.163607 Feb 19 20:54:28.020144 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 530/995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:27 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:28.036906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-61844107-3964-4272-b065-1ab27961dd3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:28.038556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-61844107-3964-4272-b065-1ab27961dd3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] [instance: f4f05bec-0cf3-4c8d-adda-1f646f93100c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:28.047403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61844107-3964-4272-b065-1ab27961dd3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.048509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61844107-3964-4272-b065-1ab27961dd3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.049435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61844107-3964-4272-b065-1ab27961dd3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.051254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61844107-3964-4272-b065-1ab27961dd3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.072564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:28.083847 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-61844107-3964-4272-b065-1ab27961dd3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] HTTP exception thrown: Instance f4f05bec-0cf3-4c8d-adda-1f646f93100c could not be found. Feb 19 20:54:28.084521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-61844107-3964-4272-b065-1ab27961dd3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] Returning 404 to user: Instance f4f05bec-0cf3-4c8d-adda-1f646f93100c could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:28.085535 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-61844107-3964-4272-b065-1ab27961dd3e tempest-ServersWithSpecificFlavorTestJSON-334149017 tempest-ServersWithSpecificFlavorTestJSON-334149017-project] 10.222.0.30 "GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c" status: 404 len: 111 microversion: 2.1 time: 0.063860 Feb 19 20:54:28.090419 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 531/996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:28 2022] GET /compute/v2.1/servers/f4f05bec-0cf3-4c8d-adda-1f646f93100c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:28.114865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:28.116676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:28.118046 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-414fc467-7d71-44b2-8093-8658ff1699fd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.557636 Feb 19 20:54:28.122234 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 466/997] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:27 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:28.151243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5eceebd0-98e3-4c2c-b170-085aa606d497 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:28.171603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5eceebd0-98e3-4c2c-b170-085aa606d497 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:28.184149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5eceebd0-98e3-4c2c-b170-085aa606d497 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.190396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5eceebd0-98e3-4c2c-b170-085aa606d497 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.191764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5eceebd0-98e3-4c2c-b170-085aa606d497 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.192242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5eceebd0-98e3-4c2c-b170-085aa606d497 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.292459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7cb9cf3b-6e13-4bfc-b237-f13713a1bf16 tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] Calling method '.version_select at 0x7f6467c3e310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:28.308179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cb9cf3b-6e13-4bfc-b237-f13713a1bf16 tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.309062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cb9cf3b-6e13-4bfc-b237-f13713a1bf16 tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.309887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cb9cf3b-6e13-4bfc-b237-f13713a1bf16 tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.310317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cb9cf3b-6e13-4bfc-b237-f13713a1bf16 tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.339173 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7cb9cf3b-6e13-4bfc-b237-f13713a1bf16 tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.246922 Feb 19 20:54:28.340398 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 532/998] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:28 2022] GET /compute/v2.1/limits => generated 511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:28.345674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-dcb79cce-dec8-4493-9e82-e57a3ca24146 req-27d5b125-6301-4a01-937d-a1203bceba57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2c4005-033c-4df6-978e-8ec53d9ac654", "name": "network-vif-deleted", "tag": "4313e698-6c12-4d1e-b019-f8d0163bad53"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:28.349010 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:28.349010 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:28.359638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-dcb79cce-dec8-4493-9e82-e57a3ca24146 req-27d5b125-6301-4a01-937d-a1203bceba57 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.360157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-dcb79cce-dec8-4493-9e82-e57a3ca24146 req-27d5b125-6301-4a01-937d-a1203bceba57 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.376784 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-dcb79cce-dec8-4493-9e82-e57a3ca24146 req-27d5b125-6301-4a01-937d-a1203bceba57 service nova] Creating event network-vif-deleted:4313e698-6c12-4d1e-b019-f8d0163bad53 for instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 on nch2-master-1 Feb 19 20:54:28.384510 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-dcb79cce-dec8-4493-9e82-e57a3ca24146 req-27d5b125-6301-4a01-937d-a1203bceba57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042550 Feb 19 20:54:28.386272 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 533/999] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:28.392062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:28.393095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:28.401155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.401704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.402620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.403155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.464240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.464754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.465212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lazy-loading 'fault' on Instance uuid 8d2c4005-033c-4df6-978e-8ec53d9ac654 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:54:28.543784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a4a7cd3a234092987f7fb637c91e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869a0cf6b5604ec89af633eb5012ff5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:28.557500 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-78efedfe-2506-4c39-891a-5d5a6ddb63c3 tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 200 len: 1313 microversion: 2.1 time: 0.169704 Feb 19 20:54:28.568762 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 534/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:28 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:28.578464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-41533b1f-00a3-477c-aec9-f6b38fa343c0 req-8ea3425b-3a49-4ba0-82c9-2667b6d94795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-plugged", "status": "completed", "tag": "72bb29c9-1a0c-4c88-a3aa-9aed178a43cc"}, {"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-plugged", "status": "completed", "tag": "1e1241d9-ddbc-426c-9df0-86c2c9670f97"}, {"server_uuid": "258092fb-1cd7-47c9-88f4-d92fafb344ef", "name": "network-vif-plugged", "status": "completed", "tag": "3c2d56ee-dcf8-4145-a7ce-83aa6441cb22"}, {"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-plugged", "status": "completed", "tag": "2bd27571-334d-4e5a-a015-91dd528ffb9f"}, {"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-plugged", "status": "completed", "tag": "8bb1ce04-77ae-47cb-af1b-16718979fb14"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:28.584078 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:28.584078 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:28.616177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-41533b1f-00a3-477c-aec9-f6b38fa343c0 req-8ea3425b-3a49-4ba0-82c9-2667b6d94795 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.617537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-41533b1f-00a3-477c-aec9-f6b38fa343c0 req-8ea3425b-3a49-4ba0-82c9-2667b6d94795 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.644259 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-41533b1f-00a3-477c-aec9-f6b38fa343c0 req-8ea3425b-3a49-4ba0-82c9-2667b6d94795 service nova] Creating event network-vif-plugged:72bb29c9-1a0c-4c88-a3aa-9aed178a43cc for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:28.645129 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-41533b1f-00a3-477c-aec9-f6b38fa343c0 req-8ea3425b-3a49-4ba0-82c9-2667b6d94795 service nova] Creating event network-vif-plugged:1e1241d9-ddbc-426c-9df0-86c2c9670f97 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:28.646066 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-41533b1f-00a3-477c-aec9-f6b38fa343c0 req-8ea3425b-3a49-4ba0-82c9-2667b6d94795 service nova] Creating event network-vif-plugged:3c2d56ee-dcf8-4145-a7ce-83aa6441cb22 for instance 258092fb-1cd7-47c9-88f4-d92fafb344ef on nch2-master-1 Feb 19 20:54:28.647157 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-41533b1f-00a3-477c-aec9-f6b38fa343c0 req-8ea3425b-3a49-4ba0-82c9-2667b6d94795 service nova] Creating event network-vif-plugged:2bd27571-334d-4e5a-a015-91dd528ffb9f for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:28.647885 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-41533b1f-00a3-477c-aec9-f6b38fa343c0 req-8ea3425b-3a49-4ba0-82c9-2667b6d94795 service nova] Creating event network-vif-plugged:8bb1ce04-77ae-47cb-af1b-16718979fb14 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:28.651273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5eceebd0-98e3-4c2c-b170-085aa606d497 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:28.657768 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-41533b1f-00a3-477c-aec9-f6b38fa343c0 req-8ea3425b-3a49-4ba0-82c9-2667b6d94795 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.097281 Feb 19 20:54:28.659047 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 535/1001] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:28.664665 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5eceebd0-98e3-4c2c-b170-085aa606d497 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1332 microversion: 2.1 time: 0.529463 Feb 19 20:54:28.666716 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 467/1002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:28 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1332 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:28.670355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3d2821e2-9af0-45de-a681-93112af7690c tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-33843874", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:28.680196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-087e1205-717a-4d9c-a07f-42f5f524f0e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:28.681102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-087e1205-717a-4d9c-a07f-42f5f524f0e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:28.692746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-087e1205-717a-4d9c-a07f-42f5f524f0e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.693203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-087e1205-717a-4d9c-a07f-42f5f524f0e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.694945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-087e1205-717a-4d9c-a07f-42f5f524f0e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:28.704856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-087e1205-717a-4d9c-a07f-42f5f524f0e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:28.770369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-3d2821e2-9af0-45de-a681-93112af7690c tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:54:29.241501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-087e1205-717a-4d9c-a07f-42f5f524f0e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:29.257519 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-087e1205-717a-4d9c-a07f-42f5f524f0e5 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1536 microversion: 2.1 time: 0.589545 Feb 19 20:54:29.258119 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 468/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:28 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1536 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:29.284088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:29.284658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:29.291941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:29.292640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:29.293801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:29.294412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:29.298447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-3d2821e2-9af0-45de-a681-93112af7690c tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] Getting quotas for project 8c0b0cac9d204f91b873271c7ced6fb3. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:29.307785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-3d2821e2-9af0-45de-a681-93112af7690c tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] Getting quotas for user b619186490cd489d854ec0ad316b5361 and project 8c0b0cac9d204f91b873271c7ced6fb3. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:29.342859 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-3d2821e2-9af0-45de-a681-93112af7690c tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Feb 19 20:54:29.343472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3d2821e2-9af0-45de-a681-93112af7690c tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:29.344359 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3d2821e2-9af0-45de-a681-93112af7690c tempest-AbsoluteLimitsNegativeTestJSON-684850359 tempest-AbsoluteLimitsNegativeTestJSON-684850359-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.683220 Feb 19 20:54:29.344948 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 536/1004] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Feb 19 20:54:28 2022] POST /compute/v2.1/servers => generated 87 bytes in 685 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:54:29.350384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b370260-ad88-4f1b-af3a-f2b8f2cffa0f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:29.351901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9b370260-ad88-4f1b-af3a-f2b8f2cffa0f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:29.359488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b370260-ad88-4f1b-af3a-f2b8f2cffa0f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:29.360624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b370260-ad88-4f1b-af3a-f2b8f2cffa0f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:29.361434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b370260-ad88-4f1b-af3a-f2b8f2cffa0f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:29.362038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b370260-ad88-4f1b-af3a-f2b8f2cffa0f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:29.940590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:29.956506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:29.959240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:29.961437 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-086c584f-60ac-4acd-bfe5-526bb8da3811 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1281 microversion: 2.25 time: 0.686245 Feb 19 20:54:29.962497 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 469/1005] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:29 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1281 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:29.969139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:29.970020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:29.978565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:29.979306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:29.988114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:29.989360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:30.094544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9b370260-ad88-4f1b-af3a-f2b8f2cffa0f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:30.109472 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b370260-ad88-4f1b-af3a-f2b8f2cffa0f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1317 microversion: 2.1 time: 0.763061 Feb 19 20:54:30.110341 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 537/1006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:29 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:30.118616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74be0325-cfcc-4683-83fb-63984341394c tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:30.119553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-74be0325-cfcc-4683-83fb-63984341394c tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] [instance: 8d2c4005-033c-4df6-978e-8ec53d9ac654] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:30.126085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74be0325-cfcc-4683-83fb-63984341394c tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:30.126542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74be0325-cfcc-4683-83fb-63984341394c tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:30.127351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74be0325-cfcc-4683-83fb-63984341394c tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:30.127795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74be0325-cfcc-4683-83fb-63984341394c tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:30.143317 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-74be0325-cfcc-4683-83fb-63984341394c tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] HTTP exception thrown: Instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 could not be found. Feb 19 20:54:30.143912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74be0325-cfcc-4683-83fb-63984341394c tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] Returning 404 to user: Instance 8d2c4005-033c-4df6-978e-8ec53d9ac654 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:30.144850 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-74be0325-cfcc-4683-83fb-63984341394c tempest-FloatingIPsAssociationTestJSON-381741989 tempest-FloatingIPsAssociationTestJSON-381741989-project] 10.222.0.30 "GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654" status: 404 len: 111 microversion: 2.1 time: 0.033122 Feb 19 20:54:30.145591 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 538/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:30 2022] GET /compute/v2.1/servers/8d2c4005-033c-4df6-978e-8ec53d9ac654 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:30.150144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-973f4f2c-1903-467a-a8a4-9d89d1483298 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:30.150753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-973f4f2c-1903-467a-a8a4-9d89d1483298 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:30.157256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-973f4f2c-1903-467a-a8a4-9d89d1483298 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:30.157442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-973f4f2c-1903-467a-a8a4-9d89d1483298 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:30.158750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-973f4f2c-1903-467a-a8a4-9d89d1483298 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:30.159383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-973f4f2c-1903-467a-a8a4-9d89d1483298 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:30.665157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:30.677824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:30.679345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:30.680779 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-17b1c6c9-5f28-445b-bf52-34b5209e04c2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1875 microversion: 2.42 time: 0.717004 Feb 19 20:54:30.681559 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 470/1008] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:29 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1875 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:30.685631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-596f5a99-42f2-4692-8764-588f7b1f4710 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:30.686235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-596f5a99-42f2-4692-8764-588f7b1f4710 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:30.697891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-596f5a99-42f2-4692-8764-588f7b1f4710 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:30.698454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-596f5a99-42f2-4692-8764-588f7b1f4710 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:30.699331 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-596f5a99-42f2-4692-8764-588f7b1f4710 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:30.699845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-596f5a99-42f2-4692-8764-588f7b1f4710 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:31.147809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-973f4f2c-1903-467a-a8a4-9d89d1483298 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:31.158701 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-973f4f2c-1903-467a-a8a4-9d89d1483298 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1332 microversion: 2.1 time: 1.011759 Feb 19 20:54:31.159240 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 539/1009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:30 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1332 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:31.165875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:31.170077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:31.182666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:31.185938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:31.186936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:31.188960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:31.396433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-596f5a99-42f2-4692-8764-588f7b1f4710 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:31.408955 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-596f5a99-42f2-4692-8764-588f7b1f4710 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1536 microversion: 2.1 time: 0.726440 Feb 19 20:54:31.409824 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 471/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:30 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1536 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:31.417789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fdbc0bea-7680-4f62-80e2-08783baff61e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:31.418775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fdbc0bea-7680-4f62-80e2-08783baff61e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:31.430879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdbc0bea-7680-4f62-80e2-08783baff61e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:31.432906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdbc0bea-7680-4f62-80e2-08783baff61e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:31.436755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdbc0bea-7680-4f62-80e2-08783baff61e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:31.437497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdbc0bea-7680-4f62-80e2-08783baff61e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:31.903142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:31.928149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:31.933588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:31.945921 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44142648-cb44-4c83-85b6-75616cd684d9 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1281 microversion: 2.25 time: 0.785387 Feb 19 20:54:31.947718 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 540/1011] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:31 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1281 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:31.953332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4eb8b2a8-b6c2-45de-8093-e73ae20584f8 req-ead2446b-1786-4490-ad43-2fd17c2ddcad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c97b67a-8ac7-415a-8fd9-9b05f343eb16", "tag": "90891e43-b363-4c09-a2eb-51710df5cd41"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:31.959129 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:31.959129 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:31.991570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fdbc0bea-7680-4f62-80e2-08783baff61e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:32.001966 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fdbc0bea-7680-4f62-80e2-08783baff61e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1317 microversion: 2.1 time: 0.590730 Feb 19 20:54:32.002778 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 472/1012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:31 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:32.005216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4eb8b2a8-b6c2-45de-8093-e73ae20584f8 req-ead2446b-1786-4490-ad43-2fd17c2ddcad service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.006148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4eb8b2a8-b6c2-45de-8093-e73ae20584f8 req-ead2446b-1786-4490-ad43-2fd17c2ddcad service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:32.012925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-888cf105-f882-4699-a05e-83ac92e4600a req-4855bc08-a1e1-4754-b0a4-b63cf3cd91eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016b6ece-713e-4a2d-ba16-6de26f2479cb", "name": "network-vif-plugged", "status": "completed", "tag": "8a66314a-6be0-4ed3-85c0-e29d46b221c9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:32.023139 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:32.023139 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:32.024638 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4eb8b2a8-b6c2-45de-8093-e73ae20584f8 req-ead2446b-1786-4490-ad43-2fd17c2ddcad service nova] Creating event network-changed:90891e43-b363-4c09-a2eb-51710df5cd41 for instance 4c97b67a-8ac7-415a-8fd9-9b05f343eb16 on nch2-master-1 Feb 19 20:54:32.030083 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4eb8b2a8-b6c2-45de-8093-e73ae20584f8 req-ead2446b-1786-4490-ad43-2fd17c2ddcad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081047 Feb 19 20:54:32.031167 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 541/1013] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:32.037837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:32.039418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:32.041866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-888cf105-f882-4699-a05e-83ac92e4600a req-4855bc08-a1e1-4754-b0a4-b63cf3cd91eb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.046756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.047426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:32.048398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.048522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-888cf105-f882-4699-a05e-83ac92e4600a req-4855bc08-a1e1-4754-b0a4-b63cf3cd91eb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:32.049271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:32.086636 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-888cf105-f882-4699-a05e-83ac92e4600a req-4855bc08-a1e1-4754-b0a4-b63cf3cd91eb service nova] Creating event network-vif-plugged:8a66314a-6be0-4ed3-85c0-e29d46b221c9 for instance 016b6ece-713e-4a2d-ba16-6de26f2479cb on nch1-master-1 Feb 19 20:54:32.097843 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-888cf105-f882-4699-a05e-83ac92e4600a req-4855bc08-a1e1-4754-b0a4-b63cf3cd91eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091637 Feb 19 20:54:32.101215 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 473/1014] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:32.185247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b3ac6d4b-e9d0-467b-a48b-dab58228d410 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:32.186073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b3ac6d4b-e9d0-467b-a48b-dab58228d410 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:32.195248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3ac6d4b-e9d0-467b-a48b-dab58228d410 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.195702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3ac6d4b-e9d0-467b-a48b-dab58228d410 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:32.197238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3ac6d4b-e9d0-467b-a48b-dab58228d410 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.198470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3ac6d4b-e9d0-467b-a48b-dab58228d410 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:32.899176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:32.920016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:32.924361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:32.927311 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-abba2f0b-19a6-42d2-a77c-3763c13b4289 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2833 microversion: 2.42 time: 0.894460 Feb 19 20:54:32.928513 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 542/1015] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:32 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2833 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:32.936455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-483574ee-7bb5-4fbb-80e5-653c5204bd0a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:32.937079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-483574ee-7bb5-4fbb-80e5-653c5204bd0a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:32.942140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b3ac6d4b-e9d0-467b-a48b-dab58228d410 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:32.952929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-483574ee-7bb5-4fbb-80e5-653c5204bd0a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.953386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-483574ee-7bb5-4fbb-80e5-653c5204bd0a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:32.954183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-483574ee-7bb5-4fbb-80e5-653c5204bd0a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.954625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-483574ee-7bb5-4fbb-80e5-653c5204bd0a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:32.961095 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b3ac6d4b-e9d0-467b-a48b-dab58228d410 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1534 microversion: 2.1 time: 0.785832 Feb 19 20:54:32.963835 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 474/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:32 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1534 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:54:32.988923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d1af0bc-6580-41c0-948b-90902f5bf61d tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:32.989460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d1af0bc-6580-41c0-948b-90902f5bf61d tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:32.995638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d1af0bc-6580-41c0-948b-90902f5bf61d tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.996295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d1af0bc-6580-41c0-948b-90902f5bf61d tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:32.996916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d1af0bc-6580-41c0-948b-90902f5bf61d tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:32.997358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d1af0bc-6580-41c0-948b-90902f5bf61d tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:33.301458 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d1af0bc-6580-41c0-948b-90902f5bf61d tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.324260 Feb 19 20:54:33.309226 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 475/1017] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Feb 19 20:54:32 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749/os-interface => generated 1832 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:33.320966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:33.321656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:33.329500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:33.330021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:33.331078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:33.332103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:33.528228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-483574ee-7bb5-4fbb-80e5-653c5204bd0a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:33.578645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-483574ee-7bb5-4fbb-80e5-653c5204bd0a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1536 microversion: 2.1 time: 0.641862 Feb 19 20:54:33.579335 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 543/1018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:32 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1536 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:33.606937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a7bbd4f-e754-4655-bcb7-049fd139e2da tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Action: 'create', calling method: .version_select at 0x7f6467b8b3a0>, body: {"pool": "46539bba-6cad-4c87-80c0-0d2c8447156a"} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:34.149097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:34.166065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:34.181607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:34.182830 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d19ef4ee-6250-4b21-a0d9-0938574b1b48 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1281 microversion: 2.25 time: 0.872042 Feb 19 20:54:34.183451 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 476/1019] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:33 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1281 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:34.188138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f4bd1c13-9dfa-4847-83c7-35951e54576b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:34.201339 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f4bd1c13-9dfa-4847-83c7-35951e54576b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:34.207961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4bd1c13-9dfa-4847-83c7-35951e54576b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:34.208694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4bd1c13-9dfa-4847-83c7-35951e54576b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:34.209504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4bd1c13-9dfa-4847-83c7-35951e54576b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:34.210114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4bd1c13-9dfa-4847-83c7-35951e54576b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:35.107092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f4bd1c13-9dfa-4847-83c7-35951e54576b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:35.126166 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f4bd1c13-9dfa-4847-83c7-35951e54576b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1317 microversion: 2.1 time: 0.940157 Feb 19 20:54:35.132241 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 477/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:34 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1317 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:35.142298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-9284f445-fd23-4bca-bec4-4e694e09fd8c req-bb6c6b09-8e6a-4847-821f-181718f0828d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de", "name": "network-vif-unplugged", "status": "completed", "tag": "191fbf35-b9ce-44cc-bb60-5039a7b3f93f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:35.145011 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:35.145011 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:35.153071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9284f445-fd23-4bca-bec4-4e694e09fd8c req-bb6c6b09-8e6a-4847-821f-181718f0828d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:35.154309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9284f445-fd23-4bca-bec4-4e694e09fd8c req-bb6c6b09-8e6a-4847-821f-181718f0828d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:35.177188 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-9284f445-fd23-4bca-bec4-4e694e09fd8c req-bb6c6b09-8e6a-4847-821f-181718f0828d service nova] Creating event network-vif-unplugged:191fbf35-b9ce-44cc-bb60-5039a7b3f93f for instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de on nch1-master-1 Feb 19 20:54:35.183171 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-9284f445-fd23-4bca-bec4-4e694e09fd8c req-bb6c6b09-8e6a-4847-821f-181718f0828d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049348 Feb 19 20:54:35.184488 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 478/1021] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:35.189746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8908d381-b117-4009-a05f-a94ba99b478a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:35.190666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8908d381-b117-4009-a05f-a94ba99b478a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:35.200044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8908d381-b117-4009-a05f-a94ba99b478a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:35.200846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8908d381-b117-4009-a05f-a94ba99b478a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:35.201957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8908d381-b117-4009-a05f-a94ba99b478a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:35.202560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8908d381-b117-4009-a05f-a94ba99b478a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:35.805586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8908d381-b117-4009-a05f-a94ba99b478a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:35.814599 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8908d381-b117-4009-a05f-a94ba99b478a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1529 microversion: 2.1 time: 0.628731 Feb 19 20:54:35.824406 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 479/1022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:35 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1529 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:35.824406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:35.824406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:35.830886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:35.831418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:35.832443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:35.832958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:36.239456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:36.254272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:36.256242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:36.262304 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cf165209-3039-47e1-b73f-6d23af24960b tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1477 microversion: 2.25 time: 0.444056 Feb 19 20:54:36.262983 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 480/1023] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:35 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1477 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:36.439338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-718748473", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "2f59eddf-b940-4bbe-b896-7b9364a9f83b"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:36.500835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] validate_networks() for [('2f59eddf-b940-4bbe-b896-7b9364a9f83b', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:54:37.665213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:54:37.666417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:54:37.667393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:54:37.667992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:54:37.668590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:54:37.689020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:37.691530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:37.691530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:37.692494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:37.735266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Getting quotas for project 29dd33f3e21c4153b2dc5ec75558b150. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:37.742018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Getting quotas for user 40515f5be4664c98a06359ae852e7b84 and project 29dd33f3e21c4153b2dc5ec75558b150. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:37.759157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:54:37.763974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:54:37.845814 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f2001462-5f5a-4b9d-a86a-478ec1268770 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569891 Feb 19 20:54:37.851297 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 481/1024] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:54:37.862604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2229ea4-2d14-432c-a59a-ea848558b567 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:37.863925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2229ea4-2d14-432c-a59a-ea848558b567 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:37.901543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2229ea4-2d14-432c-a59a-ea848558b567 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:37.904283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2229ea4-2d14-432c-a59a-ea848558b567 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:37.905814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2229ea4-2d14-432c-a59a-ea848558b567 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:37.906729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2229ea4-2d14-432c-a59a-ea848558b567 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.242775 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a7bbd4f-e754-4655-bcb7-049fd139e2da tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.650146 Feb 19 20:54:38.245092 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 544/1025] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:54:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:38.258313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-11de67fc-7af9-42ea-8d66-b733d759548e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:38.259433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-11de67fc-7af9-42ea-8d66-b733d759548e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:38.268121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11de67fc-7af9-42ea-8d66-b733d759548e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.268984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11de67fc-7af9-42ea-8d66-b733d759548e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.270341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11de67fc-7af9-42ea-8d66-b733d759548e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.271781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11de67fc-7af9-42ea-8d66-b733d759548e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.296554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2229ea4-2d14-432c-a59a-ea848558b567 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:38.310773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2229ea4-2d14-432c-a59a-ea848558b567 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1529 microversion: 2.1 time: 0.456970 Feb 19 20:54:38.314771 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 482/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:37 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1529 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:38.330217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-894caa8d-9968-4084-bd64-3d98678ee103 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:38.333820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-894caa8d-9968-4084-bd64-3d98678ee103 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:38.354311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-894caa8d-9968-4084-bd64-3d98678ee103 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.354968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-894caa8d-9968-4084-bd64-3d98678ee103 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.355866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-894caa8d-9968-4084-bd64-3d98678ee103 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.356304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-894caa8d-9968-4084-bd64-3d98678ee103 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.689137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11de67fc-7af9-42ea-8d66-b733d759548e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:38.739509 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-11de67fc-7af9-42ea-8d66-b733d759548e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1317 microversion: 2.1 time: 0.477976 Feb 19 20:54:38.741327 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 545/1027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:38 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:38.758580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-894caa8d-9968-4084-bd64-3d98678ee103 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid 016b6ece-713e-4a2d-ba16-6de26f2479cb {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:54:38.761719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:38.762339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:38.774357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.780773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.781212 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-894caa8d-9968-4084-bd64-3d98678ee103 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1970 microversion: 2.25 time: 0.462337 Feb 19 20:54:38.781781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.782294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.782754 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 483/1028] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:38 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1970 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:38.790628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-392a4b2d-a40f-4599-b82b-024dae82bfc9 req-0c19f2b3-ac76-4d73-b031-6577211abe6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "tag": "a5a05223-8669-4696-8f96-528bee454543"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:38.793392 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:38.793392 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:38.801645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-392a4b2d-a40f-4599-b82b-024dae82bfc9 req-0c19f2b3-ac76-4d73-b031-6577211abe6d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.802323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-392a4b2d-a40f-4599-b82b-024dae82bfc9 req-0c19f2b3-ac76-4d73-b031-6577211abe6d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.818754 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-392a4b2d-a40f-4599-b82b-024dae82bfc9 req-0c19f2b3-ac76-4d73-b031-6577211abe6d service nova] Creating event network-changed:a5a05223-8669-4696-8f96-528bee454543 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:54:38.828949 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-392a4b2d-a40f-4599-b82b-024dae82bfc9 req-0c19f2b3-ac76-4d73-b031-6577211abe6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039791 Feb 19 20:54:38.830570 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 484/1029] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:38.836109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-89559817-4a0d-489b-8696-6882772b0611 req-f9d9f420-d105-4603-a2bd-78c9897888a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de", "name": "network-vif-plugged", "status": "completed", "tag": "191fbf35-b9ce-44cc-bb60-5039a7b3f93f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:38.838147 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:38.838147 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:38.846065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-89559817-4a0d-489b-8696-6882772b0611 req-f9d9f420-d105-4603-a2bd-78c9897888a2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.846635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-89559817-4a0d-489b-8696-6882772b0611 req-f9d9f420-d105-4603-a2bd-78c9897888a2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.861971 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-89559817-4a0d-489b-8696-6882772b0611 req-f9d9f420-d105-4603-a2bd-78c9897888a2 service nova] Creating event network-vif-plugged:191fbf35-b9ce-44cc-bb60-5039a7b3f93f for instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de on nch1-master-1 Feb 19 20:54:38.868900 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-89559817-4a0d-489b-8696-6882772b0611 req-f9d9f420-d105-4603-a2bd-78c9897888a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036915 Feb 19 20:54:38.870151 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 485/1030] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:38.876855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d4585b2b-a40b-4a3f-93a4-81d526786d0e tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:38.877568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d4585b2b-a40b-4a3f-93a4-81d526786d0e tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:38.884814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4585b2b-a40b-4a3f-93a4-81d526786d0e tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.885441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4585b2b-a40b-4a3f-93a4-81d526786d0e tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.886653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4585b2b-a40b-4a3f-93a4-81d526786d0e tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:38.887327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4585b2b-a40b-4a3f-93a4-81d526786d0e tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:38.971933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d4585b2b-a40b-4a3f-93a4-81d526786d0e tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:38.979948 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d4585b2b-a40b-4a3f-93a4-81d526786d0e tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1268 microversion: 2.1 time: 0.108325 Feb 19 20:54:38.980590 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 486/1031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:38 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1268 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:39.102019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8045534a-d708-4877-9435-ab6c3e01c26e tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Calling method '.version_select at 0x7f6467cd20d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:39.122701 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8045534a-d708-4877-9435-ab6c3e01c26e tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] HTTP exception thrown: Image not found. Feb 19 20:54:39.123296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8045534a-d708-4877-9435-ab6c3e01c26e tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Returning 404 to user: Image not found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:39.124127 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8045534a-d708-4877-9435-ab6c3e01c26e tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] 10.222.0.30 "DELETE /compute/v2.1/images/c9c2c921-c12c-490d-97c6-c86a398c351e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.142627 Feb 19 20:54:39.124716 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 487/1032] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 20:54:38 2022] DELETE /compute/v2.1/images/c9c2c921-c12c-490d-97c6-c86a398c351e/metadata/os_distro => generated 62 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:54:39.129929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.212"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:39.132376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:39.138287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:39.138739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:39.139529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:39.139977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:39.163880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Acquired lock "refresh_cache-258092fb-1cd7-47c9-88f4-d92fafb344ef" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:54:39.502494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:39.511218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:39.512773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:39.514005 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4a9ab392-e553-4c40-9c0c-d3e305dca918 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2833 microversion: 2.42 time: 0.759006 Feb 19 20:54:39.514586 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 546/1033] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:38 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2833 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:39.519603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e61ee2fe-b314-421e-9918-c13e56922819 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:39.520479 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:39.520479 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:39.526195 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e61ee2fe-b314-421e-9918-c13e56922819 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] HTTP exception thrown: Flavor 095b66d7-d6c5-4c13-8884-b31217056c4e could not be found. Feb 19 20:54:39.526786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e61ee2fe-b314-421e-9918-c13e56922819 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Returning 404 to user: Flavor 095b66d7-d6c5-4c13-8884-b31217056c4e could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:39.527613 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e61ee2fe-b314-421e-9918-c13e56922819 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/095b66d7-d6c5-4c13-8884-b31217056c4e" status: 404 len: 109 microversion: 2.1 time: 0.012119 Feb 19 20:54:39.531202 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 547/1034] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:54:39 2022] DELETE /compute/v2.1/flavors/095b66d7-d6c5-4c13-8884-b31217056c4e => generated 109 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:54:39.546912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-45ceba3d-5f8e-4074-8dc2-c8a8f3fb6703 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:39.547525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-45ceba3d-5f8e-4074-8dc2-c8a8f3fb6703 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:39.556297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45ceba3d-5f8e-4074-8dc2-c8a8f3fb6703 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:39.556778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45ceba3d-5f8e-4074-8dc2-c8a8f3fb6703 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:39.557646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45ceba3d-5f8e-4074-8dc2-c8a8f3fb6703 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:39.558090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45ceba3d-5f8e-4074-8dc2-c8a8f3fb6703 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:40.458841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-45ceba3d-5f8e-4074-8dc2-c8a8f3fb6703 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid 016b6ece-713e-4a2d-ba16-6de26f2479cb {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:54:40.472080 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-45ceba3d-5f8e-4074-8dc2-c8a8f3fb6703 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1970 microversion: 2.25 time: 0.942534 Feb 19 20:54:40.472686 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 548/1035] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:39 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1970 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:40.476881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0ee4b99a-cc74-4f2f-be2f-c994e94f2ee2 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Calling method '.version_select at 0x7f6467c3d0d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:40.498225 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0ee4b99a-cc74-4f2f-be2f-c994e94f2ee2 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] HTTP exception thrown: Image not found. Feb 19 20:54:40.498814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0ee4b99a-cc74-4f2f-be2f-c994e94f2ee2 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:40.499755 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0ee4b99a-cc74-4f2f-be2f-c994e94f2ee2 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] 10.222.0.30 "GET /compute/v2.1/images/e9a7e19c-d252-43be-8f2f-5ea5974fe85d/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.026171 Feb 19 20:54:40.500466 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 549/1036] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 20:54:40 2022] GET /compute/v2.1/images/e9a7e19c-d252-43be-8f2f-5ea5974fe85d/metadata/os_version => generated 62 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:54:40.506555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f738ffd-79ae-4b6c-b5fe-dded9d7601ea tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:40.507719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f738ffd-79ae-4b6c-b5fe-dded9d7601ea tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:40.514141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f738ffd-79ae-4b6c-b5fe-dded9d7601ea tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:40.514583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f738ffd-79ae-4b6c-b5fe-dded9d7601ea tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:40.515357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f738ffd-79ae-4b6c-b5fe-dded9d7601ea tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:40.515785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f738ffd-79ae-4b6c-b5fe-dded9d7601ea tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:40.950116 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f738ffd-79ae-4b6c-b5fe-dded9d7601ea tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.448731 Feb 19 20:54:40.951294 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 550/1037] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Feb 19 20:54:40 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749/os-interface => generated 1832 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:40.955920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2070793155", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:41.025256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:54:42.089831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:54:42.093148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:54:42.094290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:54:42.094698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:54:42.095696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:54:42.126212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:42.127026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:42.128273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:42.129406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:42.169335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:42.180300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Getting quotas for user c26bc5048c9849218cadd12475cd5fbe and project e2599a1bea39406f9b1e548ab3f1cd22. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:42.199216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:54:42.202134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:54:42.267690 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-77e4c726-4ea7-4c4a-b470-a89f427aeded tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315149 Feb 19 20:54:42.274528 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 551/1038] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:54:42.284529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a6ed8d6-34b0-48e3-b1c7-d31c449ca3b4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:42.286546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a6ed8d6-34b0-48e3-b1c7-d31c449ca3b4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:42.296043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a6ed8d6-34b0-48e3-b1c7-d31c449ca3b4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:42.297137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a6ed8d6-34b0-48e3-b1c7-d31c449ca3b4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:42.298613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a6ed8d6-34b0-48e3-b1c7-d31c449ca3b4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:42.299791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a6ed8d6-34b0-48e3-b1c7-d31c449ca3b4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:42.794102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Building network info cache for instance {{(pid=136095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 20:54:42.819065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a6ed8d6-34b0-48e3-b1c7-d31c449ca3b4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:42.836936 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a6ed8d6-34b0-48e3-b1c7-d31c449ca3b4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1317 microversion: 2.1 time: 0.561051 Feb 19 20:54:42.837556 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 552/1039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:42 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:42.850607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-793957ed-5462-4f80-9cd9-01a3087f0f71 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:42.851363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-793957ed-5462-4f80-9cd9-01a3087f0f71 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:42.865594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-793957ed-5462-4f80-9cd9-01a3087f0f71 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:42.865991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-793957ed-5462-4f80-9cd9-01a3087f0f71 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:42.867009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-793957ed-5462-4f80-9cd9-01a3087f0f71 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:42.867418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-793957ed-5462-4f80-9cd9-01a3087f0f71 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:43.455942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-793957ed-5462-4f80-9cd9-01a3087f0f71 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:43.464118 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-793957ed-5462-4f80-9cd9-01a3087f0f71 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1316 microversion: 2.1 time: 0.625506 Feb 19 20:54:43.481616 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 553/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:42 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:43.514002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ec3170a-5bd3-426d-8772-c430a46f7807 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:43.518057 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:43.518057 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:43.521986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ec3170a-5bd3-426d-8772-c430a46f7807 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:43.523175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ec3170a-5bd3-426d-8772-c430a46f7807 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:43.524272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ec3170a-5bd3-426d-8772-c430a46f7807 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:43.525351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ec3170a-5bd3-426d-8772-c430a46f7807 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:43.569752 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ec3170a-5bd3-426d-8772-c430a46f7807 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093790 Feb 19 20:54:43.570782 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 554/1041] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Feb 19 20:54:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:54:43.602497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84a6605e-973c-4b42-a69c-40a67d426c86 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Calling method '.version_select at 0x7f6467b4d160>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:43.643040 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-84a6605e-973c-4b42-a69c-40a67d426c86 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] HTTP exception thrown: Image not found. Feb 19 20:54:43.643510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84a6605e-973c-4b42-a69c-40a67d426c86 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:43.644932 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84a6605e-973c-4b42-a69c-40a67d426c86 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] 10.222.0.30 "GET /compute/v2.1/images/761e5fc0-ebac-4c48-9588-de35af59f11b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.072864 Feb 19 20:54:43.651361 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 555/1042] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:54:43 2022] GET /compute/v2.1/images/761e5fc0-ebac-4c48-9588-de35af59f11b/metadata => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:54:43.658171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6a50f8e1-dfc7-43b8-843d-9f2ea64db75d req-7013b6ea-aa58-406e-89b7-b03145883b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c97b67a-8ac7-415a-8fd9-9b05f343eb16", "name": "network-vif-plugged", "status": "completed", "tag": "90891e43-b363-4c09-a2eb-51710df5cd41"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:43.661813 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:43.661813 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:43.672839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6a50f8e1-dfc7-43b8-843d-9f2ea64db75d req-7013b6ea-aa58-406e-89b7-b03145883b89 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:43.673588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6a50f8e1-dfc7-43b8-843d-9f2ea64db75d req-7013b6ea-aa58-406e-89b7-b03145883b89 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:43.691389 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6a50f8e1-dfc7-43b8-843d-9f2ea64db75d req-7013b6ea-aa58-406e-89b7-b03145883b89 service nova] Creating event network-vif-plugged:90891e43-b363-4c09-a2eb-51710df5cd41 for instance 4c97b67a-8ac7-415a-8fd9-9b05f343eb16 on nch2-master-1 Feb 19 20:54:43.706531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6a50f8e1-dfc7-43b8-843d-9f2ea64db75d req-7013b6ea-aa58-406e-89b7-b03145883b89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051700 Feb 19 20:54:43.708220 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 556/1043] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:43.717970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2492439f-1718-45b8-9f71-eebd47311274 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:43.726607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2492439f-1718-45b8-9f71-eebd47311274 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:43.749958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2492439f-1718-45b8-9f71-eebd47311274 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:43.751547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2492439f-1718-45b8-9f71-eebd47311274 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:43.754479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2492439f-1718-45b8-9f71-eebd47311274 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:43.756559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2492439f-1718-45b8-9f71-eebd47311274 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:43.983717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2492439f-1718-45b8-9f71-eebd47311274 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:43.996977 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2492439f-1718-45b8-9f71-eebd47311274 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1273 microversion: 2.1 time: 0.285984 Feb 19 20:54:43.998245 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 557/1044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:43 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:44.005887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6e9d3e6e-ee25-4d23-9491-28a40d4a2271 req-2e4dec69-1260-41b2-865a-32b87911a6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258092fb-1cd7-47c9-88f4-d92fafb344ef", "tag": "3c2d56ee-dcf8-4145-a7ce-83aa6441cb22"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:44.008210 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:44.008210 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:44.027194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6e9d3e6e-ee25-4d23-9491-28a40d4a2271 req-2e4dec69-1260-41b2-865a-32b87911a6af service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:44.027682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6e9d3e6e-ee25-4d23-9491-28a40d4a2271 req-2e4dec69-1260-41b2-865a-32b87911a6af service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:44.044794 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6e9d3e6e-ee25-4d23-9491-28a40d4a2271 req-2e4dec69-1260-41b2-865a-32b87911a6af service nova] Creating event network-changed:3c2d56ee-dcf8-4145-a7ce-83aa6441cb22 for instance 258092fb-1cd7-47c9-88f4-d92fafb344ef on nch2-master-1 Feb 19 20:54:44.053161 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6e9d3e6e-ee25-4d23-9491-28a40d4a2271 req-2e4dec69-1260-41b2-865a-32b87911a6af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053030 Feb 19 20:54:44.054651 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 558/1045] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:44.060881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-01b81794-5f12-49d3-9455-b56bc7652b60 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:44.062349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-01b81794-5f12-49d3-9455-b56bc7652b60 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:44.073576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01b81794-5f12-49d3-9455-b56bc7652b60 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:44.074629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01b81794-5f12-49d3-9455-b56bc7652b60 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:44.075888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01b81794-5f12-49d3-9455-b56bc7652b60 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:44.076628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01b81794-5f12-49d3-9455-b56bc7652b60 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:44.116993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-01b81794-5f12-49d3-9455-b56bc7652b60 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'flavor' on Instance uuid 016b6ece-713e-4a2d-ba16-6de26f2479cb {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:54:44.137348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-01b81794-5f12-49d3-9455-b56bc7652b60 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Going to try to live migrate instance to nch2-master-1 {{(pid=136094) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 20:54:44.639871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Updating instance_info_cache with network_info: [{"id": "3c2d56ee-dcf8-4145-a7ce-83aa6441cb22", "address": "fa:16:3e:80:b8:96", "network": {"id": "e1715c46-c90a-49c7-8aa3-a86a06453327", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-70565224-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8a274e94e3e643c4b814892e2429db0e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3c2d56ee-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 20:54:44.655892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Releasing lock "refresh_cache-258092fb-1cd7-47c9-88f4-d92fafb344ef" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:54:44.665164 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e2c33713-e51e-44b8-8a3f-e9e576eaa075 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action" status: 202 len: 0 microversion: 2.1 time: 5.532393 Feb 19 20:54:44.668568 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 488/1046] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:54:39 2022] POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action => generated 0 bytes in 5541 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 20:54:44.670600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-541d3090-ed1c-4de8-9b90-17d767c53dd9 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Action: 'update_all', calling method: .version_select at 0x7f6467cdae50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:44.703632 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-541d3090-ed1c-4de8-9b90-17d767c53dd9 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] HTTP exception thrown: Image not found. Feb 19 20:54:44.704534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-541d3090-ed1c-4de8-9b90-17d767c53dd9 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Returning 404 to user: Image not found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:44.705511 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-541d3090-ed1c-4de8-9b90-17d767c53dd9 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] 10.222.0.30 "PUT /compute/v2.1/images/a6fd4dce-5da9-4636-b35d-dca6a0c8844e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.038536 Feb 19 20:54:44.707684 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 489/1047] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:54:44 2022] PUT /compute/v2.1/images/a6fd4dce-5da9-4636-b35d-dca6a0c8844e/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:54:44.716910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-26553140-0d6f-438d-b916-21a3b2c4189f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:44.717860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-26553140-0d6f-438d-b916-21a3b2c4189f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:44.727124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26553140-0d6f-438d-b916-21a3b2c4189f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:44.727927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26553140-0d6f-438d-b916-21a3b2c4189f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:44.729012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26553140-0d6f-438d-b916-21a3b2c4189f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:44.729665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26553140-0d6f-438d-b916-21a3b2c4189f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:45.122891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-26553140-0d6f-438d-b916-21a3b2c4189f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:45.131464 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-26553140-0d6f-438d-b916-21a3b2c4189f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1317 microversion: 2.1 time: 0.422485 Feb 19 20:54:45.132063 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 490/1048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:44 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:45.139306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f37f555-6857-4f71-9248-058591e110ef tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:45.147182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f37f555-6857-4f71-9248-058591e110ef tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:45.168535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f37f555-6857-4f71-9248-058591e110ef tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:45.171035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f37f555-6857-4f71-9248-058591e110ef tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:45.172213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f37f555-6857-4f71-9248-058591e110ef tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:45.173544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f37f555-6857-4f71-9248-058591e110ef tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:45.772078 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-01b81794-5f12-49d3-9455-b56bc7652b60 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb/action" status: 202 len: 0 microversion: 2.25 time: 1.715465 Feb 19 20:54:45.772832 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 559/1049] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 20:54:44 2022] POST /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb/action => generated 0 bytes in 1717 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:54:45.777672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82cadf4f-2a29-48de-98b6-7647185115d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Action: 'create', calling method: .version_select at 0x7f6467cd65e0>, body: {"pool": "46539bba-6cad-4c87-80c0-0d2c8447156a"} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:45.876856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f37f555-6857-4f71-9248-058591e110ef tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:45.888416 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f37f555-6857-4f71-9248-058591e110ef tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1316 microversion: 2.1 time: 0.752423 Feb 19 20:54:45.890112 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 491/1050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:45 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:45.896224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a6e35bc0-082d-400b-8113-1bbf37bd3128 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Action: 'update', calling method: .version_select at 0x7f6467ce4d30>, body: {"meta": {"os_distro": "alt"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:45.932592 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-a6e35bc0-082d-400b-8113-1bbf37bd3128 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] HTTP exception thrown: Image not found. Feb 19 20:54:45.933318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a6e35bc0-082d-400b-8113-1bbf37bd3128 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Returning 404 to user: Image not found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:45.934039 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a6e35bc0-082d-400b-8113-1bbf37bd3128 tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] 10.222.0.30 "PUT /compute/v2.1/images/20f5c283-2a49-4d78-94a0-82122501eaba/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.042527 Feb 19 20:54:45.939219 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 492/1051] 10.222.0.30 () {60 vars in 1309 bytes} [Sat Feb 19 20:54:45 2022] PUT /compute/v2.1/images/20f5c283-2a49-4d78-94a0-82122501eaba/metadata/os_distro => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:54:45.949804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f8953a1-2a36-41fa-b548-2f2435c92c61 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:45.950465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f8953a1-2a36-41fa-b548-2f2435c92c61 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:45.986212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f8953a1-2a36-41fa-b548-2f2435c92c61 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:45.986888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f8953a1-2a36-41fa-b548-2f2435c92c61 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:45.990033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f8953a1-2a36-41fa-b548-2f2435c92c61 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:45.991433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f8953a1-2a36-41fa-b548-2f2435c92c61 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:46.439000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9f8953a1-2a36-41fa-b548-2f2435c92c61 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:46.453346 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f8953a1-2a36-41fa-b548-2f2435c92c61 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.515155 Feb 19 20:54:46.470352 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 493/1052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:45 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:46.478803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:46.479636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:46.486289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:46.487122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:46.490113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:46.490930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:46.904285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:46.916833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:46.919325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:46.920993 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4a24fda3-6a44-4e84-ba92-2413f0df7ede tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.449423 Feb 19 20:54:46.921726 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 494/1053] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:46 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:46.929661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06a477e6-bc52-45a9-9a17-e4dfb47f99aa tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Action: 'create', calling method: .version_select at 0x7f6467dbe550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:46.952841 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-06a477e6-bc52-45a9-9a17-e4dfb47f99aa tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] HTTP exception thrown: Image not found. Feb 19 20:54:46.953886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06a477e6-bc52-45a9-9a17-e4dfb47f99aa tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] Returning 404 to user: Image not found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:46.955021 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06a477e6-bc52-45a9-9a17-e4dfb47f99aa tempest-ImagesMetadataNegativeTestJSON-835656351 tempest-ImagesMetadataNegativeTestJSON-835656351-project] 10.222.0.30 "POST /compute/v2.1/images/0000fe50-0367-4b47-975d-8f4bc9e981a9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032083 Feb 19 20:54:46.955994 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 495/1054] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Feb 19 20:54:46 2022] POST /compute/v2.1/images/0000fe50-0367-4b47-975d-8f4bc9e981a9/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:54:46.971269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-7098b65a-aa5f-42bb-aff1-e03b9e49f05c req-727a43c6-6f05-4d9d-b66f-433e9d1217ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ef2a35-0d6a-42b8-8275-c514b5724837", "tag": "ab2d1d8e-e972-4f4b-8626-d98c3b875877"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:46.976434 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:46.976434 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:46.997171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7098b65a-aa5f-42bb-aff1-e03b9e49f05c req-727a43c6-6f05-4d9d-b66f-433e9d1217ba service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:46.998006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7098b65a-aa5f-42bb-aff1-e03b9e49f05c req-727a43c6-6f05-4d9d-b66f-433e9d1217ba service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:47.043252 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-7098b65a-aa5f-42bb-aff1-e03b9e49f05c req-727a43c6-6f05-4d9d-b66f-433e9d1217ba service nova] Creating event network-changed:ab2d1d8e-e972-4f4b-8626-d98c3b875877 for instance 61ef2a35-0d6a-42b8-8275-c514b5724837 on nch1-master-1 Feb 19 20:54:47.055660 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-7098b65a-aa5f-42bb-aff1-e03b9e49f05c req-727a43c6-6f05-4d9d-b66f-433e9d1217ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094775 Feb 19 20:54:47.058103 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 496/1055] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:47.070832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bee96768-f979-425d-8ae9-5099ba082a82 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:47.072656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bee96768-f979-425d-8ae9-5099ba082a82 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:47.092265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bee96768-f979-425d-8ae9-5099ba082a82 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:47.093389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bee96768-f979-425d-8ae9-5099ba082a82 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:47.094638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bee96768-f979-425d-8ae9-5099ba082a82 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:47.096271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bee96768-f979-425d-8ae9-5099ba082a82 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:47.685906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bee96768-f979-425d-8ae9-5099ba082a82 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:47.693932 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bee96768-f979-425d-8ae9-5099ba082a82 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1466 microversion: 2.1 time: 0.633775 Feb 19 20:54:47.719004 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 497/1056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:47 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1466 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:47.724101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cdb3f51c-b1ee-4dbe-8faf-30b10dc84ccd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:47.732371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cdb3f51c-b1ee-4dbe-8faf-30b10dc84ccd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:47.739457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdb3f51c-b1ee-4dbe-8faf-30b10dc84ccd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:47.740161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdb3f51c-b1ee-4dbe-8faf-30b10dc84ccd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:47.741191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdb3f51c-b1ee-4dbe-8faf-30b10dc84ccd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:47.742336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdb3f51c-b1ee-4dbe-8faf-30b10dc84ccd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:48.266613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cdb3f51c-b1ee-4dbe-8faf-30b10dc84ccd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:48.274812 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cdb3f51c-b1ee-4dbe-8faf-30b10dc84ccd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1316 microversion: 2.1 time: 0.554232 Feb 19 20:54:48.275385 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 498/1057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:47 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:48.633232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2051102698", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:48.699456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:54:49.110749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:54:49.111182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:54:49.111666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:54:49.112077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:54:49.112698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:54:49.121472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:49.121932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:49.122783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:49.123226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:49.139878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Getting quotas for project 756e52c91ebf4bc9bacebcc1431abb28. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:49.144463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Getting quotas for user 076a0cb931aa4bcd8c4b4d95c387fb4c and project 756e52c91ebf4bc9bacebcc1431abb28. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:49.155261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:54:49.157646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:54:49.202674 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-82cadf4f-2a29-48de-98b6-7647185115d6 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.428658 Feb 19 20:54:49.203165 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-129608e7-65b7-4b73-ae0d-f438993e8489 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925983 Feb 19 20:54:49.209819 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 499/1058] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:54:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:54:49.209819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-70614f8e-201c-4dbf-b91d-091254dd4a95 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:49.216728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-70614f8e-201c-4dbf-b91d-091254dd4a95 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:49.217922 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 560/1059] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:54:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:49.222645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70614f8e-201c-4dbf-b91d-091254dd4a95 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:49.223198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70614f8e-201c-4dbf-b91d-091254dd4a95 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:49.224399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70614f8e-201c-4dbf-b91d-091254dd4a95 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:49.224920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70614f8e-201c-4dbf-b91d-091254dd4a95 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:49.422712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d407261a-4edd-4ed4-a41a-9207cf7625c6 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:49.423290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d407261a-4edd-4ed4-a41a-9207cf7625c6 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:49.430467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d407261a-4edd-4ed4-a41a-9207cf7625c6 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:49.431171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d407261a-4edd-4ed4-a41a-9207cf7625c6 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:49.432138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d407261a-4edd-4ed4-a41a-9207cf7625c6 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:49.432831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d407261a-4edd-4ed4-a41a-9207cf7625c6 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:49.811874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-70614f8e-201c-4dbf-b91d-091254dd4a95 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:49.823943 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-70614f8e-201c-4dbf-b91d-091254dd4a95 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.618814 Feb 19 20:54:49.824820 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 500/1060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:49 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:49.838256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:49.838879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:49.844865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:49.845517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:49.846547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:49.847182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:49.963512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d407261a-4edd-4ed4-a41a-9207cf7625c6 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1617 microversion: 2.1 time: 0.743880 Feb 19 20:54:49.964088 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 561/1061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:49 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1617 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:50.027086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:50.028077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3b24e54f-82ee-41e3-a5f1-77622a9cfb21 tempest-ListImagesTestJSON-1928948878 tempest-ListImagesTestJSON-1928948878-project] Calling method '.version_select at 0x7f6467c3e310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:50.035166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:50.036700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:50.037852 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-23628a48-c504-4d20-b855-1c90e5c1f083 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.203279 Feb 19 20:54:50.038422 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 501/1062] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:49 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:50.042850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-08e52d35-aa21-4729-84e9-4471355db2ea req-2f04e15c-48fb-414a-a9a4-8e6efc9d56d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a", "tag": "baf844cf-250b-42ea-b385-80d607da7e79"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:50.044398 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:50.044398 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:50.051636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-08e52d35-aa21-4729-84e9-4471355db2ea req-2f04e15c-48fb-414a-a9a4-8e6efc9d56d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:50.052110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-08e52d35-aa21-4729-84e9-4471355db2ea req-2f04e15c-48fb-414a-a9a4-8e6efc9d56d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:50.063613 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-08e52d35-aa21-4729-84e9-4471355db2ea req-2f04e15c-48fb-414a-a9a4-8e6efc9d56d9 service nova] Creating event network-changed:baf844cf-250b-42ea-b385-80d607da7e79 for instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a on nch2-master-1 Feb 19 20:54:50.069232 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-08e52d35-aa21-4729-84e9-4471355db2ea req-2f04e15c-48fb-414a-a9a4-8e6efc9d56d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029741 Feb 19 20:54:50.069886 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 502/1063] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:50.071308 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3b24e54f-82ee-41e3-a5f1-77622a9cfb21 tempest-ListImagesTestJSON-1928948878 tempest-ListImagesTestJSON-1928948878-project] 10.222.0.30 "GET /compute/v2.1/images/f75529b9-2911-475e-b974-4af06053c17c" status: 200 len: 784 microversion: 2.1 time: 0.093784 Feb 19 20:54:50.071947 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 562/1064] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:54:49 2022] GET /compute/v2.1/images/f75529b9-2911-475e-b974-4af06053c17c => generated 784 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:50.075050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-da6ab737-6de1-4c63-8940-0bce4eced724 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:50.075750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-da6ab737-6de1-4c63-8940-0bce4eced724 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:50.076310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.243"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:50.078075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:50.083218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6ab737-6de1-4c63-8940-0bce4eced724 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:50.083677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6ab737-6de1-4c63-8940-0bce4eced724 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:50.084511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6ab737-6de1-4c63-8940-0bce4eced724 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:50.084952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6ab737-6de1-4c63-8940-0bce4eced724 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:50.085802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:50.086261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:50.087061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:50.087675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:50.115050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Acquired lock "refresh_cache-258092fb-1cd7-47c9-88f4-d92fafb344ef" {{(pid=136094) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:54:50.186563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da6ab737-6de1-4c63-8940-0bce4eced724 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:50.194427 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-da6ab737-6de1-4c63-8940-0bce4eced724 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1272 microversion: 2.1 time: 0.123374 Feb 19 20:54:50.195019 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 503/1065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:50 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:50.199416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f50ee2af-d816-411d-bd92-50732411ca2b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:50.200028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f50ee2af-d816-411d-bd92-50732411ca2b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:50.206024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f50ee2af-d816-411d-bd92-50732411ca2b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:50.207454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f50ee2af-d816-411d-bd92-50732411ca2b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:50.208247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f50ee2af-d816-411d-bd92-50732411ca2b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:50.208734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f50ee2af-d816-411d-bd92-50732411ca2b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:50.804166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f50ee2af-d816-411d-bd92-50732411ca2b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:50.811726 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f50ee2af-d816-411d-bd92-50732411ca2b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1316 microversion: 2.1 time: 0.615750 Feb 19 20:54:50.812316 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 504/1066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:50 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:50.817219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-55c4a523-ba44-43f9-8033-72afe6547f9f req-ef59875e-f355-4ae1-953e-4e19b0ac2949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ef2a35-0d6a-42b8-8275-c514b5724837", "name": "network-vif-plugged", "status": "completed", "tag": "ab2d1d8e-e972-4f4b-8626-d98c3b875877"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:50.818821 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:50.818821 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:54:50.825857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-55c4a523-ba44-43f9-8033-72afe6547f9f req-ef59875e-f355-4ae1-953e-4e19b0ac2949 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:50.826334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-55c4a523-ba44-43f9-8033-72afe6547f9f req-ef59875e-f355-4ae1-953e-4e19b0ac2949 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:50.837715 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-55c4a523-ba44-43f9-8033-72afe6547f9f req-ef59875e-f355-4ae1-953e-4e19b0ac2949 service nova] Creating event network-vif-plugged:ab2d1d8e-e972-4f4b-8626-d98c3b875877 for instance 61ef2a35-0d6a-42b8-8275-c514b5724837 on nch1-master-1 Feb 19 20:54:50.842556 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-55c4a523-ba44-43f9-8033-72afe6547f9f req-ef59875e-f355-4ae1-953e-4e19b0ac2949 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029077 Feb 19 20:54:50.843191 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 505/1067] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:50.848301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0b654246-819f-4d70-8d0e-20b8701d91c8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Action: 'create', calling method: .version_select at 0x7f6467dbea60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1746209504", "policies": ["affinity"]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:50.864802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-0b654246-819f-4d70-8d0e-20b8701d91c8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:50.869016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-0b654246-819f-4d70-8d0e-20b8701d91c8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:50.923987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-0b654246-819f-4d70-8d0e-20b8701d91c8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:50.928244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-0b654246-819f-4d70-8d0e-20b8701d91c8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:50.940677 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0b654246-819f-4d70-8d0e-20b8701d91c8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.096296 Feb 19 20:54:50.950667 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 506/1068] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Feb 19 20:54:50 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:50.950667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b71862e3-3cdc-4d8c-8eae-b68b495b0e31 tempest-ListImagesTestJSON-1928948878 tempest-ListImagesTestJSON-1928948878-project] Calling method '.version_select at 0x7f6467d30040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:51.022997 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b71862e3-3cdc-4d8c-8eae-b68b495b0e31 tempest-ListImagesTestJSON-1928948878 tempest-ListImagesTestJSON-1928948878-project] 10.222.0.30 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.080651 Feb 19 20:54:51.023825 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 507/1069] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 20:54:50 2022] GET /compute/v2.1/images => generated 445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:51.028416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-63998f8c-656a-4b0b-b904-0280757acf05 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:51.029365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-63998f8c-656a-4b0b-b904-0280757acf05 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:51.036577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63998f8c-656a-4b0b-b904-0280757acf05 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:51.037293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63998f8c-656a-4b0b-b904-0280757acf05 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:51.038316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63998f8c-656a-4b0b-b904-0280757acf05 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:51.038836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63998f8c-656a-4b0b-b904-0280757acf05 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:51.060214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG neutronclient.v2_0.client [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.2.243 (2a27d305-fde6-41be-9265-3ecf57696302) with port 3c2d56ee-dcf8-4145-a7ce-83aa6441cb22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 46539bba-6cad-4c87-80c0-0d2c8447156a.", "detail": ""}} {{(pid=136094) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:54:51.060908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Releasing lock "refresh_cache-258092fb-1cd7-47c9-88f4-d92fafb344ef" {{(pid=136094) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:54:51.061512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] HTTP exception thrown: Cannot associate floating IP 172.35.2.243 (2a27d305-fde6-41be-9265-3ecf57696302) with port 3c2d56ee-dcf8-4145-a7ce-83aa6441cb22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 46539bba-6cad-4c87-80c0-0d2c8447156a. Feb 19 20:54:51.061512 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-ca407426-bf53-4292-9a63-475276874199'] Feb 19 20:54:51.062153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Returning 400 to user: Cannot associate floating IP 172.35.2.243 (2a27d305-fde6-41be-9265-3ecf57696302) with port 3c2d56ee-dcf8-4145-a7ce-83aa6441cb22 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 46539bba-6cad-4c87-80c0-0d2c8447156a. Feb 19 20:54:51.062153 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-ca407426-bf53-4292-9a63-475276874199'] {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:54:51.063150 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b108217a-ad2a-45b6-bf20-27c31fb6b60b tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action" status: 400 len: 381 microversion: 2.1 time: 0.990232 Feb 19 20:54:51.064199 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 563/1070] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:54:50 2022] POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action => generated 381 bytes in 991 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:54:51.070819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d9ec14b-cd57-482c-b167-36f87cdfb8ae tempest-ListImagesTestJSON-1928948878 tempest-ListImagesTestJSON-1928948878-project] Calling method '.version_select at 0x7f6467b4df70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:51.118905 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d9ec14b-cd57-482c-b167-36f87cdfb8ae tempest-ListImagesTestJSON-1928948878 tempest-ListImagesTestJSON-1928948878-project] 10.222.0.30 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.053446 Feb 19 20:54:51.119777 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 564/1071] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:54:51 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:51.132384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1026347749", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "866ffc53-6983-48e3-9b13-752164543709"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:51.201201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:54:51.501343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-63998f8c-656a-4b0b-b904-0280757acf05 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:51.518723 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-63998f8c-656a-4b0b-b904-0280757acf05 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.493040 Feb 19 20:54:51.520480 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 508/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:51 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:51.534260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:51.535450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:51.541991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:51.542689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:51.543646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:51.544246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:51.800921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:54:51.801567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:54:51.802243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:54:51.802716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:54:51.803119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:54:51.834341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:51.835028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:51.836370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:51.837581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:51.865288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:51.871250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:51.884779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Going to run 2 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:54:51.885377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:51.888099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:54:51.895383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:51.897297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:51.898830 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3bbb5d32-e725-4cf6-8713-39a5c1e49d4c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.368478 Feb 19 20:54:51.901297 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 509/1073] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:51 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:51.906147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aed99f2c-635b-41e8-9851-2bb09e48e964 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '.version_select at 0x7f6467c8ab80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:51.936104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=136094) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Feb 19 20:54:51.960605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:51.964927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:52.024007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:52.029068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:52.048920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=688a015d-1d10-44c7-b358-4d2cbe080bc2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:54:52.124586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:52.129278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:52.185749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:52.191510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:52.232394 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0fedf19-1e5b-4e53-bbca-d6d88657008c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.111456 Feb 19 20:54:52.233682 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 565/1074] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:54:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 1113 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Feb 19 20:54:52.239992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2e4e704a-89f8-42c3-ac02-1552e2325a58 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:52.240917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2e4e704a-89f8-42c3-ac02-1552e2325a58 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:52.248550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e4e704a-89f8-42c3-ac02-1552e2325a58 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:52.249388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e4e704a-89f8-42c3-ac02-1552e2325a58 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:52.250663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e4e704a-89f8-42c3-ac02-1552e2325a58 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:52.251322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e4e704a-89f8-42c3-ac02-1552e2325a58 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:52.530694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2e4e704a-89f8-42c3-ac02-1552e2325a58 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:52.551327 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2e4e704a-89f8-42c3-ac02-1552e2325a58 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1278 microversion: 2.1 time: 0.314192 Feb 19 20:54:52.551951 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 566/1075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:52 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1278 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:52.561012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-16a7e4ac-5025-4079-84ee-1941bd582c96 req-ae241d63-a696-48d7-87ff-d9875cf7a32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016b6ece-713e-4a2d-ba16-6de26f2479cb", "name": "network-vif-unplugged", "status": "completed", "tag": "8a66314a-6be0-4ed3-85c0-e29d46b221c9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:52.566901 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:52.566901 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:52.578398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-16a7e4ac-5025-4079-84ee-1941bd582c96 req-ae241d63-a696-48d7-87ff-d9875cf7a32d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:52.579021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-16a7e4ac-5025-4079-84ee-1941bd582c96 req-ae241d63-a696-48d7-87ff-d9875cf7a32d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:52.614527 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-16a7e4ac-5025-4079-84ee-1941bd582c96 req-ae241d63-a696-48d7-87ff-d9875cf7a32d service nova] Creating event network-vif-unplugged:8a66314a-6be0-4ed3-85c0-e29d46b221c9 for instance 016b6ece-713e-4a2d-ba16-6de26f2479cb on nch1-master-1 Feb 19 20:54:52.634932 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-16a7e4ac-5025-4079-84ee-1941bd582c96 req-ae241d63-a696-48d7-87ff-d9875cf7a32d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074602 Feb 19 20:54:52.636222 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 567/1076] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:52.646848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e8a835b6-f455-44d4-9e40-1a90d798655b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:52.648183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e8a835b6-f455-44d4-9e40-1a90d798655b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:52.657450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8a835b6-f455-44d4-9e40-1a90d798655b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:52.658454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8a835b6-f455-44d4-9e40-1a90d798655b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:52.660277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8a835b6-f455-44d4-9e40-1a90d798655b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:52.661139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8a835b6-f455-44d4-9e40-1a90d798655b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:53.118288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e8a835b6-f455-44d4-9e40-1a90d798655b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:53.133177 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e8a835b6-f455-44d4-9e40-1a90d798655b tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1506 microversion: 2.1 time: 0.494269 Feb 19 20:54:53.135786 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 568/1077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:52 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:53.145877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a440a4cb-0bdf-4fb5-aecd-e05a6ccb3a72 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:53.155405 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:53.155405 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:53.160484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a440a4cb-0bdf-4fb5-aecd-e05a6ccb3a72 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:53.161484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a440a4cb-0bdf-4fb5-aecd-e05a6ccb3a72 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Searching by: {'deleted': False, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:54:53.181960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a440a4cb-0bdf-4fb5-aecd-e05a6ccb3a72 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:53.185491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a440a4cb-0bdf-4fb5-aecd-e05a6ccb3a72 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:53.189260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a440a4cb-0bdf-4fb5-aecd-e05a6ccb3a72 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:53.190494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a440a4cb-0bdf-4fb5-aecd-e05a6ccb3a72 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:53.343800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-a440a4cb-0bdf-4fb5-aecd-e05a6ccb3a72 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Listed batch of 3 results from cell out of 999 limit. Returned 3 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:54:53.427102 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a440a4cb-0bdf-4fb5-aecd-e05a6ccb3a72 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.289633 Feb 19 20:54:53.428345 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 569/1078] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 20:54:53 2022] GET /compute/v2.1/servers => generated 1004 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:53.435370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c54b60b8-81f3-4d48-a956-d42794980fc0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:53.435995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c54b60b8-81f3-4d48-a956-d42794980fc0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:53.442919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c54b60b8-81f3-4d48-a956-d42794980fc0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:53.443377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c54b60b8-81f3-4d48-a956-d42794980fc0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:53.444183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c54b60b8-81f3-4d48-a956-d42794980fc0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:53.444654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c54b60b8-81f3-4d48-a956-d42794980fc0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:53.845742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c54b60b8-81f3-4d48-a956-d42794980fc0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:53.867417 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c54b60b8-81f3-4d48-a956-d42794980fc0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.437504 Feb 19 20:54:53.868067 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 570/1079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:53 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:53.873871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:53.874689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:53.885779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:53.886721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:53.887855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:53.888293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:54.022814 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aed99f2c-635b-41e8-9851-2bb09e48e964 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/2a27d305-fde6-41be-9265-3ecf57696302" status: 202 len: 0 microversion: 2.1 time: 2.119872 Feb 19 20:54:54.023552 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 510/1080] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:54:51 2022] DELETE /compute/v2.1/os-floating-ips/2a27d305-fde6-41be-9265-3ecf57696302 => generated 0 bytes in 2121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:54:54.043383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-596ffa9d-8bd9-4380-b57e-bdd2e239f24f tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:54.045240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-596ffa9d-8bd9-4380-b57e-bdd2e239f24f tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:54.058742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-596ffa9d-8bd9-4380-b57e-bdd2e239f24f tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:54.072144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-596ffa9d-8bd9-4380-b57e-bdd2e239f24f tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:54.073776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-596ffa9d-8bd9-4380-b57e-bdd2e239f24f tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:54.075033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-596ffa9d-8bd9-4380-b57e-bdd2e239f24f tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:54.195906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-596ffa9d-8bd9-4380-b57e-bdd2e239f24f tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:54.197416 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-596ffa9d-8bd9-4380-b57e-bdd2e239f24f tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837/os-instance-actions/req-f2001462-5f5a-4b9d-a86a-478ec1268770" status: 200 len: 313 microversion: 2.1 time: 0.166982 Feb 19 20:54:54.198258 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 511/1081] 10.222.0.30 () {58 vars in 1418 bytes} [Sat Feb 19 20:54:54 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837/os-instance-actions/req-f2001462-5f5a-4b9d-a86a-478ec1268770 => generated 313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:54.205200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2a1b5c36-f0f8-4bcc-a0a0-8c7bc4abf5a7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:54.206053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2a1b5c36-f0f8-4bcc-a0a0-8c7bc4abf5a7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:54.217778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a1b5c36-f0f8-4bcc-a0a0-8c7bc4abf5a7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:54.219522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a1b5c36-f0f8-4bcc-a0a0-8c7bc4abf5a7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:54.221731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a1b5c36-f0f8-4bcc-a0a0-8c7bc4abf5a7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:54.223466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a1b5c36-f0f8-4bcc-a0a0-8c7bc4abf5a7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:54.354269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:54.377996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:54.380301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:54.381569 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c37389a-4186-4176-8dfc-57f857356764 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.512299 Feb 19 20:54:54.395713 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 571/1082] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:53 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:54.401533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bfcaed3d-879a-409d-8093-32d244b43cf7 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:54.402142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bfcaed3d-879a-409d-8093-32d244b43cf7 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:54.424605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bfcaed3d-879a-409d-8093-32d244b43cf7 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:54.425134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bfcaed3d-879a-409d-8093-32d244b43cf7 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:54.425929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bfcaed3d-879a-409d-8093-32d244b43cf7 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:54.426364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bfcaed3d-879a-409d-8093-32d244b43cf7 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:54.437614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2a1b5c36-f0f8-4bcc-a0a0-8c7bc4abf5a7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:54.451155 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2a1b5c36-f0f8-4bcc-a0a0-8c7bc4abf5a7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1271 microversion: 2.1 time: 0.251383 Feb 19 20:54:54.462214 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 512/1083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:54 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:54.467253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.212"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:54.877449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:54.884318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:54.884995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:54.885941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:54.886382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:55.013188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bfcaed3d-879a-409d-8093-32d244b43cf7 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:55.022954 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bfcaed3d-879a-409d-8093-32d244b43cf7 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1320 microversion: 2.1 time: 0.625199 Feb 19 20:54:55.025039 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 572/1084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:54 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1320 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:55.036923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eac117db-6dd0-493b-b120-502742425a48 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:55.040441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eac117db-6dd0-493b-b120-502742425a48 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:55.057659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eac117db-6dd0-493b-b120-502742425a48 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:55.064504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eac117db-6dd0-493b-b120-502742425a48 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:55.067503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eac117db-6dd0-493b-b120-502742425a48 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:55.068284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eac117db-6dd0-493b-b120-502742425a48 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:55.243162 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eac117db-6dd0-493b-b120-502742425a48 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "POST /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837/action" status: 202 len: 0 microversion: 2.1 time: 0.211196 Feb 19 20:54:55.245142 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 573/1085] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:54:55 2022] POST /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:54:55.254064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-780f27b8-892e-4f71-ace2-323e5a76d5b6 req-9801f08e-5ad4-4041-b278-c07efdcacaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016b6ece-713e-4a2d-ba16-6de26f2479cb", "tag": "8a66314a-6be0-4ed3-85c0-e29d46b221c9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:55.257111 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:55.257111 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:55.270728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-780f27b8-892e-4f71-ace2-323e5a76d5b6 req-9801f08e-5ad4-4041-b278-c07efdcacaa2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:55.271544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-780f27b8-892e-4f71-ace2-323e5a76d5b6 req-9801f08e-5ad4-4041-b278-c07efdcacaa2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:55.291915 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-780f27b8-892e-4f71-ace2-323e5a76d5b6 req-9801f08e-5ad4-4041-b278-c07efdcacaa2 service nova] Creating event network-changed:8a66314a-6be0-4ed3-85c0-e29d46b221c9 for instance 016b6ece-713e-4a2d-ba16-6de26f2479cb on nch1-master-1 Feb 19 20:54:55.333575 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-780f27b8-892e-4f71-ace2-323e5a76d5b6 req-9801f08e-5ad4-4041-b278-c07efdcacaa2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071938 Feb 19 20:54:55.336582 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 574/1086] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:55.358070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5ff6fedb-86f0-47e2-b2b0-453536ce3227 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:55.359128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5ff6fedb-86f0-47e2-b2b0-453536ce3227 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:55.369796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ff6fedb-86f0-47e2-b2b0-453536ce3227 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:55.371141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ff6fedb-86f0-47e2-b2b0-453536ce3227 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:55.372840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ff6fedb-86f0-47e2-b2b0-453536ce3227 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:55.373278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ff6fedb-86f0-47e2-b2b0-453536ce3227 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:55.555696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Acquired lock "refresh_cache-258092fb-1cd7-47c9-88f4-d92fafb344ef" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:54:56.327754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5ff6fedb-86f0-47e2-b2b0-453536ce3227 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:56.337063 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5ff6fedb-86f0-47e2-b2b0-453536ce3227 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.997104 Feb 19 20:54:56.338077 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 575/1087] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:55 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:56.477739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2113838122", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "351c1efd-5280-463c-84c7-ead44efacdc6"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:56.537217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] validate_networks() for [('351c1efd-5280-463c-84c7-ead44efacdc6', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:54:57.878635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:54:57.879320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:54:57.879638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:54:57.880056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:54:57.880744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:54:57.895202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:57.895720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:57.900170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:57.900789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:57.924655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Getting quotas for project 808305a45737485185adcb60012ea91a. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:54:57.930739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Getting quotas for user ccc221761620472ea3cd887988f9f2c0 and project 808305a45737485185adcb60012ea91a. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:54:57.953254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:54:57.955930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:54:58.010343 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6b861e87-3f94-47e0-8dd7-da4a243bf5bc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661494 Feb 19 20:54:58.011225 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 576/1088] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:54:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:54:58.015552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-aa59ece7-cdfd-43ba-95f5-0951619a1b2a req-f348dae8-adf5-4d29-a320-05d3d790e329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5997373e-abc0-4f20-9feb-047df1ddcbf5", "tag": "e7a4ce4e-94ea-436b-bae9-e67c3bf0fc90"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:54:58.017463 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:54:58.017463 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:54:58.025779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-aa59ece7-cdfd-43ba-95f5-0951619a1b2a req-f348dae8-adf5-4d29-a320-05d3d790e329 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:58.026230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-aa59ece7-cdfd-43ba-95f5-0951619a1b2a req-f348dae8-adf5-4d29-a320-05d3d790e329 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:58.053699 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-aa59ece7-cdfd-43ba-95f5-0951619a1b2a req-f348dae8-adf5-4d29-a320-05d3d790e329 service nova] Creating event network-changed:e7a4ce4e-94ea-436b-bae9-e67c3bf0fc90 for instance 5997373e-abc0-4f20-9feb-047df1ddcbf5 on nch1-master-1 Feb 19 20:54:58.060512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-aa59ece7-cdfd-43ba-95f5-0951619a1b2a req-f348dae8-adf5-4d29-a320-05d3d790e329 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047189 Feb 19 20:54:58.061806 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 577/1089] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:54:58.069688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-10552022-8300-4d9a-8db7-864b3e7d2c24 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:58.070619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-10552022-8300-4d9a-8db7-864b3e7d2c24 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:58.077929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-10552022-8300-4d9a-8db7-864b3e7d2c24 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:58.078650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-10552022-8300-4d9a-8db7-864b3e7d2c24 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:58.079649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-10552022-8300-4d9a-8db7-864b3e7d2c24 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:58.080270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-10552022-8300-4d9a-8db7-864b3e7d2c24 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:58.492920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Building network info cache for instance {{(pid=136095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 20:54:58.668444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-10552022-8300-4d9a-8db7-864b3e7d2c24 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:58.681524 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-10552022-8300-4d9a-8db7-864b3e7d2c24 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1513 microversion: 2.1 time: 0.618338 Feb 19 20:54:58.684521 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 578/1090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:58 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1513 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:54:58.692058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:58.693439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:58.707678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:58.708740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:58.709881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:58.710486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:59.338639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:59.350981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:59.359405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:54:59.361361 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9c7b4d5d-af8f-4b8e-a0e0-69a5c2377da2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.675093 Feb 19 20:54:59.372656 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 579/1091] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:54:58 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:54:59.379289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0f53db4c-7b8e-4b2b-93b8-626460403b2f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:54:59.380040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0f53db4c-7b8e-4b2b-93b8-626460403b2f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:54:59.391667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f53db4c-7b8e-4b2b-93b8-626460403b2f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:59.392682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f53db4c-7b8e-4b2b-93b8-626460403b2f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:54:59.394795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f53db4c-7b8e-4b2b-93b8-626460403b2f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:54:59.396218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f53db4c-7b8e-4b2b-93b8-626460403b2f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:00.075503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0f53db4c-7b8e-4b2b-93b8-626460403b2f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:00.084563 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0f53db4c-7b8e-4b2b-93b8-626460403b2f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.720286 Feb 19 20:55:00.084810 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 580/1092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:54:59 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:00.089104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-438fcff7-2cd7-46fd-9cad-18486043e51e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:00.089701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-438fcff7-2cd7-46fd-9cad-18486043e51e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:00.095404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-438fcff7-2cd7-46fd-9cad-18486043e51e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:00.095932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-438fcff7-2cd7-46fd-9cad-18486043e51e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:00.097214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-438fcff7-2cd7-46fd-9cad-18486043e51e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:00.097785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-438fcff7-2cd7-46fd-9cad-18486043e51e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:00.405394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Updating instance_info_cache with network_info: [{"id": "3c2d56ee-dcf8-4145-a7ce-83aa6441cb22", "address": "fa:16:3e:80:b8:96", "network": {"id": "e1715c46-c90a-49c7-8aa3-a86a06453327", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-70565224-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8a274e94e3e643c4b814892e2429db0e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3c2d56ee-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 20:55:00.416889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Releasing lock "refresh_cache-258092fb-1cd7-47c9-88f4-d92fafb344ef" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:55:00.417727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-10fa5a96-de65-48d5-9da0-216d43e27389 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action" status: 202 len: 0 microversion: 2.1 time: 5.954274 Feb 19 20:55:00.418339 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 513/1093] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:54:54 2022] POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action => generated 0 bytes in 5955 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 20:55:00.422976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8699d8d2-e4b0-4be0-b312-d8061037b14a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:00.423603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8699d8d2-e4b0-4be0-b312-d8061037b14a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:00.430941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8699d8d2-e4b0-4be0-b312-d8061037b14a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:00.431390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8699d8d2-e4b0-4be0-b312-d8061037b14a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:00.432203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8699d8d2-e4b0-4be0-b312-d8061037b14a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:00.432692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8699d8d2-e4b0-4be0-b312-d8061037b14a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:00.592345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-438fcff7-2cd7-46fd-9cad-18486043e51e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:00.603326 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-438fcff7-2cd7-46fd-9cad-18486043e51e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1320 microversion: 2.1 time: 0.517446 Feb 19 20:55:00.604852 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 581/1094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:00 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1320 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:00.609736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c2bd35af-938c-467e-91cc-f97de6ad00e9 req-291a205f-4341-4cb1-abaa-dee1c0a3182b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1eb520e-c397-4539-b786-0e315ff274b7", "tag": "d61fad0a-c589-4682-9531-d1e1afc31551"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:00.611541 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:00.611541 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:00.619476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c2bd35af-938c-467e-91cc-f97de6ad00e9 req-291a205f-4341-4cb1-abaa-dee1c0a3182b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:00.620169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c2bd35af-938c-467e-91cc-f97de6ad00e9 req-291a205f-4341-4cb1-abaa-dee1c0a3182b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:00.632571 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c2bd35af-938c-467e-91cc-f97de6ad00e9 req-291a205f-4341-4cb1-abaa-dee1c0a3182b service nova] Creating event network-changed:d61fad0a-c589-4682-9531-d1e1afc31551 for instance f1eb520e-c397-4539-b786-0e315ff274b7 on nch2-master-1 Feb 19 20:55:00.637444 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c2bd35af-938c-467e-91cc-f97de6ad00e9 req-291a205f-4341-4cb1-abaa-dee1c0a3182b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031207 Feb 19 20:55:00.638129 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 582/1095] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:00.643399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27b7211f-4312-49aa-b2b5-81d70638fed3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:00.644229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-27b7211f-4312-49aa-b2b5-81d70638fed3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:00.650435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27b7211f-4312-49aa-b2b5-81d70638fed3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:00.650958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27b7211f-4312-49aa-b2b5-81d70638fed3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:00.651816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27b7211f-4312-49aa-b2b5-81d70638fed3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:00.652320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27b7211f-4312-49aa-b2b5-81d70638fed3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:01.105344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-27b7211f-4312-49aa-b2b5-81d70638fed3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:01.118363 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-27b7211f-4312-49aa-b2b5-81d70638fed3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1276 microversion: 2.1 time: 0.478780 Feb 19 20:55:01.119683 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 583/1096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:00 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1276 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:01.133592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b2fbf83c-857d-4934-bdf5-c1272c749c4b req-10082612-4bd7-4469-aba6-bdad82f9b499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a", "name": "network-vif-plugged", "status": "completed", "tag": "baf844cf-250b-42ea-b385-80d607da7e79"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:01.135713 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:01.135713 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:01.147075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b2fbf83c-857d-4934-bdf5-c1272c749c4b req-10082612-4bd7-4469-aba6-bdad82f9b499 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:01.147632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b2fbf83c-857d-4934-bdf5-c1272c749c4b req-10082612-4bd7-4469-aba6-bdad82f9b499 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:01.167537 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b2fbf83c-857d-4934-bdf5-c1272c749c4b req-10082612-4bd7-4469-aba6-bdad82f9b499 service nova] Creating event network-vif-plugged:baf844cf-250b-42ea-b385-80d607da7e79 for instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a on nch2-master-1 Feb 19 20:55:01.181192 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b2fbf83c-857d-4934-bdf5-c1272c749c4b req-10082612-4bd7-4469-aba6-bdad82f9b499 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057122 Feb 19 20:55:01.182656 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 584/1097] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:01.202950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5d6bd86b-e0f0-4d48-a5a9-506afe06e681 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:01.204107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5d6bd86b-e0f0-4d48-a5a9-506afe06e681 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:01.215305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d6bd86b-e0f0-4d48-a5a9-506afe06e681 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:01.217599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d6bd86b-e0f0-4d48-a5a9-506afe06e681 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:01.219729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d6bd86b-e0f0-4d48-a5a9-506afe06e681 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:01.224213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d6bd86b-e0f0-4d48-a5a9-506afe06e681 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:01.226925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8699d8d2-e4b0-4be0-b312-d8061037b14a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:01.271998 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8699d8d2-e4b0-4be0-b312-d8061037b14a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.844787 Feb 19 20:55:01.273127 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 514/1098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:00 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:01.279128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-39b3dc6e-bdaf-42a5-8a31-a9a74860b592 req-3743b79d-0510-48a7-8200-0e38f86ee30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258092fb-1cd7-47c9-88f4-d92fafb344ef", "tag": "3c2d56ee-dcf8-4145-a7ce-83aa6441cb22"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:01.281677 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:01.281677 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:01.303045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-39b3dc6e-bdaf-42a5-8a31-a9a74860b592 req-3743b79d-0510-48a7-8200-0e38f86ee30e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:01.304062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-39b3dc6e-bdaf-42a5-8a31-a9a74860b592 req-3743b79d-0510-48a7-8200-0e38f86ee30e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:01.339508 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-39b3dc6e-bdaf-42a5-8a31-a9a74860b592 req-3743b79d-0510-48a7-8200-0e38f86ee30e service nova] Creating event network-changed:3c2d56ee-dcf8-4145-a7ce-83aa6441cb22 for instance 258092fb-1cd7-47c9-88f4-d92fafb344ef on nch2-master-1 Feb 19 20:55:01.347204 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-39b3dc6e-bdaf-42a5-8a31-a9a74860b592 req-3743b79d-0510-48a7-8200-0e38f86ee30e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072149 Feb 19 20:55:01.348671 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 515/1099] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:01.357591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:01.358580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:01.368668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:01.369081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:01.369910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:01.370373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:02.042361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:02.054092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:02.058139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:02.059304 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-76516cd0-d259-44fc-a3f4-73dce155883e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.708760 Feb 19 20:55:02.059885 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 516/1100] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:01 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:02.082891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-90553d23-7828-429a-b6f3-27278a7f97df tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '.version_select at 0x7f6467cbaf70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:02.138969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5d6bd86b-e0f0-4d48-a5a9-506afe06e681 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:02.150849 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5d6bd86b-e0f0-4d48-a5a9-506afe06e681 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1506 microversion: 2.1 time: 0.958588 Feb 19 20:55:02.152301 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 585/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:01 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1506 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:02.157262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3cdb8bc9-cd46-448d-bd6b-a51f93ebe7fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:02.158089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3cdb8bc9-cd46-448d-bd6b-a51f93ebe7fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:02.171561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3cdb8bc9-cd46-448d-bd6b-a51f93ebe7fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:02.172156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3cdb8bc9-cd46-448d-bd6b-a51f93ebe7fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:02.173369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3cdb8bc9-cd46-448d-bd6b-a51f93ebe7fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:02.174137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3cdb8bc9-cd46-448d-bd6b-a51f93ebe7fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:02.881344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3cdb8bc9-cd46-448d-bd6b-a51f93ebe7fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:02.889794 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3cdb8bc9-cd46-448d-bd6b-a51f93ebe7fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.736226 Feb 19 20:55:02.890380 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 586/1102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:02 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:02.901842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-268fc1c9-ecb6-410b-a5b9-f46aa522b15b tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:02.901842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-268fc1c9-ecb6-410b-a5b9-f46aa522b15b tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:02.902217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-268fc1c9-ecb6-410b-a5b9-f46aa522b15b tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:02.902712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-268fc1c9-ecb6-410b-a5b9-f46aa522b15b tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:02.903606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-268fc1c9-ecb6-410b-a5b9-f46aa522b15b tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:02.904090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-268fc1c9-ecb6-410b-a5b9-f46aa522b15b tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:03.438525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-268fc1c9-ecb6-410b-a5b9-f46aa522b15b tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:03.446753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-268fc1c9-ecb6-410b-a5b9-f46aa522b15b tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1320 microversion: 2.1 time: 0.555328 Feb 19 20:55:03.458024 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 587/1103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:02 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1320 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:03.462758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a87e84f5-b5ea-452a-bb8a-98937a07520a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:03.463637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a87e84f5-b5ea-452a-bb8a-98937a07520a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:03.470431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a87e84f5-b5ea-452a-bb8a-98937a07520a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:03.471110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a87e84f5-b5ea-452a-bb8a-98937a07520a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:03.472771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a87e84f5-b5ea-452a-bb8a-98937a07520a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:03.473201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a87e84f5-b5ea-452a-bb8a-98937a07520a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:03.867919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a87e84f5-b5ea-452a-bb8a-98937a07520a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:03.877282 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a87e84f5-b5ea-452a-bb8a-98937a07520a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1318 microversion: 2.1 time: 0.417986 Feb 19 20:55:03.890279 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 588/1104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:03 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:03.890279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6a0686db-bc49-458d-a628-1a4290c33d93 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '.version_select at 0x7f6467bfeca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:03.890279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6a0686db-bc49-458d-a628-1a4290c33d93 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:03.900033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a0686db-bc49-458d-a628-1a4290c33d93 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:03.900745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a0686db-bc49-458d-a628-1a4290c33d93 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:03.901351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a0686db-bc49-458d-a628-1a4290c33d93 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:03.901791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a0686db-bc49-458d-a628-1a4290c33d93 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:03.939630 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6a0686db-bc49-458d-a628-1a4290c33d93 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.058867 Feb 19 20:55:03.940143 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 589/1105] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Feb 19 20:55:03 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837/os-instance-actions => generated 611 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:03.945440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-11b222f8-5c49-4c0b-8473-5f85b14c8324 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:03.946050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-11b222f8-5c49-4c0b-8473-5f85b14c8324 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:03.952586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11b222f8-5c49-4c0b-8473-5f85b14c8324 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:03.953038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11b222f8-5c49-4c0b-8473-5f85b14c8324 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:03.953836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11b222f8-5c49-4c0b-8473-5f85b14c8324 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:03.954279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11b222f8-5c49-4c0b-8473-5f85b14c8324 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:04.514755 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-90553d23-7828-429a-b6f3-27278a7f97df tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/8b1586c0-4d04-4647-8cfd-d5387340d837" status: 202 len: 0 microversion: 2.1 time: 2.453606 Feb 19 20:55:04.517122 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 517/1106] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:55:02 2022] DELETE /compute/v2.1/os-floating-ips/8b1586c0-4d04-4647-8cfd-d5387340d837 => generated 0 bytes in 2456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:55:04.525398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:04.527617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:04.530415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11b222f8-5c49-4c0b-8473-5f85b14c8324 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:04.540751 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-11b222f8-5c49-4c0b-8473-5f85b14c8324 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.598570 Feb 19 20:55:04.541301 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 590/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:03 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:04.545856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d8db665e-ad94-46c2-a4c7-d5f1cf94f74b req-3d313830-6379-42bf-a52d-5a732820ca14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688a015d-1d10-44c7-b358-4d2cbe080bc2", "tag": "77f19c96-0ed8-4178-b8cb-e6bc2c9ea499"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:04.547484 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:04.547484 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:04.552674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:04.553145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:04.553990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:04.554458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:04.554568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d8db665e-ad94-46c2-a4c7-d5f1cf94f74b req-3d313830-6379-42bf-a52d-5a732820ca14 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:04.554984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d8db665e-ad94-46c2-a4c7-d5f1cf94f74b req-3d313830-6379-42bf-a52d-5a732820ca14 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:04.568985 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d8db665e-ad94-46c2-a4c7-d5f1cf94f74b req-3d313830-6379-42bf-a52d-5a732820ca14 service nova] Creating event network-changed:77f19c96-0ed8-4178-b8cb-e6bc2c9ea499 for instance 688a015d-1d10-44c7-b358-4d2cbe080bc2 on nch2-master-1 Feb 19 20:55:04.574814 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d8db665e-ad94-46c2-a4c7-d5f1cf94f74b req-3d313830-6379-42bf-a52d-5a732820ca14 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031974 Feb 19 20:55:04.575939 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 591/1108] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:04.582075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-fefd1ecc-000e-42d7-923a-0842fa78b085 req-18b1f1af-05b7-4dfb-9c62-46331b2ad3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5997373e-abc0-4f20-9feb-047df1ddcbf5", "name": "network-vif-plugged", "status": "completed", "tag": "e7a4ce4e-94ea-436b-bae9-e67c3bf0fc90"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:04.584083 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:04.584083 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:04.593109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fefd1ecc-000e-42d7-923a-0842fa78b085 req-18b1f1af-05b7-4dfb-9c62-46331b2ad3a3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:04.594027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fefd1ecc-000e-42d7-923a-0842fa78b085 req-18b1f1af-05b7-4dfb-9c62-46331b2ad3a3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:04.607894 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-fefd1ecc-000e-42d7-923a-0842fa78b085 req-18b1f1af-05b7-4dfb-9c62-46331b2ad3a3 service nova] Creating event network-vif-plugged:e7a4ce4e-94ea-436b-bae9-e67c3bf0fc90 for instance 5997373e-abc0-4f20-9feb-047df1ddcbf5 on nch1-master-1 Feb 19 20:55:04.613187 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-fefd1ecc-000e-42d7-923a-0842fa78b085 req-18b1f1af-05b7-4dfb-9c62-46331b2ad3a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035481 Feb 19 20:55:04.613793 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 592/1109] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:04.619015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-082a23f1-a7f5-470c-9d42-35b4dcc9e87c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:04.619749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-082a23f1-a7f5-470c-9d42-35b4dcc9e87c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:04.626183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-082a23f1-a7f5-470c-9d42-35b4dcc9e87c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:04.626675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-082a23f1-a7f5-470c-9d42-35b4dcc9e87c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:04.627730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-082a23f1-a7f5-470c-9d42-35b4dcc9e87c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:04.628440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-082a23f1-a7f5-470c-9d42-35b4dcc9e87c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.091238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:05.100762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:05.102610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:05.103803 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fad3214a-0494-4d32-b555-386bfebd32c8 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.585322 Feb 19 20:55:05.104729 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 518/1110] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:04 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:05.109907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f5b76d06-5456-42e0-8db9-a2c1ab459744 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:05.110618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f5b76d06-5456-42e0-8db9-a2c1ab459744 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:05.118003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5b76d06-5456-42e0-8db9-a2c1ab459744 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.118656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5b76d06-5456-42e0-8db9-a2c1ab459744 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.119884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5b76d06-5456-42e0-8db9-a2c1ab459744 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.120407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5b76d06-5456-42e0-8db9-a2c1ab459744 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.129335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-082a23f1-a7f5-470c-9d42-35b4dcc9e87c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:05.138318 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-082a23f1-a7f5-470c-9d42-35b4dcc9e87c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.523186 Feb 19 20:55:05.138924 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 593/1111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:04 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:05.144281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1635c9e2-3c1c-4a28-8696-e02bce023997 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:05.144973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1635c9e2-3c1c-4a28-8696-e02bce023997 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:05.151859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1635c9e2-3c1c-4a28-8696-e02bce023997 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.152361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1635c9e2-3c1c-4a28-8696-e02bce023997 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.153569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1635c9e2-3c1c-4a28-8696-e02bce023997 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.154279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1635c9e2-3c1c-4a28-8696-e02bce023997 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.162067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f5b76d06-5456-42e0-8db9-a2c1ab459744 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:55:05.247835 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f5b76d06-5456-42e0-8db9-a2c1ab459744 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "DELETE /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 204 len: 0 microversion: 2.1 time: 0.141769 Feb 19 20:55:05.248714 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 519/1112] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:55:05 2022] DELETE /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:55:05.254341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9541e09e-e9fb-4245-88a6-a95350042337 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:05.255655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9541e09e-e9fb-4245-88a6-a95350042337 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:05.256487 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9541e09e-e9fb-4245-88a6-a95350042337 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action" status: 400 len: 142 microversion: 2.1 time: 0.006390 Feb 19 20:55:05.257341 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 520/1113] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:55:05 2022] POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action => generated 142 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:55:05.263574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cf5c5891-8b02-4b43-abbe-da6ddd0ef800 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:05.264583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cf5c5891-8b02-4b43-abbe-da6ddd0ef800 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:05.274068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf5c5891-8b02-4b43-abbe-da6ddd0ef800 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.274523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf5c5891-8b02-4b43-abbe-da6ddd0ef800 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.275323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf5c5891-8b02-4b43-abbe-da6ddd0ef800 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.275796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf5c5891-8b02-4b43-abbe-da6ddd0ef800 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.316047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1635c9e2-3c1c-4a28-8696-e02bce023997 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:05.328437 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1635c9e2-3c1c-4a28-8696-e02bce023997 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1320 microversion: 2.1 time: 0.187538 Feb 19 20:55:05.329538 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 594/1114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:05 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:05.334708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a2e09fe-e48b-46c5-850a-c002a7a16362 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:05.335308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a2e09fe-e48b-46c5-850a-c002a7a16362 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:05.341888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a2e09fe-e48b-46c5-850a-c002a7a16362 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.342252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a2e09fe-e48b-46c5-850a-c002a7a16362 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.343041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a2e09fe-e48b-46c5-850a-c002a7a16362 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.343466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a2e09fe-e48b-46c5-850a-c002a7a16362 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.584709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf5c5891-8b02-4b43-abbe-da6ddd0ef800 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:05.589247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a2e09fe-e48b-46c5-850a-c002a7a16362 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:05.592835 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cf5c5891-8b02-4b43-abbe-da6ddd0ef800 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1318 microversion: 2.1 time: 0.334397 Feb 19 20:55:05.593367 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 521/1115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:05 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:05.598819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:05.599027 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a2e09fe-e48b-46c5-850a-c002a7a16362 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1512 microversion: 2.1 time: 0.268059 Feb 19 20:55:05.599738 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 595/1116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:05 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:05.599960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:05.604830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5a8aa28e-4667-489d-bf3a-b7839bff6ce1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:05.605459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5a8aa28e-4667-489d-bf3a-b7839bff6ce1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:05.613018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a8aa28e-4667-489d-bf3a-b7839bff6ce1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.613483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.613642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a8aa28e-4667-489d-bf3a-b7839bff6ce1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.614299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.614457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a8aa28e-4667-489d-bf3a-b7839bff6ce1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.614606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.614843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a8aa28e-4667-489d-bf3a-b7839bff6ce1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.615050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.647105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Acquired lock "refresh_cache-258092fb-1cd7-47c9-88f4-d92fafb344ef" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 20:55:05.826062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Releasing lock "refresh_cache-258092fb-1cd7-47c9-88f4-d92fafb344ef" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 20:55:05.826722 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] HTTP exception thrown: floating IP not found Feb 19 20:55:05.827351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Returning 404 to user: floating IP not found {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:05.828222 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4b04ec9c-fc9c-4c36-a358-e326c1c95aec tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action" status: 404 len: 67 microversion: 2.1 time: 0.233688 Feb 19 20:55:05.828925 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 522/1117] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:55:05 2022] POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action => generated 67 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:55:05.838771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1424add7-34b0-4ad5-af81-04e1bd6ccfdc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:05.892894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5a8aa28e-4667-489d-bf3a-b7839bff6ce1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:05.893052 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-1424add7-34b0-4ad5-af81-04e1bd6ccfdc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Feb 19 20:55:05.894263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1424add7-34b0-4ad5-af81-04e1bd6ccfdc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:05.895361 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1424add7-34b0-4ad5-af81-04e1bd6ccfdc tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action" status: 404 len: 88 microversion: 2.1 time: 0.060875 Feb 19 20:55:05.896113 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 523/1118] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:55:05 2022] POST /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef/action => generated 88 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 19 20:55:05.903255 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5a8aa28e-4667-489d-bf3a-b7839bff6ce1 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.301833 Feb 19 20:55:05.903935 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 596/1119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:05 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:05.905036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-767eee39-ba5e-4f11-9ade-1b4df5b62a3d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:05.905562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-767eee39-ba5e-4f11-9ade-1b4df5b62a3d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:05.913267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-767eee39-ba5e-4f11-9ade-1b4df5b62a3d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.913757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-767eee39-ba5e-4f11-9ade-1b4df5b62a3d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.914514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-767eee39-ba5e-4f11-9ade-1b4df5b62a3d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:05.914958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-767eee39-ba5e-4f11-9ade-1b4df5b62a3d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:05.942137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-767eee39-ba5e-4f11-9ade-1b4df5b62a3d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:55:06.028063 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-767eee39-ba5e-4f11-9ade-1b4df5b62a3d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "DELETE /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 204 len: 0 microversion: 2.1 time: 0.126296 Feb 19 20:55:06.028829 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 524/1120] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:55:05 2022] DELETE /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 20:55:06.037492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9d296c5b-7b9e-4eb5-91e9-0246048ee66d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:06.038162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9d296c5b-7b9e-4eb5-91e9-0246048ee66d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:06.044947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d296c5b-7b9e-4eb5-91e9-0246048ee66d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.045395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d296c5b-7b9e-4eb5-91e9-0246048ee66d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.046245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d296c5b-7b9e-4eb5-91e9-0246048ee66d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.046689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d296c5b-7b9e-4eb5-91e9-0246048ee66d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.125610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:06.126758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:06.136306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.136952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.138343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.138832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.240278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9d296c5b-7b9e-4eb5-91e9-0246048ee66d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:06.248894 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9d296c5b-7b9e-4eb5-91e9-0246048ee66d tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.215311 Feb 19 20:55:06.249631 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 597/1121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:06 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:55:06.267028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c0ed7f5-a0f4-4500-904c-9d946621610a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:06.267862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c0ed7f5-a0f4-4500-904c-9d946621610a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:06.275680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c0ed7f5-a0f4-4500-904c-9d946621610a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.276415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c0ed7f5-a0f4-4500-904c-9d946621610a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.277114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c0ed7f5-a0f4-4500-904c-9d946621610a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.277540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c0ed7f5-a0f4-4500-904c-9d946621610a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.318461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:06.328849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:06.334557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:06.335668 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae1d666b-bc6d-44bb-8686-705538b4659d tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.215678 Feb 19 20:55:06.336581 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 525/1122] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:06 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:06.346441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a90207a9-b738-4552-be1d-aee789fc46d4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:06.347081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a90207a9-b738-4552-be1d-aee789fc46d4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:06.355189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a90207a9-b738-4552-be1d-aee789fc46d4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.355668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a90207a9-b738-4552-be1d-aee789fc46d4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.356558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a90207a9-b738-4552-be1d-aee789fc46d4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.356957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a90207a9-b738-4552-be1d-aee789fc46d4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.480530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8c0ed7f5-a0f4-4500-904c-9d946621610a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:06.489535 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c0ed7f5-a0f4-4500-904c-9d946621610a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.226895 Feb 19 20:55:06.490289 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 598/1123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:06 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:06.541728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a90207a9-b738-4552-be1d-aee789fc46d4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:06.549729 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a90207a9-b738-4552-be1d-aee789fc46d4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1320 microversion: 2.1 time: 0.207010 Feb 19 20:55:06.550303 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 526/1124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:06 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:06.592420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-31e5b865-28bf-48d5-a95c-2547ee696e13 req-271ca677-16ba-48b4-b29f-38f70bda202a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1343027f-776d-4868-a38a-15e285438dd6", "tag": "f438d8af-a8db-44da-92fe-ef9f6ae35141"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:06.594777 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:06.594777 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:06.602771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-31e5b865-28bf-48d5-a95c-2547ee696e13 req-271ca677-16ba-48b4-b29f-38f70bda202a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.603222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-31e5b865-28bf-48d5-a95c-2547ee696e13 req-271ca677-16ba-48b4-b29f-38f70bda202a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.610285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7806ee44-a950-44fd-8c28-9f85148e228e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:06.610951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7806ee44-a950-44fd-8c28-9f85148e228e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:06.617132 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-31e5b865-28bf-48d5-a95c-2547ee696e13 req-271ca677-16ba-48b4-b29f-38f70bda202a service nova] Creating event network-changed:f438d8af-a8db-44da-92fe-ef9f6ae35141 for instance 1343027f-776d-4868-a38a-15e285438dd6 on nch1-master-1 Feb 19 20:55:06.617471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7806ee44-a950-44fd-8c28-9f85148e228e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.618046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7806ee44-a950-44fd-8c28-9f85148e228e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.618864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7806ee44-a950-44fd-8c28-9f85148e228e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.619303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7806ee44-a950-44fd-8c28-9f85148e228e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.622444 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-31e5b865-28bf-48d5-a95c-2547ee696e13 req-271ca677-16ba-48b4-b29f-38f70bda202a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033904 Feb 19 20:55:06.623138 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 599/1125] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:55:06.628749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b8131f11-8105-4afb-884b-8c2c224d61e3 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:06.629494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b8131f11-8105-4afb-884b-8c2c224d61e3 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:06.636000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8131f11-8105-4afb-884b-8c2c224d61e3 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.636486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8131f11-8105-4afb-884b-8c2c224d61e3 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:06.637329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8131f11-8105-4afb-884b-8c2c224d61e3 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:06.637770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8131f11-8105-4afb-884b-8c2c224d61e3 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:07.004172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7806ee44-a950-44fd-8c28-9f85148e228e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:07.014169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b8131f11-8105-4afb-884b-8c2c224d61e3 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:07.016741 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7806ee44-a950-44fd-8c28-9f85148e228e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1318 microversion: 2.1 time: 0.410269 Feb 19 20:55:07.017609 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 527/1126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:06 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:55:07.023342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a69e6eea-1435-4848-8e05-db4c56608806 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:07.024162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a69e6eea-1435-4848-8e05-db4c56608806 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:07.031106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a69e6eea-1435-4848-8e05-db4c56608806 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:07.031687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a69e6eea-1435-4848-8e05-db4c56608806 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:07.032605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a69e6eea-1435-4848-8e05-db4c56608806 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:07.033117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a69e6eea-1435-4848-8e05-db4c56608806 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:07.033934 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b8131f11-8105-4afb-884b-8c2c224d61e3 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1512 microversion: 2.1 time: 0.408857 Feb 19 20:55:07.033934 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 600/1127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:06 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:07.221349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-96197240-6267-4115-b104-76734be60a00 req-cb0bcea1-98ba-4c60-a7f3-6df4fe95a701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1eb520e-c397-4539-b786-0e315ff274b7", "name": "network-vif-plugged", "status": "completed", "tag": "d61fad0a-c589-4682-9531-d1e1afc31551"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:07.224682 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:07.224682 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:07.233361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-96197240-6267-4115-b104-76734be60a00 req-cb0bcea1-98ba-4c60-a7f3-6df4fe95a701 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:07.233796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-96197240-6267-4115-b104-76734be60a00 req-cb0bcea1-98ba-4c60-a7f3-6df4fe95a701 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:07.249129 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-96197240-6267-4115-b104-76734be60a00 req-cb0bcea1-98ba-4c60-a7f3-6df4fe95a701 service nova] Creating event network-vif-plugged:d61fad0a-c589-4682-9531-d1e1afc31551 for instance f1eb520e-c397-4539-b786-0e315ff274b7 on nch2-master-1 Feb 19 20:55:07.254711 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-96197240-6267-4115-b104-76734be60a00 req-cb0bcea1-98ba-4c60-a7f3-6df4fe95a701 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037928 Feb 19 20:55:07.255523 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 601/1128] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:55:07.273576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-99a174f9-e466-472e-8e3f-11f06ddd8237 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:07.274150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-99a174f9-e466-472e-8e3f-11f06ddd8237 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:07.281720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99a174f9-e466-472e-8e3f-11f06ddd8237 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:07.281720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99a174f9-e466-472e-8e3f-11f06ddd8237 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:07.282469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99a174f9-e466-472e-8e3f-11f06ddd8237 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:07.282934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99a174f9-e466-472e-8e3f-11f06ddd8237 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:07.465869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a69e6eea-1435-4848-8e05-db4c56608806 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:07.475144 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a69e6eea-1435-4848-8e05-db4c56608806 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.456049 Feb 19 20:55:07.476022 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 528/1129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:07 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:07.482488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:07.483194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:07.490710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:07.491315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:07.492230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:07.493208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:07.763699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-99a174f9-e466-472e-8e3f-11f06ddd8237 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:07.775753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-99a174f9-e466-472e-8e3f-11f06ddd8237 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.506681 Feb 19 20:55:07.776914 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 602/1130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:07 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:07.782201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-78e853cc-8557-4041-b041-d03525048ca9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:07.784107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-78e853cc-8557-4041-b041-d03525048ca9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:07.792125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78e853cc-8557-4041-b041-d03525048ca9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:07.793057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78e853cc-8557-4041-b041-d03525048ca9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:07.794256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78e853cc-8557-4041-b041-d03525048ca9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:07.794854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78e853cc-8557-4041-b041-d03525048ca9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.226246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:08.235431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:08.237279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:08.238724 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ca66ef1d-2534-4050-bd18-818f32992961 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.761791 Feb 19 20:55:08.239353 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 529/1131] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:07 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:08.245945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-91055290-432d-42a3-b7a3-b5f0e329d15a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:08.246857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-91055290-432d-42a3-b7a3-b5f0e329d15a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:08.254276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91055290-432d-42a3-b7a3-b5f0e329d15a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.254875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91055290-432d-42a3-b7a3-b5f0e329d15a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.255763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91055290-432d-42a3-b7a3-b5f0e329d15a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.256414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91055290-432d-42a3-b7a3-b5f0e329d15a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.381614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-78e853cc-8557-4041-b041-d03525048ca9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:08.392445 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-78e853cc-8557-4041-b041-d03525048ca9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.613223 Feb 19 20:55:08.393300 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 603/1132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:07 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:08.401114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-50c1a7b9-46ee-4191-9086-0524fcac69f7 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:08.401821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-50c1a7b9-46ee-4191-9086-0524fcac69f7 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:08.411189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50c1a7b9-46ee-4191-9086-0524fcac69f7 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.412100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50c1a7b9-46ee-4191-9086-0524fcac69f7 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.413326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50c1a7b9-46ee-4191-9086-0524fcac69f7 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.413911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50c1a7b9-46ee-4191-9086-0524fcac69f7 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.584368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91055290-432d-42a3-b7a3-b5f0e329d15a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:08.594736 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-91055290-432d-42a3-b7a3-b5f0e329d15a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1468 microversion: 2.1 time: 0.352423 Feb 19 20:55:08.606391 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 530/1133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:08 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1468 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:08.613710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aaa725b7-736e-4688-baa6-1a2f499cf1a8 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:08.614518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aaa725b7-736e-4688-baa6-1a2f499cf1a8 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:08.621639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aaa725b7-736e-4688-baa6-1a2f499cf1a8 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.622161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aaa725b7-736e-4688-baa6-1a2f499cf1a8 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.623192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aaa725b7-736e-4688-baa6-1a2f499cf1a8 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.623745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aaa725b7-736e-4688-baa6-1a2f499cf1a8 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.693726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-50c1a7b9-46ee-4191-9086-0524fcac69f7 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:08.705725 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-50c1a7b9-46ee-4191-9086-0524fcac69f7 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1318 microversion: 2.1 time: 0.310506 Feb 19 20:55:08.715621 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 604/1134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:08 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:08.715621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84993a2a-7cbe-40d2-9956-e3724ca7d9e8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:08.715621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-84993a2a-7cbe-40d2-9956-e3724ca7d9e8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:08.718252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84993a2a-7cbe-40d2-9956-e3724ca7d9e8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.718687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84993a2a-7cbe-40d2-9956-e3724ca7d9e8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.722407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aaa725b7-736e-4688-baa6-1a2f499cf1a8 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40515f5be4664c98a06359ae852e7b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dd33f3e21c4153b2dc5ec75558b150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:08.727429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84993a2a-7cbe-40d2-9956-e3724ca7d9e8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.727901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84993a2a-7cbe-40d2-9956-e3724ca7d9e8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.736053 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aaa725b7-736e-4688-baa6-1a2f499cf1a8 tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 200 len: 1301 microversion: 2.1 time: 0.125334 Feb 19 20:55:08.736810 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 531/1135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:08 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 1301 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:08.879219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d6a8bc47-8d66-4fc3-a836-6cbf767cdc9e tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:08.879557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d6a8bc47-8d66-4fc3-a836-6cbf767cdc9e tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:08.882985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84993a2a-7cbe-40d2-9956-e3724ca7d9e8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:08.885813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc47-8d66-4fc3-a836-6cbf767cdc9e tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.886259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc47-8d66-4fc3-a836-6cbf767cdc9e tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.887064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc47-8d66-4fc3-a836-6cbf767cdc9e tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.887550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6a8bc47-8d66-4fc3-a836-6cbf767cdc9e tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.892785 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84993a2a-7cbe-40d2-9956-e3724ca7d9e8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.184484 Feb 19 20:55:08.893506 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 605/1136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:08 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:08.898672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3f3ea57a-7f5d-4303-95c3-9b3acec916f3 req-e0eb3e06-1971-4816-94c8-880964c39c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ef2a35-0d6a-42b8-8275-c514b5724837", "name": "network-vif-deleted", "tag": "ab2d1d8e-e972-4f4b-8626-d98c3b875877"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:08.900220 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:08.900220 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:08.907593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3f3ea57a-7f5d-4303-95c3-9b3acec916f3 req-e0eb3e06-1971-4816-94c8-880964c39c5f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.908152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3f3ea57a-7f5d-4303-95c3-9b3acec916f3 req-e0eb3e06-1971-4816-94c8-880964c39c5f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.918062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d6a8bc47-8d66-4fc3-a836-6cbf767cdc9e tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:55:08.920508 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3f3ea57a-7f5d-4303-95c3-9b3acec916f3 req-e0eb3e06-1971-4816-94c8-880964c39c5f service nova] Creating event network-vif-deleted:ab2d1d8e-e972-4f4b-8626-d98c3b875877 for instance 61ef2a35-0d6a-42b8-8275-c514b5724837 on nch1-master-1 Feb 19 20:55:08.926548 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3f3ea57a-7f5d-4303-95c3-9b3acec916f3 req-e0eb3e06-1971-4816-94c8-880964c39c5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030993 Feb 19 20:55:08.927155 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 606/1137] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:08.932218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c8ec0fd0-c4aa-4886-817c-83f2613bab37 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:08.932998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c8ec0fd0-c4aa-4886-817c-83f2613bab37 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:08.939512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8ec0fd0-c4aa-4886-817c-83f2613bab37 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.940025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8ec0fd0-c4aa-4886-817c-83f2613bab37 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:08.941434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8ec0fd0-c4aa-4886-817c-83f2613bab37 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:08.941821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8ec0fd0-c4aa-4886-817c-83f2613bab37 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.014169 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d6a8bc47-8d66-4fc3-a836-6cbf767cdc9e tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 204 len: 0 microversion: 2.1 time: 0.275321 Feb 19 20:55:09.014864 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 532/1138] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:55:08 2022] DELETE /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:55:09.024902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66249a1b-f2a0-46e4-a11a-0ae3cdfe9917 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:09.025894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-66249a1b-f2a0-46e4-a11a-0ae3cdfe9917 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:09.032756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66249a1b-f2a0-46e4-a11a-0ae3cdfe9917 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.033361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66249a1b-f2a0-46e4-a11a-0ae3cdfe9917 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.034163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66249a1b-f2a0-46e4-a11a-0ae3cdfe9917 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.034793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66249a1b-f2a0-46e4-a11a-0ae3cdfe9917 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.153050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c8ec0fd0-c4aa-4886-817c-83f2613bab37 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:09.165001 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c8ec0fd0-c4aa-4886-817c-83f2613bab37 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.236153 Feb 19 20:55:09.166404 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 607/1139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:08 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:09.224810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-66249a1b-f2a0-46e4-a11a-0ae3cdfe9917 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:09.233100 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-66249a1b-f2a0-46e4-a11a-0ae3cdfe9917 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1474 microversion: 2.1 time: 0.213149 Feb 19 20:55:09.233776 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 533/1140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:09 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1474 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:09.257839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:09.258529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:09.265367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.265889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.266768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.267133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.411020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-888d521d-e583-4f42-9678-9e6beade6b76 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:09.411592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-888d521d-e583-4f42-9678-9e6beade6b76 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:09.417913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-888d521d-e583-4f42-9678-9e6beade6b76 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.418424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-888d521d-e583-4f42-9678-9e6beade6b76 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.419232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-888d521d-e583-4f42-9678-9e6beade6b76 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.419752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:09.420026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-888d521d-e583-4f42-9678-9e6beade6b76 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.430014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:09.432197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:09.433857 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d6f6b0df-a594-4060-83a9-c99e109d0b9e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.180622 Feb 19 20:55:09.434912 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 608/1141] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:09 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:09.581019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-888d521d-e583-4f42-9678-9e6beade6b76 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:09.590140 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-888d521d-e583-4f42-9678-9e6beade6b76 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.182954 Feb 19 20:55:09.591023 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 534/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:09 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:55:09.645837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-50f66b8c-4334-4ffc-9c1c-dab3e18ec194 req-34864d94-1507-4d54-98c5-d3471d7adeec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1343027f-776d-4868-a38a-15e285438dd6", "name": "network-vif-plugged", "status": "completed", "tag": "f438d8af-a8db-44da-92fe-ef9f6ae35141"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:09.648008 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:09.648008 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:09.656915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-50f66b8c-4334-4ffc-9c1c-dab3e18ec194 req-34864d94-1507-4d54-98c5-d3471d7adeec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.657583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-50f66b8c-4334-4ffc-9c1c-dab3e18ec194 req-34864d94-1507-4d54-98c5-d3471d7adeec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.676393 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-50f66b8c-4334-4ffc-9c1c-dab3e18ec194 req-34864d94-1507-4d54-98c5-d3471d7adeec service nova] Creating event network-vif-plugged:f438d8af-a8db-44da-92fe-ef9f6ae35141 for instance 1343027f-776d-4868-a38a-15e285438dd6 on nch1-master-1 Feb 19 20:55:09.684180 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-50f66b8c-4334-4ffc-9c1c-dab3e18ec194 req-34864d94-1507-4d54-98c5-d3471d7adeec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043275 Feb 19 20:55:09.685468 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 609/1143] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:09.724900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fb2ebc6c-c144-4bb8-98f1-f0d44495e285 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:09.731102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fb2ebc6c-c144-4bb8-98f1-f0d44495e285 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:09.737965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb2ebc6c-c144-4bb8-98f1-f0d44495e285 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.738422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb2ebc6c-c144-4bb8-98f1-f0d44495e285 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.739221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb2ebc6c-c144-4bb8-98f1-f0d44495e285 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.739939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb2ebc6c-c144-4bb8-98f1-f0d44495e285 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.758055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd8a5981-ff4c-4e42-b858-0eaa5981cebd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:09.758938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fd8a5981-ff4c-4e42-b858-0eaa5981cebd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] [instance: 61ef2a35-0d6a-42b8-8275-c514b5724837] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:09.766981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd8a5981-ff4c-4e42-b858-0eaa5981cebd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.767652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd8a5981-ff4c-4e42-b858-0eaa5981cebd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.769160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd8a5981-ff4c-4e42-b858-0eaa5981cebd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.769807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd8a5981-ff4c-4e42-b858-0eaa5981cebd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.787772 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-fd8a5981-ff4c-4e42-b858-0eaa5981cebd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] HTTP exception thrown: Instance 61ef2a35-0d6a-42b8-8275-c514b5724837 could not be found. Feb 19 20:55:09.788784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd8a5981-ff4c-4e42-b858-0eaa5981cebd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] Returning 404 to user: Instance 61ef2a35-0d6a-42b8-8275-c514b5724837 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:09.789732 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fd8a5981-ff4c-4e42-b858-0eaa5981cebd tempest-InstanceActionsTestJSON-629921606 tempest-InstanceActionsTestJSON-629921606-project] 10.222.0.30 "GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837" status: 404 len: 111 microversion: 2.1 time: 0.038269 Feb 19 20:55:09.790456 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 610/1144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:09 2022] GET /compute/v2.1/servers/61ef2a35-0d6a-42b8-8275-c514b5724837 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:55:09.917312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54857890-ac6e-4358-b00d-bd35df4e3406 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:09.920813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54857890-ac6e-4358-b00d-bd35df4e3406 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:09.931705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54857890-ac6e-4358-b00d-bd35df4e3406 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.932210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54857890-ac6e-4358-b00d-bd35df4e3406 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.934234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54857890-ac6e-4358-b00d-bd35df4e3406 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:09.934907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54857890-ac6e-4358-b00d-bd35df4e3406 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:09.942767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb2ebc6c-c144-4bb8-98f1-f0d44495e285 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:09.953412 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fb2ebc6c-c144-4bb8-98f1-f0d44495e285 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1318 microversion: 2.1 time: 0.233505 Feb 19 20:55:09.954069 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 535/1145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:09 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:10.106643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54857890-ac6e-4358-b00d-bd35df4e3406 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:10.115663 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54857890-ac6e-4358-b00d-bd35df4e3406 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.208356 Feb 19 20:55:10.116418 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 611/1146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:09 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:10.183600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a0fae2a-8008-4735-ac04-641cc3b1d37f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:10.184451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1a0fae2a-8008-4735-ac04-641cc3b1d37f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:10.192150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a0fae2a-8008-4735-ac04-641cc3b1d37f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.192691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a0fae2a-8008-4735-ac04-641cc3b1d37f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:10.193828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a0fae2a-8008-4735-ac04-641cc3b1d37f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.194878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a0fae2a-8008-4735-ac04-641cc3b1d37f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:10.252888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-623425bd-1139-42d0-b52d-320c57785b72 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:10.253586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-623425bd-1139-42d0-b52d-320c57785b72 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:10.263043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-623425bd-1139-42d0-b52d-320c57785b72 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.263609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-623425bd-1139-42d0-b52d-320c57785b72 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:10.264532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-623425bd-1139-42d0-b52d-320c57785b72 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.265182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-623425bd-1139-42d0-b52d-320c57785b72 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:10.383703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1a0fae2a-8008-4735-ac04-641cc3b1d37f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:10.392843 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1a0fae2a-8008-4735-ac04-641cc3b1d37f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.213187 Feb 19 20:55:10.396373 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 536/1147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:10 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:10.453347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-623425bd-1139-42d0-b52d-320c57785b72 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:10.453931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:10.454674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:10.461852 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-623425bd-1139-42d0-b52d-320c57785b72 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1474 microversion: 2.1 time: 0.212673 Feb 19 20:55:10.464372 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 612/1148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:10 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1474 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:10.464538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.464538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:10.464538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.464862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:10.608435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fc44dc5f-1976-4062-ac54-187e1e762e26 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:10.609118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fc44dc5f-1976-4062-ac54-187e1e762e26 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:10.612380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:10.617581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc44dc5f-1976-4062-ac54-187e1e762e26 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.618431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc44dc5f-1976-4062-ac54-187e1e762e26 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:10.619300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc44dc5f-1976-4062-ac54-187e1e762e26 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.619745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc44dc5f-1976-4062-ac54-187e1e762e26 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:10.620898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:10.622296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:10.623456 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fb6773a4-5c1b-467f-b5ba-02fbe05c1605 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.173998 Feb 19 20:55:10.624389 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 537/1149] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:10 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:10.838766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fc44dc5f-1976-4062-ac54-187e1e762e26 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:10.847330 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fc44dc5f-1976-4062-ac54-187e1e762e26 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.243937 Feb 19 20:55:10.849987 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 613/1150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:10 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:10.970757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e2349c54-6f7f-4666-8118-5f38da938e1f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:10.971374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e2349c54-6f7f-4666-8118-5f38da938e1f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:10.977608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2349c54-6f7f-4666-8118-5f38da938e1f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.978293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2349c54-6f7f-4666-8118-5f38da938e1f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:10.979256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2349c54-6f7f-4666-8118-5f38da938e1f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:10.979861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2349c54-6f7f-4666-8118-5f38da938e1f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.135727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6dd2abf9-d43d-4cbc-a423-9a306c548fce tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:11.136654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6dd2abf9-d43d-4cbc-a423-9a306c548fce tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:11.143797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dd2abf9-d43d-4cbc-a423-9a306c548fce tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.144298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dd2abf9-d43d-4cbc-a423-9a306c548fce tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.145533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dd2abf9-d43d-4cbc-a423-9a306c548fce tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.145981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dd2abf9-d43d-4cbc-a423-9a306c548fce tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.306775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e2349c54-6f7f-4666-8118-5f38da938e1f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:11.317935 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e2349c54-6f7f-4666-8118-5f38da938e1f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1318 microversion: 2.1 time: 0.350631 Feb 19 20:55:11.330063 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 538/1151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:10 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:11.412579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-809419e6-df79-4a0c-84fd-741760f25f8a tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:11.413266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-809419e6-df79-4a0c-84fd-741760f25f8a tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:11.428460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-809419e6-df79-4a0c-84fd-741760f25f8a tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.429252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-809419e6-df79-4a0c-84fd-741760f25f8a tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.430609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-809419e6-df79-4a0c-84fd-741760f25f8a tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.431304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-809419e6-df79-4a0c-84fd-741760f25f8a tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.473909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6dd2abf9-d43d-4cbc-a423-9a306c548fce tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:11.483227 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6dd2abf9-d43d-4cbc-a423-9a306c548fce tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.353999 Feb 19 20:55:11.483832 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 614/1152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:11 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:11.499200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-73c39451-99e1-4bcf-8844-d80b06a8c737 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:11.499965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-73c39451-99e1-4bcf-8844-d80b06a8c737 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:11.519686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73c39451-99e1-4bcf-8844-d80b06a8c737 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.520276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73c39451-99e1-4bcf-8844-d80b06a8c737 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.521313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73c39451-99e1-4bcf-8844-d80b06a8c737 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.521852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73c39451-99e1-4bcf-8844-d80b06a8c737 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.619235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-73c39451-99e1-4bcf-8844-d80b06a8c737 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:11.629428 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-73c39451-99e1-4bcf-8844-d80b06a8c737 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 200 len: 1432 microversion: 2.1 time: 0.134474 Feb 19 20:55:11.632731 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 615/1153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:11 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 1432 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:11.647594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d177b6b4-6198-446b-9f43-3e4f84bfeba3 req-53064de5-6b71-438f-90a8-66e47a277c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5997373e-abc0-4f20-9feb-047df1ddcbf5", "name": "network-vif-deleted", "tag": "e7a4ce4e-94ea-436b-bae9-e67c3bf0fc90"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:11.653750 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:11.653750 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:11.679283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d177b6b4-6198-446b-9f43-3e4f84bfeba3 req-53064de5-6b71-438f-90a8-66e47a277c33 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.680887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d177b6b4-6198-446b-9f43-3e4f84bfeba3 req-53064de5-6b71-438f-90a8-66e47a277c33 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.721695 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d177b6b4-6198-446b-9f43-3e4f84bfeba3 req-53064de5-6b71-438f-90a8-66e47a277c33 service nova] Creating event network-vif-deleted:e7a4ce4e-94ea-436b-bae9-e67c3bf0fc90 for instance 5997373e-abc0-4f20-9feb-047df1ddcbf5 on nch1-master-1 Feb 19 20:55:11.727381 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d177b6b4-6198-446b-9f43-3e4f84bfeba3 req-53064de5-6b71-438f-90a8-66e47a277c33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092207 Feb 19 20:55:11.729542 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 616/1154] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:11.736124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:11.736881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:11.744163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.744687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.745737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.746235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.783313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-809419e6-df79-4a0c-84fd-741760f25f8a tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:11.792312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-809419e6-df79-4a0c-84fd-741760f25f8a tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.386125 Feb 19 20:55:11.793220 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 539/1155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:11 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:11.864743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1cc8abd9-786f-46b3-90c7-da80619f3db7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:11.865565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1cc8abd9-786f-46b3-90c7-da80619f3db7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:11.873023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cc8abd9-786f-46b3-90c7-da80619f3db7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.873601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cc8abd9-786f-46b3-90c7-da80619f3db7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.874683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cc8abd9-786f-46b3-90c7-da80619f3db7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:11.875241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cc8abd9-786f-46b3-90c7-da80619f3db7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:11.920605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:11.931528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:11.933051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:11.934443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-11252591-c0a0-4e49-90ac-7a6f95de8707 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.203492 Feb 19 20:55:11.935014 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 617/1156] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:11 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:12.049401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1cc8abd9-786f-46b3-90c7-da80619f3db7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:12.062387 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1cc8abd9-786f-46b3-90c7-da80619f3db7 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.201766 Feb 19 20:55:12.073421 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 540/1157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:11 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:12.338245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-80377e68-ac78-4b57-9584-458e4b4337af tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:12.339776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-80377e68-ac78-4b57-9584-458e4b4337af tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:12.347736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80377e68-ac78-4b57-9584-458e4b4337af tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.348675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80377e68-ac78-4b57-9584-458e4b4337af tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:12.349444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80377e68-ac78-4b57-9584-458e4b4337af tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.349923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80377e68-ac78-4b57-9584-458e4b4337af tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:12.500733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9d43875a-e884-47fc-bf40-dcbe9726c4ee tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:12.501475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9d43875a-e884-47fc-bf40-dcbe9726c4ee tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:12.510018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d43875a-e884-47fc-bf40-dcbe9726c4ee tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.510368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d43875a-e884-47fc-bf40-dcbe9726c4ee tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:12.511191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d43875a-e884-47fc-bf40-dcbe9726c4ee tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.511671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d43875a-e884-47fc-bf40-dcbe9726c4ee tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:12.659620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80377e68-ac78-4b57-9584-458e4b4337af tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:12.667820 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-80377e68-ac78-4b57-9584-458e4b4337af tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1508 microversion: 2.1 time: 0.333325 Feb 19 20:55:12.680986 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 618/1158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:12 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:12.686533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0902d510-7568-436c-8320-e8129acae29a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:12.687187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0902d510-7568-436c-8320-e8129acae29a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:12.694897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0902d510-7568-436c-8320-e8129acae29a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.695440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0902d510-7568-436c-8320-e8129acae29a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:12.696231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0902d510-7568-436c-8320-e8129acae29a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.696950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0902d510-7568-436c-8320-e8129acae29a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:12.716586 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0902d510-7568-436c-8320-e8129acae29a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] HTTP exception thrown: Instance 5997373e-abc0-4f20-9feb-047df1ddcbf5 could not be found. Feb 19 20:55:12.717330 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0902d510-7568-436c-8320-e8129acae29a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Returning 404 to user: Instance 5997373e-abc0-4f20-9feb-047df1ddcbf5 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:12.718241 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0902d510-7568-436c-8320-e8129acae29a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 404 len: 111 microversion: 2.1 time: 0.035935 Feb 19 20:55:12.718826 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 619/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:12 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:55:12.723454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d3c8f18-7d00-4d96-8e5e-d311a1d41e25 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:12.724253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2d3c8f18-7d00-4d96-8e5e-d311a1d41e25 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:12.734768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d3c8f18-7d00-4d96-8e5e-d311a1d41e25 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.735429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d3c8f18-7d00-4d96-8e5e-d311a1d41e25 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:12.736958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d3c8f18-7d00-4d96-8e5e-d311a1d41e25 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.738329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d3c8f18-7d00-4d96-8e5e-d311a1d41e25 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:12.965767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9d43875a-e884-47fc-bf40-dcbe9726c4ee tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:12.975071 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9d43875a-e884-47fc-bf40-dcbe9726c4ee tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.478137 Feb 19 20:55:12.976481 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 541/1160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:12 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:55:12.980889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5c3ebcc9-0fd8-4c56-a76a-b8f1a83f702e tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:12.981508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5c3ebcc9-0fd8-4c56-a76a-b8f1a83f702e tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:12.988508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c3ebcc9-0fd8-4c56-a76a-b8f1a83f702e tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.988938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c3ebcc9-0fd8-4c56-a76a-b8f1a83f702e tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:12.989782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c3ebcc9-0fd8-4c56-a76a-b8f1a83f702e tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:12.990278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c3ebcc9-0fd8-4c56-a76a-b8f1a83f702e tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:13.097213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2d3c8f18-7d00-4d96-8e5e-d311a1d41e25 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:13.104789 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d3c8f18-7d00-4d96-8e5e-d311a1d41e25 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1508 microversion: 2.1 time: 0.384831 Feb 19 20:55:13.116420 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 620/1161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:12 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:13.121538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1734379544", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:13.175874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:55:13.381919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5c3ebcc9-0fd8-4c56-a76a-b8f1a83f702e tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:13.390093 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5c3ebcc9-0fd8-4c56-a76a-b8f1a83f702e tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.412386 Feb 19 20:55:13.390904 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 542/1162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:12 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:13.395289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:13.395902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:13.401684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:13.402143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:13.403023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:13.403369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:13.663445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:55:13.663983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:55:13.664407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:55:13.664878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:55:13.665779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:55:13.677356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:13.677794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:13.678929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:13.679404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:13.704998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Getting quotas for project 756e52c91ebf4bc9bacebcc1431abb28. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:13.710315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Getting quotas for user 076a0cb931aa4bcd8c4b4d95c387fb4c and project 756e52c91ebf4bc9bacebcc1431abb28. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:13.727563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:55:13.731090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:55:13.775678 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2133f704-cd09-4899-b59b-ece7d413c39a tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658081 Feb 19 20:55:13.777809 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 621/1163] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:55:13.781755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-703202d0-c6c4-40f0-931d-0576c7b947e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:13.782623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-703202d0-c6c4-40f0-931d-0576c7b947e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:13.789703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:13.791002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-703202d0-c6c4-40f0-931d-0576c7b947e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:13.791002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-703202d0-c6c4-40f0-931d-0576c7b947e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:13.794557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-703202d0-c6c4-40f0-931d-0576c7b947e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:13.794557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-703202d0-c6c4-40f0-931d-0576c7b947e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:13.821671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:13.825614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:13.827110 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1f57110c-7f9e-4432-aec5-8fdc06000e73 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.435275 Feb 19 20:55:13.828133 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 543/1164] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:13 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:13.837775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:13.839869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:13.847193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:13.847842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:13.849090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:13.849728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:13.950346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:55:13.950771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:55:13.951246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:55:13.951661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:55:13.952106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:55:14.040509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-703202d0-c6c4-40f0-931d-0576c7b947e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:14.049052 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-703202d0-c6c4-40f0-931d-0576c7b947e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.271104 Feb 19 20:55:14.049833 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 622/1165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:13 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:14.051502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:14.057490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-29056ea2-597e-4663-b929-a7a6e42073ee tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:14.058078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-29056ea2-597e-4663-b929-a7a6e42073ee tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:14.066118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.066594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:14.068124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.068989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:14.113618 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e9a29f4e-4fb9-4179-9131-e6de3aaa1437 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "POST /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6/action" status: 202 len: 1110 microversion: 2.1 time: 0.284265 Feb 19 20:55:14.115038 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 544/1166] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:55:13 2022] POST /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6/action => generated 1110 bytes in 286 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 19 20:55:14.129550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a542f15c-c594-4fc6-b825-d7ff42c6725a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:14.130684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a542f15c-c594-4fc6-b825-d7ff42c6725a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:14.137974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a542f15c-c594-4fc6-b825-d7ff42c6725a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.138679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a542f15c-c594-4fc6-b825-d7ff42c6725a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:14.140109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a542f15c-c594-4fc6-b825-d7ff42c6725a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.140739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a542f15c-c594-4fc6-b825-d7ff42c6725a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:14.197141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29056ea2-597e-4663-b929-a7a6e42073ee tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:14.211077 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-29056ea2-597e-4663-b929-a7a6e42073ee tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1220 microversion: 2.1 time: 0.159666 Feb 19 20:55:14.212253 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 623/1167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:14 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:14.218294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cf5ac114-b002-4431-a63e-748fe06b169e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:14.218990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cf5ac114-b002-4431-a63e-748fe06b169e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:14.227234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf5ac114-b002-4431-a63e-748fe06b169e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.227831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf5ac114-b002-4431-a63e-748fe06b169e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:14.228777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf5ac114-b002-4431-a63e-748fe06b169e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.229392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf5ac114-b002-4431-a63e-748fe06b169e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:14.838019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a542f15c-c594-4fc6-b825-d7ff42c6725a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:14.847485 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a542f15c-c594-4fc6-b825-d7ff42c6725a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.731096 Feb 19 20:55:14.848901 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 545/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:14 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:14.854043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-25b216e5-3196-4d8f-a80e-e9c581da2787 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:14.854683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-25b216e5-3196-4d8f-a80e-e9c581da2787 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:14.859438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cf5ac114-b002-4431-a63e-748fe06b169e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:14.863499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25b216e5-3196-4d8f-a80e-e9c581da2787 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.864214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25b216e5-3196-4d8f-a80e-e9c581da2787 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:14.865283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25b216e5-3196-4d8f-a80e-e9c581da2787 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.865983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25b216e5-3196-4d8f-a80e-e9c581da2787 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:14.872042 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cf5ac114-b002-4431-a63e-748fe06b169e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.658356 Feb 19 20:55:14.873085 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 624/1169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:14 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:14.889784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:14.890570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:14.900385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.901661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:14.902754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:14.903381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:15.392529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-25b216e5-3196-4d8f-a80e-e9c581da2787 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:15.400991 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-25b216e5-3196-4d8f-a80e-e9c581da2787 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.550814 Feb 19 20:55:15.401801 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 546/1170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:14 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:15.406747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b3bfc5b-d8f9-4d15-bed4-a11fe983c782 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:15.407363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b3bfc5b-d8f9-4d15-bed4-a11fe983c782 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:15.413192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:15.413396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc5b-d8f9-4d15-bed4-a11fe983c782 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:15.413843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc5b-d8f9-4d15-bed4-a11fe983c782 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:15.414647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc5b-d8f9-4d15-bed4-a11fe983c782 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:15.415085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc5b-d8f9-4d15-bed4-a11fe983c782 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:15.429244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:15.431723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:15.433562 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5700eb10-b4d5-49a9-9fd5-e63130a4674c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.559411 Feb 19 20:55:15.434565 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 625/1171] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:14 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:15.440103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-744d85fe-3ff9-4f5a-a514-f86e8886452f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:15.442344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-744d85fe-3ff9-4f5a-a514-f86e8886452f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:15.448923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-744d85fe-3ff9-4f5a-a514-f86e8886452f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:15.449541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-744d85fe-3ff9-4f5a-a514-f86e8886452f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:15.451038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-744d85fe-3ff9-4f5a-a514-f86e8886452f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:15.451686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-744d85fe-3ff9-4f5a-a514-f86e8886452f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:15.595656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-744d85fe-3ff9-4f5a-a514-f86e8886452f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:15.603766 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-744d85fe-3ff9-4f5a-a514-f86e8886452f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1278 microversion: 2.1 time: 0.167993 Feb 19 20:55:15.604375 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 626/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:15 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:15.814990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b3bfc5b-d8f9-4d15-bed4-a11fe983c782 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:15.825202 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b3bfc5b-d8f9-4d15-bed4-a11fe983c782 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.422041 Feb 19 20:55:15.825950 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 547/1173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:15 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:15.866865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-60f730a4-fe0f-4b56-9d4e-a38ecae0a22b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:15.867473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-60f730a4-fe0f-4b56-9d4e-a38ecae0a22b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:15.873638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60f730a4-fe0f-4b56-9d4e-a38ecae0a22b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:15.874322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60f730a4-fe0f-4b56-9d4e-a38ecae0a22b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:15.875386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60f730a4-fe0f-4b56-9d4e-a38ecae0a22b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:15.875983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60f730a4-fe0f-4b56-9d4e-a38ecae0a22b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:15.889808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-69c63319-ab56-44ec-af2b-271887fa7e6e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:15.890422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-69c63319-ab56-44ec-af2b-271887fa7e6e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:15.897083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69c63319-ab56-44ec-af2b-271887fa7e6e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:15.897611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69c63319-ab56-44ec-af2b-271887fa7e6e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:15.898560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69c63319-ab56-44ec-af2b-271887fa7e6e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:15.899009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69c63319-ab56-44ec-af2b-271887fa7e6e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:16.274843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-60f730a4-fe0f-4b56-9d4e-a38ecae0a22b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:16.287050 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-60f730a4-fe0f-4b56-9d4e-a38ecae0a22b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.424194 Feb 19 20:55:16.296375 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 627/1174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:15 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:16.309237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-69c63319-ab56-44ec-af2b-271887fa7e6e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:16.323483 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-69c63319-ab56-44ec-af2b-271887fa7e6e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.437721 Feb 19 20:55:16.325163 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 548/1175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:15 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:16.418924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-71e62571-688d-4b27-8ad0-fc415a52f933 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:16.419494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-71e62571-688d-4b27-8ad0-fc415a52f933 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:16.432912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71e62571-688d-4b27-8ad0-fc415a52f933 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:16.433357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71e62571-688d-4b27-8ad0-fc415a52f933 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:16.442004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71e62571-688d-4b27-8ad0-fc415a52f933 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:16.443421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71e62571-688d-4b27-8ad0-fc415a52f933 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:16.453275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:16.453890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:16.462583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:16.463038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:16.463914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:16.464300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:16.868910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-71e62571-688d-4b27-8ad0-fc415a52f933 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:16.886776 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-71e62571-688d-4b27-8ad0-fc415a52f933 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.471749 Feb 19 20:55:16.891787 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 628/1176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:16 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:16.908807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1bd34631-29ae-4a42-a04b-c0be077718e0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:16.911540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1bd34631-29ae-4a42-a04b-c0be077718e0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:16.922685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bd34631-29ae-4a42-a04b-c0be077718e0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:16.923450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bd34631-29ae-4a42-a04b-c0be077718e0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:16.925501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bd34631-29ae-4a42-a04b-c0be077718e0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:16.927082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bd34631-29ae-4a42-a04b-c0be077718e0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:16.940066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:16.963979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:16.973494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:16.975287 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2320d986-3071-4f37-8a76-551e9d363fbe tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.525663 Feb 19 20:55:16.977740 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 549/1177] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:16 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:55:16.992072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-92203d51-dfb7-48dc-a8ec-95b5d3db32aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:16.993118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-92203d51-dfb7-48dc-a8ec-95b5d3db32aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:17.008317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92203d51-dfb7-48dc-a8ec-95b5d3db32aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:17.011312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92203d51-dfb7-48dc-a8ec-95b5d3db32aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:17.013918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92203d51-dfb7-48dc-a8ec-95b5d3db32aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:17.017229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92203d51-dfb7-48dc-a8ec-95b5d3db32aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:17.364375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-92203d51-dfb7-48dc-a8ec-95b5d3db32aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:17.372904 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-92203d51-dfb7-48dc-a8ec-95b5d3db32aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.391333 Feb 19 20:55:17.373663 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 550/1178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:16 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:17.389494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-28b47e66-34ba-44b0-8aaf-87e723f9d128 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:17.390360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-28b47e66-34ba-44b0-8aaf-87e723f9d128 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:17.400036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28b47e66-34ba-44b0-8aaf-87e723f9d128 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:17.400734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28b47e66-34ba-44b0-8aaf-87e723f9d128 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:17.401750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28b47e66-34ba-44b0-8aaf-87e723f9d128 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:17.402370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28b47e66-34ba-44b0-8aaf-87e723f9d128 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:17.426314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1bd34631-29ae-4a42-a04b-c0be077718e0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:17.453433 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1bd34631-29ae-4a42-a04b-c0be077718e0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1320 microversion: 2.1 time: 0.557860 Feb 19 20:55:17.454435 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 629/1179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:16 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1320 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:17.472165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5b91014c-7788-40b8-909b-6a9728a09237 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:17.473158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5b91014c-7788-40b8-909b-6a9728a09237 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:17.481237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b91014c-7788-40b8-909b-6a9728a09237 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:17.482559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b91014c-7788-40b8-909b-6a9728a09237 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:17.483667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b91014c-7788-40b8-909b-6a9728a09237 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:17.484271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b91014c-7788-40b8-909b-6a9728a09237 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:17.840171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-28b47e66-34ba-44b0-8aaf-87e723f9d128 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:17.854462 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-28b47e66-34ba-44b0-8aaf-87e723f9d128 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.478180 Feb 19 20:55:17.855098 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 551/1180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:17 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:17.866768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5b91014c-7788-40b8-909b-6a9728a09237 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:17.874693 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5b91014c-7788-40b8-909b-6a9728a09237 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.407284 Feb 19 20:55:17.886200 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 630/1181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:17 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:17.906372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d0933b86-8578-44ac-8e2e-9ea034a0ff3f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:17.907464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d0933b86-8578-44ac-8e2e-9ea034a0ff3f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:17.916295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0933b86-8578-44ac-8e2e-9ea034a0ff3f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:17.917626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0933b86-8578-44ac-8e2e-9ea034a0ff3f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:17.920015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0933b86-8578-44ac-8e2e-9ea034a0ff3f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:17.920558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0933b86-8578-44ac-8e2e-9ea034a0ff3f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:17.994330 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:17.997958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:18.007359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:18.009531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:18.010819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:18.011811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:18.746355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d0933b86-8578-44ac-8e2e-9ea034a0ff3f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:18.762298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:18.767306 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d0933b86-8578-44ac-8e2e-9ea034a0ff3f tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.864790 Feb 19 20:55:18.775166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:18.778751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:18.779662 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 552/1182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:17 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:18.780990 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-86835bd5-5dcb-47a4-b3d9-0cac87c40fe5 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.790917 Feb 19 20:55:18.782033 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 631/1183] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:17 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:55:18.789275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8ff936ff-debb-4f42-85c9-55553057e8f0 req-29fa7bae-da7d-47cf-839c-36487f1b1bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73f9801-8d11-4cf5-a822-e3692fbb693f", "tag": "fb4a12b5-a532-459a-882e-77fe1c128ae4"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:18.791688 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:18.791688 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:18.793267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d6db904-ddb0-4d2b-9cbe-ba86c499ffc2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:18.795077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d6db904-ddb0-4d2b-9cbe-ba86c499ffc2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:18.800953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8ff936ff-debb-4f42-85c9-55553057e8f0 req-29fa7bae-da7d-47cf-839c-36487f1b1bf8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:18.801666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8ff936ff-debb-4f42-85c9-55553057e8f0 req-29fa7bae-da7d-47cf-839c-36487f1b1bf8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:18.810236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6db904-ddb0-4d2b-9cbe-ba86c499ffc2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:18.811335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6db904-ddb0-4d2b-9cbe-ba86c499ffc2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:18.812373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6db904-ddb0-4d2b-9cbe-ba86c499ffc2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:18.813004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6db904-ddb0-4d2b-9cbe-ba86c499ffc2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:18.827393 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8ff936ff-debb-4f42-85c9-55553057e8f0 req-29fa7bae-da7d-47cf-839c-36487f1b1bf8 service nova] Creating event network-changed:fb4a12b5-a532-459a-882e-77fe1c128ae4 for instance e73f9801-8d11-4cf5-a822-e3692fbb693f on nch1-master-1 Feb 19 20:55:18.836153 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8ff936ff-debb-4f42-85c9-55553057e8f0 req-29fa7bae-da7d-47cf-839c-36487f1b1bf8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052312 Feb 19 20:55:18.837556 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 632/1184] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:18.845811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-be530f8c-231b-44a2-a496-9bfb67ace459 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:18.847818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-be530f8c-231b-44a2-a496-9bfb67ace459 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:18.864228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be530f8c-231b-44a2-a496-9bfb67ace459 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:18.864940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be530f8c-231b-44a2-a496-9bfb67ace459 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:18.867701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be530f8c-231b-44a2-a496-9bfb67ace459 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:18.870958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be530f8c-231b-44a2-a496-9bfb67ace459 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:19.187209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-be530f8c-231b-44a2-a496-9bfb67ace459 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:19.197078 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-be530f8c-231b-44a2-a496-9bfb67ace459 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1320 microversion: 2.1 time: 0.357318 Feb 19 20:55:19.197960 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 633/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:18 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1320 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:19.203391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00d10a2f-5590-45b7-88a6-6e0c0b983a32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:19.203999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-00d10a2f-5590-45b7-88a6-6e0c0b983a32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:19.213052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00d10a2f-5590-45b7-88a6-6e0c0b983a32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:19.213817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00d10a2f-5590-45b7-88a6-6e0c0b983a32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:19.214743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00d10a2f-5590-45b7-88a6-6e0c0b983a32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:19.215123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8d6db904-ddb0-4d2b-9cbe-ba86c499ffc2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:19.215867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00d10a2f-5590-45b7-88a6-6e0c0b983a32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:19.223644 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d6db904-ddb0-4d2b-9cbe-ba86c499ffc2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.440425 Feb 19 20:55:19.224405 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 553/1186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:18 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:19.241242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-df092406-80d2-4153-8e3a-7623fc6e2781 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:19.242252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-df092406-80d2-4153-8e3a-7623fc6e2781 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:19.253239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df092406-80d2-4153-8e3a-7623fc6e2781 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:19.253853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df092406-80d2-4153-8e3a-7623fc6e2781 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:19.254869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df092406-80d2-4153-8e3a-7623fc6e2781 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:19.255481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df092406-80d2-4153-8e3a-7623fc6e2781 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:19.608139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-00d10a2f-5590-45b7-88a6-6e0c0b983a32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:19.616758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-df092406-80d2-4153-8e3a-7623fc6e2781 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:19.618271 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-00d10a2f-5590-45b7-88a6-6e0c0b983a32 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.418890 Feb 19 20:55:19.627864 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-df092406-80d2-4153-8e3a-7623fc6e2781 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.392033 Feb 19 20:55:19.629369 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 554/1187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:19 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:19.630373 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 634/1188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:19 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:19.778758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-847386938", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:19.792010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b7bdee8e-de1c-4383-add1-55da01de81b5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:19.793228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b7bdee8e-de1c-4383-add1-55da01de81b5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:19.802508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b7bdee8e-de1c-4383-add1-55da01de81b5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:19.803160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b7bdee8e-de1c-4383-add1-55da01de81b5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:19.804971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b7bdee8e-de1c-4383-add1-55da01de81b5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:19.805674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b7bdee8e-de1c-4383-add1-55da01de81b5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:19.850447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] validate_networks() for [('522a4889-4ca5-4003-88ab-4ec7fe7bb9fa', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:55:20.239107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b7bdee8e-de1c-4383-add1-55da01de81b5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:20.248271 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b7bdee8e-de1c-4383-add1-55da01de81b5 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.466058 Feb 19 20:55:20.249190 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 635/1189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:19 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:20.254168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:20.255029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:20.261573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.262482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:20.263579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.264315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:20.588976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:20.601759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:20.603855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:20.605164 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14d2b56d-3065-4c29-82be-7bb72f808e35 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.354655 Feb 19 20:55:20.617714 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 636/1190] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:20 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:20.622696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a6265a8b-dc80-4f63-a7c0-2aca2dd09b05 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:20.623477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a6265a8b-dc80-4f63-a7c0-2aca2dd09b05 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:20.631868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6265a8b-dc80-4f63-a7c0-2aca2dd09b05 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.632660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6265a8b-dc80-4f63-a7c0-2aca2dd09b05 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:20.633796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6265a8b-dc80-4f63-a7c0-2aca2dd09b05 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.634464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6265a8b-dc80-4f63-a7c0-2aca2dd09b05 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:20.639601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:55:20.642134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:55:20.642134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:55:20.642134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:55:20.642134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:55:20.655511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.656793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:20.658220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.658843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:20.689931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Getting quotas for project 4e7060607f9342ad93e2ddbab97d8d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:20.712359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Getting quotas for user 605ee8b93b804ecc9f21177c4cbf0b2a and project 4e7060607f9342ad93e2ddbab97d8d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:20.741191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:55:20.747441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:55:20.819914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a6265a8b-dc80-4f63-a7c0-2aca2dd09b05 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:20.825740 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-48c09420-d618-4ef1-b450-a9eca5e88002 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.189913 Feb 19 20:55:20.831260 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 555/1191] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:55:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:55:20.832691 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a6265a8b-dc80-4f63-a7c0-2aca2dd09b05 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1320 microversion: 2.1 time: 0.211996 Feb 19 20:55:20.835523 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 637/1192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:20 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:20.839430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-08d0fbd0-4248-45f0-b2aa-c61658134176 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:20.840064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08d0fbd0-4248-45f0-b2aa-c61658134176 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:20.840590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f1d8291-6019-482d-8c30-021237b7de94 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:20.841380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9f1d8291-6019-482d-8c30-021237b7de94 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:20.847965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08d0fbd0-4248-45f0-b2aa-c61658134176 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.848417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08d0fbd0-4248-45f0-b2aa-c61658134176 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:20.849395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08d0fbd0-4248-45f0-b2aa-c61658134176 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.850190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f1d8291-6019-482d-8c30-021237b7de94 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.850441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08d0fbd0-4248-45f0-b2aa-c61658134176 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:20.851025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f1d8291-6019-482d-8c30-021237b7de94 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:20.852722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f1d8291-6019-482d-8c30-021237b7de94 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:20.853577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f1d8291-6019-482d-8c30-021237b7de94 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:21.144314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9f1d8291-6019-482d-8c30-021237b7de94 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:21.152836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-08d0fbd0-4248-45f0-b2aa-c61658134176 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:21.154281 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f1d8291-6019-482d-8c30-021237b7de94 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 0.317496 Feb 19 20:55:21.156027 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 638/1193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:20 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:21.161683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8bb46c67-c962-464c-89d4-9053e60fab7c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:21.162620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8bb46c67-c962-464c-89d4-9053e60fab7c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:21.170328 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-08d0fbd0-4248-45f0-b2aa-c61658134176 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 0.337506 Feb 19 20:55:21.171024 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 556/1194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:20 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:21.171377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8bb46c67-c962-464c-89d4-9053e60fab7c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:21.172026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8bb46c67-c962-464c-89d4-9053e60fab7c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:21.173188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8bb46c67-c962-464c-89d4-9053e60fab7c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:21.173843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8bb46c67-c962-464c-89d4-9053e60fab7c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:21.177671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2839f90-987d-4869-a356-6c575e713c98 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:21.178816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2839f90-987d-4869-a356-6c575e713c98 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:21.299377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2839f90-987d-4869-a356-6c575e713c98 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:21.309155 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2839f90-987d-4869-a356-6c575e713c98 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1213 microversion: 2.1 time: 0.136798 Feb 19 20:55:21.312345 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 557/1195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:21 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:21.319673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f0d52a38-af9e-4681-ac91-34db2ff348ba tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:21.324217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f0d52a38-af9e-4681-ac91-34db2ff348ba tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:21.338784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0d52a38-af9e-4681-ac91-34db2ff348ba tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:21.342219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0d52a38-af9e-4681-ac91-34db2ff348ba tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:21.343679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0d52a38-af9e-4681-ac91-34db2ff348ba tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:21.344309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0d52a38-af9e-4681-ac91-34db2ff348ba tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:21.757401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8bb46c67-c962-464c-89d4-9053e60fab7c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:21.774555 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8bb46c67-c962-464c-89d4-9053e60fab7c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.616960 Feb 19 20:55:21.787762 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 639/1196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:21 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:21.801515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0d52a38-af9e-4681-ac91-34db2ff348ba tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:21.801827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:21.802332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:21.815615 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f0d52a38-af9e-4681-ac91-34db2ff348ba tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.501151 Feb 19 20:55:21.816647 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 558/1197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:21 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:21.833045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:21.834205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:21.836767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:21.838326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:21.853981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-32c81418-af37-4d83-89f0-7f13e3a49b7f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:21.855635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-32c81418-af37-4d83-89f0-7f13e3a49b7f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:21.862442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32c81418-af37-4d83-89f0-7f13e3a49b7f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:21.866032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32c81418-af37-4d83-89f0-7f13e3a49b7f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:21.866999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32c81418-af37-4d83-89f0-7f13e3a49b7f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:21.868171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32c81418-af37-4d83-89f0-7f13e3a49b7f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:22.384745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-32c81418-af37-4d83-89f0-7f13e3a49b7f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:22.399364 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-32c81418-af37-4d83-89f0-7f13e3a49b7f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1320 microversion: 2.1 time: 0.549235 Feb 19 20:55:22.405533 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 559/1198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:21 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1320 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:22.419508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-254b3efa-5eb7-40e7-8354-a018b7327297 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:22.425654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-254b3efa-5eb7-40e7-8354-a018b7327297 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:22.437643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-254b3efa-5eb7-40e7-8354-a018b7327297 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:22.438458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-254b3efa-5eb7-40e7-8354-a018b7327297 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:22.440169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-254b3efa-5eb7-40e7-8354-a018b7327297 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:22.441448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-254b3efa-5eb7-40e7-8354-a018b7327297 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:22.587347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:22.608909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:22.610563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:22.627088 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-340e5de6-278b-4e13-9206-bca4cf21f425 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1487 microversion: 2.25 time: 0.822378 Feb 19 20:55:22.642406 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 640/1199] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:21 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1487 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:22.648073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0333f61c-f6a6-43d3-a39a-3d17d5455c71 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:22.649046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0333f61c-f6a6-43d3-a39a-3d17d5455c71 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:22.655733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0333f61c-f6a6-43d3-a39a-3d17d5455c71 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:22.656575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0333f61c-f6a6-43d3-a39a-3d17d5455c71 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:22.657497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0333f61c-f6a6-43d3-a39a-3d17d5455c71 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:22.658146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0333f61c-f6a6-43d3-a39a-3d17d5455c71 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:23.472731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-254b3efa-5eb7-40e7-8354-a018b7327297 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:23.488807 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-254b3efa-5eb7-40e7-8354-a018b7327297 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1313 microversion: 2.1 time: 1.081736 Feb 19 20:55:23.500960 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 560/1200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:22 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:23.507751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2b4154a3-a7e4-4f28-88cf-f1f94951d9e4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:23.508733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2b4154a3-a7e4-4f28-88cf-f1f94951d9e4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:23.545431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2b4154a3-a7e4-4f28-88cf-f1f94951d9e4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:23.546044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2b4154a3-a7e4-4f28-88cf-f1f94951d9e4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:23.547076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2b4154a3-a7e4-4f28-88cf-f1f94951d9e4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:23.547842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2b4154a3-a7e4-4f28-88cf-f1f94951d9e4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:23.686369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2b4154a3-a7e4-4f28-88cf-f1f94951d9e4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:23.699841 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2b4154a3-a7e4-4f28-88cf-f1f94951d9e4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1271 microversion: 2.1 time: 0.196897 Feb 19 20:55:23.706773 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 561/1201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:23 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:23.714216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca85dfc1-5f58-4c21-b0b0-a0b21d09c966 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:23.715258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ca85dfc1-5f58-4c21-b0b0-a0b21d09c966 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:23.726419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca85dfc1-5f58-4c21-b0b0-a0b21d09c966 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:23.727894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca85dfc1-5f58-4c21-b0b0-a0b21d09c966 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:23.729223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca85dfc1-5f58-4c21-b0b0-a0b21d09c966 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:23.730431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca85dfc1-5f58-4c21-b0b0-a0b21d09c966 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:23.842363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0333f61c-f6a6-43d3-a39a-3d17d5455c71 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:23.861551 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0333f61c-f6a6-43d3-a39a-3d17d5455c71 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1319 microversion: 2.1 time: 1.216787 Feb 19 20:55:23.863019 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 641/1202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:22 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1319 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:23.871600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b566cd7-2474-4c18-b526-47462544b7c8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:23.872814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b566cd7-2474-4c18-b526-47462544b7c8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:23.882417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b566cd7-2474-4c18-b526-47462544b7c8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:23.883227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b566cd7-2474-4c18-b526-47462544b7c8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:23.885385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b566cd7-2474-4c18-b526-47462544b7c8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:23.886295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b566cd7-2474-4c18-b526-47462544b7c8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:24.414236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca85dfc1-5f58-4c21-b0b0-a0b21d09c966 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:24.421961 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ca85dfc1-5f58-4c21-b0b0-a0b21d09c966 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.714334 Feb 19 20:55:24.431409 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 562/1203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:23 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:24.436154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-51da94ee-4dda-4b3a-aadd-07392d2bc198 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:24.436798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-51da94ee-4dda-4b3a-aadd-07392d2bc198 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:24.456991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-51da94ee-4dda-4b3a-aadd-07392d2bc198 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:24.458434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-51da94ee-4dda-4b3a-aadd-07392d2bc198 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:24.459501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-51da94ee-4dda-4b3a-aadd-07392d2bc198 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:24.460091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-51da94ee-4dda-4b3a-aadd-07392d2bc198 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:24.772903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4b566cd7-2474-4c18-b526-47462544b7c8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05e321d65ab4c218cebea855d1aad86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a274e94e3e643c4b814892e2429db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:24.782590 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b566cd7-2474-4c18-b526-47462544b7c8 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 200 len: 1540 microversion: 2.1 time: 0.918072 Feb 19 20:55:24.783183 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 642/1204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:23 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 1540 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:24.790158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:24.790860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:24.798278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:24.798707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:24.800015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:24.800662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:24.947934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-51da94ee-4dda-4b3a-aadd-07392d2bc198 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:24.958274 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-51da94ee-4dda-4b3a-aadd-07392d2bc198 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1320 microversion: 2.1 time: 0.525544 Feb 19 20:55:24.959180 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 563/1205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:24 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1320 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:24.965844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-827c8735-916f-4584-862a-57210a398af0 req-fa3e5bec-50aa-496a-b0c8-043319a54666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73f9801-8d11-4cf5-a822-e3692fbb693f", "name": "network-vif-plugged", "status": "completed", "tag": "fb4a12b5-a532-459a-882e-77fe1c128ae4"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:24.967701 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:24.967701 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:24.976306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-827c8735-916f-4584-862a-57210a398af0 req-fa3e5bec-50aa-496a-b0c8-043319a54666 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:24.976991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-827c8735-916f-4584-862a-57210a398af0 req-fa3e5bec-50aa-496a-b0c8-043319a54666 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:24.989564 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-827c8735-916f-4584-862a-57210a398af0 req-fa3e5bec-50aa-496a-b0c8-043319a54666 service nova] Creating event network-vif-plugged:fb4a12b5-a532-459a-882e-77fe1c128ae4 for instance e73f9801-8d11-4cf5-a822-e3692fbb693f on nch1-master-1 Feb 19 20:55:24.995899 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-827c8735-916f-4584-862a-57210a398af0 req-fa3e5bec-50aa-496a-b0c8-043319a54666 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034822 Feb 19 20:55:24.997249 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 564/1206] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:25.006421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1109096f-440f-4e3a-ba93-5780e8e1478d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:25.007384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1109096f-440f-4e3a-ba93-5780e8e1478d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:25.014328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1109096f-440f-4e3a-ba93-5780e8e1478d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.015026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1109096f-440f-4e3a-ba93-5780e8e1478d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.016271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1109096f-440f-4e3a-ba93-5780e8e1478d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.016728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1109096f-440f-4e3a-ba93-5780e8e1478d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.161449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:25.173480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:25.176421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:25.177854 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4434fc2e-5586-4584-9a22-660de9d34893 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1477 microversion: 2.25 time: 0.393530 Feb 19 20:55:25.178744 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 643/1207] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:24 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:25.185297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-26086769-157c-4314-8a90-ac1a9cbfc044 req-e68729cc-bdf2-46d5-86af-59f546cd54c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258092fb-1cd7-47c9-88f4-d92fafb344ef", "name": "network-vif-deleted", "tag": "3c2d56ee-dcf8-4145-a7ce-83aa6441cb22"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:25.187093 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:25.187093 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:25.198593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-26086769-157c-4314-8a90-ac1a9cbfc044 req-e68729cc-bdf2-46d5-86af-59f546cd54c3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.199321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-26086769-157c-4314-8a90-ac1a9cbfc044 req-e68729cc-bdf2-46d5-86af-59f546cd54c3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.218347 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-26086769-157c-4314-8a90-ac1a9cbfc044 req-e68729cc-bdf2-46d5-86af-59f546cd54c3 service nova] Creating event network-vif-deleted:3c2d56ee-dcf8-4145-a7ce-83aa6441cb22 for instance 258092fb-1cd7-47c9-88f4-d92fafb344ef on nch2-master-1 Feb 19 20:55:25.228661 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-26086769-157c-4314-8a90-ac1a9cbfc044 req-e68729cc-bdf2-46d5-86af-59f546cd54c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047310 Feb 19 20:55:25.231486 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 644/1208] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:25.245479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b0b0b1e9-11c5-4c19-a9cc-494639f466af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:25.246246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b0b0b1e9-11c5-4c19-a9cc-494639f466af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:25.255100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0b0b1e9-11c5-4c19-a9cc-494639f466af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.255561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0b0b1e9-11c5-4c19-a9cc-494639f466af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.258474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0b0b1e9-11c5-4c19-a9cc-494639f466af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.259052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0b0b1e9-11c5-4c19-a9cc-494639f466af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.488853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1109096f-440f-4e3a-ba93-5780e8e1478d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:25.498419 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1109096f-440f-4e3a-ba93-5780e8e1478d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1463 microversion: 2.1 time: 0.499825 Feb 19 20:55:25.499052 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 565/1209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:24 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1463 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:25.503966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-838c66ab-b391-4bde-8116-d44d9b67ba42 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:25.504769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-838c66ab-b391-4bde-8116-d44d9b67ba42 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:25.511178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-838c66ab-b391-4bde-8116-d44d9b67ba42 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.511923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-838c66ab-b391-4bde-8116-d44d9b67ba42 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.513043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-838c66ab-b391-4bde-8116-d44d9b67ba42 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.513512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-838c66ab-b391-4bde-8116-d44d9b67ba42 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.656611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b0b0b1e9-11c5-4c19-a9cc-494639f466af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:25.667782 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b0b0b1e9-11c5-4c19-a9cc-494639f466af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1313 microversion: 2.1 time: 0.434692 Feb 19 20:55:25.668598 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 645/1210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:25 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:25.673635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-95bb5883-e6a9-4e32-b9bd-2dc060646b9a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '.version_select at 0x7f6467ab0c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:25.675789 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:25.675789 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:25.677217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95bb5883-e6a9-4e32-b9bd-2dc060646b9a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.677912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95bb5883-e6a9-4e32-b9bd-2dc060646b9a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.691999 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-95bb5883-e6a9-4e32-b9bd-2dc060646b9a tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2961 microversion: 2.25 time: 0.022097 Feb 19 20:55:25.692934 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 646/1211] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Feb 19 20:55:25 2022] GET /compute/v2.1/os-migrations => generated 2961 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:25.705123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cb7eff09-3a40-40f8-ace2-ee12448e4dae tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:25.706108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cb7eff09-3a40-40f8-ace2-ee12448e4dae tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:25.714884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb7eff09-3a40-40f8-ace2-ee12448e4dae tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.715530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb7eff09-3a40-40f8-ace2-ee12448e4dae tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.716658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb7eff09-3a40-40f8-ace2-ee12448e4dae tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.717480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb7eff09-3a40-40f8-ace2-ee12448e4dae tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.944772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-838c66ab-b391-4bde-8116-d44d9b67ba42 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:25.952921 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-838c66ab-b391-4bde-8116-d44d9b67ba42 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1468 microversion: 2.1 time: 0.452565 Feb 19 20:55:25.970215 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 566/1212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:25 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1468 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:25.976606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dafd4c25-8bd0-47e2-abcf-1d521ad695da tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:25.977565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dafd4c25-8bd0-47e2-abcf-1d521ad695da tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:25.989218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dafd4c25-8bd0-47e2-abcf-1d521ad695da tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.990182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dafd4c25-8bd0-47e2-abcf-1d521ad695da tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:25.991062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dafd4c25-8bd0-47e2-abcf-1d521ad695da tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:25.991518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dafd4c25-8bd0-47e2-abcf-1d521ad695da tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.099941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cb7eff09-3a40-40f8-ace2-ee12448e4dae tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:26.110322 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cb7eff09-3a40-40f8-ace2-ee12448e4dae tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.416130 Feb 19 20:55:26.120474 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 647/1213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:25 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:26.120474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-15515753-323f-4eeb-acb6-7ac6974ffbf6 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:26.120474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-15515753-323f-4eeb-acb6-7ac6974ffbf6 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:26.125426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15515753-323f-4eeb-acb6-7ac6974ffbf6 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.126072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15515753-323f-4eeb-acb6-7ac6974ffbf6 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.127008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15515753-323f-4eeb-acb6-7ac6974ffbf6 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.127482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15515753-323f-4eeb-acb6-7ac6974ffbf6 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.312362 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dafd4c25-8bd0-47e2-abcf-1d521ad695da tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1614 microversion: 2.1 time: 0.340800 Feb 19 20:55:26.312976 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 567/1214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:25 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1614 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:26.318739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-556e1a00-0c50-4e2a-b8ae-103f502fb6a7 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:26.319704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-556e1a00-0c50-4e2a-b8ae-103f502fb6a7 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] [instance: 258092fb-1cd7-47c9-88f4-d92fafb344ef] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:26.326879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-556e1a00-0c50-4e2a-b8ae-103f502fb6a7 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.327691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-556e1a00-0c50-4e2a-b8ae-103f502fb6a7 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.328778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-556e1a00-0c50-4e2a-b8ae-103f502fb6a7 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.329707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-556e1a00-0c50-4e2a-b8ae-103f502fb6a7 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.348105 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-556e1a00-0c50-4e2a-b8ae-103f502fb6a7 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] HTTP exception thrown: Instance 258092fb-1cd7-47c9-88f4-d92fafb344ef could not be found. Feb 19 20:55:26.348755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-556e1a00-0c50-4e2a-b8ae-103f502fb6a7 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] Returning 404 to user: Instance 258092fb-1cd7-47c9-88f4-d92fafb344ef could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:26.349859 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-556e1a00-0c50-4e2a-b8ae-103f502fb6a7 tempest-FloatingIPsAssociationNegativeTestJSON-657764517 tempest-FloatingIPsAssociationNegativeTestJSON-657764517-project] 10.222.0.30 "GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef" status: 404 len: 111 microversion: 2.1 time: 0.035706 Feb 19 20:55:26.350611 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 568/1215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:26 2022] GET /compute/v2.1/servers/258092fb-1cd7-47c9-88f4-d92fafb344ef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:55:26.359051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc735934-8dff-4ac0-87ed-bf6471798b7a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:26.359879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc735934-8dff-4ac0-87ed-bf6471798b7a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:26.366647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc735934-8dff-4ac0-87ed-bf6471798b7a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.368276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc735934-8dff-4ac0-87ed-bf6471798b7a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.369445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc735934-8dff-4ac0-87ed-bf6471798b7a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.370282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc735934-8dff-4ac0-87ed-bf6471798b7a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.489328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-15515753-323f-4eeb-acb6-7ac6974ffbf6 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] Lazy-loading 'services' on Instance uuid 016b6ece-713e-4a2d-ba16-6de26f2479cb {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:55:26.509197 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-15515753-323f-4eeb-acb6-7ac6974ffbf6 tempest-LiveAutoBlockMigrationV225Test-579170983 tempest-LiveAutoBlockMigrationV225Test-579170983-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1970 microversion: 2.25 time: 0.396973 Feb 19 20:55:26.509868 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 648/1216] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:26 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1970 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:26.529425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0cc4c112-a013-4be5-ad55-1641bca1ecd4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:26.530377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0cc4c112-a013-4be5-ad55-1641bca1ecd4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:26.537375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cc4c112-a013-4be5-ad55-1641bca1ecd4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.538157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cc4c112-a013-4be5-ad55-1641bca1ecd4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.538945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cc4c112-a013-4be5-ad55-1641bca1ecd4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.539381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cc4c112-a013-4be5-ad55-1641bca1ecd4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.767385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc735934-8dff-4ac0-87ed-bf6471798b7a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:26.775666 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc735934-8dff-4ac0-87ed-bf6471798b7a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1319 microversion: 2.1 time: 0.423758 Feb 19 20:55:26.776573 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 569/1217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:26 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:26.781655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:26.782442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:26.788993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.789711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.790756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.791393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.827003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '168c8aa254304f4097c3a3c75e3e423a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407c70643b364ed8a2371acba506a19f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:26.828130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] flavor_id is None. Assuming migration. {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4073}} Feb 19 20:55:26.828596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 20:55:26.978078 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-84db1833-c5fe-425b-aff6-6c6851367f75 tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a/action" status: 202 len: 0 microversion: 2.1 time: 0.199908 Feb 19 20:55:26.980136 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 570/1218] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:55:26 2022] POST /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:55:26.987495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:26.988573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:26.996061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.997394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:26.997921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:26.998843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:27.029227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:55:27.163440 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-961ce8fd-cf5d-4dea-acfb-53d3f79aee64 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "DELETE /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 204 len: 0 microversion: 2.25 time: 0.180604 Feb 19 20:55:27.163440 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 571/1219] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:55:26 2022] DELETE /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:55:27.170266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-02bcac34-c3db-4ce5-83a8-59c4f8e8c4b8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:27.171197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-02bcac34-c3db-4ce5-83a8-59c4f8e8c4b8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:27.185253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02bcac34-c3db-4ce5-83a8-59c4f8e8c4b8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:27.185819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02bcac34-c3db-4ce5-83a8-59c4f8e8c4b8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:27.186722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02bcac34-c3db-4ce5-83a8-59c4f8e8c4b8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:27.187156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02bcac34-c3db-4ce5-83a8-59c4f8e8c4b8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:27.260092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0cc4c112-a013-4be5-ad55-1641bca1ecd4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:27.267536 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0cc4c112-a013-4be5-ad55-1641bca1ecd4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1320 microversion: 2.1 time: 0.744462 Feb 19 20:55:27.280501 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 649/1220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:26 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1320 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:27.285894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e62fdedd-f896-4cc1-9d5f-7eae65f9d9c5 req-32cd209b-dd4a-4bb0-810a-64278e2fe051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5ff470-fc3c-4ef2-8811-930620cc10f8", "tag": "dd609551-9c3b-4d51-ab65-39dd0fa6d3ba"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:27.287384 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:27.287384 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:27.300534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e62fdedd-f896-4cc1-9d5f-7eae65f9d9c5 req-32cd209b-dd4a-4bb0-810a-64278e2fe051 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:27.300983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e62fdedd-f896-4cc1-9d5f-7eae65f9d9c5 req-32cd209b-dd4a-4bb0-810a-64278e2fe051 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:27.319033 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e62fdedd-f896-4cc1-9d5f-7eae65f9d9c5 req-32cd209b-dd4a-4bb0-810a-64278e2fe051 service nova] Creating event network-changed:dd609551-9c3b-4d51-ab65-39dd0fa6d3ba for instance 7e5ff470-fc3c-4ef2-8811-930620cc10f8 on nch1-master-1 Feb 19 20:55:27.324056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e62fdedd-f896-4cc1-9d5f-7eae65f9d9c5 req-32cd209b-dd4a-4bb0-810a-64278e2fe051 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042253 Feb 19 20:55:27.325304 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 650/1221] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:27.330437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c2a21193-ebdb-4305-a372-b99537789dec tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:27.331977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c2a21193-ebdb-4305-a372-b99537789dec tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:27.339922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2a21193-ebdb-4305-a372-b99537789dec tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:27.340846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2a21193-ebdb-4305-a372-b99537789dec tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:27.342614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2a21193-ebdb-4305-a372-b99537789dec tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:27.343284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2a21193-ebdb-4305-a372-b99537789dec tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:27.609556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-02bcac34-c3db-4ce5-83a8-59c4f8e8c4b8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:27.618810 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-02bcac34-c3db-4ce5-83a8-59c4f8e8c4b8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1313 microversion: 2.1 time: 0.454115 Feb 19 20:55:27.623822 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 572/1222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:27 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:27.637555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-da1aa6c8-7f95-48d9-a87e-f47b1ab0628b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:27.638906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-da1aa6c8-7f95-48d9-a87e-f47b1ab0628b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:27.650996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da1aa6c8-7f95-48d9-a87e-f47b1ab0628b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:27.651918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da1aa6c8-7f95-48d9-a87e-f47b1ab0628b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:27.653390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da1aa6c8-7f95-48d9-a87e-f47b1ab0628b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:27.654061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da1aa6c8-7f95-48d9-a87e-f47b1ab0628b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:27.769221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c2a21193-ebdb-4305-a372-b99537789dec tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:27.782625 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c2a21193-ebdb-4305-a372-b99537789dec tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1472 microversion: 2.1 time: 0.455849 Feb 19 20:55:27.783646 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 651/1223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:27 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:27.792953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:27.793851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:27.801322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:27.802132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:27.803282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:27.804188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:28.262218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da1aa6c8-7f95-48d9-a87e-f47b1ab0628b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:28.274714 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-da1aa6c8-7f95-48d9-a87e-f47b1ab0628b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.648878 Feb 19 20:55:28.286553 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 573/1224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:27 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:28.291658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a672896b-06fd-45d5-b9ce-2bb1a81e809a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:28.292688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a672896b-06fd-45d5-b9ce-2bb1a81e809a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:28.293537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:28.301735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a672896b-06fd-45d5-b9ce-2bb1a81e809a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:28.302484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a672896b-06fd-45d5-b9ce-2bb1a81e809a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:28.303505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a672896b-06fd-45d5-b9ce-2bb1a81e809a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:28.304428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a672896b-06fd-45d5-b9ce-2bb1a81e809a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:28.321552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:28.323009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:28.324177 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e50f1ddc-8320-4e6b-9661-a2238c0b3a54 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1483 microversion: 2.25 time: 0.538698 Feb 19 20:55:28.335098 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 652/1225] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:27 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1483 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:28.335098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-359cab61-2440-4ea6-a993-eb3f24641984 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:28.335098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-359cab61-2440-4ea6-a993-eb3f24641984 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:28.349723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-359cab61-2440-4ea6-a993-eb3f24641984 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:28.351001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-359cab61-2440-4ea6-a993-eb3f24641984 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:28.353957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-359cab61-2440-4ea6-a993-eb3f24641984 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:28.355027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-359cab61-2440-4ea6-a993-eb3f24641984 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:28.755951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a672896b-06fd-45d5-b9ce-2bb1a81e809a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:28.773298 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a672896b-06fd-45d5-b9ce-2bb1a81e809a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1319 microversion: 2.1 time: 0.484788 Feb 19 20:55:28.774254 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 574/1226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:28 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:28.802716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-406f550e-3af6-4675-8489-78e19cf2146f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:28.804187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-406f550e-3af6-4675-8489-78e19cf2146f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:28.822648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-406f550e-3af6-4675-8489-78e19cf2146f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:28.823976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-406f550e-3af6-4675-8489-78e19cf2146f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:28.827282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-406f550e-3af6-4675-8489-78e19cf2146f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:28.827913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-406f550e-3af6-4675-8489-78e19cf2146f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:28.895450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-359cab61-2440-4ea6-a993-eb3f24641984 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:28.904322 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-359cab61-2440-4ea6-a993-eb3f24641984 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1470 microversion: 2.1 time: 0.578193 Feb 19 20:55:28.916710 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 653/1227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:28 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1470 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:28.923787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3e360299-2d2e-4379-8441-c9a4db79f8cd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:28.924728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3e360299-2d2e-4379-8441-c9a4db79f8cd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:28.935912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e360299-2d2e-4379-8441-c9a4db79f8cd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:28.936435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e360299-2d2e-4379-8441-c9a4db79f8cd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:28.937184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e360299-2d2e-4379-8441-c9a4db79f8cd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:28.937620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e360299-2d2e-4379-8441-c9a4db79f8cd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.394863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-406f550e-3af6-4675-8489-78e19cf2146f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:29.403456 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-406f550e-3af6-4675-8489-78e19cf2146f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1313 microversion: 2.1 time: 0.618312 Feb 19 20:55:29.404749 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 575/1228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:28 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:29.410099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-faef9d3d-51fa-4df2-aaae-fb683ac06c19 tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:29.411156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-faef9d3d-51fa-4df2-aaae-fb683ac06c19 tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:29.417204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-faef9d3d-51fa-4df2-aaae-fb683ac06c19 tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:29.418642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-faef9d3d-51fa-4df2-aaae-fb683ac06c19 tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.419524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-faef9d3d-51fa-4df2-aaae-fb683ac06c19 tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:29.420045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-faef9d3d-51fa-4df2-aaae-fb683ac06c19 tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.466632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3e360299-2d2e-4379-8441-c9a4db79f8cd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:29.478766 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3e360299-2d2e-4379-8441-c9a4db79f8cd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1472 microversion: 2.1 time: 0.560587 Feb 19 20:55:29.480855 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 654/1229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:28 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1472 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:29.486060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-529b20a7-06c6-4471-b37f-cb2f2ec3af6d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:29.488374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-529b20a7-06c6-4471-b37f-cb2f2ec3af6d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:29.497349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-529b20a7-06c6-4471-b37f-cb2f2ec3af6d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:29.498236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-529b20a7-06c6-4471-b37f-cb2f2ec3af6d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.499047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-529b20a7-06c6-4471-b37f-cb2f2ec3af6d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:29.499468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-529b20a7-06c6-4471-b37f-cb2f2ec3af6d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.529942 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-faef9d3d-51fa-4df2-aaae-fb683ac06c19 tempest-DeleteServersAdminTestJSON-442226615 tempest-DeleteServersAdminTestJSON-442226615-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f/action" status: 202 len: 0 microversion: 2.1 time: 0.123300 Feb 19 20:55:29.531583 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 576/1230] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:55:29 2022] POST /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:55:29.540545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:29.541585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:29.550816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:29.551353 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.552795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:29.553495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.781215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:29.791592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:29.794112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:29.795900 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e13168e8-df49-4c6b-aff6-95daf419dba3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 200 len: 1441 microversion: 2.25 time: 0.263030 Feb 19 20:55:29.796869 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 577/1231] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:29 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 1441 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:29.801935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:29.802812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:29.813683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:29.814134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.818333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:29.818988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.861758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:29.862495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:29.863140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lazy-loading 'fault' on Instance uuid e73f9801-8d11-4cf5-a822-e3692fbb693f {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:55:30.067642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-529b20a7-06c6-4471-b37f-cb2f2ec3af6d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:30.076491 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-529b20a7-06c6-4471-b37f-cb2f2ec3af6d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.594314 Feb 19 20:55:30.092812 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 655/1232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:29 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:30.109926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0b3dc02a-8664-4418-b938-b8cb59014307 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:30.111957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0b3dc02a-8664-4418-b938-b8cb59014307 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:30.119341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b3dc02a-8664-4418-b938-b8cb59014307 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.120060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b3dc02a-8664-4418-b938-b8cb59014307 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.121155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b3dc02a-8664-4418-b938-b8cb59014307 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.121611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b3dc02a-8664-4418-b938-b8cb59014307 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.129381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:30.137718 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cbd89d5d-2372-4f95-9ed5-6a7cae3a9fe3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1453 microversion: 2.1 time: 0.339653 Feb 19 20:55:30.139439 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 578/1233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:29 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1453 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:30.156413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-90bf0cd3-d43d-4b54-b421-8c0bb9c10b18 req-e428771e-d94a-4dc1-ba7c-ef450869c021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016b6ece-713e-4a2d-ba16-6de26f2479cb", "name": "network-vif-deleted", "tag": "8a66314a-6be0-4ed3-85c0-e29d46b221c9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:30.159609 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:30.159609 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:30.169268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-90bf0cd3-d43d-4b54-b421-8c0bb9c10b18 req-e428771e-d94a-4dc1-ba7c-ef450869c021 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.170015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-90bf0cd3-d43d-4b54-b421-8c0bb9c10b18 req-e428771e-d94a-4dc1-ba7c-ef450869c021 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.183429 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-90bf0cd3-d43d-4b54-b421-8c0bb9c10b18 req-e428771e-d94a-4dc1-ba7c-ef450869c021 service nova] Creating event network-vif-deleted:8a66314a-6be0-4ed3-85c0-e29d46b221c9 for instance 016b6ece-713e-4a2d-ba16-6de26f2479cb on nch2-master-1 Feb 19 20:55:30.188770 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-90bf0cd3-d43d-4b54-b421-8c0bb9c10b18 req-e428771e-d94a-4dc1-ba7c-ef450869c021 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047877 Feb 19 20:55:30.189993 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 579/1234] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:30.197572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a8c2a4b-3af1-476c-bfe1-d0cafe8f666e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:30.198581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1a8c2a4b-3af1-476c-bfe1-d0cafe8f666e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:30.207914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a8c2a4b-3af1-476c-bfe1-d0cafe8f666e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.208741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a8c2a4b-3af1-476c-bfe1-d0cafe8f666e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.209630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a8c2a4b-3af1-476c-bfe1-d0cafe8f666e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.210147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a8c2a4b-3af1-476c-bfe1-d0cafe8f666e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.290030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1a8c2a4b-3af1-476c-bfe1-d0cafe8f666e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:55:30.334799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0b3dc02a-8664-4418-b938-b8cb59014307 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:30.350408 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0b3dc02a-8664-4418-b938-b8cb59014307 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1319 microversion: 2.1 time: 0.255403 Feb 19 20:55:30.367820 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 656/1235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:30 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:30.421927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c1372586-bcf7-4ced-8ac1-744bd54e15bf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:30.422492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c1372586-bcf7-4ced-8ac1-744bd54e15bf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:30.431172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1372586-bcf7-4ced-8ac1-744bd54e15bf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.431956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1372586-bcf7-4ced-8ac1-744bd54e15bf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.432818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1372586-bcf7-4ced-8ac1-744bd54e15bf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.433810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1372586-bcf7-4ced-8ac1-744bd54e15bf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.459687 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1a8c2a4b-3af1-476c-bfe1-d0cafe8f666e tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 204 len: 0 microversion: 2.1 time: 0.267822 Feb 19 20:55:30.464635 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 580/1236] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:55:30 2022] DELETE /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:55:30.471127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:30.472939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:30.486669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.489384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.490908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.504022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.551062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.551519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.551996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lazy-loading 'fault' on Instance uuid e73f9801-8d11-4cf5-a822-e3692fbb693f {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:55:30.734132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c1372586-bcf7-4ced-8ac1-744bd54e15bf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:30.742911 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c1372586-bcf7-4ced-8ac1-744bd54e15bf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1313 microversion: 2.1 time: 0.325040 Feb 19 20:55:30.753733 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 657/1237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:30 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:55:30.761564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2922cb07-e196-4c89-b193-7c983897315c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:30.762603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2922cb07-e196-4c89-b193-7c983897315c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:30.782588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2922cb07-e196-4c89-b193-7c983897315c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.783446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2922cb07-e196-4c89-b193-7c983897315c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:30.785236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2922cb07-e196-4c89-b193-7c983897315c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:30.785851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2922cb07-e196-4c89-b193-7c983897315c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:31.034586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:31.046681 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fcb3a673-11d7-429b-aeb6-2b7a02d8edec tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1459 microversion: 2.1 time: 0.580213 Feb 19 20:55:31.047438 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 581/1238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:30 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1459 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:31.053445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0b9db5ce-7e82-4c71-9083-fb908f44bcb4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:31.054467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0b9db5ce-7e82-4c71-9083-fb908f44bcb4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 016b6ece-713e-4a2d-ba16-6de26f2479cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:31.064573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b9db5ce-7e82-4c71-9083-fb908f44bcb4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:31.065557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b9db5ce-7e82-4c71-9083-fb908f44bcb4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:31.066387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b9db5ce-7e82-4c71-9083-fb908f44bcb4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:31.066809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b9db5ce-7e82-4c71-9083-fb908f44bcb4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:31.083904 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-0b9db5ce-7e82-4c71-9083-fb908f44bcb4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] HTTP exception thrown: Instance 016b6ece-713e-4a2d-ba16-6de26f2479cb could not be found. Feb 19 20:55:31.084730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0b9db5ce-7e82-4c71-9083-fb908f44bcb4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Returning 404 to user: Instance 016b6ece-713e-4a2d-ba16-6de26f2479cb could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:31.086157 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0b9db5ce-7e82-4c71-9083-fb908f44bcb4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb" status: 404 len: 111 microversion: 2.25 time: 0.037513 Feb 19 20:55:31.090001 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 582/1239] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:31 2022] GET /compute/v2.1/servers/016b6ece-713e-4a2d-ba16-6de26f2479cb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:55:31.097932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-03fd7caa-7f60-469b-aef8-b2605ff782da tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:31.098708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-03fd7caa-7f60-469b-aef8-b2605ff782da tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:31.106293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03fd7caa-7f60-469b-aef8-b2605ff782da tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:31.106758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03fd7caa-7f60-469b-aef8-b2605ff782da tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:31.107570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03fd7caa-7f60-469b-aef8-b2605ff782da tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:31.108014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03fd7caa-7f60-469b-aef8-b2605ff782da tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:31.144813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2922cb07-e196-4c89-b193-7c983897315c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:31.155944 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2922cb07-e196-4c89-b193-7c983897315c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1472 microversion: 2.1 time: 0.408158 Feb 19 20:55:31.157469 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 658/1240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:30 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:31.368655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a1410963-342e-459a-8a78-00d8085d6c62 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:31.369590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a1410963-342e-459a-8a78-00d8085d6c62 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:31.378791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1410963-342e-459a-8a78-00d8085d6c62 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:31.379503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1410963-342e-459a-8a78-00d8085d6c62 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:31.379914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-03fd7caa-7f60-469b-aef8-b2605ff782da tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:31.380741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1410963-342e-459a-8a78-00d8085d6c62 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:31.381513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1410963-342e-459a-8a78-00d8085d6c62 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:31.392059 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-03fd7caa-7f60-469b-aef8-b2605ff782da tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.298983 Feb 19 20:55:31.393479 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 583/1241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:31 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:31.601609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a33a8771-1999-472c-bca3-8be3d0fc1986 req-782744f4-ffb4-4668-af2e-29142db1313b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688a015d-1d10-44c7-b358-4d2cbe080bc2", "name": "network-vif-plugged", "status": "completed", "tag": "77f19c96-0ed8-4178-b8cb-e6bc2c9ea499"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:31.604512 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:31.604512 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:31.614516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a33a8771-1999-472c-bca3-8be3d0fc1986 req-782744f4-ffb4-4668-af2e-29142db1313b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:31.615682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a33a8771-1999-472c-bca3-8be3d0fc1986 req-782744f4-ffb4-4668-af2e-29142db1313b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:31.636163 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a33a8771-1999-472c-bca3-8be3d0fc1986 req-782744f4-ffb4-4668-af2e-29142db1313b service nova] Creating event network-vif-plugged:77f19c96-0ed8-4178-b8cb-e6bc2c9ea499 for instance 688a015d-1d10-44c7-b358-4d2cbe080bc2 on nch2-master-1 Feb 19 20:55:31.643911 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a33a8771-1999-472c-bca3-8be3d0fc1986 req-782744f4-ffb4-4668-af2e-29142db1313b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046460 Feb 19 20:55:31.645214 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 584/1242] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:31.673637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a1410963-342e-459a-8a78-00d8085d6c62 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:31.682654 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a1410963-342e-459a-8a78-00d8085d6c62 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1319 microversion: 2.1 time: 0.318280 Feb 19 20:55:31.696015 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 659/1243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:31 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:55:31.763905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ef44704f-081e-43fc-ac32-bdddec956d6e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:31.765665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ef44704f-081e-43fc-ac32-bdddec956d6e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:31.778840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef44704f-081e-43fc-ac32-bdddec956d6e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:31.786795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef44704f-081e-43fc-ac32-bdddec956d6e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:31.788651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef44704f-081e-43fc-ac32-bdddec956d6e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:31.790151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef44704f-081e-43fc-ac32-bdddec956d6e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:32.046808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ef44704f-081e-43fc-ac32-bdddec956d6e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:32.057695 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ef44704f-081e-43fc-ac32-bdddec956d6e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1313 microversion: 2.1 time: 0.300084 Feb 19 20:55:32.058366 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 585/1244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:31 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:32.073183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:32.074905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:32.084062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:32.084579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:32.086141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:32.086780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:32.133586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:32.134749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:32.135250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lazy-loading 'fault' on Instance uuid e73f9801-8d11-4cf5-a822-e3692fbb693f {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:55:32.177022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06624b39-00d5-499a-8328-dc6a309f2a01 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:32.180360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06624b39-00d5-499a-8328-dc6a309f2a01 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:32.196480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06624b39-00d5-499a-8328-dc6a309f2a01 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:32.197510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06624b39-00d5-499a-8328-dc6a309f2a01 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:32.201142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06624b39-00d5-499a-8328-dc6a309f2a01 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:32.201656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06624b39-00d5-499a-8328-dc6a309f2a01 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:32.803200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:32.817895 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-478cbb45-9bbd-4a08-9492-7cda483a205c tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1459 microversion: 2.1 time: 0.749138 Feb 19 20:55:32.819283 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 660/1245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:32 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1459 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:32.824121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5fc0f714-f64d-41d4-b8d2-d06f5091f961 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:32.825782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5fc0f714-f64d-41d4-b8d2-d06f5091f961 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:32.835545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fc0f714-f64d-41d4-b8d2-d06f5091f961 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:32.836388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fc0f714-f64d-41d4-b8d2-d06f5091f961 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:32.837531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fc0f714-f64d-41d4-b8d2-d06f5091f961 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:32.838162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fc0f714-f64d-41d4-b8d2-d06f5091f961 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:32.925550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-06624b39-00d5-499a-8328-dc6a309f2a01 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:32.934726 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06624b39-00d5-499a-8328-dc6a309f2a01 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.762829 Feb 19 20:55:32.935792 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 586/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:32 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:32.940883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ec161c3c-020c-4941-8a6e-c39b2e26c696 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:32.942005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ec161c3c-020c-4941-8a6e-c39b2e26c696 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:32.949459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec161c3c-020c-4941-8a6e-c39b2e26c696 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:32.950239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec161c3c-020c-4941-8a6e-c39b2e26c696 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:32.951234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec161c3c-020c-4941-8a6e-c39b2e26c696 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:32.951856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec161c3c-020c-4941-8a6e-c39b2e26c696 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.157089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5fc0f714-f64d-41d4-b8d2-d06f5091f961 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:33.172188 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5fc0f714-f64d-41d4-b8d2-d06f5091f961 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.351292 Feb 19 20:55:33.173983 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 661/1247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:32 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:33.178635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-11c63606-6f44-4c8a-95e4-34a64b5e2db1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:33.179321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-11c63606-6f44-4c8a-95e4-34a64b5e2db1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:33.186291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11c63606-6f44-4c8a-95e4-34a64b5e2db1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.187193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11c63606-6f44-4c8a-95e4-34a64b5e2db1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.188500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11c63606-6f44-4c8a-95e4-34a64b5e2db1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.189156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11c63606-6f44-4c8a-95e4-34a64b5e2db1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.306704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ec161c3c-020c-4941-8a6e-c39b2e26c696 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:33.318635 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ec161c3c-020c-4941-8a6e-c39b2e26c696 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1319 microversion: 2.1 time: 0.381500 Feb 19 20:55:33.335634 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 587/1248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:32 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:33.341658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d02f142c-3d76-49fa-9480-f59b497455dd req-2fe7bb75-be41-4062-ad06-e11a8a97f20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73f9801-8d11-4cf5-a822-e3692fbb693f", "name": "network-vif-deleted", "tag": "fb4a12b5-a532-459a-882e-77fe1c128ae4"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:33.343678 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:33.343678 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:33.351975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d02f142c-3d76-49fa-9480-f59b497455dd req-2fe7bb75-be41-4062-ad06-e11a8a97f20c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.352723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d02f142c-3d76-49fa-9480-f59b497455dd req-2fe7bb75-be41-4062-ad06-e11a8a97f20c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.367712 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d02f142c-3d76-49fa-9480-f59b497455dd req-2fe7bb75-be41-4062-ad06-e11a8a97f20c service nova] Creating event network-vif-deleted:fb4a12b5-a532-459a-882e-77fe1c128ae4 for instance e73f9801-8d11-4cf5-a822-e3692fbb693f on nch1-master-1 Feb 19 20:55:33.376501 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d02f142c-3d76-49fa-9480-f59b497455dd req-2fe7bb75-be41-4062-ad06-e11a8a97f20c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038068 Feb 19 20:55:33.379488 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 588/1249] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:33.409071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11c63606-6f44-4c8a-95e4-34a64b5e2db1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:33.420256 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-11c63606-6f44-4c8a-95e4-34a64b5e2db1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1313 microversion: 2.1 time: 0.244947 Feb 19 20:55:33.422490 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 662/1250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:33 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:33.465687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b2bf060e-b0de-40fa-a6f4-7bb8b3c0b0c3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:33.466568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b2bf060e-b0de-40fa-a6f4-7bb8b3c0b0c3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:33.473935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2bf060e-b0de-40fa-a6f4-7bb8b3c0b0c3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.474393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2bf060e-b0de-40fa-a6f4-7bb8b3c0b0c3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.475593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2bf060e-b0de-40fa-a6f4-7bb8b3c0b0c3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.476171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2bf060e-b0de-40fa-a6f4-7bb8b3c0b0c3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.510687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b2bf060e-b0de-40fa-a6f4-7bb8b3c0b0c3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:55:33.622732 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b2bf060e-b0de-40fa-a6f4-7bb8b3c0b0c3 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 204 len: 0 microversion: 2.25 time: 0.162464 Feb 19 20:55:33.624705 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 589/1251] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:55:33 2022] DELETE /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:55:33.633591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:33.634458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:33.644702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.646058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.647007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.647765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.776582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a6bc6b59-d1f0-4069-809e-ad1295c75557 req-19dada33-cb14-4a58-af55-02a811e1740a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5ff470-fc3c-4ef2-8811-930620cc10f8", "name": "network-vif-plugged", "status": "completed", "tag": "dd609551-9c3b-4d51-ab65-39dd0fa6d3ba"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:33.780800 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:33.780800 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:33.790459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a6bc6b59-d1f0-4069-809e-ad1295c75557 req-19dada33-cb14-4a58-af55-02a811e1740a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.791302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a6bc6b59-d1f0-4069-809e-ad1295c75557 req-19dada33-cb14-4a58-af55-02a811e1740a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.805243 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a6bc6b59-d1f0-4069-809e-ad1295c75557 req-19dada33-cb14-4a58-af55-02a811e1740a service nova] Creating event network-vif-plugged:dd609551-9c3b-4d51-ab65-39dd0fa6d3ba for instance 7e5ff470-fc3c-4ef2-8811-930620cc10f8 on nch1-master-1 Feb 19 20:55:33.811838 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a6bc6b59-d1f0-4069-809e-ad1295c75557 req-19dada33-cb14-4a58-af55-02a811e1740a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057257 Feb 19 20:55:33.812474 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 590/1252] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:33.838941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:33.840860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:33.851516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.852865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.853931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.854780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.902517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.903206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.903975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lazy-loading 'fault' on Instance uuid e73f9801-8d11-4cf5-a822-e3692fbb693f {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:55:33.908809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:33.932314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:33.934532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:33.936639 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f41fff38-cfff-4ec8-8631-57fdfb9fb110 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1564 microversion: 2.25 time: 0.306810 Feb 19 20:55:33.938037 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 663/1253] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:33 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1564 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:33.956007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7f1bdb36-925e-4b52-a802-c3a855c2f53f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:33.957827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7f1bdb36-925e-4b52-a802-c3a855c2f53f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:33.964596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a0cb931aa4bcd8c4b4d95c387fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756e52c91ebf4bc9bacebcc1431abb28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:33.966124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f1bdb36-925e-4b52-a802-c3a855c2f53f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.966741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f1bdb36-925e-4b52-a802-c3a855c2f53f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.968266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f1bdb36-925e-4b52-a802-c3a855c2f53f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:33.968929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f1bdb36-925e-4b52-a802-c3a855c2f53f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:33.984764 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-26318337-9684-4f9b-9836-e670beac18b0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 200 len: 1310 microversion: 2.1 time: 0.150739 Feb 19 20:55:33.985555 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 591/1254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:33 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 1310 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:55:34.194377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f30541ba-e3b3-4c82-a505-0958b0622032 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:34.195410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f30541ba-e3b3-4c82-a505-0958b0622032 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:34.208386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f30541ba-e3b3-4c82-a505-0958b0622032 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:34.209162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f30541ba-e3b3-4c82-a505-0958b0622032 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:34.210157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f30541ba-e3b3-4c82-a505-0958b0622032 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:34.210755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f30541ba-e3b3-4c82-a505-0958b0622032 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:34.458024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7f1bdb36-925e-4b52-a802-c3a855c2f53f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:34.465450 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7f1bdb36-925e-4b52-a802-c3a855c2f53f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.515836 Feb 19 20:55:34.465955 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 664/1255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:33 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:34.470472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-941faf64-32e1-4f5c-b598-609f8f88530a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:34.471024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-941faf64-32e1-4f5c-b598-609f8f88530a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:34.477992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-941faf64-32e1-4f5c-b598-609f8f88530a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:34.478495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-941faf64-32e1-4f5c-b598-609f8f88530a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:34.479393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-941faf64-32e1-4f5c-b598-609f8f88530a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:34.480020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-941faf64-32e1-4f5c-b598-609f8f88530a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:34.681444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f30541ba-e3b3-4c82-a505-0958b0622032 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:34.689801 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f30541ba-e3b3-4c82-a505-0958b0622032 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.502715 Feb 19 20:55:34.690504 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 592/1256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:34 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:34.695294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d5af4c65-f629-4003-a59c-abb45cdaa4a0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:34.708204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d5af4c65-f629-4003-a59c-abb45cdaa4a0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:34.714301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5af4c65-f629-4003-a59c-abb45cdaa4a0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:34.714856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5af4c65-f629-4003-a59c-abb45cdaa4a0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:34.715760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5af4c65-f629-4003-a59c-abb45cdaa4a0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:34.716209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5af4c65-f629-4003-a59c-abb45cdaa4a0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:34.863377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-941faf64-32e1-4f5c-b598-609f8f88530a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:34.873914 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-941faf64-32e1-4f5c-b598-609f8f88530a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1469 microversion: 2.1 time: 0.406937 Feb 19 20:55:34.874756 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 665/1257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:34 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1469 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:34.900046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:34.904673 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:34.904673 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:34.908116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:34.909737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Searching by: {'reservation_id': 'r-i2u45h9i', 'deleted': False, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:55:34.919462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:34.920762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:34.922519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:34.925483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.033634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d5af4c65-f629-4003-a59c-abb45cdaa4a0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:35.042089 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d5af4c65-f629-4003-a59c-abb45cdaa4a0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1313 microversion: 2.1 time: 0.350337 Feb 19 20:55:35.043071 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 593/1258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:34 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:35.047733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:35.048575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:35.060857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.061972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.062898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.063453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.116087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:55:35.212236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:35.220793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.222067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.331332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:35.344438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:35.350634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:35.353148 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fb7a2827-f279-4035-b8ca-9c1813932e7c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 200 len: 1564 microversion: 2.25 time: 0.308280 Feb 19 20:55:35.354290 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 594/1259] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:35 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 1564 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:35.362693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fdc3f528-6355-40bc-a0cf-be7891d230e3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:35.363893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fdc3f528-6355-40bc-a0cf-be7891d230e3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:35.372485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdc3f528-6355-40bc-a0cf-be7891d230e3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.373252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdc3f528-6355-40bc-a0cf-be7891d230e3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.374611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdc3f528-6355-40bc-a0cf-be7891d230e3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.375323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdc3f528-6355-40bc-a0cf-be7891d230e3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.394421 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-fdc3f528-6355-40bc-a0cf-be7891d230e3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] HTTP exception thrown: Instance e73f9801-8d11-4cf5-a822-e3692fbb693f could not be found. Feb 19 20:55:35.395281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fdc3f528-6355-40bc-a0cf-be7891d230e3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Returning 404 to user: Instance e73f9801-8d11-4cf5-a822-e3692fbb693f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:35.396480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fdc3f528-6355-40bc-a0cf-be7891d230e3 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 404 len: 111 microversion: 2.1 time: 0.041060 Feb 19 20:55:35.403951 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 595/1260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:35 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:55:35.411276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1bcf870b-9258-4070-b9ec-25ec0db18fd0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:35.411963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1bcf870b-9258-4070-b9ec-25ec0db18fd0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:35.421808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1bcf870b-9258-4070-b9ec-25ec0db18fd0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.423735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1bcf870b-9258-4070-b9ec-25ec0db18fd0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.426148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1bcf870b-9258-4070-b9ec-25ec0db18fd0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.426814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1bcf870b-9258-4070-b9ec-25ec0db18fd0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.450899 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-1bcf870b-9258-4070-b9ec-25ec0db18fd0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] HTTP exception thrown: Instance e73f9801-8d11-4cf5-a822-e3692fbb693f could not be found. Feb 19 20:55:35.453587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1bcf870b-9258-4070-b9ec-25ec0db18fd0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Returning 404 to user: Instance e73f9801-8d11-4cf5-a822-e3692fbb693f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:35.457433 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1bcf870b-9258-4070-b9ec-25ec0db18fd0 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 404 len: 111 microversion: 2.1 time: 0.052139 Feb 19 20:55:35.460282 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 596/1261] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:55:35 2022] DELETE /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:55:35.479028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b31cbe42-36af-42f3-b932-6904afc9e24f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:35.479028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b31cbe42-36af-42f3-b932-6904afc9e24f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: e73f9801-8d11-4cf5-a822-e3692fbb693f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:35.492145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b31cbe42-36af-42f3-b932-6904afc9e24f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.493326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b31cbe42-36af-42f3-b932-6904afc9e24f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.494360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b31cbe42-36af-42f3-b932-6904afc9e24f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.495174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b31cbe42-36af-42f3-b932-6904afc9e24f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.549119 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-b31cbe42-36af-42f3-b932-6904afc9e24f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] HTTP exception thrown: Instance e73f9801-8d11-4cf5-a822-e3692fbb693f could not be found. Feb 19 20:55:35.550804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b31cbe42-36af-42f3-b932-6904afc9e24f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Returning 404 to user: Instance e73f9801-8d11-4cf5-a822-e3692fbb693f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:35.552174 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b31cbe42-36af-42f3-b932-6904afc9e24f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f" status: 404 len: 111 microversion: 2.1 time: 0.081005 Feb 19 20:55:35.556488 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6a6e7092-abe2-434d-9808-a8a7cff066b3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-i2u45h9i" status: 200 len: 2930 microversion: 2.1 time: 0.668267 Feb 19 20:55:35.557568 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 666/1263] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Feb 19 20:55:34 2022] GET /compute/v2.1/servers/detail?reservation_id=r-i2u45h9i => generated 2930 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:35.570319 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 597/1263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:35 2022] GET /compute/v2.1/servers/e73f9801-8d11-4cf5-a822-e3692fbb693f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:55:35.570319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b0085962-3d58-49f3-a429-ebd5d7b8c035 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:35.570319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b0085962-3d58-49f3-a429-ebd5d7b8c035 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:35.572410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0085962-3d58-49f3-a429-ebd5d7b8c035 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.573743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0085962-3d58-49f3-a429-ebd5d7b8c035 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.575313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0085962-3d58-49f3-a429-ebd5d7b8c035 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.576127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0085962-3d58-49f3-a429-ebd5d7b8c035 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.839392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-870307a7-2577-4b74-9645-9fe51504723f req-dc737fd1-460a-48b3-8df9-a6555a761829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa53378c-0deb-40cc-a2a5-bc55778f6146", "name": "network-vif-deleted", "tag": "a926fff0-c109-4640-adbe-9f6dd047f15f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:35.841725 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:35.841725 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:35.850772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-870307a7-2577-4b74-9645-9fe51504723f req-dc737fd1-460a-48b3-8df9-a6555a761829 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.851297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-870307a7-2577-4b74-9645-9fe51504723f req-dc737fd1-460a-48b3-8df9-a6555a761829 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.867170 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-870307a7-2577-4b74-9645-9fe51504723f req-dc737fd1-460a-48b3-8df9-a6555a761829 service nova] Creating event network-vif-deleted:a926fff0-c109-4640-adbe-9f6dd047f15f for instance fa53378c-0deb-40cc-a2a5-bc55778f6146 on nch1-master-1 Feb 19 20:55:35.879936 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-870307a7-2577-4b74-9645-9fe51504723f req-dc737fd1-460a-48b3-8df9-a6555a761829 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307508 Feb 19 20:55:35.888629 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 667/1264] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:35.901123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4d839eb3-7f54-4d13-98a5-9cc77d900f8f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:35.902157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4d839eb3-7f54-4d13-98a5-9cc77d900f8f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:35.902892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b0085962-3d58-49f3-a429-ebd5d7b8c035 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:35.912417 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b0085962-3d58-49f3-a429-ebd5d7b8c035 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.353281 Feb 19 20:55:35.913588 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 598/1265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:35 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:35.918887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1dd0ea58-83a4-475d-bb1f-de3b689747bb tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:35.928549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d839eb3-7f54-4d13-98a5-9cc77d900f8f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.929085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d839eb3-7f54-4d13-98a5-9cc77d900f8f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.929805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d839eb3-7f54-4d13-98a5-9cc77d900f8f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.930283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d839eb3-7f54-4d13-98a5-9cc77d900f8f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.950464 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-4d839eb3-7f54-4d13-98a5-9cc77d900f8f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] HTTP exception thrown: Instance 5997373e-abc0-4f20-9feb-047df1ddcbf5 could not be found. Feb 19 20:55:35.951107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4d839eb3-7f54-4d13-98a5-9cc77d900f8f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Returning 404 to user: Instance 5997373e-abc0-4f20-9feb-047df1ddcbf5 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:35.952269 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4d839eb3-7f54-4d13-98a5-9cc77d900f8f tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 404 len: 111 microversion: 2.1 time: 0.061993 Feb 19 20:55:35.953064 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 668/1266] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:55:35 2022] DELETE /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:55:35.955193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.compute.server_groups [None req-1dd0ea58-83a4-475d-bb1f-de3b689747bb tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Querying cell 661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) for 2 instances {{(pid=136095) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 19 20:55:35.956429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1dd0ea58-83a4-475d-bb1f-de3b689747bb tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.957137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1dd0ea58-83a4-475d-bb1f-de3b689747bb tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.961256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f27dfe5f-69d9-4981-987e-d522a2ce7fbf tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:35.962097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f27dfe5f-69d9-4981-987e-d522a2ce7fbf tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:35.968766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f27dfe5f-69d9-4981-987e-d522a2ce7fbf tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.969471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f27dfe5f-69d9-4981-987e-d522a2ce7fbf tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:35.970666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f27dfe5f-69d9-4981-987e-d522a2ce7fbf tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:35.971324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f27dfe5f-69d9-4981-987e-d522a2ce7fbf tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.000304 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1dd0ea58-83a4-475d-bb1f-de3b689747bb tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/866ffc53-6983-48e3-9b13-752164543709" status: 200 len: 266 microversion: 2.1 time: 0.085386 Feb 19 20:55:36.006811 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 599/1267] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:55:35 2022] GET /compute/v2.1/os-server-groups/866ffc53-6983-48e3-9b13-752164543709 => generated 266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:36.007491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-408cf27a-afa4-45cc-8034-adb71545ece4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:36.008627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-408cf27a-afa4-45cc-8034-adb71545ece4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] [instance: 5997373e-abc0-4f20-9feb-047df1ddcbf5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:36.018637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-408cf27a-afa4-45cc-8034-adb71545ece4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.019532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-408cf27a-afa4-45cc-8034-adb71545ece4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.020576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-408cf27a-afa4-45cc-8034-adb71545ece4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.021378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-408cf27a-afa4-45cc-8034-adb71545ece4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.039628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-408cf27a-afa4-45cc-8034-adb71545ece4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] HTTP exception thrown: Instance 5997373e-abc0-4f20-9feb-047df1ddcbf5 could not be found. Feb 19 20:55:36.040284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-408cf27a-afa4-45cc-8034-adb71545ece4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] Returning 404 to user: Instance 5997373e-abc0-4f20-9feb-047df1ddcbf5 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:36.041375 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-408cf27a-afa4-45cc-8034-adb71545ece4 tempest-DeleteServersAdminTestJSON-1347154919 tempest-DeleteServersAdminTestJSON-1347154919-project] 10.222.0.30 "GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5" status: 404 len: 111 microversion: 2.1 time: 0.038790 Feb 19 20:55:36.045103 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 600/1268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:36 2022] GET /compute/v2.1/servers/5997373e-abc0-4f20-9feb-047df1ddcbf5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:55:36.054964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a4d48ad0-2f29-41bc-b050-c21f4352428c tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:36.054964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a4d48ad0-2f29-41bc-b050-c21f4352428c tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:36.076809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a4d48ad0-2f29-41bc-b050-c21f4352428c tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.077866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a4d48ad0-2f29-41bc-b050-c21f4352428c tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.078849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a4d48ad0-2f29-41bc-b050-c21f4352428c tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.079419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a4d48ad0-2f29-41bc-b050-c21f4352428c tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.301721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f27dfe5f-69d9-4981-987e-d522a2ce7fbf tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:36.318248 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f27dfe5f-69d9-4981-987e-d522a2ce7fbf tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.363045 Feb 19 20:55:36.321080 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 669/1269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:35 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:36.328051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c56209a5-50ba-4f25-aecb-c16fbf075898 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:36.331650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c56209a5-50ba-4f25-aecb-c16fbf075898 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:36.349952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c56209a5-50ba-4f25-aecb-c16fbf075898 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.350412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c56209a5-50ba-4f25-aecb-c16fbf075898 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.361591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c56209a5-50ba-4f25-aecb-c16fbf075898 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.364031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c56209a5-50ba-4f25-aecb-c16fbf075898 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.405591 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a4d48ad0-2f29-41bc-b050-c21f4352428c tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 200 len: 1619 microversion: 2.1 time: 0.357831 Feb 19 20:55:36.407241 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 601/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:36 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 1619 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:36.415222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb60bf89-fe63-4f5e-911f-db46d9ab1c03 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:36.416040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb60bf89-fe63-4f5e-911f-db46d9ab1c03 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: fa53378c-0deb-40cc-a2a5-bc55778f6146] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:36.424135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb60bf89-fe63-4f5e-911f-db46d9ab1c03 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.425422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb60bf89-fe63-4f5e-911f-db46d9ab1c03 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.426573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb60bf89-fe63-4f5e-911f-db46d9ab1c03 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.427269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb60bf89-fe63-4f5e-911f-db46d9ab1c03 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.448586 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-cb60bf89-fe63-4f5e-911f-db46d9ab1c03 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] HTTP exception thrown: Instance fa53378c-0deb-40cc-a2a5-bc55778f6146 could not be found. Feb 19 20:55:36.449485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb60bf89-fe63-4f5e-911f-db46d9ab1c03 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Returning 404 to user: Instance fa53378c-0deb-40cc-a2a5-bc55778f6146 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:36.450699 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb60bf89-fe63-4f5e-911f-db46d9ab1c03 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146" status: 404 len: 111 microversion: 2.25 time: 0.042316 Feb 19 20:55:36.451697 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 602/1271] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:36 2022] GET /compute/v2.1/servers/fa53378c-0deb-40cc-a2a5-bc55778f6146 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:55:36.458734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-517a21a9-82db-405c-97e7-f9db070407fe tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:36.469827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-517a21a9-82db-405c-97e7-f9db070407fe tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:36.477465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-517a21a9-82db-405c-97e7-f9db070407fe tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.477978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-517a21a9-82db-405c-97e7-f9db070407fe tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.478807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-517a21a9-82db-405c-97e7-f9db070407fe tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.479241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-517a21a9-82db-405c-97e7-f9db070407fe tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.808996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c56209a5-50ba-4f25-aecb-c16fbf075898 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:36.824460 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c56209a5-50ba-4f25-aecb-c16fbf075898 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1499 microversion: 2.1 time: 0.500275 Feb 19 20:55:36.836461 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 670/1272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:36 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1499 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:36.836691 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-517a21a9-82db-405c-97e7-f9db070407fe tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1620 microversion: 2.1 time: 0.379894 Feb 19 20:55:36.836977 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 603/1273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:36 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1620 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:36.845132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-89d21735-6c60-4d72-b873-c65c38056841 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:36.859258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-89d21735-6c60-4d72-b873-c65c38056841 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:36.860897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-564daf1f-fbee-471b-a6c5-c0d069e2a13e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:36.861576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-564daf1f-fbee-471b-a6c5-c0d069e2a13e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:36.878260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89d21735-6c60-4d72-b873-c65c38056841 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.879319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89d21735-6c60-4d72-b873-c65c38056841 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.881113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-564daf1f-fbee-471b-a6c5-c0d069e2a13e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.881459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89d21735-6c60-4d72-b873-c65c38056841 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.882051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-564daf1f-fbee-471b-a6c5-c0d069e2a13e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.882618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89d21735-6c60-4d72-b873-c65c38056841 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.892057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-564daf1f-fbee-471b-a6c5-c0d069e2a13e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:36.893309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-564daf1f-fbee-471b-a6c5-c0d069e2a13e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:36.955885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-89d21735-6c60-4d72-b873-c65c38056841 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lazy-loading 'flavor' on Instance uuid 7e5ff470-fc3c-4ef2-8811-930620cc10f8 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:55:36.966268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-564daf1f-fbee-471b-a6c5-c0d069e2a13e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:55:37.202052 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-564daf1f-fbee-471b-a6c5-c0d069e2a13e tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "DELETE /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 204 len: 0 microversion: 2.25 time: 0.357865 Feb 19 20:55:37.203104 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 671/1274] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:55:36 2022] DELETE /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:55:37.215559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1677a78d-9b87-43a3-a94c-d7bb2f8e7833 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Action: 'create', calling method: .version_select at 0x7f6467db85e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2118444471", "policies": ["anti-affinity"]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:37.250764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1677a78d-9b87-43a3-a94c-d7bb2f8e7833 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:37.259832 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-89d21735-6c60-4d72-b873-c65c38056841 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "POST /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8/action" status: 200 len: 32 microversion: 2.1 time: 0.421044 Feb 19 20:55:37.261282 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 604/1275] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:55:36 2022] POST /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8/action => generated 32 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:55:37.270434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6a7e458d-878d-47c2-a6e8-bd806fd8ed6f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:37.271373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6a7e458d-878d-47c2-a6e8-bd806fd8ed6f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:37.281396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1677a78d-9b87-43a3-a94c-d7bb2f8e7833 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:37.301856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a7e458d-878d-47c2-a6e8-bd806fd8ed6f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:37.302105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a7e458d-878d-47c2-a6e8-bd806fd8ed6f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:37.304598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a7e458d-878d-47c2-a6e8-bd806fd8ed6f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:37.305341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a7e458d-878d-47c2-a6e8-bd806fd8ed6f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:37.400804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1677a78d-9b87-43a3-a94c-d7bb2f8e7833 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:37.405070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1677a78d-9b87-43a3-a94c-d7bb2f8e7833 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:37.443129 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1677a78d-9b87-43a3-a94c-d7bb2f8e7833 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.232270 Feb 19 20:55:37.444842 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 672/1276] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Feb 19 20:55:37 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:37.469287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:37.472839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:37.489062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:37.489233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:37.490036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:37.490469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:38.001530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:38.015617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:38.021764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:38.023200 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-80c3017f-0bf4-4eb9-b6d2-f5714436892c tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1549 microversion: 2.25 time: 0.575622 Feb 19 20:55:38.024764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6a7e458d-878d-47c2-a6e8-bd806fd8ed6f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:38.034625 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 673/1277] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:37 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1549 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:38.043179 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6a7e458d-878d-47c2-a6e8-bd806fd8ed6f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.780181 Feb 19 20:55:38.043860 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 605/1278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:37 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:38.047454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3184ab0a-5ba4-4ac1-b0c2-283ee6910d61 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:38.048373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3184ab0a-5ba4-4ac1-b0c2-283ee6910d61 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:38.059143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3184ab0a-5ba4-4ac1-b0c2-283ee6910d61 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:38.060162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3184ab0a-5ba4-4ac1-b0c2-283ee6910d61 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:38.062632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-014d9c22-6d72-4e57-b5eb-7d1614621ff0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:38.063400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3184ab0a-5ba4-4ac1-b0c2-283ee6910d61 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:38.063821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3184ab0a-5ba4-4ac1-b0c2-283ee6910d61 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:38.066075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-014d9c22-6d72-4e57-b5eb-7d1614621ff0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:38.075033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-014d9c22-6d72-4e57-b5eb-7d1614621ff0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:38.078354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-014d9c22-6d72-4e57-b5eb-7d1614621ff0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:38.079266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-014d9c22-6d72-4e57-b5eb-7d1614621ff0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:38.081572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-014d9c22-6d72-4e57-b5eb-7d1614621ff0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:38.640168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3184ab0a-5ba4-4ac1-b0c2-283ee6910d61 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:38.647230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-014d9c22-6d72-4e57-b5eb-7d1614621ff0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:38.649842 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3184ab0a-5ba4-4ac1-b0c2-283ee6910d61 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.613645 Feb 19 20:55:38.662610 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 674/1279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:38 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:38.668267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1955395494", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0263ea3c-24a8-4f5f-9169-9734e7c95978"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:38.679293 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-014d9c22-6d72-4e57-b5eb-7d1614621ff0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.624532 Feb 19 20:55:38.682616 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 606/1280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:38 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:38.769167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:55:39.046030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:39.048533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:39.068499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:39.069583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:39.074145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:39.075804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:39.248070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:39.279503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:39.284917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:39.286994 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ffab4232-90cd-4ff7-8b9d-896e0ef12e51 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 200 len: 1507 microversion: 2.25 time: 0.249002 Feb 19 20:55:39.288987 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 607/1281] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:39 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:55:39.295354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bbd0f52b-9922-45e2-8294-b1dc5e1d37aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:39.296257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bbd0f52b-9922-45e2-8294-b1dc5e1d37aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:39.304971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbd0f52b-9922-45e2-8294-b1dc5e1d37aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:39.306102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbd0f52b-9922-45e2-8294-b1dc5e1d37aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:39.307119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbd0f52b-9922-45e2-8294-b1dc5e1d37aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:39.307728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbd0f52b-9922-45e2-8294-b1dc5e1d37aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:39.873139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:55:39.877292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:55:39.878975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:55:39.880016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:55:39.881794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:55:39.918499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:39.919192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:39.920005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:39.920465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:39.958203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:39.965682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:39.980897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Going to run 2 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:55:39.983890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:55:40.029234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bbd0f52b-9922-45e2-8294-b1dc5e1d37aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:40.043426 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bbd0f52b-9922-45e2-8294-b1dc5e1d37aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.751950 Feb 19 20:55:40.044303 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 608/1282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:39 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:40.051967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5cd0f81e-4d07-4918-b272-2cd07373a53b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:40.052980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5cd0f81e-4d07-4918-b272-2cd07373a53b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:40.061853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cd0f81e-4d07-4918-b272-2cd07373a53b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.062751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cd0f81e-4d07-4918-b272-2cd07373a53b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.063938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cd0f81e-4d07-4918-b272-2cd07373a53b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.064649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cd0f81e-4d07-4918-b272-2cd07373a53b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.093969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:40.099932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:40.147634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:40.152519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:40.169205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=ebe6da6b-8db6-4c96-9df5-d5e74a151eda,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:55:40.287979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:40.300425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:40.336793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5cd0f81e-4d07-4918-b272-2cd07373a53b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:40.350888 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5cd0f81e-4d07-4918-b272-2cd07373a53b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.303625 Feb 19 20:55:40.351559 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 609/1283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:40 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:40.360301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0eef94e5-f00c-4a8e-b9df-8be249714029 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:40.361484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0eef94e5-f00c-4a8e-b9df-8be249714029 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:40.369388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0eef94e5-f00c-4a8e-b9df-8be249714029 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.370088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0eef94e5-f00c-4a8e-b9df-8be249714029 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.376709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0eef94e5-f00c-4a8e-b9df-8be249714029 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.378352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0eef94e5-f00c-4a8e-b9df-8be249714029 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.388095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:40.399932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'server_group_members'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:40.464798 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6e7c5c93-e574-44a5-a199-be6b037acdc8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.800266 Feb 19 20:55:40.467744 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 675/1284] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:55:38 2022] POST /compute/v2.1/servers => generated 32 bytes in 1804 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Feb 19 20:55:40.497627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a574dcfc-1e1b-4ed8-b084-c1d472f32e26 req-08a107c4-472b-426c-a46b-b136874a29e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470c141a-60d6-46e9-bd5f-08ce9c6a7f99", "name": "network-vif-deleted", "tag": "8fa16ec0-665d-486a-8609-c23482d79a71"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:40.505272 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:40.505272 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:40.528450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a574dcfc-1e1b-4ed8-b084-c1d472f32e26 req-08a107c4-472b-426c-a46b-b136874a29e2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.531683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a574dcfc-1e1b-4ed8-b084-c1d472f32e26 req-08a107c4-472b-426c-a46b-b136874a29e2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.578842 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a574dcfc-1e1b-4ed8-b084-c1d472f32e26 req-08a107c4-472b-426c-a46b-b136874a29e2 service nova] Creating event network-vif-deleted:8fa16ec0-665d-486a-8609-c23482d79a71 for instance 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 on nch1-master-1 Feb 19 20:55:40.599801 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a574dcfc-1e1b-4ed8-b084-c1d472f32e26 req-08a107c4-472b-426c-a46b-b136874a29e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130463 Feb 19 20:55:40.605779 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 676/1285] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:40.632879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab0fae2c-710a-41b1-adc1-30fee324d9c4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:40.633763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ab0fae2c-710a-41b1-adc1-30fee324d9c4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: 470c141a-60d6-46e9-bd5f-08ce9c6a7f99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:40.650318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0eef94e5-f00c-4a8e-b9df-8be249714029 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:40.651547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab0fae2c-710a-41b1-adc1-30fee324d9c4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.652004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab0fae2c-710a-41b1-adc1-30fee324d9c4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.652833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab0fae2c-710a-41b1-adc1-30fee324d9c4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.653272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab0fae2c-710a-41b1-adc1-30fee324d9c4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.667429 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0eef94e5-f00c-4a8e-b9df-8be249714029 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1515 microversion: 2.1 time: 0.313591 Feb 19 20:55:40.672916 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ab0fae2c-710a-41b1-adc1-30fee324d9c4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] HTTP exception thrown: Instance 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 could not be found. Feb 19 20:55:40.673903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab0fae2c-710a-41b1-adc1-30fee324d9c4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Returning 404 to user: Instance 470c141a-60d6-46e9-bd5f-08ce9c6a7f99 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:40.675495 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab0fae2c-710a-41b1-adc1-30fee324d9c4 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99" status: 404 len: 111 microversion: 2.25 time: 0.068544 Feb 19 20:55:40.676771 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 677/1286] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:40 2022] GET /compute/v2.1/servers/470c141a-60d6-46e9-bd5f-08ce9c6a7f99 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:55:40.679990 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 610/1287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:40 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1515 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:40.682485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0207d9fa-18e8-4174-893f-0215e65d07aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:40.686517 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:40.686517 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:40.691761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0207d9fa-18e8-4174-893f-0215e65d07aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:40.693241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0207d9fa-18e8-4174-893f-0215e65d07aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Searching by: {'deleted': False, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:55:40.696842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5bc2dca6-3809-49b2-b439-8d9b9e31bb39 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:40.697860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5bc2dca6-3809-49b2-b439-8d9b9e31bb39 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:40.718547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bc2dca6-3809-49b2-b439-8d9b9e31bb39 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.719196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bc2dca6-3809-49b2-b439-8d9b9e31bb39 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.722039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bc2dca6-3809-49b2-b439-8d9b9e31bb39 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.724136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bc2dca6-3809-49b2-b439-8d9b9e31bb39 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.733165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0207d9fa-18e8-4174-893f-0215e65d07aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.733623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0207d9fa-18e8-4174-893f-0215e65d07aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.734554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0207d9fa-18e8-4174-893f-0215e65d07aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:40.734953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0207d9fa-18e8-4174-893f-0215e65d07aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:40.798547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5bc2dca6-3809-49b2-b439-8d9b9e31bb39 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:55:40.818039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-0207d9fa-18e8-4174-893f-0215e65d07aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:55:40.877000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0207d9fa-18e8-4174-893f-0215e65d07aa tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.188364 Feb 19 20:55:40.877870 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 678/1288] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 20:55:40 2022] GET /compute/v2.1/servers => generated 1666 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:40.893191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f36cf043-a984-4bac-b931-ea9626d1d6f4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:40.893745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f36cf043-a984-4bac-b931-ea9626d1d6f4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:41.015703 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5bc2dca6-3809-49b2-b439-8d9b9e31bb39 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "DELETE /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 204 len: 0 microversion: 2.25 time: 0.332444 Feb 19 20:55:41.018498 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 611/1289] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:55:40 2022] DELETE /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:55:41.030916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:41.031601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:41.046446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f36cf043-a984-4bac-b931-ea9626d1d6f4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:41.054820 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f36cf043-a984-4bac-b931-ea9626d1d6f4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1219 microversion: 2.1 time: 0.168926 Feb 19 20:55:41.057628 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 679/1290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:40 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1219 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:41.068401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:41.068856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:41.069663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:41.070094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:41.076225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0399672d-cb7d-4026-b718-0362b7976951 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:41.077028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0399672d-cb7d-4026-b718-0362b7976951 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:41.086491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0399672d-cb7d-4026-b718-0362b7976951 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:41.086944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0399672d-cb7d-4026-b718-0362b7976951 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:41.087741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0399672d-cb7d-4026-b718-0362b7976951 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:41.088170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0399672d-cb7d-4026-b718-0362b7976951 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:41.486832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0399672d-cb7d-4026-b718-0362b7976951 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:41.507347 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0399672d-cb7d-4026-b718-0362b7976951 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.448616 Feb 19 20:55:41.508028 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 680/1291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:41 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:41.554543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:41.569174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:41.574027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec1a2a2db19c41cca4342aa082770a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f02f88286b49babe665db9d00787a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:41.575560 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98ede089-af3f-4529-87ae-30a1f62f80b2 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 200 len: 1563 microversion: 2.25 time: 0.551952 Feb 19 20:55:41.577062 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 612/1292] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:41 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 1563 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:55:41.582491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bc71e409-39b4-4e31-bebe-12120763e3e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:41.583678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc71e409-39b4-4e31-bebe-12120763e3e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:41.590780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc71e409-39b4-4e31-bebe-12120763e3e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:41.591410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc71e409-39b4-4e31-bebe-12120763e3e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:41.592475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc71e409-39b4-4e31-bebe-12120763e3e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:41.604829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc71e409-39b4-4e31-bebe-12120763e3e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:41.749215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a9e1890-d63b-4749-9721-a30e41363407 tempest-FlavorsV261TestJSON-1409083853 tempest-FlavorsV261TestJSON-1409083853-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-226039442", "id": 859059799, "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:41.750988 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:41.750988 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:41.778435 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1a9e1890-d63b-4749-9721-a30e41363407 tempest-FlavorsV261TestJSON-1409083853 tempest-FlavorsV261TestJSON-1409083853-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.268719 Feb 19 20:55:41.779604 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 681/1293] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 20:55:41 2022] POST /compute/v2.1/flavors => generated 464 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:55:41.901311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-19195575-5c3c-4494-a824-abbba3cd4713 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Action: 'create', calling method: .version_select at 0x7f6467906e50>, body: {"pool": null} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:41.928070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bc71e409-39b4-4e31-bebe-12120763e3e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:41.940945 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc71e409-39b4-4e31-bebe-12120763e3e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.361878 Feb 19 20:55:41.942142 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 613/1294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:41 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:41.947224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7944b2d3-7c17-4716-852b-ad7d1575ee26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:41.947839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7944b2d3-7c17-4716-852b-ad7d1575ee26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:41.954461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7944b2d3-7c17-4716-852b-ad7d1575ee26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:41.954961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7944b2d3-7c17-4716-852b-ad7d1575ee26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:41.956623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7944b2d3-7c17-4716-852b-ad7d1575ee26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:41.957244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7944b2d3-7c17-4716-852b-ad7d1575ee26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:42.353347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7944b2d3-7c17-4716-852b-ad7d1575ee26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:42.362699 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7944b2d3-7c17-4716-852b-ad7d1575ee26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1521 microversion: 2.1 time: 0.419020 Feb 19 20:55:42.363900 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 614/1295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:41 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:42.381203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-614b4e30-5063-43d6-9c86-93877c409723 req-f55fe9f5-a92f-4cc0-b2c4-39b3b0f84ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1343027f-776d-4868-a38a-15e285438dd6", "name": "network-vif-unplugged", "status": "completed", "tag": "f438d8af-a8db-44da-92fe-ef9f6ae35141"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:42.382989 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:42.382989 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:42.391597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-614b4e30-5063-43d6-9c86-93877c409723 req-f55fe9f5-a92f-4cc0-b2c4-39b3b0f84ae1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:42.392410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-614b4e30-5063-43d6-9c86-93877c409723 req-f55fe9f5-a92f-4cc0-b2c4-39b3b0f84ae1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:42.410314 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-614b4e30-5063-43d6-9c86-93877c409723 req-f55fe9f5-a92f-4cc0-b2c4-39b3b0f84ae1 service nova] Creating event network-vif-unplugged:f438d8af-a8db-44da-92fe-ef9f6ae35141 for instance 1343027f-776d-4868-a38a-15e285438dd6 on nch1-master-1 Feb 19 20:55:42.418538 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-614b4e30-5063-43d6-9c86-93877c409723 req-f55fe9f5-a92f-4cc0-b2c4-39b3b0f84ae1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041802 Feb 19 20:55:42.419908 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 615/1296] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:42.686256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eb55a74b-09ef-4c8b-83da-d0f5bff1c977 tempest-FlavorsV261TestJSON-1670056596 tempest-FlavorsV261TestJSON-1670056596-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:42.708987 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eb55a74b-09ef-4c8b-83da-d0f5bff1c977 tempest-FlavorsV261TestJSON-1670056596 tempest-FlavorsV261TestJSON-1670056596-project] 10.222.0.30 "GET /compute/v2.1/flavors/859059799" status: 200 len: 464 microversion: 2.61 time: 0.285203 Feb 19 20:55:42.709554 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 616/1297] 10.222.0.30 () {60 vars in 1195 bytes} [Sat Feb 19 20:55:42 2022] GET /compute/v2.1/flavors/859059799 => generated 464 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:55:42.736192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ea61b80f-b632-43e6-87db-4810e1888b3f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:42.743638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ea61b80f-b632-43e6-87db-4810e1888b3f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:42.762221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea61b80f-b632-43e6-87db-4810e1888b3f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:42.763293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea61b80f-b632-43e6-87db-4810e1888b3f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:42.765423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea61b80f-b632-43e6-87db-4810e1888b3f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:42.766643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea61b80f-b632-43e6-87db-4810e1888b3f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:43.043633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ea61b80f-b632-43e6-87db-4810e1888b3f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:43.054702 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ea61b80f-b632-43e6-87db-4810e1888b3f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1279 microversion: 2.1 time: 0.334142 Feb 19 20:55:43.066614 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 617/1298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:42 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1279 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:43.072840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f8d1977-59a0-47ae-8c5a-c9a503ff0809 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:43.073736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f8d1977-59a0-47ae-8c5a-c9a503ff0809 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:43.081838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f8d1977-59a0-47ae-8c5a-c9a503ff0809 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:43.082595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f8d1977-59a0-47ae-8c5a-c9a503ff0809 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:43.083857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f8d1977-59a0-47ae-8c5a-c9a503ff0809 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:43.084401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f8d1977-59a0-47ae-8c5a-c9a503ff0809 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:43.468354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8f8d1977-59a0-47ae-8c5a-c9a503ff0809 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:43.480738 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8f8d1977-59a0-47ae-8c5a-c9a503ff0809 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.411928 Feb 19 20:55:43.500274 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 618/1299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:43 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:43.507217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f51e503e-f32f-40ce-8e8e-b5f5aa89c446 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:43.508001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f51e503e-f32f-40ce-8e8e-b5f5aa89c446 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] [instance: da666172-5dd1-484f-aca0-a346a83ecec3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:43.516295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f51e503e-f32f-40ce-8e8e-b5f5aa89c446 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:43.517117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f51e503e-f32f-40ce-8e8e-b5f5aa89c446 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:43.518527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f51e503e-f32f-40ce-8e8e-b5f5aa89c446 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:43.519229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f51e503e-f32f-40ce-8e8e-b5f5aa89c446 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:43.537881 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f51e503e-f32f-40ce-8e8e-b5f5aa89c446 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] HTTP exception thrown: Instance da666172-5dd1-484f-aca0-a346a83ecec3 could not be found. Feb 19 20:55:43.538512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f51e503e-f32f-40ce-8e8e-b5f5aa89c446 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] Returning 404 to user: Instance da666172-5dd1-484f-aca0-a346a83ecec3 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:43.540033 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f51e503e-f32f-40ce-8e8e-b5f5aa89c446 tempest-LiveAutoBlockMigrationV225Test-1806086406 tempest-LiveAutoBlockMigrationV225Test-1806086406-project] 10.222.0.30 "GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3" status: 404 len: 111 microversion: 2.25 time: 0.037503 Feb 19 20:55:43.546423 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 619/1300] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:55:43 2022] GET /compute/v2.1/servers/da666172-5dd1-484f-aca0-a346a83ecec3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:55:43.553134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e3a9b7e6-54b2-4a30-af11-c61b7061aa08 req-2913db73-f5de-4cc3-9ba5-d02ce90e2fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da666172-5dd1-484f-aca0-a346a83ecec3", "name": "network-vif-deleted", "tag": "8e715e53-af3f-4a70-b33f-5b5471d22747"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:43.555062 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:43.555062 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:43.563336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e3a9b7e6-54b2-4a30-af11-c61b7061aa08 req-2913db73-f5de-4cc3-9ba5-d02ce90e2fb8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:43.564045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e3a9b7e6-54b2-4a30-af11-c61b7061aa08 req-2913db73-f5de-4cc3-9ba5-d02ce90e2fb8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:43.578820 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e3a9b7e6-54b2-4a30-af11-c61b7061aa08 req-2913db73-f5de-4cc3-9ba5-d02ce90e2fb8 service nova] Creating event network-vif-deleted:8e715e53-af3f-4a70-b33f-5b5471d22747 for instance da666172-5dd1-484f-aca0-a346a83ecec3 on nch1-master-1 Feb 19 20:55:43.587355 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e3a9b7e6-54b2-4a30-af11-c61b7061aa08 req-2913db73-f5de-4cc3-9ba5-d02ce90e2fb8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038707 Feb 19 20:55:43.589766 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 620/1301] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:43.600150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f0987079-42ca-477e-812b-a69f8fd2b4dc tempest-FlavorsV261TestJSON-1409083853 tempest-FlavorsV261TestJSON-1409083853-project-admin] Action: 'update', calling method: .version_select at 0x7f6476811670>, body: {"flavor": {"description": "new"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:43.614860 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:43.614860 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:43.663134 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f0987079-42ca-477e-812b-a69f8fd2b4dc tempest-FlavorsV261TestJSON-1409083853 tempest-FlavorsV261TestJSON-1409083853-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/859059799" status: 200 len: 465 microversion: 2.61 time: 0.071402 Feb 19 20:55:43.665469 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 621/1302] 10.222.0.30 () {62 vars in 1215 bytes} [Sat Feb 19 20:55:43 2022] PUT /compute/v2.1/flavors/859059799 => generated 465 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 20:55:43.671988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d1a7d821-93c9-4c3e-a964-29346955801c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:43.673281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d1a7d821-93c9-4c3e-a964-29346955801c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:43.687657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1a7d821-93c9-4c3e-a964-29346955801c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:43.688536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1a7d821-93c9-4c3e-a964-29346955801c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:43.690923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1a7d821-93c9-4c3e-a964-29346955801c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:43.692199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1a7d821-93c9-4c3e-a964-29346955801c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:44.010564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d1a7d821-93c9-4c3e-a964-29346955801c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:44.022184 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d1a7d821-93c9-4c3e-a964-29346955801c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.355006 Feb 19 20:55:44.023432 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 622/1303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:43 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:44.028015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5967978d-832f-449b-9735-db8583f69e46 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:44.028727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5967978d-832f-449b-9735-db8583f69e46 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:44.039840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5967978d-832f-449b-9735-db8583f69e46 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:44.040504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5967978d-832f-449b-9735-db8583f69e46 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:44.041411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5967978d-832f-449b-9735-db8583f69e46 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:44.041780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5967978d-832f-449b-9735-db8583f69e46 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:44.790700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5967978d-832f-449b-9735-db8583f69e46 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:44.801121 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5967978d-832f-449b-9735-db8583f69e46 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1521 microversion: 2.1 time: 0.776363 Feb 19 20:55:44.802921 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 623/1304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:44 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1521 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:44.809352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-75bd165e-2474-477c-9fc0-07fe3647de4f tempest-FlavorsV261TestJSON-1670056596 tempest-FlavorsV261TestJSON-1670056596-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:44.834472 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-75bd165e-2474-477c-9fc0-07fe3647de4f tempest-FlavorsV261TestJSON-1670056596 tempest-FlavorsV261TestJSON-1670056596-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.028763 Feb 19 20:55:44.835590 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 624/1305] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Feb 19 20:55:44 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:44.839762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-15756800-15ff-4afd-a143-34b1ce041835 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:44.840490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-15756800-15ff-4afd-a143-34b1ce041835 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:44.850625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15756800-15ff-4afd-a143-34b1ce041835 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:44.851077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15756800-15ff-4afd-a143-34b1ce041835 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:44.851880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15756800-15ff-4afd-a143-34b1ce041835 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:44.852455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15756800-15ff-4afd-a143-34b1ce041835 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:44.991918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-15756800-15ff-4afd-a143-34b1ce041835 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:45.003450 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-15756800-15ff-4afd-a143-34b1ce041835 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1277 microversion: 2.1 time: 0.165985 Feb 19 20:55:45.015519 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 625/1306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:44 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:45.021404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5ced1ea4-6726-4760-a629-b421dc11e4aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:45.022028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5ced1ea4-6726-4760-a629-b421dc11e4aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:45.029707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ced1ea4-6726-4760-a629-b421dc11e4aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:45.030480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ced1ea4-6726-4760-a629-b421dc11e4aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:45.033449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ced1ea4-6726-4760-a629-b421dc11e4aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:45.033449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ced1ea4-6726-4760-a629-b421dc11e4aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:45.195377 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-19195575-5c3c-4494-a824-abbba3cd4713 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.413897 Feb 19 20:55:45.198963 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 682/1307] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:55:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:45.211128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0f1e3b27-58c9-4641-9df5-a5ffed11e7ae tempest-FlavorsV261TestJSON-1670056596 tempest-FlavorsV261TestJSON-1670056596-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:45.284555 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0f1e3b27-58c9-4641-9df5-a5ffed11e7ae tempest-FlavorsV261TestJSON-1670056596 tempest-FlavorsV261TestJSON-1670056596-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.082989 Feb 19 20:55:45.285281 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 683/1308] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Feb 19 20:55:45 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:45.292322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f8294f09-d577-4e40-ab69-c1230c71edc8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:45.294177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f8294f09-d577-4e40-ab69-c1230c71edc8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:45.304736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8294f09-d577-4e40-ab69-c1230c71edc8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:45.306438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8294f09-d577-4e40-ab69-c1230c71edc8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:45.307602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8294f09-d577-4e40-ab69-c1230c71edc8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:45.308126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8294f09-d577-4e40-ab69-c1230c71edc8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:45.499351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5ced1ea4-6726-4760-a629-b421dc11e4aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:45.513044 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5ced1ea4-6726-4760-a629-b421dc11e4aa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.494090 Feb 19 20:55:45.514563 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 626/1309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:45 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:45.528137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f304046e-a7a2-442e-b884-863deec7a58b tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Action: 'create', calling method: .version_select at 0x7f6467c6b670>, body: {"pool": null} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:46.204879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f8294f09-d577-4e40-ab69-c1230c71edc8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:46.219082 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f8294f09-d577-4e40-ab69-c1230c71edc8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.926410 Feb 19 20:55:46.219771 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 684/1310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:45 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:46.229004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-455ca9aa-3b67-4ed7-8650-02d6ac5ea3b9 tempest-FlavorsV261TestJSON-1409083853 tempest-FlavorsV261TestJSON-1409083853-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:46.232048 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:46.232048 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:46.274937 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-455ca9aa-3b67-4ed7-8650-02d6ac5ea3b9 tempest-FlavorsV261TestJSON-1409083853 tempest-FlavorsV261TestJSON-1409083853-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/859059799" status: 202 len: 0 microversion: 2.61 time: 0.053668 Feb 19 20:55:46.279142 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 685/1311] 10.222.0.30 () {60 vars in 1198 bytes} [Sat Feb 19 20:55:46 2022] DELETE /compute/v2.1/flavors/859059799 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:55:46.292186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1273a2cd-0fb7-4735-8f27-24fa9e68361c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:46.293013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1273a2cd-0fb7-4735-8f27-24fa9e68361c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:46.310201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1273a2cd-0fb7-4735-8f27-24fa9e68361c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:46.310659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1273a2cd-0fb7-4735-8f27-24fa9e68361c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:46.314432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1273a2cd-0fb7-4735-8f27-24fa9e68361c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:46.315091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1273a2cd-0fb7-4735-8f27-24fa9e68361c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:46.793551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1273a2cd-0fb7-4735-8f27-24fa9e68361c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:46.805193 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1273a2cd-0fb7-4735-8f27-24fa9e68361c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1521 microversion: 2.1 time: 0.524584 Feb 19 20:55:46.811783 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 686/1312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:46 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1521 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:46.830496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54c7a90f-056e-4175-867b-81137696d96c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:46.831659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54c7a90f-056e-4175-867b-81137696d96c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:46.844293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54c7a90f-056e-4175-867b-81137696d96c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:46.846927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54c7a90f-056e-4175-867b-81137696d96c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:46.848065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54c7a90f-056e-4175-867b-81137696d96c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:46.851394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54c7a90f-056e-4175-867b-81137696d96c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:47.382043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54c7a90f-056e-4175-867b-81137696d96c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:47.392145 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54c7a90f-056e-4175-867b-81137696d96c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1319 microversion: 2.1 time: 0.569210 Feb 19 20:55:47.395409 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 687/1313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:46 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1319 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:47.401089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6799fbcf-0fb3-490c-97c3-6d9b6911c8a1 tempest-FlavorsV261TestJSON-1409083853 tempest-FlavorsV261TestJSON-1409083853-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:47.449404 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6799fbcf-0fb3-490c-97c3-6d9b6911c8a1 tempest-FlavorsV261TestJSON-1409083853 tempest-FlavorsV261TestJSON-1409083853-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.051609 Feb 19 20:55:47.451341 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 688/1314] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Feb 19 20:55:47 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:47.464853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b2246133-a6fb-4925-b42f-1036ba53f357 req-7d98ee47-60ec-4f3f-9d0c-a74c9476b185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe6da6b-8db6-4c96-9df5-d5e74a151eda", "tag": "365ebc46-b2da-4491-a96e-331ee2fb5b8b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:47.478015 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:47.478015 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:47.492216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b2246133-a6fb-4925-b42f-1036ba53f357 req-7d98ee47-60ec-4f3f-9d0c-a74c9476b185 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:47.493424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b2246133-a6fb-4925-b42f-1036ba53f357 req-7d98ee47-60ec-4f3f-9d0c-a74c9476b185 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:47.508104 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b2246133-a6fb-4925-b42f-1036ba53f357 req-7d98ee47-60ec-4f3f-9d0c-a74c9476b185 service nova] Creating event network-changed:365ebc46-b2da-4491-a96e-331ee2fb5b8b for instance ebe6da6b-8db6-4c96-9df5-d5e74a151eda on nch2-master-1 Feb 19 20:55:47.514832 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b2246133-a6fb-4925-b42f-1036ba53f357 req-7d98ee47-60ec-4f3f-9d0c-a74c9476b185 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062283 Feb 19 20:55:47.516093 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 689/1315] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:47.524541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a97d25ec-2f89-4499-8dac-a89110449f9c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:47.537431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a97d25ec-2f89-4499-8dac-a89110449f9c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:47.547086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a97d25ec-2f89-4499-8dac-a89110449f9c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:47.547876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a97d25ec-2f89-4499-8dac-a89110449f9c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:47.548985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a97d25ec-2f89-4499-8dac-a89110449f9c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:47.562986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a97d25ec-2f89-4499-8dac-a89110449f9c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:48.151159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a97d25ec-2f89-4499-8dac-a89110449f9c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:48.167028 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a97d25ec-2f89-4499-8dac-a89110449f9c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.648608 Feb 19 20:55:48.179143 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 690/1316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:47 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:48.189327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-30af9776-31db-4701-afe9-f303c0ba7c86 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:48.189988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30af9776-31db-4701-afe9-f303c0ba7c86 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:48.197791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30af9776-31db-4701-afe9-f303c0ba7c86 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:48.199691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30af9776-31db-4701-afe9-f303c0ba7c86 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:48.200695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30af9776-31db-4701-afe9-f303c0ba7c86 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:48.201264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30af9776-31db-4701-afe9-f303c0ba7c86 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:48.616786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-30af9776-31db-4701-afe9-f303c0ba7c86 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:48.632613 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-30af9776-31db-4701-afe9-f303c0ba7c86 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.452265 Feb 19 20:55:48.634164 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 691/1317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:48 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:48.640467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ebbdd678-ee00-4c9a-b2d9-4ba807c40b05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:48.642761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ebbdd678-ee00-4c9a-b2d9-4ba807c40b05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:48.651200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebbdd678-ee00-4c9a-b2d9-4ba807c40b05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:48.653638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebbdd678-ee00-4c9a-b2d9-4ba807c40b05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:48.654699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebbdd678-ee00-4c9a-b2d9-4ba807c40b05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:48.655492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebbdd678-ee00-4c9a-b2d9-4ba807c40b05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:49.054767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ebbdd678-ee00-4c9a-b2d9-4ba807c40b05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:49.064473 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ebbdd678-ee00-4c9a-b2d9-4ba807c40b05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1521 microversion: 2.1 time: 0.428698 Feb 19 20:55:49.067515 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 692/1318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:48 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:49.073784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8d5dbedc-dd03-44ee-b6d3-e7a92c9bf285 req-d0103189-32d0-447f-9a54-e8e459793591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1343027f-776d-4868-a38a-15e285438dd6", "name": "network-vif-plugged", "status": "completed", "tag": "f438d8af-a8db-44da-92fe-ef9f6ae35141"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:49.076649 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:49.076649 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:49.090195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8d5dbedc-dd03-44ee-b6d3-e7a92c9bf285 req-d0103189-32d0-447f-9a54-e8e459793591 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:49.091321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8d5dbedc-dd03-44ee-b6d3-e7a92c9bf285 req-d0103189-32d0-447f-9a54-e8e459793591 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:49.106056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8d5dbedc-dd03-44ee-b6d3-e7a92c9bf285 req-d0103189-32d0-447f-9a54-e8e459793591 service nova] Creating event network-vif-plugged:f438d8af-a8db-44da-92fe-ef9f6ae35141 for instance 1343027f-776d-4868-a38a-15e285438dd6 on nch1-master-1 Feb 19 20:55:49.111482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8d5dbedc-dd03-44ee-b6d3-e7a92c9bf285 req-d0103189-32d0-447f-9a54-e8e459793591 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041925 Feb 19 20:55:49.113701 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 693/1319] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:49.131233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-92df6c38-2056-4870-8a43-9f457ceec458 req-d5ef6283-0540-4f6d-8b6d-9a082d52720d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eee1ae54-f01f-41c1-811a-689b47b22890", "tag": "6ad13ef7-c05f-4bdb-be33-195dad103115"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:49.133978 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:49.133978 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:49.147812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-92df6c38-2056-4870-8a43-9f457ceec458 req-d5ef6283-0540-4f6d-8b6d-9a082d52720d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:49.148653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-92df6c38-2056-4870-8a43-9f457ceec458 req-d5ef6283-0540-4f6d-8b6d-9a082d52720d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:49.166908 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-92df6c38-2056-4870-8a43-9f457ceec458 req-d5ef6283-0540-4f6d-8b6d-9a082d52720d service nova] Creating event network-changed:6ad13ef7-c05f-4bdb-be33-195dad103115 for instance eee1ae54-f01f-41c1-811a-689b47b22890 on nch1-master-1 Feb 19 20:55:49.176041 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-92df6c38-2056-4870-8a43-9f457ceec458 req-d5ef6283-0540-4f6d-8b6d-9a082d52720d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058856 Feb 19 20:55:49.177713 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 694/1320] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:49.185335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e7bb89fb-4d49-4305-be6a-a4832f92e55a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:49.186420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e7bb89fb-4d49-4305-be6a-a4832f92e55a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:49.196596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7bb89fb-4d49-4305-be6a-a4832f92e55a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:49.197442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7bb89fb-4d49-4305-be6a-a4832f92e55a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:49.198755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7bb89fb-4d49-4305-be6a-a4832f92e55a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:49.199555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7bb89fb-4d49-4305-be6a-a4832f92e55a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:49.365921 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f304046e-a7a2-442e-b884-863deec7a58b tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.849948 Feb 19 20:55:49.366626 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 627/1321] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:55:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:49.372879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06783e97-060f-4494-8d80-d5ccb1ce640e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:49.373970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06783e97-060f-4494-8d80-d5ccb1ce640e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:49.382259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06783e97-060f-4494-8d80-d5ccb1ce640e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:49.382994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06783e97-060f-4494-8d80-d5ccb1ce640e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:49.383985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06783e97-060f-4494-8d80-d5ccb1ce640e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:49.384686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06783e97-060f-4494-8d80-d5ccb1ce640e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:49.906657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e7bb89fb-4d49-4305-be6a-a4832f92e55a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:49.914181 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e7bb89fb-4d49-4305-be6a-a4832f92e55a tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1319 microversion: 2.1 time: 0.734981 Feb 19 20:55:49.914758 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 695/1322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:49 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1319 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:49.919233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aad22719-42c4-44dc-85ca-569ce64352e6 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Action: 'create', calling method: .version_select at 0x7f646791fc10>, body: {"pool": null} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:50.184478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-06783e97-060f-4494-8d80-d5ccb1ce640e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:50.192865 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06783e97-060f-4494-8d80-d5ccb1ce640e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.824884 Feb 19 20:55:50.194049 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 628/1323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:49 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:50.198679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13af3c87-7c19-469a-89e0-57bad73de9f4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:50.199335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-13af3c87-7c19-469a-89e0-57bad73de9f4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:50.206326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13af3c87-7c19-469a-89e0-57bad73de9f4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:50.206778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13af3c87-7c19-469a-89e0-57bad73de9f4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:50.207761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13af3c87-7c19-469a-89e0-57bad73de9f4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:50.208194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13af3c87-7c19-469a-89e0-57bad73de9f4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:50.654401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13af3c87-7c19-469a-89e0-57bad73de9f4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:50.662851 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13af3c87-7c19-469a-89e0-57bad73de9f4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.467557 Feb 19 20:55:50.671984 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 629/1324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:50 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:50.678228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a23da52f-1dc8-4d7a-ad65-44ca301d7e85 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:50.679105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a23da52f-1dc8-4d7a-ad65-44ca301d7e85 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:50.685492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a23da52f-1dc8-4d7a-ad65-44ca301d7e85 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:50.685950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a23da52f-1dc8-4d7a-ad65-44ca301d7e85 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:50.686741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a23da52f-1dc8-4d7a-ad65-44ca301d7e85 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:50.687173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a23da52f-1dc8-4d7a-ad65-44ca301d7e85 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:51.066001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a23da52f-1dc8-4d7a-ad65-44ca301d7e85 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:51.078470 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a23da52f-1dc8-4d7a-ad65-44ca301d7e85 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1521 microversion: 2.1 time: 0.400971 Feb 19 20:55:51.079344 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 630/1325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:50 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:51.273264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e609efd-d166-4924-b429-1fe19117037a tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:51.275292 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:51.275292 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:51.287699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e609efd-d166-4924-b429-1fe19117037a tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:51.289474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e609efd-d166-4924-b429-1fe19117037a tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:51.290655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e609efd-d166-4924-b429-1fe19117037a tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:51.291330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e609efd-d166-4924-b429-1fe19117037a tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:51.354815 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e609efd-d166-4924-b429-1fe19117037a tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.271818 Feb 19 20:55:51.358355 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 631/1326] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:55:51 2022] GET /compute/v2.1/os-services => generated 947 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:51.364701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bc8e8084-3b1b-47a1-a8d7-5f499b93ece5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:51.366643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc8e8084-3b1b-47a1-a8d7-5f499b93ece5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:51.378903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc8e8084-3b1b-47a1-a8d7-5f499b93ece5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:51.379360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc8e8084-3b1b-47a1-a8d7-5f499b93ece5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:51.380527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc8e8084-3b1b-47a1-a8d7-5f499b93ece5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:51.381849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc8e8084-3b1b-47a1-a8d7-5f499b93ece5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:51.661110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bc8e8084-3b1b-47a1-a8d7-5f499b93ece5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:51.671827 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc8e8084-3b1b-47a1-a8d7-5f499b93ece5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1319 microversion: 2.1 time: 0.311324 Feb 19 20:55:51.681761 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 632/1327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:51 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:51.681761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad693c11-c3b7-4b5d-a49b-b17e853e899f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:51.682734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ad693c11-c3b7-4b5d-a49b-b17e853e899f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:51.690382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad693c11-c3b7-4b5d-a49b-b17e853e899f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:51.690831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad693c11-c3b7-4b5d-a49b-b17e853e899f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:51.691631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad693c11-c3b7-4b5d-a49b-b17e853e899f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:51.692053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad693c11-c3b7-4b5d-a49b-b17e853e899f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:51.987482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ad693c11-c3b7-4b5d-a49b-b17e853e899f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:51.995416 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad693c11-c3b7-4b5d-a49b-b17e853e899f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.321531 Feb 19 20:55:51.996009 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 633/1328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:51 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:52.000463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a73fbb8a-9f7e-4d5a-b11f-893849b1c92e tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:52.001901 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:52.001901 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:52.003762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a73fbb8a-9f7e-4d5a-b11f-893849b1c92e tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.004400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a73fbb8a-9f7e-4d5a-b11f-893849b1c92e tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.005456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a73fbb8a-9f7e-4d5a-b11f-893849b1c92e tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.006068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a73fbb8a-9f7e-4d5a-b11f-893849b1c92e tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.030283 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a73fbb8a-9f7e-4d5a-b11f-893849b1c92e tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.033152 Feb 19 20:55:52.031217 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 634/1329] 10.222.0.30 () {58 vars in 1173 bytes} [Sat Feb 19 20:55:51 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:52.048767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-253aab38-f735-4425-9a87-eef3ab852491 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:52.049425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-253aab38-f735-4425-9a87-eef3ab852491 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:52.057194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-253aab38-f735-4425-9a87-eef3ab852491 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.057979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-253aab38-f735-4425-9a87-eef3ab852491 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.058998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-253aab38-f735-4425-9a87-eef3ab852491 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.059443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-253aab38-f735-4425-9a87-eef3ab852491 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.091036 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aad22719-42c4-44dc-85ca-569ce64352e6 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.174998 Feb 19 20:55:52.100098 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 696/1330] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:55:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:52.106628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2a66bc68-38a8-423b-a954-8aa1c559eaec tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:52.108300 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:52.108300 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:52.110527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a66bc68-38a8-423b-a954-8aa1c559eaec tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.110970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a66bc68-38a8-423b-a954-8aa1c559eaec tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.112843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a66bc68-38a8-423b-a954-8aa1c559eaec tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.113482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a66bc68-38a8-423b-a954-8aa1c559eaec tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.157585 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2a66bc68-38a8-423b-a954-8aa1c559eaec tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056079 Feb 19 20:55:52.168251 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 697/1331] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Feb 19 20:55:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:52.175018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d4bf0fd8-c4f4-41d8-85db-f2f62c5f3ded tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:52.175964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d4bf0fd8-c4f4-41d8-85db-f2f62c5f3ded tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:52.184710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4bf0fd8-c4f4-41d8-85db-f2f62c5f3ded tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.185484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4bf0fd8-c4f4-41d8-85db-f2f62c5f3ded tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.186655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4bf0fd8-c4f4-41d8-85db-f2f62c5f3ded tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.188970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4bf0fd8-c4f4-41d8-85db-f2f62c5f3ded tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.221681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-253aab38-f735-4425-9a87-eef3ab852491 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:52.230272 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-253aab38-f735-4425-9a87-eef3ab852491 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.197850 Feb 19 20:55:52.235566 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 635/1332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:52 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:52.240118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dc93b10e-3e3d-4ec3-ab83-d857c96f2f4e tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Action: 'create', calling method: .version_select at 0x7f6467b7d940>, body: {"pool": null} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:52.463537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d4bf0fd8-c4f4-41d8-85db-f2f62c5f3ded tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:52.476134 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d4bf0fd8-c4f4-41d8-85db-f2f62c5f3ded tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1506 microversion: 2.1 time: 0.306049 Feb 19 20:55:52.492320 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 698/1333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:52 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:52.500499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e9d1178b-1bac-4e46-9eb4-382d49ddf580 tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:52.502087 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:52.502087 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:52.504809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9d1178b-1bac-4e46-9eb4-382d49ddf580 tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.505483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9d1178b-1bac-4e46-9eb4-382d49ddf580 tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.506656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9d1178b-1bac-4e46-9eb4-382d49ddf580 tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.507305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9d1178b-1bac-4e46-9eb4-382d49ddf580 tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.546206 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e9d1178b-1bac-4e46-9eb4-382d49ddf580 tempest-ServicesAdminTestJSON-842134549 tempest-ServicesAdminTestJSON-842134549-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.052232 Feb 19 20:55:52.547495 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 699/1334] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:55:52 2022] GET /compute/v2.1/os-services => generated 947 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:52.555192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57cff382-2e0a-4de4-89b7-9f7d67817568 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:52.557134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-57cff382-2e0a-4de4-89b7-9f7d67817568 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:52.565507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57cff382-2e0a-4de4-89b7-9f7d67817568 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.566343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57cff382-2e0a-4de4-89b7-9f7d67817568 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:52.567361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57cff382-2e0a-4de4-89b7-9f7d67817568 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:52.567997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57cff382-2e0a-4de4-89b7-9f7d67817568 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:53.102764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57cff382-2e0a-4de4-89b7-9f7d67817568 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:53.110099 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-57cff382-2e0a-4de4-89b7-9f7d67817568 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 200 len: 1506 microversion: 2.1 time: 0.561104 Feb 19 20:55:53.117549 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 700/1335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:52 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:53.120817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-43683cae-f797-4c50-8249-ae1ad4986776 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:53.121432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-43683cae-f797-4c50-8249-ae1ad4986776 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:53.128398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43683cae-f797-4c50-8249-ae1ad4986776 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:53.128956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43683cae-f797-4c50-8249-ae1ad4986776 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:53.129800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43683cae-f797-4c50-8249-ae1ad4986776 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:53.130349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43683cae-f797-4c50-8249-ae1ad4986776 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:53.368820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-43683cae-f797-4c50-8249-ae1ad4986776 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:53.378228 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-43683cae-f797-4c50-8249-ae1ad4986776 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1319 microversion: 2.1 time: 0.265524 Feb 19 20:55:53.378942 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 701/1336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:53 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:53.646804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1660154435", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "38f0b579-c349-4313-af39-532bf5d625a7"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:53.707334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] validate_networks() for [('38f0b579-c349-4313-af39-532bf5d625a7', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:55:53.894761 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dc93b10e-3e3d-4ec3-ab83-d857c96f2f4e tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.658049 Feb 19 20:55:53.904084 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 636/1337] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:55:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:53.909939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13bdc156-4ded-4547-8295-b98ba5a18110 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:53.911883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-13bdc156-4ded-4547-8295-b98ba5a18110 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:53.922858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13bdc156-4ded-4547-8295-b98ba5a18110 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:53.923321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13bdc156-4ded-4547-8295-b98ba5a18110 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:53.926531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13bdc156-4ded-4547-8295-b98ba5a18110 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:53.927321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13bdc156-4ded-4547-8295-b98ba5a18110 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:54.384869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13bdc156-4ded-4547-8295-b98ba5a18110 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:54.392763 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13bdc156-4ded-4547-8295-b98ba5a18110 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.487007 Feb 19 20:55:54.393704 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 637/1338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:53 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:54.407621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f77f3f21-3e3c-4394-9bb7-a52fd5bef2d1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:54.408104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f77f3f21-3e3c-4394-9bb7-a52fd5bef2d1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:54.414883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f77f3f21-3e3c-4394-9bb7-a52fd5bef2d1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:54.415331 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f77f3f21-3e3c-4394-9bb7-a52fd5bef2d1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:54.416110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f77f3f21-3e3c-4394-9bb7-a52fd5bef2d1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:54.416753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f77f3f21-3e3c-4394-9bb7-a52fd5bef2d1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:54.444266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f77f3f21-3e3c-4394-9bb7-a52fd5bef2d1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:55:54.537874 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f77f3f21-3e3c-4394-9bb7-a52fd5bef2d1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 204 len: 0 microversion: 2.1 time: 0.132930 Feb 19 20:55:54.539035 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 638/1339] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:55:54 2022] DELETE /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:55:54.548671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6631a839-0c0f-4fc7-9190-fe6183a8d0c8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:54.549958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6631a839-0c0f-4fc7-9190-fe6183a8d0c8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:54.564056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6631a839-0c0f-4fc7-9190-fe6183a8d0c8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:54.565397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6631a839-0c0f-4fc7-9190-fe6183a8d0c8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:54.566486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6631a839-0c0f-4fc7-9190-fe6183a8d0c8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:54.567095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6631a839-0c0f-4fc7-9190-fe6183a8d0c8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:54.586819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:55:54.588563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:55:54.589439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:55:54.590081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:55:54.590855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:55:54.601291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:54.602032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:54.603110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:54.603842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:54.640786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Getting quotas for project 63acbd462dfc418fab3fbeedccacb9c7. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:54.646192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Getting quotas for user 0d694f3e8da440a9a1cac8ca2de030e8 and project 63acbd462dfc418fab3fbeedccacb9c7. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:54.671058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:55:54.673512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:55:54.721845 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dd65a709-83fa-4b82-b01b-1545c42e0954 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341413 Feb 19 20:55:54.727626 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 702/1340] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:55:54.747616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6631a839-0c0f-4fc7-9190-fe6183a8d0c8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:54.756027 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6631a839-0c0f-4fc7-9190-fe6183a8d0c8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.215843 Feb 19 20:55:54.757364 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 639/1341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:54 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:54.773175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-315a1001-b922-4db7-b696-5954683b52ca tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Calling method '.version_select at 0x7f6467bbdee0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:54.973738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4c93524e-ceac-4a87-9dd7-213e93bedaeb req-e013612a-6d9c-4e12-bcfc-540cda249dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee1ae54-f01f-41c1-811a-689b47b22890", "name": "network-vif-plugged", "status": "completed", "tag": "6ad13ef7-c05f-4bdb-be33-195dad103115"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:54.976178 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:54.976178 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:54.983775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4c93524e-ceac-4a87-9dd7-213e93bedaeb req-e013612a-6d9c-4e12-bcfc-540cda249dab service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:54.984219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4c93524e-ceac-4a87-9dd7-213e93bedaeb req-e013612a-6d9c-4e12-bcfc-540cda249dab service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:54.994662 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4c93524e-ceac-4a87-9dd7-213e93bedaeb req-e013612a-6d9c-4e12-bcfc-540cda249dab service nova] Creating event network-vif-plugged:6ad13ef7-c05f-4bdb-be33-195dad103115 for instance eee1ae54-f01f-41c1-811a-689b47b22890 on nch1-master-1 Feb 19 20:55:55.000774 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4c93524e-ceac-4a87-9dd7-213e93bedaeb req-e013612a-6d9c-4e12-bcfc-540cda249dab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276958 Feb 19 20:55:55.001766 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 703/1342] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:55.009751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-067d1743-f3c7-4763-b115-b589a4b82e40 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:55.010698 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-315a1001-b922-4db7-b696-5954683b52ca tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/c7b9fff9-9978-4dee-8d67-a5cdf9491996" status: 200 len: 142 microversion: 2.1 time: 0.251230 Feb 19 20:55:55.011151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-067d1743-f3c7-4763-b115-b589a4b82e40 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:55.011427 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 640/1343] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:55:54 2022] GET /compute/v2.1/os-floating-ips/c7b9fff9-9978-4dee-8d67-a5cdf9491996 => generated 142 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:55.023830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-067d1743-f3c7-4763-b115-b589a4b82e40 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:55.024452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-067d1743-f3c7-4763-b115-b589a4b82e40 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:55.027022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-067d1743-f3c7-4763-b115-b589a4b82e40 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:55.027682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-067d1743-f3c7-4763-b115-b589a4b82e40 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:55.057044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2135330674", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "351c1efd-5280-463c-84c7-ead44efacdc6"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:55.159038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] validate_networks() for [('351c1efd-5280-463c-84c7-ead44efacdc6', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:55:55.402666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-067d1743-f3c7-4763-b115-b589a4b82e40 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:55.412352 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-067d1743-f3c7-4763-b115-b589a4b82e40 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1319 microversion: 2.1 time: 0.408602 Feb 19 20:55:55.421321 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 704/1344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:55 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:55.426583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-833e4b46-e90a-460b-b104-112def3a921b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:55.427192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-833e4b46-e90a-460b-b104-112def3a921b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:55.436732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-833e4b46-e90a-460b-b104-112def3a921b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:55.437227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-833e4b46-e90a-460b-b104-112def3a921b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:55.438030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-833e4b46-e90a-460b-b104-112def3a921b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:55.438686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-833e4b46-e90a-460b-b104-112def3a921b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:55.556674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-833e4b46-e90a-460b-b104-112def3a921b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:55.572121 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-833e4b46-e90a-460b-b104-112def3a921b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1207 microversion: 2.1 time: 0.149558 Feb 19 20:55:55.580796 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 705/1345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:55 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1207 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:55.587552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d65dd717-6293-479e-846f-fe67ad141a07 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Calling method '.version_select at 0x7f6467a5e1f0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:55.990390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:55:55.990822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:55:55.991307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:55:55.991922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:55:55.993587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:55:56.008105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:56.009174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:56.011644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:56.012924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:56.042757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Getting quotas for project 808305a45737485185adcb60012ea91a. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:55:56.047708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Getting quotas for user ccc221761620472ea3cd887988f9f2c0 and project 808305a45737485185adcb60012ea91a. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:55:56.061397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:55:56.064239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:55:56.132317 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b0cd6724-823b-4400-93ce-1aa3621704fd tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119116 Feb 19 20:55:56.134435 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 641/1346] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:55:56.138516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2a6c2abc-62aa-49d1-a6d1-9386d1f0f389 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:56.139528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2a6c2abc-62aa-49d1-a6d1-9386d1f0f389 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:56.147709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a6c2abc-62aa-49d1-a6d1-9386d1f0f389 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:56.148190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a6c2abc-62aa-49d1-a6d1-9386d1f0f389 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:56.149115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a6c2abc-62aa-49d1-a6d1-9386d1f0f389 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:56.149903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a6c2abc-62aa-49d1-a6d1-9386d1f0f389 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:56.528694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2a6c2abc-62aa-49d1-a6d1-9386d1f0f389 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:56.536502 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2a6c2abc-62aa-49d1-a6d1-9386d1f0f389 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.401910 Feb 19 20:55:56.539861 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 642/1347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:56 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:56.546696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-29c3cd34-8250-436c-95d1-66ce7d0d54a2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:56.557306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-29c3cd34-8250-436c-95d1-66ce7d0d54a2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:56.567983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29c3cd34-8250-436c-95d1-66ce7d0d54a2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:56.568545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29c3cd34-8250-436c-95d1-66ce7d0d54a2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:56.569589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29c3cd34-8250-436c-95d1-66ce7d0d54a2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:56.570572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29c3cd34-8250-436c-95d1-66ce7d0d54a2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.012476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-29c3cd34-8250-436c-95d1-66ce7d0d54a2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:57.025183 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-29c3cd34-8250-436c-95d1-66ce7d0d54a2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.481930 Feb 19 20:55:57.027050 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 643/1348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:56 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:57.187811 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d65dd717-6293-479e-846f-fe67ad141a07 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/c7b9fff9-9978-4dee-8d67-a5cdf9491996" status: 202 len: 0 microversion: 2.1 time: 1.605186 Feb 19 20:55:57.188321 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 706/1349] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:55:55 2022] DELETE /compute/v2.1/os-floating-ips/c7b9fff9-9978-4dee-8d67-a5cdf9491996 => generated 0 bytes in 1607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:55:57.197071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bd2b8284-50c8-441e-94f2-1237d372d086 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:57.197621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bd2b8284-50c8-441e-94f2-1237d372d086 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:57.207435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc322df6-a9c6-4050-9cc0-cc0906e61489 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Action: 'update', calling method: .version_select at 0x7f6467b37ee0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:57.209210 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:57.209210 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:57.211086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc322df6-a9c6-4050-9cc0-cc0906e61489 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:57.211728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc322df6-a9c6-4050-9cc0-cc0906e61489 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.215922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd2b8284-50c8-441e-94f2-1237d372d086 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:57.216413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd2b8284-50c8-441e-94f2-1237d372d086 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.217282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd2b8284-50c8-441e-94f2-1237d372d086 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:57.217765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd2b8284-50c8-441e-94f2-1237d372d086 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.226038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc322df6-a9c6-4050-9cc0-cc0906e61489 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:57.228839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc322df6-a9c6-4050-9cc0-cc0906e61489 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.241324 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-fc322df6-a9c6-4050-9cc0-cc0906e61489 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] HTTP exception thrown: Service b8f9e2a6-33c9-498c-b1e4-e8b46726e98f could not be found. Feb 19 20:55:57.242275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc322df6-a9c6-4050-9cc0-cc0906e61489 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Returning 404 to user: Service b8f9e2a6-33c9-498c-b1e4-e8b46726e98f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:57.243398 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc322df6-a9c6-4050-9cc0-cc0906e61489 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/b8f9e2a6-33c9-498c-b1e4-e8b46726e98f" status: 404 len: 110 microversion: 2.53 time: 0.212797 Feb 19 20:55:57.244194 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 644/1350] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Feb 19 20:55:57 2022] PUT /compute/v2.1/os-services/b8f9e2a6-33c9-498c-b1e4-e8b46726e98f => generated 110 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:55:57.253157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-020f5e14-24aa-45b4-a02c-db4770964020 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:57.253773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-020f5e14-24aa-45b4-a02c-db4770964020 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:57.260210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-020f5e14-24aa-45b4-a02c-db4770964020 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:57.260689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-020f5e14-24aa-45b4-a02c-db4770964020 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.262333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-020f5e14-24aa-45b4-a02c-db4770964020 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:57.262810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-020f5e14-24aa-45b4-a02c-db4770964020 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.326952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bd2b8284-50c8-441e-94f2-1237d372d086 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:57.341455 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bd2b8284-50c8-441e-94f2-1237d372d086 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1270 microversion: 2.1 time: 0.151900 Feb 19 20:55:57.353987 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 707/1351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:57 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:57.354905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-38d18854-4c90-43ef-8705-1aad58fe1701 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:57.355533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-38d18854-4c90-43ef-8705-1aad58fe1701 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:57.361768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38d18854-4c90-43ef-8705-1aad58fe1701 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:57.362293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38d18854-4c90-43ef-8705-1aad58fe1701 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.363056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38d18854-4c90-43ef-8705-1aad58fe1701 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:57.363497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38d18854-4c90-43ef-8705-1aad58fe1701 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.589584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-020f5e14-24aa-45b4-a02c-db4770964020 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:57.599747 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-020f5e14-24aa-45b4-a02c-db4770964020 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1469 microversion: 2.1 time: 0.354219 Feb 19 20:55:57.600708 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 645/1352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:57 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1469 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:57.605575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6156895a-47f3-4316-8db4-58d23fef6e81 req-9dad9d8d-eb86-4f25-8119-46d57f0896fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe6da6b-8db6-4c96-9df5-d5e74a151eda", "name": "network-vif-plugged", "status": "completed", "tag": "365ebc46-b2da-4491-a96e-331ee2fb5b8b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:57.607353 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:57.607353 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:57.617064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6156895a-47f3-4316-8db4-58d23fef6e81 req-9dad9d8d-eb86-4f25-8119-46d57f0896fd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:57.617858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6156895a-47f3-4316-8db4-58d23fef6e81 req-9dad9d8d-eb86-4f25-8119-46d57f0896fd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:57.634441 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6156895a-47f3-4316-8db4-58d23fef6e81 req-9dad9d8d-eb86-4f25-8119-46d57f0896fd service nova] Creating event network-vif-plugged:365ebc46-b2da-4491-a96e-331ee2fb5b8b for instance ebe6da6b-8db6-4c96-9df5-d5e74a151eda on nch2-master-1 Feb 19 20:55:57.640248 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6156895a-47f3-4316-8db4-58d23fef6e81 req-9dad9d8d-eb86-4f25-8119-46d57f0896fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038161 Feb 19 20:55:57.641015 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 646/1353] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:57.646957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3d82f173-756f-4967-a2c1-9ccabacee641 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Calling method '.version_select at 0x7f6467bcdd30>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:58.298086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-38d18854-4c90-43ef-8705-1aad58fe1701 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:58.306442 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-38d18854-4c90-43ef-8705-1aad58fe1701 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1311 microversion: 2.1 time: 0.959622 Feb 19 20:55:58.307014 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 708/1354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:57 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1311 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:58.311915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c17fafaf-ccbc-4fd4-97ec-034872eded43 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Action: 'update', calling method: .version_select at 0x7f6467a3e0d0>, body: {"status": "disabled"} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:58.313527 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:58.313527 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:58.315204 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3d82f173-756f-4967-a2c1-9ccabacee641 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.672076 Feb 19 20:55:58.316228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c17fafaf-ccbc-4fd4-97ec-034872eded43 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.316707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c17fafaf-ccbc-4fd4-97ec-034872eded43 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.317217 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 647/1355] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Feb 19 20:55:57 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:55:58.327814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-72634279-01fa-4bb1-930d-a15c9d091e92 req-52729de5-52a8-428b-a384-de6009c5f55e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1343027f-776d-4868-a38a-15e285438dd6", "name": "network-vif-deleted", "tag": "f438d8af-a8db-44da-92fe-ef9f6ae35141"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:58.331338 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:58.331338 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:58.336081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c17fafaf-ccbc-4fd4-97ec-034872eded43 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.336081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c17fafaf-ccbc-4fd4-97ec-034872eded43 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.344057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-72634279-01fa-4bb1-930d-a15c9d091e92 req-52729de5-52a8-428b-a384-de6009c5f55e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.344664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-72634279-01fa-4bb1-930d-a15c9d091e92 req-52729de5-52a8-428b-a384-de6009c5f55e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.347917 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-c17fafaf-ccbc-4fd4-97ec-034872eded43 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] HTTP exception thrown: Service b8f9e2a6-33c9-498c-b1e4-e8b46726e98f could not be found. Feb 19 20:55:58.349019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c17fafaf-ccbc-4fd4-97ec-034872eded43 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Returning 404 to user: Service b8f9e2a6-33c9-498c-b1e4-e8b46726e98f could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:58.350602 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c17fafaf-ccbc-4fd4-97ec-034872eded43 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/b8f9e2a6-33c9-498c-b1e4-e8b46726e98f" status: 404 len: 110 microversion: 2.53 time: 0.042667 Feb 19 20:55:58.351192 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 709/1356] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Feb 19 20:55:58 2022] PUT /compute/v2.1/os-services/b8f9e2a6-33c9-498c-b1e4-e8b46726e98f => generated 110 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:55:58.355634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe5406ec-dbf1-4827-9af4-13cce8b93850 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:58.356243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fe5406ec-dbf1-4827-9af4-13cce8b93850 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:58.358555 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-72634279-01fa-4bb1-930d-a15c9d091e92 req-52729de5-52a8-428b-a384-de6009c5f55e service nova] Creating event network-vif-deleted:f438d8af-a8db-44da-92fe-ef9f6ae35141 for instance 1343027f-776d-4868-a38a-15e285438dd6 on nch1-master-1 Feb 19 20:55:58.363793 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-72634279-01fa-4bb1-930d-a15c9d091e92 req-52729de5-52a8-428b-a384-de6009c5f55e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045237 Feb 19 20:55:58.364981 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 648/1357] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:58.367545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe5406ec-dbf1-4827-9af4-13cce8b93850 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.369363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe5406ec-dbf1-4827-9af4-13cce8b93850 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.369363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe5406ec-dbf1-4827-9af4-13cce8b93850 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.369363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe5406ec-dbf1-4827-9af4-13cce8b93850 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.370551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ca37afe-67c0-4b52-b821-d9339466f625 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:58.371430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ca37afe-67c0-4b52-b821-d9339466f625 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:58.378470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ca37afe-67c0-4b52-b821-d9339466f625 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.379158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ca37afe-67c0-4b52-b821-d9339466f625 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.379941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ca37afe-67c0-4b52-b821-d9339466f625 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.380414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ca37afe-67c0-4b52-b821-d9339466f625 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.685961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe5406ec-dbf1-4827-9af4-13cce8b93850 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:58.693785 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fe5406ec-dbf1-4827-9af4-13cce8b93850 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.341522 Feb 19 20:55:58.703429 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 710/1358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:58 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:58.704179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ca37afe-67c0-4b52-b821-d9339466f625 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:58.704613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0f635e09-d695-442d-8dbe-9c6a43dea3b6 req-4333c276-f3fa-4ba3-8f88-88aaf8e8cdfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aa80efa-1c90-4f4a-bb66-91e6e91c9db9", "tag": "29196269-26de-4888-9bd6-bdcde982f91c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:58.706057 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:58.706057 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:58.706474 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ca37afe-67c0-4b52-b821-d9339466f625 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda" status: 200 len: 1319 microversion: 2.1 time: 0.339903 Feb 19 20:55:58.707058 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 649/1359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:58 2022] GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:58.712144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f060395-709a-43db-a017-4f3189ea4ba6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:58.712962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f060395-709a-43db-a017-4f3189ea4ba6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:58.713702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0f635e09-d695-442d-8dbe-9c6a43dea3b6 req-4333c276-f3fa-4ba3-8f88-88aaf8e8cdfe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.714345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0f635e09-d695-442d-8dbe-9c6a43dea3b6 req-4333c276-f3fa-4ba3-8f88-88aaf8e8cdfe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.719999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f060395-709a-43db-a017-4f3189ea4ba6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.720539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f060395-709a-43db-a017-4f3189ea4ba6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.721499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f060395-709a-43db-a017-4f3189ea4ba6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:58.721937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f060395-709a-43db-a017-4f3189ea4ba6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:58.731637 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0f635e09-d695-442d-8dbe-9c6a43dea3b6 req-4333c276-f3fa-4ba3-8f88-88aaf8e8cdfe service nova] Creating event network-changed:29196269-26de-4888-9bd6-bdcde982f91c for instance 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 on nch2-master-1 Feb 19 20:55:58.737319 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0f635e09-d695-442d-8dbe-9c6a43dea3b6 req-4333c276-f3fa-4ba3-8f88-88aaf8e8cdfe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035595 Feb 19 20:55:58.738465 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 711/1360] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:58.746001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-970b7efd-5e40-428d-8db4-cf3f4492bce7 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Calling method '.version_select at 0x7f6467a2b9d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:59.178176 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-970b7efd-5e40-428d-8db4-cf3f4492bce7 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.438274 Feb 19 20:55:59.178998 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 712/1361] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 20:55:58 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:55:59.185635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9f060395-709a-43db-a017-4f3189ea4ba6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:59.194810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57972229-2ca7-408e-a5c2-516abd9bce64 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Action: 'update', calling method: .version_select at 0x7f6467a2b550>, body: {"status": "enabled"} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:55:59.196205 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:59.196205 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:55:59.196976 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f060395-709a-43db-a017-4f3189ea4ba6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.488402 Feb 19 20:55:59.198179 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 650/1362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:58 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:59.202747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d2693d9-e865-43dc-9df1-9beebc148c94 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:59.203498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2d2693d9-e865-43dc-9df1-9beebc148c94 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:59.207640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57972229-2ca7-408e-a5c2-516abd9bce64 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:59.207830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57972229-2ca7-408e-a5c2-516abd9bce64 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:59.209848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d2693d9-e865-43dc-9df1-9beebc148c94 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:59.210508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d2693d9-e865-43dc-9df1-9beebc148c94 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:59.211103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d2693d9-e865-43dc-9df1-9beebc148c94 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:59.211544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d2693d9-e865-43dc-9df1-9beebc148c94 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:59.213876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57972229-2ca7-408e-a5c2-516abd9bce64 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:59.214614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57972229-2ca7-408e-a5c2-516abd9bce64 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:59.222604 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-57972229-2ca7-408e-a5c2-516abd9bce64 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] HTTP exception thrown: Service b8f9e2a6-33c9-498c-b1e4-e8b46726e98f could not be found. Feb 19 20:55:59.223198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57972229-2ca7-408e-a5c2-516abd9bce64 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Returning 404 to user: Service b8f9e2a6-33c9-498c-b1e4-e8b46726e98f could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:55:59.224024 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-57972229-2ca7-408e-a5c2-516abd9bce64 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/b8f9e2a6-33c9-498c-b1e4-e8b46726e98f" status: 404 len: 110 microversion: 2.53 time: 0.035140 Feb 19 20:55:59.229774 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 713/1363] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Feb 19 20:55:59 2022] PUT /compute/v2.1/os-services/b8f9e2a6-33c9-498c-b1e4-e8b46726e98f => generated 110 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:55:59.230352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-faba1c24-50ea-4a0b-8d4f-dc607b3c9d39 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Calling method '.version_select at 0x7f64679c6430>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:59.815746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d2693d9-e865-43dc-9df1-9beebc148c94 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:55:59.824118 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2d2693d9-e865-43dc-9df1-9beebc148c94 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1318 microversion: 2.1 time: 0.625080 Feb 19 20:55:59.824943 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 651/1364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:59 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:55:59.829452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d1339031-bc96-4f0b-bce9-1acc1734064b tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:59.831167 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:55:59.831167 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:55:59.833364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1339031-bc96-4f0b-bce9-1acc1734064b tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:59.834032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1339031-bc96-4f0b-bce9-1acc1734064b tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:59.835059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1339031-bc96-4f0b-bce9-1acc1734064b tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:59.835701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1339031-bc96-4f0b-bce9-1acc1734064b tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:59.866644 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d1339031-bc96-4f0b-bce9-1acc1734064b tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.040129 Feb 19 20:55:59.867608 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 652/1365] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Feb 19 20:55:59 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:55:59.873074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-07703da9-8066-45f8-a592-e67b901a3517 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:55:59.874180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-07703da9-8066-45f8-a592-e67b901a3517 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:55:59.882320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07703da9-8066-45f8-a592-e67b901a3517 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:59.883060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07703da9-8066-45f8-a592-e67b901a3517 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:55:59.884535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07703da9-8066-45f8-a592-e67b901a3517 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:55:59.885462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07703da9-8066-45f8-a592-e67b901a3517 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:00.379607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-07703da9-8066-45f8-a592-e67b901a3517 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:00.389989 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-07703da9-8066-45f8-a592-e67b901a3517 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1311 microversion: 2.1 time: 0.521123 Feb 19 20:56:00.400818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 653/1366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:55:59 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1311 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:00.509806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4d0a92f-6f94-4775-acd3-bf8cfc074d82 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:00.510422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c4d0a92f-6f94-4775-acd3-bf8cfc074d82 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:00.517016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4d0a92f-6f94-4775-acd3-bf8cfc074d82 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:00.517468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4d0a92f-6f94-4775-acd3-bf8cfc074d82 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:00.518858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4d0a92f-6f94-4775-acd3-bf8cfc074d82 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:00.519300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4d0a92f-6f94-4775-acd3-bf8cfc074d82 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:01.266705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4d0a92f-6f94-4775-acd3-bf8cfc074d82 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:01.276998 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c4d0a92f-6f94-4775-acd3-bf8cfc074d82 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.884458 Feb 19 20:56:01.277685 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 654/1367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:00 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:01.282077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f6e7ce92-50ef-46b7-b2ea-61ffcfd60251 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:01.284374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f6e7ce92-50ef-46b7-b2ea-61ffcfd60251 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:01.292054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6e7ce92-50ef-46b7-b2ea-61ffcfd60251 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:01.292906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6e7ce92-50ef-46b7-b2ea-61ffcfd60251 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:01.296078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6e7ce92-50ef-46b7-b2ea-61ffcfd60251 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:01.296826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6e7ce92-50ef-46b7-b2ea-61ffcfd60251 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:01.546044 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-faba1c24-50ea-4a0b-8d4f-dc607b3c9d39 tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/dceb5df2-1c30-41d6-8b0c-3e1ce6eaf307" status: 202 len: 0 microversion: 2.1 time: 2.319925 Feb 19 20:56:01.546710 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 714/1368] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:55:59 2022] DELETE /compute/v2.1/os-floating-ips/dceb5df2-1c30-41d6-8b0c-3e1ce6eaf307 => generated 0 bytes in 2321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:56:01.553146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57401d2e-d610-4816-b02b-f1220744ba88 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:01.554983 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:01.554983 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:01.558009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57401d2e-d610-4816-b02b-f1220744ba88 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:01.558615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57401d2e-d610-4816-b02b-f1220744ba88 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:01.559674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57401d2e-d610-4816-b02b-f1220744ba88 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:01.560128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57401d2e-d610-4816-b02b-f1220744ba88 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:01.586780 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-57401d2e-d610-4816-b02b-f1220744ba88 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.038892 Feb 19 20:56:01.587438 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 715/1369] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Feb 19 20:56:01 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:56:01.591915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e597f5c7-dbe4-4ae3-852f-440cc74a37ff tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:01.594267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e597f5c7-dbe4-4ae3-852f-440cc74a37ff tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:01.605387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e597f5c7-dbe4-4ae3-852f-440cc74a37ff tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:01.605722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e597f5c7-dbe4-4ae3-852f-440cc74a37ff tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:01.606513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e597f5c7-dbe4-4ae3-852f-440cc74a37ff tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:01.606948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e597f5c7-dbe4-4ae3-852f-440cc74a37ff tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:01.770588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f6e7ce92-50ef-46b7-b2ea-61ffcfd60251 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:01.779389 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f6e7ce92-50ef-46b7-b2ea-61ffcfd60251 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda" status: 200 len: 1468 microversion: 2.1 time: 0.500447 Feb 19 20:56:01.779869 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 655/1370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:01 2022] GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda => generated 1468 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:01.784648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5b587fdd-d6fd-4fee-b62d-94fcc89afc54 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:01.785462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5b587fdd-d6fd-4fee-b62d-94fcc89afc54 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:01.792037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b587fdd-d6fd-4fee-b62d-94fcc89afc54 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:01.792390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b587fdd-d6fd-4fee-b62d-94fcc89afc54 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:01.793310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b587fdd-d6fd-4fee-b62d-94fcc89afc54 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:01.793795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b587fdd-d6fd-4fee-b62d-94fcc89afc54 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:02.040016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e597f5c7-dbe4-4ae3-852f-440cc74a37ff tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:02.049009 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e597f5c7-dbe4-4ae3-852f-440cc74a37ff tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.460194 Feb 19 20:56:02.050157 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 716/1371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:01 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:02.055019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d0b07cd-1282-4328-a614-28e3c68ac8bf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:02.059205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1d0b07cd-1282-4328-a614-28e3c68ac8bf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:02.062355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d0b07cd-1282-4328-a614-28e3c68ac8bf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:02.062833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d0b07cd-1282-4328-a614-28e3c68ac8bf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:02.063870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d0b07cd-1282-4328-a614-28e3c68ac8bf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:02.064392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d0b07cd-1282-4328-a614-28e3c68ac8bf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:02.303649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5b587fdd-d6fd-4fee-b62d-94fcc89afc54 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:02.313098 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5b587fdd-d6fd-4fee-b62d-94fcc89afc54 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1318 microversion: 2.1 time: 0.532067 Feb 19 20:56:02.313699 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 656/1372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:01 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:02.323442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cdcbe415-c822-4d5b-b3ef-1360dd04359e tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Calling method '.version_select at 0x7f6467c3b700>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:02.628076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d0b07cd-1282-4328-a614-28e3c68ac8bf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:02.637422 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d0b07cd-1282-4328-a614-28e3c68ac8bf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1311 microversion: 2.1 time: 0.585463 Feb 19 20:56:02.647911 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 717/1373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:02 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1311 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:02.653041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bb1431e2-cd1c-493a-b20f-52ee18e80555 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:02.654506 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:02.654506 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:02.656073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb1431e2-cd1c-493a-b20f-52ee18e80555 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:02.657171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb1431e2-cd1c-493a-b20f-52ee18e80555 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:02.657406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb1431e2-cd1c-493a-b20f-52ee18e80555 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:02.657825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb1431e2-cd1c-493a-b20f-52ee18e80555 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:02.682048 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bb1431e2-cd1c-493a-b20f-52ee18e80555 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.032709 Feb 19 20:56:02.683288 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 718/1374] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Feb 19 20:56:02 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:56:02.687777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:02.691676 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:02.691676 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:02.692712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:02.693881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Searching by: {'reservation_id': 'r-md73mgtv', 'deleted': False, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:56:02.699290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:02.699796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:02.700671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:02.701109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:02.795562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:56:02.862316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:02.869001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:02.869453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:03.160851 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b1e3f2d0-a192-406b-8be3-10ae56efa0f5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-md73mgtv" status: 200 len: 2930 microversion: 2.1 time: 0.475944 Feb 19 20:56:03.161631 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 719/1375] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Feb 19 20:56:02 2022] GET /compute/v2.1/servers/detail?reservation_id=r-md73mgtv => generated 2930 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:03.174529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-53e39775-1f63-4847-bce2-3f0a456b469f req-69ca0e6a-46fd-45a5-9991-be75f62f2d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ece57c-a579-45c4-82fb-74b6ed0363e1", "tag": "5a3851e0-4e2d-4a66-9cec-b7694420e692"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:03.174529 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:03.174529 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:03.176552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-53e39775-1f63-4847-bce2-3f0a456b469f req-69ca0e6a-46fd-45a5-9991-be75f62f2d2d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:03.176988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-53e39775-1f63-4847-bce2-3f0a456b469f req-69ca0e6a-46fd-45a5-9991-be75f62f2d2d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:03.190489 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-53e39775-1f63-4847-bce2-3f0a456b469f req-69ca0e6a-46fd-45a5-9991-be75f62f2d2d service nova] Creating event network-changed:5a3851e0-4e2d-4a66-9cec-b7694420e692 for instance c0ece57c-a579-45c4-82fb-74b6ed0363e1 on nch1-master-1 Feb 19 20:56:03.197259 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-53e39775-1f63-4847-bce2-3f0a456b469f req-69ca0e6a-46fd-45a5-9991-be75f62f2d2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034156 Feb 19 20:56:03.197865 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 720/1376] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:03.203690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3d840e3a-d6ae-466e-bbc0-460cbd832c86 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:03.205341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3d840e3a-d6ae-466e-bbc0-460cbd832c86 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:03.213372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d840e3a-d6ae-466e-bbc0-460cbd832c86 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:03.213567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d840e3a-d6ae-466e-bbc0-460cbd832c86 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:03.214483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d840e3a-d6ae-466e-bbc0-460cbd832c86 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:03.215115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d840e3a-d6ae-466e-bbc0-460cbd832c86 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:03.552593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3d840e3a-d6ae-466e-bbc0-460cbd832c86 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:03.563680 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3d840e3a-d6ae-466e-bbc0-460cbd832c86 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1477 microversion: 2.1 time: 0.364422 Feb 19 20:56:03.564760 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 721/1377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:03 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1477 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:03.580559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-855b1b79-aeed-409a-91e1-5b8e4a62740e tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:03.581976 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:03.581976 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:03.583680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-855b1b79-aeed-409a-91e1-5b8e4a62740e tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:03.584245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-855b1b79-aeed-409a-91e1-5b8e4a62740e tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:03.585306 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-855b1b79-aeed-409a-91e1-5b8e4a62740e tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:03.585826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-855b1b79-aeed-409a-91e1-5b8e4a62740e tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:03.615924 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-855b1b79-aeed-409a-91e1-5b8e4a62740e tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.039618 Feb 19 20:56:03.616566 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 722/1378] 10.222.0.30 () {60 vars in 1236 bytes} [Sat Feb 19 20:56:03 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:03.627212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-04266bd2-1d86-44d9-9a89-9d3d1c58edfc tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:03.627994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-04266bd2-1d86-44d9-9a89-9d3d1c58edfc tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:03.634474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04266bd2-1d86-44d9-9a89-9d3d1c58edfc tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:03.635267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04266bd2-1d86-44d9-9a89-9d3d1c58edfc tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:03.635816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04266bd2-1d86-44d9-9a89-9d3d1c58edfc tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:03.636432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04266bd2-1d86-44d9-9a89-9d3d1c58edfc tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:04.227872 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cdcbe415-c822-4d5b-b3ef-1360dd04359e tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/3cb57389-71c5-4d31-acea-ecb289f005a4" status: 202 len: 0 microversion: 2.1 time: 1.913070 Feb 19 20:56:04.229896 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 657/1379] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:56:02 2022] DELETE /compute/v2.1/os-floating-ips/3cb57389-71c5-4d31-acea-ecb289f005a4 => generated 0 bytes in 1915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:56:04.236220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6f570990-d802-455a-9832-770a69591222 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:04.257673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.compute.server_groups [None req-6f570990-d802-455a-9832-770a69591222 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Querying cell 661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) for 2 instances {{(pid=136095) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 19 20:56:04.259097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f570990-d802-455a-9832-770a69591222 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:04.259710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f570990-d802-455a-9832-770a69591222 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:04.283790 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6f570990-d802-455a-9832-770a69591222 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/0263ea3c-24a8-4f5f-9169-9734e7c95978" status: 200 len: 271 microversion: 2.1 time: 0.052110 Feb 19 20:56:04.284522 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 658/1380] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:56:04 2022] GET /compute/v2.1/os-server-groups/0263ea3c-24a8-4f5f-9169-9734e7c95978 => generated 271 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:04.290559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5493c99a-937e-4a84-9183-e4d0e9f4fe5a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:04.291923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5493c99a-937e-4a84-9183-e4d0e9f4fe5a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:04.297932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5493c99a-937e-4a84-9183-e4d0e9f4fe5a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:04.298605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5493c99a-937e-4a84-9183-e4d0e9f4fe5a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:04.300851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5493c99a-937e-4a84-9183-e4d0e9f4fe5a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:04.301298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5493c99a-937e-4a84-9183-e4d0e9f4fe5a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:04.304130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-04266bd2-1d86-44d9-9a89-9d3d1c58edfc tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:04.315593 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-04266bd2-1d86-44d9-9a89-9d3d1c58edfc tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.693925 Feb 19 20:56:04.318887 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 723/1381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:03 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:04.332960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-061c0f28-c3bf-4a4f-96df-da82eb94b800 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:04.335740 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:04.335740 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:04.338238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-061c0f28-c3bf-4a4f-96df-da82eb94b800 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:04.339037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-061c0f28-c3bf-4a4f-96df-da82eb94b800 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:04.339868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-061c0f28-c3bf-4a4f-96df-da82eb94b800 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:04.340304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-061c0f28-c3bf-4a4f-96df-da82eb94b800 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:04.371968 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-061c0f28-c3bf-4a4f-96df-da82eb94b800 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.050447 Feb 19 20:56:04.372740 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 724/1382] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Feb 19 20:56:04 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:56:04.382352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5789ee2d-ba97-4c2e-9d92-c26fb10b28b1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:04.383072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5789ee2d-ba97-4c2e-9d92-c26fb10b28b1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:04.389225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5789ee2d-ba97-4c2e-9d92-c26fb10b28b1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:04.389681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5789ee2d-ba97-4c2e-9d92-c26fb10b28b1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:04.390474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5789ee2d-ba97-4c2e-9d92-c26fb10b28b1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:04.390916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5789ee2d-ba97-4c2e-9d92-c26fb10b28b1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:04.643192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5493c99a-937e-4a84-9183-e4d0e9f4fe5a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:04.650588 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5493c99a-937e-4a84-9183-e4d0e9f4fe5a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1318 microversion: 2.1 time: 0.364225 Feb 19 20:56:04.651274 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 659/1383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:04 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:04.663943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45686491-1148-4fee-b89d-a20c2503135b tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] Calling method '.version_select at 0x7f6467b9e0d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:04.684368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5789ee2d-ba97-4c2e-9d92-c26fb10b28b1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:04.692374 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5789ee2d-ba97-4c2e-9d92-c26fb10b28b1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1311 microversion: 2.1 time: 0.314710 Feb 19 20:56:04.693016 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 725/1384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:04 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1311 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:04.706673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0dba6409-ec04-4bac-96e9-f9c52768b286 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:04.707281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0dba6409-ec04-4bac-96e9-f9c52768b286 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:04.713248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dba6409-ec04-4bac-96e9-f9c52768b286 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:04.713693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dba6409-ec04-4bac-96e9-f9c52768b286 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:04.714566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dba6409-ec04-4bac-96e9-f9c52768b286 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:04.715031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dba6409-ec04-4bac-96e9-f9c52768b286 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:05.184383 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0dba6409-ec04-4bac-96e9-f9c52768b286 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda" status: 200 len: 1619 microversion: 2.1 time: 0.481597 Feb 19 20:56:05.185062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 726/1385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:04 2022] GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda => generated 1619 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:05.190805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-427b7b3a-fe77-4342-ad7b-c7b1163535b9 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:05.192403 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:05.192403 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:05.194667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-427b7b3a-fe77-4342-ad7b-c7b1163535b9 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:05.195184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-427b7b3a-fe77-4342-ad7b-c7b1163535b9 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:05.196802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-427b7b3a-fe77-4342-ad7b-c7b1163535b9 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:05.197839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-427b7b3a-fe77-4342-ad7b-c7b1163535b9 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:05.223596 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-427b7b3a-fe77-4342-ad7b-c7b1163535b9 tempest-ServicesAdminNegativeV253TestJSON-1644423909 tempest-ServicesAdminNegativeV253TestJSON-1644423909-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036798 Feb 19 20:56:05.224378 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 727/1386] 10.222.0.30 () {60 vars in 1238 bytes} [Sat Feb 19 20:56:05 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:05.231330 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-60f64297-29bc-469f-a5be-e226456a062e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:05.231952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-60f64297-29bc-469f-a5be-e226456a062e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:05.238380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60f64297-29bc-469f-a5be-e226456a062e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:05.238824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60f64297-29bc-469f-a5be-e226456a062e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:05.239604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60f64297-29bc-469f-a5be-e226456a062e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:05.240035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60f64297-29bc-469f-a5be-e226456a062e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:05.617075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-60f64297-29bc-469f-a5be-e226456a062e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:05.625927 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-60f64297-29bc-469f-a5be-e226456a062e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1476 microversion: 2.1 time: 0.400129 Feb 19 20:56:05.626698 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 728/1387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:05 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1476 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:05.632223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-497cbb21-aca3-467d-a133-be7134c63747 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:05.632868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-497cbb21-aca3-467d-a133-be7134c63747 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:05.642902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497cbb21-aca3-467d-a133-be7134c63747 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:05.643436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497cbb21-aca3-467d-a133-be7134c63747 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:05.644370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497cbb21-aca3-467d-a133-be7134c63747 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:05.644885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497cbb21-aca3-467d-a133-be7134c63747 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:06.010083 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-497cbb21-aca3-467d-a133-be7134c63747 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 200 len: 1620 microversion: 2.1 time: 0.381902 Feb 19 20:56:06.012373 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 729/1388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:05 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 1620 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:06.160754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7e06c759-7bd4-4e96-b90a-499944a2921a tempest-ServicesAdminNegativeV253TestJSON-5586228 tempest-ServicesAdminNegativeV253TestJSON-5586228-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:06.162049 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:06.162049 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:06.163375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7e06c759-7bd4-4e96-b90a-499944a2921a tempest-ServicesAdminNegativeV253TestJSON-5586228 tempest-ServicesAdminNegativeV253TestJSON-5586228-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a1a6b64d6ce34d408dba77434484aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba474a1f664d4cfcaea1fd186c243b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:06.164040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7e06c759-7bd4-4e96-b90a-499944a2921a tempest-ServicesAdminNegativeV253TestJSON-5586228 tempest-ServicesAdminNegativeV253TestJSON-5586228-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:06.164888 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7e06c759-7bd4-4e96-b90a-499944a2921a tempest-ServicesAdminNegativeV253TestJSON-5586228 tempest-ServicesAdminNegativeV253TestJSON-5586228-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.152980 Feb 19 20:56:06.171157 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 730/1389] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Feb 19 20:56:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:56:06.180854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-236dcced-9672-4345-8046-a324ea09b81e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:06.181821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-236dcced-9672-4345-8046-a324ea09b81e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:06.191089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-236dcced-9672-4345-8046-a324ea09b81e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:06.191557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-236dcced-9672-4345-8046-a324ea09b81e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:06.192448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-236dcced-9672-4345-8046-a324ea09b81e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:06.193015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-236dcced-9672-4345-8046-a324ea09b81e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:06.325754 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45686491-1148-4fee-b89d-a20c2503135b tempest-FloatingIPDetailsTestJSON-399934968 tempest-FloatingIPDetailsTestJSON-399934968-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/8648cb38-6ad4-467d-b3bd-ceb0d6473e82" status: 202 len: 0 microversion: 2.1 time: 1.673347 Feb 19 20:56:06.327056 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 660/1390] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:56:04 2022] DELETE /compute/v2.1/os-floating-ips/8648cb38-6ad4-467d-b3bd-ceb0d6473e82 => generated 0 bytes in 1675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:56:06.334106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c2e44373-5a4e-4dd6-91bf-db35b7b2a684 req-3210f2fc-b96d-4af1-b6e0-3ce5015a3138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a", "name": "network-vif-unplugged", "status": "completed", "tag": "baf844cf-250b-42ea-b385-80d607da7e79"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:06.335648 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:06.335648 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:06.355139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c2e44373-5a4e-4dd6-91bf-db35b7b2a684 req-3210f2fc-b96d-4af1-b6e0-3ce5015a3138 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:06.355434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c2e44373-5a4e-4dd6-91bf-db35b7b2a684 req-3210f2fc-b96d-4af1-b6e0-3ce5015a3138 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:06.379234 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c2e44373-5a4e-4dd6-91bf-db35b7b2a684 req-3210f2fc-b96d-4af1-b6e0-3ce5015a3138 service nova] Creating event network-vif-unplugged:baf844cf-250b-42ea-b385-80d607da7e79 for instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a on nch1-master-1 Feb 19 20:56:06.388141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-c2e44373-5a4e-4dd6-91bf-db35b7b2a684 req-3210f2fc-b96d-4af1-b6e0-3ce5015a3138 service nova] Instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:56:06.403793 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c2e44373-5a4e-4dd6-91bf-db35b7b2a684 req-3210f2fc-b96d-4af1-b6e0-3ce5015a3138 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074956 Feb 19 20:56:06.405183 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 661/1391] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:06.420313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-28af335c-48ae-4083-b6d2-b462ef576b9c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:06.421401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-28af335c-48ae-4083-b6d2-b462ef576b9c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:06.429254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28af335c-48ae-4083-b6d2-b462ef576b9c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:06.429981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28af335c-48ae-4083-b6d2-b462ef576b9c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:06.431335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28af335c-48ae-4083-b6d2-b462ef576b9c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:06.432791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28af335c-48ae-4083-b6d2-b462ef576b9c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:06.755234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-236dcced-9672-4345-8046-a324ea09b81e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:06.765522 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-236dcced-9672-4345-8046-a324ea09b81e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1505 microversion: 2.1 time: 0.592607 Feb 19 20:56:06.766366 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 731/1392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:06 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:06.779467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e1016a46-b51a-439f-922c-ead428965faa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:06.780232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e1016a46-b51a-439f-922c-ead428965faa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:06.787518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1016a46-b51a-439f-922c-ead428965faa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:06.788093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1016a46-b51a-439f-922c-ead428965faa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:06.789229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1016a46-b51a-439f-922c-ead428965faa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:06.789737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1016a46-b51a-439f-922c-ead428965faa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:06.884576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-28af335c-48ae-4083-b6d2-b462ef576b9c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:06.899705 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-28af335c-48ae-4083-b6d2-b462ef576b9c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1318 microversion: 2.1 time: 0.487366 Feb 19 20:56:06.900561 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 662/1393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:06 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:06.911684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-92925069", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "4c97b67a-8ac7-415a-8fd9-9b05f343eb16"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:06.968758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:56:07.644726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e1016a46-b51a-439f-922c-ead428965faa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:07.656911 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e1016a46-b51a-439f-922c-ead428965faa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1311 microversion: 2.1 time: 0.881772 Feb 19 20:56:07.657804 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 732/1394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:06 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1311 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:07.663331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a2f560d-b509-4e00-a36f-dc77a3d1839b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:07.664394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a2f560d-b509-4e00-a36f-dc77a3d1839b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:07.677857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a2f560d-b509-4e00-a36f-dc77a3d1839b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:07.679307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a2f560d-b509-4e00-a36f-dc77a3d1839b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:07.680309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a2f560d-b509-4e00-a36f-dc77a3d1839b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:07.681208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a2f560d-b509-4e00-a36f-dc77a3d1839b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:07.992223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:07.993575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:07.994961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:07.996577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:07.997752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:08.013998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.014590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.016411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.018217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.043670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:08.058283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:08.075381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:56:08.078750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:56:08.157191 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a2535352-5b00-40c3-adf0-db558412c187 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254315 Feb 19 20:56:08.160599 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 663/1395] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:56:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:56:08.172955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-caa9c3ee-4358-4927-b23a-579aa30251b7 req-071e0cb5-4ff5-4adf-8250-c02a0a569814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa80efa-1c90-4f4a-bb66-91e6e91c9db9", "name": "network-vif-plugged", "status": "completed", "tag": "29196269-26de-4888-9bd6-bdcde982f91c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:08.182583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a2f560d-b509-4e00-a36f-dc77a3d1839b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:08.193901 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a2f560d-b509-4e00-a36f-dc77a3d1839b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1476 microversion: 2.1 time: 0.534240 Feb 19 20:56:08.195265 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:08.195265 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:08.208222 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 733/1396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:07 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1476 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:08.220192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c0b86166-a190-486d-9462-c58b4ff7c335 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:08.221707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c0b86166-a190-486d-9462-c58b4ff7c335 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:08.223491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-caa9c3ee-4358-4927-b23a-579aa30251b7 req-071e0cb5-4ff5-4adf-8250-c02a0a569814 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.224269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-caa9c3ee-4358-4927-b23a-579aa30251b7 req-071e0cb5-4ff5-4adf-8250-c02a0a569814 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.247139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0b86166-a190-486d-9462-c58b4ff7c335 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.247528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0b86166-a190-486d-9462-c58b4ff7c335 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.249061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0b86166-a190-486d-9462-c58b4ff7c335 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.249253 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-caa9c3ee-4358-4927-b23a-579aa30251b7 req-071e0cb5-4ff5-4adf-8250-c02a0a569814 service nova] Creating event network-vif-plugged:29196269-26de-4888-9bd6-bdcde982f91c for instance 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 on nch2-master-1 Feb 19 20:56:08.249859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0b86166-a190-486d-9462-c58b4ff7c335 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.264754 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-caa9c3ee-4358-4927-b23a-579aa30251b7 req-071e0cb5-4ff5-4adf-8250-c02a0a569814 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095119 Feb 19 20:56:08.266897 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 664/1397] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:08.293327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-54b09d4b-fe52-4492-93ce-d3331950b047 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:08.294042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-54b09d4b-fe52-4492-93ce-d3331950b047 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:08.317146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-54b09d4b-fe52-4492-93ce-d3331950b047 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.319739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-54b09d4b-fe52-4492-93ce-d3331950b047 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.321818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-54b09d4b-fe52-4492-93ce-d3331950b047 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.323312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-54b09d4b-fe52-4492-93ce-d3331950b047 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.628359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c0b86166-a190-486d-9462-c58b4ff7c335 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:08.643554 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c0b86166-a190-486d-9462-c58b4ff7c335 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1485 microversion: 2.1 time: 0.433477 Feb 19 20:56:08.656362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 734/1398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:08 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1485 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:08.659054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-54b09d4b-fe52-4492-93ce-d3331950b047 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:08.663350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d439b7e2-0542-4722-911d-c3ea8312958b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:08.665035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d439b7e2-0542-4722-911d-c3ea8312958b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:08.687883 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-54b09d4b-fe52-4492-93ce-d3331950b047 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1318 microversion: 2.1 time: 0.419336 Feb 19 20:56:08.689896 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 665/1399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:08 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:08.699130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-795d2460-3010-49f8-bd47-31f004515f43 req-4901f4da-10c6-4274-9b0f-c625a9924a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a", "tag": "baf844cf-250b-42ea-b385-80d607da7e79"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:08.708098 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:08.708098 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:08.738761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-795d2460-3010-49f8-bd47-31f004515f43 req-4901f4da-10c6-4274-9b0f-c625a9924a40 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.742431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-795d2460-3010-49f8-bd47-31f004515f43 req-4901f4da-10c6-4274-9b0f-c625a9924a40 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.772872 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-795d2460-3010-49f8-bd47-31f004515f43 req-4901f4da-10c6-4274-9b0f-c625a9924a40 service nova] Creating event network-changed:baf844cf-250b-42ea-b385-80d607da7e79 for instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a on nch1-master-1 Feb 19 20:56:08.785994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-795d2460-3010-49f8-bd47-31f004515f43 req-4901f4da-10c6-4274-9b0f-c625a9924a40 service nova] Instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:56:08.794280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d439b7e2-0542-4722-911d-c3ea8312958b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:08.802088 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d439b7e2-0542-4722-911d-c3ea8312958b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1215 microversion: 2.1 time: 0.156118 Feb 19 20:56:08.802913 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 735/1400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:08 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:08.821727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-795d2460-3010-49f8-bd47-31f004515f43 req-4901f4da-10c6-4274-9b0f-c625a9924a40 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128253 Feb 19 20:56:08.822357 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 666/1401] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:08.826430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-255d8373-1cd1-4a42-9d0f-742707425dd2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:08.827359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-255d8373-1cd1-4a42-9d0f-742707425dd2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:08.840843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-255d8373-1cd1-4a42-9d0f-742707425dd2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.844022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-255d8373-1cd1-4a42-9d0f-742707425dd2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.845072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-255d8373-1cd1-4a42-9d0f-742707425dd2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:08.848272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-255d8373-1cd1-4a42-9d0f-742707425dd2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:08.860631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1067890597", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:08.933400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] validate_networks() for [('522a4889-4ca5-4003-88ab-4ec7fe7bb9fa', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:56:09.618078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-255d8373-1cd1-4a42-9d0f-742707425dd2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:09.625584 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-255d8373-1cd1-4a42-9d0f-742707425dd2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1311 microversion: 2.1 time: 0.811168 Feb 19 20:56:09.626482 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 736/1402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:08 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1311 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:09.633297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41ce674f-a93f-45fc-8c75-abbb254637bd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:09.633899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41ce674f-a93f-45fc-8c75-abbb254637bd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:09.640579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41ce674f-a93f-45fc-8c75-abbb254637bd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:09.641309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41ce674f-a93f-45fc-8c75-abbb254637bd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:09.642288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41ce674f-a93f-45fc-8c75-abbb254637bd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:09.642919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41ce674f-a93f-45fc-8c75-abbb254637bd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:10.454163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-41ce674f-a93f-45fc-8c75-abbb254637bd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:10.465133 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41ce674f-a93f-45fc-8c75-abbb254637bd tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1474 microversion: 2.1 time: 0.837476 Feb 19 20:56:10.477809 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 737/1403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:09 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1474 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:10.483779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d92351b2-bd1e-4b10-b1b3-d126c5ed2887 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:10.484764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d92351b2-bd1e-4b10-b1b3-d126c5ed2887 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:10.495176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d92351b2-bd1e-4b10-b1b3-d126c5ed2887 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:10.495967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d92351b2-bd1e-4b10-b1b3-d126c5ed2887 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:10.497236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d92351b2-bd1e-4b10-b1b3-d126c5ed2887 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:10.499019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d92351b2-bd1e-4b10-b1b3-d126c5ed2887 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:11.367857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:11.368383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:11.369047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:11.371164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:11.372552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:11.394297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:11.395453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:11.397193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:11.397986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:11.419466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Getting quotas for project 4e7060607f9342ad93e2ddbab97d8d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:11.424948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Getting quotas for user 605ee8b93b804ecc9f21177c4cbf0b2a and project 4e7060607f9342ad93e2ddbab97d8d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:11.442864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:56:11.447304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:56:11.490066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d92351b2-bd1e-4b10-b1b3-d126c5ed2887 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:11.499388 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d92351b2-bd1e-4b10-b1b3-d126c5ed2887 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1318 microversion: 2.1 time: 1.020116 Feb 19 20:56:11.500106 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 738/1404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:10 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1318 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:11.505269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a0afb786-6601-4b1b-a619-9dae5f37c872 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:11.506177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a0afb786-6601-4b1b-a619-9dae5f37c872 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:11.512556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0afb786-6601-4b1b-a619-9dae5f37c872 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:11.513349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0afb786-6601-4b1b-a619-9dae5f37c872 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:11.514367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0afb786-6601-4b1b-a619-9dae5f37c872 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:11.515108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0afb786-6601-4b1b-a619-9dae5f37c872 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:11.532018 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e8ca261a-2593-4e2f-bce5-2c2bfec904e0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.676605 Feb 19 20:56:11.535523 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 667/1405] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:56:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 20:56:11.542661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a5ebf739-9966-476c-bbaf-3a908b4193d9 req-8d4e0db4-211f-41d3-9cd5-108bf71cc46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ece57c-a579-45c4-82fb-74b6ed0363e1", "name": "network-vif-plugged", "status": "completed", "tag": "5a3851e0-4e2d-4a66-9cec-b7694420e692"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:11.544948 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:11.544948 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:11.553977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a5ebf739-9966-476c-bbaf-3a908b4193d9 req-8d4e0db4-211f-41d3-9cd5-108bf71cc46b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:11.554778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a5ebf739-9966-476c-bbaf-3a908b4193d9 req-8d4e0db4-211f-41d3-9cd5-108bf71cc46b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:11.571200 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a5ebf739-9966-476c-bbaf-3a908b4193d9 req-8d4e0db4-211f-41d3-9cd5-108bf71cc46b service nova] Creating event network-vif-plugged:5a3851e0-4e2d-4a66-9cec-b7694420e692 for instance c0ece57c-a579-45c4-82fb-74b6ed0363e1 on nch1-master-1 Feb 19 20:56:11.588942 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a5ebf739-9966-476c-bbaf-3a908b4193d9 req-8d4e0db4-211f-41d3-9cd5-108bf71cc46b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040714 Feb 19 20:56:11.593687 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 668/1406] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:11.606950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fccdbc0b-e675-4a04-ad6e-0c572654b315 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:11.607949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fccdbc0b-e675-4a04-ad6e-0c572654b315 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:11.625628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fccdbc0b-e675-4a04-ad6e-0c572654b315 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:11.626096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fccdbc0b-e675-4a04-ad6e-0c572654b315 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:11.630596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fccdbc0b-e675-4a04-ad6e-0c572654b315 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:11.631244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fccdbc0b-e675-4a04-ad6e-0c572654b315 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:11.829896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a0afb786-6601-4b1b-a619-9dae5f37c872 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:11.840148 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a0afb786-6601-4b1b-a619-9dae5f37c872 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1273 microversion: 2.1 time: 0.338299 Feb 19 20:56:11.840298 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 739/1407] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:11 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:11.868758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ca1bdb18-6a17-43fd-9429-1ae86df87291 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:11.869488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ca1bdb18-6a17-43fd-9429-1ae86df87291 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:11.880515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca1bdb18-6a17-43fd-9429-1ae86df87291 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:11.882627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca1bdb18-6a17-43fd-9429-1ae86df87291 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:11.885261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca1bdb18-6a17-43fd-9429-1ae86df87291 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:11.888727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca1bdb18-6a17-43fd-9429-1ae86df87291 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:12.192138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fccdbc0b-e675-4a04-ad6e-0c572654b315 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:12.201365 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fccdbc0b-e675-4a04-ad6e-0c572654b315 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1495 microversion: 2.1 time: 0.606392 Feb 19 20:56:12.212941 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 669/1408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:11 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1495 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:12.219866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1b79b59b-38f8-4cf2-87ee-b6dc66ccbfb8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:12.221385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1b79b59b-38f8-4cf2-87ee-b6dc66ccbfb8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:12.229239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b79b59b-38f8-4cf2-87ee-b6dc66ccbfb8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:12.229961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b79b59b-38f8-4cf2-87ee-b6dc66ccbfb8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:12.230989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b79b59b-38f8-4cf2-87ee-b6dc66ccbfb8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:12.231664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b79b59b-38f8-4cf2-87ee-b6dc66ccbfb8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:12.336967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1b79b59b-38f8-4cf2-87ee-b6dc66ccbfb8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:12.345844 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1b79b59b-38f8-4cf2-87ee-b6dc66ccbfb8 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1218 microversion: 2.1 time: 0.129114 Feb 19 20:56:12.356273 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 670/1409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:12 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:12.402313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ca1bdb18-6a17-43fd-9429-1ae86df87291 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:12.413899 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ca1bdb18-6a17-43fd-9429-1ae86df87291 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1471 microversion: 2.1 time: 0.558600 Feb 19 20:56:12.415658 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 740/1410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:11 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1471 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:12.579260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2119750727", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:12.698466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ba1d02d-a180-484c-8e2a-bac2a85d7d93 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:12.698466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ba1d02d-a180-484c-8e2a-bac2a85d7d93 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:12.702352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ba1d02d-a180-484c-8e2a-bac2a85d7d93 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:12.706236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ba1d02d-a180-484c-8e2a-bac2a85d7d93 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:12.707774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ba1d02d-a180-484c-8e2a-bac2a85d7d93 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:12.709749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ba1d02d-a180-484c-8e2a-bac2a85d7d93 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:12.726774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:56:13.366039 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ba1d02d-a180-484c-8e2a-bac2a85d7d93 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1646 microversion: 2.1 time: 0.948834 Feb 19 20:56:13.367311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 741/1411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:12 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1646 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:13.373472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-517e16e1-bac0-4289-b8d0-dd2ba156a13f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:13.374657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-517e16e1-bac0-4289-b8d0-dd2ba156a13f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:13.381716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517e16e1-bac0-4289-b8d0-dd2ba156a13f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:13.382255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517e16e1-bac0-4289-b8d0-dd2ba156a13f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:13.383336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517e16e1-bac0-4289-b8d0-dd2ba156a13f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:13.383977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517e16e1-bac0-4289-b8d0-dd2ba156a13f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:13.457235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:13.458039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:13.459402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:13.460194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:13.461563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:13.483568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:13.484705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:13.487293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:13.489391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:13.522389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Getting quotas for project ac7c7b1e5ce345fd99f7b69afd3a5554. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:13.531051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Getting quotas for user bb905e794fc44406911ef1d5b77cc26a and project ac7c7b1e5ce345fd99f7b69afd3a5554. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:13.547738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:56:13.551214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:56:13.584902 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-517e16e1-bac0-4289-b8d0-dd2ba156a13f tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "POST /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a/action" status: 202 len: 0 microversion: 2.1 time: 0.213537 Feb 19 20:56:13.585710 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 742/1412] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:56:13 2022] POST /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:56:13.600728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ea5e47b-9426-49ab-b00a-48e8389d2226 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:13.601885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ea5e47b-9426-49ab-b00a-48e8389d2226 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:13.613930 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7345c51e-f4c9-41f6-a451-49a3d2939063 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.256241 Feb 19 20:56:13.615818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 671/1413] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:56:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:56:13.622321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ea5e47b-9426-49ab-b00a-48e8389d2226 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:13.622541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-428c07ad-255d-4cf3-b140-ef01401d171f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:13.623321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-428c07ad-255d-4cf3-b140-ef01401d171f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:13.623538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ea5e47b-9426-49ab-b00a-48e8389d2226 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:13.624630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ea5e47b-9426-49ab-b00a-48e8389d2226 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:13.625818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ea5e47b-9426-49ab-b00a-48e8389d2226 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:13.632630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-428c07ad-255d-4cf3-b140-ef01401d171f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:13.633370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-428c07ad-255d-4cf3-b140-ef01401d171f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:13.634277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-428c07ad-255d-4cf3-b140-ef01401d171f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:13.635419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-428c07ad-255d-4cf3-b140-ef01401d171f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:14.160369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ea5e47b-9426-49ab-b00a-48e8389d2226 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:14.168837 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ea5e47b-9426-49ab-b00a-48e8389d2226 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1507 microversion: 2.1 time: 0.581227 Feb 19 20:56:14.169454 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 743/1414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:13 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1507 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:14.184928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-428c07ad-255d-4cf3-b140-ef01401d171f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:14.185332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4a5410d-a8bd-4879-8371-68c607d86218 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:14.186322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e4a5410d-a8bd-4879-8371-68c607d86218 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:14.193877 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-428c07ad-255d-4cf3-b140-ef01401d171f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1315 microversion: 2.1 time: 0.576644 Feb 19 20:56:14.206420 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 672/1415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:13 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:14.209845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4a5410d-a8bd-4879-8371-68c607d86218 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:14.210825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4a5410d-a8bd-4879-8371-68c607d86218 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:14.211917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4a5410d-a8bd-4879-8371-68c607d86218 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:14.212630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4a5410d-a8bd-4879-8371-68c607d86218 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:14.214169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-438d59a4-e50a-47c0-894f-46132df5482a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:14.217063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-438d59a4-e50a-47c0-894f-46132df5482a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:14.230789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-438d59a4-e50a-47c0-894f-46132df5482a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:14.231505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-438d59a4-e50a-47c0-894f-46132df5482a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:14.245579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-438d59a4-e50a-47c0-894f-46132df5482a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:14.246049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-438d59a4-e50a-47c0-894f-46132df5482a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:14.349896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e4a5410d-a8bd-4879-8371-68c607d86218 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:14.358029 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e4a5410d-a8bd-4879-8371-68c607d86218 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1272 microversion: 2.1 time: 0.187566 Feb 19 20:56:14.359630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 744/1416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:14 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:14.364901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-435f85fc-81d9-4d52-bef1-0307d34e777a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:14.365724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-435f85fc-81d9-4d52-bef1-0307d34e777a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:14.374929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435f85fc-81d9-4d52-bef1-0307d34e777a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:14.375727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435f85fc-81d9-4d52-bef1-0307d34e777a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:14.376875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435f85fc-81d9-4d52-bef1-0307d34e777a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:14.378243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435f85fc-81d9-4d52-bef1-0307d34e777a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:14.921540 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-438d59a4-e50a-47c0-894f-46132df5482a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1646 microversion: 2.1 time: 0.713595 Feb 19 20:56:14.925154 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 673/1417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:14 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1646 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:14.935722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-bce8904f-7e0c-4408-a234-80f2538d56b1 req-7db62e9a-d502-4ed4-afbc-50ff80edd0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a", "name": "network-vif-plugged", "status": "completed", "tag": "baf844cf-250b-42ea-b385-80d607da7e79"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:14.941599 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:14.941599 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:14.958704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-bce8904f-7e0c-4408-a234-80f2538d56b1 req-7db62e9a-d502-4ed4-afbc-50ff80edd0e7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:14.959480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-bce8904f-7e0c-4408-a234-80f2538d56b1 req-7db62e9a-d502-4ed4-afbc-50ff80edd0e7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:14.967426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-435f85fc-81d9-4d52-bef1-0307d34e777a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:14.975405 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-435f85fc-81d9-4d52-bef1-0307d34e777a tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1470 microversion: 2.1 time: 0.614562 Feb 19 20:56:14.976935 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-bce8904f-7e0c-4408-a234-80f2538d56b1 req-7db62e9a-d502-4ed4-afbc-50ff80edd0e7 service nova] Creating event network-vif-plugged:baf844cf-250b-42ea-b385-80d607da7e79 for instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a on nch1-master-1 Feb 19 20:56:14.979909 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 745/1418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:14 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1470 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:14.985495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ad2bd42-fbbd-4474-b914-0356911520b0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:14.989174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ad2bd42-fbbd-4474-b914-0356911520b0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:14.995503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-bce8904f-7e0c-4408-a234-80f2538d56b1 req-7db62e9a-d502-4ed4-afbc-50ff80edd0e7 service nova] Instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:56:15.007436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ad2bd42-fbbd-4474-b914-0356911520b0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:15.007950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ad2bd42-fbbd-4474-b914-0356911520b0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:15.009028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ad2bd42-fbbd-4474-b914-0356911520b0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:15.009635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ad2bd42-fbbd-4474-b914-0356911520b0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:15.016700 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-bce8904f-7e0c-4408-a234-80f2538d56b1 req-7db62e9a-d502-4ed4-afbc-50ff80edd0e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090134 Feb 19 20:56:15.017804 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 674/1419] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:15.024972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e452ed54-4a0e-4166-a53d-09dee0449bdb tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:15.025920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e452ed54-4a0e-4166-a53d-09dee0449bdb tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:15.032690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e452ed54-4a0e-4166-a53d-09dee0449bdb tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:15.033383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e452ed54-4a0e-4166-a53d-09dee0449bdb tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:15.034870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e452ed54-4a0e-4166-a53d-09dee0449bdb tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:15.035815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e452ed54-4a0e-4166-a53d-09dee0449bdb tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:15.202706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ad2bd42-fbbd-4474-b914-0356911520b0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb905e794fc44406911ef1d5b77cc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:15.210298 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ad2bd42-fbbd-4474-b914-0356911520b0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 200 len: 1274 microversion: 2.1 time: 0.228471 Feb 19 20:56:15.210880 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 746/1420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:14 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:15.347312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1739901544", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "0b77203b-47b2-4bd5-a7b7-432923f05242"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:15.417321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] validate_networks() for [('0b77203b-47b2-4bd5-a7b7-432923f05242', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:56:15.432681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e452ed54-4a0e-4166-a53d-09dee0449bdb tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:15.442772 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e452ed54-4a0e-4166-a53d-09dee0449bdb tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1507 microversion: 2.1 time: 0.423708 Feb 19 20:56:15.443897 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 675/1421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:15 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:15.448530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a3df7320-4b66-4fd0-91d2-f2a47ba18a2c req-ca4d99b2-9c7d-4091-9423-b469c2e12a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba0c692-3aec-4680-a3f6-e88127dd525d", "tag": "f5cb9be2-7b1d-4cd2-91be-100fad1c21de"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:15.450096 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:15.450096 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:15.457661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a3df7320-4b66-4fd0-91d2-f2a47ba18a2c req-ca4d99b2-9c7d-4091-9423-b469c2e12a42 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:15.458158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a3df7320-4b66-4fd0-91d2-f2a47ba18a2c req-ca4d99b2-9c7d-4091-9423-b469c2e12a42 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:15.470160 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a3df7320-4b66-4fd0-91d2-f2a47ba18a2c req-ca4d99b2-9c7d-4091-9423-b469c2e12a42 service nova] Creating event network-changed:f5cb9be2-7b1d-4cd2-91be-100fad1c21de for instance 4ba0c692-3aec-4680-a3f6-e88127dd525d on nch1-master-1 Feb 19 20:56:15.475763 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a3df7320-4b66-4fd0-91d2-f2a47ba18a2c req-ca4d99b2-9c7d-4091-9423-b469c2e12a42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030707 Feb 19 20:56:15.476396 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 676/1422] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:15.481593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3d7fbfa2-1433-422f-93d0-d5cb2ef47314 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:15.482946 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:15.482946 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:15.484513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3d7fbfa2-1433-422f-93d0-d5cb2ef47314 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:15.485059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3d7fbfa2-1433-422f-93d0-d5cb2ef47314 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:15.485797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3d7fbfa2-1433-422f-93d0-d5cb2ef47314 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:15.486275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3d7fbfa2-1433-422f-93d0-d5cb2ef47314 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:15.512233 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3d7fbfa2-1433-422f-93d0-d5cb2ef47314 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034386 Feb 19 20:56:15.516498 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 677/1423] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Feb 19 20:56:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:15.520713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c7c4290-d512-47fe-b998-fd85816b1395 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:15.521469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3c7c4290-d512-47fe-b998-fd85816b1395 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:15.528060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c7c4290-d512-47fe-b998-fd85816b1395 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:15.528781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c7c4290-d512-47fe-b998-fd85816b1395 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:15.529716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c7c4290-d512-47fe-b998-fd85816b1395 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:15.530151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c7c4290-d512-47fe-b998-fd85816b1395 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:16.339746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c7c4290-d512-47fe-b998-fd85816b1395 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:16.348731 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c7c4290-d512-47fe-b998-fd85816b1395 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1315 microversion: 2.1 time: 0.834317 Feb 19 20:56:16.349316 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 678/1424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:15 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:16.354762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-366fa9a0-d7ba-4894-ab82-cde201077e07 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:16.355594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-366fa9a0-d7ba-4894-ab82-cde201077e07 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:16.362611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-366fa9a0-d7ba-4894-ab82-cde201077e07 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:16.363344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-366fa9a0-d7ba-4894-ab82-cde201077e07 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:16.364310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-366fa9a0-d7ba-4894-ab82-cde201077e07 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:16.364928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-366fa9a0-d7ba-4894-ab82-cde201077e07 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:16.791080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:16.791578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:16.792193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:16.792760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:16.793235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:16.804231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:16.804979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:16.805803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:16.806726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:16.831100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-366fa9a0-d7ba-4894-ab82-cde201077e07 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:16.835564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Getting quotas for project b959eb07a97740dca63d3cf3d2ed0a63. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:16.840707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Getting quotas for user 5a3a1e86138d41b991f5e44a1e8ae2eb and project b959eb07a97740dca63d3cf3d2ed0a63. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:16.843115 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-366fa9a0-d7ba-4894-ab82-cde201077e07 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.492560 Feb 19 20:56:16.844316 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 679/1425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:16 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:16.855602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c219c248-d0c0-48bd-8dc8-fbdf7b2eb538 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:16.856740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c219c248-d0c0-48bd-8dc8-fbdf7b2eb538 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:16.861982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:56:16.864740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:56:16.866287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c219c248-d0c0-48bd-8dc8-fbdf7b2eb538 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:16.867494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c219c248-d0c0-48bd-8dc8-fbdf7b2eb538 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:16.868809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c219c248-d0c0-48bd-8dc8-fbdf7b2eb538 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:16.869384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c219c248-d0c0-48bd-8dc8-fbdf7b2eb538 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:16.956274 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0505ef7d-b9fd-4d5a-936e-919076325f41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.743392 Feb 19 20:56:16.962077 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 747/1426] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:56:16.971229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-53863b05-ed2d-48b7-b3e9-ffab0913a440 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:16.973609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-53863b05-ed2d-48b7-b3e9-ffab0913a440 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:16.980873 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c219c248-d0c0-48bd-8dc8-fbdf7b2eb538 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "PUT /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1079 microversion: 2.1 time: 0.135141 Feb 19 20:56:16.981944 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 680/1427] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 20:56:16 2022] PUT /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1079 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:16.990724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-69bf289e-4350-4a22-ad68-4835a91a7c57 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:16.991335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-69bf289e-4350-4a22-ad68-4835a91a7c57 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:16.992902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-53863b05-ed2d-48b7-b3e9-ffab0913a440 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:16.993371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-53863b05-ed2d-48b7-b3e9-ffab0913a440 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:16.994169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-53863b05-ed2d-48b7-b3e9-ffab0913a440 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:16.994603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-53863b05-ed2d-48b7-b3e9-ffab0913a440 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:17.005770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69bf289e-4350-4a22-ad68-4835a91a7c57 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:17.006550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69bf289e-4350-4a22-ad68-4835a91a7c57 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:17.008726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69bf289e-4350-4a22-ad68-4835a91a7c57 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:17.009406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69bf289e-4350-4a22-ad68-4835a91a7c57 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:17.047570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-53863b05-ed2d-48b7-b3e9-ffab0913a440 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lazy-loading 'flavor' on Instance uuid 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:56:17.071415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-53863b05-ed2d-48b7-b3e9-ffab0913a440 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Going to try to live migrate instance to nch1-master-1 {{(pid=136094) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 20:56:17.391486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-69bf289e-4350-4a22-ad68-4835a91a7c57 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:17.400707 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-69bf289e-4350-4a22-ad68-4835a91a7c57 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1470 microversion: 2.1 time: 0.417379 Feb 19 20:56:17.408674 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 681/1428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:16 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1470 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:17.415870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-df1ee945-33cf-4989-9eed-6b4356ca5547 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:17.417554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-df1ee945-33cf-4989-9eed-6b4356ca5547 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:17.440221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df1ee945-33cf-4989-9eed-6b4356ca5547 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:17.441115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df1ee945-33cf-4989-9eed-6b4356ca5547 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:17.442267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df1ee945-33cf-4989-9eed-6b4356ca5547 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:17.442948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df1ee945-33cf-4989-9eed-6b4356ca5547 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:17.911171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-df1ee945-33cf-4989-9eed-6b4356ca5547 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb905e794fc44406911ef1d5b77cc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:17.921327 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-df1ee945-33cf-4989-9eed-6b4356ca5547 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 200 len: 1314 microversion: 2.1 time: 0.511317 Feb 19 20:56:17.922579 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 682/1429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:17 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:18.030351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-42355e06-0891-40fa-b490-6fba2325d9cb req-af4c53fb-6abd-472d-9e68-3cabd42222e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eaee1c7-bade-4297-9c88-df64b809a763", "tag": "d9d53a10-25f3-4c06-8b46-bd8bdfc071ea"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:18.031882 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:18.031882 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:18.040462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-42355e06-0891-40fa-b490-6fba2325d9cb req-af4c53fb-6abd-472d-9e68-3cabd42222e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:18.041163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-42355e06-0891-40fa-b490-6fba2325d9cb req-af4c53fb-6abd-472d-9e68-3cabd42222e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:18.056899 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-42355e06-0891-40fa-b490-6fba2325d9cb req-af4c53fb-6abd-472d-9e68-3cabd42222e6 service nova] Creating event network-changed:d9d53a10-25f3-4c06-8b46-bd8bdfc071ea for instance 9eaee1c7-bade-4297-9c88-df64b809a763 on nch1-master-1 Feb 19 20:56:18.062137 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-42355e06-0891-40fa-b490-6fba2325d9cb req-af4c53fb-6abd-472d-9e68-3cabd42222e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136824 Feb 19 20:56:18.063493 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 683/1430] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:18.068897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b0894e6a-4eac-4036-ac2c-9262f9ba26c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:18.069870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b0894e6a-4eac-4036-ac2c-9262f9ba26c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:18.077479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0894e6a-4eac-4036-ac2c-9262f9ba26c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:18.077933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0894e6a-4eac-4036-ac2c-9262f9ba26c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:18.078739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0894e6a-4eac-4036-ac2c-9262f9ba26c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:18.079176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0894e6a-4eac-4036-ac2c-9262f9ba26c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:18.193870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b0894e6a-4eac-4036-ac2c-9262f9ba26c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:18.202078 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b0894e6a-4eac-4036-ac2c-9262f9ba26c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1260 microversion: 2.1 time: 0.137026 Feb 19 20:56:18.202678 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 684/1431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:18 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1260 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:18.217639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-178da4ed-5eac-4a11-8908-2f49b76cd0fe tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:18.218675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-178da4ed-5eac-4a11-8908-2f49b76cd0fe tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:18.237044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-178da4ed-5eac-4a11-8908-2f49b76cd0fe tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:18.237502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-178da4ed-5eac-4a11-8908-2f49b76cd0fe tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:18.238314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-178da4ed-5eac-4a11-8908-2f49b76cd0fe tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:18.238756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-178da4ed-5eac-4a11-8908-2f49b76cd0fe tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:18.924729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-178da4ed-5eac-4a11-8908-2f49b76cd0fe tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:18.933375 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-178da4ed-5eac-4a11-8908-2f49b76cd0fe tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1505 microversion: 2.1 time: 0.719448 Feb 19 20:56:18.935443 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 685/1432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:18 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1505 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:18.942069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d58bff08-9eca-4ea6-a071-23eb44d158f9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:18.942887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d58bff08-9eca-4ea6-a071-23eb44d158f9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:18.951077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d58bff08-9eca-4ea6-a071-23eb44d158f9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:18.951820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d58bff08-9eca-4ea6-a071-23eb44d158f9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:18.953230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d58bff08-9eca-4ea6-a071-23eb44d158f9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:18.954023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d58bff08-9eca-4ea6-a071-23eb44d158f9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:19.632573 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-53863b05-ed2d-48b7-b3e9-ffab0913a440 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9/action" status: 202 len: 0 microversion: 2.1 time: 2.668765 Feb 19 20:56:19.636706 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 748/1433] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:56:16 2022] POST /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9/action => generated 0 bytes in 2671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:56:19.641248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5b8290be-17cb-423e-beb1-a6761c735d9b req-82f76b49-92d8-4e7f-992d-4b22f45fb853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59252cac-71fd-4839-8d62-e20d42abc8cb", "tag": "31d6bb39-99dc-4d88-9fb6-3d09d608c1ea"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:19.643164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d58bff08-9eca-4ea6-a071-23eb44d158f9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:19.644733 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:19.644733 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:19.653883 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d58bff08-9eca-4ea6-a071-23eb44d158f9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1315 microversion: 2.1 time: 0.717171 Feb 19 20:56:19.654644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5b8290be-17cb-423e-beb1-a6761c735d9b req-82f76b49-92d8-4e7f-992d-4b22f45fb853 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:19.655158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5b8290be-17cb-423e-beb1-a6761c735d9b req-82f76b49-92d8-4e7f-992d-4b22f45fb853 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:19.657225 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 686/1434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:18 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:19.661957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e3dbca8b-902a-4229-838c-ebba62d6794a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:19.662563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e3dbca8b-902a-4229-838c-ebba62d6794a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:19.668595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e3dbca8b-902a-4229-838c-ebba62d6794a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:19.669175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e3dbca8b-902a-4229-838c-ebba62d6794a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:19.669978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e3dbca8b-902a-4229-838c-ebba62d6794a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:19.670407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e3dbca8b-902a-4229-838c-ebba62d6794a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:19.684898 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5b8290be-17cb-423e-beb1-a6761c735d9b req-82f76b49-92d8-4e7f-992d-4b22f45fb853 service nova] Creating event network-changed:31d6bb39-99dc-4d88-9fb6-3d09d608c1ea for instance 59252cac-71fd-4839-8d62-e20d42abc8cb on nch2-master-1 Feb 19 20:56:19.691899 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5b8290be-17cb-423e-beb1-a6761c735d9b req-82f76b49-92d8-4e7f-992d-4b22f45fb853 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056450 Feb 19 20:56:19.692924 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 749/1435] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:19.699932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7d738d32-e64c-4b72-9803-190ff8267ad0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:19.701549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7d738d32-e64c-4b72-9803-190ff8267ad0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:19.719548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d738d32-e64c-4b72-9803-190ff8267ad0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:19.720892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d738d32-e64c-4b72-9803-190ff8267ad0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:19.721751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d738d32-e64c-4b72-9803-190ff8267ad0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:19.722402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d738d32-e64c-4b72-9803-190ff8267ad0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.074681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e3dbca8b-902a-4229-838c-ebba62d6794a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:20.087579 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e3dbca8b-902a-4229-838c-ebba62d6794a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.429226 Feb 19 20:56:20.089068 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 687/1436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:19 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:20.101644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a5244f4b-eb50-4208-ac0a-f4110e549889 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:20.102660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a5244f4b-eb50-4208-ac0a-f4110e549889 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:20.112775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5244f4b-eb50-4208-ac0a-f4110e549889 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.113611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5244f4b-eb50-4208-ac0a-f4110e549889 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.115138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5244f4b-eb50-4208-ac0a-f4110e549889 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.115841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5244f4b-eb50-4208-ac0a-f4110e549889 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.138983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7d738d32-e64c-4b72-9803-190ff8267ad0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:20.165167 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7d738d32-e64c-4b72-9803-190ff8267ad0 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1470 microversion: 2.1 time: 0.470851 Feb 19 20:56:20.165944 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 750/1437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:19 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1470 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:20.170729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a9356fe4-c6c5-45d6-9a31-f0ec23e3ec61 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:20.171722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a9356fe4-c6c5-45d6-9a31-f0ec23e3ec61 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:20.181009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9356fe4-c6c5-45d6-9a31-f0ec23e3ec61 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.185121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9356fe4-c6c5-45d6-9a31-f0ec23e3ec61 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.186456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9356fe4-c6c5-45d6-9a31-f0ec23e3ec61 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.187128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9356fe4-c6c5-45d6-9a31-f0ec23e3ec61 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.396675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a5244f4b-eb50-4208-ac0a-f4110e549889 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb905e794fc44406911ef1d5b77cc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:20.412503 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a5244f4b-eb50-4208-ac0a-f4110e549889 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 200 len: 1314 microversion: 2.1 time: 0.321493 Feb 19 20:56:20.420803 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 688/1438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:20 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:20.434042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ed7511e-18a4-4fd7-b422-8157eabdd9ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:20.434940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ed7511e-18a4-4fd7-b422-8157eabdd9ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:20.445087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ed7511e-18a4-4fd7-b422-8157eabdd9ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.446750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ed7511e-18a4-4fd7-b422-8157eabdd9ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.447629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ed7511e-18a4-4fd7-b422-8157eabdd9ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.448071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ed7511e-18a4-4fd7-b422-8157eabdd9ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.548368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a9356fe4-c6c5-45d6-9a31-f0ec23e3ec61 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:20.558394 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a9356fe4-c6c5-45d6-9a31-f0ec23e3ec61 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1505 microversion: 2.1 time: 0.391247 Feb 19 20:56:20.568217 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 751/1439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:20 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:20.568217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dc3b70de-130b-4fab-ac0a-0e75a541ecae tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:20.568217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dc3b70de-130b-4fab-ac0a-0e75a541ecae tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:20.580483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc3b70de-130b-4fab-ac0a-0e75a541ecae tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.582762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc3b70de-130b-4fab-ac0a-0e75a541ecae tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.583580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc3b70de-130b-4fab-ac0a-0e75a541ecae tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.584023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc3b70de-130b-4fab-ac0a-0e75a541ecae tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.710752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ed7511e-18a4-4fd7-b422-8157eabdd9ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:20.721257 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ed7511e-18a4-4fd7-b422-8157eabdd9ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.304617 Feb 19 20:56:20.732099 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 689/1440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:20 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:20.740191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6ac5ed37-17df-4aa0-8771-dc6893f27845 req-5ad61724-967d-4f9d-ba65-a062fbede96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a", "name": "network-vif-unplugged", "status": "completed", "tag": "baf844cf-250b-42ea-b385-80d607da7e79"}, {"name": "network-changed", "server_uuid": "de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a", "tag": "baf844cf-250b-42ea-b385-80d607da7e79"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:20.742172 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:20.742172 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:20.749693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6ac5ed37-17df-4aa0-8771-dc6893f27845 req-5ad61724-967d-4f9d-ba65-a062fbede96c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.750391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6ac5ed37-17df-4aa0-8771-dc6893f27845 req-5ad61724-967d-4f9d-ba65-a062fbede96c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.763498 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6ac5ed37-17df-4aa0-8771-dc6893f27845 req-5ad61724-967d-4f9d-ba65-a062fbede96c service nova] Creating event network-vif-unplugged:baf844cf-250b-42ea-b385-80d607da7e79 for instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a on nch2-master-1 Feb 19 20:56:20.764260 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6ac5ed37-17df-4aa0-8771-dc6893f27845 req-5ad61724-967d-4f9d-ba65-a062fbede96c service nova] Creating event network-changed:baf844cf-250b-42ea-b385-80d607da7e79 for instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a on nch2-master-1 Feb 19 20:56:20.771144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-6ac5ed37-17df-4aa0-8771-dc6893f27845 req-5ad61724-967d-4f9d-ba65-a062fbede96c service nova] Instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 20:56:20.786351 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6ac5ed37-17df-4aa0-8771-dc6893f27845 req-5ad61724-967d-4f9d-ba65-a062fbede96c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.052095 Feb 19 20:56:20.787715 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 690/1441] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:20.795623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:20.797415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:20.810995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.811875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.813975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:20.815965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:20.927602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:20.928162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:20.928668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:20.929081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:20.929494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:20.995385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:20.999754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dc3b70de-130b-4fab-ac0a-0e75a541ecae tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:21.007328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.009186 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dc3b70de-130b-4fab-ac0a-0e75a541ecae tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1505 microversion: 2.1 time: 0.448759 Feb 19 20:56:21.009672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:21.009909 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 752/1442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:20 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:21.012751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.013720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:21.014256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-50ba554c-b05d-410a-b59a-202809eeeca1 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:21.024917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-50ba554c-b05d-410a-b59a-202809eeeca1 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:21.043992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50ba554c-b05d-410a-b59a-202809eeeca1 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.044484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50ba554c-b05d-410a-b59a-202809eeeca1 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:21.045289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50ba554c-b05d-410a-b59a-202809eeeca1 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.045728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50ba554c-b05d-410a-b59a-202809eeeca1 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:21.059753 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5ca4a0eb-54ac-49a1-87c3-cff4b58aa2a8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "POST /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1/action" status: 202 len: 1111 microversion: 2.1 time: 0.267769 Feb 19 20:56:21.060821 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 691/1443] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:56:20 2022] POST /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1/action => generated 1111 bytes in 272 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 19 20:56:21.077426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fb4e7378-9a80-4c7b-8a0f-fd4959366d8d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:21.078141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fb4e7378-9a80-4c7b-8a0f-fd4959366d8d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:21.096564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb4e7378-9a80-4c7b-8a0f-fd4959366d8d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.097039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb4e7378-9a80-4c7b-8a0f-fd4959366d8d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:21.098054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb4e7378-9a80-4c7b-8a0f-fd4959366d8d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.098494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb4e7378-9a80-4c7b-8a0f-fd4959366d8d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:21.559532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-50ba554c-b05d-410a-b59a-202809eeeca1 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:21.562413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb4e7378-9a80-4c7b-8a0f-fd4959366d8d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:21.569816 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-50ba554c-b05d-410a-b59a-202809eeeca1 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1315 microversion: 2.1 time: 0.558437 Feb 19 20:56:21.570299 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fb4e7378-9a80-4c7b-8a0f-fd4959366d8d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.496608 Feb 19 20:56:21.579633 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 753/1444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:21 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:21.580708 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 692/1445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:21 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:21.583911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3b1c5b05-a648-4d6b-88cd-db9035ea8cd3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:21.584552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3b1c5b05-a648-4d6b-88cd-db9035ea8cd3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:21.585502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-77a09e85-4599-472c-a96d-e5a751ac286b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:21.585989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-77a09e85-4599-472c-a96d-e5a751ac286b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:21.593092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77a09e85-4599-472c-a96d-e5a751ac286b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.593583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b1c5b05-a648-4d6b-88cd-db9035ea8cd3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.593984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77a09e85-4599-472c-a96d-e5a751ac286b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:21.594129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b1c5b05-a648-4d6b-88cd-db9035ea8cd3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:21.594823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b1c5b05-a648-4d6b-88cd-db9035ea8cd3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.595261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b1c5b05-a648-4d6b-88cd-db9035ea8cd3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:21.596047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77a09e85-4599-472c-a96d-e5a751ac286b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:21.596721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77a09e85-4599-472c-a96d-e5a751ac286b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.016183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-77a09e85-4599-472c-a96d-e5a751ac286b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:22.031480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-77a09e85-4599-472c-a96d-e5a751ac286b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1470 microversion: 2.1 time: 0.448668 Feb 19 20:56:22.032472 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 693/1446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:21 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:22.046681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f931b0b3-9e60-4d5d-93b8-05284123b213 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:22.047174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3b1c5b05-a648-4d6b-88cd-db9035ea8cd3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:22.049413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f931b0b3-9e60-4d5d-93b8-05284123b213 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:22.057323 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3b1c5b05-a648-4d6b-88cd-db9035ea8cd3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.477771 Feb 19 20:56:22.058034 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 754/1447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:21 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:22.062738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f931b0b3-9e60-4d5d-93b8-05284123b213 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.063776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-43e9c470-70f6-40c6-8396-c79ae31f254d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:22.068907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f931b0b3-9e60-4d5d-93b8-05284123b213 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.069957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f931b0b3-9e60-4d5d-93b8-05284123b213 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.070563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f931b0b3-9e60-4d5d-93b8-05284123b213 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.075733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-43e9c470-70f6-40c6-8396-c79ae31f254d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:22.097846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43e9c470-70f6-40c6-8396-c79ae31f254d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.101364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43e9c470-70f6-40c6-8396-c79ae31f254d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.103886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43e9c470-70f6-40c6-8396-c79ae31f254d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.104554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43e9c470-70f6-40c6-8396-c79ae31f254d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.461014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f931b0b3-9e60-4d5d-93b8-05284123b213 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb905e794fc44406911ef1d5b77cc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:22.467471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-43e9c470-70f6-40c6-8396-c79ae31f254d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:22.472173 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f931b0b3-9e60-4d5d-93b8-05284123b213 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 200 len: 1314 microversion: 2.1 time: 0.437476 Feb 19 20:56:22.479351 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 694/1448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:22 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:22.482907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-89a8505f-d8ab-4c90-9344-dc1d7d742f14 req-9f62d21b-105b-43fb-9847-c20f451a8487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eaee1c7-bade-4297-9c88-df64b809a763", "name": "network-vif-plugged", "status": "completed", "tag": "d9d53a10-25f3-4c06-8b46-bd8bdfc071ea"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:22.484286 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-43e9c470-70f6-40c6-8396-c79ae31f254d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.424964 Feb 19 20:56:22.484511 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:22.484511 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:22.493571 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 755/1449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:22 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:22.493571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83f035b0-1def-42cf-acbf-f57678f557df tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:22.493571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83f035b0-1def-42cf-acbf-f57678f557df tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:22.493972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-89a8505f-d8ab-4c90-9344-dc1d7d742f14 req-9f62d21b-105b-43fb-9847-c20f451a8487 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.493972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-89a8505f-d8ab-4c90-9344-dc1d7d742f14 req-9f62d21b-105b-43fb-9847-c20f451a8487 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.498955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83f035b0-1def-42cf-acbf-f57678f557df tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.499402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83f035b0-1def-42cf-acbf-f57678f557df tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.500190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83f035b0-1def-42cf-acbf-f57678f557df tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.500815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83f035b0-1def-42cf-acbf-f57678f557df tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.506252 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-89a8505f-d8ab-4c90-9344-dc1d7d742f14 req-9f62d21b-105b-43fb-9847-c20f451a8487 service nova] Creating event network-vif-plugged:d9d53a10-25f3-4c06-8b46-bd8bdfc071ea for instance 9eaee1c7-bade-4297-9c88-df64b809a763 on nch1-master-1 Feb 19 20:56:22.513563 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-89a8505f-d8ab-4c90-9344-dc1d7d742f14 req-9f62d21b-105b-43fb-9847-c20f451a8487 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038437 Feb 19 20:56:22.514629 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 695/1450] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:22.523340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-af44e9d9-4ca4-4cd6-a43a-18eccc7718d8 req-802daa19-411f-4f69-909b-93400bc46785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d927e050-ac38-4b26-8aa5-14f490410068", "tag": "ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:22.525684 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:22.525684 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:22.543453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-af44e9d9-4ca4-4cd6-a43a-18eccc7718d8 req-802daa19-411f-4f69-909b-93400bc46785 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.543902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-af44e9d9-4ca4-4cd6-a43a-18eccc7718d8 req-802daa19-411f-4f69-909b-93400bc46785 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.555617 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-af44e9d9-4ca4-4cd6-a43a-18eccc7718d8 req-802daa19-411f-4f69-909b-93400bc46785 service nova] Creating event network-changed:ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c for instance d927e050-ac38-4b26-8aa5-14f490410068 on nch2-master-1 Feb 19 20:56:22.560754 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-af44e9d9-4ca4-4cd6-a43a-18eccc7718d8 req-802daa19-411f-4f69-909b-93400bc46785 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044737 Feb 19 20:56:22.561364 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 696/1451] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:22.587520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-879e043b-b5be-470f-b844-ac93d4348aec tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:22.588366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-879e043b-b5be-470f-b844-ac93d4348aec tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:22.594750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-879e043b-b5be-470f-b844-ac93d4348aec tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.595201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-879e043b-b5be-470f-b844-ac93d4348aec tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:22.596609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-879e043b-b5be-470f-b844-ac93d4348aec tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:22.597039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-879e043b-b5be-470f-b844-ac93d4348aec tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.189065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83f035b0-1def-42cf-acbf-f57678f557df tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:23.196912 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83f035b0-1def-42cf-acbf-f57678f557df tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1505 microversion: 2.1 time: 0.710649 Feb 19 20:56:23.197616 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 756/1452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:22 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1505 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:23.202766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a7d91ce5-c936-4539-8238-733b3ae29d05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:23.203620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a7d91ce5-c936-4539-8238-733b3ae29d05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:23.211154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7d91ce5-c936-4539-8238-733b3ae29d05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.211681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7d91ce5-c936-4539-8238-733b3ae29d05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.212758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7d91ce5-c936-4539-8238-733b3ae29d05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.213260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7d91ce5-c936-4539-8238-733b3ae29d05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.225429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-879e043b-b5be-470f-b844-ac93d4348aec tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:23.233935 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-879e043b-b5be-470f-b844-ac93d4348aec tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1315 microversion: 2.1 time: 0.650544 Feb 19 20:56:23.234532 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 697/1453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:22 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:23.251138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b59ee53d-b34e-4030-8c07-b2a3d854be5c req-9b805fd0-eaa1-46f9-b908-fbae5393a1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa80efa-1c90-4f4a-bb66-91e6e91c9db9", "name": "network-vif-unplugged", "status": "completed", "tag": "29196269-26de-4888-9bd6-bdcde982f91c"}, {"name": "network-changed", "server_uuid": "5aa80efa-1c90-4f4a-bb66-91e6e91c9db9", "tag": "29196269-26de-4888-9bd6-bdcde982f91c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:23.253061 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:23.253061 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:23.264670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b59ee53d-b34e-4030-8c07-b2a3d854be5c req-9b805fd0-eaa1-46f9-b908-fbae5393a1a3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.265422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b59ee53d-b34e-4030-8c07-b2a3d854be5c req-9b805fd0-eaa1-46f9-b908-fbae5393a1a3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.278974 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b59ee53d-b34e-4030-8c07-b2a3d854be5c req-9b805fd0-eaa1-46f9-b908-fbae5393a1a3 service nova] Creating event network-vif-unplugged:29196269-26de-4888-9bd6-bdcde982f91c for instance 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 on nch2-master-1 Feb 19 20:56:23.279721 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b59ee53d-b34e-4030-8c07-b2a3d854be5c req-9b805fd0-eaa1-46f9-b908-fbae5393a1a3 service nova] Creating event network-changed:29196269-26de-4888-9bd6-bdcde982f91c for instance 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 on nch2-master-1 Feb 19 20:56:23.285172 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b59ee53d-b34e-4030-8c07-b2a3d854be5c req-9b805fd0-eaa1-46f9-b908-fbae5393a1a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.037966 Feb 19 20:56:23.285770 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 698/1454] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:23.299756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6acca698-f415-44b7-aed9-8fbbe6c7e29c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:23.300499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6acca698-f415-44b7-aed9-8fbbe6c7e29c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:23.307078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6acca698-f415-44b7-aed9-8fbbe6c7e29c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.307523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6acca698-f415-44b7-aed9-8fbbe6c7e29c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.308305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6acca698-f415-44b7-aed9-8fbbe6c7e29c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.308942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6acca698-f415-44b7-aed9-8fbbe6c7e29c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.518068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a7d91ce5-c936-4539-8238-733b3ae29d05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:23.539559 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a7d91ce5-c936-4539-8238-733b3ae29d05 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.339647 Feb 19 20:56:23.549816 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 757/1455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:23 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:23.549816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00e13bc1-9970-4556-ac61-f414bc1ec64c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:23.549816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-00e13bc1-9970-4556-ac61-f414bc1ec64c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:23.557790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00e13bc1-9970-4556-ac61-f414bc1ec64c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.558559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00e13bc1-9970-4556-ac61-f414bc1ec64c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.560085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00e13bc1-9970-4556-ac61-f414bc1ec64c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.560820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00e13bc1-9970-4556-ac61-f414bc1ec64c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.593502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6acca698-f415-44b7-aed9-8fbbe6c7e29c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:23.604268 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6acca698-f415-44b7-aed9-8fbbe6c7e29c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1470 microversion: 2.1 time: 0.308913 Feb 19 20:56:23.605844 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 699/1456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:23 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:23.612117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71bd5f6e-3bb7-4f92-834c-ec8fd37e92f4 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:23.613076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-71bd5f6e-3bb7-4f92-834c-ec8fd37e92f4 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:23.624381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71bd5f6e-3bb7-4f92-834c-ec8fd37e92f4 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.624945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71bd5f6e-3bb7-4f92-834c-ec8fd37e92f4 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.625790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71bd5f6e-3bb7-4f92-834c-ec8fd37e92f4 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.626227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71bd5f6e-3bb7-4f92-834c-ec8fd37e92f4 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.955887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-00e13bc1-9970-4556-ac61-f414bc1ec64c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:23.963904 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-00e13bc1-9970-4556-ac61-f414bc1ec64c tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.422236 Feb 19 20:56:23.964773 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 758/1457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:23 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:23.973432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-71bd5f6e-3bb7-4f92-834c-ec8fd37e92f4 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb905e794fc44406911ef1d5b77cc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:23.973815 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71bd5f6e-3bb7-4f92-834c-ec8fd37e92f4 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 200 len: 1314 microversion: 2.1 time: 0.366225 Feb 19 20:56:23.974681 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 700/1458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:23 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:23.985290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-81c99a71-676b-42a2-84ef-b481cf8b2492 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:23.986632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-81c99a71-676b-42a2-84ef-b481cf8b2492 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:23.992871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81c99a71-676b-42a2-84ef-b481cf8b2492 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.993401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81c99a71-676b-42a2-84ef-b481cf8b2492 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:23.994354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81c99a71-676b-42a2-84ef-b481cf8b2492 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:23.994854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81c99a71-676b-42a2-84ef-b481cf8b2492 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.182624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-81c99a71-676b-42a2-84ef-b481cf8b2492 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:24.190177 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-81c99a71-676b-42a2-84ef-b481cf8b2492 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.209035 Feb 19 20:56:24.190758 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 759/1459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:23 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:24.214551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-41e16d40-459c-4399-8943-c785fed0cbbd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:24.215158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-41e16d40-459c-4399-8943-c785fed0cbbd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:24.224557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41e16d40-459c-4399-8943-c785fed0cbbd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.225011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41e16d40-459c-4399-8943-c785fed0cbbd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.225790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41e16d40-459c-4399-8943-c785fed0cbbd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.226221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41e16d40-459c-4399-8943-c785fed0cbbd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.251471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d6eb2186-a39e-4783-88e1-0a7c04a44724 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:24.252243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d6eb2186-a39e-4783-88e1-0a7c04a44724 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:24.258378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6eb2186-a39e-4783-88e1-0a7c04a44724 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.258824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6eb2186-a39e-4783-88e1-0a7c04a44724 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.259594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6eb2186-a39e-4783-88e1-0a7c04a44724 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.260023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6eb2186-a39e-4783-88e1-0a7c04a44724 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.435316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-41e16d40-459c-4399-8943-c785fed0cbbd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:24.443225 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-41e16d40-459c-4399-8943-c785fed0cbbd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1505 microversion: 2.1 time: 0.232285 Feb 19 20:56:24.443801 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 701/1460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:24 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:24.448581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6eb2186-a39e-4783-88e1-0a7c04a44724 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:24.457086 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d6eb2186-a39e-4783-88e1-0a7c04a44724 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1315 microversion: 2.1 time: 0.210160 Feb 19 20:56:24.457673 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 760/1461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:24 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:24.527764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c2a95cf0-9c45-4890-b104-2360a0b17b77 req-4ac5953b-2ebc-4467-b808-bfc991f9e6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba0c692-3aec-4680-a3f6-e88127dd525d", "name": "network-vif-plugged", "status": "completed", "tag": "f5cb9be2-7b1d-4cd2-91be-100fad1c21de"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:24.529350 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:24.529350 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:24.536161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c2a95cf0-9c45-4890-b104-2360a0b17b77 req-4ac5953b-2ebc-4467-b808-bfc991f9e6ec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.536662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c2a95cf0-9c45-4890-b104-2360a0b17b77 req-4ac5953b-2ebc-4467-b808-bfc991f9e6ec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.546982 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c2a95cf0-9c45-4890-b104-2360a0b17b77 req-4ac5953b-2ebc-4467-b808-bfc991f9e6ec service nova] Creating event network-vif-plugged:f5cb9be2-7b1d-4cd2-91be-100fad1c21de for instance 4ba0c692-3aec-4680-a3f6-e88127dd525d on nch1-master-1 Feb 19 20:56:24.551558 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c2a95cf0-9c45-4890-b104-2360a0b17b77 req-4ac5953b-2ebc-4467-b808-bfc991f9e6ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027407 Feb 19 20:56:24.552172 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 702/1462] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:24.557336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6086fb2b-6881-458c-94eb-c0f7c491fbb4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:24.557950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6086fb2b-6881-458c-94eb-c0f7c491fbb4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:24.568492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6086fb2b-6881-458c-94eb-c0f7c491fbb4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.568954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6086fb2b-6881-458c-94eb-c0f7c491fbb4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.569759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6086fb2b-6881-458c-94eb-c0f7c491fbb4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.570201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6086fb2b-6881-458c-94eb-c0f7c491fbb4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.635791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3534e1fe-4091-4d53-b3ef-ad9692726516 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:24.636613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3534e1fe-4091-4d53-b3ef-ad9692726516 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:24.644686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3534e1fe-4091-4d53-b3ef-ad9692726516 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.645152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3534e1fe-4091-4d53-b3ef-ad9692726516 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.645954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3534e1fe-4091-4d53-b3ef-ad9692726516 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.646592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3534e1fe-4091-4d53-b3ef-ad9692726516 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.790882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6086fb2b-6881-458c-94eb-c0f7c491fbb4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:24.798931 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6086fb2b-6881-458c-94eb-c0f7c491fbb4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.245344 Feb 19 20:56:24.799871 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 761/1463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:24 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:24.881586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3534e1fe-4091-4d53-b3ef-ad9692726516 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:24.889091 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3534e1fe-4091-4d53-b3ef-ad9692726516 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1470 microversion: 2.1 time: 0.262708 Feb 19 20:56:24.889682 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 703/1464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:24 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:24.980106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-053125f6-1a70-435e-90b0-9c3bf98ee6f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:24.980783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-053125f6-1a70-435e-90b0-9c3bf98ee6f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:24.986648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-053125f6-1a70-435e-90b0-9c3bf98ee6f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.987106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-053125f6-1a70-435e-90b0-9c3bf98ee6f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.987893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-053125f6-1a70-435e-90b0-9c3bf98ee6f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.988354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-053125f6-1a70-435e-90b0-9c3bf98ee6f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.990162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4d29a3b2-e55f-4f60-b586-76576ded5ef0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:24.990878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4d29a3b2-e55f-4f60-b586-76576ded5ef0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:24.996658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d29a3b2-e55f-4f60-b586-76576ded5ef0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.997114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d29a3b2-e55f-4f60-b586-76576ded5ef0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:24.997900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d29a3b2-e55f-4f60-b586-76576ded5ef0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:24.998341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d29a3b2-e55f-4f60-b586-76576ded5ef0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.188445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-053125f6-1a70-435e-90b0-9c3bf98ee6f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:25.193123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4d29a3b2-e55f-4f60-b586-76576ded5ef0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb905e794fc44406911ef1d5b77cc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:25.196446 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-053125f6-1a70-435e-90b0-9c3bf98ee6f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.220068 Feb 19 20:56:25.197020 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 762/1465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:24 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:25.201073 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4d29a3b2-e55f-4f60-b586-76576ded5ef0 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 200 len: 1464 microversion: 2.1 time: 0.214731 Feb 19 20:56:25.201887 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 704/1466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:24 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 1464 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:25.207405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-20118659-b522-4cf6-a479-979758bff4d0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:25.208013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-20118659-b522-4cf6-a479-979758bff4d0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:25.214076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20118659-b522-4cf6-a479-979758bff4d0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.214533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20118659-b522-4cf6-a479-979758bff4d0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.215316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20118659-b522-4cf6-a479-979758bff4d0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.215751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20118659-b522-4cf6-a479-979758bff4d0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.321910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-92484270-9022-4e51-96d4-c1aa7ffb7302 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Calling method '.version_select at 0x7f6467a89040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:25.331687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92484270-9022-4e51-96d4-c1aa7ffb7302 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.332133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92484270-9022-4e51-96d4-c1aa7ffb7302 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.348474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92484270-9022-4e51-96d4-c1aa7ffb7302 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.349058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92484270-9022-4e51-96d4-c1aa7ffb7302 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.349978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-20118659-b522-4cf6-a479-979758bff4d0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:25.357414 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-20118659-b522-4cf6-a479-979758bff4d0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.154087 Feb 19 20:56:25.357987 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 763/1467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:25 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:25.368244 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-92484270-9022-4e51-96d4-c1aa7ffb7302 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/ac7c7b1e5ce345fd99f7b69afd3a5554?start=2022-02-18T20%3A56%3A25.211357&end=2022-02-20T20%3A56%3A25.211357" status: 200 len: 700 microversion: 2.1 time: 0.153422 Feb 19 20:56:25.368861 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 705/1468] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Feb 19 20:56:25 2022] GET /compute/v2.1/os-simple-tenant-usage/ac7c7b1e5ce345fd99f7b69afd3a5554?start=2022-02-18T20%3A56%3A25.211357&end=2022-02-20T20%3A56%3A25.211357 => generated 700 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:25.381313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68fc352f-9a06-4b00-947f-d2c113f7a1fd tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '.version_select at 0x7f6467bfdaf0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:25.391208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68fc352f-9a06-4b00-947f-d2c113f7a1fd tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.391651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68fc352f-9a06-4b00-947f-d2c113f7a1fd tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.406911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68fc352f-9a06-4b00-947f-d2c113f7a1fd tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.407346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68fc352f-9a06-4b00-947f-d2c113f7a1fd tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.424502 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-68fc352f-9a06-4b00-947f-d2c113f7a1fd tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/ac7c7b1e5ce345fd99f7b69afd3a5554?start=2022-02-18T20%3A56%3A25.211357&end=2022-02-20T20%3A56%3A25.211357" status: 200 len: 700 microversion: 2.1 time: 0.046155 Feb 19 20:56:25.425068 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 764/1469] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Feb 19 20:56:25 2022] GET /compute/v2.1/os-simple-tenant-usage/ac7c7b1e5ce345fd99f7b69afd3a5554?start=2022-02-18T20%3A56%3A25.211357&end=2022-02-20T20%3A56%3A25.211357 => generated 700 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:25.437227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e5d69b14-6c76-4c77-8154-2c7cfd714296 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Calling method '.version_select at 0x7f6467a890d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:25.438558 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:25.438558 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:25.444777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5d69b14-6c76-4c77-8154-2c7cfd714296 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.445221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5d69b14-6c76-4c77-8154-2c7cfd714296 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.459761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8df5bd7f-d8e3-46a2-8566-8b14d360ef45 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:25.460614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8df5bd7f-d8e3-46a2-8566-8b14d360ef45 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:25.462012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5d69b14-6c76-4c77-8154-2c7cfd714296 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.462566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5d69b14-6c76-4c77-8154-2c7cfd714296 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.467489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8df5bd7f-d8e3-46a2-8566-8b14d360ef45 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.468127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8df5bd7f-d8e3-46a2-8566-8b14d360ef45 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.469216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8df5bd7f-d8e3-46a2-8566-8b14d360ef45 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.469908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8df5bd7f-d8e3-46a2-8566-8b14d360ef45 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.544119 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e5d69b14-6c76-4c77-8154-2c7cfd714296 tempest-TenantUsagesTestJSON-339294657 tempest-TenantUsagesTestJSON-339294657-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-02-18T20%3A56%3A25.211357&end=2022-02-20T20%3A56%3A25.211357&detailed=1" status: 200 len: 19710 microversion: 2.1 time: 0.109516 Feb 19 20:56:25.545921 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 706/1470] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Feb 19 20:56:25 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-02-18T20%3A56%3A25.211357&end=2022-02-20T20%3A56%3A25.211357&detailed=1 => generated 19710 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 20:56:25.545921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-80b2075d-28e1-40fb-b772-302220d4f2c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:25.545921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-80b2075d-28e1-40fb-b772-302220d4f2c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:25.545921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80b2075d-28e1-40fb-b772-302220d4f2c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.545921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80b2075d-28e1-40fb-b772-302220d4f2c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.545921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80b2075d-28e1-40fb-b772-302220d4f2c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.545921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80b2075d-28e1-40fb-b772-302220d4f2c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.644673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8df5bd7f-d8e3-46a2-8566-8b14d360ef45 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:25.652995 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8df5bd7f-d8e3-46a2-8566-8b14d360ef45 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1505 microversion: 2.1 time: 0.197102 Feb 19 20:56:25.663603 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 765/1471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:25 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:25.669855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cbf18392-8a59-4720-9f93-a3ce26e10aed tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:25.670367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cbf18392-8a59-4720-9f93-a3ce26e10aed tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:25.676495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cbf18392-8a59-4720-9f93-a3ce26e10aed tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.677579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cbf18392-8a59-4720-9f93-a3ce26e10aed tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.678387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cbf18392-8a59-4720-9f93-a3ce26e10aed tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.678826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cbf18392-8a59-4720-9f93-a3ce26e10aed tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.715919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cbf18392-8a59-4720-9f93-a3ce26e10aed tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:56:25.739865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-80b2075d-28e1-40fb-b772-302220d4f2c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:25.747630 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-80b2075d-28e1-40fb-b772-302220d4f2c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1315 microversion: 2.1 time: 0.200390 Feb 19 20:56:25.748368 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 707/1472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:25 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:25.799549 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cbf18392-8a59-4720-9f93-a3ce26e10aed tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 204 len: 0 microversion: 2.1 time: 0.133780 Feb 19 20:56:25.800545 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 766/1473] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:56:25 2022] DELETE /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:56:25.808869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-700108ce-a0bd-4fc5-ba41-67a32152fb9e tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:25.809538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-700108ce-a0bd-4fc5-ba41-67a32152fb9e tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:25.816470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-700108ce-a0bd-4fc5-ba41-67a32152fb9e tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.816948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-700108ce-a0bd-4fc5-ba41-67a32152fb9e tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.817502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2558ed34-03ff-483b-8a9c-975e4b8deb3e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:25.817784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-700108ce-a0bd-4fc5-ba41-67a32152fb9e tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.818198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2558ed34-03ff-483b-8a9c-975e4b8deb3e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:25.818333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-700108ce-a0bd-4fc5-ba41-67a32152fb9e tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.823965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2558ed34-03ff-483b-8a9c-975e4b8deb3e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.824452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2558ed34-03ff-483b-8a9c-975e4b8deb3e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:25.825225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2558ed34-03ff-483b-8a9c-975e4b8deb3e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:25.825660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2558ed34-03ff-483b-8a9c-975e4b8deb3e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.025736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-700108ce-a0bd-4fc5-ba41-67a32152fb9e tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb905e794fc44406911ef1d5b77cc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:26.032439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2558ed34-03ff-483b-8a9c-975e4b8deb3e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:26.033299 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-700108ce-a0bd-4fc5-ba41-67a32152fb9e tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 200 len: 1470 microversion: 2.1 time: 0.228430 Feb 19 20:56:26.033886 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 708/1474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:25 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:26.038977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9140a307-505c-4415-8550-416f8f745218 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:26.039592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9140a307-505c-4415-8550-416f8f745218 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:26.040027 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2558ed34-03ff-483b-8a9c-975e4b8deb3e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.227663 Feb 19 20:56:26.040731 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 767/1475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:25 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:26.045432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9140a307-505c-4415-8550-416f8f745218 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.045902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9140a307-505c-4415-8550-416f8f745218 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.046855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9140a307-505c-4415-8550-416f8f745218 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.047301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9140a307-505c-4415-8550-416f8f745218 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.179850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9140a307-505c-4415-8550-416f8f745218 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:26.187260 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9140a307-505c-4415-8550-416f8f745218 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1463 microversion: 2.1 time: 0.152448 Feb 19 20:56:26.188017 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 709/1476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:26 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:26.212850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c278af9-246d-4f3e-a9f6-43f887461f9a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:26.213461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c278af9-246d-4f3e-a9f6-43f887461f9a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:26.219165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c278af9-246d-4f3e-a9f6-43f887461f9a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.219722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c278af9-246d-4f3e-a9f6-43f887461f9a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.220657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c278af9-246d-4f3e-a9f6-43f887461f9a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.221130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c278af9-246d-4f3e-a9f6-43f887461f9a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.313408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a607703d-3b01-4cf5-826a-05eb757583df tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:26.314032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a607703d-3b01-4cf5-826a-05eb757583df tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:26.321563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a607703d-3b01-4cf5-826a-05eb757583df tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.322153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a607703d-3b01-4cf5-826a-05eb757583df tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.323052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a607703d-3b01-4cf5-826a-05eb757583df tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.323574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a607703d-3b01-4cf5-826a-05eb757583df tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.372830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c278af9-246d-4f3e-a9f6-43f887461f9a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:26.380794 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c278af9-246d-4f3e-a9f6-43f887461f9a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.171392 Feb 19 20:56:26.381365 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 710/1477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:26 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:26.385480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-484c8ddd-585e-429f-bf0c-6cd5d3a1ca08 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:26.386070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-484c8ddd-585e-429f-bf0c-6cd5d3a1ca08 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:26.391568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-484c8ddd-585e-429f-bf0c-6cd5d3a1ca08 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.392012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-484c8ddd-585e-429f-bf0c-6cd5d3a1ca08 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.392803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-484c8ddd-585e-429f-bf0c-6cd5d3a1ca08 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.393261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-484c8ddd-585e-429f-bf0c-6cd5d3a1ca08 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.492681 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a607703d-3b01-4cf5-826a-05eb757583df tempest-MigrationsAdminTest-123295761 tempest-MigrationsAdminTest-123295761-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1614 microversion: 2.1 time: 0.292865 Feb 19 20:56:26.493272 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 768/1478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:26 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1614 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:26.517722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a1a5ce33-026b-424c-a118-71786e86eae8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:26.518216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a1a5ce33-026b-424c-a118-71786e86eae8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:26.523979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1a5ce33-026b-424c-a118-71786e86eae8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.524454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1a5ce33-026b-424c-a118-71786e86eae8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.525226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1a5ce33-026b-424c-a118-71786e86eae8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.525660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1a5ce33-026b-424c-a118-71786e86eae8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.550315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a1a5ce33-026b-424c-a118-71786e86eae8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:56:26.550492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-484c8ddd-585e-429f-bf0c-6cd5d3a1ca08 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:26.557881 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-484c8ddd-585e-429f-bf0c-6cd5d3a1ca08 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.175595 Feb 19 20:56:26.558451 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 711/1479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:26 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:26.623021 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a1a5ce33-026b-424c-a118-71786e86eae8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "DELETE /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 204 len: 0 microversion: 2.1 time: 0.108701 Feb 19 20:56:26.623605 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 769/1480] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:56:26 2022] DELETE /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 20:56:26.631495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-812f44e7-f3b4-4dbb-8d62-76e1e09e19da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:26.632103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-812f44e7-f3b4-4dbb-8d62-76e1e09e19da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:26.638762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-812f44e7-f3b4-4dbb-8d62-76e1e09e19da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.639269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-812f44e7-f3b4-4dbb-8d62-76e1e09e19da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.640079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-812f44e7-f3b4-4dbb-8d62-76e1e09e19da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.640548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-812f44e7-f3b4-4dbb-8d62-76e1e09e19da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.670911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5428067-ea71-4fed-abbc-46674ef0b5f6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:26.671613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d5428067-ea71-4fed-abbc-46674ef0b5f6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:26.678766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5428067-ea71-4fed-abbc-46674ef0b5f6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.679240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5428067-ea71-4fed-abbc-46674ef0b5f6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.680017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5428067-ea71-4fed-abbc-46674ef0b5f6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.680473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5428067-ea71-4fed-abbc-46674ef0b5f6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.822220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-812f44e7-f3b4-4dbb-8d62-76e1e09e19da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:26.830167 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-812f44e7-f3b4-4dbb-8d62-76e1e09e19da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1469 microversion: 2.1 time: 0.202288 Feb 19 20:56:26.830746 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 712/1481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:26 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1469 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:26.834988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-276fe117-eb0e-4aa9-a21c-0d2c96652d68 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:26.835580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-276fe117-eb0e-4aa9-a21c-0d2c96652d68 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:26.841153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-276fe117-eb0e-4aa9-a21c-0d2c96652d68 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.841595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-276fe117-eb0e-4aa9-a21c-0d2c96652d68 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.842364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-276fe117-eb0e-4aa9-a21c-0d2c96652d68 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:26.842794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-276fe117-eb0e-4aa9-a21c-0d2c96652d68 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:26.860895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d5428067-ea71-4fed-abbc-46674ef0b5f6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:26.868788 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5428067-ea71-4fed-abbc-46674ef0b5f6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1505 microversion: 2.1 time: 0.201807 Feb 19 20:56:26.869372 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 770/1482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:26 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:26.974824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-276fe117-eb0e-4aa9-a21c-0d2c96652d68 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:26.982014 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-276fe117-eb0e-4aa9-a21c-0d2c96652d68 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1315 microversion: 2.1 time: 0.150264 Feb 19 20:56:26.982581 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 713/1483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:26 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:27.050070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6a180853-0181-4960-b96b-cca00e104e91 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:27.050719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6a180853-0181-4960-b96b-cca00e104e91 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:27.056155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dcc4fb2c-225e-4256-98f1-0db109a6f7c0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:27.056977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a180853-0181-4960-b96b-cca00e104e91 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.057098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dcc4fb2c-225e-4256-98f1-0db109a6f7c0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:27.057430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a180853-0181-4960-b96b-cca00e104e91 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.058217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a180853-0181-4960-b96b-cca00e104e91 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.058661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a180853-0181-4960-b96b-cca00e104e91 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.063379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcc4fb2c-225e-4256-98f1-0db109a6f7c0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.064009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcc4fb2c-225e-4256-98f1-0db109a6f7c0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.065015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcc4fb2c-225e-4256-98f1-0db109a6f7c0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.065547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcc4fb2c-225e-4256-98f1-0db109a6f7c0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.262688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6a180853-0181-4960-b96b-cca00e104e91 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb905e794fc44406911ef1d5b77cc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:27.265971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dcc4fb2c-225e-4256-98f1-0db109a6f7c0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:27.270680 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6a180853-0181-4960-b96b-cca00e104e91 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 200 len: 1470 microversion: 2.1 time: 0.224409 Feb 19 20:56:27.271259 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 771/1484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:27 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:27.275293 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dcc4fb2c-225e-4256-98f1-0db109a6f7c0 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.222592 Feb 19 20:56:27.275864 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 714/1485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:27 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:27.397959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-95f35dc5-6e1e-40c8-a3b9-c1282b9769ca tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:27.398482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-95f35dc5-6e1e-40c8-a3b9-c1282b9769ca tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:27.404425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95f35dc5-6e1e-40c8-a3b9-c1282b9769ca tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.404886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95f35dc5-6e1e-40c8-a3b9-c1282b9769ca tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.405662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95f35dc5-6e1e-40c8-a3b9-c1282b9769ca tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.406099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95f35dc5-6e1e-40c8-a3b9-c1282b9769ca tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.541998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-95f35dc5-6e1e-40c8-a3b9-c1282b9769ca tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:27.549421 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-95f35dc5-6e1e-40c8-a3b9-c1282b9769ca tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.155221 Feb 19 20:56:27.549993 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 772/1486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:27 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:27.574491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-365158ec-b79a-4f51-8181-7e0b1db9e46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:27.575092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-365158ec-b79a-4f51-8181-7e0b1db9e46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:27.581612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-365158ec-b79a-4f51-8181-7e0b1db9e46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.582054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-365158ec-b79a-4f51-8181-7e0b1db9e46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.582818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-365158ec-b79a-4f51-8181-7e0b1db9e46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.583250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-365158ec-b79a-4f51-8181-7e0b1db9e46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.721665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-365158ec-b79a-4f51-8181-7e0b1db9e46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:27.728920 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-365158ec-b79a-4f51-8181-7e0b1db9e46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.157981 Feb 19 20:56:27.729488 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 715/1487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:27 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:27.845914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-555a4d22-9033-41fa-b5f6-1260134d0928 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:27.846604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-555a4d22-9033-41fa-b5f6-1260134d0928 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:27.852942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-555a4d22-9033-41fa-b5f6-1260134d0928 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.853391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-555a4d22-9033-41fa-b5f6-1260134d0928 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.854165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-555a4d22-9033-41fa-b5f6-1260134d0928 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.854601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-555a4d22-9033-41fa-b5f6-1260134d0928 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.885409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9b41e44-b06e-4287-aeef-606c06cbc9ea tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:27.886115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9b41e44-b06e-4287-aeef-606c06cbc9ea tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:27.892098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9b41e44-b06e-4287-aeef-606c06cbc9ea tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.892952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9b41e44-b06e-4287-aeef-606c06cbc9ea tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:27.893801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9b41e44-b06e-4287-aeef-606c06cbc9ea tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:27.894320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9b41e44-b06e-4287-aeef-606c06cbc9ea tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.040067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-555a4d22-9033-41fa-b5f6-1260134d0928 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:28.047473 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-555a4d22-9033-41fa-b5f6-1260134d0928 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1469 microversion: 2.1 time: 0.205257 Feb 19 20:56:28.048041 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 773/1488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:27 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:28.052766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-01b96f8c-28fc-42a8-b8ed-0c5e67ea173c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:28.053354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-01b96f8c-28fc-42a8-b8ed-0c5e67ea173c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:28.059689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01b96f8c-28fc-42a8-b8ed-0c5e67ea173c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.060138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01b96f8c-28fc-42a8-b8ed-0c5e67ea173c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.060948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01b96f8c-28fc-42a8-b8ed-0c5e67ea173c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.061382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01b96f8c-28fc-42a8-b8ed-0c5e67ea173c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.086171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a9b41e44-b06e-4287-aeef-606c06cbc9ea tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:28.093424 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9b41e44-b06e-4287-aeef-606c06cbc9ea tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1505 microversion: 2.1 time: 0.211730 Feb 19 20:56:28.094001 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 716/1489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:27 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:28.194327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-01b96f8c-28fc-42a8-b8ed-0c5e67ea173c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:28.201680 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-01b96f8c-28fc-42a8-b8ed-0c5e67ea173c tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1465 microversion: 2.1 time: 0.152131 Feb 19 20:56:28.202190 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 774/1490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:28 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:28.217381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8fa60d20-9a21-47bc-b037-3ec5feebb99a tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:28.218266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8fa60d20-9a21-47bc-b037-3ec5feebb99a tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:28.225277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fa60d20-9a21-47bc-b037-3ec5feebb99a tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.225723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fa60d20-9a21-47bc-b037-3ec5feebb99a tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.226502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fa60d20-9a21-47bc-b037-3ec5feebb99a tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.226937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fa60d20-9a21-47bc-b037-3ec5feebb99a tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.287236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e1f71036-11d9-41d6-b1b7-025952b8f24c tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:28.288184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e1f71036-11d9-41d6-b1b7-025952b8f24c tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:28.294837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1f71036-11d9-41d6-b1b7-025952b8f24c tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.295300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1f71036-11d9-41d6-b1b7-025952b8f24c tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.296090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1f71036-11d9-41d6-b1b7-025952b8f24c tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.296555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1f71036-11d9-41d6-b1b7-025952b8f24c tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.531906 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8fa60d20-9a21-47bc-b037-3ec5feebb99a tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1616 microversion: 2.1 time: 0.318141 Feb 19 20:56:28.532581 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 717/1491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:28 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1616 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:28.537251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a20d68e-c21c-443f-9e1f-6fc273a8c7b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:28.537860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a20d68e-c21c-443f-9e1f-6fc273a8c7b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:28.550728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a20d68e-c21c-443f-9e1f-6fc273a8c7b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.551183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a20d68e-c21c-443f-9e1f-6fc273a8c7b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.552251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a20d68e-c21c-443f-9e1f-6fc273a8c7b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.552444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a20d68e-c21c-443f-9e1f-6fc273a8c7b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.570468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e1f71036-11d9-41d6-b1b7-025952b8f24c tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb905e794fc44406911ef1d5b77cc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7c7b1e5ce345fd99f7b69afd3a5554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:28.578938 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e1f71036-11d9-41d6-b1b7-025952b8f24c tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 200 len: 1470 microversion: 2.1 time: 0.295865 Feb 19 20:56:28.579889 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 775/1492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:28 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 1470 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:28.584452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dbf9cd2c-6fc8-47bd-b457-29561440e0e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:28.585069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dbf9cd2c-6fc8-47bd-b457-29561440e0e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:28.591052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbf9cd2c-6fc8-47bd-b457-29561440e0e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.591769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbf9cd2c-6fc8-47bd-b457-29561440e0e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.592612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbf9cd2c-6fc8-47bd-b457-29561440e0e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.593275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbf9cd2c-6fc8-47bd-b457-29561440e0e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.870554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9a20d68e-c21c-443f-9e1f-6fc273a8c7b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:28.878630 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a20d68e-c21c-443f-9e1f-6fc273a8c7b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.344490 Feb 19 20:56:28.879431 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 718/1493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:28 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:28.879912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dbf9cd2c-6fc8-47bd-b457-29561440e0e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:28.883618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1586595410", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["4c97b67a-8ac7-415a-8fd9-9b05f343eb16"]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:28.887991 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dbf9cd2c-6fc8-47bd-b457-29561440e0e3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.306990 Feb 19 20:56:28.888980 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 776/1494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:28 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:28.895666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-405567ea-75ad-4229-bff5-8cb6eaaacc41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:28.896446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-405567ea-75ad-4229-bff5-8cb6eaaacc41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:28.903544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-405567ea-75ad-4229-bff5-8cb6eaaacc41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.903994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-405567ea-75ad-4229-bff5-8cb6eaaacc41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.904834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-405567ea-75ad-4229-bff5-8cb6eaaacc41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:28.905275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-405567ea-75ad-4229-bff5-8cb6eaaacc41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:28.945257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:56:29.368858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-405567ea-75ad-4229-bff5-8cb6eaaacc41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:29.376975 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-405567ea-75ad-4229-bff5-8cb6eaaacc41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.486757 Feb 19 20:56:29.387993 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 777/1495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:28 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:29.394278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1b65a9c-dd6f-462b-a998-b0f4ee9cd334 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:29.395188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b1b65a9c-dd6f-462b-a998-b0f4ee9cd334 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:29.405118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1b65a9c-dd6f-462b-a998-b0f4ee9cd334 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:29.405910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1b65a9c-dd6f-462b-a998-b0f4ee9cd334 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:29.406915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1b65a9c-dd6f-462b-a998-b0f4ee9cd334 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:29.407537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1b65a9c-dd6f-462b-a998-b0f4ee9cd334 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:29.843587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:29.844016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:29.844531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:29.844940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:29.846078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:29.864773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:29.865233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:29.866058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:29.866497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:29.896588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:29.901204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:29.913529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:56:29.916566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:56:29.992319 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-377a5ce6-7ede-4b27-882f-7d000bb47296 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111984 Feb 19 20:56:29.995476 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 719/1496] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:56:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:56:30.004424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-20c78c8e-244b-47bd-8032-e9d092e8cd67 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:30.005841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-20c78c8e-244b-47bd-8032-e9d092e8cd67 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:30.012692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20c78c8e-244b-47bd-8032-e9d092e8cd67 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:30.013367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20c78c8e-244b-47bd-8032-e9d092e8cd67 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:30.014446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20c78c8e-244b-47bd-8032-e9d092e8cd67 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:30.015149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20c78c8e-244b-47bd-8032-e9d092e8cd67 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:30.078056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b1b65a9c-dd6f-462b-a998-b0f4ee9cd334 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:30.098192 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b1b65a9c-dd6f-462b-a998-b0f4ee9cd334 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 200 len: 1469 microversion: 2.1 time: 0.708956 Feb 19 20:56:30.098797 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 778/1497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:29 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 1469 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:30.103461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c1d8f5be-69fb-40ac-bcc9-e52f67903ddc req-48fe5be3-9bca-4dab-8da1-355c7d9c5a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eaee1c7-bade-4297-9c88-df64b809a763", "name": "network-vif-deleted", "tag": "d9d53a10-25f3-4c06-8b46-bd8bdfc071ea"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:30.105104 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:30.105104 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:30.119992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c1d8f5be-69fb-40ac-bcc9-e52f67903ddc req-48fe5be3-9bca-4dab-8da1-355c7d9c5a9c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:30.132614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c1d8f5be-69fb-40ac-bcc9-e52f67903ddc req-48fe5be3-9bca-4dab-8da1-355c7d9c5a9c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:30.145319 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c1d8f5be-69fb-40ac-bcc9-e52f67903ddc req-48fe5be3-9bca-4dab-8da1-355c7d9c5a9c service nova] Creating event network-vif-deleted:d9d53a10-25f3-4c06-8b46-bd8bdfc071ea for instance 9eaee1c7-bade-4297-9c88-df64b809a763 on nch1-master-1 Feb 19 20:56:30.151900 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c1d8f5be-69fb-40ac-bcc9-e52f67903ddc req-48fe5be3-9bca-4dab-8da1-355c7d9c5a9c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051672 Feb 19 20:56:30.152579 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 779/1498] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:30.163113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f1426e3-7d09-47b4-b501-f3b00226e534 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:30.169843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f1426e3-7d09-47b4-b501-f3b00226e534 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] [instance: 9eaee1c7-bade-4297-9c88-df64b809a763] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:30.179334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f1426e3-7d09-47b4-b501-f3b00226e534 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:30.179798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f1426e3-7d09-47b4-b501-f3b00226e534 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:30.180643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f1426e3-7d09-47b4-b501-f3b00226e534 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:30.181093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f1426e3-7d09-47b4-b501-f3b00226e534 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:30.215326 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-4f1426e3-7d09-47b4-b501-f3b00226e534 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] HTTP exception thrown: Instance 9eaee1c7-bade-4297-9c88-df64b809a763 could not be found. Feb 19 20:56:30.218392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f1426e3-7d09-47b4-b501-f3b00226e534 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] Returning 404 to user: Instance 9eaee1c7-bade-4297-9c88-df64b809a763 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:30.219420 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f1426e3-7d09-47b4-b501-f3b00226e534 tempest-TenantUsagesTestJSON-1250193384 tempest-TenantUsagesTestJSON-1250193384-project] 10.222.0.30 "GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763" status: 404 len: 111 microversion: 2.1 time: 0.065771 Feb 19 20:56:30.223166 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 780/1499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:30 2022] GET /compute/v2.1/servers/9eaee1c7-bade-4297-9c88-df64b809a763 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:30.234015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-af4b857c-d486-4413-8036-0e4eb875322c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:30.236443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-af4b857c-d486-4413-8036-0e4eb875322c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:30.247242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af4b857c-d486-4413-8036-0e4eb875322c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:30.248697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af4b857c-d486-4413-8036-0e4eb875322c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:30.251174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af4b857c-d486-4413-8036-0e4eb875322c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:30.251834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af4b857c-d486-4413-8036-0e4eb875322c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:30.307610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-20c78c8e-244b-47bd-8032-e9d092e8cd67 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:30.320080 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-20c78c8e-244b-47bd-8032-e9d092e8cd67 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1505 microversion: 2.1 time: 0.320660 Feb 19 20:56:30.321340 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 720/1500] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:29 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:30.338783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-de2ba088-69eb-4fd3-b8d9-7642215b6708 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:30.339447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-de2ba088-69eb-4fd3-b8d9-7642215b6708 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:30.353656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de2ba088-69eb-4fd3-b8d9-7642215b6708 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:30.354328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de2ba088-69eb-4fd3-b8d9-7642215b6708 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:30.355301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de2ba088-69eb-4fd3-b8d9-7642215b6708 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:30.355913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de2ba088-69eb-4fd3-b8d9-7642215b6708 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:30.948672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-af4b857c-d486-4413-8036-0e4eb875322c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:30.960731 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-af4b857c-d486-4413-8036-0e4eb875322c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.735876 Feb 19 20:56:30.972630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 781/1501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:30 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:30.978328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-aa0de17f-8527-4480-a78f-c4f9e4c025e4 req-b22e55f5-9d95-453f-9644-5bfaad26a0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a", "name": "network-vif-plugged", "status": "completed", "tag": "baf844cf-250b-42ea-b385-80d607da7e79"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:30.980465 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:30.980465 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:31.004188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-de2ba088-69eb-4fd3-b8d9-7642215b6708 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:31.024689 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-de2ba088-69eb-4fd3-b8d9-7642215b6708 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.699214 Feb 19 20:56:31.025203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-aa0de17f-8527-4480-a78f-c4f9e4c025e4 req-b22e55f5-9d95-453f-9644-5bfaad26a0af service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.026527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-aa0de17f-8527-4480-a78f-c4f9e4c025e4 req-b22e55f5-9d95-453f-9644-5bfaad26a0af service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.026981 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 721/1502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:30 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:31.045172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-285a3bf1-442a-443f-82d6-296a9d513768 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:31.045843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-285a3bf1-442a-443f-82d6-296a9d513768 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:31.057907 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-aa0de17f-8527-4480-a78f-c4f9e4c025e4 req-b22e55f5-9d95-453f-9644-5bfaad26a0af service nova] Creating event network-vif-plugged:baf844cf-250b-42ea-b385-80d607da7e79 for instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a on nch2-master-1 Feb 19 20:56:31.060033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-285a3bf1-442a-443f-82d6-296a9d513768 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.060522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-285a3bf1-442a-443f-82d6-296a9d513768 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.061314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-285a3bf1-442a-443f-82d6-296a9d513768 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.061753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-285a3bf1-442a-443f-82d6-296a9d513768 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.072561 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-aa0de17f-8527-4480-a78f-c4f9e4c025e4 req-b22e55f5-9d95-453f-9644-5bfaad26a0af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098024 Feb 19 20:56:31.075491 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 782/1503] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:31.093060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bee04cf3-7733-4580-bcb2-9418fbc85b78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:31.094057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bee04cf3-7733-4580-bcb2-9418fbc85b78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:31.108862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bee04cf3-7733-4580-bcb2-9418fbc85b78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.109636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bee04cf3-7733-4580-bcb2-9418fbc85b78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.121816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bee04cf3-7733-4580-bcb2-9418fbc85b78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.124474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bee04cf3-7733-4580-bcb2-9418fbc85b78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.239481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-285a3bf1-442a-443f-82d6-296a9d513768 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:31.251009 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-285a3bf1-442a-443f-82d6-296a9d513768 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1269 microversion: 2.1 time: 0.222855 Feb 19 20:56:31.253099 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 722/1504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:31 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1269 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:31.258492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e94e0e6b-5c7d-4f5e-9f2d-5adc80c02b9b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:31.259303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e94e0e6b-5c7d-4f5e-9f2d-5adc80c02b9b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:31.265949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e94e0e6b-5c7d-4f5e-9f2d-5adc80c02b9b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.266401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e94e0e6b-5c7d-4f5e-9f2d-5adc80c02b9b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.268123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e94e0e6b-5c7d-4f5e-9f2d-5adc80c02b9b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.268823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e94e0e6b-5c7d-4f5e-9f2d-5adc80c02b9b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.282709 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-e94e0e6b-5c7d-4f5e-9f2d-5adc80c02b9b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] HTTP exception thrown: Instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a could not be found. Feb 19 20:56:31.283326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e94e0e6b-5c7d-4f5e-9f2d-5adc80c02b9b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Returning 404 to user: Instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:31.284513 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e94e0e6b-5c7d-4f5e-9f2d-5adc80c02b9b tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a" status: 404 len: 111 microversion: 2.1 time: 0.030168 Feb 19 20:56:31.285193 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 723/1505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:31 2022] GET /compute/v2.1/servers/de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:31.292909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2dc6c6b6-5259-4769-b7f4-51a2430e132c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:31.300819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2dc6c6b6-5259-4769-b7f4-51a2430e132c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:31.305677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dc6c6b6-5259-4769-b7f4-51a2430e132c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.306483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dc6c6b6-5259-4769-b7f4-51a2430e132c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.307385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dc6c6b6-5259-4769-b7f4-51a2430e132c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.307919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dc6c6b6-5259-4769-b7f4-51a2430e132c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.337487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2dc6c6b6-5259-4769-b7f4-51a2430e132c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:56:31.435421 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2dc6c6b6-5259-4769-b7f4-51a2430e132c tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "DELETE /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 204 len: 0 microversion: 2.1 time: 0.145786 Feb 19 20:56:31.436477 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 724/1506] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:56:31 2022] DELETE /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:56:31.451017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bee04cf3-7733-4580-bcb2-9418fbc85b78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:31.464448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b41d1ce-ac21-4f64-a760-7cd155f3d227 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:31.465605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b41d1ce-ac21-4f64-a760-7cd155f3d227 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:31.465725 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bee04cf3-7733-4580-bcb2-9418fbc85b78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.388505 Feb 19 20:56:31.472026 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 783/1507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:31 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:31.479869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-518909ff-169d-4fee-8f74-dc9004f00e13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:31.482161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-518909ff-169d-4fee-8f74-dc9004f00e13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:31.482746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b41d1ce-ac21-4f64-a760-7cd155f3d227 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.483443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b41d1ce-ac21-4f64-a760-7cd155f3d227 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.484486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b41d1ce-ac21-4f64-a760-7cd155f3d227 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.485141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b41d1ce-ac21-4f64-a760-7cd155f3d227 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.491782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-518909ff-169d-4fee-8f74-dc9004f00e13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.492446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-518909ff-169d-4fee-8f74-dc9004f00e13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.493363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-518909ff-169d-4fee-8f74-dc9004f00e13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.497227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-518909ff-169d-4fee-8f74-dc9004f00e13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.872956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b41d1ce-ac21-4f64-a760-7cd155f3d227 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:31.901126 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b41d1ce-ac21-4f64-a760-7cd155f3d227 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1505 microversion: 2.1 time: 0.461931 Feb 19 20:56:31.903239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-518909ff-169d-4fee-8f74-dc9004f00e13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:31.911967 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 725/1508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:31 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:31.925688 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-518909ff-169d-4fee-8f74-dc9004f00e13 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1535 microversion: 2.1 time: 0.451988 Feb 19 20:56:31.926710 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 784/1509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:31 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1535 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:31.977668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-858bdc4a-3956-49ea-8069-77e2ddf0c85a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:31.978275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-858bdc4a-3956-49ea-8069-77e2ddf0c85a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:31.984927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-858bdc4a-3956-49ea-8069-77e2ddf0c85a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.985371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-858bdc4a-3956-49ea-8069-77e2ddf0c85a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:31.986183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-858bdc4a-3956-49ea-8069-77e2ddf0c85a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:31.987501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-858bdc4a-3956-49ea-8069-77e2ddf0c85a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.041954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ae5b4c6e-1d89-4dbe-907a-07348f0ce452 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:32.043227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae5b4c6e-1d89-4dbe-907a-07348f0ce452 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:32.054075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae5b4c6e-1d89-4dbe-907a-07348f0ce452 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.054766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae5b4c6e-1d89-4dbe-907a-07348f0ce452 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.055977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae5b4c6e-1d89-4dbe-907a-07348f0ce452 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.056752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae5b4c6e-1d89-4dbe-907a-07348f0ce452 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.307809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-858bdc4a-3956-49ea-8069-77e2ddf0c85a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:32.327353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ae5b4c6e-1d89-4dbe-907a-07348f0ce452 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:32.340114 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ae5b4c6e-1d89-4dbe-907a-07348f0ce452 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.301625 Feb 19 20:56:32.341330 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 785/1510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:32 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:32.350265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-71d4d237-1cb4-4319-b51b-d1d23dae816e req-950dbdf1-4bf0-4e13-93de-65797dcb3a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a", "name": "network-vif-deleted", "tag": "baf844cf-250b-42ea-b385-80d607da7e79"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:32.352220 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:32.352220 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:32.355025 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-858bdc4a-3956-49ea-8069-77e2ddf0c85a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.366585 Feb 19 20:56:32.355693 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 726/1511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:31 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:32.362150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-79920f9f-821e-4160-aa35-e70ab2bf1853 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:32.362768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-79920f9f-821e-4160-aa35-e70ab2bf1853 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:32.362892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-71d4d237-1cb4-4319-b51b-d1d23dae816e req-950dbdf1-4bf0-4e13-93de-65797dcb3a0a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.363627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-71d4d237-1cb4-4319-b51b-d1d23dae816e req-950dbdf1-4bf0-4e13-93de-65797dcb3a0a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.376993 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-71d4d237-1cb4-4319-b51b-d1d23dae816e req-950dbdf1-4bf0-4e13-93de-65797dcb3a0a service nova] Creating event network-vif-deleted:baf844cf-250b-42ea-b385-80d607da7e79 for instance de6a0c2f-34b3-4eb3-8b8e-6fb62c29900a on nch2-master-1 Feb 19 20:56:32.379451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79920f9f-821e-4160-aa35-e70ab2bf1853 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.379899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79920f9f-821e-4160-aa35-e70ab2bf1853 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.383613 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-71d4d237-1cb4-4319-b51b-d1d23dae816e req-950dbdf1-4bf0-4e13-93de-65797dcb3a0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040539 Feb 19 20:56:32.383765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79920f9f-821e-4160-aa35-e70ab2bf1853 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.384244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79920f9f-821e-4160-aa35-e70ab2bf1853 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.385119 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 786/1512] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:32.490499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a45df0cf-cf8f-4a28-a691-bd4df066b787 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:32.491478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a45df0cf-cf8f-4a28-a691-bd4df066b787 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:32.507658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a45df0cf-cf8f-4a28-a691-bd4df066b787 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.509081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a45df0cf-cf8f-4a28-a691-bd4df066b787 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.511479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a45df0cf-cf8f-4a28-a691-bd4df066b787 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.512729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a45df0cf-cf8f-4a28-a691-bd4df066b787 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.735856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79920f9f-821e-4160-aa35-e70ab2bf1853 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:32.750416 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-79920f9f-821e-4160-aa35-e70ab2bf1853 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1317 microversion: 2.1 time: 0.393309 Feb 19 20:56:32.752507 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 727/1513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:32 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:32.891562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a45df0cf-cf8f-4a28-a691-bd4df066b787 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:32.906017 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a45df0cf-cf8f-4a28-a691-bd4df066b787 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.424258 Feb 19 20:56:32.908062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 787/1514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:32 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:32.929373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-820a06f3-6c7d-40fd-b938-4be46ba53eb7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:32.930030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-820a06f3-6c7d-40fd-b938-4be46ba53eb7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:32.940356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-820a06f3-6c7d-40fd-b938-4be46ba53eb7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.941149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-820a06f3-6c7d-40fd-b938-4be46ba53eb7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.942157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-820a06f3-6c7d-40fd-b938-4be46ba53eb7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.942835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-820a06f3-6c7d-40fd-b938-4be46ba53eb7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.944349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b3f3415e-41c6-462b-ae98-d5eafd26a056 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:32.947118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b3f3415e-41c6-462b-ae98-d5eafd26a056 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:32.957937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3f3415e-41c6-462b-ae98-d5eafd26a056 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.958456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3f3415e-41c6-462b-ae98-d5eafd26a056 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:32.959940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3f3415e-41c6-462b-ae98-d5eafd26a056 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:32.960639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3f3415e-41c6-462b-ae98-d5eafd26a056 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:33.219245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-820a06f3-6c7d-40fd-b938-4be46ba53eb7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:33.231245 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-820a06f3-6c7d-40fd-b938-4be46ba53eb7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1495 microversion: 2.1 time: 0.304421 Feb 19 20:56:33.231839 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 728/1515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:32 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1495 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:33.246949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-135950ff-abb0-4ca1-bf26-b98d8a1af512 req-58a4014c-27f5-4d75-9f95-c4aec6670f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59252cac-71fd-4839-8d62-e20d42abc8cb", "name": "network-vif-plugged", "status": "completed", "tag": "31d6bb39-99dc-4d88-9fb6-3d09d608c1ea"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:33.248937 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:33.248937 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:33.258593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-135950ff-abb0-4ca1-bf26-b98d8a1af512 req-58a4014c-27f5-4d75-9f95-c4aec6670f0a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:33.259031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-135950ff-abb0-4ca1-bf26-b98d8a1af512 req-58a4014c-27f5-4d75-9f95-c4aec6670f0a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:33.278953 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-135950ff-abb0-4ca1-bf26-b98d8a1af512 req-58a4014c-27f5-4d75-9f95-c4aec6670f0a service nova] Creating event network-vif-plugged:31d6bb39-99dc-4d88-9fb6-3d09d608c1ea for instance 59252cac-71fd-4839-8d62-e20d42abc8cb on nch2-master-1 Feb 19 20:56:33.291976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b3f3415e-41c6-462b-ae98-d5eafd26a056 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:33.302200 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b3f3415e-41c6-462b-ae98-d5eafd26a056 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1535 microversion: 2.1 time: 0.361586 Feb 19 20:56:33.303775 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-135950ff-abb0-4ca1-bf26-b98d8a1af512 req-58a4014c-27f5-4d75-9f95-c4aec6670f0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070432 Feb 19 20:56:33.304589 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 788/1516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:32 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1535 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:33.305147 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 729/1517] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:33.345767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40486ac4-e8b3-4f39-8413-3f96f1c941ba tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '.version_select at 0x7f6467b0f040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:33.347998 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:33.347998 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:33.350212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40486ac4-e8b3-4f39-8413-3f96f1c941ba tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:33.351852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40486ac4-e8b3-4f39-8413-3f96f1c941ba tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:33.358804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-baf357ef-79e7-4074-be79-48ff437dfe69 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:33.374175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-baf357ef-79e7-4074-be79-48ff437dfe69 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:33.394564 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-40486ac4-e8b3-4f39-8413-3f96f1c941ba tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1576 microversion: 2.1 time: 0.087951 Feb 19 20:56:33.395201 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 730/1518] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:56:33 2022] GET /compute/v2.1/os-migrations => generated 1576 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:33.406563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dc7c7f13-b483-4bbc-b22c-a27dc1fdc22c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:33.407438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dc7c7f13-b483-4bbc-b22c-a27dc1fdc22c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:33.417731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baf357ef-79e7-4074-be79-48ff437dfe69 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:33.425063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baf357ef-79e7-4074-be79-48ff437dfe69 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:33.426381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baf357ef-79e7-4074-be79-48ff437dfe69 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:33.426940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baf357ef-79e7-4074-be79-48ff437dfe69 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:33.436660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc7c7f13-b483-4bbc-b22c-a27dc1fdc22c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:33.437507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc7c7f13-b483-4bbc-b22c-a27dc1fdc22c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:33.438510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc7c7f13-b483-4bbc-b22c-a27dc1fdc22c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:33.439229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc7c7f13-b483-4bbc-b22c-a27dc1fdc22c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:33.876527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-baf357ef-79e7-4074-be79-48ff437dfe69 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:33.885614 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-baf357ef-79e7-4074-be79-48ff437dfe69 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.531696 Feb 19 20:56:33.886772 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 789/1519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:33 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:33.891447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a7e4252b-ea4e-4675-a4cc-2f5498acc9e2 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:33.892420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a7e4252b-ea4e-4675-a4cc-2f5498acc9e2 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:33.892905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dc7c7f13-b483-4bbc-b22c-a27dc1fdc22c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:33.898881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7e4252b-ea4e-4675-a4cc-2f5498acc9e2 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:33.899643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7e4252b-ea4e-4675-a4cc-2f5498acc9e2 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:33.900967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7e4252b-ea4e-4675-a4cc-2f5498acc9e2 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:33.901627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7e4252b-ea4e-4675-a4cc-2f5498acc9e2 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:33.901998 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dc7c7f13-b483-4bbc-b22c-a27dc1fdc22c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.505586 Feb 19 20:56:33.905643 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 731/1520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:33 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:34.057821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5986897-f123-436d-879d-0acf45d96970 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Action: 'create', calling method: .version_select at 0x7f6467b7c280>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:34.063043 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-b5986897-f123-436d-879d-0acf45d96970 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Feb 19 20:56:34.063455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5986897-f123-436d-879d-0acf45d96970 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:34.064923 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b5986897-f123-436d-879d-0acf45d96970 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.157535 Feb 19 20:56:34.070207 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 732/1521] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:56:33 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:56:34.073533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ae730019-e555-4437-a015-98dffd4683fc req-ab763e01-e0a0-4f97-b1be-56ffb06a2472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c91011-f731-4d80-b568-d970fcd46286", "tag": "a0a6b42b-6ed6-490d-be6f-f141ef78c41e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:34.074935 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:34.074935 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:34.083004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ae730019-e555-4437-a015-98dffd4683fc req-ab763e01-e0a0-4f97-b1be-56ffb06a2472 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:34.083449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ae730019-e555-4437-a015-98dffd4683fc req-ab763e01-e0a0-4f97-b1be-56ffb06a2472 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:34.094182 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ae730019-e555-4437-a015-98dffd4683fc req-ab763e01-e0a0-4f97-b1be-56ffb06a2472 service nova] Creating event network-changed:a0a6b42b-6ed6-490d-be6f-f141ef78c41e for instance 87c91011-f731-4d80-b568-d970fcd46286 on nch1-master-1 Feb 19 20:56:34.099401 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ae730019-e555-4437-a015-98dffd4683fc req-ab763e01-e0a0-4f97-b1be-56ffb06a2472 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032417 Feb 19 20:56:34.099992 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 733/1522] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:34.105039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-28263ebe-6082-4e72-92da-b28b1c517f84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:34.105738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-28263ebe-6082-4e72-92da-b28b1c517f84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:34.117324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28263ebe-6082-4e72-92da-b28b1c517f84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:34.117798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28263ebe-6082-4e72-92da-b28b1c517f84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:34.118649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28263ebe-6082-4e72-92da-b28b1c517f84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:34.119575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28263ebe-6082-4e72-92da-b28b1c517f84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:34.158605 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a7e4252b-ea4e-4675-a4cc-2f5498acc9e2 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1646 microversion: 2.1 time: 0.269971 Feb 19 20:56:34.172850 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 790/1523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:33 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1646 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:34.188761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-17c6c563-d939-4e49-ab3d-d4f66fdc7882 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:34.189794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17c6c563-d939-4e49-ab3d-d4f66fdc7882 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:34.198787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17c6c563-d939-4e49-ab3d-d4f66fdc7882 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:34.199251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17c6c563-d939-4e49-ab3d-d4f66fdc7882 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:34.200062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17c6c563-d939-4e49-ab3d-d4f66fdc7882 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:34.200535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17c6c563-d939-4e49-ab3d-d4f66fdc7882 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:34.470031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-28263ebe-6082-4e72-92da-b28b1c517f84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:34.481428 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-28263ebe-6082-4e72-92da-b28b1c517f84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1317 microversion: 2.1 time: 0.379739 Feb 19 20:56:34.481923 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 734/1524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:34 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:34.490753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ffc86e0-0e24-470d-8078-ac21c5e437fe tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Action: 'create', calling method: .version_select at 0x7f6479391d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1876517988", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:34.519180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17c6c563-d939-4e49-ab3d-d4f66fdc7882 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:34.530105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7ffc86e0-0e24-470d-8078-ac21c5e437fe tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:34.531248 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-17c6c563-d939-4e49-ab3d-d4f66fdc7882 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.353677 Feb 19 20:56:34.532068 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 791/1525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:34 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:34.536533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7ffc86e0-0e24-470d-8078-ac21c5e437fe tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for user 43615d3db32e4691a7be7a57127ae380 and project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:34.547494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:34.548880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:34.552926 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-7ffc86e0-0e24-470d-8078-ac21c5e437fe tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Feb 19 20:56:34.553544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ffc86e0-0e24-470d-8078-ac21c5e437fe tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:34.554376 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ffc86e0-0e24-470d-8078-ac21c5e437fe tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.069566 Feb 19 20:56:34.557625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:34.560212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:34.560599 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 735/1526] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Feb 19 20:56:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:34.561466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:34.562083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:34.567018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-972716521", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "38f0b579-c349-4313-af39-532bf5d625a7"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:34.607615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:34.608530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:34.609155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lazy-loading 'fault' on Instance uuid 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:56:34.634164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] validate_networks() for [('38f0b579-c349-4313-af39-532bf5d625a7', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:56:34.655285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:34.665227 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-497d83be-4c15-45af-bb09-4a2554249684 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 200 len: 1369 microversion: 2.1 time: 0.121361 Feb 19 20:56:34.668309 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 792/1527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:34 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 1369 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:34.674724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f5d93c3d-fcf3-4b77-9dd7-196315a90c11 req-57673aaa-926d-43f1-963c-c11a65faf978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de", "name": "network-vif-deleted", "tag": "191fbf35-b9ce-44cc-bb60-5039a7b3f93f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:34.675333 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:34.675333 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:34.687788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f5d93c3d-fcf3-4b77-9dd7-196315a90c11 req-57673aaa-926d-43f1-963c-c11a65faf978 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:34.688229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f5d93c3d-fcf3-4b77-9dd7-196315a90c11 req-57673aaa-926d-43f1-963c-c11a65faf978 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:34.702755 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f5d93c3d-fcf3-4b77-9dd7-196315a90c11 req-57673aaa-926d-43f1-963c-c11a65faf978 service nova] Creating event network-vif-deleted:191fbf35-b9ce-44cc-bb60-5039a7b3f93f for instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de on nch1-master-1 Feb 19 20:56:34.714868 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f5d93c3d-fcf3-4b77-9dd7-196315a90c11 req-57673aaa-926d-43f1-963c-c11a65faf978 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044807 Feb 19 20:56:34.716103 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 793/1528] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:34.722469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-69b1f05c-6519-49bd-b925-a2061cbf5841 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Action: 'create', calling method: .version_select at 0x7f6467ab00d0>, body: {"keypair": {"name": "tempest-keypair-768629113"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:34.747270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-69b1f05c-6519-49bd-b925-a2061cbf5841 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:34.753062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-69b1f05c-6519-49bd-b925-a2061cbf5841 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for user 43615d3db32e4691a7be7a57127ae380 and project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:34.995400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-69b1f05c-6519-49bd-b925-a2061cbf5841 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:34.999582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-69b1f05c-6519-49bd-b925-a2061cbf5841 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for user 43615d3db32e4691a7be7a57127ae380 and project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:35.018010 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-69b1f05c-6519-49bd-b925-a2061cbf5841 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.299954 Feb 19 20:56:35.024902 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 794/1529] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:56:34 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:35.030287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e839fce5-97cc-4583-9c08-d65b7bdf94dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.031110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e839fce5-97cc-4583-9c08-d65b7bdf94dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:35.039022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e839fce5-97cc-4583-9c08-d65b7bdf94dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.040596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e839fce5-97cc-4583-9c08-d65b7bdf94dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.042483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e839fce5-97cc-4583-9c08-d65b7bdf94dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.042610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e839fce5-97cc-4583-9c08-d65b7bdf94dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.086902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:35.087680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:35.088166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:35.088595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:35.089261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:35.099270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.100017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.101075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.101748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.120993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Getting quotas for project 63acbd462dfc418fab3fbeedccacb9c7. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:35.125633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Getting quotas for user 0d694f3e8da440a9a1cac8ca2de030e8 and project 63acbd462dfc418fab3fbeedccacb9c7. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:35.137868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:56:35.140231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:56:35.186315 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8e78c224-7bee-469e-8da3-106d5ddfe6fd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624617 Feb 19 20:56:35.192712 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 736/1530] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:56:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:56:35.193103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-611e24e5-0749-460c-a485-284d1a7913fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.193713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-611e24e5-0749-460c-a485-284d1a7913fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:35.200299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-611e24e5-0749-460c-a485-284d1a7913fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.200822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-611e24e5-0749-460c-a485-284d1a7913fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.201638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-611e24e5-0749-460c-a485-284d1a7913fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.202071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-611e24e5-0749-460c-a485-284d1a7913fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.202671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e839fce5-97cc-4583-9c08-d65b7bdf94dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:35.212181 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e839fce5-97cc-4583-9c08-d65b7bdf94dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1314 microversion: 2.1 time: 0.185943 Feb 19 20:56:35.213122 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 795/1531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:35 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:35.218147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ceca0cac-c44f-438d-a629-0a58101e2b12 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Action: 'create', calling method: .version_select at 0x7f6467a9fc10>, body: {"keypair": {"name": "tempest-keypair-768629113"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:35.238063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ceca0cac-c44f-438d-a629-0a58101e2b12 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:35.242521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ceca0cac-c44f-438d-a629-0a58101e2b12 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for user 43615d3db32e4691a7be7a57127ae380 and project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:35.359742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-611e24e5-0749-460c-a485-284d1a7913fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:35.367919 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-611e24e5-0749-460c-a485-284d1a7913fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.179464 Feb 19 20:56:35.372666 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 737/1532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:35 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:35.377122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-90687335-3257-4568-a444-b0884f2601c3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.377818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-90687335-3257-4568-a444-b0884f2601c3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:35.383020 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ceca0cac-c44f-438d-a629-0a58101e2b12 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] HTTP exception thrown: Key pair 'tempest-keypair-768629113' already exists. Feb 19 20:56:35.383634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ceca0cac-c44f-438d-a629-0a58101e2b12 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Returning 409 to user: Key pair 'tempest-keypair-768629113' already exists. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:35.384481 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ceca0cac-c44f-438d-a629-0a58101e2b12 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.170531 Feb 19 20:56:35.388687 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 796/1533] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:56:35 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:56:35.390994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f27778ac-8acf-4684-9b55-b2a60afcf2cc req-556ca791-052d-4f3c-bb15-54221b02dbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d927e050-ac38-4b26-8aa5-14f490410068", "name": "network-vif-plugged", "status": "completed", "tag": "ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:35.393064 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:35.393064 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:35.399960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f27778ac-8acf-4684-9b55-b2a60afcf2cc req-556ca791-052d-4f3c-bb15-54221b02dbf6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.400430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f27778ac-8acf-4684-9b55-b2a60afcf2cc req-556ca791-052d-4f3c-bb15-54221b02dbf6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.411681 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f27778ac-8acf-4684-9b55-b2a60afcf2cc req-556ca791-052d-4f3c-bb15-54221b02dbf6 service nova] Creating event network-vif-plugged:ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c for instance d927e050-ac38-4b26-8aa5-14f490410068 on nch2-master-1 Feb 19 20:56:35.417278 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f27778ac-8acf-4684-9b55-b2a60afcf2cc req-556ca791-052d-4f3c-bb15-54221b02dbf6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030440 Feb 19 20:56:35.418239 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 797/1534] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:35.423008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8f773630-f44d-4f00-90a6-7f9290a2f9e5 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Calling method '.version_select at 0x7f6467a12670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.436765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-90687335-3257-4568-a444-b0884f2601c3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:35.443842 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8f773630-f44d-4f00-90a6-7f9290a2f9e5 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768629113" status: 202 len: 0 microversion: 2.1 time: 0.024462 Feb 19 20:56:35.444670 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 798/1535] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 20:56:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768629113 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:56:35.445584 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-90687335-3257-4568-a444-b0884f2601c3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1210 microversion: 2.1 time: 0.071763 Feb 19 20:56:35.446548 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 738/1536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:35 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1210 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:35.466245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-337db1ac-cca3-45b0-8383-5eb7b5954797 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Action: 'create', calling method: .version_select at 0x7f6467b8b670>, body: {"keypair": {"name": ""}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:35.469688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-337db1ac-cca3-45b0-8383-5eb7b5954797 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:35.470564 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-337db1ac-cca3-45b0-8383-5eb7b5954797 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009783 Feb 19 20:56:35.471155 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 799/1537] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:56:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:56:35.479995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c76c4154-6e1d-4fd0-8232-28bc85139e05 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Action: 'create', calling method: .version_select at 0x7f647935c940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-394747288", "public_key": " "}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:35.495497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c76c4154-6e1d-4fd0-8232-28bc85139e05 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:35.498661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f6e5b68-c1d1-4f6f-a814-4de0d269551f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.499374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c76c4154-6e1d-4fd0-8232-28bc85139e05 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for user 43615d3db32e4691a7be7a57127ae380 and project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:35.500529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f6e5b68-c1d1-4f6f-a814-4de0d269551f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:35.508379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f6e5b68-c1d1-4f6f-a814-4de0d269551f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.509035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f6e5b68-c1d1-4f6f-a814-4de0d269551f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.509987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f6e5b68-c1d1-4f6f-a814-4de0d269551f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.510618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f6e5b68-c1d1-4f6f-a814-4de0d269551f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.514740 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c76c4154-6e1d-4fd0-8232-28bc85139e05 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Feb 19 20:56:35.515256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c76c4154-6e1d-4fd0-8232-28bc85139e05 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:35.516074 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c76c4154-6e1d-4fd0-8232-28bc85139e05 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.039796 Feb 19 20:56:35.516673 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 739/1538] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:56:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:35.700242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f6e5b68-c1d1-4f6f-a814-4de0d269551f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:35.710560 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f6e5b68-c1d1-4f6f-a814-4de0d269551f tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1317 microversion: 2.1 time: 0.216951 Feb 19 20:56:35.711172 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 800/1539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:35 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:35.715488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fb12771d-7f08-43c2-9870-b15787a24054 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.716785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fb12771d-7f08-43c2-9870-b15787a24054 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:35.723633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb12771d-7f08-43c2-9870-b15787a24054 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.724083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb12771d-7f08-43c2-9870-b15787a24054 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.725706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb12771d-7f08-43c2-9870-b15787a24054 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.725706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb12771d-7f08-43c2-9870-b15787a24054 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.730350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d8a2a062-3df8-4b08-8d5a-87713dceb8f2 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Action: 'create', calling method: .version_select at 0x7f64747b9550>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:35.730350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d8a2a062-3df8-4b08-8d5a-87713dceb8f2 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:35.730926 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d8a2a062-3df8-4b08-8d5a-87713dceb8f2 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.209106 Feb 19 20:56:35.731791 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 740/1540] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Feb 19 20:56:35 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 19 20:56:35.739835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-579c7d51-f518-4e9f-87f9-ef977102c005 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.740469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-579c7d51-f518-4e9f-87f9-ef977102c005 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:35.746717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-579c7d51-f518-4e9f-87f9-ef977102c005 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.747173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-579c7d51-f518-4e9f-87f9-ef977102c005 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.747962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-579c7d51-f518-4e9f-87f9-ef977102c005 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.748438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-579c7d51-f518-4e9f-87f9-ef977102c005 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.761843 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-579c7d51-f518-4e9f-87f9-ef977102c005 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] HTTP exception thrown: Instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de could not be found. Feb 19 20:56:35.762435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-579c7d51-f518-4e9f-87f9-ef977102c005 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Returning 404 to user: Instance 10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:35.763263 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-579c7d51-f518-4e9f-87f9-ef977102c005 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de" status: 404 len: 111 microversion: 2.1 time: 0.030574 Feb 19 20:56:35.764040 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 741/1541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:35 2022] GET /compute/v2.1/servers/10dc77ef-8119-46c0-ad0e-a1fcbb2aa6de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:35.770922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e9b108e-9c93-451b-ad21-7baf9a55a5e3 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Action: 'create', calling method: .version_select at 0x7f6467abde50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-242285761", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:35.784594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8e9b108e-9c93-451b-ad21-7baf9a55a5e3 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:35.788424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8e9b108e-9c93-451b-ad21-7baf9a55a5e3 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Getting quotas for user 43615d3db32e4691a7be7a57127ae380 and project 293e8257104f47469cf322754e382cad. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:35.803017 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8e9b108e-9c93-451b-ad21-7baf9a55a5e3 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Feb 19 20:56:35.803619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e9b108e-9c93-451b-ad21-7baf9a55a5e3 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:35.804473 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8e9b108e-9c93-451b-ad21-7baf9a55a5e3 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.039750 Feb 19 20:56:35.808660 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 742/1542] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Feb 19 20:56:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:56:35.814490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff761b25-69b4-4927-ad91-f045873f7d79 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.815218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff761b25-69b4-4927-ad91-f045873f7d79 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:35.821269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff761b25-69b4-4927-ad91-f045873f7d79 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.821772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff761b25-69b4-4927-ad91-f045873f7d79 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.822563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff761b25-69b4-4927-ad91-f045873f7d79 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:35.823023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff761b25-69b4-4927-ad91-f045873f7d79 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:35.847799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff761b25-69b4-4927-ad91-f045873f7d79 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:56:35.868230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fb12771d-7f08-43c2-9870-b15787a24054 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:35.876141 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fb12771d-7f08-43c2-9870-b15787a24054 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1308 microversion: 2.1 time: 0.163883 Feb 19 20:56:35.877304 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 801/1543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:35 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:35.886226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd861b4a-bac4-4a46-b89b-2068cfc845a2 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Calling method '.version_select at 0x7f6467c6f280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.906160 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-dd861b4a-bac4-4a46-b89b-2068cfc845a2 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1230560690 not found for user 43615d3db32e4691a7be7a57127ae380 Feb 19 20:56:35.906770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd861b4a-bac4-4a46-b89b-2068cfc845a2 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1230560690 not found for user 43615d3db32e4691a7be7a57127ae380 {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:35.907618 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dd861b4a-bac4-4a46-b89b-2068cfc845a2 tempest-KeyPairsNegativeTestJSON-777505503 tempest-KeyPairsNegativeTestJSON-777505503-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1230560690" status: 404 len: 145 microversion: 2.1 time: 0.029410 Feb 19 20:56:35.908447 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 802/1544] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 20:56:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1230560690 => generated 145 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:35.977429 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff761b25-69b4-4927-ad91-f045873f7d79 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 204 len: 0 microversion: 2.1 time: 0.166512 Feb 19 20:56:35.980419 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 743/1545] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:56:35 2022] DELETE /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:56:35.988033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-418c349d-4898-4b7b-97a9-66b5255b7ee8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:35.988470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-418c349d-4898-4b7b-97a9-66b5255b7ee8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:35.999403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-418c349d-4898-4b7b-97a9-66b5255b7ee8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.001401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-418c349d-4898-4b7b-97a9-66b5255b7ee8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.005447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-418c349d-4898-4b7b-97a9-66b5255b7ee8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.006038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-418c349d-4898-4b7b-97a9-66b5255b7ee8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.175590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-418c349d-4898-4b7b-97a9-66b5255b7ee8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:36.184888 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-418c349d-4898-4b7b-97a9-66b5255b7ee8 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1467 microversion: 2.1 time: 0.201689 Feb 19 20:56:36.185835 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 803/1546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:35 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1467 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:36.231764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c50ac90c-fbb3-4965-8a9d-292b549a19e7 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:36.232515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c50ac90c-fbb3-4965-8a9d-292b549a19e7 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:36.240906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c50ac90c-fbb3-4965-8a9d-292b549a19e7 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.242017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c50ac90c-fbb3-4965-8a9d-292b549a19e7 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.244937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c50ac90c-fbb3-4965-8a9d-292b549a19e7 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.245728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c50ac90c-fbb3-4965-8a9d-292b549a19e7 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.389136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4a8b5a36-96cb-4a47-be2d-c90beccd00d8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:36.389888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4a8b5a36-96cb-4a47-be2d-c90beccd00d8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:36.397070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a8b5a36-96cb-4a47-be2d-c90beccd00d8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.398150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a8b5a36-96cb-4a47-be2d-c90beccd00d8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.398702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a8b5a36-96cb-4a47-be2d-c90beccd00d8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.399228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a8b5a36-96cb-4a47-be2d-c90beccd00d8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.423378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c50ac90c-fbb3-4965-8a9d-292b549a19e7 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:36.431778 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c50ac90c-fbb3-4965-8a9d-292b549a19e7 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1500 microversion: 2.1 time: 0.204697 Feb 19 20:56:36.441710 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 744/1547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:36 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1500 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:36.448459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-41c9fc08-65e1-4f52-9808-a6d8e59f14b9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:36.449396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-41c9fc08-65e1-4f52-9808-a6d8e59f14b9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:36.456625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41c9fc08-65e1-4f52-9808-a6d8e59f14b9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.457162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41c9fc08-65e1-4f52-9808-a6d8e59f14b9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.458219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41c9fc08-65e1-4f52-9808-a6d8e59f14b9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.458742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41c9fc08-65e1-4f52-9808-a6d8e59f14b9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.484126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-41c9fc08-65e1-4f52-9808-a6d8e59f14b9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lazy-loading 'flavor' on Instance uuid 59252cac-71fd-4839-8d62-e20d42abc8cb {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:56:36.562946 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-41c9fc08-65e1-4f52-9808-a6d8e59f14b9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "POST /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb/action" status: 200 len: 32 microversion: 2.1 time: 0.118209 Feb 19 20:56:36.564725 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 745/1548] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:56:36 2022] POST /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 20:56:36.570468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c9a23d4-7ef5-47f1-93a2-fcdcb029e437 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:36.571781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4c9a23d4-7ef5-47f1-93a2-fcdcb029e437 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:36.580530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c9a23d4-7ef5-47f1-93a2-fcdcb029e437 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.581213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c9a23d4-7ef5-47f1-93a2-fcdcb029e437 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.582590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c9a23d4-7ef5-47f1-93a2-fcdcb029e437 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.583242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c9a23d4-7ef5-47f1-93a2-fcdcb029e437 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.679149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4c9a23d4-7ef5-47f1-93a2-fcdcb029e437 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:36.683411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a8b5a36-96cb-4a47-be2d-c90beccd00d8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:36.689925 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c9a23d4-7ef5-47f1-93a2-fcdcb029e437 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1262 microversion: 2.1 time: 0.123300 Feb 19 20:56:36.693268 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4a8b5a36-96cb-4a47-be2d-c90beccd00d8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.307438 Feb 19 20:56:36.694485 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 804/1549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:36 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:36.700054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c3a084ae-91d6-440f-95eb-aca68aba720b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:36.701049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c3a084ae-91d6-440f-95eb-aca68aba720b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:36.708816 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 746/1550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:36 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1262 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:36.715953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3a084ae-91d6-440f-95eb-aca68aba720b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.716546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3a084ae-91d6-440f-95eb-aca68aba720b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.718409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3a084ae-91d6-440f-95eb-aca68aba720b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.718949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3a084ae-91d6-440f-95eb-aca68aba720b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.730831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-94ba2ffa-8df0-4556-8a39-971449ea5d11 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:36.731674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-94ba2ffa-8df0-4556-8a39-971449ea5d11 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:36.742455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94ba2ffa-8df0-4556-8a39-971449ea5d11 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.742903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94ba2ffa-8df0-4556-8a39-971449ea5d11 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:36.743702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94ba2ffa-8df0-4556-8a39-971449ea5d11 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:36.744360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94ba2ffa-8df0-4556-8a39-971449ea5d11 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:37.459050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c3a084ae-91d6-440f-95eb-aca68aba720b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:37.466542 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c3a084ae-91d6-440f-95eb-aca68aba720b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.770692 Feb 19 20:56:37.468811 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 805/1551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:36 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:37.474097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c99ddb3-37c1-4a23-98ec-2af2a9bf57d8 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:37.474911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7c99ddb3-37c1-4a23-98ec-2af2a9bf57d8 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:37.481093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c99ddb3-37c1-4a23-98ec-2af2a9bf57d8 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:37.481851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c99ddb3-37c1-4a23-98ec-2af2a9bf57d8 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:37.483001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c99ddb3-37c1-4a23-98ec-2af2a9bf57d8 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:37.483609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c99ddb3-37c1-4a23-98ec-2af2a9bf57d8 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:37.485594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-94ba2ffa-8df0-4556-8a39-971449ea5d11 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:37.493483 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-94ba2ffa-8df0-4556-8a39-971449ea5d11 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1317 microversion: 2.1 time: 0.766547 Feb 19 20:56:37.502969 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 747/1552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:36 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1317 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:37.507044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57b92384-5b3e-43f7-8a8f-95b96b797b4d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:37.507887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57b92384-5b3e-43f7-8a8f-95b96b797b4d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:37.515994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57b92384-5b3e-43f7-8a8f-95b96b797b4d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:37.516596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57b92384-5b3e-43f7-8a8f-95b96b797b4d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:37.518023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57b92384-5b3e-43f7-8a8f-95b96b797b4d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:37.518537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57b92384-5b3e-43f7-8a8f-95b96b797b4d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:37.852885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7c99ddb3-37c1-4a23-98ec-2af2a9bf57d8 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:37.862021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-57b92384-5b3e-43f7-8a8f-95b96b797b4d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:37.864415 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c99ddb3-37c1-4a23-98ec-2af2a9bf57d8 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1485 microversion: 2.1 time: 0.394162 Feb 19 20:56:37.878507 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 806/1553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:37 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1485 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:37.883764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e80224d7-f5d1-42b7-9215-e22b56586b5b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:37.885068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e80224d7-f5d1-42b7-9215-e22b56586b5b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:37.885488 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57b92384-5b3e-43f7-8a8f-95b96b797b4d tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1467 microversion: 2.1 time: 0.386825 Feb 19 20:56:37.895943 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 748/1554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:37 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1467 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:37.902645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f4dae6a-76ea-47df-9a97-2868286d8b1a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:37.905103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f4dae6a-76ea-47df-9a97-2868286d8b1a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:37.910097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e80224d7-f5d1-42b7-9215-e22b56586b5b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:37.911749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e80224d7-f5d1-42b7-9215-e22b56586b5b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:37.912646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e80224d7-f5d1-42b7-9215-e22b56586b5b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:37.913091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e80224d7-f5d1-42b7-9215-e22b56586b5b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:37.917179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f4dae6a-76ea-47df-9a97-2868286d8b1a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:37.919546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f4dae6a-76ea-47df-9a97-2868286d8b1a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:37.920419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f4dae6a-76ea-47df-9a97-2868286d8b1a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:37.920865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f4dae6a-76ea-47df-9a97-2868286d8b1a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.046989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e80224d7-f5d1-42b7-9215-e22b56586b5b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:38.058628 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e80224d7-f5d1-42b7-9215-e22b56586b5b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1268 microversion: 2.1 time: 0.178721 Feb 19 20:56:38.059512 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 807/1555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:37 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:38.076915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-52a7d0a4-89b6-4f75-8cfb-93c8c0ca3377 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:38.077765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-52a7d0a4-89b6-4f75-8cfb-93c8c0ca3377 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:38.085083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52a7d0a4-89b6-4f75-8cfb-93c8c0ca3377 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.085745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52a7d0a4-89b6-4f75-8cfb-93c8c0ca3377 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.087065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52a7d0a4-89b6-4f75-8cfb-93c8c0ca3377 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.087661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52a7d0a4-89b6-4f75-8cfb-93c8c0ca3377 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.198362 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-52a7d0a4-89b6-4f75-8cfb-93c8c0ca3377 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068/action" status: 202 len: 0 microversion: 2.1 time: 0.125207 Feb 19 20:56:38.199271 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 808/1556] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:56:38 2022] POST /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:56:38.206998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6ba22160-8030-4979-af29-f1043f805958 req-41204564-75eb-4555-80b2-0d459e8073a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c91011-f731-4d80-b568-d970fcd46286", "name": "network-vif-plugged", "status": "completed", "tag": "a0a6b42b-6ed6-490d-be6f-f141ef78c41e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:38.208975 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:38.208975 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:38.216656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9f4dae6a-76ea-47df-9a97-2868286d8b1a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:38.220131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6ba22160-8030-4979-af29-f1043f805958 req-41204564-75eb-4555-80b2-0d459e8073a5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.221517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6ba22160-8030-4979-af29-f1043f805958 req-41204564-75eb-4555-80b2-0d459e8073a5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.228077 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f4dae6a-76ea-47df-9a97-2868286d8b1a tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.336877 Feb 19 20:56:38.238343 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 749/1557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:37 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:38.238343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e711b711-94b9-495d-bc8b-fbedb31a7e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:38.238343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e711b711-94b9-495d-bc8b-fbedb31a7e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:38.243530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e711b711-94b9-495d-bc8b-fbedb31a7e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.244149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e711b711-94b9-495d-bc8b-fbedb31a7e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.245194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e711b711-94b9-495d-bc8b-fbedb31a7e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.245710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e711b711-94b9-495d-bc8b-fbedb31a7e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.265200 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6ba22160-8030-4979-af29-f1043f805958 req-41204564-75eb-4555-80b2-0d459e8073a5 service nova] Creating event network-vif-plugged:a0a6b42b-6ed6-490d-be6f-f141ef78c41e for instance 87c91011-f731-4d80-b568-d970fcd46286 on nch1-master-1 Feb 19 20:56:38.274993 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6ba22160-8030-4979-af29-f1043f805958 req-41204564-75eb-4555-80b2-0d459e8073a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073483 Feb 19 20:56:38.275636 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 809/1558] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:38.488253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-abf2bc6d-7189-4efc-87c7-07a265c19982 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:38.489141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-abf2bc6d-7189-4efc-87c7-07a265c19982 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:38.497640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abf2bc6d-7189-4efc-87c7-07a265c19982 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.498384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abf2bc6d-7189-4efc-87c7-07a265c19982 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.499393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abf2bc6d-7189-4efc-87c7-07a265c19982 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.499832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abf2bc6d-7189-4efc-87c7-07a265c19982 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.537907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e711b711-94b9-495d-bc8b-fbedb31a7e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:38.552069 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e711b711-94b9-495d-bc8b-fbedb31a7e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1490 microversion: 2.1 time: 0.320539 Feb 19 20:56:38.557316 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 750/1559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:38 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1490 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:38.565608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-34a331ba-395d-4779-a7d5-edeac67ac92e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:38.566566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-34a331ba-395d-4779-a7d5-edeac67ac92e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:38.573747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34a331ba-395d-4779-a7d5-edeac67ac92e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.574200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34a331ba-395d-4779-a7d5-edeac67ac92e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.575226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34a331ba-395d-4779-a7d5-edeac67ac92e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.575821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34a331ba-395d-4779-a7d5-edeac67ac92e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.884125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-abf2bc6d-7189-4efc-87c7-07a265c19982 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:38.916993 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-abf2bc6d-7189-4efc-87c7-07a265c19982 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.433422 Feb 19 20:56:38.917667 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 810/1560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:38 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:38.929445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b12b9856-34dc-4e57-834a-a6731c129c4e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:38.932602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-34a331ba-395d-4779-a7d5-edeac67ac92e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:38.934197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b12b9856-34dc-4e57-834a-a6731c129c4e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:38.941968 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-34a331ba-395d-4779-a7d5-edeac67ac92e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1317 microversion: 2.1 time: 0.383273 Feb 19 20:56:38.944308 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 751/1561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:38 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:38.954111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b12b9856-34dc-4e57-834a-a6731c129c4e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.955792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b12b9856-34dc-4e57-834a-a6731c129c4e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:38.958027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b12b9856-34dc-4e57-834a-a6731c129c4e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:38.958652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b12b9856-34dc-4e57-834a-a6731c129c4e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.020947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-63eb7919-c672-4e23-adc9-265cc0cd563f req-ed38ae03-3273-43a3-891d-21e0132bba3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af34c3d-efca-4de5-94a6-7bdb97d068fd", "name": "network-vif-deleted", "tag": "45bff999-b4bd-48a5-8654-55e37f10072d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:39.025212 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:39.025212 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:39.040357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-63eb7919-c672-4e23-adc9-265cc0cd563f req-ed38ae03-3273-43a3-891d-21e0132bba3a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.041229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-63eb7919-c672-4e23-adc9-265cc0cd563f req-ed38ae03-3273-43a3-891d-21e0132bba3a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.054901 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-63eb7919-c672-4e23-adc9-265cc0cd563f req-ed38ae03-3273-43a3-891d-21e0132bba3a service nova] Creating event network-vif-deleted:45bff999-b4bd-48a5-8654-55e37f10072d for instance 5af34c3d-efca-4de5-94a6-7bdb97d068fd on nch2-master-1 Feb 19 20:56:39.062586 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-63eb7919-c672-4e23-adc9-265cc0cd563f req-ed38ae03-3273-43a3-891d-21e0132bba3a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046650 Feb 19 20:56:39.063201 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 752/1562] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:56:39.076720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b965903a-ce3f-4f09-8a55-3326fdaa4eaf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:39.077652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b965903a-ce3f-4f09-8a55-3326fdaa4eaf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:39.082739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b12b9856-34dc-4e57-834a-a6731c129c4e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:39.086367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b965903a-ce3f-4f09-8a55-3326fdaa4eaf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.086943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b965903a-ce3f-4f09-8a55-3326fdaa4eaf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.087955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b965903a-ce3f-4f09-8a55-3326fdaa4eaf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.088573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b965903a-ce3f-4f09-8a55-3326fdaa4eaf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.095946 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b12b9856-34dc-4e57-834a-a6731c129c4e tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 200 len: 1425 microversion: 2.1 time: 0.176497 Feb 19 20:56:39.100763 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 811/1563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:38 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 1425 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:39.247530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5b654828-2564-46f5-99f4-72d615c2918b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:39.248143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5b654828-2564-46f5-99f4-72d615c2918b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:39.255200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b654828-2564-46f5-99f4-72d615c2918b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.255816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b654828-2564-46f5-99f4-72d615c2918b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.256634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b654828-2564-46f5-99f4-72d615c2918b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.257064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b654828-2564-46f5-99f4-72d615c2918b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.507696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b965903a-ce3f-4f09-8a55-3326fdaa4eaf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:39.517069 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b965903a-ce3f-4f09-8a55-3326fdaa4eaf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.444389 Feb 19 20:56:39.527328 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 753/1564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:39 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:39.577015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-64611ca6-9ebe-42d5-ba7c-d2d86bd8395a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:39.578055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-64611ca6-9ebe-42d5-ba7c-d2d86bd8395a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:39.585212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64611ca6-9ebe-42d5-ba7c-d2d86bd8395a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.585870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64611ca6-9ebe-42d5-ba7c-d2d86bd8395a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.586694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64611ca6-9ebe-42d5-ba7c-d2d86bd8395a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.587133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64611ca6-9ebe-42d5-ba7c-d2d86bd8395a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.734481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5b654828-2564-46f5-99f4-72d615c2918b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:39.742526 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5b654828-2564-46f5-99f4-72d615c2918b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.500512 Feb 19 20:56:39.743115 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 812/1565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:39 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:39.896543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64611ca6-9ebe-42d5-ba7c-d2d86bd8395a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:39.909247 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-64611ca6-9ebe-42d5-ba7c-d2d86bd8395a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 200 len: 1470 microversion: 2.1 time: 0.338251 Feb 19 20:56:39.910078 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 754/1566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:39 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 1470 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:39.928504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-377e07ab-8824-4f0f-8dfa-afd415305d81 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-280388658"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:39.930496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-377e07ab-8824-4f0f-8dfa-afd415305d81 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:39.937734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-377e07ab-8824-4f0f-8dfa-afd415305d81 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.938236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-377e07ab-8824-4f0f-8dfa-afd415305d81 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.944943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-377e07ab-8824-4f0f-8dfa-afd415305d81 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.945440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-377e07ab-8824-4f0f-8dfa-afd415305d81 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.950235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-091a8d88-7791-450d-96e9-19ad5ac3cf27 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:39.961627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-091a8d88-7791-450d-96e9-19ad5ac3cf27 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:39.987759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-091a8d88-7791-450d-96e9-19ad5ac3cf27 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.993160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-091a8d88-7791-450d-96e9-19ad5ac3cf27 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:39.996483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-091a8d88-7791-450d-96e9-19ad5ac3cf27 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:39.998432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-091a8d88-7791-450d-96e9-19ad5ac3cf27 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.287333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-091a8d88-7791-450d-96e9-19ad5ac3cf27 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:40.294523 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-377e07ab-8824-4f0f-8dfa-afd415305d81 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068/action" status: 202 len: 0 microversion: 2.1 time: 0.370841 Feb 19 20:56:40.295169 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 813/1567] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:56:39 2022] POST /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 20:56:40.297194 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-091a8d88-7791-450d-96e9-19ad5ac3cf27 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.361955 Feb 19 20:56:40.301656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1dd680f0-c89c-4362-b9b0-b9865f1e15be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:40.302361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1dd680f0-c89c-4362-b9b0-b9865f1e15be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:40.304923 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 755/1568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:39 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:40.309090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dd680f0-c89c-4362-b9b0-b9865f1e15be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.309545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dd680f0-c89c-4362-b9b0-b9865f1e15be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.310332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dd680f0-c89c-4362-b9b0-b9865f1e15be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.310772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dd680f0-c89c-4362-b9b0-b9865f1e15be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.321029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-415f7e4e-1a22-4799-8362-b4bdd425cca5 req-e189e23a-7d11-462d-a667-6eb2e97f3525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65e4283-9a5c-4b89-a006-7e6727e92f45", "tag": "36f49322-08ea-4d05-b1fa-2357653ca8be"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:40.325186 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:40.325186 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:40.341683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-415f7e4e-1a22-4799-8362-b4bdd425cca5 req-e189e23a-7d11-462d-a667-6eb2e97f3525 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.342137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-415f7e4e-1a22-4799-8362-b4bdd425cca5 req-e189e23a-7d11-462d-a667-6eb2e97f3525 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.364043 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-415f7e4e-1a22-4799-8362-b4bdd425cca5 req-e189e23a-7d11-462d-a667-6eb2e97f3525 service nova] Creating event network-changed:36f49322-08ea-4d05-b1fa-2357653ca8be for instance c65e4283-9a5c-4b89-a006-7e6727e92f45 on nch2-master-1 Feb 19 20:56:40.370480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-415f7e4e-1a22-4799-8362-b4bdd425cca5 req-e189e23a-7d11-462d-a667-6eb2e97f3525 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064240 Feb 19 20:56:40.371391 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 756/1569] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:40.377646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-783525c0-de6d-4191-9dc2-c78cb24c9145 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:40.378576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-783525c0-de6d-4191-9dc2-c78cb24c9145 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: 5af34c3d-efca-4de5-94a6-7bdb97d068fd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:40.387153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-783525c0-de6d-4191-9dc2-c78cb24c9145 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.387646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-783525c0-de6d-4191-9dc2-c78cb24c9145 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.388477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-783525c0-de6d-4191-9dc2-c78cb24c9145 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.388921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-783525c0-de6d-4191-9dc2-c78cb24c9145 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.402337 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-783525c0-de6d-4191-9dc2-c78cb24c9145 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] HTTP exception thrown: Instance 5af34c3d-efca-4de5-94a6-7bdb97d068fd could not be found. Feb 19 20:56:40.402964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-783525c0-de6d-4191-9dc2-c78cb24c9145 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Returning 404 to user: Instance 5af34c3d-efca-4de5-94a6-7bdb97d068fd could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:40.403934 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-783525c0-de6d-4191-9dc2-c78cb24c9145 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd" status: 404 len: 111 microversion: 2.1 time: 0.031302 Feb 19 20:56:40.404841 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 757/1570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:40 2022] GET /compute/v2.1/servers/5af34c3d-efca-4de5-94a6-7bdb97d068fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:40.524818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-572fda7a-6dcb-4c80-ab46-2c60a1b34327 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Calling method '.version_select at 0x7f6467b37550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:40.560115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1dd680f0-c89c-4362-b9b0-b9865f1e15be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:40.566027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-572fda7a-6dcb-4c80-ab46-2c60a1b34327 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5abd2f1c-7140-4cf9-9dde-38de0cbabd65 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:56:40.566688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-572fda7a-6dcb-4c80-ab46-2c60a1b34327 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Neutron security group 5abd2f1c-7140-4cf9-9dde-38de0cbabd65 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 20:56:40.567208 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-572fda7a-6dcb-4c80-ab46-2c60a1b34327 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] HTTP exception thrown: Security group 5abd2f1c-7140-4cf9-9dde-38de0cbabd65 does not exist Feb 19 20:56:40.567208 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-a059eabe-4e9f-4be6-91ef-f9247cafff2b'] Feb 19 20:56:40.567797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-572fda7a-6dcb-4c80-ab46-2c60a1b34327 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Returning 404 to user: Security group 5abd2f1c-7140-4cf9-9dde-38de0cbabd65 does not exist Feb 19 20:56:40.567797 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-a059eabe-4e9f-4be6-91ef-f9247cafff2b'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:40.568641 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-572fda7a-6dcb-4c80-ab46-2c60a1b34327 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/5abd2f1c-7140-4cf9-9dde-38de0cbabd65" status: 404 len: 194 microversion: 2.1 time: 0.162878 Feb 19 20:56:40.569056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1dd680f0-c89c-4362-b9b0-b9865f1e15be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1467 microversion: 2.1 time: 0.272354 Feb 19 20:56:40.569734 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 814/1571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:40 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1467 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:40.573796 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 758/1572] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:56:40 2022] DELETE /compute/v2.1/os-security-groups/5abd2f1c-7140-4cf9-9dde-38de0cbabd65 => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:40.581697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c5a478f-d41d-42d2-8ba5-e2e1a410aa84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:40.582277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4c5a478f-d41d-42d2-8ba5-e2e1a410aa84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:40.585434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b918d55b-11e5-4c2b-9b16-58d5a6110789 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467a9d8b0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:40.589117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c5a478f-d41d-42d2-8ba5-e2e1a410aa84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.589696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c5a478f-d41d-42d2-8ba5-e2e1a410aa84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.590583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c5a478f-d41d-42d2-8ba5-e2e1a410aa84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.591119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c5a478f-d41d-42d2-8ba5-e2e1a410aa84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.617438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4c5a478f-d41d-42d2-8ba5-e2e1a410aa84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:56:40.637969 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b918d55b-11e5-4c2b-9b16-58d5a6110789 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.066865 Feb 19 20:56:40.638559 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 815/1573] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:40 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:40.643099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-07475b39-6252-4d85-87ad-c62b334d03de tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:40.643704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-07475b39-6252-4d85-87ad-c62b334d03de tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:40.649882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07475b39-6252-4d85-87ad-c62b334d03de tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.650587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07475b39-6252-4d85-87ad-c62b334d03de tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.651553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07475b39-6252-4d85-87ad-c62b334d03de tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.652015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07475b39-6252-4d85-87ad-c62b334d03de tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.718853 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c5a478f-d41d-42d2-8ba5-e2e1a410aa84 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 204 len: 0 microversion: 2.1 time: 0.143375 Feb 19 20:56:40.719435 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 759/1574] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:56:40 2022] DELETE /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:56:40.725066 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc231161-8ae0-41ed-862b-8d7801801f23 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004073 Feb 19 20:56:40.732395 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 760/1575] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Feb 19 20:56:40 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 19 20:56:40.738592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31079a8e-5973-470f-99f0-65e2f27e6c07 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:40.739301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-31079a8e-5973-470f-99f0-65e2f27e6c07 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:40.745260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31079a8e-5973-470f-99f0-65e2f27e6c07 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.745828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31079a8e-5973-470f-99f0-65e2f27e6c07 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.746614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31079a8e-5973-470f-99f0-65e2f27e6c07 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.747053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31079a8e-5973-470f-99f0-65e2f27e6c07 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.952799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-07475b39-6252-4d85-87ad-c62b334d03de tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:40.960898 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-07475b39-6252-4d85-87ad-c62b334d03de tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.321235 Feb 19 20:56:40.961805 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 816/1576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:40 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:40.966164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-94d85870-5d8c-4d7e-a188-3c4e319a72da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:40.966773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-94d85870-5d8c-4d7e-a188-3c4e319a72da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:40.972458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94d85870-5d8c-4d7e-a188-3c4e319a72da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.972911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94d85870-5d8c-4d7e-a188-3c4e319a72da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:40.973818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94d85870-5d8c-4d7e-a188-3c4e319a72da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:40.974272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94d85870-5d8c-4d7e-a188-3c4e319a72da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:41.033610 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-31079a8e-5973-470f-99f0-65e2f27e6c07 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1618 microversion: 2.1 time: 0.300030 Feb 19 20:56:41.034180 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 761/1577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:40 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1618 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:41.049832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-988230af-4b0c-4585-b859-82f73e49ddde tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Calling method '.version_select at 0x7f6467abdf70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:41.255029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-94d85870-5d8c-4d7e-a188-3c4e319a72da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:41.262450 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-94d85870-5d8c-4d7e-a188-3c4e319a72da tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1467 microversion: 2.1 time: 0.299673 Feb 19 20:56:41.263147 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 817/1578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:40 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1467 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:41.276761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5252f66f-2c93-4a7a-8090-2db0261bfdd9 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:41.277379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5252f66f-2c93-4a7a-8090-2db0261bfdd9 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:41.283747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5252f66f-2c93-4a7a-8090-2db0261bfdd9 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:41.284198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5252f66f-2c93-4a7a-8090-2db0261bfdd9 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:41.285028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5252f66f-2c93-4a7a-8090-2db0261bfdd9 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:41.285470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5252f66f-2c93-4a7a-8090-2db0261bfdd9 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:41.426645 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-988230af-4b0c-4585-b859-82f73e49ddde tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.380266 Feb 19 20:56:41.427537 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 762/1579] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 20:56:41 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:41.432001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1396387201", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4c97b67a-8ac7-415a-8fd9-9b05f343eb16"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:41.484050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:56:41.531619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5252f66f-2c93-4a7a-8090-2db0261bfdd9 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:41.539902 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5252f66f-2c93-4a7a-8090-2db0261bfdd9 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.266600 Feb 19 20:56:41.540506 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 818/1580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:41 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:41.544928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a2fbdba8-eea9-479e-995f-2f22d8a34a4b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:41.545538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a2fbdba8-eea9-479e-995f-2f22d8a34a4b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:41.551703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2fbdba8-eea9-479e-995f-2f22d8a34a4b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:41.552155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2fbdba8-eea9-479e-995f-2f22d8a34a4b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:41.552966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2fbdba8-eea9-479e-995f-2f22d8a34a4b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:41.553408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2fbdba8-eea9-479e-995f-2f22d8a34a4b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:41.764256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a2fbdba8-eea9-479e-995f-2f22d8a34a4b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:41.771661 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a2fbdba8-eea9-479e-995f-2f22d8a34a4b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.230009 Feb 19 20:56:41.772236 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 819/1581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:41 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:41.776473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fee4b1af-c3d9-42af-acde-4feaff885f19 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Calling method '.version_select at 0x7f6467c76ee0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:41.787982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:41.788518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:41.789031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:41.789507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:41.790025 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:41.799306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:41.799840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:41.800759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:41.801266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:41.818368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:41.822270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Getting quotas for user ab3fa7eadddf42b4b700593dad828e44 and project dabc5bb30faa4af797e9ba1cd4bad547. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:41.833965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:56:41.836320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:56:41.878845 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-31fa1341-cef0-4993-bd46-9ae601aa7b1d tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.450456 Feb 19 20:56:41.879706 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 763/1582] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:56:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:56:41.887195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-829155fb-04eb-4b32-9df0-47317281075b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467bcd3a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:41.898136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG neutronclient.v2_0.client [None req-fee4b1af-c3d9-42af-acde-4feaff885f19 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=136094) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:56:41.899215 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-fee4b1af-c3d9-42af-acde-4feaff885f19 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] HTTP exception thrown: Insufficient rights for removing default security group. Feb 19 20:56:41.899215 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-0b327cc6-3db2-4234-b7f8-df72ffa4120f'] Feb 19 20:56:41.899969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fee4b1af-c3d9-42af-acde-4feaff885f19 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Returning 400 to user: Insufficient rights for removing default security group. Feb 19 20:56:41.899969 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-0b327cc6-3db2-4234-b7f8-df72ffa4120f'] {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:41.900996 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fee4b1af-c3d9-42af-acde-4feaff885f19 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a4f94751-386f-41e0-a55f-c0524e274e38" status: 400 len: 182 microversion: 2.1 time: 0.127831 Feb 19 20:56:41.903253 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 820/1583] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 20:56:41 2022] DELETE /compute/v2.1/os-security-groups/a4f94751-386f-41e0-a55f-c0524e274e38 => generated 182 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:56:41.908169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aa26e6a0-e43c-4b15-8ba2-e62edef6ce84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:41.908940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aa26e6a0-e43c-4b15-8ba2-e62edef6ce84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:41.943175 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-829155fb-04eb-4b32-9df0-47317281075b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.061415 Feb 19 20:56:41.943750 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 764/1584] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:41 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:41.949906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ca4c1cb-fc12-4b91-b48c-cea0201980e0 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Calling method '.version_select at 0x7f6467abd550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:41.973940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa26e6a0-e43c-4b15-8ba2-e62edef6ce84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:41.981103 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aa26e6a0-e43c-4b15-8ba2-e62edef6ce84 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1217 microversion: 2.1 time: 0.076581 Feb 19 20:56:41.982662 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 821/1585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:41 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:41.987665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-8ca4c1cb-fc12-4b91-b48c-cea0201980e0 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 442ede3c-4664-4377-a192-81131d559bd7 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:56:41.988271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-8ca4c1cb-fc12-4b91-b48c-cea0201980e0 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Neutron security group 442ede3c-4664-4377-a192-81131d559bd7 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 20:56:41.988895 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8ca4c1cb-fc12-4b91-b48c-cea0201980e0 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] HTTP exception thrown: Security group 442ede3c-4664-4377-a192-81131d559bd7 does not exist Feb 19 20:56:41.988895 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-30a8d225-1885-4bda-9ec2-517023d13e54'] Feb 19 20:56:41.989840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ca4c1cb-fc12-4b91-b48c-cea0201980e0 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Returning 404 to user: Security group 442ede3c-4664-4377-a192-81131d559bd7 does not exist Feb 19 20:56:41.989840 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-30a8d225-1885-4bda-9ec2-517023d13e54'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:41.990309 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ca4c1cb-fc12-4b91-b48c-cea0201980e0 tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/442ede3c-4664-4377-a192-81131d559bd7" status: 404 len: 194 microversion: 2.1 time: 0.045672 Feb 19 20:56:41.991060 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 765/1586] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 20:56:41 2022] GET /compute/v2.1/os-security-groups/442ede3c-4664-4377-a192-81131d559bd7 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:41.995178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9ea90373-818f-4b53-ac69-c48192612f0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:41.997071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9ea90373-818f-4b53-ac69-c48192612f0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:42.000228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b32171d2-ed78-49a3-bbcd-9d737aeef4cb tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Action: 'update', calling method: .version_select at 0x7f6467ac3790>, body: {"security_group": {"name": "tempest-sg-837020660", "description": "tempest-description-1442008722"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:42.005364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ea90373-818f-4b53-ac69-c48192612f0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:42.005830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ea90373-818f-4b53-ac69-c48192612f0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:42.006622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ea90373-818f-4b53-ac69-c48192612f0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:42.007165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ea90373-818f-4b53-ac69-c48192612f0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:42.024209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-b32171d2-ed78-49a3-bbcd-9d737aeef4cb tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1ddbc41-514d-40cf-a01a-894120ac7584 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:56:42.025590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-b32171d2-ed78-49a3-bbcd-9d737aeef4cb tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Neutron security group c1ddbc41-514d-40cf-a01a-894120ac7584 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 20:56:42.026241 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-b32171d2-ed78-49a3-bbcd-9d737aeef4cb tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] HTTP exception thrown: Security group c1ddbc41-514d-40cf-a01a-894120ac7584 does not exist Feb 19 20:56:42.026241 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-a7d92744-fc92-452f-9fd4-0662911e30f2'] Feb 19 20:56:42.026904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b32171d2-ed78-49a3-bbcd-9d737aeef4cb tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] Returning 404 to user: Security group c1ddbc41-514d-40cf-a01a-894120ac7584 does not exist Feb 19 20:56:42.026904 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-a7d92744-fc92-452f-9fd4-0662911e30f2'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:42.027980 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b32171d2-ed78-49a3-bbcd-9d737aeef4cb tempest-SecurityGroupsNegativeTestJSON-704359152 tempest-SecurityGroupsNegativeTestJSON-704359152-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/c1ddbc41-514d-40cf-a01a-894120ac7584" status: 404 len: 194 microversion: 2.1 time: 0.031538 Feb 19 20:56:42.029028 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 766/1587] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Feb 19 20:56:41 2022] PUT /compute/v2.1/os-security-groups/c1ddbc41-514d-40cf-a01a-894120ac7584 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:42.248527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9ea90373-818f-4b53-ac69-c48192612f0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:42.257443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9ea90373-818f-4b53-ac69-c48192612f0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.271684 Feb 19 20:56:42.267121 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 822/1588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:41 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:42.282022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-969ec3c8-35c6-4adb-99d0-91c99995d204 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:42.282804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-969ec3c8-35c6-4adb-99d0-91c99995d204 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:42.289298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-969ec3c8-35c6-4adb-99d0-91c99995d204 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:42.289786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-969ec3c8-35c6-4adb-99d0-91c99995d204 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:42.290790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-969ec3c8-35c6-4adb-99d0-91c99995d204 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:42.291230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-969ec3c8-35c6-4adb-99d0-91c99995d204 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:42.448835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-969ec3c8-35c6-4adb-99d0-91c99995d204 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:42.457725 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-969ec3c8-35c6-4adb-99d0-91c99995d204 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1467 microversion: 2.1 time: 0.181243 Feb 19 20:56:42.458394 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 767/1589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:42 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1467 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:42.556663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e3db972-488a-4cc8-a61a-7b3d4ea746b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:42.557290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e3db972-488a-4cc8-a61a-7b3d4ea746b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:42.563590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e3db972-488a-4cc8-a61a-7b3d4ea746b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:42.564041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e3db972-488a-4cc8-a61a-7b3d4ea746b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:42.564936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e3db972-488a-4cc8-a61a-7b3d4ea746b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:42.565378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e3db972-488a-4cc8-a61a-7b3d4ea746b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:42.721143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6e3db972-488a-4cc8-a61a-7b3d4ea746b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:42.735048 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6e3db972-488a-4cc8-a61a-7b3d4ea746b1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.182522 Feb 19 20:56:42.735818 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 823/1590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:42 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:42.788093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d90d0276-0546-4929-bcd5-1d9203f20233 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:42.788723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d90d0276-0546-4929-bcd5-1d9203f20233 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:42.794481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d90d0276-0546-4929-bcd5-1d9203f20233 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:42.794931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d90d0276-0546-4929-bcd5-1d9203f20233 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:42.795707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d90d0276-0546-4929-bcd5-1d9203f20233 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:42.796140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d90d0276-0546-4929-bcd5-1d9203f20233 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:42.938744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d90d0276-0546-4929-bcd5-1d9203f20233 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:42.948105 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d90d0276-0546-4929-bcd5-1d9203f20233 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.163606 Feb 19 20:56:42.949804 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 768/1591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:42 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:42.963321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-72d6eb40-3cfa-4126-9a95-5aa8f5fb2d79 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467c6f700>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:43.003543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b135eaf2-2c0d-4630-b765-b7df38546684 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:43.004163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b135eaf2-2c0d-4630-b765-b7df38546684 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:43.013583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b135eaf2-2c0d-4630-b765-b7df38546684 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:43.014592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b135eaf2-2c0d-4630-b765-b7df38546684 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:43.015683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b135eaf2-2c0d-4630-b765-b7df38546684 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:43.016120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b135eaf2-2c0d-4630-b765-b7df38546684 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:43.023456 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-72d6eb40-3cfa-4126-9a95-5aa8f5fb2d79 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.070752 Feb 19 20:56:43.024435 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 824/1592] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:42 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:43.087605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b135eaf2-2c0d-4630-b765-b7df38546684 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:43.096878 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b135eaf2-2c0d-4630-b765-b7df38546684 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1269 microversion: 2.1 time: 0.100675 Feb 19 20:56:43.097525 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 769/1593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:42 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1269 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:43.274626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b9eab9ed-a021-40ea-b59b-40ceeb5a5c3d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:43.275263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b9eab9ed-a021-40ea-b59b-40ceeb5a5c3d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:43.281326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9eab9ed-a021-40ea-b59b-40ceeb5a5c3d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:43.281769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9eab9ed-a021-40ea-b59b-40ceeb5a5c3d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:43.282551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9eab9ed-a021-40ea-b59b-40ceeb5a5c3d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:43.282984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9eab9ed-a021-40ea-b59b-40ceeb5a5c3d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:43.426236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b9eab9ed-a021-40ea-b59b-40ceeb5a5c3d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:43.437303 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b9eab9ed-a021-40ea-b59b-40ceeb5a5c3d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.166719 Feb 19 20:56:43.448458 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 825/1594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:43 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:43.476851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0bfa4084-895f-4c9a-b46a-532c25ac4baa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:43.476851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0bfa4084-895f-4c9a-b46a-532c25ac4baa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:43.484118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bfa4084-895f-4c9a-b46a-532c25ac4baa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:43.484669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bfa4084-895f-4c9a-b46a-532c25ac4baa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:43.486212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bfa4084-895f-4c9a-b46a-532c25ac4baa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:43.486826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bfa4084-895f-4c9a-b46a-532c25ac4baa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:43.750854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96a69ae8-3022-4505-946e-9cd7e147db0b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:43.751513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-96a69ae8-3022-4505-946e-9cd7e147db0b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:43.757856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96a69ae8-3022-4505-946e-9cd7e147db0b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:43.758534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96a69ae8-3022-4505-946e-9cd7e147db0b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:43.759316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96a69ae8-3022-4505-946e-9cd7e147db0b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:43.759755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96a69ae8-3022-4505-946e-9cd7e147db0b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:44.085799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0bfa4084-895f-4c9a-b46a-532c25ac4baa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:44.095543 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0bfa4084-895f-4c9a-b46a-532c25ac4baa tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1467 microversion: 2.1 time: 0.624757 Feb 19 20:56:44.096282 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 770/1595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:43 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1467 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:44.112578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-08e1bb41-1dcd-4999-860b-2fa58ef484f3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:44.113466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08e1bb41-1dcd-4999-860b-2fa58ef484f3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:44.120537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08e1bb41-1dcd-4999-860b-2fa58ef484f3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:44.121349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08e1bb41-1dcd-4999-860b-2fa58ef484f3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:44.122536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08e1bb41-1dcd-4999-860b-2fa58ef484f3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:44.123188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08e1bb41-1dcd-4999-860b-2fa58ef484f3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:44.320895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-96a69ae8-3022-4505-946e-9cd7e147db0b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:44.330906 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96a69ae8-3022-4505-946e-9cd7e147db0b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.583679 Feb 19 20:56:44.338753 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 826/1596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:43 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:44.345170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f742e12-c1d5-4fe9-bd8e-de8e93ccdff9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467b4d1f0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:44.387263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-08e1bb41-1dcd-4999-860b-2fa58ef484f3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:44.396849 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-08e1bb41-1dcd-4999-860b-2fa58ef484f3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.289451 Feb 19 20:56:44.397434 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 771/1597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:44 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:44.407136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c5fc67a0-3027-481a-9574-9f9a659951b2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:44.408025 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c5fc67a0-3027-481a-9574-9f9a659951b2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:44.421186 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f742e12-c1d5-4fe9-bd8e-de8e93ccdff9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.081084 Feb 19 20:56:44.424183 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 827/1598] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:44 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:44.424964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5fc67a0-3027-481a-9574-9f9a659951b2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:44.427375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5fc67a0-3027-481a-9574-9f9a659951b2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:44.428202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5fc67a0-3027-481a-9574-9f9a659951b2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:44.428670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5fc67a0-3027-481a-9574-9f9a659951b2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:44.459529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a1efbbdb-9473-4b2c-b0b5-032f84c0f7c9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:44.460713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a1efbbdb-9473-4b2c-b0b5-032f84c0f7c9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:44.468129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1efbbdb-9473-4b2c-b0b5-032f84c0f7c9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:44.468901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1efbbdb-9473-4b2c-b0b5-032f84c0f7c9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:44.470955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1efbbdb-9473-4b2c-b0b5-032f84c0f7c9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:44.471605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1efbbdb-9473-4b2c-b0b5-032f84c0f7c9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:44.793174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c5fc67a0-3027-481a-9574-9f9a659951b2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:44.804239 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c5fc67a0-3027-481a-9574-9f9a659951b2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.405747 Feb 19 20:56:44.814393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a1efbbdb-9473-4b2c-b0b5-032f84c0f7c9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:44.817933 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 772/1599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:44 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:44.822734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-afbb4955-cad1-4e65-bcc2-62998b4d938d req-1bd92b54-c263-4f8f-9032-bf7f2be6ae33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24d94c6-d921-42bf-affb-6f8556e5b76d", "name": "network-vif-deleted", "tag": "99019bb9-0cfe-4900-a813-f2a3826c4aed"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:44.824252 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a1efbbdb-9473-4b2c-b0b5-032f84c0f7c9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.370160 Feb 19 20:56:44.824439 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:44.824439 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:44.825749 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 828/1600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:44 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:44.832168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-afbb4955-cad1-4e65-bcc2-62998b4d938d req-1bd92b54-c263-4f8f-9032-bf7f2be6ae33 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:44.832859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-afbb4955-cad1-4e65-bcc2-62998b4d938d req-1bd92b54-c263-4f8f-9032-bf7f2be6ae33 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:44.850572 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-afbb4955-cad1-4e65-bcc2-62998b4d938d req-1bd92b54-c263-4f8f-9032-bf7f2be6ae33 service nova] Creating event network-vif-deleted:99019bb9-0cfe-4900-a813-f2a3826c4aed for instance d24d94c6-d921-42bf-affb-6f8556e5b76d on nch2-master-1 Feb 19 20:56:44.857400 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-afbb4955-cad1-4e65-bcc2-62998b4d938d req-1bd92b54-c263-4f8f-9032-bf7f2be6ae33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038136 Feb 19 20:56:44.858394 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 773/1601] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:45.112850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:45.113472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:45.123526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:45.124312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:45.125387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:45.126149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:45.167910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:45.168891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:45.169591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lazy-loading 'fault' on Instance uuid d24d94c6-d921-42bf-affb-6f8556e5b76d {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:56:45.223731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26bc5048c9849218cadd12475cd5fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2599a1bea39406f9b1e548ab3f1cd22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:45.232744 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a8e9c76c-412d-4c38-aa24-958fd33d0fcf tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 200 len: 1302 microversion: 2.1 time: 0.123437 Feb 19 20:56:45.233722 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 829/1602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:45 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:45.351085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-37352b4a-3b80-48fb-8d4b-1501f3894af8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:45.351822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-37352b4a-3b80-48fb-8d4b-1501f3894af8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:45.363163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37352b4a-3b80-48fb-8d4b-1501f3894af8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:45.363667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37352b4a-3b80-48fb-8d4b-1501f3894af8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:45.364536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37352b4a-3b80-48fb-8d4b-1501f3894af8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:45.365000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37352b4a-3b80-48fb-8d4b-1501f3894af8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:45.414615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-720fa6f6-af19-43ba-a57b-0083955dc424 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:45.415283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-720fa6f6-af19-43ba-a57b-0083955dc424 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:45.422654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720fa6f6-af19-43ba-a57b-0083955dc424 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:45.423392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720fa6f6-af19-43ba-a57b-0083955dc424 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:45.424653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720fa6f6-af19-43ba-a57b-0083955dc424 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:45.425259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720fa6f6-af19-43ba-a57b-0083955dc424 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:45.962188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-720fa6f6-af19-43ba-a57b-0083955dc424 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:45.970068 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-720fa6f6-af19-43ba-a57b-0083955dc424 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.559758 Feb 19 20:56:45.980006 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 830/1603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:45 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:45.982576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d4b8acf2-447c-47f6-80b2-49be31a64746 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467a9d4c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:45.998135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-37352b4a-3b80-48fb-8d4b-1501f3894af8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:46.006569 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-37352b4a-3b80-48fb-8d4b-1501f3894af8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.661617 Feb 19 20:56:46.009004 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 774/1604] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:45 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:46.025782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2a75c1d1-56ad-45ea-885f-b8d97553c6f5 req-5007f1ca-ec65-4734-ba4b-6af48c53176e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99", "tag": "020bbc87-1ec4-420c-9f86-2a44e5ea3d18"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:46.039036 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:46.039036 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:46.046887 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d4b8acf2-447c-47f6-80b2-49be31a64746 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.067857 Feb 19 20:56:46.047081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2a75c1d1-56ad-45ea-885f-b8d97553c6f5 req-5007f1ca-ec65-4734-ba4b-6af48c53176e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:46.047488 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 831/1605] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:45 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:46.047727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2a75c1d1-56ad-45ea-885f-b8d97553c6f5 req-5007f1ca-ec65-4734-ba4b-6af48c53176e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:46.060064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cc6d6217-b9a5-4525-9fe0-6f6bc8244bac tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:46.062188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cc6d6217-b9a5-4525-9fe0-6f6bc8244bac tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:46.072272 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2a75c1d1-56ad-45ea-885f-b8d97553c6f5 req-5007f1ca-ec65-4734-ba4b-6af48c53176e service nova] Creating event network-changed:020bbc87-1ec4-420c-9f86-2a44e5ea3d18 for instance 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 on nch2-master-1 Feb 19 20:56:46.081828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc6d6217-b9a5-4525-9fe0-6f6bc8244bac tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:46.082508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc6d6217-b9a5-4525-9fe0-6f6bc8244bac tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:46.083494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc6d6217-b9a5-4525-9fe0-6f6bc8244bac tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:46.084253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc6d6217-b9a5-4525-9fe0-6f6bc8244bac tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:46.089657 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2a75c1d1-56ad-45ea-885f-b8d97553c6f5 req-5007f1ca-ec65-4734-ba4b-6af48c53176e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079196 Feb 19 20:56:46.091099 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 775/1606] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:46.100529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f5162d8-efa8-4317-b1a3-22836a76ce43 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:46.101545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f5162d8-efa8-4317-b1a3-22836a76ce43 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:46.108919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f5162d8-efa8-4317-b1a3-22836a76ce43 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:46.109755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f5162d8-efa8-4317-b1a3-22836a76ce43 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:46.111549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f5162d8-efa8-4317-b1a3-22836a76ce43 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:46.112729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f5162d8-efa8-4317-b1a3-22836a76ce43 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:46.481466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cc6d6217-b9a5-4525-9fe0-6f6bc8244bac tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:46.489493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f5162d8-efa8-4317-b1a3-22836a76ce43 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:46.494572 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cc6d6217-b9a5-4525-9fe0-6f6bc8244bac tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.444491 Feb 19 20:56:46.495385 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 832/1607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:46 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:46.505405 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f5162d8-efa8-4317-b1a3-22836a76ce43 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.404027 Feb 19 20:56:46.505405 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 776/1608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:46 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:46.505405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6e79d394-dcc8-4b6e-a00f-7e93589ef704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:46.506153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6e79d394-dcc8-4b6e-a00f-7e93589ef704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] [instance: d24d94c6-d921-42bf-affb-6f8556e5b76d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:46.512207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e79d394-dcc8-4b6e-a00f-7e93589ef704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:46.512982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e79d394-dcc8-4b6e-a00f-7e93589ef704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:46.514112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e79d394-dcc8-4b6e-a00f-7e93589ef704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:46.515355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e79d394-dcc8-4b6e-a00f-7e93589ef704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:46.531645 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-6e79d394-dcc8-4b6e-a00f-7e93589ef704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] HTTP exception thrown: Instance d24d94c6-d921-42bf-affb-6f8556e5b76d could not be found. Feb 19 20:56:46.532629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6e79d394-dcc8-4b6e-a00f-7e93589ef704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] Returning 404 to user: Instance d24d94c6-d921-42bf-affb-6f8556e5b76d could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:56:46.534619 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6e79d394-dcc8-4b6e-a00f-7e93589ef704 tempest-MigrationsAdminTest-1602652948 tempest-MigrationsAdminTest-1602652948-project] 10.222.0.30 "GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d" status: 404 len: 111 microversion: 2.1 time: 0.034743 Feb 19 20:56:46.535633 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 777/1609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:46 2022] GET /compute/v2.1/servers/d24d94c6-d921-42bf-affb-6f8556e5b76d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:56:46.987291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-49480549-3507-450a-be0e-63cfc3f2e407 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:46.988293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-49480549-3507-450a-be0e-63cfc3f2e407 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:47.000775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49480549-3507-450a-be0e-63cfc3f2e407 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:47.002126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49480549-3507-450a-be0e-63cfc3f2e407 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:47.003019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49480549-3507-450a-be0e-63cfc3f2e407 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:47.003636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49480549-3507-450a-be0e-63cfc3f2e407 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:47.027547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e12ce5d-a4fc-4311-be4c-c5a2dc821622 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:47.028669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e12ce5d-a4fc-4311-be4c-c5a2dc821622 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:47.038221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e12ce5d-a4fc-4311-be4c-c5a2dc821622 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:47.044981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e12ce5d-a4fc-4311-be4c-c5a2dc821622 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:47.045945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e12ce5d-a4fc-4311-be4c-c5a2dc821622 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:47.046625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e12ce5d-a4fc-4311-be4c-c5a2dc821622 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:47.471744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8e12ce5d-a4fc-4311-be4c-c5a2dc821622 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:47.479163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-49480549-3507-450a-be0e-63cfc3f2e407 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:47.480052 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8e12ce5d-a4fc-4311-be4c-c5a2dc821622 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.458653 Feb 19 20:56:47.489909 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 778/1610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:47 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:47.490534 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-49480549-3507-450a-be0e-63cfc3f2e407 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.506325 Feb 19 20:56:47.491773 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 833/1611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:46 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:47.501907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2e38ad25-cd17-421d-9f88-f4057b0412fd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467b7ce50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:47.513362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1df9c2c4-130b-46c4-b6a6-4f41a3196714 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:47.515871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1df9c2c4-130b-46c4-b6a6-4f41a3196714 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:47.550514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1df9c2c4-130b-46c4-b6a6-4f41a3196714 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:47.556203 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2e38ad25-cd17-421d-9f88-f4057b0412fd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.064088 Feb 19 20:56:47.562143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1df9c2c4-130b-46c4-b6a6-4f41a3196714 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:47.562958 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 779/1612] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:47 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:47.563548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1df9c2c4-130b-46c4-b6a6-4f41a3196714 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:47.568881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d83dc913-09b1-4af4-b7d8-645ea449450a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:47.569794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d83dc913-09b1-4af4-b7d8-645ea449450a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:47.570898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1df9c2c4-130b-46c4-b6a6-4f41a3196714 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:47.582206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d83dc913-09b1-4af4-b7d8-645ea449450a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:47.583063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d83dc913-09b1-4af4-b7d8-645ea449450a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:47.584262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d83dc913-09b1-4af4-b7d8-645ea449450a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:47.585033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d83dc913-09b1-4af4-b7d8-645ea449450a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:47.973942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d83dc913-09b1-4af4-b7d8-645ea449450a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:47.978101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1df9c2c4-130b-46c4-b6a6-4f41a3196714 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:47.983747 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d83dc913-09b1-4af4-b7d8-645ea449450a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.418611 Feb 19 20:56:47.992587 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 780/1613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:47 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:47.995681 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1df9c2c4-130b-46c4-b6a6-4f41a3196714 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.486750 Feb 19 20:56:48.004596 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 834/1614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:47 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:48.043103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-bc4ed475-9b1c-4e13-a308-41f1435fd502 req-3aa423f6-121b-4d1c-b651-ff2d4ba5bec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d927e050-ac38-4b26-8aa5-14f490410068", "name": "network-vif-plugged", "status": "completed", "tag": "ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:48.045128 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:48.045128 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:48.053039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-bc4ed475-9b1c-4e13-a308-41f1435fd502 req-3aa423f6-121b-4d1c-b651-ff2d4ba5bec7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:48.053797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-bc4ed475-9b1c-4e13-a308-41f1435fd502 req-3aa423f6-121b-4d1c-b651-ff2d4ba5bec7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:48.069007 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-bc4ed475-9b1c-4e13-a308-41f1435fd502 req-3aa423f6-121b-4d1c-b651-ff2d4ba5bec7 service nova] Creating event network-vif-plugged:ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c for instance d927e050-ac38-4b26-8aa5-14f490410068 on nch2-master-1 Feb 19 20:56:48.076809 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-bc4ed475-9b1c-4e13-a308-41f1435fd502 req-3aa423f6-121b-4d1c-b651-ff2d4ba5bec7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036085 Feb 19 20:56:48.077990 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 781/1615] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:48.499140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-153a575c-2fe9-44f1-af5d-53985a2b51c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:48.500884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-153a575c-2fe9-44f1-af5d-53985a2b51c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:48.508710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c251301-1a3e-4781-8d3d-c39621cb71dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:48.509413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c251301-1a3e-4781-8d3d-c39621cb71dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:48.511373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-153a575c-2fe9-44f1-af5d-53985a2b51c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:48.512195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-153a575c-2fe9-44f1-af5d-53985a2b51c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:48.513568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-153a575c-2fe9-44f1-af5d-53985a2b51c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:48.514227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-153a575c-2fe9-44f1-af5d-53985a2b51c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:48.520898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c251301-1a3e-4781-8d3d-c39621cb71dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:48.521407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c251301-1a3e-4781-8d3d-c39621cb71dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:48.522234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c251301-1a3e-4781-8d3d-c39621cb71dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:48.522679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c251301-1a3e-4781-8d3d-c39621cb71dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:48.935637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-153a575c-2fe9-44f1-af5d-53985a2b51c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:48.968124 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-153a575c-2fe9-44f1-af5d-53985a2b51c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.474705 Feb 19 20:56:48.970454 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 835/1616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:48 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:48.975750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-19bc1553-706e-42c9-bbd7-88ad4d44deba tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467c764c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:48.983278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c251301-1a3e-4781-8d3d-c39621cb71dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:48.992739 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c251301-1a3e-4781-8d3d-c39621cb71dd tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.488895 Feb 19 20:56:48.993333 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 782/1617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:48 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:49.007478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-558ee6e6-1d55-41d0-8b3f-77775f21665e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:49.008102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-558ee6e6-1d55-41d0-8b3f-77775f21665e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:49.017366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-558ee6e6-1d55-41d0-8b3f-77775f21665e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:49.018071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-558ee6e6-1d55-41d0-8b3f-77775f21665e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:49.019250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-558ee6e6-1d55-41d0-8b3f-77775f21665e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:49.020096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-558ee6e6-1d55-41d0-8b3f-77775f21665e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:49.051127 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-19bc1553-706e-42c9-bbd7-88ad4d44deba tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.079191 Feb 19 20:56:49.051785 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 836/1618] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:48 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:49.062802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d49148f5-b40b-49e1-b57b-57e359e95b94 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:49.062802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d49148f5-b40b-49e1-b57b-57e359e95b94 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:49.070776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d49148f5-b40b-49e1-b57b-57e359e95b94 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:49.071467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d49148f5-b40b-49e1-b57b-57e359e95b94 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:49.072455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d49148f5-b40b-49e1-b57b-57e359e95b94 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:49.073238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d49148f5-b40b-49e1-b57b-57e359e95b94 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:49.373673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-558ee6e6-1d55-41d0-8b3f-77775f21665e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:49.376800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d49148f5-b40b-49e1-b57b-57e359e95b94 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:49.384413 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d49148f5-b40b-49e1-b57b-57e359e95b94 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.331340 Feb 19 20:56:49.384830 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-558ee6e6-1d55-41d0-8b3f-77775f21665e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.380635 Feb 19 20:56:49.394100 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 837/1619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:49 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:49.395076 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 783/1620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:49 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:49.986534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e16a9422-1afc-42de-9e87-8366799764c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:49.987315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e16a9422-1afc-42de-9e87-8366799764c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:49.998349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e16a9422-1afc-42de-9e87-8366799764c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:50.001145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e16a9422-1afc-42de-9e87-8366799764c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:50.002787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e16a9422-1afc-42de-9e87-8366799764c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:50.004244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e16a9422-1afc-42de-9e87-8366799764c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:50.011894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-29fb7030-36e8-496f-90a5-5540b740f79e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:50.012546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-29fb7030-36e8-496f-90a5-5540b740f79e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:50.021806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29fb7030-36e8-496f-90a5-5540b740f79e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:50.023250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29fb7030-36e8-496f-90a5-5540b740f79e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:50.025877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29fb7030-36e8-496f-90a5-5540b740f79e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:50.026602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29fb7030-36e8-496f-90a5-5540b740f79e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:50.379534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e16a9422-1afc-42de-9e87-8366799764c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:50.387262 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e16a9422-1afc-42de-9e87-8366799764c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.404936 Feb 19 20:56:50.387979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-29fb7030-36e8-496f-90a5-5540b740f79e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:50.397921 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 838/1621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:49 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:50.401815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f0d5667e-d532-4369-ab69-e71649e11fa4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64679c6310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:50.404517 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-29fb7030-36e8-496f-90a5-5540b740f79e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.396719 Feb 19 20:56:50.414431 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 784/1622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:50 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:50.473254 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f0d5667e-d532-4369-ab69-e71649e11fa4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.079867 Feb 19 20:56:50.474279 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 839/1623] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:50 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:50.484639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec923680-4577-4694-989a-15a56800cdea tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:50.485249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ec923680-4577-4694-989a-15a56800cdea tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:50.491596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec923680-4577-4694-989a-15a56800cdea tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:50.492046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec923680-4577-4694-989a-15a56800cdea tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:50.492872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec923680-4577-4694-989a-15a56800cdea tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:50.493551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec923680-4577-4694-989a-15a56800cdea tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:50.568271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1970331475", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:50.635284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:56:50.910334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec923680-4577-4694-989a-15a56800cdea tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:50.918962 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec923680-4577-4694-989a-15a56800cdea tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.438389 Feb 19 20:56:50.924670 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 840/1624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:50 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:50.931789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e2abf4eb-b196-4301-952e-714384124804 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:50.933536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e2abf4eb-b196-4301-952e-714384124804 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:50.949804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2abf4eb-b196-4301-952e-714384124804 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:50.950115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2abf4eb-b196-4301-952e-714384124804 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:50.951914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2abf4eb-b196-4301-952e-714384124804 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:50.953157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2abf4eb-b196-4301-952e-714384124804 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:51.141392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:51.142574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:51.143321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:51.143768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:51.144539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:51.166662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:51.167327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:51.169258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:51.175148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:51.212196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Getting quotas for project 106062f100884d929b001725a5daa730. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:51.222332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Getting quotas for user 4a93bc6b2b584caab5baabf5fdbea583 and project 106062f100884d929b001725a5daa730. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:51.249158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:56:51.253192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:56:51.342459 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-85e178a6-cb81-4a59-8903-8e6199df688a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936382 Feb 19 20:56:51.343701 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 785/1625] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:56:51.353727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dd435910-355c-4bb9-8d45-c1f5f037a6d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:51.369492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dd435910-355c-4bb9-8d45-c1f5f037a6d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:51.523271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dd435910-355c-4bb9-8d45-c1f5f037a6d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:51.534078 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dd435910-355c-4bb9-8d45-c1f5f037a6d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1222 microversion: 2.1 time: 0.184165 Feb 19 20:56:51.537779 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 786/1626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:51 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:51.554411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c765756-3656-489b-a93f-5c3c6a3f03fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:51.555744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4c765756-3656-489b-a93f-5c3c6a3f03fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:51.579132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c765756-3656-489b-a93f-5c3c6a3f03fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:51.583900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c765756-3656-489b-a93f-5c3c6a3f03fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:51.585208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c765756-3656-489b-a93f-5c3c6a3f03fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:51.587381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c765756-3656-489b-a93f-5c3c6a3f03fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:51.795361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e2abf4eb-b196-4301-952e-714384124804 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:51.808489 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e2abf4eb-b196-4301-952e-714384124804 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.882494 Feb 19 20:56:51.809894 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 841/1627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:50 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:51.814927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41f5a4c9-c982-4c7a-9bd5-b57003ba55fb tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:51.815533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41f5a4c9-c982-4c7a-9bd5-b57003ba55fb tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:51.836676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41f5a4c9-c982-4c7a-9bd5-b57003ba55fb tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:51.837510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41f5a4c9-c982-4c7a-9bd5-b57003ba55fb tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:51.838489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41f5a4c9-c982-4c7a-9bd5-b57003ba55fb tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:51.839091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41f5a4c9-c982-4c7a-9bd5-b57003ba55fb tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:52.036034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4c765756-3656-489b-a93f-5c3c6a3f03fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:52.053090 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c765756-3656-489b-a93f-5c3c6a3f03fc tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.513940 Feb 19 20:56:52.055207 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 787/1628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:51 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:52.068279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19ec4ae2-1d82-4687-85e2-ffc45c920278 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467abb1f0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:52.125136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-41f5a4c9-c982-4c7a-9bd5-b57003ba55fb tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:52.132993 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41f5a4c9-c982-4c7a-9bd5-b57003ba55fb tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.322140 Feb 19 20:56:52.133572 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 842/1629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:51 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:52.147012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0fc64ab7-cdf6-4d57-b698-2f6a80f67783 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:52.147953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0fc64ab7-cdf6-4d57-b698-2f6a80f67783 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:52.153199 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-19ec4ae2-1d82-4687-85e2-ffc45c920278 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.096240 Feb 19 20:56:52.154181 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 788/1630] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:52 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:52.164827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fc64ab7-cdf6-4d57-b698-2f6a80f67783 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:52.166111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fc64ab7-cdf6-4d57-b698-2f6a80f67783 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:52.169384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fc64ab7-cdf6-4d57-b698-2f6a80f67783 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:52.169908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fc64ab7-cdf6-4d57-b698-2f6a80f67783 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:52.245192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13d5e3a2-54a3-467d-b87a-82b6195fced3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Action: 'create', calling method: .version_select at 0x7f6467b37280>, body: {"keypair": {"name": "tempest-keypair-93172753"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:52.261224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-13d5e3a2-54a3-467d-b87a-82b6195fced3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Getting quotas for project 5c496adb59f3467687458650e28da232. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:52.265885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-13d5e3a2-54a3-467d-b87a-82b6195fced3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Getting quotas for user 33f01d50bf4e41ff95c09af549cd37e9 and project 5c496adb59f3467687458650e28da232. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:52.355301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0fc64ab7-cdf6-4d57-b698-2f6a80f67783 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:52.364622 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0fc64ab7-cdf6-4d57-b698-2f6a80f67783 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.229373 Feb 19 20:56:52.365847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 843/1631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:52 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:52.432934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-13d5e3a2-54a3-467d-b87a-82b6195fced3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Getting quotas for project 5c496adb59f3467687458650e28da232. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:52.438050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-13d5e3a2-54a3-467d-b87a-82b6195fced3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Getting quotas for user 33f01d50bf4e41ff95c09af549cd37e9 and project 5c496adb59f3467687458650e28da232. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:52.455083 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13d5e3a2-54a3-467d-b87a-82b6195fced3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.271034 Feb 19 20:56:52.456001 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 789/1632] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:56:52 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:52.559561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3e6e136e-3465-4847-8619-e4feddbf01d5 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:52.561256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3e6e136e-3465-4847-8619-e4feddbf01d5 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:52.579457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e6e136e-3465-4847-8619-e4feddbf01d5 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:52.580358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e6e136e-3465-4847-8619-e4feddbf01d5 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:52.581409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e6e136e-3465-4847-8619-e4feddbf01d5 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:52.582226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e6e136e-3465-4847-8619-e4feddbf01d5 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:52.700698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3e6e136e-3465-4847-8619-e4feddbf01d5 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:52.714403 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3e6e136e-3465-4847-8619-e4feddbf01d5 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1274 microversion: 2.1 time: 0.163923 Feb 19 20:56:52.727361 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 844/1633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:52 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:52.827028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0d99706b-e2df-4d61-b480-394ac4a3f2cc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:52.827659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0d99706b-e2df-4d61-b480-394ac4a3f2cc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:52.839300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d99706b-e2df-4d61-b480-394ac4a3f2cc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:52.841138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d99706b-e2df-4d61-b480-394ac4a3f2cc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:52.844376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d99706b-e2df-4d61-b480-394ac4a3f2cc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:52.845645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d99706b-e2df-4d61-b480-394ac4a3f2cc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:53.073919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6ac1ebf2-c844-45e4-8fa7-bc6eeaa2d050 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:53.074804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6ac1ebf2-c844-45e4-8fa7-bc6eeaa2d050 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:53.087873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ac1ebf2-c844-45e4-8fa7-bc6eeaa2d050 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:53.091092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ac1ebf2-c844-45e4-8fa7-bc6eeaa2d050 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:53.093447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ac1ebf2-c844-45e4-8fa7-bc6eeaa2d050 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:53.094083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ac1ebf2-c844-45e4-8fa7-bc6eeaa2d050 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:53.167188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0d99706b-e2df-4d61-b480-394ac4a3f2cc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:53.181318 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0d99706b-e2df-4d61-b480-394ac4a3f2cc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.357674 Feb 19 20:56:53.184581 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 790/1634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:52 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:53.193443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5b4db363-dae9-497e-9b53-c18a9b4bd5ab tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:53.194467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5b4db363-dae9-497e-9b53-c18a9b4bd5ab tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:53.208164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b4db363-dae9-497e-9b53-c18a9b4bd5ab tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:53.209355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b4db363-dae9-497e-9b53-c18a9b4bd5ab tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:53.212295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b4db363-dae9-497e-9b53-c18a9b4bd5ab tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:53.212796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b4db363-dae9-497e-9b53-c18a9b4bd5ab tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:53.473427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6ac1ebf2-c844-45e4-8fa7-bc6eeaa2d050 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:53.495787 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6ac1ebf2-c844-45e4-8fa7-bc6eeaa2d050 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1516 microversion: 2.1 time: 0.428208 Feb 19 20:56:53.508156 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 845/1635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:53 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1516 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:53.513327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd982682-93c9-4b3d-9656-cded723ece11 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467c28550>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:53.557704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5b4db363-dae9-497e-9b53-c18a9b4bd5ab tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:53.582158 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5b4db363-dae9-497e-9b53-c18a9b4bd5ab tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.396305 Feb 19 20:56:53.584577 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 791/1636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:53 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:53.601088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cf54ede7-b78e-4a82-bfa6-213fd65fc1fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:53.601748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cf54ede7-b78e-4a82-bfa6-213fd65fc1fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:53.615866 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd982682-93c9-4b3d-9656-cded723ece11 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.106038 Feb 19 20:56:53.616826 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 846/1637] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:53 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:53.626885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf54ede7-b78e-4a82-bfa6-213fd65fc1fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:53.627345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf54ede7-b78e-4a82-bfa6-213fd65fc1fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:53.628160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf54ede7-b78e-4a82-bfa6-213fd65fc1fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:53.629354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf54ede7-b78e-4a82-bfa6-213fd65fc1fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:53.741808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1cad7485-7ea5-438f-85ff-23d3ed23c06d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:53.742986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1cad7485-7ea5-438f-85ff-23d3ed23c06d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:53.755139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cad7485-7ea5-438f-85ff-23d3ed23c06d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:53.755749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cad7485-7ea5-438f-85ff-23d3ed23c06d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:53.756796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cad7485-7ea5-438f-85ff-23d3ed23c06d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:53.758573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cad7485-7ea5-438f-85ff-23d3ed23c06d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:53.933263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1cad7485-7ea5-438f-85ff-23d3ed23c06d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:53.942039 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1cad7485-7ea5-438f-85ff-23d3ed23c06d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1280 microversion: 2.1 time: 0.203924 Feb 19 20:56:53.946639 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 847/1638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:53 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:53.999974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf54ede7-b78e-4a82-bfa6-213fd65fc1fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:54.012319 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cf54ede7-b78e-4a82-bfa6-213fd65fc1fd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.426260 Feb 19 20:56:54.015028 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 792/1639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:53 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:54.147296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d625cc76-ccd1-4611-920c-32c49169f70d req-e42f3f6d-7b66-4cff-8cfa-ce1291f9b067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65e4283-9a5c-4b89-a006-7e6727e92f45", "name": "network-vif-plugged", "status": "completed", "tag": "36f49322-08ea-4d05-b1fa-2357653ca8be"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:54.150076 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:54.150076 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:54.165997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d625cc76-ccd1-4611-920c-32c49169f70d req-e42f3f6d-7b66-4cff-8cfa-ce1291f9b067 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:54.166446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d625cc76-ccd1-4611-920c-32c49169f70d req-e42f3f6d-7b66-4cff-8cfa-ce1291f9b067 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:54.186740 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d625cc76-ccd1-4611-920c-32c49169f70d req-e42f3f6d-7b66-4cff-8cfa-ce1291f9b067 service nova] Creating event network-vif-plugged:36f49322-08ea-4d05-b1fa-2357653ca8be for instance c65e4283-9a5c-4b89-a006-7e6727e92f45 on nch2-master-1 Feb 19 20:56:54.203790 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d625cc76-ccd1-4611-920c-32c49169f70d req-e42f3f6d-7b66-4cff-8cfa-ce1291f9b067 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060047 Feb 19 20:56:54.204991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fba43e27-eeb5-4f40-97ee-d801d97a43e2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:54.205626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fba43e27-eeb5-4f40-97ee-d801d97a43e2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:54.209808 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 848/1640] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:54.231806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fba43e27-eeb5-4f40-97ee-d801d97a43e2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:54.234276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fba43e27-eeb5-4f40-97ee-d801d97a43e2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:54.235340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fba43e27-eeb5-4f40-97ee-d801d97a43e2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:54.236061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fba43e27-eeb5-4f40-97ee-d801d97a43e2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:54.515588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b881c8b-4546-4258-b221-c497c1b17078 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:54.516390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b881c8b-4546-4258-b221-c497c1b17078 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:54.527139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b881c8b-4546-4258-b221-c497c1b17078 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:54.545801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fba43e27-eeb5-4f40-97ee-d801d97a43e2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:54.548925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b881c8b-4546-4258-b221-c497c1b17078 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:54.550123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b881c8b-4546-4258-b221-c497c1b17078 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:54.552838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b881c8b-4546-4258-b221-c497c1b17078 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:54.557350 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fba43e27-eeb5-4f40-97ee-d801d97a43e2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.358192 Feb 19 20:56:54.559859 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 793/1641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:54 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:54.601918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bdaca7db-d7ad-4312-aabc-25bc2bfc84b4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:54.602539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bdaca7db-d7ad-4312-aabc-25bc2bfc84b4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:54.617817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdaca7db-d7ad-4312-aabc-25bc2bfc84b4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:54.618277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdaca7db-d7ad-4312-aabc-25bc2bfc84b4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:54.619087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdaca7db-d7ad-4312-aabc-25bc2bfc84b4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:54.619528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdaca7db-d7ad-4312-aabc-25bc2bfc84b4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:55.779351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bdaca7db-d7ad-4312-aabc-25bc2bfc84b4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:55.796101 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bdaca7db-d7ad-4312-aabc-25bc2bfc84b4 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 1.198796 Feb 19 20:56:55.803761 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 794/1642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:54 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:55.815647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4b881c8b-4546-4258-b221-c497c1b17078 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:55.818739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fcb776b7-21f3-4f8d-8838-62003674bd78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467b7b940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:55.825567 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b881c8b-4546-4258-b221-c497c1b17078 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1522 microversion: 2.1 time: 1.315773 Feb 19 20:56:55.837393 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 849/1643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:54 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1522 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:55.842346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7fc3e84c-33a1-49de-8bd5-e4efeaac146a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:55.878343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7fc3e84c-33a1-49de-8bd5-e4efeaac146a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:55.902103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fc3e84c-33a1-49de-8bd5-e4efeaac146a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:55.903141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fc3e84c-33a1-49de-8bd5-e4efeaac146a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:55.905356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fc3e84c-33a1-49de-8bd5-e4efeaac146a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:55.907008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fc3e84c-33a1-49de-8bd5-e4efeaac146a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:55.924023 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fcb776b7-21f3-4f8d-8838-62003674bd78 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.118544 Feb 19 20:56:55.929736 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 795/1644] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:55 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:55.943350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b7ea44ef-042c-46e0-aaa8-8770e58f47d6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:55.945490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b7ea44ef-042c-46e0-aaa8-8770e58f47d6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:55.973945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7ea44ef-042c-46e0-aaa8-8770e58f47d6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:55.978693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7ea44ef-042c-46e0-aaa8-8770e58f47d6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:55.979406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7ea44ef-042c-46e0-aaa8-8770e58f47d6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:55.979851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7ea44ef-042c-46e0-aaa8-8770e58f47d6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:56.826551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7fc3e84c-33a1-49de-8bd5-e4efeaac146a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:56.844160 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7fc3e84c-33a1-49de-8bd5-e4efeaac146a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1322 microversion: 2.1 time: 1.005284 Feb 19 20:56:56.846916 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 850/1645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:55 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1322 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:56.859532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7df7347-d3e0-4ddf-b25d-9bb837259ff7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:56.863818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d7df7347-d3e0-4ddf-b25d-9bb837259ff7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:56.883321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7df7347-d3e0-4ddf-b25d-9bb837259ff7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:56.889319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7df7347-d3e0-4ddf-b25d-9bb837259ff7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:56.890597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7df7347-d3e0-4ddf-b25d-9bb837259ff7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:56.893654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7df7347-d3e0-4ddf-b25d-9bb837259ff7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:56.912517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b7ea44ef-042c-46e0-aaa8-8770e58f47d6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:56.928056 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b7ea44ef-042c-46e0-aaa8-8770e58f47d6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 1.001532 Feb 19 20:56:56.941500 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 796/1646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:55 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:56.946713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4a441b58-bfa7-4d1e-acba-fbf72f5dc0d1 req-6f32345d-8ecd-4515-b487-ac3ca8aadd1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75011271-d547-41a8-b625-be065cdd7483", "tag": "7d04593a-188e-4b4f-ab61-c23f7653caf7"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:56.953289 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:56.953289 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:56:56.973922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4a441b58-bfa7-4d1e-acba-fbf72f5dc0d1 req-6f32345d-8ecd-4515-b487-ac3ca8aadd1f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:56.980400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4a441b58-bfa7-4d1e-acba-fbf72f5dc0d1 req-6f32345d-8ecd-4515-b487-ac3ca8aadd1f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:57.017269 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4a441b58-bfa7-4d1e-acba-fbf72f5dc0d1 req-6f32345d-8ecd-4515-b487-ac3ca8aadd1f service nova] Creating event network-changed:7d04593a-188e-4b4f-ab61-c23f7653caf7 for instance 75011271-d547-41a8-b625-be065cdd7483 on nch1-master-1 Feb 19 20:56:57.036477 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4a441b58-bfa7-4d1e-acba-fbf72f5dc0d1 req-6f32345d-8ecd-4515-b487-ac3ca8aadd1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093417 Feb 19 20:56:57.041221 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 797/1647] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:57.054659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c943fb5-7b98-44dc-97d4-f604af719866 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:57.060418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4c943fb5-7b98-44dc-97d4-f604af719866 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:57.082900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c943fb5-7b98-44dc-97d4-f604af719866 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:57.090211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c943fb5-7b98-44dc-97d4-f604af719866 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:57.093875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c943fb5-7b98-44dc-97d4-f604af719866 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:57.098131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c943fb5-7b98-44dc-97d4-f604af719866 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:57.239985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d7df7347-d3e0-4ddf-b25d-9bb837259ff7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:57.250898 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d7df7347-d3e0-4ddf-b25d-9bb837259ff7 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1310 microversion: 2.1 time: 0.400822 Feb 19 20:56:57.252372 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 851/1648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:56 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1310 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:57.265200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f7c0442-6e99-49ba-be52-af32a07e5bf4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:57.267821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2f7c0442-6e99-49ba-be52-af32a07e5bf4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:57.286414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f7c0442-6e99-49ba-be52-af32a07e5bf4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:57.286414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f7c0442-6e99-49ba-be52-af32a07e5bf4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:57.288842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f7c0442-6e99-49ba-be52-af32a07e5bf4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:57.289293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f7c0442-6e99-49ba-be52-af32a07e5bf4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:57.452538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4c943fb5-7b98-44dc-97d4-f604af719866 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:57.463375 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c943fb5-7b98-44dc-97d4-f604af719866 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.417769 Feb 19 20:56:57.464108 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 798/1649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:57 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:57.479802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1362137414", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6896d345-c983-4d87-bf12-73e53cdf45a5"}], "security_groups": [{"name": "tempest-securitygroup--570613036"}], "key_name": "tempest-keypair-93172753", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:57.604588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f7c0442-6e99-49ba-be52-af32a07e5bf4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:57.655763 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f7c0442-6e99-49ba-be52-af32a07e5bf4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1522 microversion: 2.1 time: 0.398696 Feb 19 20:56:57.656824 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 852/1650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:57 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:57.673709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8e8ce024-1194-4d71-9b38-10b3ea5120e9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467cd6040>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:57.763367 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8e8ce024-1194-4d71-9b38-10b3ea5120e9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.100850 Feb 19 20:56:57.765073 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 853/1651] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:57 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:57.804685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] validate_networks() for [('6896d345-c983-4d87-bf12-73e53cdf45a5', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:56:57.862316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-76528664-b426-48c9-89be-65d491d3e827 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:57.864795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-76528664-b426-48c9-89be-65d491d3e827 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:57.883936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76528664-b426-48c9-89be-65d491d3e827 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:57.884857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76528664-b426-48c9-89be-65d491d3e827 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:57.885824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76528664-b426-48c9-89be-65d491d3e827 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:57.886373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76528664-b426-48c9-89be-65d491d3e827 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.239614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-76528664-b426-48c9-89be-65d491d3e827 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:58.254003 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-76528664-b426-48c9-89be-65d491d3e827 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1322 microversion: 2.1 time: 0.396333 Feb 19 20:56:58.259406 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 854/1652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:57 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:58.269828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8f0d47b5-5725-4114-afcc-6a1349863c90 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:58.270818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8f0d47b5-5725-4114-afcc-6a1349863c90 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:58.280120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f0d47b5-5725-4114-afcc-6a1349863c90 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.280960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f0d47b5-5725-4114-afcc-6a1349863c90 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.282191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f0d47b5-5725-4114-afcc-6a1349863c90 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.283245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f0d47b5-5725-4114-afcc-6a1349863c90 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.569297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8f0d47b5-5725-4114-afcc-6a1349863c90 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:58.576645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8f0d47b5-5725-4114-afcc-6a1349863c90 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.315848 Feb 19 20:56:58.588095 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 855/1653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:58 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:58.592985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1381b89b-5ebb-43db-9f17-f7ec554fa5d6 req-35b215d2-03b4-4f5e-87ff-d1cbf6f3a532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99", "name": "network-vif-plugged", "status": "completed", "tag": "020bbc87-1ec4-420c-9f86-2a44e5ea3d18"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:58.594569 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:58.594569 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:58.604783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1381b89b-5ebb-43db-9f17-f7ec554fa5d6 req-35b215d2-03b4-4f5e-87ff-d1cbf6f3a532 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.605216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1381b89b-5ebb-43db-9f17-f7ec554fa5d6 req-35b215d2-03b4-4f5e-87ff-d1cbf6f3a532 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.612576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Getting quotas for project 5c496adb59f3467687458650e28da232. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:58.619428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Getting quotas for user 33f01d50bf4e41ff95c09af549cd37e9 and project 5c496adb59f3467687458650e28da232. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:58.628295 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1381b89b-5ebb-43db-9f17-f7ec554fa5d6 req-35b215d2-03b4-4f5e-87ff-d1cbf6f3a532 service nova] Creating event network-vif-plugged:020bbc87-1ec4-420c-9f86-2a44e5ea3d18 for instance 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 on nch2-master-1 Feb 19 20:56:58.635799 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1381b89b-5ebb-43db-9f17-f7ec554fa5d6 req-35b215d2-03b4-4f5e-87ff-d1cbf6f3a532 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046202 Feb 19 20:56:58.636696 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 856/1654] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:56:58.639784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:56:58.640640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:56:58.643465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:56:58.645659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:56:58.645806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b9a7aa83-79f2-43f9-a94d-c6e76e5f1cdc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:58.646489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b9a7aa83-79f2-43f9-a94d-c6e76e5f1cdc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:58.647528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:56:58.652908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9a7aa83-79f2-43f9-a94d-c6e76e5f1cdc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.653365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9a7aa83-79f2-43f9-a94d-c6e76e5f1cdc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.654155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9a7aa83-79f2-43f9-a94d-c6e76e5f1cdc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.654589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9a7aa83-79f2-43f9-a94d-c6e76e5f1cdc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.675982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.676475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.677306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.677748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.721706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Getting quotas for project 5c496adb59f3467687458650e28da232. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:56:58.730370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Getting quotas for user 33f01d50bf4e41ff95c09af549cd37e9 and project 5c496adb59f3467687458650e28da232. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:56:58.760564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:56:58.764535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:56:58.829642 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5972259e-05b1-484f-b2f3-67e734012567 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.364269 Feb 19 20:56:58.831043 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 799/1655] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:56:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:56:58.851975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc41faf5-82bb-4ef9-82eb-1a1b6c8161fa tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:58.852642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc41faf5-82bb-4ef9-82eb-1a1b6c8161fa tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:58.868509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc41faf5-82bb-4ef9-82eb-1a1b6c8161fa tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.871110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc41faf5-82bb-4ef9-82eb-1a1b6c8161fa tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.871110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc41faf5-82bb-4ef9-82eb-1a1b6c8161fa tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.871110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc41faf5-82bb-4ef9-82eb-1a1b6c8161fa tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.912143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b9a7aa83-79f2-43f9-a94d-c6e76e5f1cdc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:58.919765 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b9a7aa83-79f2-43f9-a94d-c6e76e5f1cdc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1494 microversion: 2.1 time: 0.278719 Feb 19 20:56:58.935381 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 857/1656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:58 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1494 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:58.940743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d1852479-8622-4e5a-bf67-7ef792b2d16f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:58.941686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d1852479-8622-4e5a-bf67-7ef792b2d16f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:58.948039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1852479-8622-4e5a-bf67-7ef792b2d16f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.948950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1852479-8622-4e5a-bf67-7ef792b2d16f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:58.950069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1852479-8622-4e5a-bf67-7ef792b2d16f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:58.951570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1852479-8622-4e5a-bf67-7ef792b2d16f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.092052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc41faf5-82bb-4ef9-82eb-1a1b6c8161fa tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:59.102499 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc41faf5-82bb-4ef9-82eb-1a1b6c8161fa tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.270202 Feb 19 20:56:59.103091 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 800/1657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:58 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:59.107588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3d571c7b-e6a2-4ed0-ac9f-b8f7b064e4fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467a843a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:59.194969 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3d571c7b-e6a2-4ed0-ac9f-b8f7b064e4fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.090467 Feb 19 20:56:59.196818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 801/1658] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:56:59 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:59.202424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-12872664-3f69-4100-81c8-7560676c9d12 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:59.203326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-12872664-3f69-4100-81c8-7560676c9d12 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:59.212803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d1852479-8622-4e5a-bf67-7ef792b2d16f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:59.223648 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d1852479-8622-4e5a-bf67-7ef792b2d16f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1522 microversion: 2.1 time: 0.286995 Feb 19 20:56:59.225552 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 858/1659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:58 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:59.229971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-313089ab-86ca-47ac-87d5-69886b1c1e66 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:59.231306 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-313089ab-86ca-47ac-87d5-69886b1c1e66 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:59.238288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-313089ab-86ca-47ac-87d5-69886b1c1e66 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.238901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-313089ab-86ca-47ac-87d5-69886b1c1e66 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.239805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-313089ab-86ca-47ac-87d5-69886b1c1e66 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.240690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-313089ab-86ca-47ac-87d5-69886b1c1e66 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.286603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-12872664-3f69-4100-81c8-7560676c9d12 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:59.297205 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-12872664-3f69-4100-81c8-7560676c9d12 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1268 microversion: 2.1 time: 0.098884 Feb 19 20:56:59.307313 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 802/1660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:59 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1268 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:59.307313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2aec7a62-5cd8-4358-8cd6-dde0764a9ddc tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:59.307313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2aec7a62-5cd8-4358-8cd6-dde0764a9ddc tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:59.314443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2aec7a62-5cd8-4358-8cd6-dde0764a9ddc tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.314989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2aec7a62-5cd8-4358-8cd6-dde0764a9ddc tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.315725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2aec7a62-5cd8-4358-8cd6-dde0764a9ddc tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.316149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2aec7a62-5cd8-4358-8cd6-dde0764a9ddc tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.453962 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-313089ab-86ca-47ac-87d5-69886b1c1e66 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1645 microversion: 2.1 time: 0.227197 Feb 19 20:56:59.455683 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 859/1661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:59 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1645 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:59.473648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a06773d7-8301-40f0-810c-6f703002e5b7 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:59.474759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a06773d7-8301-40f0-810c-6f703002e5b7 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:59.481835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a06773d7-8301-40f0-810c-6f703002e5b7 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.482417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a06773d7-8301-40f0-810c-6f703002e5b7 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.483336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a06773d7-8301-40f0-810c-6f703002e5b7 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.483823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a06773d7-8301-40f0-810c-6f703002e5b7 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.545680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2aec7a62-5cd8-4358-8cd6-dde0764a9ddc tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:59.555484 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2aec7a62-5cd8-4358-8cd6-dde0764a9ddc tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1322 microversion: 2.1 time: 0.255503 Feb 19 20:56:59.556305 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 803/1662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:59 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:59.596467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-414904af-f4d5-4008-ac2e-31917b1f786e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:59.601923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-414904af-f4d5-4008-ac2e-31917b1f786e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:59.617890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-414904af-f4d5-4008-ac2e-31917b1f786e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.619094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-414904af-f4d5-4008-ac2e-31917b1f786e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.620111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-414904af-f4d5-4008-ac2e-31917b1f786e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.624022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-414904af-f4d5-4008-ac2e-31917b1f786e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.706491 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a06773d7-8301-40f0-810c-6f703002e5b7 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1645 microversion: 2.1 time: 0.237373 Feb 19 20:56:59.709982 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 860/1663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:59 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1645 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:56:59.734213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-69557626-c1b6-43a1-93be-261084ee329a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:59.735920 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:56:59.735920 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:56:59.738448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69557626-c1b6-43a1-93be-261084ee329a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.739114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69557626-c1b6-43a1-93be-261084ee329a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.740535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69557626-c1b6-43a1-93be-261084ee329a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.741405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69557626-c1b6-43a1-93be-261084ee329a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.781483 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-69557626-c1b6-43a1-93be-261084ee329a tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057630 Feb 19 20:56:59.782216 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 861/1664] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Feb 19 20:56:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:56:59.800480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c3ebb990-1f68-4175-8fa5-ea3618086d7e tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:56:59.801270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c3ebb990-1f68-4175-8fa5-ea3618086d7e tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:59.808692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3ebb990-1f68-4175-8fa5-ea3618086d7e tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.809289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3ebb990-1f68-4175-8fa5-ea3618086d7e tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.810338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3ebb990-1f68-4175-8fa5-ea3618086d7e tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.810947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3ebb990-1f68-4175-8fa5-ea3618086d7e tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.878495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-414904af-f4d5-4008-ac2e-31917b1f786e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:56:59.889451 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-414904af-f4d5-4008-ac2e-31917b1f786e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.296901 Feb 19 20:56:59.889911 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 804/1665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:59 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:56:59.909607 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c3ebb990-1f68-4175-8fa5-ea3618086d7e tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45/action" status: 202 len: 0 microversion: 2.1 time: 0.118350 Feb 19 20:56:59.910428 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 862/1666] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:56:59 2022] POST /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:56:59.921257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-89091378-f1bc-4b54-8f39-8bb3706188a6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:56:59.921948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-89091378-f1bc-4b54-8f39-8bb3706188a6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:56:59.932739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89091378-f1bc-4b54-8f39-8bb3706188a6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.934062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89091378-f1bc-4b54-8f39-8bb3706188a6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:56:59.935243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89091378-f1bc-4b54-8f39-8bb3706188a6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:56:59.935734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89091378-f1bc-4b54-8f39-8bb3706188a6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.120400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-006f1684-7a69-40e7-b855-acb9a7673597 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:00.121779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-006f1684-7a69-40e7-b855-acb9a7673597 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:00.126942 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-89091378-f1bc-4b54-8f39-8bb3706188a6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1650 microversion: 2.1 time: 0.212169 Feb 19 20:57:00.128379 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 805/1667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:56:59 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1650 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:00.134210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006f1684-7a69-40e7-b855-acb9a7673597 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.134664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006f1684-7a69-40e7-b855-acb9a7673597 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.135478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006f1684-7a69-40e7-b855-acb9a7673597 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.135915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006f1684-7a69-40e7-b855-acb9a7673597 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.209644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45a5bc51-d775-4d08-9519-ccde5fe60718 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467b374c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:00.303863 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45a5bc51-d775-4d08-9519-ccde5fe60718 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.098134 Feb 19 20:57:00.305210 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 806/1668] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:00 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:00.322519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-83dbbe0c-fbbd-4b1f-bd5d-998d6978a539 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:00.327982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-83dbbe0c-fbbd-4b1f-bd5d-998d6978a539 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:00.346894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83dbbe0c-fbbd-4b1f-bd5d-998d6978a539 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.355656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83dbbe0c-fbbd-4b1f-bd5d-998d6978a539 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.358595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83dbbe0c-fbbd-4b1f-bd5d-998d6978a539 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.359089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83dbbe0c-fbbd-4b1f-bd5d-998d6978a539 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.380844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-006f1684-7a69-40e7-b855-acb9a7673597 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:00.394359 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-006f1684-7a69-40e7-b855-acb9a7673597 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.277965 Feb 19 20:57:00.395295 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 863/1669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:00 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:00.403168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec60a757-3a06-407a-bdaa-eb576a672937 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:00.403785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ec60a757-3a06-407a-bdaa-eb576a672937 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:00.429430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec60a757-3a06-407a-bdaa-eb576a672937 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.429881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec60a757-3a06-407a-bdaa-eb576a672937 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.430683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec60a757-3a06-407a-bdaa-eb576a672937 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.431154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec60a757-3a06-407a-bdaa-eb576a672937 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.577172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec60a757-3a06-407a-bdaa-eb576a672937 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:00.593418 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec60a757-3a06-407a-bdaa-eb576a672937 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1338 microversion: 2.1 time: 0.197022 Feb 19 20:57:00.597012 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 864/1670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:00 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1338 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:00.605415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c599b533-8826-4586-9592-6c2386bedda7 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:00.609143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c599b533-8826-4586-9592-6c2386bedda7 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:00.621645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c599b533-8826-4586-9592-6c2386bedda7 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.623968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c599b533-8826-4586-9592-6c2386bedda7 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.624953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c599b533-8826-4586-9592-6c2386bedda7 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.627108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c599b533-8826-4586-9592-6c2386bedda7 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.782171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-83dbbe0c-fbbd-4b1f-bd5d-998d6978a539 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:00.796662 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-83dbbe0c-fbbd-4b1f-bd5d-998d6978a539 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1522 microversion: 2.1 time: 0.490084 Feb 19 20:57:00.800127 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 807/1671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:00 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:00.816454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-426ce030-906a-4b40-a291-307271037836 req-7af4586f-6254-4a79-9b9d-5f9eb47dcb55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ece57c-a579-45c4-82fb-74b6ed0363e1", "name": "network-vif-plugged", "status": "completed", "tag": "5a3851e0-4e2d-4a66-9cec-b7694420e692"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:00.818715 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:00.818715 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:00.830300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-426ce030-906a-4b40-a291-307271037836 req-7af4586f-6254-4a79-9b9d-5f9eb47dcb55 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.831096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-426ce030-906a-4b40-a291-307271037836 req-7af4586f-6254-4a79-9b9d-5f9eb47dcb55 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.847606 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-426ce030-906a-4b40-a291-307271037836 req-7af4586f-6254-4a79-9b9d-5f9eb47dcb55 service nova] Creating event network-vif-plugged:5a3851e0-4e2d-4a66-9cec-b7694420e692 for instance c0ece57c-a579-45c4-82fb-74b6ed0363e1 on nch1-master-1 Feb 19 20:57:00.854609 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-426ce030-906a-4b40-a291-307271037836 req-7af4586f-6254-4a79-9b9d-5f9eb47dcb55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052031 Feb 19 20:57:00.859515 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 808/1672] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:00.891004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c599b533-8826-4586-9592-6c2386bedda7 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:00.900549 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c599b533-8826-4586-9592-6c2386bedda7 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1322 microversion: 2.1 time: 0.302526 Feb 19 20:57:00.910878 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 865/1673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:00 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:00.918107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fe9d9ce5-a259-413a-97e6-d74155e41146 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:00.919255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fe9d9ce5-a259-413a-97e6-d74155e41146 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:00.935552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fe9d9ce5-a259-413a-97e6-d74155e41146 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.939834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fe9d9ce5-a259-413a-97e6-d74155e41146 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:00.943229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fe9d9ce5-a259-413a-97e6-d74155e41146 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:00.949635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fe9d9ce5-a259-413a-97e6-d74155e41146 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:01.157954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-78c1418d-041f-4190-b1bb-8f738a05fb77 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:01.158594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-78c1418d-041f-4190-b1bb-8f738a05fb77 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:01.181578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78c1418d-041f-4190-b1bb-8f738a05fb77 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:01.182952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78c1418d-041f-4190-b1bb-8f738a05fb77 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:01.183198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78c1418d-041f-4190-b1bb-8f738a05fb77 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:01.183838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78c1418d-041f-4190-b1bb-8f738a05fb77 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:01.289698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fe9d9ce5-a259-413a-97e6-d74155e41146 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:01.297304 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fe9d9ce5-a259-413a-97e6-d74155e41146 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1317 microversion: 2.1 time: 0.384238 Feb 19 20:57:01.297956 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 809/1674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:00 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:01.318909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bf11df67-5c34-4427-a32c-ebf4475f47fe tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467bcd310>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:01.406831 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bf11df67-5c34-4427-a32c-ebf4475f47fe tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.091581 Feb 19 20:57:01.408399 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 810/1675] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:01 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:01.417535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-daa3df6e-1c5a-4cdf-9f8b-68d404f5644b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:01.418608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-daa3df6e-1c5a-4cdf-9f8b-68d404f5644b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:01.441287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-daa3df6e-1c5a-4cdf-9f8b-68d404f5644b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:01.442064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-daa3df6e-1c5a-4cdf-9f8b-68d404f5644b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:01.442534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-daa3df6e-1c5a-4cdf-9f8b-68d404f5644b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:01.442976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-daa3df6e-1c5a-4cdf-9f8b-68d404f5644b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:01.657703 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-78c1418d-041f-4190-b1bb-8f738a05fb77 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1630 microversion: 2.1 time: 0.516972 Feb 19 20:57:01.665856 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 866/1676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:01 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1630 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:01.671231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3eafe537-faac-476d-9de3-3b291fde0baf tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:01.671851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3eafe537-faac-476d-9de3-3b291fde0baf tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:01.679168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3eafe537-faac-476d-9de3-3b291fde0baf tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:01.680257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3eafe537-faac-476d-9de3-3b291fde0baf tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:01.680424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3eafe537-faac-476d-9de3-3b291fde0baf tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:01.680864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3eafe537-faac-476d-9de3-3b291fde0baf tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:01.863839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-daa3df6e-1c5a-4cdf-9f8b-68d404f5644b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:01.873751 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-daa3df6e-1c5a-4cdf-9f8b-68d404f5644b tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.464927 Feb 19 20:57:01.886817 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 811/1677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:01 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:01.893101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d9a8d637-0251-41ca-8367-bf653acaf5d4 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:01.894937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d9a8d637-0251-41ca-8367-bf653acaf5d4 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:01.901911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9a8d637-0251-41ca-8367-bf653acaf5d4 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:01.902633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9a8d637-0251-41ca-8367-bf653acaf5d4 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:01.904091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9a8d637-0251-41ca-8367-bf653acaf5d4 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:01.904769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9a8d637-0251-41ca-8367-bf653acaf5d4 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:01.979471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-d9a8d637-0251-41ca-8367-bf653acaf5d4 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lazy-loading 'flavor' on Instance uuid c65e4283-9a5c-4b89-a006-7e6727e92f45 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:57:02.012595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d9a8d637-0251-41ca-8367-bf653acaf5d4 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Going to try to live migrate instance to nch1-master-1 {{(pid=136095) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 20:57:02.029075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3eafe537-faac-476d-9de3-3b291fde0baf tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:02.052588 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3eafe537-faac-476d-9de3-3b291fde0baf tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1393 microversion: 2.1 time: 0.384153 Feb 19 20:57:02.064786 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 867/1678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:01 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1393 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:02.070748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d8e153f-fd2f-4d72-8911-72aa206cd376 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:02.072039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1d8e153f-fd2f-4d72-8911-72aa206cd376 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:02.082859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d8e153f-fd2f-4d72-8911-72aa206cd376 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:02.083801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d8e153f-fd2f-4d72-8911-72aa206cd376 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:02.085808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d8e153f-fd2f-4d72-8911-72aa206cd376 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:02.087534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d8e153f-fd2f-4d72-8911-72aa206cd376 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:02.373536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d8e153f-fd2f-4d72-8911-72aa206cd376 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:02.399715 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d8e153f-fd2f-4d72-8911-72aa206cd376 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1522 microversion: 2.1 time: 0.319696 Feb 19 20:57:02.401652 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 868/1679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:02 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:02.409264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eedaefce-698c-4785-ae0e-def444de7972 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:02.409892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eedaefce-698c-4785-ae0e-def444de7972 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:02.428836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eedaefce-698c-4785-ae0e-def444de7972 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:02.431063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eedaefce-698c-4785-ae0e-def444de7972 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:02.433788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eedaefce-698c-4785-ae0e-def444de7972 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:02.434269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eedaefce-698c-4785-ae0e-def444de7972 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:02.794355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-eedaefce-698c-4785-ae0e-def444de7972 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:02.802707 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eedaefce-698c-4785-ae0e-def444de7972 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1322 microversion: 2.1 time: 0.399944 Feb 19 20:57:02.803581 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 869/1680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:02 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:02.808643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-77847531-f655-4ea5-aab0-57c095ad3ac5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:02.809347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-77847531-f655-4ea5-aab0-57c095ad3ac5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:02.816125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77847531-f655-4ea5-aab0-57c095ad3ac5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:02.816678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77847531-f655-4ea5-aab0-57c095ad3ac5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:02.817488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77847531-f655-4ea5-aab0-57c095ad3ac5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:02.817924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77847531-f655-4ea5-aab0-57c095ad3ac5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:03.087773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-77847531-f655-4ea5-aab0-57c095ad3ac5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:03.097622 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-77847531-f655-4ea5-aab0-57c095ad3ac5 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1467 microversion: 2.1 time: 0.293211 Feb 19 20:57:03.112922 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 870/1681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:02 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1467 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:03.122708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b91d46bb-3926-43fa-b5eb-e36c9979f299 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467bfe0d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:03.191018 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b91d46bb-3926-43fa-b5eb-e36c9979f299 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.076695 Feb 19 20:57:03.191906 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 871/1682] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:03 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:03.213236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b1d906d5-ab22-449b-8ccb-44b2f50314b1 req-ad5f9685-c2f5-49ae-8d16-1270bfc9ee9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f1f59f-19d3-4b89-873c-bc100187739c", "tag": "7b13225c-b3f5-46c0-a7ec-cecdc4f9a82a"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:03.217739 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:03.217739 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:03.232124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b1d906d5-ab22-449b-8ccb-44b2f50314b1 req-ad5f9685-c2f5-49ae-8d16-1270bfc9ee9f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:03.232644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b1d906d5-ab22-449b-8ccb-44b2f50314b1 req-ad5f9685-c2f5-49ae-8d16-1270bfc9ee9f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:03.247541 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b1d906d5-ab22-449b-8ccb-44b2f50314b1 req-ad5f9685-c2f5-49ae-8d16-1270bfc9ee9f service nova] Creating event network-changed:7b13225c-b3f5-46c0-a7ec-cecdc4f9a82a for instance e9f1f59f-19d3-4b89-873c-bc100187739c on nch1-master-1 Feb 19 20:57:03.254024 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b1d906d5-ab22-449b-8ccb-44b2f50314b1 req-ad5f9685-c2f5-49ae-8d16-1270bfc9ee9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060613 Feb 19 20:57:03.255106 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 872/1683] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:03.259937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ded7eb56-0b80-4127-ae98-ef2b86552d5d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:03.260663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ded7eb56-0b80-4127-ae98-ef2b86552d5d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:03.267226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ded7eb56-0b80-4127-ae98-ef2b86552d5d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:03.269264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ded7eb56-0b80-4127-ae98-ef2b86552d5d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:03.270934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ded7eb56-0b80-4127-ae98-ef2b86552d5d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:03.271658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ded7eb56-0b80-4127-ae98-ef2b86552d5d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:03.480474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ded7eb56-0b80-4127-ae98-ef2b86552d5d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:03.492352 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ded7eb56-0b80-4127-ae98-ef2b86552d5d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.236014 Feb 19 20:57:03.503567 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 873/1684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:03 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:03.508712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b6696e12-0956-4c97-b21e-981303f03d9b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:03.509454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b6696e12-0956-4c97-b21e-981303f03d9b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:03.519704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6696e12-0956-4c97-b21e-981303f03d9b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:03.520770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6696e12-0956-4c97-b21e-981303f03d9b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:03.522003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6696e12-0956-4c97-b21e-981303f03d9b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:03.523010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6696e12-0956-4c97-b21e-981303f03d9b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:03.741660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b6696e12-0956-4c97-b21e-981303f03d9b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:03.758896 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b6696e12-0956-4c97-b21e-981303f03d9b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1393 microversion: 2.1 time: 0.253978 Feb 19 20:57:03.759882 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 874/1685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:03 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1393 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:03.771853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-66ab05fd-4c99-489c-a56c-41bbb80a9ce2 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:03.777055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-66ab05fd-4c99-489c-a56c-41bbb80a9ce2 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:03.785853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-66ab05fd-4c99-489c-a56c-41bbb80a9ce2 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:03.786619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-66ab05fd-4c99-489c-a56c-41bbb80a9ce2 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:03.787666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-66ab05fd-4c99-489c-a56c-41bbb80a9ce2 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:03.788286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-66ab05fd-4c99-489c-a56c-41bbb80a9ce2 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:03.964733 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-66ab05fd-4c99-489c-a56c-41bbb80a9ce2 tempest-ServersOnMultiNodesTest-143134840 tempest-ServersOnMultiNodesTest-143134840-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1618 microversion: 2.1 time: 0.201586 Feb 19 20:57:03.972606 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 875/1686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:03 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1618 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:03.983415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27cfd418-331c-4ba1-826b-ac77c39bda88 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:03.984081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-27cfd418-331c-4ba1-826b-ac77c39bda88 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:03.997672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27cfd418-331c-4ba1-826b-ac77c39bda88 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:03.998398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27cfd418-331c-4ba1-826b-ac77c39bda88 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.001589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27cfd418-331c-4ba1-826b-ac77c39bda88 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.002066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27cfd418-331c-4ba1-826b-ac77c39bda88 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.186789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-27cfd418-331c-4ba1-826b-ac77c39bda88 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:04.199908 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-27cfd418-331c-4ba1-826b-ac77c39bda88 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1507 microversion: 2.1 time: 0.225526 Feb 19 20:57:04.200531 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 876/1687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:03 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:04.207186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0122accc-354f-4669-b11c-2ba6793c329c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:04.207799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0122accc-354f-4669-b11c-2ba6793c329c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:04.220909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0122accc-354f-4669-b11c-2ba6793c329c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.221391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0122accc-354f-4669-b11c-2ba6793c329c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.222211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0122accc-354f-4669-b11c-2ba6793c329c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.222652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0122accc-354f-4669-b11c-2ba6793c329c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.432789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0122accc-354f-4669-b11c-2ba6793c329c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:04.464573 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0122accc-354f-4669-b11c-2ba6793c329c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1322 microversion: 2.1 time: 0.258199 Feb 19 20:57:04.465400 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 877/1688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:04 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:04.480226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-406a1594-f892-4296-84eb-6bbc04d70190 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:04.481055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-406a1594-f892-4296-84eb-6bbc04d70190 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:04.490689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-406a1594-f892-4296-84eb-6bbc04d70190 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.491172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-406a1594-f892-4296-84eb-6bbc04d70190 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.492523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-406a1594-f892-4296-84eb-6bbc04d70190 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.493146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-406a1594-f892-4296-84eb-6bbc04d70190 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.526598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-406a1594-f892-4296-84eb-6bbc04d70190 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:04.649480 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-406a1594-f892-4296-84eb-6bbc04d70190 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 204 len: 0 microversion: 2.1 time: 0.182868 Feb 19 20:57:04.653512 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 878/1689] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:04 2022] DELETE /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:04.656511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7850485-a74f-4bf0-9ba6-aa1f82062940 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64679c61f0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:04.744008 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d9a8d637-0251-41ca-8367-bf653acaf5d4 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45/action" status: 202 len: 0 microversion: 2.1 time: 2.855794 Feb 19 20:57:04.748934 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 812/1690] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:57:01 2022] POST /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45/action => generated 0 bytes in 2859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:57:04.749943 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7850485-a74f-4bf0-9ba6-aa1f82062940 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.095968 Feb 19 20:57:04.755067 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 879/1691] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:04 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:04.763120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e439206f-bb00-41cc-a0cb-9b7554f0e05f req-9375bcde-0ffa-4854-b399-42bb7174a7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75011271-d547-41a8-b625-be065cdd7483", "name": "network-vif-plugged", "status": "completed", "tag": "7d04593a-188e-4b4f-ab61-c23f7653caf7"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:04.770568 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:04.770568 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:04.774111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6ed72d80-c8b1-41f4-a252-1cd61da2a64d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:04.775362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6ed72d80-c8b1-41f4-a252-1cd61da2a64d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:04.793958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ed72d80-c8b1-41f4-a252-1cd61da2a64d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.794461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ed72d80-c8b1-41f4-a252-1cd61da2a64d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.795570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ed72d80-c8b1-41f4-a252-1cd61da2a64d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.796148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ed72d80-c8b1-41f4-a252-1cd61da2a64d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.798962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e439206f-bb00-41cc-a0cb-9b7554f0e05f req-9375bcde-0ffa-4854-b399-42bb7174a7e9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.799396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e439206f-bb00-41cc-a0cb-9b7554f0e05f req-9375bcde-0ffa-4854-b399-42bb7174a7e9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.823127 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e439206f-bb00-41cc-a0cb-9b7554f0e05f req-9375bcde-0ffa-4854-b399-42bb7174a7e9 service nova] Creating event network-vif-plugged:7d04593a-188e-4b4f-ab61-c23f7653caf7 for instance 75011271-d547-41a8-b625-be065cdd7483 on nch1-master-1 Feb 19 20:57:04.835456 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e439206f-bb00-41cc-a0cb-9b7554f0e05f req-9375bcde-0ffa-4854-b399-42bb7174a7e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076773 Feb 19 20:57:04.836675 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 880/1692] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:04.845611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-785c1dde-189a-4d97-aa05-5f213cf5fe1e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:04.846310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-785c1dde-189a-4d97-aa05-5f213cf5fe1e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:04.854120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-785c1dde-189a-4d97-aa05-5f213cf5fe1e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.854585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-785c1dde-189a-4d97-aa05-5f213cf5fe1e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:04.855749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-785c1dde-189a-4d97-aa05-5f213cf5fe1e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:04.856594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-785c1dde-189a-4d97-aa05-5f213cf5fe1e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:05.180737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-785c1dde-189a-4d97-aa05-5f213cf5fe1e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:05.186285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6ed72d80-c8b1-41f4-a252-1cd61da2a64d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:05.198064 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6ed72d80-c8b1-41f4-a252-1cd61da2a64d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 200 len: 1507 microversion: 2.1 time: 0.447772 Feb 19 20:57:05.214681 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-785c1dde-189a-4d97-aa05-5f213cf5fe1e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.377014 Feb 19 20:57:05.215273 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 881/1694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:04 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:05.216487 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 813/1694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:04 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 1507 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:05.221759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1cd46b1d-9a25-460e-a435-6a55e76a36ba tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:05.227187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1376570d-159b-464b-9647-b3387c5863e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:05.227187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1376570d-159b-464b-9647-b3387c5863e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:05.228413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1cd46b1d-9a25-460e-a435-6a55e76a36ba tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:05.237433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1376570d-159b-464b-9647-b3387c5863e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:05.238210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1376570d-159b-464b-9647-b3387c5863e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:05.239230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1376570d-159b-464b-9647-b3387c5863e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:05.239944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1376570d-159b-464b-9647-b3387c5863e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:05.243831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cd46b1d-9a25-460e-a435-6a55e76a36ba tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:05.244694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cd46b1d-9a25-460e-a435-6a55e76a36ba tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:05.245623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cd46b1d-9a25-460e-a435-6a55e76a36ba tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:05.246381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cd46b1d-9a25-460e-a435-6a55e76a36ba tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:05.650467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1376570d-159b-464b-9647-b3387c5863e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:05.664195 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1376570d-159b-464b-9647-b3387c5863e8 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1473 microversion: 2.1 time: 0.447856 Feb 19 20:57:05.666203 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 882/1695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:05 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1473 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:05.671787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a52a04ff-0d04-448e-8990-17ae53401612 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:05.672437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a52a04ff-0d04-448e-8990-17ae53401612 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:05.680849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a52a04ff-0d04-448e-8990-17ae53401612 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:05.681328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a52a04ff-0d04-448e-8990-17ae53401612 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:05.682444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a52a04ff-0d04-448e-8990-17ae53401612 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:05.682882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a52a04ff-0d04-448e-8990-17ae53401612 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:05.713735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1cd46b1d-9a25-460e-a435-6a55e76a36ba tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:05.736632 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1cd46b1d-9a25-460e-a435-6a55e76a36ba tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1504 microversion: 2.1 time: 0.517912 Feb 19 20:57:05.737481 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 814/1696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:05 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:05.755787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0b5d25f5-c405-4a23-adbf-e727dd6afe99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:05.769587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0b5d25f5-c405-4a23-adbf-e727dd6afe99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:05.779589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b5d25f5-c405-4a23-adbf-e727dd6afe99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:05.780760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b5d25f5-c405-4a23-adbf-e727dd6afe99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:05.781872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b5d25f5-c405-4a23-adbf-e727dd6afe99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:05.782875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b5d25f5-c405-4a23-adbf-e727dd6afe99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:05.816995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0b5d25f5-c405-4a23-adbf-e727dd6afe99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:06.003545 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0b5d25f5-c405-4a23-adbf-e727dd6afe99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 204 len: 0 microversion: 2.1 time: 0.263717 Feb 19 20:57:06.005281 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 815/1697] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:05 2022] DELETE /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:06.028855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6cf5e835-6de4-4c17-b00f-658d633f92fd tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:06.031175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6cf5e835-6de4-4c17-b00f-658d633f92fd tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:06.044797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6cf5e835-6de4-4c17-b00f-658d633f92fd tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:06.045254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6cf5e835-6de4-4c17-b00f-658d633f92fd tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:06.046065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6cf5e835-6de4-4c17-b00f-658d633f92fd tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:06.046507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6cf5e835-6de4-4c17-b00f-658d633f92fd tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:06.049876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a52a04ff-0d04-448e-8990-17ae53401612 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:06.066665 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a52a04ff-0d04-448e-8990-17ae53401612 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1393 microversion: 2.1 time: 0.399071 Feb 19 20:57:06.067283 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 883/1698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:05 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1393 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:06.074377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3484eec-d0fe-4197-b5c1-07eb27d71aeb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467c51160>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:06.157164 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e3484eec-d0fe-4197-b5c1-07eb27d71aeb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1413 microversion: 2.1 time: 0.088357 Feb 19 20:57:06.160700 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 884/1699] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:06 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:06.235679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aecdff03-dac3-45db-92d5-c04b5bb1640f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:06.236922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aecdff03-dac3-45db-92d5-c04b5bb1640f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:06.247380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aecdff03-dac3-45db-92d5-c04b5bb1640f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:06.261527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aecdff03-dac3-45db-92d5-c04b5bb1640f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:06.262398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aecdff03-dac3-45db-92d5-c04b5bb1640f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:06.262836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aecdff03-dac3-45db-92d5-c04b5bb1640f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:06.505850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6cf5e835-6de4-4c17-b00f-658d633f92fd tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:06.517194 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6cf5e835-6de4-4c17-b00f-658d633f92fd tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1322 microversion: 2.1 time: 0.509480 Feb 19 20:57:06.518400 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 816/1700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:06 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:06.542770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2065075601", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "351c1efd-5280-463c-84c7-ead44efacdc6"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:06.649064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] validate_networks() for [('351c1efd-5280-463c-84c7-ead44efacdc6', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:57:06.875459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aecdff03-dac3-45db-92d5-c04b5bb1640f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:06.899991 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aecdff03-dac3-45db-92d5-c04b5bb1640f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.668533 Feb 19 20:57:06.916711 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 885/1701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:06 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:06.931208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4d36af00-aaff-413d-ad9d-fb7fe7000fc6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:06.931935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4d36af00-aaff-413d-ad9d-fb7fe7000fc6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:06.942410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d36af00-aaff-413d-ad9d-fb7fe7000fc6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:06.942868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d36af00-aaff-413d-ad9d-fb7fe7000fc6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:06.943686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d36af00-aaff-413d-ad9d-fb7fe7000fc6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:06.944378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d36af00-aaff-413d-ad9d-fb7fe7000fc6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:07.728885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4d36af00-aaff-413d-ad9d-fb7fe7000fc6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:07.738670 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4d36af00-aaff-413d-ad9d-fb7fe7000fc6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1473 microversion: 2.1 time: 0.820708 Feb 19 20:57:07.739452 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 886/1702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:06 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1473 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:07.753746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-164c3cfd-a772-478f-a207-f44f1ed8c31c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:07.754094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-164c3cfd-a772-478f-a207-f44f1ed8c31c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:07.760928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-164c3cfd-a772-478f-a207-f44f1ed8c31c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:07.761385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-164c3cfd-a772-478f-a207-f44f1ed8c31c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:07.762171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-164c3cfd-a772-478f-a207-f44f1ed8c31c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:07.762603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-164c3cfd-a772-478f-a207-f44f1ed8c31c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.014188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:57:08.014699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:57:08.015613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:57:08.016297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:57:08.017397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:57:08.026682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:08.027206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.028344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:08.029036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.052234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Getting quotas for project 808305a45737485185adcb60012ea91a. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:57:08.057021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Getting quotas for user ccc221761620472ea3cd887988f9f2c0 and project 808305a45737485185adcb60012ea91a. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:57:08.070970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:57:08.074541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:57:08.134905 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7a46de28-a3f1-4c18-8dc0-7b1248000013 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604230 Feb 19 20:57:08.135997 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 817/1703] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:57:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:57:08.142865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca95c92b-03bc-4f09-9e6d-21036d6555bb tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:08.143754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ca95c92b-03bc-4f09-9e6d-21036d6555bb tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:08.153819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca95c92b-03bc-4f09-9e6d-21036d6555bb tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:08.154572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca95c92b-03bc-4f09-9e6d-21036d6555bb tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.155531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca95c92b-03bc-4f09-9e6d-21036d6555bb tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:08.156596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca95c92b-03bc-4f09-9e6d-21036d6555bb tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.373395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-164c3cfd-a772-478f-a207-f44f1ed8c31c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:08.384505 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-164c3cfd-a772-478f-a207-f44f1ed8c31c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1504 microversion: 2.1 time: 0.635329 Feb 19 20:57:08.389007 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 887/1704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:07 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1504 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:08.402580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c8c53e36-b91f-4ec2-99a9-e4162eb78e5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467ceaca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:08.475624 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c8c53e36-b91f-4ec2-99a9-e4162eb78e5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1422 microversion: 2.1 time: 0.084576 Feb 19 20:57:08.477108 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 888/1705] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:08 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:08.483797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-65cfa3c3-99ac-47a0-aca2-43e7b9677b3d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:08.484541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-65cfa3c3-99ac-47a0-aca2-43e7b9677b3d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:08.520309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c3-99ac-47a0-aca2-43e7b9677b3d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:08.520828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c3-99ac-47a0-aca2-43e7b9677b3d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.523431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c3-99ac-47a0-aca2-43e7b9677b3d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:08.524173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65cfa3c3-99ac-47a0-aca2-43e7b9677b3d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.636714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca95c92b-03bc-4f09-9e6d-21036d6555bb tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:08.651849 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ca95c92b-03bc-4f09-9e6d-21036d6555bb tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1393 microversion: 2.1 time: 0.513112 Feb 19 20:57:08.663842 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 818/1706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:08 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1393 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:08.670187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-48159e74-4bf2-4af7-8f01-bff0d4521af2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:08.670969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-48159e74-4bf2-4af7-8f01-bff0d4521af2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:08.679750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48159e74-4bf2-4af7-8f01-bff0d4521af2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:08.680362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48159e74-4bf2-4af7-8f01-bff0d4521af2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.681510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48159e74-4bf2-4af7-8f01-bff0d4521af2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:08.682962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48159e74-4bf2-4af7-8f01-bff0d4521af2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.947645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-65cfa3c3-99ac-47a0-aca2-43e7b9677b3d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:08.955658 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-65cfa3c3-99ac-47a0-aca2-43e7b9677b3d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1472 microversion: 2.1 time: 0.477227 Feb 19 20:57:08.968213 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 889/1707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:08 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1472 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:08.973213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4a8f3c0e-5dba-4666-aeb7-caf39423b22b req-181cf70d-c8b1-493b-853f-3bea591feeff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65e4283-9a5c-4b89-a006-7e6727e92f45", "name": "network-vif-unplugged", "status": "completed", "tag": "36f49322-08ea-4d05-b1fa-2357653ca8be"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:08.975112 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:08.975112 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:08.983858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4a8f3c0e-5dba-4666-aeb7-caf39423b22b req-181cf70d-c8b1-493b-853f-3bea591feeff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:08.984864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4a8f3c0e-5dba-4666-aeb7-caf39423b22b req-181cf70d-c8b1-493b-853f-3bea591feeff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:08.999743 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4a8f3c0e-5dba-4666-aeb7-caf39423b22b req-181cf70d-c8b1-493b-853f-3bea591feeff service nova] Creating event network-vif-unplugged:36f49322-08ea-4d05-b1fa-2357653ca8be for instance c65e4283-9a5c-4b89-a006-7e6727e92f45 on nch2-master-1 Feb 19 20:57:09.006765 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4a8f3c0e-5dba-4666-aeb7-caf39423b22b req-181cf70d-c8b1-493b-853f-3bea591feeff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036962 Feb 19 20:57:09.007531 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 890/1708] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:09.013518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eea094db-de92-4b0b-ac69-0ed40b5ffc90 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:09.014231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eea094db-de92-4b0b-ac69-0ed40b5ffc90 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:09.020747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eea094db-de92-4b0b-ac69-0ed40b5ffc90 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.021440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eea094db-de92-4b0b-ac69-0ed40b5ffc90 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:09.022401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eea094db-de92-4b0b-ac69-0ed40b5ffc90 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.023008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eea094db-de92-4b0b-ac69-0ed40b5ffc90 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:09.209147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-eea094db-de92-4b0b-ac69-0ed40b5ffc90 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:09.223443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eea094db-de92-4b0b-ac69-0ed40b5ffc90 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1214 microversion: 2.1 time: 0.214436 Feb 19 20:57:09.224018 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 891/1709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:09 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:09.228696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1f3c59c7-42fe-4453-8b7c-76c239d67006 req-c340dc8a-d8f0-4780-af03-9bd26959dc99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f1f59f-19d3-4b89-873c-bc100187739c", "name": "network-vif-plugged", "status": "completed", "tag": "7b13225c-b3f5-46c0-a7ec-cecdc4f9a82a"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:09.243921 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:09.243921 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:09.261513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1f3c59c7-42fe-4453-8b7c-76c239d67006 req-c340dc8a-d8f0-4780-af03-9bd26959dc99 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.262886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1f3c59c7-42fe-4453-8b7c-76c239d67006 req-c340dc8a-d8f0-4780-af03-9bd26959dc99 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:09.284155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-48159e74-4bf2-4af7-8f01-bff0d4521af2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:09.289414 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1f3c59c7-42fe-4453-8b7c-76c239d67006 req-c340dc8a-d8f0-4780-af03-9bd26959dc99 service nova] Creating event network-vif-plugged:7b13225c-b3f5-46c0-a7ec-cecdc4f9a82a for instance e9f1f59f-19d3-4b89-873c-bc100187739c on nch1-master-1 Feb 19 20:57:09.297294 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-48159e74-4bf2-4af7-8f01-bff0d4521af2 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.631976 Feb 19 20:57:09.298476 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 819/1710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:08 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:09.304353 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7284525b-3eb8-4538-a857-8e995f3e7ea7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467a84790>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:09.340379 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1f3c59c7-42fe-4453-8b7c-76c239d67006 req-c340dc8a-d8f0-4780-af03-9bd26959dc99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114839 Feb 19 20:57:09.342776 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 892/1711] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:09.350399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-414b67fa-5c64-48c4-9738-c616139af63e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:09.355197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-414b67fa-5c64-48c4-9738-c616139af63e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:09.370460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-414b67fa-5c64-48c4-9738-c616139af63e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.371145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-414b67fa-5c64-48c4-9738-c616139af63e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:09.372150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-414b67fa-5c64-48c4-9738-c616139af63e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.373043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-414b67fa-5c64-48c4-9738-c616139af63e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:09.390022 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7284525b-3eb8-4538-a857-8e995f3e7ea7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 200 len: 1422 microversion: 2.1 time: 0.090156 Feb 19 20:57:09.393422 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 820/1712] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:57:09 2022] GET /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:09.406608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6c27493e-4278-49d4-b281-bcf786b58cef req-2c8fc711-6a06-427f-bddb-0c340ad68a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ece57c-a579-45c4-82fb-74b6ed0363e1", "name": "network-vif-deleted", "tag": "5a3851e0-4e2d-4a66-9cec-b7694420e692"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:09.410956 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:09.410956 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:09.441951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6c27493e-4278-49d4-b281-bcf786b58cef req-2c8fc711-6a06-427f-bddb-0c340ad68a1b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.443770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6c27493e-4278-49d4-b281-bcf786b58cef req-2c8fc711-6a06-427f-bddb-0c340ad68a1b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:09.478366 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6c27493e-4278-49d4-b281-bcf786b58cef req-2c8fc711-6a06-427f-bddb-0c340ad68a1b service nova] Creating event network-vif-deleted:5a3851e0-4e2d-4a66-9cec-b7694420e692 for instance c0ece57c-a579-45c4-82fb-74b6ed0363e1 on nch1-master-1 Feb 19 20:57:09.487690 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6c27493e-4278-49d4-b281-bcf786b58cef req-2c8fc711-6a06-427f-bddb-0c340ad68a1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092063 Feb 19 20:57:09.489131 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 821/1713] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:09.571936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f76231fd-1839-45ad-887e-bbb00e076bdf tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:09.576348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-414b67fa-5c64-48c4-9738-c616139af63e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:09.579178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f76231fd-1839-45ad-887e-bbb00e076bdf tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] [instance: 7cf8b039-82b9-43e5-8dac-e2a32fa9288f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:09.586442 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-414b67fa-5c64-48c4-9738-c616139af63e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 200 len: 1302 microversion: 2.1 time: 0.241997 Feb 19 20:57:09.587043 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 893/1714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:09 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 1302 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:09.596645 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f76231fd-1839-45ad-887e-bbb00e076bdf tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] HTTP exception thrown: Instance 7cf8b039-82b9-43e5-8dac-e2a32fa9288f could not be found. Feb 19 20:57:09.597744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f76231fd-1839-45ad-887e-bbb00e076bdf tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Returning 404 to user: Instance 7cf8b039-82b9-43e5-8dac-e2a32fa9288f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:09.599041 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f76231fd-1839-45ad-887e-bbb00e076bdf tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/7cf8b039-82b9-43e5-8dac-e2a32fa9288f/action" status: 404 len: 111 microversion: 2.1 time: 0.107718 Feb 19 20:57:09.600297 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 822/1715] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:57:09 2022] POST /compute/v2.1/servers/7cf8b039-82b9-43e5-8dac-e2a32fa9288f/action => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:09.608057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cfc6fdcc-913e-47af-af3e-93bf8bc6a7c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:09.608844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cfc6fdcc-913e-47af-af3e-93bf8bc6a7c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:09.622738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-34b0388b-b636-49a5-b8bd-bcd7cd7fb706 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467cea1f0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:09.654738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfc6fdcc-913e-47af-af3e-93bf8bc6a7c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.655746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfc6fdcc-913e-47af-af3e-93bf8bc6a7c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:09.659470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfc6fdcc-913e-47af-af3e-93bf8bc6a7c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.661498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfc6fdcc-913e-47af-af3e-93bf8bc6a7c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:09.926735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cfc6fdcc-913e-47af-af3e-93bf8bc6a7c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:09.937571 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cfc6fdcc-913e-47af-af3e-93bf8bc6a7c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1504 microversion: 2.1 time: 0.334869 Feb 19 20:57:09.937744 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 823/1716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:09 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1504 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:09.954776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1676568e-b4da-4e0c-b269-03462bf4f433 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:09.955396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1676568e-b4da-4e0c-b269-03462bf4f433 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:09.961378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1676568e-b4da-4e0c-b269-03462bf4f433 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.962368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1676568e-b4da-4e0c-b269-03462bf4f433 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:09.963604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1676568e-b4da-4e0c-b269-03462bf4f433 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:09.964826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1676568e-b4da-4e0c-b269-03462bf4f433 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:10.405294 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-34b0388b-b636-49a5-b8bd-bcd7cd7fb706 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 204 len: 0 microversion: 2.1 time: 0.816848 Feb 19 20:57:10.406345 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 894/1717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:09 2022] DELETE /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 0 bytes in 819 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:10.409167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1676568e-b4da-4e0c-b269-03462bf4f433 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:10.413627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-539303817", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:10.425297 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1676568e-b4da-4e0c-b269-03462bf4f433 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1393 microversion: 2.1 time: 0.485588 Feb 19 20:57:10.434664 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 824/1718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:09 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1393 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:10.434664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4ae65125-e9be-4626-befd-a3beac82c70d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:10.434664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4ae65125-e9be-4626-befd-a3beac82c70d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:10.443709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ae65125-e9be-4626-befd-a3beac82c70d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:10.444923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ae65125-e9be-4626-befd-a3beac82c70d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:10.446059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ae65125-e9be-4626-befd-a3beac82c70d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:10.446627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ae65125-e9be-4626-befd-a3beac82c70d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:10.484419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:57:10.571635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4ae65125-e9be-4626-befd-a3beac82c70d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:10.580035 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4ae65125-e9be-4626-befd-a3beac82c70d tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1276 microversion: 2.1 time: 0.152426 Feb 19 20:57:10.590078 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 825/1719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:10 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:10.595294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1ce30a28-63b9-4cfa-a97c-9958aff1ce57 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:10.596213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1ce30a28-63b9-4cfa-a97c-9958aff1ce57 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:10.606112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ce30a28-63b9-4cfa-a97c-9958aff1ce57 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:10.606576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ce30a28-63b9-4cfa-a97c-9958aff1ce57 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:10.608786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ce30a28-63b9-4cfa-a97c-9958aff1ce57 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:10.609234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ce30a28-63b9-4cfa-a97c-9958aff1ce57 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:10.979925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1ce30a28-63b9-4cfa-a97c-9958aff1ce57 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:10.988596 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1ce30a28-63b9-4cfa-a97c-9958aff1ce57 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.396930 Feb 19 20:57:10.989786 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 826/1720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:10 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:10.994467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3e2d5ca2-dca2-471e-900a-974efd64a5a1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:10.995137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3e2d5ca2-dca2-471e-900a-974efd64a5a1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:11.003458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e2d5ca2-dca2-471e-900a-974efd64a5a1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.003902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e2d5ca2-dca2-471e-900a-974efd64a5a1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.004818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e2d5ca2-dca2-471e-900a-974efd64a5a1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.005300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e2d5ca2-dca2-471e-900a-974efd64a5a1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.033615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:57:11.034187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3e2d5ca2-dca2-471e-900a-974efd64a5a1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:11.034388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:57:11.034740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:57:11.035220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:57:11.036468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:57:11.048002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.048865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.049807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.050501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.071977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Getting quotas for project 106062f100884d929b001725a5daa730. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:57:11.076809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Getting quotas for user 4a93bc6b2b584caab5baabf5fdbea583 and project 106062f100884d929b001725a5daa730. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:57:11.089886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:57:11.092348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:57:11.130577 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3e2d5ca2-dca2-471e-900a-974efd64a5a1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 204 len: 0 microversion: 2.1 time: 0.139203 Feb 19 20:57:11.131621 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 827/1721] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:10 2022] DELETE /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:11.139277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ddb81a54-3164-429c-bb10-2626bf311282 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:11.140730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ddb81a54-3164-429c-bb10-2626bf311282 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:11.147979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddb81a54-3164-429c-bb10-2626bf311282 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.151069 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6aed6bd2-600d-4b32-808c-4d94080a2a12 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742937 Feb 19 20:57:11.152225 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 895/1722] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:57:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:57:11.159191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddb81a54-3164-429c-bb10-2626bf311282 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.160164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddb81a54-3164-429c-bb10-2626bf311282 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.164638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4a5953a4-b1dd-4353-905c-e4f52308fec5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:11.165806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddb81a54-3164-429c-bb10-2626bf311282 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.165944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4a5953a4-b1dd-4353-905c-e4f52308fec5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:11.184907 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-ddb81a54-3164-429c-bb10-2626bf311282 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] HTTP exception thrown: Instance 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 could not be found. Feb 19 20:57:11.185544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ddb81a54-3164-429c-bb10-2626bf311282 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Returning 404 to user: Instance 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:11.187102 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ddb81a54-3164-429c-bb10-2626bf311282 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99" status: 404 len: 111 microversion: 2.1 time: 0.054048 Feb 19 20:57:11.192651 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 828/1723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:11 2022] GET /compute/v2.1/servers/7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:11.193862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a5953a4-b1dd-4353-905c-e4f52308fec5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.196642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a5953a4-b1dd-4353-905c-e4f52308fec5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.197524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a5953a4-b1dd-4353-905c-e4f52308fec5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.198165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a3955bcc-c73e-41b6-93a9-bfd0b7dcd047 req-e67146bf-54df-4ea6-b1ed-8c802908dc38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65e4283-9a5c-4b89-a006-7e6727e92f45", "tag": "36f49322-08ea-4d05-b1fa-2357653ca8be"}, {"server_uuid": "7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99", "name": "network-vif-deleted", "tag": "020bbc87-1ec4-420c-9f86-2a44e5ea3d18"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:11.198381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a5953a4-b1dd-4353-905c-e4f52308fec5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.200221 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:11.200221 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:11.210157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a3955bcc-c73e-41b6-93a9-bfd0b7dcd047 req-e67146bf-54df-4ea6-b1ed-8c802908dc38 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.221380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a3955bcc-c73e-41b6-93a9-bfd0b7dcd047 req-e67146bf-54df-4ea6-b1ed-8c802908dc38 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.248253 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a3955bcc-c73e-41b6-93a9-bfd0b7dcd047 req-e67146bf-54df-4ea6-b1ed-8c802908dc38 service nova] Creating event network-changed:36f49322-08ea-4d05-b1fa-2357653ca8be for instance c65e4283-9a5c-4b89-a006-7e6727e92f45 on nch2-master-1 Feb 19 20:57:11.248828 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a3955bcc-c73e-41b6-93a9-bfd0b7dcd047 req-e67146bf-54df-4ea6-b1ed-8c802908dc38 service nova] Creating event network-vif-deleted:020bbc87-1ec4-420c-9f86-2a44e5ea3d18 for instance 7d01c2aa-f8c8-4f97-bfcc-501e8cc7bd99 on nch2-master-1 Feb 19 20:57:11.266092 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a3955bcc-c73e-41b6-93a9-bfd0b7dcd047 req-e67146bf-54df-4ea6-b1ed-8c802908dc38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071967 Feb 19 20:57:11.267641 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 829/1724] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:11.274690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4782a44e-560d-45e0-9d24-35238c9e1726 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:11.275711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4782a44e-560d-45e0-9d24-35238c9e1726 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:11.382129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4782a44e-560d-45e0-9d24-35238c9e1726 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:11.396848 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4782a44e-560d-45e0-9d24-35238c9e1726 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1221 microversion: 2.1 time: 0.127289 Feb 19 20:57:11.397777 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 830/1725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:11 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:11.402680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-28af5a24-9948-44bb-a01d-dc1abae72c10 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:11.403177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-28af5a24-9948-44bb-a01d-dc1abae72c10 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:11.414235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28af5a24-9948-44bb-a01d-dc1abae72c10 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.414793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28af5a24-9948-44bb-a01d-dc1abae72c10 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.416222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28af5a24-9948-44bb-a01d-dc1abae72c10 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.416222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28af5a24-9948-44bb-a01d-dc1abae72c10 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.474332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-28af5a24-9948-44bb-a01d-dc1abae72c10 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:11.629044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a5953a4-b1dd-4353-905c-e4f52308fec5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:11.633045 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-28af5a24-9948-44bb-a01d-dc1abae72c10 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 204 len: 0 microversion: 2.1 time: 0.233809 Feb 19 20:57:11.638032 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 831/1726] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:11 2022] DELETE /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:11.642490 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4a5953a4-b1dd-4353-905c-e4f52308fec5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1504 microversion: 2.1 time: 0.485131 Feb 19 20:57:11.643217 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 896/1727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:11 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:11.649065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-596323768", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "0b77203b-47b2-4bd5-a7b7-432923f05242"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:11.651970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-435dfddf-2b34-4842-9c05-aa6986d59a53 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:11.655130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-435dfddf-2b34-4842-9c05-aa6986d59a53 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:11.671056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435dfddf-2b34-4842-9c05-aa6986d59a53 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.671678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435dfddf-2b34-4842-9c05-aa6986d59a53 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.673449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435dfddf-2b34-4842-9c05-aa6986d59a53 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:11.675354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435dfddf-2b34-4842-9c05-aa6986d59a53 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:11.760990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] validate_networks() for [('0b77203b-47b2-4bd5-a7b7-432923f05242', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:57:12.123380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-435dfddf-2b34-4842-9c05-aa6986d59a53 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:12.133272 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-435dfddf-2b34-4842-9c05-aa6986d59a53 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1573 microversion: 2.1 time: 0.488316 Feb 19 20:57:12.134279 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 897/1728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:11 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1573 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:12.139213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c2aa275f-6e13-479e-a437-597b2c3ae2f5 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:12.139825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c2aa275f-6e13-479e-a437-597b2c3ae2f5 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:12.149323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2aa275f-6e13-479e-a437-597b2c3ae2f5 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:12.150718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2aa275f-6e13-479e-a437-597b2c3ae2f5 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:12.152294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2aa275f-6e13-479e-a437-597b2c3ae2f5 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:12.153409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2aa275f-6e13-479e-a437-597b2c3ae2f5 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:12.870005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c2aa275f-6e13-479e-a437-597b2c3ae2f5 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:12.884207 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c2aa275f-6e13-479e-a437-597b2c3ae2f5 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1318 microversion: 2.1 time: 0.748314 Feb 19 20:57:12.890442 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 898/1729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:12 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1318 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:12.901829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f132677-91ec-43c3-b6d5-c62ec7cf0bcd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:12.902872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f132677-91ec-43c3-b6d5-c62ec7cf0bcd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:12.916025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f132677-91ec-43c3-b6d5-c62ec7cf0bcd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:12.916865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f132677-91ec-43c3-b6d5-c62ec7cf0bcd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:12.917997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f132677-91ec-43c3-b6d5-c62ec7cf0bcd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:12.918684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f132677-91ec-43c3-b6d5-c62ec7cf0bcd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:12.948289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:57:12.949124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:57:12.949798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:57:12.950407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:57:12.951543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:57:12.967116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:12.969700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:12.971762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:12.972420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:12.994491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Getting quotas for project b959eb07a97740dca63d3cf3d2ed0a63. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:57:13.013030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Getting quotas for user 5a3a1e86138d41b991f5e44a1e8ae2eb and project b959eb07a97740dca63d3cf3d2ed0a63. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:57:13.039974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:57:13.042441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:57:13.106164 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8b5a193e-e005-4781-9675-0de1ba8b75cb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469726 Feb 19 20:57:13.107467 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 832/1730] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:57:13.115483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2cf6fc7a-017f-4845-9e88-cc579f75322f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:13.116386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2cf6fc7a-017f-4845-9e88-cc579f75322f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:13.127615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cf6fc7a-017f-4845-9e88-cc579f75322f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.128792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cf6fc7a-017f-4845-9e88-cc579f75322f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.130095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cf6fc7a-017f-4845-9e88-cc579f75322f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.130807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cf6fc7a-017f-4845-9e88-cc579f75322f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.206129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f132677-91ec-43c3-b6d5-c62ec7cf0bcd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:13.215449 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f132677-91ec-43c3-b6d5-c62ec7cf0bcd tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1473 microversion: 2.1 time: 0.323544 Feb 19 20:57:13.229599 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 899/1731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:12 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:13.242614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-76bf501f-1ae1-4ee8-9692-f339efd29fc0 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:13.242614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-76bf501f-1ae1-4ee8-9692-f339efd29fc0 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:13.249548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76bf501f-1ae1-4ee8-9692-f339efd29fc0 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.250036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76bf501f-1ae1-4ee8-9692-f339efd29fc0 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.250820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76bf501f-1ae1-4ee8-9692-f339efd29fc0 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.252135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76bf501f-1ae1-4ee8-9692-f339efd29fc0 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.493471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2cf6fc7a-017f-4845-9e88-cc579f75322f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:13.504067 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2cf6fc7a-017f-4845-9e88-cc579f75322f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.394451 Feb 19 20:57:13.505130 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-76bf501f-1ae1-4ee8-9692-f339efd29fc0 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.274082 Feb 19 20:57:13.505503 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 833/1732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:13 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:13.505847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 900/1733] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 20:57:13 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:13.518496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-97c9c5fb-b0ba-4497-8f04-1a50b16e931d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:13.519395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-97c9c5fb-b0ba-4497-8f04-1a50b16e931d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:13.537253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97c9c5fb-b0ba-4497-8f04-1a50b16e931d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.537704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97c9c5fb-b0ba-4497-8f04-1a50b16e931d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.538505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97c9c5fb-b0ba-4497-8f04-1a50b16e931d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.538943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97c9c5fb-b0ba-4497-8f04-1a50b16e931d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.542233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d924a8fe-49af-4e41-ada9-4fb090baf91b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:13.542866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d924a8fe-49af-4e41-ada9-4fb090baf91b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:13.556428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d924a8fe-49af-4e41-ada9-4fb090baf91b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.557746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d924a8fe-49af-4e41-ada9-4fb090baf91b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.560979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d924a8fe-49af-4e41-ada9-4fb090baf91b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.562713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d924a8fe-49af-4e41-ada9-4fb090baf91b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.711000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d924a8fe-49af-4e41-ada9-4fb090baf91b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:13.723879 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d924a8fe-49af-4e41-ada9-4fb090baf91b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1279 microversion: 2.1 time: 0.198298 Feb 19 20:57:13.726027 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 834/1734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:13 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:13.741399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-33d6b2b5-9b8c-4a92-a493-cbb2f75bffe6 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:13.742374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-33d6b2b5-9b8c-4a92-a493-cbb2f75bffe6 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:13.755975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33d6b2b5-9b8c-4a92-a493-cbb2f75bffe6 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.758413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33d6b2b5-9b8c-4a92-a493-cbb2f75bffe6 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.760973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33d6b2b5-9b8c-4a92-a493-cbb2f75bffe6 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.761602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33d6b2b5-9b8c-4a92-a493-cbb2f75bffe6 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.840990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-97c9c5fb-b0ba-4497-8f04-1a50b16e931d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:13.851710 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-97c9c5fb-b0ba-4497-8f04-1a50b16e931d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1504 microversion: 2.1 time: 0.337973 Feb 19 20:57:13.852790 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 901/1735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:13 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:13.860078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8ede2f8b-eb72-43b5-bb1b-bbf21e3216cb req-2d38dfce-a53b-404f-9e86-81bf6424b034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d96133-519f-46d5-9906-ad66e66ae2df", "tag": "25ae9901-aabc-4527-88db-b493a2eaf496"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:13.863088 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:13.863088 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:13.871365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8ede2f8b-eb72-43b5-bb1b-bbf21e3216cb req-2d38dfce-a53b-404f-9e86-81bf6424b034 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.872091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8ede2f8b-eb72-43b5-bb1b-bbf21e3216cb req-2d38dfce-a53b-404f-9e86-81bf6424b034 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.887721 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8ede2f8b-eb72-43b5-bb1b-bbf21e3216cb req-2d38dfce-a53b-404f-9e86-81bf6424b034 service nova] Creating event network-changed:25ae9901-aabc-4527-88db-b493a2eaf496 for instance c6d96133-519f-46d5-9906-ad66e66ae2df on nch1-master-1 Feb 19 20:57:13.896062 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8ede2f8b-eb72-43b5-bb1b-bbf21e3216cb req-2d38dfce-a53b-404f-9e86-81bf6424b034 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041860 Feb 19 20:57:13.897511 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 902/1736] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:13.907503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-33d6b2b5-9b8c-4a92-a493-cbb2f75bffe6 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:13.920814 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-33d6b2b5-9b8c-4a92-a493-cbb2f75bffe6 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1211 microversion: 2.1 time: 0.193056 Feb 19 20:57:13.921425 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 835/1737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:13 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1211 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:13.930510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ee5da053-a910-4697-9cf9-4cc54a535153 req-2f4ed715-aa7f-48aa-9953-7326a929eb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d927e050-ac38-4b26-8aa5-14f490410068", "name": "network-vif-unplugged", "status": "completed", "tag": "ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:13.930510 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:13.930510 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:13.936796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ee5da053-a910-4697-9cf9-4cc54a535153 req-2f4ed715-aa7f-48aa-9953-7326a929eb84 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.937292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ee5da053-a910-4697-9cf9-4cc54a535153 req-2f4ed715-aa7f-48aa-9953-7326a929eb84 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.937755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2eb0b859-e3bf-4ede-8e49-73f1abe4d122 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:13.939877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2eb0b859-e3bf-4ede-8e49-73f1abe4d122 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:13.947438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2eb0b859-e3bf-4ede-8e49-73f1abe4d122 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.948155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2eb0b859-e3bf-4ede-8e49-73f1abe4d122 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.949146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2eb0b859-e3bf-4ede-8e49-73f1abe4d122 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:13.950189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2eb0b859-e3bf-4ede-8e49-73f1abe4d122 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:13.952305 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ee5da053-a910-4697-9cf9-4cc54a535153 req-2f4ed715-aa7f-48aa-9953-7326a929eb84 service nova] Creating event network-vif-unplugged:ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c for instance d927e050-ac38-4b26-8aa5-14f490410068 on nch2-master-1 Feb 19 20:57:13.961194 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ee5da053-a910-4697-9cf9-4cc54a535153 req-2f4ed715-aa7f-48aa-9953-7326a929eb84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061628 Feb 19 20:57:13.966222 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 903/1738] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:14.147951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2eb0b859-e3bf-4ede-8e49-73f1abe4d122 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:14.159033 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2eb0b859-e3bf-4ede-8e49-73f1abe4d122 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1318 microversion: 2.1 time: 0.224579 Feb 19 20:57:14.160280 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 836/1739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:13 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:14.243424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f0ccd171-051f-4cc9-9fba-0445c5112dd3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:14.244122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f0ccd171-051f-4cc9-9fba-0445c5112dd3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:14.250649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ccd171-051f-4cc9-9fba-0445c5112dd3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:14.251765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ccd171-051f-4cc9-9fba-0445c5112dd3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:14.252751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ccd171-051f-4cc9-9fba-0445c5112dd3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:14.253426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ccd171-051f-4cc9-9fba-0445c5112dd3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:14.483634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0ccd171-051f-4cc9-9fba-0445c5112dd3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:14.494950 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f0ccd171-051f-4cc9-9fba-0445c5112dd3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1473 microversion: 2.1 time: 0.256221 Feb 19 20:57:14.505223 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 904/1740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:14 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1473 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:14.522337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e2a710c3-2399-49f4-bd38-c942fdef5660 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:14.523111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e2a710c3-2399-49f4-bd38-c942fdef5660 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:14.531609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2a710c3-2399-49f4-bd38-c942fdef5660 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:14.533165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2a710c3-2399-49f4-bd38-c942fdef5660 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:14.534135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2a710c3-2399-49f4-bd38-c942fdef5660 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:14.534582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2a710c3-2399-49f4-bd38-c942fdef5660 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:14.743708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-601c3b89-5232-47f1-a087-5746ed047652 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:14.744351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-601c3b89-5232-47f1-a087-5746ed047652 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:14.759792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-601c3b89-5232-47f1-a087-5746ed047652 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:14.760316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-601c3b89-5232-47f1-a087-5746ed047652 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:14.761319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-601c3b89-5232-47f1-a087-5746ed047652 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:14.762128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-601c3b89-5232-47f1-a087-5746ed047652 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:15.047571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e2a710c3-2399-49f4-bd38-c942fdef5660 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:15.058933 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e2a710c3-2399-49f4-bd38-c942fdef5660 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.540228 Feb 19 20:57:15.060638 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 837/1741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:14 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:15.067602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d81a9b2c-b989-4601-80f1-9370b849b616 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:15.069026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d81a9b2c-b989-4601-80f1-9370b849b616 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:15.076208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d81a9b2c-b989-4601-80f1-9370b849b616 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:15.076905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d81a9b2c-b989-4601-80f1-9370b849b616 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:15.077886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d81a9b2c-b989-4601-80f1-9370b849b616 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:15.078436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d81a9b2c-b989-4601-80f1-9370b849b616 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:15.273123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-601c3b89-5232-47f1-a087-5746ed047652 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:15.282993 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-601c3b89-5232-47f1-a087-5746ed047652 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.543986 Feb 19 20:57:15.296708 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 905/1742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:14 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:15.301295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0a6d2fa-2344-45ee-9ae4-81b85bb83131 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:15.302515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0a6d2fa-2344-45ee-9ae4-81b85bb83131 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:15.309762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a6d2fa-2344-45ee-9ae4-81b85bb83131 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:15.310215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a6d2fa-2344-45ee-9ae4-81b85bb83131 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:15.311322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a6d2fa-2344-45ee-9ae4-81b85bb83131 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:15.311761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a6d2fa-2344-45ee-9ae4-81b85bb83131 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:15.432488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e0a6d2fa-2344-45ee-9ae4-81b85bb83131 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:15.443204 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0a6d2fa-2344-45ee-9ae4-81b85bb83131 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1265 microversion: 2.1 time: 0.147452 Feb 19 20:57:15.444510 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 906/1743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:15 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:15.449407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-93ed080f-aba0-4269-80f5-870ea703e5a1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:15.450484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-93ed080f-aba0-4269-80f5-870ea703e5a1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:15.457666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93ed080f-aba0-4269-80f5-870ea703e5a1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:15.458707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93ed080f-aba0-4269-80f5-870ea703e5a1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:15.459067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93ed080f-aba0-4269-80f5-870ea703e5a1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:15.460805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93ed080f-aba0-4269-80f5-870ea703e5a1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:15.505383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d81a9b2c-b989-4601-80f1-9370b849b616 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:15.521547 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d81a9b2c-b989-4601-80f1-9370b849b616 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1504 microversion: 2.1 time: 0.458599 Feb 19 20:57:15.522251 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 838/1744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:15 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:15.527834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-81f6b8ad-37cf-4817-ae24-db9374b0be22 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:15.528590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-81f6b8ad-37cf-4817-ae24-db9374b0be22 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:15.537811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81f6b8ad-37cf-4817-ae24-db9374b0be22 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:15.538651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81f6b8ad-37cf-4817-ae24-db9374b0be22 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:15.539992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81f6b8ad-37cf-4817-ae24-db9374b0be22 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:15.541014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81f6b8ad-37cf-4817-ae24-db9374b0be22 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:15.950178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-93ed080f-aba0-4269-80f5-870ea703e5a1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:15.966304 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-93ed080f-aba0-4269-80f5-870ea703e5a1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1318 microversion: 2.1 time: 0.520519 Feb 19 20:57:15.970324 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 907/1745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:15 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:15.986464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-81f6b8ad-37cf-4817-ae24-db9374b0be22 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:15.995253 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-81f6b8ad-37cf-4817-ae24-db9374b0be22 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 200 len: 1473 microversion: 2.1 time: 0.471293 Feb 19 20:57:16.006666 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 839/1746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:15 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 1473 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:16.029465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a654c020-370a-401e-abd9-1b88254bf807 req-3126ca18-df8d-407e-b1b7-492f9a656507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c91011-f731-4d80-b568-d970fcd46286", "name": "network-vif-deleted", "tag": "a0a6b42b-6ed6-490d-be6f-f141ef78c41e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:16.031428 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:16.031428 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:16.055503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a654c020-370a-401e-abd9-1b88254bf807 req-3126ca18-df8d-407e-b1b7-492f9a656507 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:16.058332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a654c020-370a-401e-abd9-1b88254bf807 req-3126ca18-df8d-407e-b1b7-492f9a656507 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:16.085606 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a654c020-370a-401e-abd9-1b88254bf807 req-3126ca18-df8d-407e-b1b7-492f9a656507 service nova] Creating event network-vif-deleted:a0a6b42b-6ed6-490d-be6f-f141ef78c41e for instance 87c91011-f731-4d80-b568-d970fcd46286 on nch1-master-1 Feb 19 20:57:16.086889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-38105f5c-9f41-4a95-9203-62cdb11be4f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:16.088088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-38105f5c-9f41-4a95-9203-62cdb11be4f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:16.094409 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a654c020-370a-401e-abd9-1b88254bf807 req-3126ca18-df8d-407e-b1b7-492f9a656507 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069313 Feb 19 20:57:16.095613 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 908/1747] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:16.095932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38105f5c-9f41-4a95-9203-62cdb11be4f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:16.096582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38105f5c-9f41-4a95-9203-62cdb11be4f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:16.099544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38105f5c-9f41-4a95-9203-62cdb11be4f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:16.109055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38105f5c-9f41-4a95-9203-62cdb11be4f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:16.319386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a81126e5-a3a1-40cb-bfd2-af34805c39d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:16.327385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a81126e5-a3a1-40cb-bfd2-af34805c39d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:16.389178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a81126e5-a3a1-40cb-bfd2-af34805c39d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:16.390158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a81126e5-a3a1-40cb-bfd2-af34805c39d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:16.391068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a81126e5-a3a1-40cb-bfd2-af34805c39d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:16.391765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a81126e5-a3a1-40cb-bfd2-af34805c39d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:16.992880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-38105f5c-9f41-4a95-9203-62cdb11be4f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:17.018271 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-38105f5c-9f41-4a95-9203-62cdb11be4f6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.944488 Feb 19 20:57:17.027400 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 840/1748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:16 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:17.056529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5ac6f1c2-08cc-466b-aeb7-0be98a43542b req-14bf3ce5-7c04-46df-a33a-e8f3c0532b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d927e050-ac38-4b26-8aa5-14f490410068", "name": "network-vif-deleted", "tag": "ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:17.062990 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:17.062990 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:17.082573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5ac6f1c2-08cc-466b-aeb7-0be98a43542b req-14bf3ce5-7c04-46df-a33a-e8f3c0532b12 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:17.083024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5ac6f1c2-08cc-466b-aeb7-0be98a43542b req-14bf3ce5-7c04-46df-a33a-e8f3c0532b12 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:17.093855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a81126e5-a3a1-40cb-bfd2-af34805c39d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:17.107772 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a81126e5-a3a1-40cb-bfd2-af34805c39d0 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.806885 Feb 19 20:57:17.114322 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 909/1749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:16 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:17.117931 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5ac6f1c2-08cc-466b-aeb7-0be98a43542b req-14bf3ce5-7c04-46df-a33a-e8f3c0532b12 service nova] Creating event network-vif-deleted:ad4b3aac-0db6-4a6b-bc6e-adb874dddb0c for instance d927e050-ac38-4b26-8aa5-14f490410068 on nch2-master-1 Feb 19 20:57:17.125287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e38beb3b-dcdf-4378-becb-981a77a02af3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:17.127593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e38beb3b-dcdf-4378-becb-981a77a02af3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:17.130291 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5ac6f1c2-08cc-466b-aeb7-0be98a43542b req-14bf3ce5-7c04-46df-a33a-e8f3c0532b12 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091588 Feb 19 20:57:17.130924 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 841/1750] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:17.143861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce53a751-d5b8-40ea-8bf6-29ba11eb970a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:17.144557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e38beb3b-dcdf-4378-becb-981a77a02af3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:17.144768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ce53a751-d5b8-40ea-8bf6-29ba11eb970a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:17.144998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e38beb3b-dcdf-4378-becb-981a77a02af3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:17.146017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e38beb3b-dcdf-4378-becb-981a77a02af3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:17.146623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e38beb3b-dcdf-4378-becb-981a77a02af3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:17.153768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce53a751-d5b8-40ea-8bf6-29ba11eb970a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:17.162059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce53a751-d5b8-40ea-8bf6-29ba11eb970a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:17.170670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce53a751-d5b8-40ea-8bf6-29ba11eb970a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:17.171528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce53a751-d5b8-40ea-8bf6-29ba11eb970a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:17.566872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e38beb3b-dcdf-4378-becb-981a77a02af3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:17.587916 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e38beb3b-dcdf-4378-becb-981a77a02af3 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1573 microversion: 2.1 time: 0.470428 Feb 19 20:57:17.588869 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 910/1751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:17 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1573 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:17.637369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-07a0a2ea-8c7f-47a0-b647-cd402edcbd37 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:17.638028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-07a0a2ea-8c7f-47a0-b647-cd402edcbd37 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:17.646134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07a0a2ea-8c7f-47a0-b647-cd402edcbd37 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:17.646588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07a0a2ea-8c7f-47a0-b647-cd402edcbd37 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:17.647386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07a0a2ea-8c7f-47a0-b647-cd402edcbd37 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:17.647819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07a0a2ea-8c7f-47a0-b647-cd402edcbd37 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:17.677308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ce53a751-d5b8-40ea-8bf6-29ba11eb970a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:17.690579 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ce53a751-d5b8-40ea-8bf6-29ba11eb970a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.558060 Feb 19 20:57:17.693295 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 842/1752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:17 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:17.709847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eb498f1e-a871-4edf-8bcd-cc0d6c29cc26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:17.710653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eb498f1e-a871-4edf-8bcd-cc0d6c29cc26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:17.721621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb498f1e-a871-4edf-8bcd-cc0d6c29cc26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:17.722970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb498f1e-a871-4edf-8bcd-cc0d6c29cc26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:17.727179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb498f1e-a871-4edf-8bcd-cc0d6c29cc26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:17.729647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb498f1e-a871-4edf-8bcd-cc0d6c29cc26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.103999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eb498f1e-a871-4edf-8bcd-cc0d6c29cc26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:18.111176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-07a0a2ea-8c7f-47a0-b647-cd402edcbd37 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:18.117710 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eb498f1e-a871-4edf-8bcd-cc0d6c29cc26 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1318 microversion: 2.1 time: 0.422285 Feb 19 20:57:18.119907 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 843/1753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:17 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:18.127699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d6521dd-d0e0-45bb-a22c-9a90b9d7ddb0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:18.128552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2d6521dd-d0e0-45bb-a22c-9a90b9d7ddb0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 87c91011-f731-4d80-b568-d970fcd46286] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:18.133139 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-07a0a2ea-8c7f-47a0-b647-cd402edcbd37 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1504 microversion: 2.1 time: 0.526350 Feb 19 20:57:18.134452 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 911/1754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:17 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:18.138996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a7889839-ae0c-4e7e-ac80-8ceab7144862 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:18.139798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a7889839-ae0c-4e7e-ac80-8ceab7144862 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:18.146406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d6521dd-d0e0-45bb-a22c-9a90b9d7ddb0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.147654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7889839-ae0c-4e7e-ac80-8ceab7144862 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.148317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7889839-ae0c-4e7e-ac80-8ceab7144862 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.148911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d6521dd-d0e0-45bb-a22c-9a90b9d7ddb0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.149501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7889839-ae0c-4e7e-ac80-8ceab7144862 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.150101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d6521dd-d0e0-45bb-a22c-9a90b9d7ddb0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.150253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7889839-ae0c-4e7e-ac80-8ceab7144862 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.151245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d6521dd-d0e0-45bb-a22c-9a90b9d7ddb0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.179122 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-2d6521dd-d0e0-45bb-a22c-9a90b9d7ddb0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] HTTP exception thrown: Instance 87c91011-f731-4d80-b568-d970fcd46286 could not be found. Feb 19 20:57:18.181514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d6521dd-d0e0-45bb-a22c-9a90b9d7ddb0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Returning 404 to user: Instance 87c91011-f731-4d80-b568-d970fcd46286 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:18.183253 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2d6521dd-d0e0-45bb-a22c-9a90b9d7ddb0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286" status: 404 len: 111 microversion: 2.1 time: 0.061783 Feb 19 20:57:18.184532 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 844/1755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:18 2022] GET /compute/v2.1/servers/87c91011-f731-4d80-b568-d970fcd46286 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:18.195029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ecc0b5ee-06fb-4eaf-aed7-f2ec7b677baf tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:18.195829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ecc0b5ee-06fb-4eaf-aed7-f2ec7b677baf tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:18.207639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ecc0b5ee-06fb-4eaf-aed7-f2ec7b677baf tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.208382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ecc0b5ee-06fb-4eaf-aed7-f2ec7b677baf tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.211081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ecc0b5ee-06fb-4eaf-aed7-f2ec7b677baf tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.212356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ecc0b5ee-06fb-4eaf-aed7-f2ec7b677baf tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.520761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a7889839-ae0c-4e7e-ac80-8ceab7144862 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:18.537490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ecc0b5ee-06fb-4eaf-aed7-f2ec7b677baf tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:18.539708 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a7889839-ae0c-4e7e-ac80-8ceab7144862 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.401562 Feb 19 20:57:18.546300 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ecc0b5ee-06fb-4eaf-aed7-f2ec7b677baf tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.360596 Feb 19 20:57:18.556530 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 912/1756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:18 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:18.557204 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 845/1757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:18 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:18.562345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-15c2b068-2344-4da6-ba6c-d4a82863ad06 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:18.563056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-15c2b068-2344-4da6-ba6c-d4a82863ad06 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:18.570306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15c2b068-2344-4da6-ba6c-d4a82863ad06 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.570772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15c2b068-2344-4da6-ba6c-d4a82863ad06 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.571577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15c2b068-2344-4da6-ba6c-d4a82863ad06 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.572020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15c2b068-2344-4da6-ba6c-d4a82863ad06 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.577013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a24fe823-b169-42ef-80b0-ae973b98c2f1 req-3c389ae1-e94f-421c-a15f-8ecb1d0f5888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f1f59f-19d3-4b89-873c-bc100187739c", "tag": "7b13225c-b3f5-46c0-a7ec-cecdc4f9a82a"}, {"name": "network-changed", "server_uuid": "3ce58dc5-cdde-4b6e-800d-95033c88b685", "tag": "ea4af430-5045-4885-a178-bea7b85b3f36"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:18.582170 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:18.582170 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:18.598808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-15c2b068-2344-4da6-ba6c-d4a82863ad06 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:18.615755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a24fe823-b169-42ef-80b0-ae973b98c2f1 req-3c389ae1-e94f-421c-a15f-8ecb1d0f5888 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.616780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a24fe823-b169-42ef-80b0-ae973b98c2f1 req-3c389ae1-e94f-421c-a15f-8ecb1d0f5888 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.652814 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a24fe823-b169-42ef-80b0-ae973b98c2f1 req-3c389ae1-e94f-421c-a15f-8ecb1d0f5888 service nova] Creating event network-changed:7b13225c-b3f5-46c0-a7ec-cecdc4f9a82a for instance e9f1f59f-19d3-4b89-873c-bc100187739c on nch1-master-1 Feb 19 20:57:18.658279 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a24fe823-b169-42ef-80b0-ae973b98c2f1 req-3c389ae1-e94f-421c-a15f-8ecb1d0f5888 service nova] Creating event network-changed:ea4af430-5045-4885-a178-bea7b85b3f36 for instance 3ce58dc5-cdde-4b6e-800d-95033c88b685 on nch2-master-1 Feb 19 20:57:18.669291 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a24fe823-b169-42ef-80b0-ae973b98c2f1 req-3c389ae1-e94f-421c-a15f-8ecb1d0f5888 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.113769 Feb 19 20:57:18.686908 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 913/1758] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:18.726978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-afe506b3-1ddf-44c4-862a-22067e682134 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:18.727944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-afe506b3-1ddf-44c4-862a-22067e682134 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:18.748823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afe506b3-1ddf-44c4-862a-22067e682134 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.750278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afe506b3-1ddf-44c4-862a-22067e682134 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.751812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afe506b3-1ddf-44c4-862a-22067e682134 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.752261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afe506b3-1ddf-44c4-862a-22067e682134 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.765204 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-15c2b068-2344-4da6-ba6c-d4a82863ad06 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 204 len: 0 microversion: 2.1 time: 0.206327 Feb 19 20:57:18.766246 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 846/1759] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:18 2022] DELETE /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:18.783313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fad5667a-c548-4efd-92ba-1d73b07ece7b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:18.784979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fad5667a-c548-4efd-92ba-1d73b07ece7b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:18.795526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fad5667a-c548-4efd-92ba-1d73b07ece7b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.797011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fad5667a-c548-4efd-92ba-1d73b07ece7b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:18.799050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fad5667a-c548-4efd-92ba-1d73b07ece7b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:18.799710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fad5667a-c548-4efd-92ba-1d73b07ece7b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.272932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fad5667a-c548-4efd-92ba-1d73b07ece7b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:19.276350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-afe506b3-1ddf-44c4-862a-22067e682134 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:19.280641 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fad5667a-c548-4efd-92ba-1d73b07ece7b tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1471 microversion: 2.1 time: 0.509344 Feb 19 20:57:19.284850 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-afe506b3-1ddf-44c4-862a-22067e682134 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.578375 Feb 19 20:57:19.285911 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 914/1760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:18 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:19.290507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e6c9f81-87ac-46dd-aaf2-256625e77839 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:19.291322 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 847/1761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:18 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1471 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:19.291478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e6c9f81-87ac-46dd-aaf2-256625e77839 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:19.296931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0939e79c-4937-4f77-9712-1511cc63c02f tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:19.297827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0939e79c-4937-4f77-9712-1511cc63c02f tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:19.304088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e6c9f81-87ac-46dd-aaf2-256625e77839 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.304578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e6c9f81-87ac-46dd-aaf2-256625e77839 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.305143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0939e79c-4937-4f77-9712-1511cc63c02f tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.305380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e6c9f81-87ac-46dd-aaf2-256625e77839 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.305609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0939e79c-4937-4f77-9712-1511cc63c02f tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.305822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e6c9f81-87ac-46dd-aaf2-256625e77839 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.306381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0939e79c-4937-4f77-9712-1511cc63c02f tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.306822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0939e79c-4937-4f77-9712-1511cc63c02f tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.643533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e6c9f81-87ac-46dd-aaf2-256625e77839 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:19.648784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0939e79c-4937-4f77-9712-1511cc63c02f tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:19.651144 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e6c9f81-87ac-46dd-aaf2-256625e77839 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1318 microversion: 2.1 time: 0.363865 Feb 19 20:57:19.651735 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 915/1762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:19 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:19.656451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-06d2b447-044d-4c9c-af61-de38c64c2611 req-dd2ba720-11a4-481b-8eb7-af6f87aa53e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c58f78c-bd41-4570-86ec-a9d3a898e1b4", "tag": "296aa138-ed01-4c5c-b1dd-57c160938115"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:19.656637 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0939e79c-4937-4f77-9712-1511cc63c02f tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1479 microversion: 2.1 time: 0.363800 Feb 19 20:57:19.660461 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 848/1763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:19 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1479 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:19.660594 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:19.660594 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:19.664252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ef6e402-e5af-411f-a2be-c4b59a4cdec0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:19.664907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ef6e402-e5af-411f-a2be-c4b59a4cdec0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:19.670527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-06d2b447-044d-4c9c-af61-de38c64c2611 req-dd2ba720-11a4-481b-8eb7-af6f87aa53e5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.670700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ef6e402-e5af-411f-a2be-c4b59a4cdec0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.671151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ef6e402-e5af-411f-a2be-c4b59a4cdec0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.671317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-06d2b447-044d-4c9c-af61-de38c64c2611 req-dd2ba720-11a4-481b-8eb7-af6f87aa53e5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.671940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ef6e402-e5af-411f-a2be-c4b59a4cdec0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.672416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ef6e402-e5af-411f-a2be-c4b59a4cdec0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.683296 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-06d2b447-044d-4c9c-af61-de38c64c2611 req-dd2ba720-11a4-481b-8eb7-af6f87aa53e5 service nova] Creating event network-changed:296aa138-ed01-4c5c-b1dd-57c160938115 for instance 0c58f78c-bd41-4570-86ec-a9d3a898e1b4 on nch2-master-1 Feb 19 20:57:19.688249 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-06d2b447-044d-4c9c-af61-de38c64c2611 req-dd2ba720-11a4-481b-8eb7-af6f87aa53e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035168 Feb 19 20:57:19.688862 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 916/1764] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:19.693947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a53bd320-6928-4037-8e1d-fe64bf6218ca tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:19.694560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a53bd320-6928-4037-8e1d-fe64bf6218ca tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:19.709699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a53bd320-6928-4037-8e1d-fe64bf6218ca tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.710459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a53bd320-6928-4037-8e1d-fe64bf6218ca tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.711342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a53bd320-6928-4037-8e1d-fe64bf6218ca tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.712130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a53bd320-6928-4037-8e1d-fe64bf6218ca tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.859997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ef6e402-e5af-411f-a2be-c4b59a4cdec0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:19.868754 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ef6e402-e5af-411f-a2be-c4b59a4cdec0 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.209927 Feb 19 20:57:19.869455 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 849/1765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:19 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:19.874154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-62deec92-3829-4999-a82c-749fe3512601 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '.version_select at 0x7f6467a84c10>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:19.875706 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:19.875706 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:19.877878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-62deec92-3829-4999-a82c-749fe3512601 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.878441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-62deec92-3829-4999-a82c-749fe3512601 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.886375 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-62deec92-3829-4999-a82c-749fe3512601 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.015848 Feb 19 20:57:19.887110 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 850/1766] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:57:19 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:19.898673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-92ba27b5-0b78-48a4-96fc-0600a8e085b6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:19.899214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-92ba27b5-0b78-48a4-96fc-0600a8e085b6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:19.905006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92ba27b5-0b78-48a4-96fc-0600a8e085b6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.905462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92ba27b5-0b78-48a4-96fc-0600a8e085b6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.906251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a53bd320-6928-4037-8e1d-fe64bf6218ca tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:19.906390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92ba27b5-0b78-48a4-96fc-0600a8e085b6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:19.906690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92ba27b5-0b78-48a4-96fc-0600a8e085b6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:19.915753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a53bd320-6928-4037-8e1d-fe64bf6218ca tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.225759 Feb 19 20:57:19.916436 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 917/1767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:19 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:20.050699 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-92ba27b5-0b78-48a4-96fc-0600a8e085b6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1630 microversion: 2.1 time: 0.155499 Feb 19 20:57:20.051276 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 851/1768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:19 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1630 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:20.155108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-376652942", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "38f0b579-c349-4313-af39-532bf5d625a7"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:20.207513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] validate_networks() for [('38f0b579-c349-4313-af39-532bf5d625a7', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:57:20.310153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-60292f12-2a70-4a24-8f3c-3f794b7005e0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:20.310772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-60292f12-2a70-4a24-8f3c-3f794b7005e0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:20.325425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-60292f12-2a70-4a24-8f3c-3f794b7005e0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.326156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-60292f12-2a70-4a24-8f3c-3f794b7005e0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.327114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-60292f12-2a70-4a24-8f3c-3f794b7005e0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.327800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-60292f12-2a70-4a24-8f3c-3f794b7005e0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.599900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-60292f12-2a70-4a24-8f3c-3f794b7005e0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:20.608203 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-60292f12-2a70-4a24-8f3c-3f794b7005e0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 200 len: 1471 microversion: 2.1 time: 0.308820 Feb 19 20:57:20.608925 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 852/1769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:20 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:20.614454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-80453408-a15a-4239-955b-58607d31bbfd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:20.615147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-80453408-a15a-4239-955b-58607d31bbfd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:20.623957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80453408-a15a-4239-955b-58607d31bbfd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.624451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80453408-a15a-4239-955b-58607d31bbfd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.625253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80453408-a15a-4239-955b-58607d31bbfd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.625842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80453408-a15a-4239-955b-58607d31bbfd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.801008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:57:20.802075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:57:20.802759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:57:20.803239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:57:20.803879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:57:20.813975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.814724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.815718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.816317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.833587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Getting quotas for project 63acbd462dfc418fab3fbeedccacb9c7. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:57:20.837833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Getting quotas for user 0d694f3e8da440a9a1cac8ca2de030e8 and project 63acbd462dfc418fab3fbeedccacb9c7. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:57:20.855449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:57:20.861208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:57:20.861406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-80453408-a15a-4239-955b-58607d31bbfd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:20.869534 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-80453408-a15a-4239-955b-58607d31bbfd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.259352 Feb 19 20:57:20.870112 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 853/1770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:20 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:20.884896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c4f07f41-0fdb-4bd6-a117-78e8d490af4d req-7f2bbe9d-b972-4a2f-9921-95a5bdecb3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d96133-519f-46d5-9906-ad66e66ae2df", "name": "network-vif-plugged", "status": "completed", "tag": "25ae9901-aabc-4527-88db-b493a2eaf496"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:20.886605 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:20.886605 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:20.894838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c4f07f41-0fdb-4bd6-a117-78e8d490af4d req-7f2bbe9d-b972-4a2f-9921-95a5bdecb3ea service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.895274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c4f07f41-0fdb-4bd6-a117-78e8d490af4d req-7f2bbe9d-b972-4a2f-9921-95a5bdecb3ea service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.907101 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c4f07f41-0fdb-4bd6-a117-78e8d490af4d req-7f2bbe9d-b972-4a2f-9921-95a5bdecb3ea service nova] Creating event network-vif-plugged:25ae9901-aabc-4527-88db-b493a2eaf496 for instance c6d96133-519f-46d5-9906-ad66e66ae2df on nch1-master-1 Feb 19 20:57:20.912616 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c4f07f41-0fdb-4bd6-a117-78e8d490af4d req-7f2bbe9d-b972-4a2f-9921-95a5bdecb3ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031120 Feb 19 20:57:20.913366 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 854/1771] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:20.918392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c6b502f-caa9-4cd7-9208-dec724de5902 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:20.919348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c6b502f-caa9-4cd7-9208-dec724de5902 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:20.928217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6b502f-caa9-4cd7-9208-dec724de5902 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.928983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6b502f-caa9-4cd7-9208-dec724de5902 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.930618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6b502f-caa9-4cd7-9208-dec724de5902 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.931376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6b502f-caa9-4cd7-9208-dec724de5902 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.932686 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-218f7cb7-7bb8-4287-93e9-f5f297ee9921 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779897 Feb 19 20:57:20.934674 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 918/1772] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:57:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:57:20.947907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c7a5b01a-5d3c-4ace-99e5-185cf6085ea4 req-3d4644ec-bdb1-49db-8208-75c0aa6406b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba0c692-3aec-4680-a3f6-e88127dd525d", "name": "network-vif-deleted", "tag": "f5cb9be2-7b1d-4cd2-91be-100fad1c21de"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:20.949987 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:20.949987 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:20.958885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c7a5b01a-5d3c-4ace-99e5-185cf6085ea4 req-3d4644ec-bdb1-49db-8208-75c0aa6406b6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:20.960964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c7a5b01a-5d3c-4ace-99e5-185cf6085ea4 req-3d4644ec-bdb1-49db-8208-75c0aa6406b6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:20.974588 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c7a5b01a-5d3c-4ace-99e5-185cf6085ea4 req-3d4644ec-bdb1-49db-8208-75c0aa6406b6 service nova] Creating event network-vif-deleted:f5cb9be2-7b1d-4cd2-91be-100fad1c21de for instance 4ba0c692-3aec-4680-a3f6-e88127dd525d on nch1-master-1 Feb 19 20:57:20.981506 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c7a5b01a-5d3c-4ace-99e5-185cf6085ea4 req-3d4644ec-bdb1-49db-8208-75c0aa6406b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044072 Feb 19 20:57:20.982767 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 919/1773] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:20.991598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c410b02-b017-4ed2-8289-21691a126a94 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:20.993482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c410b02-b017-4ed2-8289-21691a126a94 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:21.000701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c410b02-b017-4ed2-8289-21691a126a94 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.001955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c410b02-b017-4ed2-8289-21691a126a94 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.002961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c410b02-b017-4ed2-8289-21691a126a94 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.003708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c410b02-b017-4ed2-8289-21691a126a94 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.247770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c6b502f-caa9-4cd7-9208-dec724de5902 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:21.259386 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c6b502f-caa9-4cd7-9208-dec724de5902 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1318 microversion: 2.1 time: 0.344450 Feb 19 20:57:21.260154 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 855/1774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:20 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:21.266038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-974cdcdf-4082-4763-82ae-c90be51b991b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:21.268253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-974cdcdf-4082-4763-82ae-c90be51b991b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:21.281190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-974cdcdf-4082-4763-82ae-c90be51b991b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.283317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-974cdcdf-4082-4763-82ae-c90be51b991b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.285020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-974cdcdf-4082-4763-82ae-c90be51b991b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.285587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-974cdcdf-4082-4763-82ae-c90be51b991b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.327948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8c410b02-b017-4ed2-8289-21691a126a94 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:21.341212 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c410b02-b017-4ed2-8289-21691a126a94 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.356794 Feb 19 20:57:21.342224 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 920/1775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:20 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:21.358212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84fd2191-24db-4f70-9872-3a1695636375 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:21.359250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-84fd2191-24db-4f70-9872-3a1695636375 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:21.455359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84fd2191-24db-4f70-9872-3a1695636375 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:21.467435 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84fd2191-24db-4f70-9872-3a1695636375 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1210 microversion: 2.1 time: 0.123972 Feb 19 20:57:21.477274 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 921/1776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:21 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:21.531656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-974cdcdf-4082-4763-82ae-c90be51b991b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:21.542835 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-974cdcdf-4082-4763-82ae-c90be51b991b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.281496 Feb 19 20:57:21.543436 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 856/1777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:21 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:21.625389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ac6e0e63-8039-4860-bb28-0904c1cd8667 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:21.626018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ac6e0e63-8039-4860-bb28-0904c1cd8667 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4ba0c692-3aec-4680-a3f6-e88127dd525d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:21.632431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac6e0e63-8039-4860-bb28-0904c1cd8667 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.632885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac6e0e63-8039-4860-bb28-0904c1cd8667 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.633654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac6e0e63-8039-4860-bb28-0904c1cd8667 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.634083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac6e0e63-8039-4860-bb28-0904c1cd8667 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.650229 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ac6e0e63-8039-4860-bb28-0904c1cd8667 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] HTTP exception thrown: Instance 4ba0c692-3aec-4680-a3f6-e88127dd525d could not be found. Feb 19 20:57:21.650842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ac6e0e63-8039-4860-bb28-0904c1cd8667 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Returning 404 to user: Instance 4ba0c692-3aec-4680-a3f6-e88127dd525d could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:21.651663 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ac6e0e63-8039-4860-bb28-0904c1cd8667 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d" status: 404 len: 111 microversion: 2.1 time: 0.029913 Feb 19 20:57:21.652218 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 922/1778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:21 2022] GET /compute/v2.1/servers/4ba0c692-3aec-4680-a3f6-e88127dd525d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:57:21.660552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f651e9dc-325e-48ed-a293-3936cbc90b9e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:21.661047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f651e9dc-325e-48ed-a293-3936cbc90b9e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:21.667410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f651e9dc-325e-48ed-a293-3936cbc90b9e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.667869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f651e9dc-325e-48ed-a293-3936cbc90b9e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.668764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f651e9dc-325e-48ed-a293-3936cbc90b9e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.669201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f651e9dc-325e-48ed-a293-3936cbc90b9e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.696818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f651e9dc-325e-48ed-a293-3936cbc90b9e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:21.784416 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f651e9dc-325e-48ed-a293-3936cbc90b9e tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda" status: 204 len: 0 microversion: 2.1 time: 0.127196 Feb 19 20:57:21.785015 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 857/1779] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:21 2022] DELETE /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 20:57:21.792843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-09d5374e-f18f-4da4-992a-8232ca1dd538 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:21.793369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-09d5374e-f18f-4da4-992a-8232ca1dd538 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:21.800418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09d5374e-f18f-4da4-992a-8232ca1dd538 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.800866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09d5374e-f18f-4da4-992a-8232ca1dd538 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.801637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09d5374e-f18f-4da4-992a-8232ca1dd538 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.802175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09d5374e-f18f-4da4-992a-8232ca1dd538 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.827442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-09d5374e-f18f-4da4-992a-8232ca1dd538 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:21.887350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7c9c16b6-4a4a-41ba-91d5-13df4a6edf80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:21.888165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7c9c16b6-4a4a-41ba-91d5-13df4a6edf80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:21.894191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c9c16b6-4a4a-41ba-91d5-13df4a6edf80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.894676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c9c16b6-4a4a-41ba-91d5-13df4a6edf80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.895532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c9c16b6-4a4a-41ba-91d5-13df4a6edf80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.895892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c9c16b6-4a4a-41ba-91d5-13df4a6edf80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.900279 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-09d5374e-f18f-4da4-992a-8232ca1dd538 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 204 len: 0 microversion: 2.1 time: 0.110783 Feb 19 20:57:21.901212 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 923/1780] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:21 2022] DELETE /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 20:57:21.910242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e650d84d-4aa3-482c-a2f5-fc3d3b274391 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:21.910950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e650d84d-4aa3-482c-a2f5-fc3d3b274391 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:21.917801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e650d84d-4aa3-482c-a2f5-fc3d3b274391 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.918271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e650d84d-4aa3-482c-a2f5-fc3d3b274391 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:21.919060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e650d84d-4aa3-482c-a2f5-fc3d3b274391 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:21.919497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e650d84d-4aa3-482c-a2f5-fc3d3b274391 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:22.111653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e650d84d-4aa3-482c-a2f5-fc3d3b274391 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:22.115719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7c9c16b6-4a4a-41ba-91d5-13df4a6edf80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:22.119452 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e650d84d-4aa3-482c-a2f5-fc3d3b274391 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda" status: 200 len: 1474 microversion: 2.1 time: 0.213269 Feb 19 20:57:22.120050 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 924/1781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:21 2022] GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda => generated 1474 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:22.124705 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7c9c16b6-4a4a-41ba-91d5-13df4a6edf80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.241226 Feb 19 20:57:22.126026 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 858/1782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:21 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:22.276308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c7b43ec9-47c8-4c47-a1a3-0771cf328c87 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:22.277185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c7b43ec9-47c8-4c47-a1a3-0771cf328c87 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:22.284245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7b43ec9-47c8-4c47-a1a3-0771cf328c87 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:22.284739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7b43ec9-47c8-4c47-a1a3-0771cf328c87 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:22.285538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7b43ec9-47c8-4c47-a1a3-0771cf328c87 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:22.285981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7b43ec9-47c8-4c47-a1a3-0771cf328c87 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:22.358837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f7af026-94a6-4138-b2c7-94af921af5a3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:22.359812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f7af026-94a6-4138-b2c7-94af921af5a3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:22.368031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f7af026-94a6-4138-b2c7-94af921af5a3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:22.368916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f7af026-94a6-4138-b2c7-94af921af5a3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:22.370135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f7af026-94a6-4138-b2c7-94af921af5a3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:22.370743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f7af026-94a6-4138-b2c7-94af921af5a3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:22.479752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c7b43ec9-47c8-4c47-a1a3-0771cf328c87 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:22.486557 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c7b43ec9-47c8-4c47-a1a3-0771cf328c87 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1318 microversion: 2.1 time: 0.214023 Feb 19 20:57:22.496868 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 925/1783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:22 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:22.502361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-79562eda-16c7-4b30-b9f2-8764f9c07240 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:22.502979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-79562eda-16c7-4b30-b9f2-8764f9c07240 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:22.517996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79562eda-16c7-4b30-b9f2-8764f9c07240 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:22.518450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79562eda-16c7-4b30-b9f2-8764f9c07240 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:22.519253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79562eda-16c7-4b30-b9f2-8764f9c07240 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:22.519691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79562eda-16c7-4b30-b9f2-8764f9c07240 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:22.601195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-79562eda-16c7-4b30-b9f2-8764f9c07240 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:22.604302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9f7af026-94a6-4138-b2c7-94af921af5a3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:22.609297 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-79562eda-16c7-4b30-b9f2-8764f9c07240 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1268 microversion: 2.1 time: 0.111052 Feb 19 20:57:22.610044 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 926/1784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:22 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1268 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:22.615054 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f7af026-94a6-4138-b2c7-94af921af5a3 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.257181 Feb 19 20:57:22.615054 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 859/1785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:22 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:22.619091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff5a9ad8-31bc-44fc-bf2b-5dab2be01ca9 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:22.619865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff5a9ad8-31bc-44fc-bf2b-5dab2be01ca9 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:22.626772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff5a9ad8-31bc-44fc-bf2b-5dab2be01ca9 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:22.627225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff5a9ad8-31bc-44fc-bf2b-5dab2be01ca9 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:22.628408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff5a9ad8-31bc-44fc-bf2b-5dab2be01ca9 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:22.628796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff5a9ad8-31bc-44fc-bf2b-5dab2be01ca9 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:22.762349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ff5a9ad8-31bc-44fc-bf2b-5dab2be01ca9 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:22.770729 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff5a9ad8-31bc-44fc-bf2b-5dab2be01ca9 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.156862 Feb 19 20:57:22.771330 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 860/1786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:22 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:23.142122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-43cfa656-3ca0-4063-9f27-a47750eae7e4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:23.142691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-43cfa656-3ca0-4063-9f27-a47750eae7e4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:23.144906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-08883b92-f250-4500-beaa-e1307470b5be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:23.145525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08883b92-f250-4500-beaa-e1307470b5be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:23.149963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43cfa656-3ca0-4063-9f27-a47750eae7e4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.150412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43cfa656-3ca0-4063-9f27-a47750eae7e4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.151196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43cfa656-3ca0-4063-9f27-a47750eae7e4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.151626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43cfa656-3ca0-4063-9f27-a47750eae7e4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.152310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08883b92-f250-4500-beaa-e1307470b5be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.152801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08883b92-f250-4500-beaa-e1307470b5be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.153594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08883b92-f250-4500-beaa-e1307470b5be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.154028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08883b92-f250-4500-beaa-e1307470b5be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.370199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-43cfa656-3ca0-4063-9f27-a47750eae7e4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:23.373955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-08883b92-f250-4500-beaa-e1307470b5be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:23.378241 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-43cfa656-3ca0-4063-9f27-a47750eae7e4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.240110 Feb 19 20:57:23.378922 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 927/1787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:23 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:23.382244 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-08883b92-f250-4500-beaa-e1307470b5be tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda" status: 200 len: 1474 microversion: 2.1 time: 0.241642 Feb 19 20:57:23.383033 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 861/1788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:23 2022] GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda => generated 1474 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:23.503310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6ccd24a8-834d-456a-8f02-3fe05c5d2f7e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:23.504174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6ccd24a8-834d-456a-8f02-3fe05c5d2f7e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:23.510436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ccd24a8-834d-456a-8f02-3fe05c5d2f7e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.510659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ccd24a8-834d-456a-8f02-3fe05c5d2f7e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.511410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ccd24a8-834d-456a-8f02-3fe05c5d2f7e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.511953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ccd24a8-834d-456a-8f02-3fe05c5d2f7e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.628559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dbd58892-367c-4d6f-b265-6af655f17491 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:23.629404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dbd58892-367c-4d6f-b265-6af655f17491 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:23.635343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbd58892-367c-4d6f-b265-6af655f17491 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.636073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbd58892-367c-4d6f-b265-6af655f17491 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.637086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbd58892-367c-4d6f-b265-6af655f17491 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.637717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbd58892-367c-4d6f-b265-6af655f17491 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.777710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6ccd24a8-834d-456a-8f02-3fe05c5d2f7e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:23.800963 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6ccd24a8-834d-456a-8f02-3fe05c5d2f7e tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1507 microversion: 2.1 time: 0.301451 Feb 19 20:57:23.802170 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 928/1789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:23 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:23.809587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5debadad-7e11-4a7a-9d55-40513d3f2b6d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:23.815014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5debadad-7e11-4a7a-9d55-40513d3f2b6d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:23.821633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5debadad-7e11-4a7a-9d55-40513d3f2b6d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.822384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5debadad-7e11-4a7a-9d55-40513d3f2b6d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.823349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5debadad-7e11-4a7a-9d55-40513d3f2b6d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.824088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5debadad-7e11-4a7a-9d55-40513d3f2b6d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.970461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dbd58892-367c-4d6f-b265-6af655f17491 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:23.979017 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dbd58892-367c-4d6f-b265-6af655f17491 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1310 microversion: 2.1 time: 0.355811 Feb 19 20:57:23.980838 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 862/1790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:23 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1310 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:23.988736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5592899-dc18-4fbf-ac1e-3388f647847c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:23.989701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b5592899-dc18-4fbf-ac1e-3388f647847c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:23.995992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5592899-dc18-4fbf-ac1e-3388f647847c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.996849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5592899-dc18-4fbf-ac1e-3388f647847c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:23.997897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5592899-dc18-4fbf-ac1e-3388f647847c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:23.998567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5592899-dc18-4fbf-ac1e-3388f647847c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:24.511168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5debadad-7e11-4a7a-9d55-40513d3f2b6d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:24.519335 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5debadad-7e11-4a7a-9d55-40513d3f2b6d tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.715971 Feb 19 20:57:24.519904 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 929/1791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:23 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:24.531447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-54138e97-55fc-4ff9-bd39-4481e383ec29 req-365bb903-99d8-49df-9380-e2da61ac9016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b048357b-44b4-4c70-8ed5-96deddc7d40e", "tag": "59f45170-96d5-43f5-8368-d97e4afa51dc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:24.532975 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:24.532975 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:24.540067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-54138e97-55fc-4ff9-bd39-4481e383ec29 req-365bb903-99d8-49df-9380-e2da61ac9016 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:24.540541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-54138e97-55fc-4ff9-bd39-4481e383ec29 req-365bb903-99d8-49df-9380-e2da61ac9016 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:24.553059 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-54138e97-55fc-4ff9-bd39-4481e383ec29 req-365bb903-99d8-49df-9380-e2da61ac9016 service nova] Creating event network-changed:59f45170-96d5-43f5-8368-d97e4afa51dc for instance b048357b-44b4-4c70-8ed5-96deddc7d40e on nch1-master-1 Feb 19 20:57:24.558145 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-54138e97-55fc-4ff9-bd39-4481e383ec29 req-365bb903-99d8-49df-9380-e2da61ac9016 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037110 Feb 19 20:57:24.559039 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 930/1792] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:24.564389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-50dfd3d5-9135-4489-92a7-612f621f01b4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:24.565093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-50dfd3d5-9135-4489-92a7-612f621f01b4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:24.571186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50dfd3d5-9135-4489-92a7-612f621f01b4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:24.571640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50dfd3d5-9135-4489-92a7-612f621f01b4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:24.572462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50dfd3d5-9135-4489-92a7-612f621f01b4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:24.572901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50dfd3d5-9135-4489-92a7-612f621f01b4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:24.599948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b5592899-dc18-4fbf-ac1e-3388f647847c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:24.613989 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b5592899-dc18-4fbf-ac1e-3388f647847c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.631783 Feb 19 20:57:24.619451 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 863/1793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:23 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:24.624234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1751314a-bb4f-424a-a2a1-100282c86688 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:24.635090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1751314a-bb4f-424a-a2a1-100282c86688 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:24.651980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1751314a-bb4f-424a-a2a1-100282c86688 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:24.652505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1751314a-bb4f-424a-a2a1-100282c86688 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:24.653281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1751314a-bb4f-424a-a2a1-100282c86688 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:24.653784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1751314a-bb4f-424a-a2a1-100282c86688 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:24.874602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-50dfd3d5-9135-4489-92a7-612f621f01b4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:24.886886 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-50dfd3d5-9135-4489-92a7-612f621f01b4 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1507 microversion: 2.1 time: 0.326612 Feb 19 20:57:24.891179 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 931/1794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:24 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:24.902687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a592b25-9b37-4418-9575-6cb984dcd8c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:24.903987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a592b25-9b37-4418-9575-6cb984dcd8c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:24.913885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a592b25-9b37-4418-9575-6cb984dcd8c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:24.914667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a592b25-9b37-4418-9575-6cb984dcd8c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:24.915722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a592b25-9b37-4418-9575-6cb984dcd8c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:24.916413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a592b25-9b37-4418-9575-6cb984dcd8c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:24.983057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1751314a-bb4f-424a-a2a1-100282c86688 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:24.993093 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1751314a-bb4f-424a-a2a1-100282c86688 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.372436 Feb 19 20:57:24.994215 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 864/1795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:24 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:24.999425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6be954bf-cc36-4b58-a844-c59dec8d514b req-fa4638ec-a506-4630-8153-2c3962e44bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eee1ae54-f01f-41c1-811a-689b47b22890", "name": "network-vif-deleted", "tag": "6ad13ef7-c05f-4bdb-be33-195dad103115"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:25.001953 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:25.001953 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:25.009758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6be954bf-cc36-4b58-a844-c59dec8d514b req-fa4638ec-a506-4630-8153-2c3962e44bde service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.010476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6be954bf-cc36-4b58-a844-c59dec8d514b req-fa4638ec-a506-4630-8153-2c3962e44bde service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.042077 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6be954bf-cc36-4b58-a844-c59dec8d514b req-fa4638ec-a506-4630-8153-2c3962e44bde service nova] Creating event network-vif-deleted:6ad13ef7-c05f-4bdb-be33-195dad103115 for instance eee1ae54-f01f-41c1-811a-689b47b22890 on nch1-master-1 Feb 19 20:57:25.048543 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6be954bf-cc36-4b58-a844-c59dec8d514b req-fa4638ec-a506-4630-8153-2c3962e44bde service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052932 Feb 19 20:57:25.049790 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 865/1796] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:25.056476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-08f5783f-8866-4cbb-8358-00336eb4ecca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:25.059864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08f5783f-8866-4cbb-8358-00336eb4ecca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:25.067349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f5783f-8866-4cbb-8358-00336eb4ecca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.068032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f5783f-8866-4cbb-8358-00336eb4ecca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.068858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f5783f-8866-4cbb-8358-00336eb4ecca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.069478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f5783f-8866-4cbb-8358-00336eb4ecca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.146553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1a592b25-9b37-4418-9575-6cb984dcd8c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:25.149937 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-08f5783f-8866-4cbb-8358-00336eb4ecca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "PUT /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1079 microversion: 2.1 time: 0.098619 Feb 19 20:57:25.151799 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 866/1797] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 20:57:25 2022] PUT /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1079 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:25.158763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5721e9f5-8ac0-438e-aa54-bafb2b8b321b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:25.159940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5721e9f5-8ac0-438e-aa54-bafb2b8b321b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:25.167292 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1a592b25-9b37-4418-9575-6cb984dcd8c6 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda" status: 200 len: 1474 microversion: 2.1 time: 0.274711 Feb 19 20:57:25.168209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5721e9f5-8ac0-438e-aa54-bafb2b8b321b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.176362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 932/1798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:24 2022] GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda => generated 1474 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:25.176362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fba3793d-477b-4e30-b439-e43acedd0df1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:25.176362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fba3793d-477b-4e30-b439-e43acedd0df1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:25.178000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5721e9f5-8ac0-438e-aa54-bafb2b8b321b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.180640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5721e9f5-8ac0-438e-aa54-bafb2b8b321b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.181334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5721e9f5-8ac0-438e-aa54-bafb2b8b321b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.184823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fba3793d-477b-4e30-b439-e43acedd0df1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.185376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fba3793d-477b-4e30-b439-e43acedd0df1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.186291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fba3793d-477b-4e30-b439-e43acedd0df1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.186826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fba3793d-477b-4e30-b439-e43acedd0df1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.466082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5721e9f5-8ac0-438e-aa54-bafb2b8b321b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:25.476427 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5721e9f5-8ac0-438e-aa54-bafb2b8b321b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1310 microversion: 2.1 time: 0.323028 Feb 19 20:57:25.477290 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 867/1799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:25 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1310 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:25.495791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fba3793d-477b-4e30-b439-e43acedd0df1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:25.503110 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fba3793d-477b-4e30-b439-e43acedd0df1 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1505 microversion: 2.1 time: 0.332736 Feb 19 20:57:25.503691 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 933/1800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:25 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:25.518938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-30ced2fa-6194-40e3-af9e-44c6b1cc8429 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:25.519711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-30ced2fa-6194-40e3-af9e-44c6b1cc8429 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:25.526124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30ced2fa-6194-40e3-af9e-44c6b1cc8429 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.526820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30ced2fa-6194-40e3-af9e-44c6b1cc8429 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.527655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30ced2fa-6194-40e3-af9e-44c6b1cc8429 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.528090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30ced2fa-6194-40e3-af9e-44c6b1cc8429 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.536915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-80db91f2-1c2b-4c82-8fa1-ab507a814e41 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:25.537536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-80db91f2-1c2b-4c82-8fa1-ab507a814e41 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:25.543783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80db91f2-1c2b-4c82-8fa1-ab507a814e41 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.544302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80db91f2-1c2b-4c82-8fa1-ab507a814e41 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.545353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80db91f2-1c2b-4c82-8fa1-ab507a814e41 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.546007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80db91f2-1c2b-4c82-8fa1-ab507a814e41 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.756394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80db91f2-1c2b-4c82-8fa1-ab507a814e41 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:25.769397 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-80db91f2-1c2b-4c82-8fa1-ab507a814e41 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1486 microversion: 2.1 time: 0.237050 Feb 19 20:57:25.770244 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 934/1801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:25 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1486 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:25.776024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0ded387-d258-47bb-a564-f7c23ebfc40c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:25.777926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d0ded387-d258-47bb-a564-f7c23ebfc40c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:25.785901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0ded387-d258-47bb-a564-f7c23ebfc40c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.786691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0ded387-d258-47bb-a564-f7c23ebfc40c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.788545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0ded387-d258-47bb-a564-f7c23ebfc40c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.789259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0ded387-d258-47bb-a564-f7c23ebfc40c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.791054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-30ced2fa-6194-40e3-af9e-44c6b1cc8429 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:25.800760 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-30ced2fa-6194-40e3-af9e-44c6b1cc8429 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1505 microversion: 2.1 time: 0.285826 Feb 19 20:57:25.801624 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 868/1802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:25 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:25.818540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-02ae9f23-2dda-4759-ab1e-bc5f607582ce tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:25.819471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-02ae9f23-2dda-4759-ab1e-bc5f607582ce tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:25.826148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02ae9f23-2dda-4759-ab1e-bc5f607582ce tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.827015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02ae9f23-2dda-4759-ab1e-bc5f607582ce tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.827939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02ae9f23-2dda-4759-ab1e-bc5f607582ce tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.828654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02ae9f23-2dda-4759-ab1e-bc5f607582ce tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.906793 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-02ae9f23-2dda-4759-ab1e-bc5f607582ce tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "POST /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb/action" status: 202 len: 0 microversion: 2.1 time: 0.091912 Feb 19 20:57:25.907787 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 869/1803] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:57:25 2022] POST /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:57:25.916736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7bb1cc3b-d36d-4e98-aa59-e72714f0be29 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:25.918500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7bb1cc3b-d36d-4e98-aa59-e72714f0be29 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:25.927352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bb1cc3b-d36d-4e98-aa59-e72714f0be29 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.927892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bb1cc3b-d36d-4e98-aa59-e72714f0be29 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.928878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bb1cc3b-d36d-4e98-aa59-e72714f0be29 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.932551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bb1cc3b-d36d-4e98-aa59-e72714f0be29 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.942282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d0ded387-d258-47bb-a564-f7c23ebfc40c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:25.953934 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d0ded387-d258-47bb-a564-f7c23ebfc40c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.182335 Feb 19 20:57:25.955923 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 935/1804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:25 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:25.962181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e9d0ec6-3dc1-4cfd-a333-e4db696fb18f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:25.963126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5e9d0ec6-3dc1-4cfd-a333-e4db696fb18f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:25.970994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e9d0ec6-3dc1-4cfd-a333-e4db696fb18f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.971740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e9d0ec6-3dc1-4cfd-a333-e4db696fb18f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:25.973320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e9d0ec6-3dc1-4cfd-a333-e4db696fb18f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:25.974201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e9d0ec6-3dc1-4cfd-a333-e4db696fb18f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.055244 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7bb1cc3b-d36d-4e98-aa59-e72714f0be29 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "PUT /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1081 microversion: 2.1 time: 0.145916 Feb 19 20:57:26.056008 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 870/1805] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 20:57:25 2022] PUT /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1081 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:26.062996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2f2a3133-c81b-4b3f-89a9-68f564645877 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.064173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2f2a3133-c81b-4b3f-89a9-68f564645877 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.072429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f2a3133-c81b-4b3f-89a9-68f564645877 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.073267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f2a3133-c81b-4b3f-89a9-68f564645877 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.074623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f2a3133-c81b-4b3f-89a9-68f564645877 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.075442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f2a3133-c81b-4b3f-89a9-68f564645877 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.206259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e9d0ec6-3dc1-4cfd-a333-e4db696fb18f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:26.217708 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5e9d0ec6-3dc1-4cfd-a333-e4db696fb18f tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1494 microversion: 2.1 time: 0.259861 Feb 19 20:57:26.228853 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 936/1806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:25 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1494 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:26.228853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-724d8edd-6e42-4df3-901d-2e0493e12cb8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.228853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-724d8edd-6e42-4df3-901d-2e0493e12cb8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.237409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-724d8edd-6e42-4df3-901d-2e0493e12cb8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.237872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-724d8edd-6e42-4df3-901d-2e0493e12cb8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.238676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-724d8edd-6e42-4df3-901d-2e0493e12cb8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.239326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-724d8edd-6e42-4df3-901d-2e0493e12cb8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.362678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2f2a3133-c81b-4b3f-89a9-68f564645877 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:26.375817 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2f2a3133-c81b-4b3f-89a9-68f564645877 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.318841 Feb 19 20:57:26.377692 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 871/1807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:26 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:26.387187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f06afcd4-e6c9-4c7f-b39d-ed7c8efa2970 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.389238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f06afcd4-e6c9-4c7f-b39d-ed7c8efa2970 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: ebe6da6b-8db6-4c96-9df5-d5e74a151eda] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.403584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f06afcd4-e6c9-4c7f-b39d-ed7c8efa2970 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.404032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f06afcd4-e6c9-4c7f-b39d-ed7c8efa2970 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.408762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f06afcd4-e6c9-4c7f-b39d-ed7c8efa2970 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.409287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f06afcd4-e6c9-4c7f-b39d-ed7c8efa2970 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.431763 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f06afcd4-e6c9-4c7f-b39d-ed7c8efa2970 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] HTTP exception thrown: Instance ebe6da6b-8db6-4c96-9df5-d5e74a151eda could not be found. Feb 19 20:57:26.432927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f06afcd4-e6c9-4c7f-b39d-ed7c8efa2970 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Returning 404 to user: Instance ebe6da6b-8db6-4c96-9df5-d5e74a151eda could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:26.433752 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f06afcd4-e6c9-4c7f-b39d-ed7c8efa2970 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda" status: 404 len: 111 microversion: 2.1 time: 0.055113 Feb 19 20:57:26.434676 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 872/1808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:26 2022] GET /compute/v2.1/servers/ebe6da6b-8db6-4c96-9df5-d5e74a151eda => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:26.442513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9e096eae-6174-46c0-a33a-15240364edd0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.443269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9e096eae-6174-46c0-a33a-15240364edd0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: eee1ae54-f01f-41c1-811a-689b47b22890] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.450285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e096eae-6174-46c0-a33a-15240364edd0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.450858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e096eae-6174-46c0-a33a-15240364edd0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.451832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e096eae-6174-46c0-a33a-15240364edd0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.452372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e096eae-6174-46c0-a33a-15240364edd0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.473255 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9e096eae-6174-46c0-a33a-15240364edd0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] HTTP exception thrown: Instance eee1ae54-f01f-41c1-811a-689b47b22890 could not be found. Feb 19 20:57:26.473962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9e096eae-6174-46c0-a33a-15240364edd0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Returning 404 to user: Instance eee1ae54-f01f-41c1-811a-689b47b22890 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:26.474880 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9e096eae-6174-46c0-a33a-15240364edd0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890" status: 404 len: 111 microversion: 2.1 time: 0.035997 Feb 19 20:57:26.479094 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 873/1809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:26 2022] GET /compute/v2.1/servers/eee1ae54-f01f-41c1-811a-689b47b22890 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:26.485108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-37df411f-ba72-46f3-9756-6bb6233c3bfe tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.501884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-724d8edd-6e42-4df3-901d-2e0493e12cb8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:26.513572 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-724d8edd-6e42-4df3-901d-2e0493e12cb8 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1507 microversion: 2.1 time: 0.293314 Feb 19 20:57:26.514369 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 937/1810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:26 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:26.519781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f03bcc20-3cc5-4c4f-b05d-bff494f73a32 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.521179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f03bcc20-3cc5-4c4f-b05d-bff494f73a32 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.528957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f03bcc20-3cc5-4c4f-b05d-bff494f73a32 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.531104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f03bcc20-3cc5-4c4f-b05d-bff494f73a32 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.532832 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-37df411f-ba72-46f3-9756-6bb6233c3bfe tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/0263ea3c-24a8-4f5f-9169-9734e7c95978" status: 204 len: 0 microversion: 2.1 time: 0.051299 Feb 19 20:57:26.533492 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 874/1811] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 20:57:26 2022] DELETE /compute/v2.1/os-server-groups/0263ea3c-24a8-4f5f-9169-9734e7c95978 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:26.533827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f03bcc20-3cc5-4c4f-b05d-bff494f73a32 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.534540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f03bcc20-3cc5-4c4f-b05d-bff494f73a32 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.538313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e88ec066-0da2-467d-936f-a110415ed392 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.538928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e88ec066-0da2-467d-936f-a110415ed392 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.545663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e88ec066-0da2-467d-936f-a110415ed392 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.546186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e88ec066-0da2-467d-936f-a110415ed392 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.546982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e88ec066-0da2-467d-936f-a110415ed392 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.547425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e88ec066-0da2-467d-936f-a110415ed392 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.755360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f03bcc20-3cc5-4c4f-b05d-bff494f73a32 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:26.762090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e88ec066-0da2-467d-936f-a110415ed392 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:26.762624 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f03bcc20-3cc5-4c4f-b05d-bff494f73a32 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1310 microversion: 2.1 time: 0.247120 Feb 19 20:57:26.763201 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 938/1812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:26 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1310 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:26.768007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87b5a327-361d-4ad0-bdbb-7983707da730 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.768577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-87b5a327-361d-4ad0-bdbb-7983707da730 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.770926 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e88ec066-0da2-467d-936f-a110415ed392 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1507 microversion: 2.1 time: 0.236460 Feb 19 20:57:26.771496 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 875/1813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:26 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:26.774630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87b5a327-361d-4ad0-bdbb-7983707da730 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.775146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87b5a327-361d-4ad0-bdbb-7983707da730 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.775994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87b5a327-361d-4ad0-bdbb-7983707da730 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.776543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-99a6ff9e-1458-4a0b-891d-8678e7b1c336 req-763de682-3c2e-4a59-a250-3bbad7dfe8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe6da6b-8db6-4c96-9df5-d5e74a151eda", "name": "network-vif-deleted", "tag": "365ebc46-b2da-4491-a96e-331ee2fb5b8b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:26.776673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87b5a327-361d-4ad0-bdbb-7983707da730 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.777946 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:26.777946 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:26.784888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-99a6ff9e-1458-4a0b-891d-8678e7b1c336 req-763de682-3c2e-4a59-a250-3bbad7dfe8f3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.785374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-99a6ff9e-1458-4a0b-891d-8678e7b1c336 req-763de682-3c2e-4a59-a250-3bbad7dfe8f3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.796576 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-99a6ff9e-1458-4a0b-891d-8678e7b1c336 req-763de682-3c2e-4a59-a250-3bbad7dfe8f3 service nova] Creating event network-vif-deleted:365ebc46-b2da-4491-a96e-331ee2fb5b8b for instance ebe6da6b-8db6-4c96-9df5-d5e74a151eda on nch2-master-1 Feb 19 20:57:26.801293 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-99a6ff9e-1458-4a0b-891d-8678e7b1c336 req-763de682-3c2e-4a59-a250-3bbad7dfe8f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028733 Feb 19 20:57:26.801894 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 876/1814] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:26.804834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-87b5a327-361d-4ad0-bdbb-7983707da730 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:26.806637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f86e5a8-1d2f-40bb-b828-5c5638ac755c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.807462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f86e5a8-1d2f-40bb-b828-5c5638ac755c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.813835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f86e5a8-1d2f-40bb-b828-5c5638ac755c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.814286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f86e5a8-1d2f-40bb-b828-5c5638ac755c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.815060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f86e5a8-1d2f-40bb-b828-5c5638ac755c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.815491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f86e5a8-1d2f-40bb-b828-5c5638ac755c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.840627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f86e5a8-1d2f-40bb-b828-5c5638ac755c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:26.882660 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-87b5a327-361d-4ad0-bdbb-7983707da730 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 204 len: 0 microversion: 2.1 time: 0.117998 Feb 19 20:57:26.883389 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 939/1815] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:26 2022] DELETE /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:26.893092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e66194a4-8af8-4b5e-abeb-da7dee9d4e58 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.893699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e66194a4-8af8-4b5e-abeb-da7dee9d4e58 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.899811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e66194a4-8af8-4b5e-abeb-da7dee9d4e58 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.900253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e66194a4-8af8-4b5e-abeb-da7dee9d4e58 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.901112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e66194a4-8af8-4b5e-abeb-da7dee9d4e58 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.901554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e66194a4-8af8-4b5e-abeb-da7dee9d4e58 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.917749 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f86e5a8-1d2f-40bb-b828-5c5638ac755c tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 204 len: 0 microversion: 2.1 time: 0.114421 Feb 19 20:57:26.918413 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 877/1816] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:26 2022] DELETE /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:26.930862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cf9bc658-8ae9-4ca7-8f47-544068eef2f3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:26.931541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cf9bc658-8ae9-4ca7-8f47-544068eef2f3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:26.937676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e66194a4-8af8-4b5e-abeb-da7dee9d4e58 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:26.939526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf9bc658-8ae9-4ca7-8f47-544068eef2f3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.940063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf9bc658-8ae9-4ca7-8f47-544068eef2f3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.941496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf9bc658-8ae9-4ca7-8f47-544068eef2f3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:26.941496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf9bc658-8ae9-4ca7-8f47-544068eef2f3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:26.967395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cf9bc658-8ae9-4ca7-8f47-544068eef2f3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:27.018619 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.compute.api [None req-cf9bc658-8ae9-4ca7-8f47-544068eef2f3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Instance is already in deleting state, ignoring this request Feb 19 20:57:27.019489 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cf9bc658-8ae9-4ca7-8f47-544068eef2f3 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 204 len: 0 microversion: 2.1 time: 0.092783 Feb 19 20:57:27.020266 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 878/1817] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:26 2022] DELETE /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:27.024092 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e66194a4-8af8-4b5e-abeb-da7dee9d4e58 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 204 len: 0 microversion: 2.1 time: 0.135539 Feb 19 20:57:27.025025 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 940/1818] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:26 2022] DELETE /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 20:57:27.029420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-35fe95d8-c471-40d8-a76b-aa4cc2db768e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:27.030049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-35fe95d8-c471-40d8-a76b-aa4cc2db768e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:27.033122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9aa73c63-3747-45ce-9674-5f6d17add518 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:27.033886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9aa73c63-3747-45ce-9674-5f6d17add518 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:27.036553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35fe95d8-c471-40d8-a76b-aa4cc2db768e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.036911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35fe95d8-c471-40d8-a76b-aa4cc2db768e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.037754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35fe95d8-c471-40d8-a76b-aa4cc2db768e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.038260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35fe95d8-c471-40d8-a76b-aa4cc2db768e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.041356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9aa73c63-3747-45ce-9674-5f6d17add518 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.043297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9aa73c63-3747-45ce-9674-5f6d17add518 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.043297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9aa73c63-3747-45ce-9674-5f6d17add518 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.043297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9aa73c63-3747-45ce-9674-5f6d17add518 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.251974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9aa73c63-3747-45ce-9674-5f6d17add518 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:27.258854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-35fe95d8-c471-40d8-a76b-aa4cc2db768e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:27.259482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9aa73c63-3747-45ce-9674-5f6d17add518 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1513 microversion: 2.1 time: 0.233262 Feb 19 20:57:27.260066 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 941/1819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:27 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:27.269585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-72f4601c-af34-4bd1-994f-454f395c9f47 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:27.269585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-72f4601c-af34-4bd1-994f-454f395c9f47 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:27.269810 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-35fe95d8-c471-40d8-a76b-aa4cc2db768e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.242366 Feb 19 20:57:27.269810 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 879/1820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:27 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:27.271596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72f4601c-af34-4bd1-994f-454f395c9f47 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.271936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e79b6b05-b3fe-4d14-bcf7-d917d7a7ca82 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:27.272045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72f4601c-af34-4bd1-994f-454f395c9f47 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.272797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e79b6b05-b3fe-4d14-bcf7-d917d7a7ca82 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:27.272915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72f4601c-af34-4bd1-994f-454f395c9f47 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.273268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72f4601c-af34-4bd1-994f-454f395c9f47 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.278647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e79b6b05-b3fe-4d14-bcf7-d917d7a7ca82 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.279185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e79b6b05-b3fe-4d14-bcf7-d917d7a7ca82 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.280023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e79b6b05-b3fe-4d14-bcf7-d917d7a7ca82 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.280556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e79b6b05-b3fe-4d14-bcf7-d917d7a7ca82 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.475828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-72f4601c-af34-4bd1-994f-454f395c9f47 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:27.482801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e79b6b05-b3fe-4d14-bcf7-d917d7a7ca82 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:27.483443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-72f4601c-af34-4bd1-994f-454f395c9f47 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1475 microversion: 2.1 time: 0.222357 Feb 19 20:57:27.484032 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 942/1821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:27 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1475 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:27.488930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b86c0865-b513-42d4-9521-265123409389 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:27.489525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b86c0865-b513-42d4-9521-265123409389 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:27.490723 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e79b6b05-b3fe-4d14-bcf7-d917d7a7ca82 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1494 microversion: 2.1 time: 0.222235 Feb 19 20:57:27.492713 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 880/1822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:27 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1494 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:27.495181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b86c0865-b513-42d4-9521-265123409389 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.495620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b86c0865-b513-42d4-9521-265123409389 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.496410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b86c0865-b513-42d4-9521-265123409389 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.496840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b86c0865-b513-42d4-9521-265123409389 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.628561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b86c0865-b513-42d4-9521-265123409389 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:27.635890 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b86c0865-b513-42d4-9521-265123409389 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.150875 Feb 19 20:57:27.636484 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 943/1823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:27 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:27.779922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0cb7d51b-df3a-4de1-bef5-1050a5d40941 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:27.780631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0cb7d51b-df3a-4de1-bef5-1050a5d40941 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:27.787645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cb7d51b-df3a-4de1-bef5-1050a5d40941 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.788097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cb7d51b-df3a-4de1-bef5-1050a5d40941 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.788895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cb7d51b-df3a-4de1-bef5-1050a5d40941 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:27.789330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cb7d51b-df3a-4de1-bef5-1050a5d40941 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:27.923934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0cb7d51b-df3a-4de1-bef5-1050a5d40941 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:27.931153 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0cb7d51b-df3a-4de1-bef5-1050a5d40941 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1310 microversion: 2.1 time: 0.154898 Feb 19 20:57:27.931724 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 881/1824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:27 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1310 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:28.276980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-30151f9d-b7f8-469e-bd41-70eba480b9ee tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:28.277749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30151f9d-b7f8-469e-bd41-70eba480b9ee tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:28.283031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9be0de85-5b87-4246-82ba-6d2130da980b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:28.283666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9be0de85-5b87-4246-82ba-6d2130da980b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:28.284962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30151f9d-b7f8-469e-bd41-70eba480b9ee tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.285512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30151f9d-b7f8-469e-bd41-70eba480b9ee tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.286421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30151f9d-b7f8-469e-bd41-70eba480b9ee tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.287230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30151f9d-b7f8-469e-bd41-70eba480b9ee tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.290338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9be0de85-5b87-4246-82ba-6d2130da980b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.290790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9be0de85-5b87-4246-82ba-6d2130da980b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.291579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9be0de85-5b87-4246-82ba-6d2130da980b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.292044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9be0de85-5b87-4246-82ba-6d2130da980b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.490482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-30151f9d-b7f8-469e-bd41-70eba480b9ee tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:28.497937 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-30151f9d-b7f8-469e-bd41-70eba480b9ee tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1513 microversion: 2.1 time: 0.224643 Feb 19 20:57:28.498616 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 944/1825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:28 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:28.503609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c896de66-8ab1-4046-bbbc-eae8a30210e8 req-611c0bfb-2b8c-472c-91a8-1ba25b026df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b048357b-44b4-4c70-8ed5-96deddc7d40e", "name": "network-vif-plugged", "status": "completed", "tag": "59f45170-96d5-43f5-8368-d97e4afa51dc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:28.505275 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:28.505275 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:28.512094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c896de66-8ab1-4046-bbbc-eae8a30210e8 req-611c0bfb-2b8c-472c-91a8-1ba25b026df1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.512632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c896de66-8ab1-4046-bbbc-eae8a30210e8 req-611c0bfb-2b8c-472c-91a8-1ba25b026df1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.513455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9be0de85-5b87-4246-82ba-6d2130da980b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:28.520810 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9be0de85-5b87-4246-82ba-6d2130da980b tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.241459 Feb 19 20:57:28.521387 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 882/1826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:28 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:28.523666 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c896de66-8ab1-4046-bbbc-eae8a30210e8 req-611c0bfb-2b8c-472c-91a8-1ba25b026df1 service nova] Creating event network-vif-plugged:59f45170-96d5-43f5-8368-d97e4afa51dc for instance b048357b-44b4-4c70-8ed5-96deddc7d40e on nch1-master-1 Feb 19 20:57:28.525563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-efe4fe53-4d94-4586-8478-f18a04cbb5c2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:28.526160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-efe4fe53-4d94-4586-8478-f18a04cbb5c2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:28.528686 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c896de66-8ab1-4046-bbbc-eae8a30210e8 req-611c0bfb-2b8c-472c-91a8-1ba25b026df1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028934 Feb 19 20:57:28.529681 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 945/1827] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:28.532840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efe4fe53-4d94-4586-8478-f18a04cbb5c2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.533304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efe4fe53-4d94-4586-8478-f18a04cbb5c2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.534077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efe4fe53-4d94-4586-8478-f18a04cbb5c2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.534530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efe4fe53-4d94-4586-8478-f18a04cbb5c2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.534843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dcc8537c-c400-41b8-a180-4ef1f649821a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:28.535679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dcc8537c-c400-41b8-a180-4ef1f649821a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:28.541650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcc8537c-c400-41b8-a180-4ef1f649821a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.542183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcc8537c-c400-41b8-a180-4ef1f649821a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.543020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcc8537c-c400-41b8-a180-4ef1f649821a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.543521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcc8537c-c400-41b8-a180-4ef1f649821a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.827054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-efe4fe53-4d94-4586-8478-f18a04cbb5c2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:28.827952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dcc8537c-c400-41b8-a180-4ef1f649821a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:28.838952 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-efe4fe53-4d94-4586-8478-f18a04cbb5c2 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1475 microversion: 2.1 time: 0.316540 Feb 19 20:57:28.839403 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dcc8537c-c400-41b8-a180-4ef1f649821a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1494 microversion: 2.1 time: 0.308266 Feb 19 20:57:28.839549 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 883/1828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:28 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1475 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:28.849502 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 946/1829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:28 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1494 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:28.853355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cd95f028-2138-48b1-9f1e-bad89144929b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:28.854006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cd95f028-2138-48b1-9f1e-bad89144929b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:28.860000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd95f028-2138-48b1-9f1e-bad89144929b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.861079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd95f028-2138-48b1-9f1e-bad89144929b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.861870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd95f028-2138-48b1-9f1e-bad89144929b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.862312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd95f028-2138-48b1-9f1e-bad89144929b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.947923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27ddf543-eaa9-45e0-8492-ea0d75f87c16 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:28.948574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-27ddf543-eaa9-45e0-8492-ea0d75f87c16 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:28.955631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27ddf543-eaa9-45e0-8492-ea0d75f87c16 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.955631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27ddf543-eaa9-45e0-8492-ea0d75f87c16 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:28.956455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27ddf543-eaa9-45e0-8492-ea0d75f87c16 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:28.956932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27ddf543-eaa9-45e0-8492-ea0d75f87c16 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.033981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cd95f028-2138-48b1-9f1e-bad89144929b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:29.041891 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cd95f028-2138-48b1-9f1e-bad89144929b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.201284 Feb 19 20:57:29.042936 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 884/1830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:28 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:29.138753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-27ddf543-eaa9-45e0-8492-ea0d75f87c16 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:29.147386 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-27ddf543-eaa9-45e0-8492-ea0d75f87c16 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1310 microversion: 2.1 time: 0.202969 Feb 19 20:57:29.148235 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 947/1831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:28 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1310 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:29.239368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5482a0f5-2d6d-43ea-bf34-d6d76ae60559 req-f539ad92-7a4f-49cb-87a6-30383eeedbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d96133-519f-46d5-9906-ad66e66ae2df", "name": "network-vif-deleted", "tag": "25ae9901-aabc-4527-88db-b493a2eaf496"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:29.241294 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:29.241294 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:29.248556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5482a0f5-2d6d-43ea-bf34-d6d76ae60559 req-f539ad92-7a4f-49cb-87a6-30383eeedbd3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.249262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5482a0f5-2d6d-43ea-bf34-d6d76ae60559 req-f539ad92-7a4f-49cb-87a6-30383eeedbd3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.263103 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5482a0f5-2d6d-43ea-bf34-d6d76ae60559 req-f539ad92-7a4f-49cb-87a6-30383eeedbd3 service nova] Creating event network-vif-deleted:25ae9901-aabc-4527-88db-b493a2eaf496 for instance c6d96133-519f-46d5-9906-ad66e66ae2df on nch1-master-1 Feb 19 20:57:29.269465 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5482a0f5-2d6d-43ea-bf34-d6d76ae60559 req-f539ad92-7a4f-49cb-87a6-30383eeedbd3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033571 Feb 19 20:57:29.270344 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 885/1832] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:29.515820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:29.516980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:29.524170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.525718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.526828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.527593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.539372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76d625c0-5f59-45a2-8874-c655381c1575 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:29.540177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-76d625c0-5f59-45a2-8874-c655381c1575 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:29.548540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d625c0-5f59-45a2-8874-c655381c1575 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.549155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d625c0-5f59-45a2-8874-c655381c1575 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.550244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d625c0-5f59-45a2-8874-c655381c1575 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.550911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d625c0-5f59-45a2-8874-c655381c1575 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.573969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.574425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.574890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lazy-loading 'fault' on Instance uuid c6d96133-519f-46d5-9906-ad66e66ae2df {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:57:29.668449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc221761620472ea3cd887988f9f2c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808305a45737485185adcb60012ea91a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:29.681153 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c7b9cf7-1010-4524-84c2-756bbac1b86f tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 200 len: 1308 microversion: 2.1 time: 0.170018 Feb 19 20:57:29.685344 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 948/1833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:29 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:29.750051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c4ddfab9-0b53-4c8f-9d1b-26269886dcee req-d01f7fbb-7b29-403e-abff-ebdf3feb8102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1eb520e-c397-4539-b786-0e315ff274b7", "name": "network-vif-deleted", "tag": "d61fad0a-c589-4682-9531-d1e1afc31551"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:29.752254 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:29.752254 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:29.772108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c4ddfab9-0b53-4c8f-9d1b-26269886dcee req-d01f7fbb-7b29-403e-abff-ebdf3feb8102 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.773334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c4ddfab9-0b53-4c8f-9d1b-26269886dcee req-d01f7fbb-7b29-403e-abff-ebdf3feb8102 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.803972 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c4ddfab9-0b53-4c8f-9d1b-26269886dcee req-d01f7fbb-7b29-403e-abff-ebdf3feb8102 service nova] Creating event network-vif-deleted:d61fad0a-c589-4682-9531-d1e1afc31551 for instance f1eb520e-c397-4539-b786-0e315ff274b7 on nch2-master-1 Feb 19 20:57:29.813906 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c4ddfab9-0b53-4c8f-9d1b-26269886dcee req-d01f7fbb-7b29-403e-abff-ebdf3feb8102 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068210 Feb 19 20:57:29.816249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 949/1834] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:29.849431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-76d625c0-5f59-45a2-8874-c655381c1575 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:29.858311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f66a225f-5b7f-4b95-b5d4-af6de875d861 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:29.859290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f66a225f-5b7f-4b95-b5d4-af6de875d861 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:29.861322 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-76d625c0-5f59-45a2-8874-c655381c1575 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.324935 Feb 19 20:57:29.862757 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 886/1835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:29 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:29.868390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:29.869315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:29.870139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f66a225f-5b7f-4b95-b5d4-af6de875d861 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.870599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f66a225f-5b7f-4b95-b5d4-af6de875d861 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.871712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f66a225f-5b7f-4b95-b5d4-af6de875d861 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.872152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f66a225f-5b7f-4b95-b5d4-af6de875d861 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.878857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.879796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.881628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.882374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.927879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:29.928956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:29.929736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lazy-loading 'fault' on Instance uuid 688a015d-1d10-44c7-b358-4d2cbe080bc2 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:57:30.061084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:30.080310 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-38f1fdc2-04ef-453a-874b-63ba05037d39 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 200 len: 1309 microversion: 2.1 time: 0.215583 Feb 19 20:57:30.081782 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 887/1836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:29 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 1309 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:30.088022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cfb96f0c-f1ac-4a8d-81e3-2bfc43969b9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.088669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cfb96f0c-f1ac-4a8d-81e3-2bfc43969b9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:30.126536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfb96f0c-f1ac-4a8d-81e3-2bfc43969b9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.127126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfb96f0c-f1ac-4a8d-81e3-2bfc43969b9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.129238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfb96f0c-f1ac-4a8d-81e3-2bfc43969b9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.130276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfb96f0c-f1ac-4a8d-81e3-2bfc43969b9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.167114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f66a225f-5b7f-4b95-b5d4-af6de875d861 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:30.178374 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f66a225f-5b7f-4b95-b5d4-af6de875d861 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1494 microversion: 2.1 time: 0.325119 Feb 19 20:57:30.179476 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 950/1837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:29 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1494 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:30.184742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8df64419-39e4-4ed2-ae0c-c1ae6802500c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.185399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8df64419-39e4-4ed2-ae0c-c1ae6802500c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:30.195298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8df64419-39e4-4ed2-ae0c-c1ae6802500c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.196977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8df64419-39e4-4ed2-ae0c-c1ae6802500c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.198148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8df64419-39e4-4ed2-ae0c-c1ae6802500c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.198835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8df64419-39e4-4ed2-ae0c-c1ae6802500c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.380446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cfb96f0c-f1ac-4a8d-81e3-2bfc43969b9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:30.390524 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cfb96f0c-f1ac-4a8d-81e3-2bfc43969b9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.307487 Feb 19 20:57:30.392059 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 888/1838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:30 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:30.406013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8df64419-39e4-4ed2-ae0c-c1ae6802500c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:30.414242 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8df64419-39e4-4ed2-ae0c-c1ae6802500c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1493 microversion: 2.1 time: 0.233517 Feb 19 20:57:30.415190 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 951/1839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:30 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1493 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:30.432734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-94b21ad8-0d7f-4ab4-a70b-eab6762625f0 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.433819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-94b21ad8-0d7f-4ab4-a70b-eab6762625f0 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:30.441013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94b21ad8-0d7f-4ab4-a70b-eab6762625f0 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.441494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94b21ad8-0d7f-4ab4-a70b-eab6762625f0 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.442520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94b21ad8-0d7f-4ab4-a70b-eab6762625f0 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.442974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94b21ad8-0d7f-4ab4-a70b-eab6762625f0 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.546436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ad5be528-7eb4-472a-9622-36a5d3b2a9cf req-08d6764d-0dfc-483e-bcce-2c253258779e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce58dc5-cdde-4b6e-800d-95033c88b685", "name": "network-vif-plugged", "status": "completed", "tag": "ea4af430-5045-4885-a178-bea7b85b3f36"}, {"server_uuid": "0c58f78c-bd41-4570-86ec-a9d3a898e1b4", "name": "network-vif-plugged", "status": "completed", "tag": "296aa138-ed01-4c5c-b1dd-57c160938115"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:30.548797 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:30.548797 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:30.561889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ad5be528-7eb4-472a-9622-36a5d3b2a9cf req-08d6764d-0dfc-483e-bcce-2c253258779e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.562341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ad5be528-7eb4-472a-9622-36a5d3b2a9cf req-08d6764d-0dfc-483e-bcce-2c253258779e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.575708 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ad5be528-7eb4-472a-9622-36a5d3b2a9cf req-08d6764d-0dfc-483e-bcce-2c253258779e service nova] Creating event network-vif-plugged:ea4af430-5045-4885-a178-bea7b85b3f36 for instance 3ce58dc5-cdde-4b6e-800d-95033c88b685 on nch2-master-1 Feb 19 20:57:30.576219 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ad5be528-7eb4-472a-9622-36a5d3b2a9cf req-08d6764d-0dfc-483e-bcce-2c253258779e service nova] Creating event network-vif-plugged:296aa138-ed01-4c5c-b1dd-57c160938115 for instance 0c58f78c-bd41-4570-86ec-a9d3a898e1b4 on nch2-master-1 Feb 19 20:57:30.582632 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ad5be528-7eb4-472a-9622-36a5d3b2a9cf req-08d6764d-0dfc-483e-bcce-2c253258779e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039944 Feb 19 20:57:30.583252 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 952/1840] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:57:30.616256 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-94b21ad8-0d7f-4ab4-a70b-eab6762625f0 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1644 microversion: 2.1 time: 0.188977 Feb 19 20:57:30.616946 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 889/1841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:30 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1644 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:30.632716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bbee48c7-bc50-4bd8-88e2-8bf882474f8f tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.634092 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:30.634092 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:30.635667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bbee48c7-bc50-4bd8-88e2-8bf882474f8f tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.636122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bbee48c7-bc50-4bd8-88e2-8bf882474f8f tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.636965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bbee48c7-bc50-4bd8-88e2-8bf882474f8f tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.637397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bbee48c7-bc50-4bd8-88e2-8bf882474f8f tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.661329 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bbee48c7-bc50-4bd8-88e2-8bf882474f8f tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.032662 Feb 19 20:57:30.661942 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 953/1842] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Feb 19 20:57:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:30.701508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6bc4ddbf-5b34-4f86-9f11-fdb9e37b7fda tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.702198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6bc4ddbf-5b34-4f86-9f11-fdb9e37b7fda tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c6d96133-519f-46d5-9906-ad66e66ae2df] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:30.710187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6bc4ddbf-5b34-4f86-9f11-fdb9e37b7fda tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.711826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6bc4ddbf-5b34-4f86-9f11-fdb9e37b7fda tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.712896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6bc4ddbf-5b34-4f86-9f11-fdb9e37b7fda tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.713444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6bc4ddbf-5b34-4f86-9f11-fdb9e37b7fda tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.733314 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-6bc4ddbf-5b34-4f86-9f11-fdb9e37b7fda tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] HTTP exception thrown: Instance c6d96133-519f-46d5-9906-ad66e66ae2df could not be found. Feb 19 20:57:30.733963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6bc4ddbf-5b34-4f86-9f11-fdb9e37b7fda tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Returning 404 to user: Instance c6d96133-519f-46d5-9906-ad66e66ae2df could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:30.734904 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6bc4ddbf-5b34-4f86-9f11-fdb9e37b7fda tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df" status: 404 len: 111 microversion: 2.1 time: 0.037379 Feb 19 20:57:30.735418 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 890/1843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:30 2022] GET /compute/v2.1/servers/c6d96133-519f-46d5-9906-ad66e66ae2df => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:30.743567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-02873c55-2483-4575-b16a-0da65043a6ca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.744619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-02873c55-2483-4575-b16a-0da65043a6ca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:30.753766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-02873c55-2483-4575-b16a-0da65043a6ca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.754219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-02873c55-2483-4575-b16a-0da65043a6ca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.759868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-02873c55-2483-4575-b16a-0da65043a6ca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.761543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-02873c55-2483-4575-b16a-0da65043a6ca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.783604 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-02873c55-2483-4575-b16a-0da65043a6ca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] HTTP exception thrown: Instance c0ece57c-a579-45c4-82fb-74b6ed0363e1 could not be found. Feb 19 20:57:30.784204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-02873c55-2483-4575-b16a-0da65043a6ca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Returning 404 to user: Instance c0ece57c-a579-45c4-82fb-74b6ed0363e1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:30.785082 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-02873c55-2483-4575-b16a-0da65043a6ca tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 404 len: 111 microversion: 2.1 time: 0.045299 Feb 19 20:57:30.786046 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 954/1844] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:30 2022] DELETE /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:30.794683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-de704222-7d98-454e-8e89-d92794224a4b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.795300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-de704222-7d98-454e-8e89-d92794224a4b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: c0ece57c-a579-45c4-82fb-74b6ed0363e1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:30.801390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de704222-7d98-454e-8e89-d92794224a4b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.801837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de704222-7d98-454e-8e89-d92794224a4b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.802622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de704222-7d98-454e-8e89-d92794224a4b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.803070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de704222-7d98-454e-8e89-d92794224a4b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.816840 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-de704222-7d98-454e-8e89-d92794224a4b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] HTTP exception thrown: Instance c0ece57c-a579-45c4-82fb-74b6ed0363e1 could not be found. Feb 19 20:57:30.817455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-de704222-7d98-454e-8e89-d92794224a4b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Returning 404 to user: Instance c0ece57c-a579-45c4-82fb-74b6ed0363e1 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:30.818300 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-de704222-7d98-454e-8e89-d92794224a4b tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1" status: 404 len: 111 microversion: 2.1 time: 0.028222 Feb 19 20:57:30.818828 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 891/1845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:30 2022] GET /compute/v2.1/servers/c0ece57c-a579-45c4-82fb-74b6ed0363e1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:30.826656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3681afdf-e4bd-409f-b6d2-be11237504c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.827180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3681afdf-e4bd-409f-b6d2-be11237504c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:30.833616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3681afdf-e4bd-409f-b6d2-be11237504c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.834095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3681afdf-e4bd-409f-b6d2-be11237504c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.834956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3681afdf-e4bd-409f-b6d2-be11237504c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.835338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3681afdf-e4bd-409f-b6d2-be11237504c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.849360 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-3681afdf-e4bd-409f-b6d2-be11237504c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] HTTP exception thrown: Instance 1343027f-776d-4868-a38a-15e285438dd6 could not be found. Feb 19 20:57:30.849975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3681afdf-e4bd-409f-b6d2-be11237504c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Returning 404 to user: Instance 1343027f-776d-4868-a38a-15e285438dd6 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:30.850790 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3681afdf-e4bd-409f-b6d2-be11237504c6 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 404 len: 111 microversion: 2.1 time: 0.027824 Feb 19 20:57:30.851337 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 955/1846] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:30 2022] DELETE /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:30.859027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9528f7f0-e973-4001-bb4f-1050d142ea99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.859723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9528f7f0-e973-4001-bb4f-1050d142ea99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] [instance: 1343027f-776d-4868-a38a-15e285438dd6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:30.865627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9528f7f0-e973-4001-bb4f-1050d142ea99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.866116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9528f7f0-e973-4001-bb4f-1050d142ea99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.866903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9528f7f0-e973-4001-bb4f-1050d142ea99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.867349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9528f7f0-e973-4001-bb4f-1050d142ea99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.878370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d68192ee-591f-4cc7-b69f-5953931de994 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:30.878980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d68192ee-591f-4cc7-b69f-5953931de994 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:30.881118 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9528f7f0-e973-4001-bb4f-1050d142ea99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] HTTP exception thrown: Instance 1343027f-776d-4868-a38a-15e285438dd6 could not be found. Feb 19 20:57:30.882168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9528f7f0-e973-4001-bb4f-1050d142ea99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] Returning 404 to user: Instance 1343027f-776d-4868-a38a-15e285438dd6 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:30.883003 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9528f7f0-e973-4001-bb4f-1050d142ea99 tempest-ServerDiskConfigTestJSON-499592808 tempest-ServerDiskConfigTestJSON-499592808-project] 10.222.0.30 "GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6" status: 404 len: 111 microversion: 2.1 time: 0.027659 Feb 19 20:57:30.883843 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 892/1847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:30 2022] GET /compute/v2.1/servers/1343027f-776d-4868-a38a-15e285438dd6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:30.888047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d68192ee-591f-4cc7-b69f-5953931de994 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.888538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d68192ee-591f-4cc7-b69f-5953931de994 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:30.889339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d68192ee-591f-4cc7-b69f-5953931de994 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:30.889780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d68192ee-591f-4cc7-b69f-5953931de994 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.101941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19943184-2e37-47f8-9530-9cf38b5b4e54 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:31.102962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-19943184-2e37-47f8-9530-9cf38b5b4e54 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 688a015d-1d10-44c7-b358-4d2cbe080bc2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:31.110851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19943184-2e37-47f8-9530-9cf38b5b4e54 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.111411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19943184-2e37-47f8-9530-9cf38b5b4e54 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.113077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19943184-2e37-47f8-9530-9cf38b5b4e54 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.113623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19943184-2e37-47f8-9530-9cf38b5b4e54 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.133691 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-19943184-2e37-47f8-9530-9cf38b5b4e54 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] HTTP exception thrown: Instance 688a015d-1d10-44c7-b358-4d2cbe080bc2 could not be found. Feb 19 20:57:31.134292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19943184-2e37-47f8-9530-9cf38b5b4e54 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Returning 404 to user: Instance 688a015d-1d10-44c7-b358-4d2cbe080bc2 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:31.137749 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-19943184-2e37-47f8-9530-9cf38b5b4e54 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2" status: 404 len: 111 microversion: 2.1 time: 0.037362 Feb 19 20:57:31.139310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d68192ee-591f-4cc7-b69f-5953931de994 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:31.142398 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 893/1848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:31 2022] GET /compute/v2.1/servers/688a015d-1d10-44c7-b358-4d2cbe080bc2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:57:31.148479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-63ef5848-ed89-44e0-9ccf-8631f73f75a3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:31.149323 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d68192ee-591f-4cc7-b69f-5953931de994 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.274492 Feb 19 20:57:31.149478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-63ef5848-ed89-44e0-9ccf-8631f73f75a3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: f1eb520e-c397-4539-b786-0e315ff274b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:31.150207 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 956/1849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:30 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:31.156484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63ef5848-ed89-44e0-9ccf-8631f73f75a3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.158008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63ef5848-ed89-44e0-9ccf-8631f73f75a3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.159412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63ef5848-ed89-44e0-9ccf-8631f73f75a3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.159936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63ef5848-ed89-44e0-9ccf-8631f73f75a3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.177973 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-63ef5848-ed89-44e0-9ccf-8631f73f75a3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] HTTP exception thrown: Instance f1eb520e-c397-4539-b786-0e315ff274b7 could not be found. Feb 19 20:57:31.178649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-63ef5848-ed89-44e0-9ccf-8631f73f75a3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Returning 404 to user: Instance f1eb520e-c397-4539-b786-0e315ff274b7 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:31.179646 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-63ef5848-ed89-44e0-9ccf-8631f73f75a3 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7" status: 404 len: 111 microversion: 2.1 time: 0.036000 Feb 19 20:57:31.180220 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 894/1850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:31 2022] GET /compute/v2.1/servers/f1eb520e-c397-4539-b786-0e315ff274b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:31.190406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e2aee93-8374-4f9b-aca2-d02e81df2db0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:31.199321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae7d0fbf-3a69-47c2-a915-a3ff9eb9790a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:31.203843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae7d0fbf-3a69-47c2-a915-a3ff9eb9790a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:31.211119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae7d0fbf-3a69-47c2-a915-a3ff9eb9790a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.211851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae7d0fbf-3a69-47c2-a915-a3ff9eb9790a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.213096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae7d0fbf-3a69-47c2-a915-a3ff9eb9790a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.213770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae7d0fbf-3a69-47c2-a915-a3ff9eb9790a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.238562 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e2aee93-8374-4f9b-aca2-d02e81df2db0 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/866ffc53-6983-48e3-9b13-752164543709" status: 204 len: 0 microversion: 2.1 time: 0.052624 Feb 19 20:57:31.239769 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 957/1851] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 20:57:31 2022] DELETE /compute/v2.1/os-server-groups/866ffc53-6983-48e3-9b13-752164543709 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 20:57:31.249152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c483796a-2363-4312-af08-b8e307126928 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:31.249725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c483796a-2363-4312-af08-b8e307126928 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:31.256520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c483796a-2363-4312-af08-b8e307126928 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.257100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c483796a-2363-4312-af08-b8e307126928 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.257891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c483796a-2363-4312-af08-b8e307126928 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.258327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c483796a-2363-4312-af08-b8e307126928 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.285009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c483796a-2363-4312-af08-b8e307126928 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:31.372457 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c483796a-2363-4312-af08-b8e307126928 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 204 len: 0 microversion: 2.1 time: 0.128460 Feb 19 20:57:31.373386 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 958/1852] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:31 2022] DELETE /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 20:57:31.378642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-265981ba-5520-42a7-9f62-0f8f137db2a0 req-d403d491-a63b-482e-ab03-b3fbd14e8862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688a015d-1d10-44c7-b358-4d2cbe080bc2", "name": "network-vif-deleted", "tag": "77f19c96-0ed8-4178-b8cb-e6bc2c9ea499"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:31.380535 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:31.380535 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:31.389670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-265981ba-5520-42a7-9f62-0f8f137db2a0 req-d403d491-a63b-482e-ab03-b3fbd14e8862 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.390112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-265981ba-5520-42a7-9f62-0f8f137db2a0 req-d403d491-a63b-482e-ab03-b3fbd14e8862 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.402932 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-265981ba-5520-42a7-9f62-0f8f137db2a0 req-d403d491-a63b-482e-ab03-b3fbd14e8862 service nova] Creating event network-vif-deleted:77f19c96-0ed8-4178-b8cb-e6bc2c9ea499 for instance 688a015d-1d10-44c7-b358-4d2cbe080bc2 on nch2-master-1 Feb 19 20:57:31.409652 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-265981ba-5520-42a7-9f62-0f8f137db2a0 req-d403d491-a63b-482e-ab03-b3fbd14e8862 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035130 Feb 19 20:57:31.410432 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 959/1853] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:31.418204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c17b50ed-0bcb-4fe5-a2af-6e935e52f0c9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:31.418495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c17b50ed-0bcb-4fe5-a2af-6e935e52f0c9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:31.425062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c17b50ed-0bcb-4fe5-a2af-6e935e52f0c9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.425470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c17b50ed-0bcb-4fe5-a2af-6e935e52f0c9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.426244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c17b50ed-0bcb-4fe5-a2af-6e935e52f0c9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.426673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c17b50ed-0bcb-4fe5-a2af-6e935e52f0c9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.483105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae7d0fbf-3a69-47c2-a915-a3ff9eb9790a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:31.490777 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae7d0fbf-3a69-47c2-a915-a3ff9eb9790a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1500 microversion: 2.1 time: 0.299233 Feb 19 20:57:31.491362 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 895/1854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:31 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1500 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:31.501846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb7a89b0-c547-4563-be91-110e52c2c381 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:31.501846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb7a89b0-c547-4563-be91-110e52c2c381 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:31.511759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb7a89b0-c547-4563-be91-110e52c2c381 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.512224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb7a89b0-c547-4563-be91-110e52c2c381 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.513064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb7a89b0-c547-4563-be91-110e52c2c381 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.513506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb7a89b0-c547-4563-be91-110e52c2c381 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.705413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c17b50ed-0bcb-4fe5-a2af-6e935e52f0c9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:31.715337 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c17b50ed-0bcb-4fe5-a2af-6e935e52f0c9 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1472 microversion: 2.1 time: 0.300972 Feb 19 20:57:31.716213 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 960/1855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:31 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:31.732819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ef855505-2ecb-4283-bac3-b71f1d6ac3e6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:31.733349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ef855505-2ecb-4283-bac3-b71f1d6ac3e6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:31.740243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef855505-2ecb-4283-bac3-b71f1d6ac3e6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.740866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef855505-2ecb-4283-bac3-b71f1d6ac3e6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.741700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef855505-2ecb-4283-bac3-b71f1d6ac3e6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.742302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef855505-2ecb-4283-bac3-b71f1d6ac3e6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.769428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ef855505-2ecb-4283-bac3-b71f1d6ac3e6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:31.781153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cb7a89b0-c547-4563-be91-110e52c2c381 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:31.789930 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb7a89b0-c547-4563-be91-110e52c2c381 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1307 microversion: 2.1 time: 0.297573 Feb 19 20:57:31.791160 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 896/1856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:31 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:31.847835 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ef855505-2ecb-4283-bac3-b71f1d6ac3e6 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "DELETE /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 204 len: 0 microversion: 2.1 time: 0.129695 Feb 19 20:57:31.848455 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 961/1857] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:31 2022] DELETE /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:31.856477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa403eef-2625-460d-a4ff-823bd823992e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:31.857099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aa403eef-2625-460d-a4ff-823bd823992e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:31.864029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa403eef-2625-460d-a4ff-823bd823992e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.864529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa403eef-2625-460d-a4ff-823bd823992e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:31.865426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa403eef-2625-460d-a4ff-823bd823992e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:31.866070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa403eef-2625-460d-a4ff-823bd823992e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:32.004764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa403eef-2625-460d-a4ff-823bd823992e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:32.013043 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa403eef-2625-460d-a4ff-823bd823992e tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.160483 Feb 19 20:57:32.013731 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 897/1858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:31 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:32.037717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e244913-ab5d-4fe3-bb55-4f761d37c8e5", "device": "/dev/xvdb"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:32.040804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:32.050611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:32.051400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:32.052520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:32.053208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:32.167317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1fecb9b5-be64-4124-bfde-75c91bc97215 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:32.168066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1fecb9b5-be64-4124-bfde-75c91bc97215 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:32.174891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fecb9b5-be64-4124-bfde-75c91bc97215 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:32.175510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fecb9b5-be64-4124-bfde-75c91bc97215 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:32.177004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fecb9b5-be64-4124-bfde-75c91bc97215 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:32.177489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fecb9b5-be64-4124-bfde-75c91bc97215 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:32.346264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1fecb9b5-be64-4124-bfde-75c91bc97215 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:32.356295 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1fecb9b5-be64-4124-bfde-75c91bc97215 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1321 microversion: 2.1 time: 0.192685 Feb 19 20:57:32.356509 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0f791ecb-5b1f-45f7-bb85-60e2a04fc7cf tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "POST /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322494 Feb 19 20:57:32.360401 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 962/1859] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 20:57:32 2022] POST /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:32.360570 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 898/1860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:32 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:32.734463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-861676c8-7023-4271-833f-68ebbf248163 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:32.735273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-861676c8-7023-4271-833f-68ebbf248163 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:32.745438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-861676c8-7023-4271-833f-68ebbf248163 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:32.747151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-861676c8-7023-4271-833f-68ebbf248163 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:32.748677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-861676c8-7023-4271-833f-68ebbf248163 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:32.749615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-861676c8-7023-4271-833f-68ebbf248163 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:32.806716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-22262258-170a-469b-a64d-8e44eba78815 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:32.807988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-22262258-170a-469b-a64d-8e44eba78815 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:32.817578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22262258-170a-469b-a64d-8e44eba78815 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:32.818343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22262258-170a-469b-a64d-8e44eba78815 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:32.819315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22262258-170a-469b-a64d-8e44eba78815 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:32.819761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22262258-170a-469b-a64d-8e44eba78815 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:32.949795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-861676c8-7023-4271-833f-68ebbf248163 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:32.960322 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-861676c8-7023-4271-833f-68ebbf248163 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1472 microversion: 2.1 time: 0.229851 Feb 19 20:57:32.961265 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 963/1861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:32 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:33.017742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-22262258-170a-469b-a64d-8e44eba78815 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:33.025469 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-22262258-170a-469b-a64d-8e44eba78815 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1484 microversion: 2.1 time: 0.222470 Feb 19 20:57:33.026007 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 899/1862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:32 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1484 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:33.032804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54ba2b16-08fb-426c-a961-c8e7a4cd51af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:33.033840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54ba2b16-08fb-426c-a961-c8e7a4cd51af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:33.042938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54ba2b16-08fb-426c-a961-c8e7a4cd51af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.043391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54ba2b16-08fb-426c-a961-c8e7a4cd51af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.043910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-30c55819-9d6f-4d4c-b87f-479f185a0ba4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:33.044178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54ba2b16-08fb-426c-a961-c8e7a4cd51af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.044668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54ba2b16-08fb-426c-a961-c8e7a4cd51af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.051641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30c55819-9d6f-4d4c-b87f-479f185a0ba4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.052102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30c55819-9d6f-4d4c-b87f-479f185a0ba4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.132189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-30c55819-9d6f-4d4c-b87f-479f185a0ba4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Going to try to stop instance {{(pid=136095) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 20:57:33.201442 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-30c55819-9d6f-4d4c-b87f-479f185a0ba4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4/action" status: 202 len: 0 microversion: 2.1 time: 0.162510 Feb 19 20:57:33.207790 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 900/1863] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:57:33 2022] POST /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 20:57:33.213348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dc828697-0fc0-4e4c-917f-7cff4f7a100e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:33.214278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dc828697-0fc0-4e4c-917f-7cff4f7a100e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:33.226851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc828697-0fc0-4e4c-917f-7cff4f7a100e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.229278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc828697-0fc0-4e4c-917f-7cff4f7a100e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.230303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc828697-0fc0-4e4c-917f-7cff4f7a100e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.230753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc828697-0fc0-4e4c-917f-7cff4f7a100e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.258351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54ba2b16-08fb-426c-a961-c8e7a4cd51af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:33.267196 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54ba2b16-08fb-426c-a961-c8e7a4cd51af tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.239192 Feb 19 20:57:33.268726 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 964/1864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:33 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:33.380408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd029214-5e67-425f-9598-ee958538a57d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:33.382864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fd029214-5e67-425f-9598-ee958538a57d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:33.392049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd029214-5e67-425f-9598-ee958538a57d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.394729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd029214-5e67-425f-9598-ee958538a57d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.395980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd029214-5e67-425f-9598-ee958538a57d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.396629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd029214-5e67-425f-9598-ee958538a57d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.424498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dc828697-0fc0-4e4c-917f-7cff4f7a100e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:33.433081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dc828697-0fc0-4e4c-917f-7cff4f7a100e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.223724 Feb 19 20:57:33.433910 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 901/1865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:33 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:33.632385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fd029214-5e67-425f-9598-ee958538a57d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:33.640248 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fd029214-5e67-425f-9598-ee958538a57d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1470 microversion: 2.1 time: 0.265307 Feb 19 20:57:33.640981 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 965/1866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:33 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:33.657050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11237fc5-2901-4a31-9e95-48b98565e50e tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:33.657511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11237fc5-2901-4a31-9e95-48b98565e50e tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:33.664494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11237fc5-2901-4a31-9e95-48b98565e50e tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.664990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11237fc5-2901-4a31-9e95-48b98565e50e tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.665782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11237fc5-2901-4a31-9e95-48b98565e50e tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.666211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11237fc5-2901-4a31-9e95-48b98565e50e tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.692156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-11237fc5-2901-4a31-9e95-48b98565e50e tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lazy-loading 'flavor' on Instance uuid 3ce58dc5-cdde-4b6e-800d-95033c88b685 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:57:33.798465 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11237fc5-2901-4a31-9e95-48b98565e50e tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685/action" status: 202 len: 0 microversion: 2.1 time: 0.143410 Feb 19 20:57:33.802897 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 902/1867] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:57:33 2022] POST /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:57:33.809993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fbb74553-80b4-4e5a-8c45-a0a147b7d040 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:33.816637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fbb74553-80b4-4e5a-8c45-a0a147b7d040 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:33.843714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbb74553-80b4-4e5a-8c45-a0a147b7d040 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.844170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbb74553-80b4-4e5a-8c45-a0a147b7d040 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.846165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbb74553-80b4-4e5a-8c45-a0a147b7d040 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:33.846647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbb74553-80b4-4e5a-8c45-a0a147b7d040 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:33.980987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e08a687-57b3-4654-9028-9cf0bab86d74 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:33.981771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1e08a687-57b3-4654-9028-9cf0bab86d74 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:34.016824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e08a687-57b3-4654-9028-9cf0bab86d74 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:34.017309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e08a687-57b3-4654-9028-9cf0bab86d74 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:34.018143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e08a687-57b3-4654-9028-9cf0bab86d74 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:34.018583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e08a687-57b3-4654-9028-9cf0bab86d74 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:34.111754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1e08a687-57b3-4654-9028-9cf0bab86d74 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3fa7eadddf42b4b700593dad828e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dabc5bb30faa4af797e9ba1cd4bad547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:34.121109 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e08a687-57b3-4654-9028-9cf0bab86d74 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 200 len: 1430 microversion: 2.1 time: 0.146767 Feb 19 20:57:34.137358 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 903/1868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:33 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 1430 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:34.142886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f2323c31-042a-4f2b-9739-a5f236f157d8 req-e71a80b3-01c1-41e5-8045-9a00004e4041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c97b67a-8ac7-415a-8fd9-9b05f343eb16", "name": "network-vif-deleted", "tag": "90891e43-b363-4c09-a2eb-51710df5cd41"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:34.144757 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:34.144757 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:34.157493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f2323c31-042a-4f2b-9739-a5f236f157d8 req-e71a80b3-01c1-41e5-8045-9a00004e4041 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:34.158216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f2323c31-042a-4f2b-9739-a5f236f157d8 req-e71a80b3-01c1-41e5-8045-9a00004e4041 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:34.179730 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f2323c31-042a-4f2b-9739-a5f236f157d8 req-e71a80b3-01c1-41e5-8045-9a00004e4041 service nova] Creating event network-vif-deleted:90891e43-b363-4c09-a2eb-51710df5cd41 for instance 4c97b67a-8ac7-415a-8fd9-9b05f343eb16 on nch2-master-1 Feb 19 20:57:34.185066 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f2323c31-042a-4f2b-9739-a5f236f157d8 req-e71a80b3-01c1-41e5-8045-9a00004e4041 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046111 Feb 19 20:57:34.185871 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 904/1869] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:34.190744 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fbb74553-80b4-4e5a-8c45-a0a147b7d040 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1629 microversion: 2.1 time: 0.384635 Feb 19 20:57:34.197951 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 966/1870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:33 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1629 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:34.285093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-728c4531-0e58-46c1-9271-2706ad4dcfba tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:34.285706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-728c4531-0e58-46c1-9271-2706ad4dcfba tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:34.292305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-728c4531-0e58-46c1-9271-2706ad4dcfba tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:34.292974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-728c4531-0e58-46c1-9271-2706ad4dcfba tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:34.293933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-728c4531-0e58-46c1-9271-2706ad4dcfba tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:34.294493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-728c4531-0e58-46c1-9271-2706ad4dcfba tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:34.304817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1774109836", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "b985be9e-d38c-4279-82e4-b246daeadbde"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:34.359261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] validate_networks() for [('b985be9e-d38c-4279-82e4-b246daeadbde', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:57:34.548711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-728c4531-0e58-46c1-9271-2706ad4dcfba tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:34.556457 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-728c4531-0e58-46c1-9271-2706ad4dcfba tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.275656 Feb 19 20:57:34.557040 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 967/1871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:34 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:34.562563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a1f7ff7-379c-43d6-9daf-3fb864af5d4a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:34.564087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a1f7ff7-379c-43d6-9daf-3fb864af5d4a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:34.571764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a1f7ff7-379c-43d6-9daf-3fb864af5d4a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:34.572213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a1f7ff7-379c-43d6-9daf-3fb864af5d4a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:34.573125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a1f7ff7-379c-43d6-9daf-3fb864af5d4a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:34.573607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a1f7ff7-379c-43d6-9daf-3fb864af5d4a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:34.846672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a1f7ff7-379c-43d6-9daf-3fb864af5d4a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:34.854139 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a1f7ff7-379c-43d6-9daf-3fb864af5d4a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.294866 Feb 19 20:57:34.854947 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 968/1872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:34 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:34.867140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:57:34.867662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:57:34.868229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:57:34.868669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:57:34.869267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:57:34.878762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:34.879335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:34.880380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:34.880840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:34.899951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Getting quotas for project 72c7d19a9f264a299de3fef34d6cc2e3. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:57:34.903925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Getting quotas for user 60cfee67e3df4200a93528bcb8036b9e and project 72c7d19a9f264a299de3fef34d6cc2e3. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:57:34.914790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Going to run 2 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:57:34.917287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 79c8a420-124f-496a-9605-633f80408b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:57:34.948829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=79c8a420-124f-496a-9605-633f80408b4b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:57:35.001399 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc9d485d-5027-49a7-8095-fe2570e7f699 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813301 Feb 19 20:57:35.001756 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 905/1873] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:57:35.011430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7ce00613-ab8d-4235-977c-7fc295a13b9f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:35.014826 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:35.014826 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:35.015825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7ce00613-ab8d-4235-977c-7fc295a13b9f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:35.017342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7ce00613-ab8d-4235-977c-7fc295a13b9f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Searching by: {'deleted': False, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:57:35.032666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ce00613-ab8d-4235-977c-7fc295a13b9f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.033126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ce00613-ab8d-4235-977c-7fc295a13b9f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.033950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ce00613-ab8d-4235-977c-7fc295a13b9f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.034389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ce00613-ab8d-4235-977c-7fc295a13b9f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.055430 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7ce00613-ab8d-4235-977c-7fc295a13b9f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.047562 Feb 19 20:57:35.056022 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 969/1874] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 20:57:35 2022] GET /compute/v2.1/servers => generated 677 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:35.066818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4acd097f-e93c-44fc-9cc9-734a1abddf11 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:35.067438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4acd097f-e93c-44fc-9cc9-734a1abddf11 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:35.120111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4acd097f-e93c-44fc-9cc9-734a1abddf11 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:35.127715 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4acd097f-e93c-44fc-9cc9-734a1abddf11 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1220 microversion: 2.1 time: 0.064514 Feb 19 20:57:35.127924 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 906/1875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:35 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1220 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:35.148185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f4c96f23-4790-47d1-8922-a3f96b838ea4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:35.148838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f4c96f23-4790-47d1-8922-a3f96b838ea4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] [instance: 4c97b67a-8ac7-415a-8fd9-9b05f343eb16] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:35.154812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4c96f23-4790-47d1-8922-a3f96b838ea4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.155266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4c96f23-4790-47d1-8922-a3f96b838ea4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.156088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4c96f23-4790-47d1-8922-a3f96b838ea4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.156558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4c96f23-4790-47d1-8922-a3f96b838ea4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.171225 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-f4c96f23-4790-47d1-8922-a3f96b838ea4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] HTTP exception thrown: Instance 4c97b67a-8ac7-415a-8fd9-9b05f343eb16 could not be found. Feb 19 20:57:35.171824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f4c96f23-4790-47d1-8922-a3f96b838ea4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] Returning 404 to user: Instance 4c97b67a-8ac7-415a-8fd9-9b05f343eb16 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:35.173268 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f4c96f23-4790-47d1-8922-a3f96b838ea4 tempest-ServersOnMultiNodesTest-855722549 tempest-ServersOnMultiNodesTest-855722549-project] 10.222.0.30 "GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16" status: 404 len: 111 microversion: 2.1 time: 0.028222 Feb 19 20:57:35.173823 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 970/1876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:35 2022] GET /compute/v2.1/servers/4c97b67a-8ac7-415a-8fd9-9b05f343eb16 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:35.210723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4142bbec-08fb-487c-a21d-9784bc45a93d tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:35.211348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4142bbec-08fb-487c-a21d-9784bc45a93d tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:35.217790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4142bbec-08fb-487c-a21d-9784bc45a93d tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.218251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4142bbec-08fb-487c-a21d-9784bc45a93d tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.219092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4142bbec-08fb-487c-a21d-9784bc45a93d tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.219575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4142bbec-08fb-487c-a21d-9784bc45a93d tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.372532 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4142bbec-08fb-487c-a21d-9784bc45a93d tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1612 microversion: 2.1 time: 0.168436 Feb 19 20:57:35.373297 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 907/1877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:35 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1612 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:35.391361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87a4b3e2-1b1e-4d12-ac6f-39471541eda0 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:35.391988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-87a4b3e2-1b1e-4d12-ac6f-39471541eda0 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:35.399124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87a4b3e2-1b1e-4d12-ac6f-39471541eda0 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.399704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87a4b3e2-1b1e-4d12-ac6f-39471541eda0 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.400534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87a4b3e2-1b1e-4d12-ac6f-39471541eda0 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.403847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87a4b3e2-1b1e-4d12-ac6f-39471541eda0 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.476391 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-87a4b3e2-1b1e-4d12-ac6f-39471541eda0 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] HTTP exception thrown: Cannot 'migrate' instance 3ce58dc5-cdde-4b6e-800d-95033c88b685 while it is in vm_state suspended Feb 19 20:57:35.477172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87a4b3e2-1b1e-4d12-ac6f-39471541eda0 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Returning 409 to user: Cannot 'migrate' instance 3ce58dc5-cdde-4b6e-800d-95033c88b685 while it is in vm_state suspended {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:35.478165 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-87a4b3e2-1b1e-4d12-ac6f-39471541eda0 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685/action" status: 409 len: 148 microversion: 2.1 time: 0.092248 Feb 19 20:57:35.484267 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 971/1878] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:57:35 2022] POST /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685/action => generated 148 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:57:35.491224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-97ef75c3-8516-4256-990f-3d1480e195c7 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:35.492445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-97ef75c3-8516-4256-990f-3d1480e195c7 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:35.493275 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-97ef75c3-8516-4256-990f-3d1480e195c7 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483/action" status: 400 len: 144 microversion: 2.1 time: 0.006146 Feb 19 20:57:35.493801 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 908/1879] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:57:35 2022] POST /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483/action => generated 144 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:57:35.505463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7527ed7-2b2f-4699-a3eb-64acc664b0f7 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:35.506766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7527ed7-2b2f-4699-a3eb-64acc664b0f7 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:35.507758 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7527ed7-2b2f-4699-a3eb-64acc664b0f7 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483/action" status: 400 len: 120 microversion: 2.1 time: 0.007745 Feb 19 20:57:35.513108 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 972/1880] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:57:35 2022] POST /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:57:35.518371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-55172ff7-4101-462e-91bc-137a8d60ed53 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:35.519604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-55172ff7-4101-462e-91bc-137a8d60ed53 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Failed to fetch instance by id 999 {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2871}} Feb 19 20:57:35.520262 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-55172ff7-4101-462e-91bc-137a8d60ed53 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] HTTP exception thrown: Instance 999 could not be found. Feb 19 20:57:35.521021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-55172ff7-4101-462e-91bc-137a8d60ed53 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:35.522042 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-55172ff7-4101-462e-91bc-137a8d60ed53 tempest-ServersAdminNegativeTestJSON-922784106 tempest-ServersAdminNegativeTestJSON-922784106-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.007963 Feb 19 20:57:35.522664 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 909/1881] 10.222.0.30 () {60 vars in 1178 bytes} [Sat Feb 19 20:57:35 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:57:35.536250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-615cba01-c615-45f5-b78d-fb307cc226e1 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:35.536786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-615cba01-c615-45f5-b78d-fb307cc226e1 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:35.543643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-615cba01-c615-45f5-b78d-fb307cc226e1 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.544082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-615cba01-c615-45f5-b78d-fb307cc226e1 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.544908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-615cba01-c615-45f5-b78d-fb307cc226e1 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.545528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-615cba01-c615-45f5-b78d-fb307cc226e1 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.576291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e2a3664f-67ed-4e33-9d4b-c3ae4fd58cc1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:35.576291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e2a3664f-67ed-4e33-9d4b-c3ae4fd58cc1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:35.591838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2a3664f-67ed-4e33-9d4b-c3ae4fd58cc1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.592322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2a3664f-67ed-4e33-9d4b-c3ae4fd58cc1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.593160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2a3664f-67ed-4e33-9d4b-c3ae4fd58cc1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.593599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2a3664f-67ed-4e33-9d4b-c3ae4fd58cc1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.596749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-615cba01-c615-45f5-b78d-fb307cc226e1 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:35.743499 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-615cba01-c615-45f5-b78d-fb307cc226e1 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 204 len: 0 microversion: 2.1 time: 0.213555 Feb 19 20:57:35.751728 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 973/1882] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:35 2022] DELETE /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:35.755514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c53f93f2-2230-473e-b7bf-6e94340a387b tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:35.756846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c53f93f2-2230-473e-b7bf-6e94340a387b tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:35.763624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c53f93f2-2230-473e-b7bf-6e94340a387b tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.764075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c53f93f2-2230-473e-b7bf-6e94340a387b tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.764885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c53f93f2-2230-473e-b7bf-6e94340a387b tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.765318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c53f93f2-2230-473e-b7bf-6e94340a387b tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.905380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e2a3664f-67ed-4e33-9d4b-c3ae4fd58cc1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:35.913137 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e2a3664f-67ed-4e33-9d4b-c3ae4fd58cc1 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1506 microversion: 2.1 time: 0.342297 Feb 19 20:57:35.914094 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 910/1883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:35 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:35.927291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a317ff9-96cd-4458-b6cf-cb8b078a074f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:35.928160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a317ff9-96cd-4458-b6cf-cb8b078a074f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:35.952837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a317ff9-96cd-4458-b6cf-cb8b078a074f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.957117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a317ff9-96cd-4458-b6cf-cb8b078a074f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:35.958274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a317ff9-96cd-4458-b6cf-cb8b078a074f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:35.958824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a317ff9-96cd-4458-b6cf-cb8b078a074f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:36.040836 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c53f93f2-2230-473e-b7bf-6e94340a387b tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1690 microversion: 2.1 time: 0.290932 Feb 19 20:57:36.044241 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 974/1884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:35 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1690 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:36.050620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-76f2f32f-a7eb-48bd-a8a1-96814bdb1e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:36.051486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-76f2f32f-a7eb-48bd-a8a1-96814bdb1e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:36.058990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76f2f32f-a7eb-48bd-a8a1-96814bdb1e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:36.059678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76f2f32f-a7eb-48bd-a8a1-96814bdb1e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:36.060717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76f2f32f-a7eb-48bd-a8a1-96814bdb1e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:36.061366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76f2f32f-a7eb-48bd-a8a1-96814bdb1e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:36.189146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5a317ff9-96cd-4458-b6cf-cb8b078a074f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:36.197181 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5a317ff9-96cd-4458-b6cf-cb8b078a074f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1467 microversion: 2.1 time: 0.282325 Feb 19 20:57:36.202756 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 911/1885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:35 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1467 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:36.208531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bac8bce6-0483-464d-a27d-e91d64ad5e28 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:36.211090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bac8bce6-0483-464d-a27d-e91d64ad5e28 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:36.218125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac8bce6-0483-464d-a27d-e91d64ad5e28 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:36.218956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac8bce6-0483-464d-a27d-e91d64ad5e28 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:36.220777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac8bce6-0483-464d-a27d-e91d64ad5e28 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:36.221520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac8bce6-0483-464d-a27d-e91d64ad5e28 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:36.249114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-bac8bce6-0483-464d-a27d-e91d64ad5e28 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lazy-loading 'flavor' on Instance uuid b048357b-44b4-4c70-8ed5-96deddc7d40e {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:57:36.264319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bac8bce6-0483-464d-a27d-e91d64ad5e28 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Going to try to live migrate instance to nch2-master-1 {{(pid=136095) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 20:57:36.542353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-76f2f32f-a7eb-48bd-a8a1-96814bdb1e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:36.554001 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-76f2f32f-a7eb-48bd-a8a1-96814bdb1e8d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.508080 Feb 19 20:57:36.556026 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 975/1886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:36 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:36.570181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-21119fe2-63c2-4659-9038-2de2c811316a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:36.571187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-21119fe2-63c2-4659-9038-2de2c811316a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:36.587784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21119fe2-63c2-4659-9038-2de2c811316a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:36.589191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21119fe2-63c2-4659-9038-2de2c811316a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:36.590338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21119fe2-63c2-4659-9038-2de2c811316a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:36.591723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21119fe2-63c2-4659-9038-2de2c811316a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:37.089295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-21119fe2-63c2-4659-9038-2de2c811316a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:37.102551 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-21119fe2-63c2-4659-9038-2de2c811316a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1290 microversion: 2.1 time: 0.541019 Feb 19 20:57:37.103197 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 976/1887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:36 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1290 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:37.118915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-18e211bb-2fdf-4c6c-ba1a-9d2f47664fb6 req-141c013b-f8a7-40b5-ad40-e8f7a45f04ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59252cac-71fd-4839-8d62-e20d42abc8cb", "name": "network-vif-deleted", "tag": "31d6bb39-99dc-4d88-9fb6-3d09d608c1ea"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:37.120904 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:37.120904 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:37.128453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-18e211bb-2fdf-4c6c-ba1a-9d2f47664fb6 req-141c013b-f8a7-40b5-ad40-e8f7a45f04ba service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:37.129178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-18e211bb-2fdf-4c6c-ba1a-9d2f47664fb6 req-141c013b-f8a7-40b5-ad40-e8f7a45f04ba service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:37.141550 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-18e211bb-2fdf-4c6c-ba1a-9d2f47664fb6 req-141c013b-f8a7-40b5-ad40-e8f7a45f04ba service nova] Creating event network-vif-deleted:31d6bb39-99dc-4d88-9fb6-3d09d608c1ea for instance 59252cac-71fd-4839-8d62-e20d42abc8cb on nch2-master-1 Feb 19 20:57:37.147094 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-18e211bb-2fdf-4c6c-ba1a-9d2f47664fb6 req-141c013b-f8a7-40b5-ad40-e8f7a45f04ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032496 Feb 19 20:57:37.157786 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 977/1888] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:37.164390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:37.165270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:37.173100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:37.173549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:37.174576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:37.175028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:37.213977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:37.214435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:37.214980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lazy-loading 'fault' on Instance uuid 59252cac-71fd-4839-8d62-e20d42abc8cb {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:57:37.269223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:37.277295 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b6cbe0f9-045e-428e-88d6-61cebeed9bdf tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 200 len: 1304 microversion: 2.1 time: 0.118181 Feb 19 20:57:37.277882 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 978/1889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:37 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:37.283044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bc859940-da9f-4a51-ab31-0466062fd959 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:37.283642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bc859940-da9f-4a51-ab31-0466062fd959 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:37.297026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc859940-da9f-4a51-ab31-0466062fd959 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:37.298164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc859940-da9f-4a51-ab31-0466062fd959 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:37.299147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc859940-da9f-4a51-ab31-0466062fd959 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:37.299772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc859940-da9f-4a51-ab31-0466062fd959 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:37.538622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bc859940-da9f-4a51-ab31-0466062fd959 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:37.546855 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bc859940-da9f-4a51-ab31-0466062fd959 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1467 microversion: 2.1 time: 0.267538 Feb 19 20:57:37.548404 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 979/1890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:37 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1467 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:37.572948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2b9e695-8045-4b0d-84cc-0097ead56fcf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:37.572948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b2b9e695-8045-4b0d-84cc-0097ead56fcf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:37.589275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2b9e695-8045-4b0d-84cc-0097ead56fcf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:37.589784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2b9e695-8045-4b0d-84cc-0097ead56fcf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:37.590634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2b9e695-8045-4b0d-84cc-0097ead56fcf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:37.591496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2b9e695-8045-4b0d-84cc-0097ead56fcf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:37.858388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b2b9e695-8045-4b0d-84cc-0097ead56fcf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:37.866926 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2b9e695-8045-4b0d-84cc-0097ead56fcf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.299179 Feb 19 20:57:37.872780 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 980/1891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:37 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:38.080649 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bac8bce6-0483-464d-a27d-e91d64ad5e28 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/action" status: 202 len: 0 microversion: 2.1 time: 1.875623 Feb 19 20:57:38.088683 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 912/1892] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:57:36 2022] POST /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/action => generated 0 bytes in 1885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:57:38.089472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe47d4bd-ebf4-4950-841c-c492634cff6a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:38.090669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fe47d4bd-ebf4-4950-841c-c492634cff6a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:38.100277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe47d4bd-ebf4-4950-841c-c492634cff6a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.101180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe47d4bd-ebf4-4950-841c-c492634cff6a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.102228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe47d4bd-ebf4-4950-841c-c492634cff6a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.102888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe47d4bd-ebf4-4950-841c-c492634cff6a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.122437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d9eaf84b-978f-48aa-851f-c523fb80bc6a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:38.123117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d9eaf84b-978f-48aa-851f-c523fb80bc6a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:38.146727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9eaf84b-978f-48aa-851f-c523fb80bc6a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.147507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9eaf84b-978f-48aa-851f-c523fb80bc6a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.158494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9eaf84b-978f-48aa-851f-c523fb80bc6a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.159154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9eaf84b-978f-48aa-851f-c523fb80bc6a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.472087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe47d4bd-ebf4-4950-841c-c492634cff6a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:38.484262 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fe47d4bd-ebf4-4950-841c-c492634cff6a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.398667 Feb 19 20:57:38.486335 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 981/1893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:38 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:38.493043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e26fded4-12b4-443d-950f-d7b03071ef55 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:38.501330 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e26fded4-12b4-443d-950f-d7b03071ef55 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 59252cac-71fd-4839-8d62-e20d42abc8cb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:38.510455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e26fded4-12b4-443d-950f-d7b03071ef55 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.511192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e26fded4-12b4-443d-950f-d7b03071ef55 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.512182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e26fded4-12b4-443d-950f-d7b03071ef55 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.512841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e26fded4-12b4-443d-950f-d7b03071ef55 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.528718 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e26fded4-12b4-443d-950f-d7b03071ef55 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] HTTP exception thrown: Instance 59252cac-71fd-4839-8d62-e20d42abc8cb could not be found. Feb 19 20:57:38.529651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e26fded4-12b4-443d-950f-d7b03071ef55 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Returning 404 to user: Instance 59252cac-71fd-4839-8d62-e20d42abc8cb could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:38.530746 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e26fded4-12b4-443d-950f-d7b03071ef55 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb" status: 404 len: 111 microversion: 2.1 time: 0.041140 Feb 19 20:57:38.531748 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 982/1894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:38 2022] GET /compute/v2.1/servers/59252cac-71fd-4839-8d62-e20d42abc8cb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:38.540929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eb06099f-a66d-4c75-a3aa-dd07d19620f9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:38.542009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eb06099f-a66d-4c75-a3aa-dd07d19620f9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:38.552304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb06099f-a66d-4c75-a3aa-dd07d19620f9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.553364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb06099f-a66d-4c75-a3aa-dd07d19620f9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.554401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb06099f-a66d-4c75-a3aa-dd07d19620f9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.555024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb06099f-a66d-4c75-a3aa-dd07d19620f9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.568158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d9eaf84b-978f-48aa-851f-c523fb80bc6a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:38.576306 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d9eaf84b-978f-48aa-851f-c523fb80bc6a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1320 microversion: 2.1 time: 0.457639 Feb 19 20:57:38.580397 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 913/1895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:38 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:38.601678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c45dde28-34ea-49d7-9576-718294d2a56a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:38.603816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c45dde28-34ea-49d7-9576-718294d2a56a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:38.607220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eb06099f-a66d-4c75-a3aa-dd07d19620f9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:38.613208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c45dde28-34ea-49d7-9576-718294d2a56a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.614281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c45dde28-34ea-49d7-9576-718294d2a56a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.615703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c45dde28-34ea-49d7-9576-718294d2a56a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.616440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c45dde28-34ea-49d7-9576-718294d2a56a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.767416 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eb06099f-a66d-4c75-a3aa-dd07d19620f9 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 204 len: 0 microversion: 2.1 time: 0.229778 Feb 19 20:57:38.770152 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 983/1896] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:38 2022] DELETE /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:38.780782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-720f3dad-f0e7-4f55-b81e-65f3bdcb6d79 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:38.782299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-720f3dad-f0e7-4f55-b81e-65f3bdcb6d79 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:38.807612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720f3dad-f0e7-4f55-b81e-65f3bdcb6d79 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.808590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720f3dad-f0e7-4f55-b81e-65f3bdcb6d79 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.810556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720f3dad-f0e7-4f55-b81e-65f3bdcb6d79 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.811544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720f3dad-f0e7-4f55-b81e-65f3bdcb6d79 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.927277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c45dde28-34ea-49d7-9576-718294d2a56a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:38.940161 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c45dde28-34ea-49d7-9576-718294d2a56a tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1467 microversion: 2.1 time: 0.343277 Feb 19 20:57:38.940894 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 914/1897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:38 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1467 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:38.952768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-da57c5be-24e8-4d5c-8ca2-3de55650b67e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:38.955177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-da57c5be-24e8-4d5c-8ca2-3de55650b67e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:38.962398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da57c5be-24e8-4d5c-8ca2-3de55650b67e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.963133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da57c5be-24e8-4d5c-8ca2-3de55650b67e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:38.964522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da57c5be-24e8-4d5c-8ca2-3de55650b67e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:38.965166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da57c5be-24e8-4d5c-8ca2-3de55650b67e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:39.129472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-720f3dad-f0e7-4f55-b81e-65f3bdcb6d79 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:39.138822 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-720f3dad-f0e7-4f55-b81e-65f3bdcb6d79 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1491 microversion: 2.1 time: 0.364583 Feb 19 20:57:39.139414 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 984/1898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:38 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1491 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:39.231859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da57c5be-24e8-4d5c-8ca2-3de55650b67e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:39.241190 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-da57c5be-24e8-4d5c-8ca2-3de55650b67e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.298923 Feb 19 20:57:39.242148 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 915/1899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:38 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:39.258511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-197f579e-2935-43cd-a7ed-90113ed37f31 req-314b1c8e-7240-49d0-ace3-a3ae979f5bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c8a420-124f-496a-9605-633f80408b4b", "tag": "3f866cda-3fba-4690-9199-9e11ff500810"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:39.261350 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:39.261350 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:39.278556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-197f579e-2935-43cd-a7ed-90113ed37f31 req-314b1c8e-7240-49d0-ace3-a3ae979f5bef service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:39.279020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-197f579e-2935-43cd-a7ed-90113ed37f31 req-314b1c8e-7240-49d0-ace3-a3ae979f5bef service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:39.283222 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-989dec09-22a5-4b80-a5dd-f00470b3edc5 tempest-TenantUsagesNegativeTestJSON-2008422754 tempest-TenantUsagesNegativeTestJSON-2008422754-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-02-18T20%3A57%3A38.895299&end=2022-02-20T20%3A57%3A38.895299" status: 404 len: 112 microversion: - time: 0.141883 Feb 19 20:57:39.283938 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 985/1900] 10.222.0.30 () {58 vars in 1315 bytes} [Sat Feb 19 20:57:39 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-02-18T20%3A57%3A38.895299&end=2022-02-20T20%3A57%3A38.895299 => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 19 20:57:39.295986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3698700f-5431-4b11-a40b-d27b9dc46b26 tempest-TenantUsagesNegativeTestJSON-2008422754 tempest-TenantUsagesNegativeTestJSON-2008422754-project-admin] Calling method '.version_select at 0x7f6467eeef70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:39.297080 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-197f579e-2935-43cd-a7ed-90113ed37f31 req-314b1c8e-7240-49d0-ace3-a3ae979f5bef service nova] Creating event network-changed:3f866cda-3fba-4690-9199-9e11ff500810 for instance 79c8a420-124f-496a-9605-633f80408b4b on nch2-master-1 Feb 19 20:57:39.300136 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-3698700f-5431-4b11-a40b-d27b9dc46b26 tempest-TenantUsagesNegativeTestJSON-2008422754 tempest-TenantUsagesNegativeTestJSON-2008422754-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Feb 19 20:57:39.300726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3698700f-5431-4b11-a40b-d27b9dc46b26 tempest-TenantUsagesNegativeTestJSON-2008422754 tempest-TenantUsagesNegativeTestJSON-2008422754-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:39.302217 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3698700f-5431-4b11-a40b-d27b9dc46b26 tempest-TenantUsagesNegativeTestJSON-2008422754 tempest-TenantUsagesNegativeTestJSON-2008422754-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/eba55f50287a466fa60373088ef7f5ff?start=2022-02-20T20%3A57%3A38.895299&end=2022-02-18T20%3A57%3A38.895299" status: 400 len: 111 microversion: 2.1 time: 0.010100 Feb 19 20:57:39.303315 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 986/1901] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Feb 19 20:57:39 2022] GET /compute/v2.1/os-simple-tenant-usage/eba55f50287a466fa60373088ef7f5ff?start=2022-02-20T20%3A57%3A38.895299&end=2022-02-18T20%3A57%3A38.895299 => generated 111 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:57:39.308259 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-197f579e-2935-43cd-a7ed-90113ed37f31 req-314b1c8e-7240-49d0-ace3-a3ae979f5bef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059432 Feb 19 20:57:39.310072 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 916/1902] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:39.423912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-91d0a033-fddd-4886-b6ed-b7a5824f0077 tempest-TenantUsagesNegativeTestJSON-1062572482 tempest-TenantUsagesNegativeTestJSON-1062572482-project] Calling method '.version_select at 0x7f6467ed3c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:39.425480 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:39.425480 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:39.427324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-91d0a033-fddd-4886-b6ed-b7a5824f0077 tempest-TenantUsagesNegativeTestJSON-1062572482 tempest-TenantUsagesNegativeTestJSON-1062572482-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'dc5857f4ed34409babe14c01a10d3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba55f50287a466fa60373088ef7f5ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:39.428259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-91d0a033-fddd-4886-b6ed-b7a5824f0077 tempest-TenantUsagesNegativeTestJSON-1062572482 tempest-TenantUsagesNegativeTestJSON-1062572482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:39.429209 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-91d0a033-fddd-4886-b6ed-b7a5824f0077 tempest-TenantUsagesNegativeTestJSON-1062572482 tempest-TenantUsagesNegativeTestJSON-1062572482-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-02-18T20%3A57%3A38.895299&end=2022-02-20T20%3A57%3A38.895299&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.120084 Feb 19 20:57:39.429805 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 987/1903] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Feb 19 20:57:39 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-02-18T20%3A57%3A38.895299&end=2022-02-20T20%3A57%3A38.895299&detailed=1 => generated 123 bytes in 121 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:39.504301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fefc61d4-4a60-4077-99f0-b5267795dfee tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:39.504969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fefc61d4-4a60-4077-99f0-b5267795dfee tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:39.517972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fefc61d4-4a60-4077-99f0-b5267795dfee tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:39.518511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fefc61d4-4a60-4077-99f0-b5267795dfee tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:39.522837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fefc61d4-4a60-4077-99f0-b5267795dfee tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:39.523350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fefc61d4-4a60-4077-99f0-b5267795dfee tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:39.597828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fddb432b-b780-48c5-9777-721b533c3258 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:39.598781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fddb432b-b780-48c5-9777-721b533c3258 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:39.610914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fddb432b-b780-48c5-9777-721b533c3258 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:39.612144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fddb432b-b780-48c5-9777-721b533c3258 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:39.617394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fddb432b-b780-48c5-9777-721b533c3258 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:39.618040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fddb432b-b780-48c5-9777-721b533c3258 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:40.017933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fddb432b-b780-48c5-9777-721b533c3258 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:40.029114 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fddb432b-b780-48c5-9777-721b533c3258 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1320 microversion: 2.1 time: 0.435354 Feb 19 20:57:40.039570 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 988/1904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:39 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1320 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:40.039570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5bfc3657-a4c8-45ad-acf2-5795f220cf48 req-507048d4-74a5-4049-9cf9-06f96d5e375b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce58dc5-cdde-4b6e-800d-95033c88b685", "name": "network-vif-deleted", "tag": "ea4af430-5045-4885-a178-bea7b85b3f36"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:40.045184 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:40.045184 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:40.059495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5bfc3657-a4c8-45ad-acf2-5795f220cf48 req-507048d4-74a5-4049-9cf9-06f96d5e375b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:40.060924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5bfc3657-a4c8-45ad-acf2-5795f220cf48 req-507048d4-74a5-4049-9cf9-06f96d5e375b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:40.062386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fefc61d4-4a60-4077-99f0-b5267795dfee tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:40.074102 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fefc61d4-4a60-4077-99f0-b5267795dfee tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.574752 Feb 19 20:57:40.077164 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 917/1905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:39 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:40.086823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:40.089055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:40.091896 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5bfc3657-a4c8-45ad-acf2-5795f220cf48 req-507048d4-74a5-4049-9cf9-06f96d5e375b service nova] Creating event network-vif-deleted:ea4af430-5045-4885-a178-bea7b85b3f36 for instance 3ce58dc5-cdde-4b6e-800d-95033c88b685 on nch2-master-1 Feb 19 20:57:40.099884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:40.104926 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5bfc3657-a4c8-45ad-acf2-5795f220cf48 req-507048d4-74a5-4049-9cf9-06f96d5e375b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069966 Feb 19 20:57:40.105180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:40.105560 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 989/1906] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:40.106447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:40.107075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:40.153806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:40.154468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:40.155097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lazy-loading 'fault' on Instance uuid 3ce58dc5-cdde-4b6e-800d-95033c88b685 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:57:40.155511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-71427ed8-22d8-4d4c-8e4d-d04058ab0019 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:40.156219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-71427ed8-22d8-4d4c-8e4d-d04058ab0019 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:40.168694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71427ed8-22d8-4d4c-8e4d-d04058ab0019 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:40.169364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71427ed8-22d8-4d4c-8e4d-d04058ab0019 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:40.170160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71427ed8-22d8-4d4c-8e4d-d04058ab0019 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:40.170592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71427ed8-22d8-4d4c-8e4d-d04058ab0019 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:40.275625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:40.287194 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4efc7e6f-421f-4913-b1fb-411b7df43303 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 200 len: 1311 microversion: 2.1 time: 0.208124 Feb 19 20:57:40.296575 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 918/1907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:40 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:40.298997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b03d87a8-a5ad-4274-b8ac-25010e21ceed tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:40.301048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b03d87a8-a5ad-4274-b8ac-25010e21ceed tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:40.308615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b03d87a8-a5ad-4274-b8ac-25010e21ceed tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:40.309262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b03d87a8-a5ad-4274-b8ac-25010e21ceed tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:40.310221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b03d87a8-a5ad-4274-b8ac-25010e21ceed tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:40.310820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b03d87a8-a5ad-4274-b8ac-25010e21ceed tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:40.624383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-71427ed8-22d8-4d4c-8e4d-d04058ab0019 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:40.634245 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-71427ed8-22d8-4d4c-8e4d-d04058ab0019 tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1491 microversion: 2.1 time: 0.482558 Feb 19 20:57:40.635469 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 990/1908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:40 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1491 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:40.787007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b03d87a8-a5ad-4274-b8ac-25010e21ceed tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:40.796521 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b03d87a8-a5ad-4274-b8ac-25010e21ceed tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.502218 Feb 19 20:57:40.799048 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 919/1909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:40 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:41.048029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-602ca212-463e-4bbd-8bfa-41adc00fbe53 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:41.048659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-602ca212-463e-4bbd-8bfa-41adc00fbe53 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:41.057028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-602ca212-463e-4bbd-8bfa-41adc00fbe53 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.057728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-602ca212-463e-4bbd-8bfa-41adc00fbe53 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.058539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-602ca212-463e-4bbd-8bfa-41adc00fbe53 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.058968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-602ca212-463e-4bbd-8bfa-41adc00fbe53 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.093664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-552708b6-206c-4697-99b0-d3ee453cc58d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:41.095234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-552708b6-206c-4697-99b0-d3ee453cc58d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:41.101355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-552708b6-206c-4697-99b0-d3ee453cc58d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.102010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-552708b6-206c-4697-99b0-d3ee453cc58d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.103015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-552708b6-206c-4697-99b0-d3ee453cc58d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.103462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-552708b6-206c-4697-99b0-d3ee453cc58d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.272503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-602ca212-463e-4bbd-8bfa-41adc00fbe53 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:41.279999 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-602ca212-463e-4bbd-8bfa-41adc00fbe53 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1320 microversion: 2.1 time: 0.236806 Feb 19 20:57:41.280771 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 991/1910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:41 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:41.302751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-552708b6-206c-4697-99b0-d3ee453cc58d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:41.304792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b674210d-b19c-4994-b34f-34bd2d04387e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:41.305577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b674210d-b19c-4994-b34f-34bd2d04387e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 3ce58dc5-cdde-4b6e-800d-95033c88b685] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:41.312092 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-552708b6-206c-4697-99b0-d3ee453cc58d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.222288 Feb 19 20:57:41.312722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b674210d-b19c-4994-b34f-34bd2d04387e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.312953 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 920/1911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:41 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:41.313373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b674210d-b19c-4994-b34f-34bd2d04387e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.314169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b674210d-b19c-4994-b34f-34bd2d04387e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.314605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b674210d-b19c-4994-b34f-34bd2d04387e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.332477 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-b674210d-b19c-4994-b34f-34bd2d04387e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] HTTP exception thrown: Instance 3ce58dc5-cdde-4b6e-800d-95033c88b685 could not be found. Feb 19 20:57:41.333149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b674210d-b19c-4994-b34f-34bd2d04387e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Returning 404 to user: Instance 3ce58dc5-cdde-4b6e-800d-95033c88b685 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:41.334226 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b674210d-b19c-4994-b34f-34bd2d04387e tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685" status: 404 len: 111 microversion: 2.1 time: 0.033830 Feb 19 20:57:41.334792 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 992/1912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:41 2022] GET /compute/v2.1/servers/3ce58dc5-cdde-4b6e-800d-95033c88b685 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:57:41.342858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-38d14438-0a8e-44ae-9989-899a79dbb9b8 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:41.343363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-38d14438-0a8e-44ae-9989-899a79dbb9b8 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:41.351708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38d14438-0a8e-44ae-9989-899a79dbb9b8 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.352170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38d14438-0a8e-44ae-9989-899a79dbb9b8 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.352981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38d14438-0a8e-44ae-9989-899a79dbb9b8 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.353419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38d14438-0a8e-44ae-9989-899a79dbb9b8 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.382272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-38d14438-0a8e-44ae-9989-899a79dbb9b8 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:41.463764 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-38d14438-0a8e-44ae-9989-899a79dbb9b8 tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "DELETE /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 204 len: 0 microversion: 2.1 time: 0.124421 Feb 19 20:57:41.465306 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 921/1913] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:41 2022] DELETE /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:41.474711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3914831c-2a28-419b-ba8a-803568bbe28c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:41.483478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3914831c-2a28-419b-ba8a-803568bbe28c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:41.489564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3914831c-2a28-419b-ba8a-803568bbe28c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.490017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3914831c-2a28-419b-ba8a-803568bbe28c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.490810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3914831c-2a28-419b-ba8a-803568bbe28c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.491251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3914831c-2a28-419b-ba8a-803568bbe28c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.658012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-561ad89e-e080-40fd-a393-216f2e9676ae tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:41.658942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-561ad89e-e080-40fd-a393-216f2e9676ae tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:41.666869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-561ad89e-e080-40fd-a393-216f2e9676ae tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.667433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-561ad89e-e080-40fd-a393-216f2e9676ae tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.669119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-561ad89e-e080-40fd-a393-216f2e9676ae tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.669594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-561ad89e-e080-40fd-a393-216f2e9676ae tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.699109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3914831c-2a28-419b-ba8a-803568bbe28c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:41.707619 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3914831c-2a28-419b-ba8a-803568bbe28c tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1478 microversion: 2.1 time: 0.238159 Feb 19 20:57:41.708215 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 993/1914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:41 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1478 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:41.816396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f0f1e2e7-5a89-4c42-a089-a6cff4937741 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:41.817607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f0f1e2e7-5a89-4c42-a089-a6cff4937741 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:41.829853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0f1e2e7-5a89-4c42-a089-a6cff4937741 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.830399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0f1e2e7-5a89-4c42-a089-a6cff4937741 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.831112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0f1e2e7-5a89-4c42-a089-a6cff4937741 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:41.835970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0f1e2e7-5a89-4c42-a089-a6cff4937741 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:41.881408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-561ad89e-e080-40fd-a393-216f2e9676ae tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605ee8b93b804ecc9f21177c4cbf0b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7060607f9342ad93e2ddbab97d8d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:41.890284 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-561ad89e-e080-40fd-a393-216f2e9676ae tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 200 len: 1491 microversion: 2.1 time: 0.242624 Feb 19 20:57:41.892031 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 922/1915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:41 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 1491 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:42.022334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0f1e2e7-5a89-4c42-a089-a6cff4937741 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:42.030453 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f0f1e2e7-5a89-4c42-a089-a6cff4937741 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.219195 Feb 19 20:57:42.031200 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 994/1916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:41 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:42.124551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-606ec4f7-f324-47d2-b42a-729ddf9787a1 req-a29f670d-58fd-4468-be6b-4861e9c678e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d46c81-d4d9-49ea-9d75-cce281fb0945", "tag": "5e90c8de-efa6-4cdf-a9b2-90d008369593"}, {"server_uuid": "7e5ff470-fc3c-4ef2-8811-930620cc10f8", "name": "network-vif-deleted", "tag": "dd609551-9c3b-4d51-ab65-39dd0fa6d3ba"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:42.126958 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:42.126958 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:42.135048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-606ec4f7-f324-47d2-b42a-729ddf9787a1 req-a29f670d-58fd-4468-be6b-4861e9c678e4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:42.135505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-606ec4f7-f324-47d2-b42a-729ddf9787a1 req-a29f670d-58fd-4468-be6b-4861e9c678e4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:42.151689 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-606ec4f7-f324-47d2-b42a-729ddf9787a1 req-a29f670d-58fd-4468-be6b-4861e9c678e4 service nova] Creating event network-changed:5e90c8de-efa6-4cdf-a9b2-90d008369593 for instance 80d46c81-d4d9-49ea-9d75-cce281fb0945 on nch1-master-1 Feb 19 20:57:42.152361 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-606ec4f7-f324-47d2-b42a-729ddf9787a1 req-a29f670d-58fd-4468-be6b-4861e9c678e4 service nova] Creating event network-vif-deleted:dd609551-9c3b-4d51-ab65-39dd0fa6d3ba for instance 7e5ff470-fc3c-4ef2-8811-930620cc10f8 on nch1-master-1 Feb 19 20:57:42.158865 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-606ec4f7-f324-47d2-b42a-729ddf9787a1 req-a29f670d-58fd-4468-be6b-4861e9c678e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037984 Feb 19 20:57:42.159489 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 923/1917] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:42.297955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1370bfcd-4295-4b95-b346-a0c7b4f9aa9e tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.298574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1370bfcd-4295-4b95-b346-a0c7b4f9aa9e tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:42.305499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1370bfcd-4295-4b95-b346-a0c7b4f9aa9e tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:42.305985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1370bfcd-4295-4b95-b346-a0c7b4f9aa9e tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:42.306790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1370bfcd-4295-4b95-b346-a0c7b4f9aa9e tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:42.307605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1370bfcd-4295-4b95-b346-a0c7b4f9aa9e tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:42.331230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-52da504d-6a5f-4d46-9382-0dcd7e1ac2c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.331947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-52da504d-6a5f-4d46-9382-0dcd7e1ac2c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:42.340080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52da504d-6a5f-4d46-9382-0dcd7e1ac2c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:42.340850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52da504d-6a5f-4d46-9382-0dcd7e1ac2c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:42.342105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52da504d-6a5f-4d46-9382-0dcd7e1ac2c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:42.342790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52da504d-6a5f-4d46-9382-0dcd7e1ac2c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:42.572037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1370bfcd-4295-4b95-b346-a0c7b4f9aa9e tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:42.575197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-52da504d-6a5f-4d46-9382-0dcd7e1ac2c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:42.580398 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1370bfcd-4295-4b95-b346-a0c7b4f9aa9e tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1320 microversion: 2.1 time: 0.286468 Feb 19 20:57:42.580987 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 995/1918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:42.584588 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-52da504d-6a5f-4d46-9382-0dcd7e1ac2c8 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.259030 Feb 19 20:57:42.585412 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 924/1919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:42.694207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ff9e7d1e-f9f5-43bb-898d-cbbd2cdf15a7 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.702331 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ff9e7d1e-f9f5-43bb-898d-cbbd2cdf15a7 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.120355 Feb 19 20:57:42.704681 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 996/1920] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:42.714143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e271b58-613e-43ae-8110-fcc4d44d963a tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.724056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c6de61b8-b1a7-42c6-b54b-57a0c73dc27f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.724708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c6de61b8-b1a7-42c6-b54b-57a0c73dc27f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:42.737756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6de61b8-b1a7-42c6-b54b-57a0c73dc27f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:42.738210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6de61b8-b1a7-42c6-b54b-57a0c73dc27f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:42.739005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6de61b8-b1a7-42c6-b54b-57a0c73dc27f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:42.739379 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e271b58-613e-43ae-8110-fcc4d44d963a tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.028772 Feb 19 20:57:42.739511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6de61b8-b1a7-42c6-b54b-57a0c73dc27f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:42.740113 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 925/1921] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:42.757888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c975745a-1d32-474e-832a-ae75fd1766d5 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.766697 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c975745a-1d32-474e-832a-ae75fd1766d5 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016310 Feb 19 20:57:42.767294 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 926/1922] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:42.780766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-400eeb3e-87e6-4e84-8360-0d56c9937046 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.788765 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-400eeb3e-87e6-4e84-8360-0d56c9937046 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011443 Feb 19 20:57:42.789348 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 927/1923] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:42.799626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0e7f4837-a471-458c-ad11-085ef94fb344 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.825148 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0e7f4837-a471-458c-ad11-085ef94fb344 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.029455 Feb 19 20:57:42.825749 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 928/1924] 10.222.0.30 () {58 vars in 1164 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:42.838782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e5d8eb98-4e00-4c7a-b6b4-afebaa5ef1ec tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.846722 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e5d8eb98-4e00-4c7a-b6b4-afebaa5ef1ec tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011394 Feb 19 20:57:42.847294 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 929/1925] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:57:42.856755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f363da6b-cfd7-4e23-9446-12d34bc190dd tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.880349 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f363da6b-cfd7-4e23-9446-12d34bc190dd tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.026765 Feb 19 20:57:42.880982 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 930/1926] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:42.882198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c6de61b8-b1a7-42c6-b54b-57a0c73dc27f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a93bc6b2b584caab5baabf5fdbea583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106062f100884d929b001725a5daa730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:42.889845 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c6de61b8-b1a7-42c6-b54b-57a0c73dc27f tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 200 len: 1478 microversion: 2.1 time: 0.169439 Feb 19 20:57:42.890411 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 997/1927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 1478 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:42.894058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-03351f3e-78aa-404a-8e69-5fd5c8a8fc61 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.906441 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-03351f3e-78aa-404a-8e69-5fd5c8a8fc61 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.016462 Feb 19 20:57:42.907748 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 931/1928] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:57:42.908017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e700a26-4982-4793-a625-46e796bcc73a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.908663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e700a26-4982-4793-a625-46e796bcc73a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] [instance: 7e5ff470-fc3c-4ef2-8811-930620cc10f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:42.915660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e700a26-4982-4793-a625-46e796bcc73a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:42.916112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e700a26-4982-4793-a625-46e796bcc73a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:42.916951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e700a26-4982-4793-a625-46e796bcc73a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:42.917389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e700a26-4982-4793-a625-46e796bcc73a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:42.918868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-855e40f5-d2ca-4431-80b6-b39b2ca7bb10 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.927552 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-855e40f5-d2ca-4431-80b6-b39b2ca7bb10 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012154 Feb 19 20:57:42.928123 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 932/1929] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:42.931137 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-6e700a26-4982-4793-a625-46e796bcc73a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] HTTP exception thrown: Instance 7e5ff470-fc3c-4ef2-8811-930620cc10f8 could not be found. Feb 19 20:57:42.931725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e700a26-4982-4793-a625-46e796bcc73a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] Returning 404 to user: Instance 7e5ff470-fc3c-4ef2-8811-930620cc10f8 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:42.932849 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6e700a26-4982-4793-a625-46e796bcc73a tempest-ServerRescueTestJSON-1630397071 tempest-ServerRescueTestJSON-1630397071-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8" status: 404 len: 111 microversion: 2.1 time: 0.029059 Feb 19 20:57:42.933550 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 998/1930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/servers/7e5ff470-fc3c-4ef2-8811-930620cc10f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:57:42.937988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d92bf6d6-7dd9-4076-b206-d6b781fbc0c1 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.973283 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d92bf6d6-7dd9-4076-b206-d6b781fbc0c1 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.038584 Feb 19 20:57:42.973881 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 933/1931] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:42.988547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1102b981-8e63-49cc-a574-d3cd722fa3fe tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:42.996824 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1102b981-8e63-49cc-a574-d3cd722fa3fe tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012225 Feb 19 20:57:42.997385 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 999/1932] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:43.007923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b8d9d7fc-71ae-419f-97b1-2d48d96ba88c tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.026350 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b8d9d7fc-71ae-419f-97b1-2d48d96ba88c tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.021978 Feb 19 20:57:43.026923 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 934/1933] 10.222.0.30 () {58 vars in 1143 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:43.039196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4d0755b-4786-4105-8364-af0ed973320b tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.047353 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e4d0755b-4786-4105-8364-af0ed973320b tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011733 Feb 19 20:57:43.048077 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1000/1934] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:43.048710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a2f43733-0159-4735-9c26-6668e5cd9951 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.049438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a2f43733-0159-4735-9c26-6668e5cd9951 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:43.055599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2f43733-0159-4735-9c26-6668e5cd9951 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:43.056047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2f43733-0159-4735-9c26-6668e5cd9951 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:43.056876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2f43733-0159-4735-9c26-6668e5cd9951 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:43.057568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2f43733-0159-4735-9c26-6668e5cd9951 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:43.058169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a6e3a7f6-5522-4199-bd0c-d77556c0f8c4 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.082125 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a6e3a7f6-5522-4199-bd0c-d77556c0f8c4 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.027698 Feb 19 20:57:43.082801 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1001/1935] 10.222.0.30 () {58 vars in 1147 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:43.093936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-255a9727-91dc-4b73-8824-576c5ba42efc tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.105780 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-255a9727-91dc-4b73-8824-576c5ba42efc tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.015257 Feb 19 20:57:43.107304 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1002/1936] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:57:43.117695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-336cfa76-7ea8-4101-8352-688d279acaa5 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.125896 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-336cfa76-7ea8-4101-8352-688d279acaa5 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011730 Feb 19 20:57:43.126668 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1003/1937] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:57:43.136482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5556bab4-ae56-4b28-bcc4-2e9f35573ea9 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.173616 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5556bab4-ae56-4b28-bcc4-2e9f35573ea9 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.040505 Feb 19 20:57:43.174719 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1004/1938] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:43.186445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-326c76c6-f1ab-497f-a96a-ecaff29cc652 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.208520 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-326c76c6-f1ab-497f-a96a-ecaff29cc652 tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025812 Feb 19 20:57:43.218445 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1005/1939] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:43.223319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ed20bd2c-176d-4f47-a0fb-4ba26cdf508c tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.231418 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ed20bd2c-176d-4f47-a0fb-4ba26cdf508c tempest-FlavorsV2TestJSON-1136572735 tempest-FlavorsV2TestJSON-1136572735-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011795 Feb 19 20:57:43.240122 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1006/1940] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:43.279768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a2f43733-0159-4735-9c26-6668e5cd9951 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:43.293162 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a2f43733-0159-4735-9c26-6668e5cd9951 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.247599 Feb 19 20:57:43.294765 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 935/1941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:43.600649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-abf613a3-8f44-434c-812d-4acede13a091 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.601913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-abf613a3-8f44-434c-812d-4acede13a091 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:43.603548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-548f1532-9dd3-451f-90f4-e0c59b259c40 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:43.604246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-548f1532-9dd3-451f-90f4-e0c59b259c40 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:43.612680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abf613a3-8f44-434c-812d-4acede13a091 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:43.613792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abf613a3-8f44-434c-812d-4acede13a091 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:43.615250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abf613a3-8f44-434c-812d-4acede13a091 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:43.617492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abf613a3-8f44-434c-812d-4acede13a091 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:43.620872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548f1532-9dd3-451f-90f4-e0c59b259c40 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:43.621334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548f1532-9dd3-451f-90f4-e0c59b259c40 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:43.626361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548f1532-9dd3-451f-90f4-e0c59b259c40 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:43.627133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548f1532-9dd3-451f-90f4-e0c59b259c40 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:44.534883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-548f1532-9dd3-451f-90f4-e0c59b259c40 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:44.543577 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-548f1532-9dd3-451f-90f4-e0c59b259c40 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.945164 Feb 19 20:57:44.544395 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 936/1942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:44.549680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9d77f3e-7cbe-4dcb-9568-4860d74e4e6d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:44.550612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9d77f3e-7cbe-4dcb-9568-4860d74e4e6d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] [instance: 75011271-d547-41a8-b625-be065cdd7483] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:44.558293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9d77f3e-7cbe-4dcb-9568-4860d74e4e6d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:44.559333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9d77f3e-7cbe-4dcb-9568-4860d74e4e6d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:44.560349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9d77f3e-7cbe-4dcb-9568-4860d74e4e6d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:44.560955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9d77f3e-7cbe-4dcb-9568-4860d74e4e6d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:44.573357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-abf613a3-8f44-434c-812d-4acede13a091 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:44.584468 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-abf613a3-8f44-434c-812d-4acede13a091 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1320 microversion: 2.1 time: 0.988573 Feb 19 20:57:44.586009 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-a9d77f3e-7cbe-4dcb-9568-4860d74e4e6d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] HTTP exception thrown: Instance 75011271-d547-41a8-b625-be065cdd7483 could not be found. Feb 19 20:57:44.586815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9d77f3e-7cbe-4dcb-9568-4860d74e4e6d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] Returning 404 to user: Instance 75011271-d547-41a8-b625-be065cdd7483 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:44.587492 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1007/1943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:43 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1320 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:44.588154 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9d77f3e-7cbe-4dcb-9568-4860d74e4e6d tempest-ServersAdminNegativeTestJSON-1342040653 tempest-ServersAdminNegativeTestJSON-1342040653-project] 10.222.0.30 "GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483" status: 404 len: 111 microversion: 2.1 time: 0.042200 Feb 19 20:57:44.591848 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 937/1944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:44 2022] GET /compute/v2.1/servers/75011271-d547-41a8-b625-be065cdd7483 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:44.598241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eb04efdd-f565-4ccf-b621-b7391b784198 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:44.598241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eb04efdd-f565-4ccf-b621-b7391b784198 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:44.604706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb04efdd-f565-4ccf-b621-b7391b784198 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:44.605389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb04efdd-f565-4ccf-b621-b7391b784198 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:44.606155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb04efdd-f565-4ccf-b621-b7391b784198 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:44.606597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb04efdd-f565-4ccf-b621-b7391b784198 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:44.616556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-cae6f35e-cd1d-478c-a328-31a879c05111 req-403a667f-19b4-4932-a2a9-0dde5c5b713d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75011271-d547-41a8-b625-be065cdd7483", "name": "network-vif-deleted", "tag": "7d04593a-188e-4b4f-ab61-c23f7653caf7"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:44.619165 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:44.619165 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:44.640271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cae6f35e-cd1d-478c-a328-31a879c05111 req-403a667f-19b4-4932-a2a9-0dde5c5b713d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:44.641069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cae6f35e-cd1d-478c-a328-31a879c05111 req-403a667f-19b4-4932-a2a9-0dde5c5b713d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:44.653376 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-cae6f35e-cd1d-478c-a328-31a879c05111 req-403a667f-19b4-4932-a2a9-0dde5c5b713d service nova] Creating event network-vif-deleted:7d04593a-188e-4b4f-ab61-c23f7653caf7 for instance 75011271-d547-41a8-b625-be065cdd7483 on nch1-master-1 Feb 19 20:57:44.660586 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-cae6f35e-cd1d-478c-a328-31a879c05111 req-403a667f-19b4-4932-a2a9-0dde5c5b713d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070582 Feb 19 20:57:44.662082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1008/1945] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:44.849755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-bce5ca38-2dfe-4492-83ac-b1e16f663c46 req-34d89e1f-cd04-47af-a2de-62e604c8b384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b048357b-44b4-4c70-8ed5-96deddc7d40e", "name": "network-vif-unplugged", "status": "completed", "tag": "59f45170-96d5-43f5-8368-d97e4afa51dc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:44.856773 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:44.856773 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:44.866316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bce5ca38-2dfe-4492-83ac-b1e16f663c46 req-34d89e1f-cd04-47af-a2de-62e604c8b384 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:44.866758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bce5ca38-2dfe-4492-83ac-b1e16f663c46 req-34d89e1f-cd04-47af-a2de-62e604c8b384 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:44.879190 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-bce5ca38-2dfe-4492-83ac-b1e16f663c46 req-34d89e1f-cd04-47af-a2de-62e604c8b384 service nova] Creating event network-vif-unplugged:59f45170-96d5-43f5-8368-d97e4afa51dc for instance b048357b-44b4-4c70-8ed5-96deddc7d40e on nch1-master-1 Feb 19 20:57:44.883914 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-bce5ca38-2dfe-4492-83ac-b1e16f663c46 req-34d89e1f-cd04-47af-a2de-62e604c8b384 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049478 Feb 19 20:57:44.884495 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1009/1946] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:57:45.087295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eb04efdd-f565-4ccf-b621-b7391b784198 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:45.104596 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eb04efdd-f565-4ccf-b621-b7391b784198 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.510443 Feb 19 20:57:45.106171 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 938/1947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:44 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:45.562686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d073f0c4-4764-4cfc-95d7-d5cc73b9762a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:45.571023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d073f0c4-4764-4cfc-95d7-d5cc73b9762a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:45.589024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d073f0c4-4764-4cfc-95d7-d5cc73b9762a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:45.589825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d073f0c4-4764-4cfc-95d7-d5cc73b9762a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:45.592314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d073f0c4-4764-4cfc-95d7-d5cc73b9762a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:45.594846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d073f0c4-4764-4cfc-95d7-d5cc73b9762a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:45.604652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57e8c796-46dc-49ed-8de3-3e4adc560624 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:45.605283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57e8c796-46dc-49ed-8de3-3e4adc560624 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:45.612959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57e8c796-46dc-49ed-8de3-3e4adc560624 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:45.613417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57e8c796-46dc-49ed-8de3-3e4adc560624 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:45.614233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57e8c796-46dc-49ed-8de3-3e4adc560624 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:45.616266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57e8c796-46dc-49ed-8de3-3e4adc560624 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:46.034903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d073f0c4-4764-4cfc-95d7-d5cc73b9762a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:46.043205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-57e8c796-46dc-49ed-8de3-3e4adc560624 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:46.050377 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d073f0c4-4764-4cfc-95d7-d5cc73b9762a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.491608 Feb 19 20:57:46.053531 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57e8c796-46dc-49ed-8de3-3e4adc560624 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1320 microversion: 2.1 time: 0.454332 Feb 19 20:57:46.055161 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 939/1948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:45 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1320 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:46.058065 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1010/1949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:45 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:46.124762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e9a6b88a-a979-4f22-aa76-71f26fffa203 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:46.125415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e9a6b88a-a979-4f22-aa76-71f26fffa203 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:46.132430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a6b88a-a979-4f22-aa76-71f26fffa203 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:46.133875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a6b88a-a979-4f22-aa76-71f26fffa203 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:46.135242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a6b88a-a979-4f22-aa76-71f26fffa203 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:46.135880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9a6b88a-a979-4f22-aa76-71f26fffa203 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:46.464688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e9a6b88a-a979-4f22-aa76-71f26fffa203 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:46.479693 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e9a6b88a-a979-4f22-aa76-71f26fffa203 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.360743 Feb 19 20:57:46.491621 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 940/1950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:46 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:46.868826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-64217d1e-c4d9-4c2d-9aee-8e07b65e25a4 req-8d808d9a-e756-424a-84fa-dfd6c7738826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d46c81-d4d9-49ea-9d75-cce281fb0945", "name": "network-vif-plugged", "status": "completed", "tag": "5e90c8de-efa6-4cdf-a9b2-90d008369593"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:46.870438 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:46.870438 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:46.882206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-64217d1e-c4d9-4c2d-9aee-8e07b65e25a4 req-8d808d9a-e756-424a-84fa-dfd6c7738826 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:46.882637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-64217d1e-c4d9-4c2d-9aee-8e07b65e25a4 req-8d808d9a-e756-424a-84fa-dfd6c7738826 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:46.908575 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-64217d1e-c4d9-4c2d-9aee-8e07b65e25a4 req-8d808d9a-e756-424a-84fa-dfd6c7738826 service nova] Creating event network-vif-plugged:5e90c8de-efa6-4cdf-a9b2-90d008369593 for instance 80d46c81-d4d9-49ea-9d75-cce281fb0945 on nch1-master-1 Feb 19 20:57:46.922243 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-64217d1e-c4d9-4c2d-9aee-8e07b65e25a4 req-8d808d9a-e756-424a-84fa-dfd6c7738826 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058125 Feb 19 20:57:46.924042 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1011/1951] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:46.991259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-47f4b243-8b3f-4bdc-a71c-3af8e42edc8f req-0cf9e299-1825-4756-955f-991345b41dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b048357b-44b4-4c70-8ed5-96deddc7d40e", "tag": "59f45170-96d5-43f5-8368-d97e4afa51dc"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:46.993014 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:46.993014 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:47.006310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-47f4b243-8b3f-4bdc-a71c-3af8e42edc8f req-0cf9e299-1825-4756-955f-991345b41dab service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:47.011277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-47f4b243-8b3f-4bdc-a71c-3af8e42edc8f req-0cf9e299-1825-4756-955f-991345b41dab service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:47.036408 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-47f4b243-8b3f-4bdc-a71c-3af8e42edc8f req-0cf9e299-1825-4756-955f-991345b41dab service nova] Creating event network-changed:59f45170-96d5-43f5-8368-d97e4afa51dc for instance b048357b-44b4-4c70-8ed5-96deddc7d40e on nch1-master-1 Feb 19 20:57:47.048461 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-47f4b243-8b3f-4bdc-a71c-3af8e42edc8f req-0cf9e299-1825-4756-955f-991345b41dab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062569 Feb 19 20:57:47.056313 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 941/1952] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:57:47.069005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ebe9cab1-9764-4d1f-9d21-a1c615719b36 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:47.070309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ebe9cab1-9764-4d1f-9d21-a1c615719b36 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:47.074100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0a70061c-239c-45b0-98c9-a66e4b7af799 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:47.076602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0a70061c-239c-45b0-98c9-a66e4b7af799 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:47.087096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebe9cab1-9764-4d1f-9d21-a1c615719b36 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:47.089674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebe9cab1-9764-4d1f-9d21-a1c615719b36 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:47.091036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a70061c-239c-45b0-98c9-a66e4b7af799 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:47.091472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a70061c-239c-45b0-98c9-a66e4b7af799 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:47.092140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebe9cab1-9764-4d1f-9d21-a1c615719b36 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:47.092272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a70061c-239c-45b0-98c9-a66e4b7af799 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:47.092720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a70061c-239c-45b0-98c9-a66e4b7af799 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:47.092991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebe9cab1-9764-4d1f-9d21-a1c615719b36 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:47.731952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0a70061c-239c-45b0-98c9-a66e4b7af799 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:47.732355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ebe9cab1-9764-4d1f-9d21-a1c615719b36 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:47.754259 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0a70061c-239c-45b0-98c9-a66e4b7af799 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1320 microversion: 2.1 time: 0.686453 Feb 19 20:57:47.755476 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ebe9cab1-9764-4d1f-9d21-a1c615719b36 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.687351 Feb 19 20:57:47.757521 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 942/1953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:47 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1320 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:47.770951 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1012/1954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:47 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:47.775042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7d5bdf37-4f76-45f4-a650-b461be03574e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:47.775939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7d5bdf37-4f76-45f4-a650-b461be03574e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:47.782758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d5bdf37-4f76-45f4-a650-b461be03574e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:47.783351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d5bdf37-4f76-45f4-a650-b461be03574e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:47.784246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d5bdf37-4f76-45f4-a650-b461be03574e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:47.784965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d5bdf37-4f76-45f4-a650-b461be03574e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:48.220523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7d5bdf37-4f76-45f4-a650-b461be03574e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:48.236341 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7d5bdf37-4f76-45f4-a650-b461be03574e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.476900 Feb 19 20:57:48.236938 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 943/1955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:47 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:48.775977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5f6a36cd-d345-41aa-abee-efe492d2a1e9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:48.776425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f8b5007e-aefd-4750-9094-01fe8d9e7d66 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:48.776948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5f6a36cd-d345-41aa-abee-efe492d2a1e9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:48.777756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f8b5007e-aefd-4750-9094-01fe8d9e7d66 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:48.783303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f6a36cd-d345-41aa-abee-efe492d2a1e9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:48.783764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f6a36cd-d345-41aa-abee-efe492d2a1e9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:48.784599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f6a36cd-d345-41aa-abee-efe492d2a1e9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:48.785039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f6a36cd-d345-41aa-abee-efe492d2a1e9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:48.801060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8b5007e-aefd-4750-9094-01fe8d9e7d66 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:48.803574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8b5007e-aefd-4750-9094-01fe8d9e7d66 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:48.824649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8b5007e-aefd-4750-9094-01fe8d9e7d66 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:48.825265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8b5007e-aefd-4750-9094-01fe8d9e7d66 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:49.388105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5f6a36cd-d345-41aa-abee-efe492d2a1e9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:49.390751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f8b5007e-aefd-4750-9094-01fe8d9e7d66 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:49.400121 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5f6a36cd-d345-41aa-abee-efe492d2a1e9 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.627767 Feb 19 20:57:49.400577 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f8b5007e-aefd-4750-9094-01fe8d9e7d66 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1320 microversion: 2.1 time: 0.631369 Feb 19 20:57:49.400947 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 944/1956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:48 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:49.405946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-03276522-2335-4794-b046-aeee355daf66 req-7d967f32-2ae4-475a-aff7-39a5629832e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c8a420-124f-496a-9605-633f80408b4b", "name": "network-vif-plugged", "status": "completed", "tag": "3f866cda-3fba-4690-9199-9e11ff500810"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:49.411482 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:49.411482 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:49.415833 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1013/1957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:48 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1320 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:49.434297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b82527d-8eb5-4fff-b1bc-0381bd0b5880 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:49.435405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9b82527d-8eb5-4fff-b1bc-0381bd0b5880 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:49.445521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b82527d-8eb5-4fff-b1bc-0381bd0b5880 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:49.449181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b82527d-8eb5-4fff-b1bc-0381bd0b5880 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:49.450625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b82527d-8eb5-4fff-b1bc-0381bd0b5880 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:49.450910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-03276522-2335-4794-b046-aeee355daf66 req-7d967f32-2ae4-475a-aff7-39a5629832e0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:49.451374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-03276522-2335-4794-b046-aeee355daf66 req-7d967f32-2ae4-475a-aff7-39a5629832e0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:49.451785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b82527d-8eb5-4fff-b1bc-0381bd0b5880 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:49.474022 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-03276522-2335-4794-b046-aeee355daf66 req-7d967f32-2ae4-475a-aff7-39a5629832e0 service nova] Creating event network-vif-plugged:3f866cda-3fba-4690-9199-9e11ff500810 for instance 79c8a420-124f-496a-9605-633f80408b4b on nch2-master-1 Feb 19 20:57:49.487901 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-03276522-2335-4794-b046-aeee355daf66 req-7d967f32-2ae4-475a-aff7-39a5629832e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085526 Feb 19 20:57:49.489174 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 945/1958] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:49.734067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9b82527d-8eb5-4fff-b1bc-0381bd0b5880 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:49.743591 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b82527d-8eb5-4fff-b1bc-0381bd0b5880 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.324331 Feb 19 20:57:49.746428 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1014/1959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:49 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:50.420380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8572f11c-3619-41a8-8000-8eb70621e6f1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:50.421318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8572f11c-3619-41a8-8000-8eb70621e6f1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:50.432193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a692cf1-36d6-414f-abdd-de9090867c7b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:50.433392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a692cf1-36d6-414f-abdd-de9090867c7b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:50.435487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8572f11c-3619-41a8-8000-8eb70621e6f1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:50.436118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8572f11c-3619-41a8-8000-8eb70621e6f1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:50.439106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8572f11c-3619-41a8-8000-8eb70621e6f1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:50.442095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a692cf1-36d6-414f-abdd-de9090867c7b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:50.442718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8572f11c-3619-41a8-8000-8eb70621e6f1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:50.445059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a692cf1-36d6-414f-abdd-de9090867c7b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:50.447112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a692cf1-36d6-414f-abdd-de9090867c7b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:50.448320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a692cf1-36d6-414f-abdd-de9090867c7b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:50.726516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8572f11c-3619-41a8-8000-8eb70621e6f1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:50.739115 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8572f11c-3619-41a8-8000-8eb70621e6f1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.320245 Feb 19 20:57:50.742148 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 946/1960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:50 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:50.744299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a692cf1-36d6-414f-abdd-de9090867c7b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:50.753208 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a692cf1-36d6-414f-abdd-de9090867c7b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 200 len: 1508 microversion: 2.1 time: 0.324661 Feb 19 20:57:50.754249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1015/1961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:50 2022] GET /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 1508 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:50.771132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:50.771890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:50.776975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad1f1880-6741-494d-9aad-ba07ef208c07 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:50.778374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ad1f1880-6741-494d-9aad-ba07ef208c07 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 79c8a420-124f-496a-9605-633f80408b4b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:50.790762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:50.791224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:50.793134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:50.793821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:50.798137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad1f1880-6741-494d-9aad-ba07ef208c07 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:50.798593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad1f1880-6741-494d-9aad-ba07ef208c07 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:50.799390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad1f1880-6741-494d-9aad-ba07ef208c07 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:50.799829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad1f1880-6741-494d-9aad-ba07ef208c07 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:51.104053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ad1f1880-6741-494d-9aad-ba07ef208c07 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:51.123302 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ad1f1880-6741-494d-9aad-ba07ef208c07 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b" status: 200 len: 1320 microversion: 2.1 time: 0.354406 Feb 19 20:57:51.123908 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1016/1962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:50 2022] GET /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b => generated 1320 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:51.170927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:51.181069 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.417614 Feb 19 20:57:51.182047 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 947/1963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:50 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:51.759617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0cde49f9-5e59-4d23-a199-f46a6547c316 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:51.760779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0cde49f9-5e59-4d23-a199-f46a6547c316 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:51.773450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cde49f9-5e59-4d23-a199-f46a6547c316 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:51.774036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cde49f9-5e59-4d23-a199-f46a6547c316 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:51.774774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cde49f9-5e59-4d23-a199-f46a6547c316 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:51.777221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cde49f9-5e59-4d23-a199-f46a6547c316 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:52.037870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:52.038857 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b03102d-c9b0-4ae6-b95d-204592ad95f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001318 Feb 19 20:57:52.044630 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 948/1964] 10.222.0.30 () {56 vars in 885 bytes} [Sat Feb 19 20:57:52 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Feb 19 20:57:52.054272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0cde49f9-5e59-4d23-a199-f46a6547c316 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:52.069120 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0cde49f9-5e59-4d23-a199-f46a6547c316 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.312198 Feb 19 20:57:52.081320 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1017/1965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:51 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:52.158723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bb92c382-cf2b-4ee3-a263-696e163f8694 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:52.158723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bb92c382-cf2b-4ee3-a263-696e163f8694 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 79c8a420-124f-496a-9605-633f80408b4b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:52.165942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb92c382-cf2b-4ee3-a263-696e163f8694 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:52.169025 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb92c382-cf2b-4ee3-a263-696e163f8694 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:52.170177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb92c382-cf2b-4ee3-a263-696e163f8694 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:52.172062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb92c382-cf2b-4ee3-a263-696e163f8694 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:52.199515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-08dc86a3-dd63-4ee9-9808-4c2a9b162d2d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:52.200248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-08dc86a3-dd63-4ee9-9808-4c2a9b162d2d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:52.220717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08dc86a3-dd63-4ee9-9808-4c2a9b162d2d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:52.221329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08dc86a3-dd63-4ee9-9808-4c2a9b162d2d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:52.222935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08dc86a3-dd63-4ee9-9808-4c2a9b162d2d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:52.223322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08dc86a3-dd63-4ee9-9808-4c2a9b162d2d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:52.648802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bb92c382-cf2b-4ee3-a263-696e163f8694 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:52.668551 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bb92c382-cf2b-4ee3-a263-696e163f8694 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b" status: 200 len: 1320 microversion: 2.1 time: 0.527170 Feb 19 20:57:52.681180 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 949/1966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:52 2022] GET /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b => generated 1320 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:52.717062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-08dc86a3-dd63-4ee9-9808-4c2a9b162d2d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:52.729939 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-08dc86a3-dd63-4ee9-9808-4c2a9b162d2d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.534716 Feb 19 20:57:52.731891 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1018/1967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:52 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:52.886128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-406718389", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "46b8fcf2-9c1f-4149-9ebf-600e0208ce2d"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:52.983433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] validate_networks() for [('46b8fcf2-9c1f-4149-9ebf-600e0208ce2d', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:57:53.042947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-58e0deea-51c4-42ff-b8dd-3ed532dd5d39 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] Calling method '.version_select at 0x7f64677a2310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:53.159454 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-58e0deea-51c4-42ff-b8dd-3ed532dd5d39 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.209498 Feb 19 20:57:53.160130 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1019/1968] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 20:57:52 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 20:57:53.174049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0836be2a-291e-43b4-b730-0b03b4cf7dfd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:53.174667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0836be2a-291e-43b4-b730-0b03b4cf7dfd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:53.180918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0836be2a-291e-43b4-b730-0b03b4cf7dfd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:53.181611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0836be2a-291e-43b4-b730-0b03b4cf7dfd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:53.182662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0836be2a-291e-43b4-b730-0b03b4cf7dfd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:53.183101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0836be2a-291e-43b4-b730-0b03b4cf7dfd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:53.593630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0836be2a-291e-43b4-b730-0b03b4cf7dfd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:53.604911 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0836be2a-291e-43b4-b730-0b03b4cf7dfd tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.436248 Feb 19 20:57:53.605534 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1020/1969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:53 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:53.626342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-716d2116-1b46-458a-95ee-5e104271d246 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] Action: 'create', calling method: .version_select at 0x7f6467905c10>, body: {"pool": "non_exist_pool"} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:53.723279 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-716d2116-1b46-458a-95ee-5e104271d246 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] HTTP exception thrown: Floating IP pool not found. Feb 19 20:57:53.723897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-716d2116-1b46-458a-95ee-5e104271d246 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] Returning 404 to user: Floating IP pool not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:53.724854 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-716d2116-1b46-458a-95ee-5e104271d246 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.102473 Feb 19 20:57:53.731078 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1021/1970] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 20:57:53 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:57:53.731879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-29a5f558-86c3-44ee-b3c9-a17341a60de1 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:53.732193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-29a5f558-86c3-44ee-b3c9-a17341a60de1 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 79c8a420-124f-496a-9605-633f80408b4b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:53.741574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29a5f558-86c3-44ee-b3c9-a17341a60de1 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:53.742025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29a5f558-86c3-44ee-b3c9-a17341a60de1 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:53.743068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29a5f558-86c3-44ee-b3c9-a17341a60de1 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:53.743684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29a5f558-86c3-44ee-b3c9-a17341a60de1 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:53.814068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:57:53.814639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:57:53.815125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:57:53.815564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:57:53.815976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:57:53.825879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:53.826332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:53.827514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:53.827991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:53.852836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Getting quotas for project 0eaac4cd79ca4f808d452057a3216fdd. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:57:53.857093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Getting quotas for user 927e2fa8122b464a8046bdc5a2c94544 and project 0eaac4cd79ca4f808d452057a3216fdd. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:57:53.871213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:57:53.873612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:57:53.924528 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-08bda4e8-4c32-4d8e-8548-fe630b0e4e31 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.250572 Feb 19 20:57:53.925518 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 950/1971] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:57:53.930090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-17867e8a-f631-40ed-8781-78c0e7740510 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] Calling method '.version_select at 0x7f6467d16b80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:54.043233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-17867e8a-f631-40ed-8781-78c0e7740510 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6cb9a7d7-af9d-49d6-ba29-543c04fc90ad could not be found", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 20:57:54.043984 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-17867e8a-f631-40ed-8781-78c0e7740510 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] HTTP exception thrown: Floating IP not found for ID 6cb9a7d7-af9d-49d6-ba29-543c04fc90ad Feb 19 20:57:54.044638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-17867e8a-f631-40ed-8781-78c0e7740510 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] Returning 404 to user: Floating IP not found for ID 6cb9a7d7-af9d-49d6-ba29-543c04fc90ad {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:57:54.045885 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-17867e8a-f631-40ed-8781-78c0e7740510 tempest-FloatingIPsNegativeTestJSON-1111180806 tempest-FloatingIPsNegativeTestJSON-1111180806-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/6cb9a7d7-af9d-49d6-ba29-543c04fc90ad" status: 404 len: 111 microversion: 2.1 time: 0.119361 Feb 19 20:57:54.046460 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 951/1972] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 20:57:53 2022] DELETE /compute/v2.1/os-floating-ips/6cb9a7d7-af9d-49d6-ba29-543c04fc90ad => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:57:54.052637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d250660-2e36-46d2-9ce4-39f30b5fae84 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:54.065229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2d250660-2e36-46d2-9ce4-39f30b5fae84 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:54.073721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d250660-2e36-46d2-9ce4-39f30b5fae84 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:54.074173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d250660-2e36-46d2-9ce4-39f30b5fae84 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:54.075958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d250660-2e36-46d2-9ce4-39f30b5fae84 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:54.076698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d250660-2e36-46d2-9ce4-39f30b5fae84 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:54.125512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29a5f558-86c3-44ee-b3c9-a17341a60de1 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:54.136343 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-29a5f558-86c3-44ee-b3c9-a17341a60de1 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b" status: 200 len: 1320 microversion: 2.1 time: 0.409266 Feb 19 20:57:54.144047 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1022/1973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:53 2022] GET /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b => generated 1320 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:54.166172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-799f2858-4a50-45a3-9f70-d6c875bc8832 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:54.167608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-799f2858-4a50-45a3-9f70-d6c875bc8832 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:54.324652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-799f2858-4a50-45a3-9f70-d6c875bc8832 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:54.334521 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-799f2858-4a50-45a3-9f70-d6c875bc8832 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1217 microversion: 2.1 time: 0.188087 Feb 19 20:57:54.345539 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1023/1974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:54 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:54.375094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d250660-2e36-46d2-9ce4-39f30b5fae84 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:54.386580 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2d250660-2e36-46d2-9ce4-39f30b5fae84 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.338387 Feb 19 20:57:54.387395 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 952/1975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:54 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:54.525487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3763c870-a416-4c3e-b5c9-f41e5be451a9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:54.529739 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:54.529739 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:54.534086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3763c870-a416-4c3e-b5c9-f41e5be451a9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:54.538061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3763c870-a416-4c3e-b5c9-f41e5be451a9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Searching by: {'deleted': False, 'project_id': '5c496adb59f3467687458650e28da232'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:57:54.552719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3763c870-a416-4c3e-b5c9-f41e5be451a9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:54.558452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3763c870-a416-4c3e-b5c9-f41e5be451a9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:54.559435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3763c870-a416-4c3e-b5c9-f41e5be451a9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:54.559897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3763c870-a416-4c3e-b5c9-f41e5be451a9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:54.623177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c7dae58-8105-4e4a-8de7-47bb824b9882 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:54.623807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8c7dae58-8105-4e4a-8de7-47bb824b9882 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:54.627955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-3763c870-a416-4c3e-b5c9-f41e5be451a9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:57:54.637279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c7dae58-8105-4e4a-8de7-47bb824b9882 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:54.637823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c7dae58-8105-4e4a-8de7-47bb824b9882 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:54.642648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c7dae58-8105-4e4a-8de7-47bb824b9882 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:54.643754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c7dae58-8105-4e4a-8de7-47bb824b9882 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:54.713743 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3763c870-a416-4c3e-b5c9-f41e5be451a9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.194260 Feb 19 20:57:54.718140 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1024/1976] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 20:57:54 2022] GET /compute/v2.1/servers => generated 334 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:54.737691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:54.741709 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:54.741709 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:54.743828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:54.745258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Searching by: {'deleted': False, 'project_id': '5c496adb59f3467687458650e28da232'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:57:54.756117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:54.758302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:54.758302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:54.759114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:54.807685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:57:54.859081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:54.868472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:54.869545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.111500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8c7dae58-8105-4e4a-8de7-47bb824b9882 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:55.126581 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c7dae58-8105-4e4a-8de7-47bb824b9882 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1549 microversion: 2.1 time: 0.506286 Feb 19 20:57:55.139454 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 953/1977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:54 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1549 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:55.161916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a901e5fd-395a-4391-bd20-5deccabc6f68 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:55.162573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a901e5fd-395a-4391-bd20-5deccabc6f68 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 79c8a420-124f-496a-9605-633f80408b4b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:55.170159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a901e5fd-395a-4391-bd20-5deccabc6f68 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.170712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a901e5fd-395a-4391-bd20-5deccabc6f68 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.171799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a901e5fd-395a-4391-bd20-5deccabc6f68 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.173043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a901e5fd-395a-4391-bd20-5deccabc6f68 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.190144 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5329040b-67fd-40ff-8a38-96bf73b9f58b tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.466292 Feb 19 20:57:55.190743 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1025/1978] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:57:54 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:55.210979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-37bb01eb-e005-49dd-af3d-b2ae797aeddc tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:55.220985 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-37bb01eb-e005-49dd-af3d-b2ae797aeddc tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014583 Feb 19 20:57:55.227006 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1026/1979] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:57:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:55.352844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4095ba82-aa3f-449e-9582-6d1708e85604 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:55.353587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4095ba82-aa3f-449e-9582-6d1708e85604 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:55.364544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4095ba82-aa3f-449e-9582-6d1708e85604 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.365236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4095ba82-aa3f-449e-9582-6d1708e85604 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.369584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4095ba82-aa3f-449e-9582-6d1708e85604 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.370274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4095ba82-aa3f-449e-9582-6d1708e85604 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.500765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4095ba82-aa3f-449e-9582-6d1708e85604 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:55.516923 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4095ba82-aa3f-449e-9582-6d1708e85604 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1269 microversion: 2.1 time: 0.168462 Feb 19 20:57:55.521456 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1027/1980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:55 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:57:55.531057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-520b019f-20e1-4777-a938-7bb35bbe518f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:55.532440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-520b019f-20e1-4777-a938-7bb35bbe518f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:55.544797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-520b019f-20e1-4777-a938-7bb35bbe518f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.546431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-520b019f-20e1-4777-a938-7bb35bbe518f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.547816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-520b019f-20e1-4777-a938-7bb35bbe518f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.548260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-520b019f-20e1-4777-a938-7bb35bbe518f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.593723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a901e5fd-395a-4391-bd20-5deccabc6f68 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:55.606787 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a901e5fd-395a-4391-bd20-5deccabc6f68 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b" status: 200 len: 1508 microversion: 2.1 time: 0.449166 Feb 19 20:57:55.621837 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 954/1981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:55 2022] GET /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:55.633819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f4d318a-3d79-4751-b082-406896992831 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:55.634576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f4d318a-3d79-4751-b082-406896992831 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:55.646362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f4d318a-3d79-4751-b082-406896992831 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.647128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f4d318a-3d79-4751-b082-406896992831 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.654083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f4d318a-3d79-4751-b082-406896992831 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.658058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f4d318a-3d79-4751-b082-406896992831 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.736760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f4d318a-3d79-4751-b082-406896992831 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:55.958360 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f4d318a-3d79-4751-b082-406896992831 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 204 len: 0 microversion: 2.1 time: 0.334702 Feb 19 20:57:55.959184 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 955/1982] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:55 2022] DELETE /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:55.970706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8cadbae0-50eb-4b98-9d13-9f2e92bc520f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:55.971319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8cadbae0-50eb-4b98-9d13-9f2e92bc520f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 79c8a420-124f-496a-9605-633f80408b4b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:55.978873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8cadbae0-50eb-4b98-9d13-9f2e92bc520f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.979326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8cadbae0-50eb-4b98-9d13-9f2e92bc520f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:55.980131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8cadbae0-50eb-4b98-9d13-9f2e92bc520f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:55.980608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8cadbae0-50eb-4b98-9d13-9f2e92bc520f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.012449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8cadbae0-50eb-4b98-9d13-9f2e92bc520f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 79c8a420-124f-496a-9605-633f80408b4b] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:56.075842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-520b019f-20e1-4777-a938-7bb35bbe518f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:56.088086 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-520b019f-20e1-4777-a938-7bb35bbe518f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.565050 Feb 19 20:57:56.093180 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1028/1983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:55 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:56.098715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1ddcd8a5-05e5-481c-9460-5375d9b20f99 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:56.099328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1ddcd8a5-05e5-481c-9460-5375d9b20f99 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:56.116126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ddcd8a5-05e5-481c-9460-5375d9b20f99 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.117646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ddcd8a5-05e5-481c-9460-5375d9b20f99 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.117867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ddcd8a5-05e5-481c-9460-5375d9b20f99 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.118288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ddcd8a5-05e5-481c-9460-5375d9b20f99 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.178930 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8cadbae0-50eb-4b98-9d13-9f2e92bc520f tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "DELETE /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b" status: 204 len: 0 microversion: 2.1 time: 0.213602 Feb 19 20:57:56.179611 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 956/1984] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:55 2022] DELETE /compute/v2.1/servers/79c8a420-124f-496a-9605-633f80408b4b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:56.192464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11a490de-5c02-43bf-bb31-c00bd1c7fdfc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:56.193231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11a490de-5c02-43bf-bb31-c00bd1c7fdfc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:56.199652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11a490de-5c02-43bf-bb31-c00bd1c7fdfc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.199987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11a490de-5c02-43bf-bb31-c00bd1c7fdfc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.200808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11a490de-5c02-43bf-bb31-c00bd1c7fdfc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.201269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11a490de-5c02-43bf-bb31-c00bd1c7fdfc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.495121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1ddcd8a5-05e5-481c-9460-5375d9b20f99 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:56.504819 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1ddcd8a5-05e5-481c-9460-5375d9b20f99 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1698 microversion: 2.1 time: 0.410517 Feb 19 20:57:56.505952 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1029/1985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:56 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1698 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:56.510435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d466c26-2df2-4964-ba78-4864115a7fe7 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:56.511110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1d466c26-2df2-4964-ba78-4864115a7fe7 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:56.517916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d466c26-2df2-4964-ba78-4864115a7fe7 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.518406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d466c26-2df2-4964-ba78-4864115a7fe7 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.519156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d466c26-2df2-4964-ba78-4864115a7fe7 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.519762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d466c26-2df2-4964-ba78-4864115a7fe7 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.557644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1d466c26-2df2-4964-ba78-4864115a7fe7 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 80d46c81-d4d9-49ea-9d75-cce281fb0945] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:57:56.567415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11a490de-5c02-43bf-bb31-c00bd1c7fdfc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:56.580048 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11a490de-5c02-43bf-bb31-c00bd1c7fdfc tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1539 microversion: 2.1 time: 0.399224 Feb 19 20:57:56.580697 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 957/1986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:56 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1539 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:56.598560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6210bf8f-b260-4797-acf2-f574c79d4141 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f6467d165e0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:56.702874 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6210bf8f-b260-4797-acf2-f574c79d4141 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/d30cf863-c403-45ae-9e3c-2a8d5f047f3e" status: 200 len: 344 microversion: 2.1 time: 0.107867 Feb 19 20:57:56.703631 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 958/1987] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 20:57:56 2022] GET /compute/v2.1/os-volumes/d30cf863-c403-45ae-9e3c-2a8d5f047f3e => generated 344 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:56.708122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-78a934c5-4452-4b8a-a53b-9fbb1718e577 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:56.709642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-78a934c5-4452-4b8a-a53b-9fbb1718e577 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:56.717092 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d466c26-2df2-4964-ba78-4864115a7fe7 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945" status: 204 len: 0 microversion: 2.1 time: 0.209659 Feb 19 20:57:56.718818 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1030/1988] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:57:56 2022] DELETE /compute/v2.1/servers/80d46c81-d4d9-49ea-9d75-cce281fb0945 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:57:56.730209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd5b46d1-b94a-4d33-adb9-de6eac8fe833 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '.version_select at 0x7f6467905c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:56.732414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78a934c5-4452-4b8a-a53b-9fbb1718e577 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.733066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78a934c5-4452-4b8a-a53b-9fbb1718e577 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.735379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78a934c5-4452-4b8a-a53b-9fbb1718e577 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.735995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78a934c5-4452-4b8a-a53b-9fbb1718e577 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.737135 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:56.737135 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:56.740283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd5b46d1-b94a-4d33-adb9-de6eac8fe833 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.747288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd5b46d1-b94a-4d33-adb9-de6eac8fe833 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.791158 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fd5b46d1-b94a-4d33-adb9-de6eac8fe833 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.068404 Feb 19 20:57:56.792196 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1031/1989] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:57:56 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:56.814515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5fde25ec-b724-492b-9fd5-6869e40b60f8 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:56.818663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5fde25ec-b724-492b-9fd5-6869e40b60f8 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:56.837253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fde25ec-b724-492b-9fd5-6869e40b60f8 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.838120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fde25ec-b724-492b-9fd5-6869e40b60f8 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.841322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fde25ec-b724-492b-9fd5-6869e40b60f8 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:56.842057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5fde25ec-b724-492b-9fd5-6869e40b60f8 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:56.893454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-78a934c5-4452-4b8a-a53b-9fbb1718e577 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:56.902504 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-78a934c5-4452-4b8a-a53b-9fbb1718e577 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1275 microversion: 2.1 time: 0.197846 Feb 19 20:57:56.903657 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 959/1990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:56 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:56.908688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-847089477", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "b985be9e-d38c-4279-82e4-b246daeadbde"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:56.981073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] validate_networks() for [('b985be9e-d38c-4279-82e4-b246daeadbde', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:57:57.768522 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5fde25ec-b724-492b-9fd5-6869e40b60f8 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1690 microversion: 2.1 time: 0.963396 Feb 19 20:57:57.780796 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1032/1991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:56 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1690 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:57.786515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1bb690f2-3fac-4895-b89f-0c9126b53625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:57.791250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1bb690f2-3fac-4895-b89f-0c9126b53625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:57.802277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bb690f2-3fac-4895-b89f-0c9126b53625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:57.803087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bb690f2-3fac-4895-b89f-0c9126b53625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:57.804260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bb690f2-3fac-4895-b89f-0c9126b53625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:57.804957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bb690f2-3fac-4895-b89f-0c9126b53625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:58.366736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1bb690f2-3fac-4895-b89f-0c9126b53625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:58.377349 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1bb690f2-3fac-4895-b89f-0c9126b53625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.592508 Feb 19 20:57:58.380031 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1033/1992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:57 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:58.387711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3aae83cc-e596-474b-b31b-d0f18ca08cc9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:58.388299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3aae83cc-e596-474b-b31b-d0f18ca08cc9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:58.395729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aae83cc-e596-474b-b31b-d0f18ca08cc9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:58.397179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aae83cc-e596-474b-b31b-d0f18ca08cc9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:58.398054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aae83cc-e596-474b-b31b-d0f18ca08cc9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:58.398469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aae83cc-e596-474b-b31b-d0f18ca08cc9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:58.715152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:57:58.715782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:57:58.716386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:57:58.716933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:57:58.717484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:57:58.739674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:58.740531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:58.741793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:58.742640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:58.773836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Getting quotas for project 72c7d19a9f264a299de3fef34d6cc2e3. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:57:58.780464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Getting quotas for user 60cfee67e3df4200a93528bcb8036b9e and project 72c7d19a9f264a299de3fef34d6cc2e3. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:57:58.815013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Going to run 2 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:57:58.819864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 330ffac4-6847-4284-aba3-e438b631a218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:57:58.963496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=330ffac4-6847-4284-aba3-e438b631a218,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:57:59.102307 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5d1f5cf1-4e38-4944-8326-2a7b81323344 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.195830 Feb 19 20:57:59.104193 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 960/1993] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:57:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 2200 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Feb 19 20:57:59.114751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3aae83cc-e596-474b-b31b-d0f18ca08cc9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:59.116646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cd45d4cd-f240-4a9b-82b6-fcc3f1343cea tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:59.117515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cd45d4cd-f240-4a9b-82b6-fcc3f1343cea tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:59.123308 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3aae83cc-e596-474b-b31b-d0f18ca08cc9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1698 microversion: 2.1 time: 0.741840 Feb 19 20:57:59.129677 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1034/1994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:58 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1698 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:59.134842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f15eb9e9-284e-4413-9de5-cdb66ed3fe55 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:59.135465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f15eb9e9-284e-4413-9de5-cdb66ed3fe55 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:59.145950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd45d4cd-f240-4a9b-82b6-fcc3f1343cea tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:59.146348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd45d4cd-f240-4a9b-82b6-fcc3f1343cea tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:59.147174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd45d4cd-f240-4a9b-82b6-fcc3f1343cea tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:59.147872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd45d4cd-f240-4a9b-82b6-fcc3f1343cea tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:59.157572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f15eb9e9-284e-4413-9de5-cdb66ed3fe55 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:59.158061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f15eb9e9-284e-4413-9de5-cdb66ed3fe55 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:59.158866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f15eb9e9-284e-4413-9de5-cdb66ed3fe55 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:59.159333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f15eb9e9-284e-4413-9de5-cdb66ed3fe55 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:59.764432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f15eb9e9-284e-4413-9de5-cdb66ed3fe55 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:59.772236 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f15eb9e9-284e-4413-9de5-cdb66ed3fe55 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1317 microversion: 2.1 time: 0.640991 Feb 19 20:57:59.776202 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1035/1995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:59 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:59.782351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-38c471ae-558c-4d0b-9166-af4588d366a8 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f646774df70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:59.834574 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cd45d4cd-f240-4a9b-82b6-fcc3f1343cea tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1690 microversion: 2.1 time: 0.727869 Feb 19 20:57:59.835197 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 961/1996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:59 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1690 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:57:59.845627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-eb632ab4-15b7-41a0-8723-12eaf207d518 req-fe3e2a1c-3954-498d-904f-8737febc1a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c8a420-124f-496a-9605-633f80408b4b", "name": "network-vif-deleted", "tag": "3f866cda-3fba-4690-9199-9e11ff500810"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:57:59.853452 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:59.853452 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:57:59.871639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-eb632ab4-15b7-41a0-8723-12eaf207d518 req-fe3e2a1c-3954-498d-904f-8737febc1a58 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:59.872543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-eb632ab4-15b7-41a0-8723-12eaf207d518 req-fe3e2a1c-3954-498d-904f-8737febc1a58 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:59.909763 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-eb632ab4-15b7-41a0-8723-12eaf207d518 req-fe3e2a1c-3954-498d-904f-8737febc1a58 service nova] Creating event network-vif-deleted:3f866cda-3fba-4690-9199-9e11ff500810 for instance 79c8a420-124f-496a-9605-633f80408b4b on nch2-master-1 Feb 19 20:57:59.918493 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-38c471ae-558c-4d0b-9166-af4588d366a8 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/d8cfc405-a83b-4ee5-a231-8389d006f7e0" status: 200 len: 344 microversion: 2.1 time: 0.140119 Feb 19 20:57:59.919319 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1036/1997] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 20:57:59 2022] GET /compute/v2.1/os-volumes/d8cfc405-a83b-4ee5-a231-8389d006f7e0 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:59.924624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a387680b-d8d6-434a-b3a4-57d75b319ba2 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:59.927245 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-eb632ab4-15b7-41a0-8723-12eaf207d518 req-fe3e2a1c-3954-498d-904f-8737febc1a58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090819 Feb 19 20:57:59.929362 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 962/1998] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:57:59.940596 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:57:59.940596 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:57:59.941822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a387680b-d8d6-434a-b3a4-57d75b319ba2 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:57:59.942628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a387680b-d8d6-434a-b3a4-57d75b319ba2 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Searching by: {'deleted': False, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:57:59.955159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06338489-fab3-4379-91bd-7f34b94f817b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:57:59.962447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06338489-fab3-4379-91bd-7f34b94f817b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:57:59.971808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06338489-fab3-4379-91bd-7f34b94f817b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:59.976349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06338489-fab3-4379-91bd-7f34b94f817b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:57:59.985023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06338489-fab3-4379-91bd-7f34b94f817b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:57:59.986240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06338489-fab3-4379-91bd-7f34b94f817b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.019110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a387680b-d8d6-434a-b3a4-57d75b319ba2 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.022253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a387680b-d8d6-434a-b3a4-57d75b319ba2 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.024487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a387680b-d8d6-434a-b3a4-57d75b319ba2 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.027070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a387680b-d8d6-434a-b3a4-57d75b319ba2 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.099579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-a387680b-d8d6-434a-b3a4-57d75b319ba2 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:58:00.163429 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a387680b-d8d6-434a-b3a4-57d75b319ba2 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.242688 Feb 19 20:58:00.164072 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1037/1999] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 20:57:59 2022] GET /compute/v2.1/servers => generated 1003 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:00.184139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-109f2540-589f-413c-81fb-94ae05d54634 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:00.189131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-109f2540-589f-413c-81fb-94ae05d54634 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:00.202845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-109f2540-589f-413c-81fb-94ae05d54634 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.204113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-109f2540-589f-413c-81fb-94ae05d54634 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.207710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-109f2540-589f-413c-81fb-94ae05d54634 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.208628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-109f2540-589f-413c-81fb-94ae05d54634 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.425006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-109f2540-589f-413c-81fb-94ae05d54634 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lazy-loading 'services' on Instance uuid b048357b-44b4-4c70-8ed5-96deddc7d40e {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:58:00.588488 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-109f2540-589f-413c-81fb-94ae05d54634 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/os-volume_attachments/5e244913-ab5d-4fe3-bb55-4f761d37c8e5" status: 202 len: 0 microversion: 2.1 time: 0.413247 Feb 19 20:58:00.588809 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1038/2000] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 20:58:00 2022] DELETE /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/os-volume_attachments/5e244913-ab5d-4fe3-bb55-4f761d37c8e5 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:58:00.600259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-24a3b717-2ff6-413a-9efb-70fe49c0deb9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:00.601000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-24a3b717-2ff6-413a-9efb-70fe49c0deb9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:00.645944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24a3b717-2ff6-413a-9efb-70fe49c0deb9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.646630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24a3b717-2ff6-413a-9efb-70fe49c0deb9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.647803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24a3b717-2ff6-413a-9efb-70fe49c0deb9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.654172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24a3b717-2ff6-413a-9efb-70fe49c0deb9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.760546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-06338489-fab3-4379-91bd-7f34b94f817b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:00.771792 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06338489-fab3-4379-91bd-7f34b94f817b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.839576 Feb 19 20:58:00.776857 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 963/2001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:57:59 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:00.787366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f210dc0-ac90-4b04-84da-b904c22c8bd9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:00.789926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f210dc0-ac90-4b04-84da-b904c22c8bd9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:00.806277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f210dc0-ac90-4b04-84da-b904c22c8bd9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.806900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f210dc0-ac90-4b04-84da-b904c22c8bd9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.813968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f210dc0-ac90-4b04-84da-b904c22c8bd9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.814870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f210dc0-ac90-4b04-84da-b904c22c8bd9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.944194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-24a3b717-2ff6-413a-9efb-70fe49c0deb9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:00.956156 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-24a3b717-2ff6-413a-9efb-70fe49c0deb9 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1631 microversion: 2.1 time: 0.366106 Feb 19 20:58:00.956787 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1039/2002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:00 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1631 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:00.970613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e57a817b-712e-4aeb-9e6b-dee7715927c2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:00.971780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e57a817b-712e-4aeb-9e6b-dee7715927c2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:00.985648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e57a817b-712e-4aeb-9e6b-dee7715927c2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.985648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e57a817b-712e-4aeb-9e6b-dee7715927c2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:00.987014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e57a817b-712e-4aeb-9e6b-dee7715927c2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:00.987569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e57a817b-712e-4aeb-9e6b-dee7715927c2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:01.047306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8f210dc0-ac90-4b04-84da-b904c22c8bd9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:01.058179 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e57a817b-712e-4aeb-9e6b-dee7715927c2 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097314 Feb 19 20:58:01.058488 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1040/2003] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 20:58:00 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:01.060763 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8f210dc0-ac90-4b04-84da-b904c22c8bd9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1213 microversion: 2.1 time: 0.281281 Feb 19 20:58:01.070911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d491478b-2966-4523-bc14-6bc53365e546 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:01.070911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d491478b-2966-4523-bc14-6bc53365e546 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:01.072319 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 964/2004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:00 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1213 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:01.079261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d491478b-2966-4523-bc14-6bc53365e546 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:01.079716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d491478b-2966-4523-bc14-6bc53365e546 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:01.080679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d491478b-2966-4523-bc14-6bc53365e546 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:01.081121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d491478b-2966-4523-bc14-6bc53365e546 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:01.088487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-07a628ed-c24a-4180-a38a-cc9960899479 req-50bc270d-7f50-421f-b9d6-0a724a17de8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2442bd9a-30f5-4574-bb24-5f0857fb20ed", "tag": "f59d1dcd-7b7b-4ed6-84ab-7b2d1fd3a947"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:01.090270 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:01.090270 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:01.113168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-07a628ed-c24a-4180-a38a-cc9960899479 req-50bc270d-7f50-421f-b9d6-0a724a17de8e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:01.120287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-07a628ed-c24a-4180-a38a-cc9960899479 req-50bc270d-7f50-421f-b9d6-0a724a17de8e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:01.142064 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-07a628ed-c24a-4180-a38a-cc9960899479 req-50bc270d-7f50-421f-b9d6-0a724a17de8e service nova] Creating event network-changed:f59d1dcd-7b7b-4ed6-84ab-7b2d1fd3a947 for instance 2442bd9a-30f5-4574-bb24-5f0857fb20ed on nch2-master-1 Feb 19 20:58:01.161931 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-07a628ed-c24a-4180-a38a-cc9960899479 req-50bc270d-7f50-421f-b9d6-0a724a17de8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087982 Feb 19 20:58:01.162645 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 965/2005] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:01.794785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9776bc1b-bf82-4565-a3de-eeaa961d708f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:01.795868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9776bc1b-bf82-4565-a3de-eeaa961d708f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:01.817004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9776bc1b-bf82-4565-a3de-eeaa961d708f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:01.817623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9776bc1b-bf82-4565-a3de-eeaa961d708f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:01.819938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9776bc1b-bf82-4565-a3de-eeaa961d708f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:01.820555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9776bc1b-bf82-4565-a3de-eeaa961d708f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:02.103436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d491478b-2966-4523-bc14-6bc53365e546 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:02.113341 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d491478b-2966-4523-bc14-6bc53365e546 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1317 microversion: 2.1 time: 1.053836 Feb 19 20:58:02.116645 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1041/2006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:01 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1317 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:02.131074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-575dea58-6d23-4b17-bc21-7e5aaf27e234 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f64678e2d30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:02.250016 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-575dea58-6d23-4b17-bc21-7e5aaf27e234 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a5793f45-246c-4580-a003-58b0ad7ff099" status: 200 len: 344 microversion: 2.1 time: 0.132035 Feb 19 20:58:02.251331 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1042/2007] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 20:58:02 2022] GET /compute/v2.1/os-volumes/a5793f45-246c-4580-a003-58b0ad7ff099 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:02.256908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:02.257716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:02.277417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:02.277944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:02.278839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:02.279348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:02.356741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:02.357455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:02.365041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lazy-loading 'fault' on Instance uuid e9f1f59f-19d3-4b89-873c-bc100187739c {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:58:02.444521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f01d50bf4e41ff95c09af549cd37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c496adb59f3467687458650e28da232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:02.455557 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3d3a6df5-909c-479e-80b3-42f42d4a42ff tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 200 len: 1358 microversion: 2.1 time: 0.201996 Feb 19 20:58:02.460705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9776bc1b-bf82-4565-a3de-eeaa961d708f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:02.470485 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9776bc1b-bf82-4565-a3de-eeaa961d708f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.683107 Feb 19 20:58:02.472774 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1043/2008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:02 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:02.475008 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 966/2009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:01 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:58:02.489130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b9a90a46-860f-448c-8d70-a6282af43cec tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:02.492378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b9a90a46-860f-448c-8d70-a6282af43cec tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:02.494680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4318dba8-e035-46f2-94f0-89c652afdca4 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:02.498099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4318dba8-e035-46f2-94f0-89c652afdca4 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:02.511071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9a90a46-860f-448c-8d70-a6282af43cec tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:02.517102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9a90a46-860f-448c-8d70-a6282af43cec tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:02.518199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9a90a46-860f-448c-8d70-a6282af43cec tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:02.518811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9a90a46-860f-448c-8d70-a6282af43cec tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:02.524454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4318dba8-e035-46f2-94f0-89c652afdca4 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:02.526023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4318dba8-e035-46f2-94f0-89c652afdca4 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:02.528586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4318dba8-e035-46f2-94f0-89c652afdca4 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:02.529938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4318dba8-e035-46f2-94f0-89c652afdca4 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:02.589807 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b9a90a46-860f-448c-8d70-a6282af43cec tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115470 Feb 19 20:58:02.590419 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1044/2010] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 20:58:02 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:58:02.608811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-77ae384b-1bbd-4f52-a94c-6e1a24066291 req-e0a6b50c-7545-4981-a5ea-c653d1ecc857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d46c81-d4d9-49ea-9d75-cce281fb0945", "name": "network-vif-deleted", "tag": "5e90c8de-efa6-4cdf-a9b2-90d008369593"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:02.611406 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:02.611406 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:02.618913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-77ae384b-1bbd-4f52-a94c-6e1a24066291 req-e0a6b50c-7545-4981-a5ea-c653d1ecc857 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:02.619708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-77ae384b-1bbd-4f52-a94c-6e1a24066291 req-e0a6b50c-7545-4981-a5ea-c653d1ecc857 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:02.640132 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-77ae384b-1bbd-4f52-a94c-6e1a24066291 req-e0a6b50c-7545-4981-a5ea-c653d1ecc857 service nova] Creating event network-vif-deleted:5e90c8de-efa6-4cdf-a9b2-90d008369593 for instance 80d46c81-d4d9-49ea-9d75-cce281fb0945 on nch1-master-1 Feb 19 20:58:02.648536 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-77ae384b-1bbd-4f52-a94c-6e1a24066291 req-e0a6b50c-7545-4981-a5ea-c653d1ecc857 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056535 Feb 19 20:58:02.649499 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1045/2011] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:02.655444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74d6ab91-1d96-4f96-87d0-5bf1450abb0f tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f6467f96820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:02.751421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4318dba8-e035-46f2-94f0-89c652afdca4 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:02.761328 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4318dba8-e035-46f2-94f0-89c652afdca4 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1275 microversion: 2.1 time: 0.279132 Feb 19 20:58:02.762498 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 967/2012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:02 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:02.806428 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-74d6ab91-1d96-4f96-87d0-5bf1450abb0f tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1015 microversion: 2.1 time: 0.155256 Feb 19 20:58:02.807385 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1046/2013] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Feb 19 20:58:02 2022] GET /compute/v2.1/os-volumes => generated 1015 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:02.821980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff62f6ff-669f-4187-805e-2975d2fab895 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f6467e6ad30>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:02.957697 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff62f6ff-669f-4187-805e-2975d2fab895 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.141720 Feb 19 20:58:02.958956 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 968/2014] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 20:58:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 681 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:02.970767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df4902e4-0234-46fe-a54e-dea9ffe87054 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f646774dd30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:03.122503 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df4902e4-0234-46fe-a54e-dea9ffe87054 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1015 microversion: 2.1 time: 0.156011 Feb 19 20:58:03.124687 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1047/2015] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Feb 19 20:58:02 2022] GET /compute/v2.1/os-volumes => generated 1015 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:03.143792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8de018ac-ae52-42ce-8a78-ceabb8fcd0a9 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:03.145637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8de018ac-ae52-42ce-8a78-ceabb8fcd0a9 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:03.160563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8de018ac-ae52-42ce-8a78-ceabb8fcd0a9 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.161427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8de018ac-ae52-42ce-8a78-ceabb8fcd0a9 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.162514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8de018ac-ae52-42ce-8a78-ceabb8fcd0a9 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.163246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8de018ac-ae52-42ce-8a78-ceabb8fcd0a9 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.411576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:03.412077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:03.423247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.423583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.424540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.425488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.473907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:58:03.612390 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-08f277bb-b28a-45d1-b99f-e6cdbe51b3bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 204 len: 0 microversion: 2.42 time: 0.484175 Feb 19 20:58:03.613099 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 969/2016] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:58:03 2022] DELETE /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:58:03.627061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58d1e4d5-1a45-427b-a9f5-26f3aba4638c tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f6467d30b80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:03.752909 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-58d1e4d5-1a45-427b-a9f5-26f3aba4638c tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.135180 Feb 19 20:58:03.753677 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 970/2017] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Feb 19 20:58:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:03.763826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e02c0416-3f57-4067-8f23-4299dd4fc8cc req-55991442-7cee-4b94-aa6b-449c915cf3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f1f59f-19d3-4b89-873c-bc100187739c", "name": "network-vif-deleted", "tag": "7b13225c-b3f5-46c0-a7ec-cecdc4f9a82a"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:03.765375 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:03.765375 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:03.777696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e02c0416-3f57-4067-8f23-4299dd4fc8cc req-55991442-7cee-4b94-aa6b-449c915cf3b3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.778155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e02c0416-3f57-4067-8f23-4299dd4fc8cc req-55991442-7cee-4b94-aa6b-449c915cf3b3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.797819 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e02c0416-3f57-4067-8f23-4299dd4fc8cc req-55991442-7cee-4b94-aa6b-449c915cf3b3 service nova] Creating event network-vif-deleted:7b13225c-b3f5-46c0-a7ec-cecdc4f9a82a for instance e9f1f59f-19d3-4b89-873c-bc100187739c on nch1-master-1 Feb 19 20:58:03.804617 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e02c0416-3f57-4067-8f23-4299dd4fc8cc req-55991442-7cee-4b94-aa6b-449c915cf3b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049549 Feb 19 20:58:03.805392 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 971/2018] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:03.815674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a397a59-568a-49bc-8fbd-5bc594aab01a tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:03.817227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a397a59-568a-49bc-8fbd-5bc594aab01a tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] [instance: e9f1f59f-19d3-4b89-873c-bc100187739c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:03.824839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a397a59-568a-49bc-8fbd-5bc594aab01a tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.825574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a397a59-568a-49bc-8fbd-5bc594aab01a tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.827985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a397a59-568a-49bc-8fbd-5bc594aab01a tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.829399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a397a59-568a-49bc-8fbd-5bc594aab01a tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.849403 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-5a397a59-568a-49bc-8fbd-5bc594aab01a tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] HTTP exception thrown: Instance e9f1f59f-19d3-4b89-873c-bc100187739c could not be found. Feb 19 20:58:03.850276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a397a59-568a-49bc-8fbd-5bc594aab01a tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Returning 404 to user: Instance e9f1f59f-19d3-4b89-873c-bc100187739c could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:58:03.851551 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5a397a59-568a-49bc-8fbd-5bc594aab01a tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c" status: 404 len: 111 microversion: 2.1 time: 0.042019 Feb 19 20:58:03.856010 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 972/2019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:03 2022] GET /compute/v2.1/servers/e9f1f59f-19d3-4b89-873c-bc100187739c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:03.858652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-75c82f5f-ce1a-40b0-bf7a-6aacbda5e342 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:03.860523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-75c82f5f-ce1a-40b0-bf7a-6aacbda5e342 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:03.863462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8de018ac-ae52-42ce-8a78-ceabb8fcd0a9 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:03.868690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75c82f5f-ce1a-40b0-bf7a-6aacbda5e342 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.869265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75c82f5f-ce1a-40b0-bf7a-6aacbda5e342 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.870340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75c82f5f-ce1a-40b0-bf7a-6aacbda5e342 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.870885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75c82f5f-ce1a-40b0-bf7a-6aacbda5e342 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.871109 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8de018ac-ae52-42ce-8a78-ceabb8fcd0a9 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1317 microversion: 2.1 time: 0.738957 Feb 19 20:58:03.880187 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1048/2020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:03 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1317 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:03.880187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:03.883655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:03.893510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.894005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:03.894932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:03.895770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:04.514746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-75c82f5f-ce1a-40b0-bf7a-6aacbda5e342 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:04.524912 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-75c82f5f-ce1a-40b0-bf7a-6aacbda5e342 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.670406 Feb 19 20:58:04.526274 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 973/2021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:03 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:04.531889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f172ca3e-68de-492a-867d-330f4a5a6715 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f6467e6c820>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:04.616955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:04.617807 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f172ca3e-68de-492a-867d-330f4a5a6715 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.088984 Feb 19 20:58:04.619535 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 974/2022] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Feb 19 20:58:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 681 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:04.624499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-05e19a78-52e2-4b89-8e0d-94b0674dd6cc tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:04.625923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-05e19a78-52e2-4b89-8e0d-94b0674dd6cc tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:04.632525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05e19a78-52e2-4b89-8e0d-94b0674dd6cc tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:04.633168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05e19a78-52e2-4b89-8e0d-94b0674dd6cc tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:04.634139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05e19a78-52e2-4b89-8e0d-94b0674dd6cc tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:04.634474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:04.634942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05e19a78-52e2-4b89-8e0d-94b0674dd6cc tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:04.636376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:04.638828 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6f86be61-50be-4151-987b-37ccb6c9f0bd tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2958 microversion: 2.42 time: 0.766194 Feb 19 20:58:04.642047 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1049/2023] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:03 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2958 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:04.653977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-102b637c-fb37-43d3-918c-3f4c78d6ca82 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] Calling method '.version_select at 0x7f646774d3a0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:04.674220 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-102b637c-fb37-43d3-918c-3f4c78d6ca82 tempest-ServersTestJSON-264749798 tempest-ServersTestJSON-264749798-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93172753" status: 202 len: 0 microversion: 2.1 time: 0.030224 Feb 19 20:58:04.677978 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1050/2024] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Feb 19 20:58:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93172753 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:58:04.686061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4ac42467-8fce-41e6-b4a8-f1482b650dd8 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467777280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:04.754851 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4ac42467-8fce-41e6-b4a8-f1482b650dd8 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56b994d5-d167-40cd-b0b3-8f83538ee3ed" status: 200 len: 661 microversion: 2.1 time: 0.077722 Feb 19 20:58:04.755763 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1051/2025] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:04 2022] GET /compute/v2.1/images/56b994d5-d167-40cd-b0b3-8f83538ee3ed => generated 661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:04.760575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-af583551-04d9-4525-a3ab-3da02bb0b571 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f6467f96e50>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:04.846950 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-af583551-04d9-4525-a3ab-3da02bb0b571 tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1015 microversion: 2.1 time: 0.090022 Feb 19 20:58:04.847990 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1052/2026] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:58:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1015 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:04.853237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4692168c-8eb5-4c83-979a-8384c5d1608e req-8c124c79-b9d6-4db8-90ef-5670c694dba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330ffac4-6847-4284-aba3-e438b631a218", "tag": "bfe33598-34b0-438e-98e1-b9d8f02efb0b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:04.855687 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:04.855687 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:04.864217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4692168c-8eb5-4c83-979a-8384c5d1608e req-8c124c79-b9d6-4db8-90ef-5670c694dba0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:04.864663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4692168c-8eb5-4c83-979a-8384c5d1608e req-8c124c79-b9d6-4db8-90ef-5670c694dba0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:04.876822 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4692168c-8eb5-4c83-979a-8384c5d1608e req-8c124c79-b9d6-4db8-90ef-5670c694dba0 service nova] Creating event network-changed:bfe33598-34b0-438e-98e1-b9d8f02efb0b for instance 330ffac4-6847-4284-aba3-e438b631a218 on nch1-master-1 Feb 19 20:58:04.883517 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4692168c-8eb5-4c83-979a-8384c5d1608e req-8c124c79-b9d6-4db8-90ef-5670c694dba0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033890 Feb 19 20:58:04.884121 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1053/2027] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:04.889663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-08161099-aba6-4b2d-9e91-f67d810662c7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467ed4790>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:04.935029 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-08161099-aba6-4b2d-9e91-f67d810662c7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56b994d5-d167-40cd-b0b3-8f83538ee3ed" status: 200 len: 661 microversion: 2.1 time: 0.049524 Feb 19 20:58:04.935631 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1054/2028] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:04 2022] GET /compute/v2.1/images/56b994d5-d167-40cd-b0b3-8f83538ee3ed => generated 661 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:04.946514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fedb05a9-375e-4d32-93fd-ddb259ca039d tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f6467ed1c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:05.049262 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fedb05a9-375e-4d32-93fd-ddb259ca039d tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.110524 Feb 19 20:58:05.051306 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1055/2029] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Feb 19 20:58:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:05.058930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-006ce7c6-896e-4fe6-a722-5e31c476142e tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:05.059864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-006ce7c6-896e-4fe6-a722-5e31c476142e tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:05.068481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006ce7c6-896e-4fe6-a722-5e31c476142e tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:05.068947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006ce7c6-896e-4fe6-a722-5e31c476142e tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:05.070355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006ce7c6-896e-4fe6-a722-5e31c476142e tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:05.070839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006ce7c6-896e-4fe6-a722-5e31c476142e tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:05.276127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-05e19a78-52e2-4b89-8e0d-94b0674dd6cc tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:05.294183 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-05e19a78-52e2-4b89-8e0d-94b0674dd6cc tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1317 microversion: 2.1 time: 0.672511 Feb 19 20:58:05.295914 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 975/2030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:04 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:05.301592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-974655ac-e3c5-451c-a1fd-68cccce10d9b tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] Calling method '.version_select at 0x7f6467ef88b0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:05.399677 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-974655ac-e3c5-451c-a1fd-68cccce10d9b tempest-VolumesTestJSON-608083348 tempest-VolumesTestJSON-608083348-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1015 microversion: 2.1 time: 0.101539 Feb 19 20:58:05.400258 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 976/2031] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 20:58:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1015 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:05.542736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d5f1ea9a-1827-41a4-95f8-f5f82612c9fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:05.543396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d5f1ea9a-1827-41a4-95f8-f5f82612c9fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:05.550572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5f1ea9a-1827-41a4-95f8-f5f82612c9fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:05.551032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5f1ea9a-1827-41a4-95f8-f5f82612c9fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:05.551839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5f1ea9a-1827-41a4-95f8-f5f82612c9fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:05.552284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5f1ea9a-1827-41a4-95f8-f5f82612c9fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:06.006105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-006ce7c6-896e-4fe6-a722-5e31c476142e tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:06.021913 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-006ce7c6-896e-4fe6-a722-5e31c476142e tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1317 microversion: 2.1 time: 0.969332 Feb 19 20:58:06.024039 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1056/2032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:05 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1317 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:06.040633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2147446008", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "38f0b579-c349-4313-af39-532bf5d625a7"}], "block_device_mapping_v2": [{"uuid": "cb0e31e2-5606-43d5-8308-b5499393d5fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:06.133278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d5f1ea9a-1827-41a4-95f8-f5f82612c9fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:06.146573 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d5f1ea9a-1827-41a4-95f8-f5f82612c9fc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.607769 Feb 19 20:58:06.147188 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 977/2033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:05 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:06.161801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:06.162418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:06.188798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:06.189262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:06.190081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:06.190530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:06.214414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] validate_networks() for [('38f0b579-c349-4313-af39-532bf5d625a7', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:58:06.774449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:06.795653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:06.801248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:06.803701 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f4f9810-450f-4d15-ae39-c2ed5e89bd85 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2958 microversion: 2.42 time: 0.647993 Feb 19 20:58:06.804549 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 978/2034] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:06 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2958 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:06.825786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2966c5ef-3e4b-4784-a19e-226f0001e927 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:06.827283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2966c5ef-3e4b-4784-a19e-226f0001e927 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:06.836066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2966c5ef-3e4b-4784-a19e-226f0001e927 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:06.836989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2966c5ef-3e4b-4784-a19e-226f0001e927 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:06.838140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2966c5ef-3e4b-4784-a19e-226f0001e927 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:06.838746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2966c5ef-3e4b-4784-a19e-226f0001e927 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:07.306108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2966c5ef-3e4b-4784-a19e-226f0001e927 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:07.328524 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2966c5ef-3e4b-4784-a19e-226f0001e927 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1317 microversion: 2.1 time: 0.511642 Feb 19 20:58:07.341692 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 979/2035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:06 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:07.350478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c6ed0f6c-f68c-45ee-859b-22a288d6df73 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467c6b1f0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:07.369150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:58:07.369684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:58:07.370280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:58:07.370779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:58:07.372645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:58:07.417984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:07.421617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:07.423556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:07.424600 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c6ed0f6c-f68c-45ee-859b-22a288d6df73 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/36e9b14f-f68c-4729-bc61-ce0d46c4a36c" status: 200 len: 661 microversion: 2.1 time: 0.081159 Feb 19 20:58:07.425157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:07.425309 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 980/2036] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:07 2022] GET /compute/v2.1/images/36e9b14f-f68c-4729-bc61-ce0d46c4a36c => generated 661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:07.440692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4ac5fdab-34a3-499c-a993-d934a5adfaa6 req-dd11df43-4f8b-4c09-84fe-c3595530af6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9678da86-446e-4e8a-8bde-75d9478d3ecf", "tag": "c0ad5b33-b1ef-47b6-9a56-eaa61e73c963"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:07.444320 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:07.444320 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:07.452577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4ac5fdab-34a3-499c-a993-d934a5adfaa6 req-dd11df43-4f8b-4c09-84fe-c3595530af6e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:07.453745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4ac5fdab-34a3-499c-a993-d934a5adfaa6 req-dd11df43-4f8b-4c09-84fe-c3595530af6e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:07.481651 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4ac5fdab-34a3-499c-a993-d934a5adfaa6 req-dd11df43-4f8b-4c09-84fe-c3595530af6e service nova] Creating event network-changed:c0ad5b33-b1ef-47b6-9a56-eaa61e73c963 for instance 9678da86-446e-4e8a-8bde-75d9478d3ecf on nch1-master-1 Feb 19 20:58:07.488691 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4ac5fdab-34a3-499c-a993-d934a5adfaa6 req-dd11df43-4f8b-4c09-84fe-c3595530af6e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061511 Feb 19 20:58:07.489651 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 981/2037] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:07.495441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8964d21b-a580-4d21-88fc-fe477986109b tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:07.496248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8964d21b-a580-4d21-88fc-fe477986109b tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:07.504488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8964d21b-a580-4d21-88fc-fe477986109b tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:07.505443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8964d21b-a580-4d21-88fc-fe477986109b tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:07.507062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8964d21b-a580-4d21-88fc-fe477986109b tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:07.508289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8964d21b-a580-4d21-88fc-fe477986109b tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:07.512640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Getting quotas for project 63acbd462dfc418fab3fbeedccacb9c7. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:07.524516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Getting quotas for user 0d694f3e8da440a9a1cac8ca2de030e8 and project 63acbd462dfc418fab3fbeedccacb9c7. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:07.610116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:58:07.613156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb0e31e2-5606-43d5-8308-b5499393d5fb',volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:58:07.805111 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e38cfb79-3a69-4819-a817-c80997798d0b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779503 Feb 19 20:58:07.805919 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1057/2038] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:58:07.812242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b6c5d4be-294d-4546-87f1-b8c44f06b182 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:07.813777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b6c5d4be-294d-4546-87f1-b8c44f06b182 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:07.822417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6c5d4be-294d-4546-87f1-b8c44f06b182 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:07.823173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6c5d4be-294d-4546-87f1-b8c44f06b182 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:07.825022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6c5d4be-294d-4546-87f1-b8c44f06b182 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:07.826026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6c5d4be-294d-4546-87f1-b8c44f06b182 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:07.924195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8964d21b-a580-4d21-88fc-fe477986109b tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:07.938183 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8964d21b-a580-4d21-88fc-fe477986109b tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1317 microversion: 2.1 time: 0.446724 Feb 19 20:58:07.951329 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 982/2039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:07 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:07.964089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-016592a9-c795-44a4-8df8-a1a580044eb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467d160d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:08.035389 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-016592a9-c795-44a4-8df8-a1a580044eb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/36e9b14f-f68c-4729-bc61-ce0d46c4a36c" status: 200 len: 661 microversion: 2.1 time: 0.079562 Feb 19 20:58:08.036934 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 983/2040] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:07 2022] GET /compute/v2.1/images/36e9b14f-f68c-4729-bc61-ce0d46c4a36c => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:08.042181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dad14db9-864e-4fa5-97a8-68efa1912f70 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:08.043290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dad14db9-864e-4fa5-97a8-68efa1912f70 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:08.188247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dad14db9-864e-4fa5-97a8-68efa1912f70 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:08.203653 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dad14db9-864e-4fa5-97a8-68efa1912f70 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1053 microversion: 2.1 time: 0.165184 Feb 19 20:58:08.206833 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 984/2041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:08 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1053 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:08.218650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:08.220156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:08.235618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:08.239420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:08.240477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:08.241021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:08.585495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b6c5d4be-294d-4546-87f1-b8c44f06b182 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:08.596948 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b6c5d4be-294d-4546-87f1-b8c44f06b182 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.789737 Feb 19 20:58:08.611797 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1058/2042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:07 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:08.623027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3d0e4ce8-5c25-4309-982f-4659209f5633 req-9d078983-d7d5-491f-8f98-a78382a69fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2442bd9a-30f5-4574-bb24-5f0857fb20ed", "name": "network-vif-plugged", "status": "completed", "tag": "f59d1dcd-7b7b-4ed6-84ab-7b2d1fd3a947"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:08.629676 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:08.629676 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:08.640885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3d0e4ce8-5c25-4309-982f-4659209f5633 req-9d078983-d7d5-491f-8f98-a78382a69fc3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:08.641978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3d0e4ce8-5c25-4309-982f-4659209f5633 req-9d078983-d7d5-491f-8f98-a78382a69fc3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:08.682462 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3d0e4ce8-5c25-4309-982f-4659209f5633 req-9d078983-d7d5-491f-8f98-a78382a69fc3 service nova] Creating event network-vif-plugged:f59d1dcd-7b7b-4ed6-84ab-7b2d1fd3a947 for instance 2442bd9a-30f5-4574-bb24-5f0857fb20ed on nch2-master-1 Feb 19 20:58:08.689971 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3d0e4ce8-5c25-4309-982f-4659209f5633 req-9d078983-d7d5-491f-8f98-a78382a69fc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074781 Feb 19 20:58:08.691560 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1059/2043] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:08.722123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c612b993-8341-46d5-b34e-268fffffe126 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:08.725224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c612b993-8341-46d5-b34e-268fffffe126 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:08.759581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c612b993-8341-46d5-b34e-268fffffe126 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:08.760704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c612b993-8341-46d5-b34e-268fffffe126 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:08.766456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c612b993-8341-46d5-b34e-268fffffe126 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:08.767180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c612b993-8341-46d5-b34e-268fffffe126 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:09.203149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:09.221456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:09.227159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:09.232547 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f682d7ac-69f3-4a8c-8dea-95dcbb788d8b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2958 microversion: 2.42 time: 1.022911 Feb 19 20:58:09.235623 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 985/2044] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:08 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2958 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:09.244534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce238cc6-6342-4a4e-ae61-1ea7a5ce703a tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:09.249775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ce238cc6-6342-4a4e-ae61-1ea7a5ce703a tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:09.260642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce238cc6-6342-4a4e-ae61-1ea7a5ce703a tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:09.261755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce238cc6-6342-4a4e-ae61-1ea7a5ce703a tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:09.263051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce238cc6-6342-4a4e-ae61-1ea7a5ce703a tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:09.263721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce238cc6-6342-4a4e-ae61-1ea7a5ce703a tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:09.542491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c612b993-8341-46d5-b34e-268fffffe126 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:09.554839 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c612b993-8341-46d5-b34e-268fffffe126 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1317 microversion: 2.1 time: 0.861479 Feb 19 20:58:09.557278 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1060/2045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:08 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:09.570942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c0b70505-57f3-419d-988d-79e6107dc246 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:09.575834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c0b70505-57f3-419d-988d-79e6107dc246 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:09.599363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0b70505-57f3-419d-988d-79e6107dc246 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:09.608271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0b70505-57f3-419d-988d-79e6107dc246 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:09.612793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0b70505-57f3-419d-988d-79e6107dc246 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:09.613672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0b70505-57f3-419d-988d-79e6107dc246 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:09.640375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ce238cc6-6342-4a4e-ae61-1ea7a5ce703a tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:09.650773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ce238cc6-6342-4a4e-ae61-1ea7a5ce703a tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1317 microversion: 2.1 time: 0.413610 Feb 19 20:58:09.651795 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 986/2046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:09 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:09.660725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2d1d435-d4a1-4ad5-9795-06b208ddbf6c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:09.661276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2d1d435-d4a1-4ad5-9795-06b208ddbf6c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:09.681800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2d1d435-d4a1-4ad5-9795-06b208ddbf6c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:09.682265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2d1d435-d4a1-4ad5-9795-06b208ddbf6c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:09.683333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2d1d435-d4a1-4ad5-9795-06b208ddbf6c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:09.683771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2d1d435-d4a1-4ad5-9795-06b208ddbf6c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:09.843286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c0b70505-57f3-419d-988d-79e6107dc246 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:09.852963 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c0b70505-57f3-419d-988d-79e6107dc246 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1151 microversion: 2.1 time: 0.292650 Feb 19 20:58:09.853563 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1061/2047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:09 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1151 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:09.934640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b555c20-2b75-49c3-87b2-fe5283f68f64 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64677499d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:09.994500 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b555c20-2b75-49c3-87b2-fe5283f68f64 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/e8397b1d-9136-445e-8cbc-e88cc9e2a086" status: 200 len: 662 microversion: 2.1 time: 0.064294 Feb 19 20:58:09.995099 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1062/2048] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:09 2022] GET /compute/v2.1/images/e8397b1d-9136-445e-8cbc-e88cc9e2a086 => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:58:10.007591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-77cba092-3bf6-42a9-b6ec-da1be9a7065f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467905dc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:10.011076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2d1d435-d4a1-4ad5-9795-06b208ddbf6c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:10.020112 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2d1d435-d4a1-4ad5-9795-06b208ddbf6c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.362902 Feb 19 20:58:10.024812 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 987/2049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:09 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:10.075057 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-77cba092-3bf6-42a9-b6ec-da1be9a7065f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/e8397b1d-9136-445e-8cbc-e88cc9e2a086" status: 200 len: 662 microversion: 2.1 time: 0.071538 Feb 19 20:58:10.075959 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1063/2050] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:10 2022] GET /compute/v2.1/images/e8397b1d-9136-445e-8cbc-e88cc9e2a086 => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:10.223098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-351513549", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:10.256074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:10.257269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:10.266785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:10.268185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:10.269646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:10.270336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:10.307095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:58:11.407829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:58:11.409494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:58:11.410282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:58:11.411429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:58:11.412040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:58:11.445506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:11.446444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:11.448996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:11.451077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:11.493372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Getting quotas for project ba0a055a14bb46128600e77140b79b10. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:11.511681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Getting quotas for user 5228f69460a3451c90e6254f5c6b6eeb and project ba0a055a14bb46128600e77140b79b10. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:11.537139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:58:11.539723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:58:11.682863 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-69920be7-c065-4482-aaac-737363013a42 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464012 Feb 19 20:58:11.692554 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 988/2051] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:58:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:58:11.715726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-14e6a15c-0f0f-4e0e-992a-a27a93e3752a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:11.719952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-14e6a15c-0f0f-4e0e-992a-a27a93e3752a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:11.733994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:11.745138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14e6a15c-0f0f-4e0e-992a-a27a93e3752a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:11.745508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14e6a15c-0f0f-4e0e-992a-a27a93e3752a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:11.746436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14e6a15c-0f0f-4e0e-992a-a27a93e3752a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:11.746751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14e6a15c-0f0f-4e0e-992a-a27a93e3752a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:11.769090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:11.774536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:11.781627 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ccda0ce4-6ebe-4f1d-8c3d-169a9c657ccb tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2937 microversion: 2.42 time: 1.525393 Feb 19 20:58:11.787088 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1064/2052] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:10 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2937 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:11.797226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e9267129-94af-4fe1-b22d-09a0d0d889b7 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:11.800791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e9267129-94af-4fe1-b22d-09a0d0d889b7 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:11.825499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9267129-94af-4fe1-b22d-09a0d0d889b7 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:11.829546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9267129-94af-4fe1-b22d-09a0d0d889b7 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:11.831655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9267129-94af-4fe1-b22d-09a0d0d889b7 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:11.832659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9267129-94af-4fe1-b22d-09a0d0d889b7 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:12.444029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e9267129-94af-4fe1-b22d-09a0d0d889b7 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:12.449033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-14e6a15c-0f0f-4e0e-992a-a27a93e3752a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:12.462252 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e9267129-94af-4fe1-b22d-09a0d0d889b7 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1505 microversion: 2.1 time: 0.666382 Feb 19 20:58:12.463287 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1065/2053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:11 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1505 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:12.475372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-14e6a15c-0f0f-4e0e-992a-a27a93e3752a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1317 microversion: 2.1 time: 0.769363 Feb 19 20:58:12.477833 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 989/2054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:11 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:12.487885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-963ce1bc-44ec-46ce-8899-8cda86c99f3e req-ee2d10fb-4ee5-4cb7-87d4-172e24deb966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-unplugged", "status": "completed", "tag": "72bb29c9-1a0c-4c88-a3aa-9aed178a43cc"}, {"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-unplugged", "status": "completed", "tag": "8bb1ce04-77ae-47cb-af1b-16718979fb14"}, {"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-unplugged", "status": "completed", "tag": "1e1241d9-ddbc-426c-9df0-86c2c9670f97"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:12.491588 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:12.491588 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:12.494704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eaaec751-27e2-47b5-80d7-f0f11925340b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:12.498268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eaaec751-27e2-47b5-80d7-f0f11925340b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:12.510193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-963ce1bc-44ec-46ce-8899-8cda86c99f3e req-ee2d10fb-4ee5-4cb7-87d4-172e24deb966 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:12.511042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-963ce1bc-44ec-46ce-8899-8cda86c99f3e req-ee2d10fb-4ee5-4cb7-87d4-172e24deb966 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:12.531195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eaaec751-27e2-47b5-80d7-f0f11925340b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:12.536150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eaaec751-27e2-47b5-80d7-f0f11925340b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:12.542405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eaaec751-27e2-47b5-80d7-f0f11925340b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:12.543760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eaaec751-27e2-47b5-80d7-f0f11925340b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:12.555463 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-963ce1bc-44ec-46ce-8899-8cda86c99f3e req-ee2d10fb-4ee5-4cb7-87d4-172e24deb966 service nova] Creating event network-vif-unplugged:72bb29c9-1a0c-4c88-a3aa-9aed178a43cc for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:12.556513 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-963ce1bc-44ec-46ce-8899-8cda86c99f3e req-ee2d10fb-4ee5-4cb7-87d4-172e24deb966 service nova] Creating event network-vif-unplugged:8bb1ce04-77ae-47cb-af1b-16718979fb14 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:12.562716 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-963ce1bc-44ec-46ce-8899-8cda86c99f3e req-ee2d10fb-4ee5-4cb7-87d4-172e24deb966 service nova] Creating event network-vif-unplugged:1e1241d9-ddbc-426c-9df0-86c2c9670f97 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:12.580837 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-963ce1bc-44ec-46ce-8899-8cda86c99f3e req-ee2d10fb-4ee5-4cb7-87d4-172e24deb966 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.101391 Feb 19 20:58:12.583123 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 990/2055] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:12.602587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d16b3b3a-07f8-4340-b7ff-1683ba245c96 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:12.602587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d16b3b3a-07f8-4340-b7ff-1683ba245c96 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:12.631784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d16b3b3a-07f8-4340-b7ff-1683ba245c96 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:12.637393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d16b3b3a-07f8-4340-b7ff-1683ba245c96 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:12.638521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d16b3b3a-07f8-4340-b7ff-1683ba245c96 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:12.639076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d16b3b3a-07f8-4340-b7ff-1683ba245c96 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:13.402261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-eaaec751-27e2-47b5-80d7-f0f11925340b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:13.412186 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eaaec751-27e2-47b5-80d7-f0f11925340b tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.946738 Feb 19 20:58:13.418415 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1066/2056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:12 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:13.428543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-690218797", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:13.444183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d16b3b3a-07f8-4340-b7ff-1683ba245c96 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:13.453952 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d16b3b3a-07f8-4340-b7ff-1683ba245c96 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1494 microversion: 2.1 time: 0.869019 Feb 19 20:58:13.466281 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 991/2057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:12 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1494 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:13.479064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:13.479686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:13.523934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:58:13.532088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:13.532609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:13.534074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:13.534524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:14.211638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:58:14.212590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:58:14.213380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:58:14.213865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:58:14.214405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:58:14.235249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:14.236023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:14.242278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:14.257700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:14.258597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:14.271440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:14.274009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:14.275559 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5d94f1ef-3f53-4880-b57a-7fd34749e4c6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2916 microversion: 2.42 time: 0.808244 Feb 19 20:58:14.278400 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 992/2058] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:13 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2916 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:14.291984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71ff7c5c-52c5-4ce6-8a25-968c0692c05a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:14.296001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-71ff7c5c-52c5-4ce6-8a25-968c0692c05a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:14.312069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71ff7c5c-52c5-4ce6-8a25-968c0692c05a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:14.314436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Getting quotas for project ba0a055a14bb46128600e77140b79b10. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:14.317123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71ff7c5c-52c5-4ce6-8a25-968c0692c05a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:14.324286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71ff7c5c-52c5-4ce6-8a25-968c0692c05a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:14.324907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71ff7c5c-52c5-4ce6-8a25-968c0692c05a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:14.328982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Getting quotas for user 5228f69460a3451c90e6254f5c6b6eeb and project ba0a055a14bb46128600e77140b79b10. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:14.373478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:58:14.381420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:58:14.514477 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-03aafa72-f920-4bd2-afc9-451776fc692d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091655 Feb 19 20:58:14.519612 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1067/2059] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:58:14.553814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a272b9e0-7951-4318-9df9-e0259b6cb240 req-3ffedfbc-f83a-48e4-a8b1-c80ef391c224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-deleted", "tag": "72bb29c9-1a0c-4c88-a3aa-9aed178a43cc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:14.555539 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:14.555539 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:14.578601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a272b9e0-7951-4318-9df9-e0259b6cb240 req-3ffedfbc-f83a-48e4-a8b1-c80ef391c224 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:14.581737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a272b9e0-7951-4318-9df9-e0259b6cb240 req-3ffedfbc-f83a-48e4-a8b1-c80ef391c224 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:14.602356 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a272b9e0-7951-4318-9df9-e0259b6cb240 req-3ffedfbc-f83a-48e4-a8b1-c80ef391c224 service nova] Creating event network-vif-deleted:72bb29c9-1a0c-4c88-a3aa-9aed178a43cc for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:14.619455 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a272b9e0-7951-4318-9df9-e0259b6cb240 req-3ffedfbc-f83a-48e4-a8b1-c80ef391c224 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096547 Feb 19 20:58:14.620219 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1068/2060] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:14.628378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-304d19b4-8146-4a67-af1e-e035b2cdd2ed tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:14.629612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-304d19b4-8146-4a67-af1e-e035b2cdd2ed tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:14.636827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-304d19b4-8146-4a67-af1e-e035b2cdd2ed tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:14.637325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-304d19b4-8146-4a67-af1e-e035b2cdd2ed tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:14.638539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-304d19b4-8146-4a67-af1e-e035b2cdd2ed tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:14.639372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-304d19b4-8146-4a67-af1e-e035b2cdd2ed tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:15.021261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-71ff7c5c-52c5-4ce6-8a25-968c0692c05a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:15.035001 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71ff7c5c-52c5-4ce6-8a25-968c0692c05a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1317 microversion: 2.1 time: 0.754959 Feb 19 20:58:15.037549 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 993/2061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:14 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1317 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:15.042072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-99fa62a3-4a54-48d4-b30b-1462a1614d52 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:15.047790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-99fa62a3-4a54-48d4-b30b-1462a1614d52 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:15.064570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99fa62a3-4a54-48d4-b30b-1462a1614d52 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:15.066807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99fa62a3-4a54-48d4-b30b-1462a1614d52 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:15.067827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99fa62a3-4a54-48d4-b30b-1462a1614d52 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:15.073127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99fa62a3-4a54-48d4-b30b-1462a1614d52 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:15.259559 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-304d19b4-8146-4a67-af1e-e035b2cdd2ed tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "POST /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.633572 Feb 19 20:58:15.261942 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1069/2062] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 20:58:14 2022] POST /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments => generated 194 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:15.283776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2439854a-f124-49a5-8601-494864429f2e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:15.286202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2439854a-f124-49a5-8601-494864429f2e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:15.315839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2439854a-f124-49a5-8601-494864429f2e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:15.316952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2439854a-f124-49a5-8601-494864429f2e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:15.334801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2439854a-f124-49a5-8601-494864429f2e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:15.341592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2439854a-f124-49a5-8601-494864429f2e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:15.634490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-99fa62a3-4a54-48d4-b30b-1462a1614d52 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:15.648620 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-99fa62a3-4a54-48d4-b30b-1462a1614d52 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.605546 Feb 19 20:58:15.649578 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 994/2063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:15 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:15.659535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8628cedd-206d-4faa-80a0-4b8d77c004c1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:15.660593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8628cedd-206d-4faa-80a0-4b8d77c004c1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:15.677876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8628cedd-206d-4faa-80a0-4b8d77c004c1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:15.678335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8628cedd-206d-4faa-80a0-4b8d77c004c1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:15.679153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8628cedd-206d-4faa-80a0-4b8d77c004c1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:15.679595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8628cedd-206d-4faa-80a0-4b8d77c004c1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:16.014974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8628cedd-206d-4faa-80a0-4b8d77c004c1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:16.024605 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8628cedd-206d-4faa-80a0-4b8d77c004c1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1221 microversion: 2.1 time: 0.373708 Feb 19 20:58:16.025959 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 995/2064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:15 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1221 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:16.030647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-fd65b273-4e6d-493b-aecb-5b555fe36942 req-8f23726a-4250-42d9-a428-b84e7257ac8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330ffac4-6847-4284-aba3-e438b631a218", "name": "network-vif-plugged", "status": "completed", "tag": "bfe33598-34b0-438e-98e1-b9d8f02efb0b"}, {"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-unplugged", "status": "completed", "tag": "2bd27571-334d-4e5a-a015-91dd528ffb9f"}, {"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-unplugged", "status": "completed", "tag": "a5a05223-8669-4696-8f96-528bee454543"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:16.033380 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:16.033380 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:16.041972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fd65b273-4e6d-493b-aecb-5b555fe36942 req-8f23726a-4250-42d9-a428-b84e7257ac8a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:16.042796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fd65b273-4e6d-493b-aecb-5b555fe36942 req-8f23726a-4250-42d9-a428-b84e7257ac8a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:16.058071 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fd65b273-4e6d-493b-aecb-5b555fe36942 req-8f23726a-4250-42d9-a428-b84e7257ac8a service nova] Creating event network-vif-plugged:bfe33598-34b0-438e-98e1-b9d8f02efb0b for instance 330ffac4-6847-4284-aba3-e438b631a218 on nch1-master-1 Feb 19 20:58:16.058798 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fd65b273-4e6d-493b-aecb-5b555fe36942 req-8f23726a-4250-42d9-a428-b84e7257ac8a service nova] Creating event network-vif-unplugged:2bd27571-334d-4e5a-a015-91dd528ffb9f for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:16.059540 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fd65b273-4e6d-493b-aecb-5b555fe36942 req-8f23726a-4250-42d9-a428-b84e7257ac8a service nova] Creating event network-vif-unplugged:a5a05223-8669-4696-8f96-528bee454543 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:16.071501 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-fd65b273-4e6d-493b-aecb-5b555fe36942 req-8f23726a-4250-42d9-a428-b84e7257ac8a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.044098 Feb 19 20:58:16.077528 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 996/2065] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:16.101336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:16.102091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:16.143620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:16.145245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:16.149248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:16.151191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:16.228645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2439854a-f124-49a5-8601-494864429f2e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:16.248886 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2439854a-f124-49a5-8601-494864429f2e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 200 len: 1471 microversion: 2.1 time: 0.977109 Feb 19 20:58:16.250571 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1070/2066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:15 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 1471 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:16.265604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3f4609f1-f60b-442d-93f7-079b71d76115 req-7df09315-cdab-43d4-85b3-2f129df1bf95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c69ff896-e0c9-463d-ac90-7b19f8f7d912", "tag": "6c8ecc50-2b75-491a-8873-0464b03ecc0d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:16.273662 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:16.273662 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:16.297733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3f4609f1-f60b-442d-93f7-079b71d76115 req-7df09315-cdab-43d4-85b3-2f129df1bf95 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:16.299186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3f4609f1-f60b-442d-93f7-079b71d76115 req-7df09315-cdab-43d4-85b3-2f129df1bf95 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:16.332083 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3f4609f1-f60b-442d-93f7-079b71d76115 req-7df09315-cdab-43d4-85b3-2f129df1bf95 service nova] Creating event network-changed:6c8ecc50-2b75-491a-8873-0464b03ecc0d for instance c69ff896-e0c9-463d-ac90-7b19f8f7d912 on nch2-master-1 Feb 19 20:58:16.340414 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3f4609f1-f60b-442d-93f7-079b71d76115 req-7df09315-cdab-43d4-85b3-2f129df1bf95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088073 Feb 19 20:58:16.341308 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1071/2067] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:16.350524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd42e329-2c2f-4d62-8d02-70739b1438b0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:16.351467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dd42e329-2c2f-4d62-8d02-70739b1438b0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:16.362677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd42e329-2c2f-4d62-8d02-70739b1438b0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:16.363625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd42e329-2c2f-4d62-8d02-70739b1438b0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:16.367229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd42e329-2c2f-4d62-8d02-70739b1438b0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:16.368559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd42e329-2c2f-4d62-8d02-70739b1438b0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:17.542178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:17.559204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:17.561914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:17.565019 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2d0a6b2c-75a8-41e0-88b2-16437d6f452b tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2710 microversion: 2.42 time: 1.483765 Feb 19 20:58:17.570228 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 997/2068] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:16 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2710 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:17.592259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f5334127-15f0-43bd-af57-6b229251b577 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1220126637"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:17.594279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f5334127-15f0-43bd-af57-6b229251b577 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:17.602133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5334127-15f0-43bd-af57-6b229251b577 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:17.602930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5334127-15f0-43bd-af57-6b229251b577 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:17.603735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5334127-15f0-43bd-af57-6b229251b577 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:17.604173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5334127-15f0-43bd-af57-6b229251b577 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:17.709543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dd42e329-2c2f-4d62-8d02-70739b1438b0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:17.719801 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dd42e329-2c2f-4d62-8d02-70739b1438b0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1317 microversion: 2.1 time: 1.376939 Feb 19 20:58:17.721280 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1072/2069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:16 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1317 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:17.734047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4940e952-e41d-45f7-b5a4-8adef0dbf77a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:17.737458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4940e952-e41d-45f7-b5a4-8adef0dbf77a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:17.747365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4940e952-e41d-45f7-b5a4-8adef0dbf77a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:17.747952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4940e952-e41d-45f7-b5a4-8adef0dbf77a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:17.748870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4940e952-e41d-45f7-b5a4-8adef0dbf77a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:17.749420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4940e952-e41d-45f7-b5a4-8adef0dbf77a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:18.110712 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f5334127-15f0-43bd-af57-6b229251b577 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4/action" status: 202 len: 0 microversion: 2.1 time: 0.521699 Feb 19 20:58:18.117366 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 998/2070] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:58:17 2022] POST /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 20:58:18.129254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-0254be60-7215-4375-9330-0b6296b743ca req-cdb388d5-d769-4d14-9a58-40bb93985069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-deleted", "tag": "2bd27571-334d-4e5a-a015-91dd528ffb9f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:18.144384 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:18.144384 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:18.173892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0254be60-7215-4375-9330-0b6296b743ca req-cdb388d5-d769-4d14-9a58-40bb93985069 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:18.174638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0254be60-7215-4375-9330-0b6296b743ca req-cdb388d5-d769-4d14-9a58-40bb93985069 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:18.207609 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-0254be60-7215-4375-9330-0b6296b743ca req-cdb388d5-d769-4d14-9a58-40bb93985069 service nova] Creating event network-vif-deleted:2bd27571-334d-4e5a-a015-91dd528ffb9f for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:18.215389 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-0254be60-7215-4375-9330-0b6296b743ca req-cdb388d5-d769-4d14-9a58-40bb93985069 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094026 Feb 19 20:58:18.217222 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 999/2071] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:18.228060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4940e952-e41d-45f7-b5a4-8adef0dbf77a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:18.237842 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4940e952-e41d-45f7-b5a4-8adef0dbf77a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.515312 Feb 19 20:58:18.242667 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1073/2072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:17 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:18.253079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3538f59e-d9e3-4bc9-b2d6-c8d1d93207f2 req-a1b25991-b89c-4cf4-8e03-e1a695e38c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9678da86-446e-4e8a-8bde-75d9478d3ecf", "name": "network-vif-plugged", "status": "completed", "tag": "c0ad5b33-b1ef-47b6-9a56-eaa61e73c963"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:18.261992 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:18.261992 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:18.262498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-37c94988-feed-4dd5-96c1-5c606a5cf981 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:18.266631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-37c94988-feed-4dd5-96c1-5c606a5cf981 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:18.279880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3538f59e-d9e3-4bc9-b2d6-c8d1d93207f2 req-a1b25991-b89c-4cf4-8e03-e1a695e38c87 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:18.280427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3538f59e-d9e3-4bc9-b2d6-c8d1d93207f2 req-a1b25991-b89c-4cf4-8e03-e1a695e38c87 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:18.295367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37c94988-feed-4dd5-96c1-5c606a5cf981 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:18.296198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37c94988-feed-4dd5-96c1-5c606a5cf981 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:18.297619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37c94988-feed-4dd5-96c1-5c606a5cf981 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:18.298382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37c94988-feed-4dd5-96c1-5c606a5cf981 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:18.300405 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3538f59e-d9e3-4bc9-b2d6-c8d1d93207f2 req-a1b25991-b89c-4cf4-8e03-e1a695e38c87 service nova] Creating event network-vif-plugged:c0ad5b33-b1ef-47b6-9a56-eaa61e73c963 for instance 9678da86-446e-4e8a-8bde-75d9478d3ecf on nch1-master-1 Feb 19 20:58:18.311793 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3538f59e-d9e3-4bc9-b2d6-c8d1d93207f2 req-a1b25991-b89c-4cf4-8e03-e1a695e38c87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067212 Feb 19 20:58:18.316443 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1074/2073] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:18.324602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a905406-ed52-474c-8228-0e1bfd6d086f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467702af0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:18.406971 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a905406-ed52-474c-8228-0e1bfd6d086f tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.088966 Feb 19 20:58:18.409794 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1075/2074] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:18 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:18.425974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-368aae24-f125-4ff2-94d2-60599d6121eb req-a14d8e93-a6a1-4c7f-ad6a-fc389bd0bbae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac13892-70a3-4a7f-b7a8-a0cd9169d0b5", "tag": "835957bc-cf48-4628-ac6b-011383e9ecd7"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:18.427647 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:18.427647 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:18.457243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-368aae24-f125-4ff2-94d2-60599d6121eb req-a14d8e93-a6a1-4c7f-ad6a-fc389bd0bbae service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:18.457698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-368aae24-f125-4ff2-94d2-60599d6121eb req-a14d8e93-a6a1-4c7f-ad6a-fc389bd0bbae service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:18.492942 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-368aae24-f125-4ff2-94d2-60599d6121eb req-a14d8e93-a6a1-4c7f-ad6a-fc389bd0bbae service nova] Creating event network-changed:835957bc-cf48-4628-ac6b-011383e9ecd7 for instance eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 on nch2-master-1 Feb 19 20:58:18.518838 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-368aae24-f125-4ff2-94d2-60599d6121eb req-a14d8e93-a6a1-4c7f-ad6a-fc389bd0bbae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092931 Feb 19 20:58:18.520811 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1076/2075] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:18.566162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-37c94988-feed-4dd5-96c1-5c606a5cf981 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:18.574884 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-37c94988-feed-4dd5-96c1-5c606a5cf981 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1275 microversion: 2.1 time: 0.354800 Feb 19 20:58:18.589288 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1000/2076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:18 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1275 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:18.596989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:18.597757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:18.605198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:18.605653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:18.606754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:18.607182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:18.736634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f44d8788-6150-4006-8803-d4cf295ec3a9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:18.738285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f44d8788-6150-4006-8803-d4cf295ec3a9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:18.749387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f44d8788-6150-4006-8803-d4cf295ec3a9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:18.754111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f44d8788-6150-4006-8803-d4cf295ec3a9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:18.755147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f44d8788-6150-4006-8803-d4cf295ec3a9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:18.755729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f44d8788-6150-4006-8803-d4cf295ec3a9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:19.331671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:19.342057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f44d8788-6150-4006-8803-d4cf295ec3a9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:19.349607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:19.352496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:19.353984 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2256b97c-9b7b-48c5-b634-4dbbcddec7b2 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2506 microversion: 2.42 time: 0.764034 Feb 19 20:58:19.354783 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f44d8788-6150-4006-8803-d4cf295ec3a9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1317 microversion: 2.1 time: 0.621476 Feb 19 20:58:19.355109 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1077/2077] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:18 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2506 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:19.363237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-abc3c600-46d0-4d4b-96ba-7fb0f4821593 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:19.364213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-abc3c600-46d0-4d4b-96ba-7fb0f4821593 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:19.367019 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1001/2078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:18 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:19.371445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abc3c600-46d0-4d4b-96ba-7fb0f4821593 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:19.372051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abc3c600-46d0-4d4b-96ba-7fb0f4821593 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:19.372946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abc3c600-46d0-4d4b-96ba-7fb0f4821593 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:19.373601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abc3c600-46d0-4d4b-96ba-7fb0f4821593 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:19.420705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1edac403-18ad-46ef-b80d-c69e15df10a3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467fc4820>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:19.496571 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1edac403-18ad-46ef-b80d-c69e15df10a3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.080241 Feb 19 20:58:19.498293 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1002/2079] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:19 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:19.606852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-df73aae5-5535-43eb-900c-088cad5aaf7b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:19.610708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-df73aae5-5535-43eb-900c-088cad5aaf7b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:19.627522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df73aae5-5535-43eb-900c-088cad5aaf7b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:19.628230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df73aae5-5535-43eb-900c-088cad5aaf7b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:19.629584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df73aae5-5535-43eb-900c-088cad5aaf7b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:19.630201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df73aae5-5535-43eb-900c-088cad5aaf7b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:19.973205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-abc3c600-46d0-4d4b-96ba-7fb0f4821593 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:19.981174 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-abc3c600-46d0-4d4b-96ba-7fb0f4821593 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.624597 Feb 19 20:58:19.982093 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1078/2080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:19 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:20.256639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f32dd9af-854e-49ca-85d4-e43b49202de4 tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "937ef08a-ab9d-459d-8c78-7e1cf775362c"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:20.260609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f32dd9af-854e-49ca-85d4-e43b49202de4 tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:20.270787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f32dd9af-854e-49ca-85d4-e43b49202de4 tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:20.271217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f32dd9af-854e-49ca-85d4-e43b49202de4 tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:20.272445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f32dd9af-854e-49ca-85d4-e43b49202de4 tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:20.273045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f32dd9af-854e-49ca-85d4-e43b49202de4 tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:20.303389 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:20.303389 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:20.348955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-df73aae5-5535-43eb-900c-088cad5aaf7b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:20.372133 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-df73aae5-5535-43eb-900c-088cad5aaf7b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1317 microversion: 2.1 time: 0.769128 Feb 19 20:58:20.373139 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1003/2081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:19 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:20.379239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a5e2abc7-2984-4647-8806-dff9670cbbf0 req-bd480270-d9ff-4d78-ba15-b72a8318bda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-deleted", "tag": "8bb1ce04-77ae-47cb-af1b-16718979fb14"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:20.381861 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:20.381861 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:20.392564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a5e2abc7-2984-4647-8806-dff9670cbbf0 req-bd480270-d9ff-4d78-ba15-b72a8318bda0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:20.393387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a5e2abc7-2984-4647-8806-dff9670cbbf0 req-bd480270-d9ff-4d78-ba15-b72a8318bda0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:20.410007 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a5e2abc7-2984-4647-8806-dff9670cbbf0 req-bd480270-d9ff-4d78-ba15-b72a8318bda0 service nova] Creating event network-vif-deleted:8bb1ce04-77ae-47cb-af1b-16718979fb14 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:20.419888 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a5e2abc7-2984-4647-8806-dff9670cbbf0 req-bd480270-d9ff-4d78-ba15-b72a8318bda0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045212 Feb 19 20:58:20.421194 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1004/2082] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:20.461811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-342b2adf-61a0-4bc2-a4e6-d479d4b203c0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:20.462962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-342b2adf-61a0-4bc2-a4e6-d479d4b203c0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:20.478160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-342b2adf-61a0-4bc2-a4e6-d479d4b203c0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:20.479171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-342b2adf-61a0-4bc2-a4e6-d479d4b203c0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:20.481232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-342b2adf-61a0-4bc2-a4e6-d479d4b203c0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:20.482323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-342b2adf-61a0-4bc2-a4e6-d479d4b203c0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:20.487617 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-f32dd9af-854e-49ca-85d4-e43b49202de4 tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] HTTP exception thrown: Volume 937ef08a-ab9d-459d-8c78-7e1cf775362c could not be found. Feb 19 20:58:20.489303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f32dd9af-854e-49ca-85d4-e43b49202de4 tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Returning 400 to user: Volume 937ef08a-ab9d-459d-8c78-7e1cf775362c could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:58:20.490615 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f32dd9af-854e-49ca-85d4-e43b49202de4 tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments/c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50" status: 400 len: 107 microversion: 2.1 time: 0.507322 Feb 19 20:58:20.494583 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1079/2083] 10.222.0.30 () {60 vars in 1432 bytes} [Sat Feb 19 20:58:19 2022] PUT /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments/c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50 => generated 107 bytes in 509 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:58:20.513900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:20.514566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:20.543989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:20.548933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:20.550024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:20.551634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:21.522133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-342b2adf-61a0-4bc2-a4e6-d479d4b203c0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:21.535181 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-342b2adf-61a0-4bc2-a4e6-d479d4b203c0 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 200 len: 1505 microversion: 2.1 time: 1.111016 Feb 19 20:58:21.535792 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1005/2084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:20 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 1505 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:21.544472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e38285b4-f971-473d-acf4-71a1fe668b9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6474419550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:21.616929 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e38285b4-f971-473d-acf4-71a1fe668b9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.080088 Feb 19 20:58:21.618073 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1006/2085] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:21 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:21.622865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5040b29a-2fee-463a-8281-5173e06d5802 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:21.623555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5040b29a-2fee-463a-8281-5173e06d5802 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:21.629981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5040b29a-2fee-463a-8281-5173e06d5802 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:21.630794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5040b29a-2fee-463a-8281-5173e06d5802 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:21.631984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5040b29a-2fee-463a-8281-5173e06d5802 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:21.632633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5040b29a-2fee-463a-8281-5173e06d5802 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:21.684981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:21.711088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:21.712126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:21.713425 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-65ed6e85-7d88-444c-9b77-b76ec078e5b9 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2346 microversion: 2.42 time: 1.221007 Feb 19 20:58:21.726415 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1080/2086] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:20 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2346 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:21.726415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a3071196-d838-4802-87cc-7cc32db89904 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:21.726415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a3071196-d838-4802-87cc-7cc32db89904 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:21.743319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3071196-d838-4802-87cc-7cc32db89904 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:21.744123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3071196-d838-4802-87cc-7cc32db89904 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:21.745123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3071196-d838-4802-87cc-7cc32db89904 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:21.747697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3071196-d838-4802-87cc-7cc32db89904 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:21.840286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-5040b29a-2fee-463a-8281-5173e06d5802 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lazy-loading 'services' on Instance uuid 2442bd9a-30f5-4574-bb24-5f0857fb20ed {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:58:22.154560 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5040b29a-2fee-463a-8281-5173e06d5802 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments/c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50" status: 202 len: 0 microversion: 2.1 time: 0.535033 Feb 19 20:58:22.155441 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1007/2087] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 20:58:21 2022] DELETE /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments/c0bd5f2f-0f69-417e-ae7a-f9f2c4787d50 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:58:22.181282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4fe5398e-8493-4585-85ff-9083c36f6358 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:22.183166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4fe5398e-8493-4585-85ff-9083c36f6358 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:22.198096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4fe5398e-8493-4585-85ff-9083c36f6358 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:22.203442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4fe5398e-8493-4585-85ff-9083c36f6358 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:22.204317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4fe5398e-8493-4585-85ff-9083c36f6358 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:22.204785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4fe5398e-8493-4585-85ff-9083c36f6358 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:22.300114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a3071196-d838-4802-87cc-7cc32db89904 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:22.323265 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a3071196-d838-4802-87cc-7cc32db89904 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.601164 Feb 19 20:58:22.324679 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1081/2088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:21 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:22.330215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c96a9df-9cfc-453b-b263-4874bb01a09a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:22.331811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3c96a9df-9cfc-453b-b263-4874bb01a09a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 330ffac4-6847-4284-aba3-e438b631a218] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:22.349270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c96a9df-9cfc-453b-b263-4874bb01a09a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:22.350448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c96a9df-9cfc-453b-b263-4874bb01a09a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:22.351650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c96a9df-9cfc-453b-b263-4874bb01a09a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:22.352267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c96a9df-9cfc-453b-b263-4874bb01a09a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:23.274506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4fe5398e-8493-4585-85ff-9083c36f6358 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:23.283843 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4fe5398e-8493-4585-85ff-9083c36f6358 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1317 microversion: 2.1 time: 1.122666 Feb 19 20:58:23.293136 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1008/2089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:22 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1317 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:23.304772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7e0bb9e9-ec8a-48e3-a2ff-b7c71ab5cd21 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:23.305748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7e0bb9e9-ec8a-48e3-a2ff-b7c71ab5cd21 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:23.342658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e0bb9e9-ec8a-48e3-a2ff-b7c71ab5cd21 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:23.343158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e0bb9e9-ec8a-48e3-a2ff-b7c71ab5cd21 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:23.349931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e0bb9e9-ec8a-48e3-a2ff-b7c71ab5cd21 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:23.353590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e0bb9e9-ec8a-48e3-a2ff-b7c71ab5cd21 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:23.373714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3c96a9df-9cfc-453b-b263-4874bb01a09a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:23.390982 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3c96a9df-9cfc-453b-b263-4874bb01a09a tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218" status: 200 len: 1506 microversion: 2.1 time: 1.064046 Feb 19 20:58:23.397002 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1082/2090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:22 2022] GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218 => generated 1506 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:23.427342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c5995d3b-9539-43e9-9a47-8ca34623adfd req-371257ef-122f-495d-aae4-dd6c22e5dada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-deleted", "tag": "a5a05223-8669-4696-8f96-528bee454543"}, {"name": "network-changed", "server_uuid": "87f8a307-e082-4ac1-b3db-3860b9e66774", "tag": "89832a83-9f4f-4449-b43c-c9fafb143517"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:23.434931 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:23.434931 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:23.462198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c5995d3b-9539-43e9-9a47-8ca34623adfd req-371257ef-122f-495d-aae4-dd6c22e5dada service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:23.471716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c5995d3b-9539-43e9-9a47-8ca34623adfd req-371257ef-122f-495d-aae4-dd6c22e5dada service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:23.498088 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7e0bb9e9-ec8a-48e3-a2ff-b7c71ab5cd21 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194510 Feb 19 20:58:23.519818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1009/2091] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 20:58:23 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:23.520837 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c5995d3b-9539-43e9-9a47-8ca34623adfd req-371257ef-122f-495d-aae4-dd6c22e5dada service nova] Creating event network-vif-deleted:a5a05223-8669-4696-8f96-528bee454543 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:23.521676 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c5995d3b-9539-43e9-9a47-8ca34623adfd req-371257ef-122f-495d-aae4-dd6c22e5dada service nova] Creating event network-changed:89832a83-9f4f-4449-b43c-c9fafb143517 for instance 87f8a307-e082-4ac1-b3db-3860b9e66774 on nch1-master-1 Feb 19 20:58:23.538733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fdefc9bf-9743-4135-b64e-f80d2700c5fd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f647421d280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:23.540690 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c5995d3b-9539-43e9-9a47-8ca34623adfd req-371257ef-122f-495d-aae4-dd6c22e5dada service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.140803 Feb 19 20:58:23.543224 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1083/2092] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:23.556947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:23.558476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:23.574906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:23.577039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:23.580944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:23.581575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:23.635039 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fdefc9bf-9743-4135-b64e-f80d2700c5fd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.113886 Feb 19 20:58:23.635668 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1010/2093] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:23 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:23.665854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eb483967-1170-4500-b71b-d1fda7ce9f94 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:23.666589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eb483967-1170-4500-b71b-d1fda7ce9f94 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:23.690096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb483967-1170-4500-b71b-d1fda7ce9f94 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:23.690973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb483967-1170-4500-b71b-d1fda7ce9f94 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:23.691795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb483967-1170-4500-b71b-d1fda7ce9f94 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:23.692237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb483967-1170-4500-b71b-d1fda7ce9f94 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:24.309700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:24.322427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:24.323950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:24.327366 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8a17762c-00ae-4a48-a4ec-030a7eb3e7ca tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 2346 microversion: 2.42 time: 0.781927 Feb 19 20:58:24.329731 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1084/2094] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:23 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 2346 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:24.345099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-515ad989-a2fa-49bb-b2ed-94ba5a92bf4b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:24.345647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-515ad989-a2fa-49bb-b2ed-94ba5a92bf4b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 330ffac4-6847-4284-aba3-e438b631a218] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:24.362477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-515ad989-a2fa-49bb-b2ed-94ba5a92bf4b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:24.362880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-515ad989-a2fa-49bb-b2ed-94ba5a92bf4b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:24.363678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-515ad989-a2fa-49bb-b2ed-94ba5a92bf4b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:24.364110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-515ad989-a2fa-49bb-b2ed-94ba5a92bf4b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:24.435575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-515ad989-a2fa-49bb-b2ed-94ba5a92bf4b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 330ffac4-6847-4284-aba3-e438b631a218] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:58:24.503057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eb483967-1170-4500-b71b-d1fda7ce9f94 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:24.511644 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eb483967-1170-4500-b71b-d1fda7ce9f94 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.874880 Feb 19 20:58:24.513306 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1011/2095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:23 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:24.520748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ef7b6365-f18e-4cf3-8dbf-97d808e1848e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:24.524918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ef7b6365-f18e-4cf3-8dbf-97d808e1848e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:24.542767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef7b6365-f18e-4cf3-8dbf-97d808e1848e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:24.545892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef7b6365-f18e-4cf3-8dbf-97d808e1848e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:24.547190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef7b6365-f18e-4cf3-8dbf-97d808e1848e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:24.547921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef7b6365-f18e-4cf3-8dbf-97d808e1848e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:24.650465 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-515ad989-a2fa-49bb-b2ed-94ba5a92bf4b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "DELETE /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218" status: 204 len: 0 microversion: 2.1 time: 0.314333 Feb 19 20:58:24.651674 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1085/2096] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:58:24 2022] DELETE /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:58:24.665686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f3bf8920-2c3c-4947-9a50-5a8047aca6ca tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:24.671296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f3bf8920-2c3c-4947-9a50-5a8047aca6ca tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:24.688748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3bf8920-2c3c-4947-9a50-5a8047aca6ca tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:24.689520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3bf8920-2c3c-4947-9a50-5a8047aca6ca tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:24.690510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3bf8920-2c3c-4947-9a50-5a8047aca6ca tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:24.693588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3bf8920-2c3c-4947-9a50-5a8047aca6ca tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:24.790300 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f3bf8920-2c3c-4947-9a50-5a8047aca6ca tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137166 Feb 19 20:58:24.799754 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1086/2097] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 20:58:24 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:58:24.804312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-438b09b8-80c4-4a37-9cb6-73fc67940665 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64677765e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:24.886844 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-438b09b8-80c4-4a37-9cb6-73fc67940665 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.085868 Feb 19 20:58:24.888259 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1087/2098] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:24 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:24.900973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dc33ea30-9e9c-4754-9120-0b317b9658ee tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:24.902970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dc33ea30-9e9c-4754-9120-0b317b9658ee tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:24.931891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc33ea30-9e9c-4754-9120-0b317b9658ee tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:24.932372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc33ea30-9e9c-4754-9120-0b317b9658ee tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:24.942333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc33ea30-9e9c-4754-9120-0b317b9658ee tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:24.943844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc33ea30-9e9c-4754-9120-0b317b9658ee tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:25.013208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dc33ea30-9e9c-4754-9120-0b317b9658ee tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:58:25.245368 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dc33ea30-9e9c-4754-9120-0b317b9658ee tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 204 len: 0 microversion: 2.1 time: 0.354390 Feb 19 20:58:25.249216 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1088/2099] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:58:24 2022] DELETE /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:58:25.260491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab241527-dd30-4fcb-94ad-650278ee2330 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:25.266315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ab241527-dd30-4fcb-94ad-650278ee2330 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 330ffac4-6847-4284-aba3-e438b631a218] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:25.284821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab241527-dd30-4fcb-94ad-650278ee2330 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:25.285256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab241527-dd30-4fcb-94ad-650278ee2330 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:25.287475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab241527-dd30-4fcb-94ad-650278ee2330 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:25.288043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab241527-dd30-4fcb-94ad-650278ee2330 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:25.333121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ef7b6365-f18e-4cf3-8dbf-97d808e1848e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:25.352906 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ef7b6365-f18e-4cf3-8dbf-97d808e1848e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1317 microversion: 2.1 time: 0.838369 Feb 19 20:58:25.359021 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1012/2100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:24 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1317 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:25.370646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:25.383165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:25.422508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:25.423010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:25.423832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:25.425241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:25.622453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:25.643700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:25.654804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72ce9a80c4b444259dda1f6a63e6fe49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0981190244846a18036aa20dce2dc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:25.656294 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d01acc15-cb53-4e9c-adca-6bf588a8bb65 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 200 len: 1605 microversion: 2.42 time: 0.290789 Feb 19 20:58:25.662239 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1013/2101] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:25 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 1605 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:58:25.667790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b189e08a-762f-4c5a-966a-9817993b26b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:25.668439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b189e08a-762f-4c5a-966a-9817993b26b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:25.684291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ab241527-dd30-4fcb-94ad-650278ee2330 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:25.690806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b189e08a-762f-4c5a-966a-9817993b26b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:25.691272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b189e08a-762f-4c5a-966a-9817993b26b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:25.692075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b189e08a-762f-4c5a-966a-9817993b26b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:25.692566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b189e08a-762f-4c5a-966a-9817993b26b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:25.721508 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab241527-dd30-4fcb-94ad-650278ee2330 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218" status: 200 len: 1512 microversion: 2.1 time: 0.470365 Feb 19 20:58:25.722383 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1089/2102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:25 2022] GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218 => generated 1512 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:25.727908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a1d8c1f9-520d-48cd-b157-263e102411b4 req-19370423-470a-44ee-82e2-74af9b40b338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13c63f9-b079-4f3b-9187-bfddac8c9749", "name": "network-vif-deleted", "tag": "1e1241d9-ddbc-426c-9df0-86c2c9670f97"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:25.740804 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:25.740804 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:25.776970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a1d8c1f9-520d-48cd-b157-263e102411b4 req-19370423-470a-44ee-82e2-74af9b40b338 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:25.777469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a1d8c1f9-520d-48cd-b157-263e102411b4 req-19370423-470a-44ee-82e2-74af9b40b338 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:25.798220 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a1d8c1f9-520d-48cd-b157-263e102411b4 req-19370423-470a-44ee-82e2-74af9b40b338 service nova] Creating event network-vif-deleted:1e1241d9-ddbc-426c-9df0-86c2c9670f97 for instance d13c63f9-b079-4f3b-9187-bfddac8c9749 on nch2-master-1 Feb 19 20:58:25.818749 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a1d8c1f9-520d-48cd-b157-263e102411b4 req-19370423-470a-44ee-82e2-74af9b40b338 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083642 Feb 19 20:58:25.819453 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1090/2103] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:25.906809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ea126ef6-61d6-4e0a-9798-066416a059ba tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467ed4550>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:26.003157 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ea126ef6-61d6-4e0a-9798-066416a059ba tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.090542 Feb 19 20:58:26.004206 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1091/2104] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:25 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:26.046072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b189e08a-762f-4c5a-966a-9817993b26b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:26.063843 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b189e08a-762f-4c5a-966a-9817993b26b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.397453 Feb 19 20:58:26.067345 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1014/2105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:25 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:26.377486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9427b58f-2344-45db-93fe-b72a6562c6be tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:26.378229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9427b58f-2344-45db-93fe-b72a6562c6be tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:26.395261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9427b58f-2344-45db-93fe-b72a6562c6be tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:26.395715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9427b58f-2344-45db-93fe-b72a6562c6be tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:26.396572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9427b58f-2344-45db-93fe-b72a6562c6be tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:26.397021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9427b58f-2344-45db-93fe-b72a6562c6be tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:26.681974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43b7feb0-59ec-4037-ac5f-8e13817bb4fc tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:26.682588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-43b7feb0-59ec-4037-ac5f-8e13817bb4fc tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:26.697209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43b7feb0-59ec-4037-ac5f-8e13817bb4fc tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:26.698839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43b7feb0-59ec-4037-ac5f-8e13817bb4fc tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:26.703562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43b7feb0-59ec-4037-ac5f-8e13817bb4fc tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:26.707915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43b7feb0-59ec-4037-ac5f-8e13817bb4fc tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:26.738265 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-43b7feb0-59ec-4037-ac5f-8e13817bb4fc tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] HTTP exception thrown: Instance d13c63f9-b079-4f3b-9187-bfddac8c9749 could not be found. Feb 19 20:58:26.741400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43b7feb0-59ec-4037-ac5f-8e13817bb4fc tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Returning 404 to user: Instance d13c63f9-b079-4f3b-9187-bfddac8c9749 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:58:26.744141 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-43b7feb0-59ec-4037-ac5f-8e13817bb4fc tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 404 len: 111 microversion: 2.42 time: 0.066243 Feb 19 20:58:26.745008 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1015/2106] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:26 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 19 20:58:26.755315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5617ff11-55a1-479e-b2e2-a77f812fae6b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:26.758348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5617ff11-55a1-479e-b2e2-a77f812fae6b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 330ffac4-6847-4284-aba3-e438b631a218] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:26.772305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5617ff11-55a1-479e-b2e2-a77f812fae6b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:26.773505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5617ff11-55a1-479e-b2e2-a77f812fae6b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:26.777472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5617ff11-55a1-479e-b2e2-a77f812fae6b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:26.778166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5617ff11-55a1-479e-b2e2-a77f812fae6b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:26.950142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9427b58f-2344-45db-93fe-b72a6562c6be tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:26.959073 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9427b58f-2344-45db-93fe-b72a6562c6be tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1317 microversion: 2.1 time: 0.586251 Feb 19 20:58:26.964826 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1092/2107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:26 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:26.971683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7264e57a-015a-4020-b696-8b65a1d03d82 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '.version_select at 0x7f6467776670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:27.015525 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7264e57a-015a-4020-b696-8b65a1d03d82 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519020627" status: 204 len: 0 microversion: 2.42 time: 0.048622 Feb 19 20:58:27.016656 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1093/2108] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 20:58:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519020627 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:58:27.021477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-baa247ee-8250-4fbe-9ae6-01aa0d93f57e tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4c7a6346-294a-4626-b313-c9f8c65e9105"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:27.022642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-baa247ee-8250-4fbe-9ae6-01aa0d93f57e tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:27.039272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa247ee-8250-4fbe-9ae6-01aa0d93f57e tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:27.039853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa247ee-8250-4fbe-9ae6-01aa0d93f57e tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:27.040768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa247ee-8250-4fbe-9ae6-01aa0d93f57e tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:27.041284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa247ee-8250-4fbe-9ae6-01aa0d93f57e tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:27.085202 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:27.085202 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:27.149933 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-baa247ee-8250-4fbe-9ae6-01aa0d93f57e tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] HTTP exception thrown: Volume 844639a6-9e58-4bd6-ba36-44f1b8549659 could not be found. Feb 19 20:58:27.151835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-baa247ee-8250-4fbe-9ae6-01aa0d93f57e tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] Returning 404 to user: Volume 844639a6-9e58-4bd6-ba36-44f1b8549659 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:58:27.152900 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-baa247ee-8250-4fbe-9ae6-01aa0d93f57e tempest-VolumesAdminNegativeTest-930528351 tempest-VolumesAdminNegativeTest-930528351-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments/844639a6-9e58-4bd6-ba36-44f1b8549659" status: 404 len: 109 microversion: 2.1 time: 0.135257 Feb 19 20:58:27.153851 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1094/2109] 10.222.0.30 () {60 vars in 1432 bytes} [Sat Feb 19 20:58:27 2022] PUT /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed/os-volume_attachments/844639a6-9e58-4bd6-ba36-44f1b8549659 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:27.161404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3eb810ad-3d23-4050-b76b-150fb2888bc1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64676e9b80>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:27.251248 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3eb810ad-3d23-4050-b76b-150fb2888bc1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.096223 Feb 19 20:58:27.251826 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1095/2110] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:27 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:27.266614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82221895-3966-44be-834f-ae517ae66b18 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:27.267246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-82221895-3966-44be-834f-ae517ae66b18 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:27.283741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82221895-3966-44be-834f-ae517ae66b18 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:27.285455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82221895-3966-44be-834f-ae517ae66b18 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:27.287700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82221895-3966-44be-834f-ae517ae66b18 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:27.289540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82221895-3966-44be-834f-ae517ae66b18 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:27.552253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5617ff11-55a1-479e-b2e2-a77f812fae6b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:27.563039 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5617ff11-55a1-479e-b2e2-a77f812fae6b tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218" status: 200 len: 1512 microversion: 2.1 time: 0.814043 Feb 19 20:58:27.571277 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1016/2111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:26 2022] GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218 => generated 1512 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:27.985359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-577ba90c-6eb1-462e-aab4-c1c8446e168c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:27.985949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-577ba90c-6eb1-462e-aab4-c1c8446e168c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:28.001016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-577ba90c-6eb1-462e-aab4-c1c8446e168c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:28.001891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-577ba90c-6eb1-462e-aab4-c1c8446e168c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:28.005194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-577ba90c-6eb1-462e-aab4-c1c8446e168c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:28.005958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-577ba90c-6eb1-462e-aab4-c1c8446e168c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:28.791234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-82221895-3966-44be-834f-ae517ae66b18 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:28.799350 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-82221895-3966-44be-834f-ae517ae66b18 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 1.541190 Feb 19 20:58:28.803784 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1096/2112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:27 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:28.815198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a70efcae-cacd-4eb6-8b6d-a420368a3ffa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467776670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:28.908559 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a70efcae-cacd-4eb6-8b6d-a420368a3ffa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.102091 Feb 19 20:58:28.910137 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1097/2113] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:28 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:28.921125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a18f691f-97f0-4ff2-8501-9181b987c598 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:28.923499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a18f691f-97f0-4ff2-8501-9181b987c598 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 330ffac4-6847-4284-aba3-e438b631a218] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:28.938655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a18f691f-97f0-4ff2-8501-9181b987c598 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:28.940468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a18f691f-97f0-4ff2-8501-9181b987c598 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:28.941650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a18f691f-97f0-4ff2-8501-9181b987c598 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:28.942331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a18f691f-97f0-4ff2-8501-9181b987c598 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:29.337171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a18f691f-97f0-4ff2-8501-9181b987c598 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cfee67e3df4200a93528bcb8036b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c7d19a9f264a299de3fef34d6cc2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:29.352573 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a18f691f-97f0-4ff2-8501-9181b987c598 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218" status: 200 len: 1470 microversion: 2.1 time: 0.440557 Feb 19 20:58:29.353873 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1098/2114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:28 2022] GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218 => generated 1470 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:29.806256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-577ba90c-6eb1-462e-aab4-c1c8446e168c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:29.823536 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-577ba90c-6eb1-462e-aab4-c1c8446e168c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1317 microversion: 2.1 time: 1.842606 Feb 19 20:58:29.830498 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1017/2115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:27 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1317 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:29.849579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-890ccce8-20e2-4a5a-b9a1-8af5192b5633 req-6287256e-91e7-4c45-8485-340742b97b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330ffac4-6847-4284-aba3-e438b631a218", "name": "network-vif-deleted", "tag": "bfe33598-34b0-438e-98e1-b9d8f02efb0b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:29.857253 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:29.857253 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:29.878053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-890ccce8-20e2-4a5a-b9a1-8af5192b5633 req-6287256e-91e7-4c45-8485-340742b97b30 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:29.885066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-890ccce8-20e2-4a5a-b9a1-8af5192b5633 req-6287256e-91e7-4c45-8485-340742b97b30 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:29.942027 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-890ccce8-20e2-4a5a-b9a1-8af5192b5633 req-6287256e-91e7-4c45-8485-340742b97b30 service nova] Creating event network-vif-deleted:bfe33598-34b0-438e-98e1-b9d8f02efb0b for instance 330ffac4-6847-4284-aba3-e438b631a218 on nch1-master-1 Feb 19 20:58:29.963236 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-890ccce8-20e2-4a5a-b9a1-8af5192b5633 req-6287256e-91e7-4c45-8485-340742b97b30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131320 Feb 19 20:58:29.963757 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1018/2116] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:29.987723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-abbfdf0a-5d6b-4782-8ccb-3018bc7df4ba tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:29.988430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-abbfdf0a-5d6b-4782-8ccb-3018bc7df4ba tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:30.021542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-abbfdf0a-5d6b-4782-8ccb-3018bc7df4ba tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:30.022000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-abbfdf0a-5d6b-4782-8ccb-3018bc7df4ba tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:30.022813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-abbfdf0a-5d6b-4782-8ccb-3018bc7df4ba tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:30.033866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-abbfdf0a-5d6b-4782-8ccb-3018bc7df4ba tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:30.132074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5934d9f7-9899-4d76-bf3c-a2b2876a71bc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Action: 'create', calling method: .version_select at 0x7f646772b3a0>, body: {"keypair": {"name": "tempest-keypair-165546861"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:30.149921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-abbfdf0a-5d6b-4782-8ccb-3018bc7df4ba tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:58:30.165683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-5934d9f7-9899-4d76-bf3c-a2b2876a71bc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Getting quotas for project 5b11084a5a46488cbb721afa4256a6bd. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:30.176360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-5934d9f7-9899-4d76-bf3c-a2b2876a71bc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Getting quotas for user 0f88ec14e66c4dafa9aeb5595692a225 and project 5b11084a5a46488cbb721afa4256a6bd. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:30.391289 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-abbfdf0a-5d6b-4782-8ccb-3018bc7df4ba tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 204 len: 0 microversion: 2.1 time: 0.425840 Feb 19 20:58:30.392579 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1019/2117] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:58:29 2022] DELETE /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:58:30.399103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-502c5140-b0aa-416c-b0b4-bd2be790254c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:30.400136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-502c5140-b0aa-416c-b0b4-bd2be790254c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:30.428359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-502c5140-b0aa-416c-b0b4-bd2be790254c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:30.429784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-502c5140-b0aa-416c-b0b4-bd2be790254c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:30.431082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-502c5140-b0aa-416c-b0b4-bd2be790254c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:30.431755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-502c5140-b0aa-416c-b0b4-bd2be790254c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:30.949322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-5934d9f7-9899-4d76-bf3c-a2b2876a71bc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Getting quotas for project 5b11084a5a46488cbb721afa4256a6bd. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:30.955437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-5934d9f7-9899-4d76-bf3c-a2b2876a71bc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Getting quotas for user 0f88ec14e66c4dafa9aeb5595692a225 and project 5b11084a5a46488cbb721afa4256a6bd. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:30.966526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-502c5140-b0aa-416c-b0b4-bd2be790254c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:30.978022 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-502c5140-b0aa-416c-b0b4-bd2be790254c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.583601 Feb 19 20:58:30.994833 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1020/2118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:30 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:30.999499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1fc42ad2-a74e-4870-beb2-902918048b65 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f647421d550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:31.012059 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5934d9f7-9899-4d76-bf3c-a2b2876a71bc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.655415 Feb 19 20:58:31.028757 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1099/2119] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:58:29 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:31.034052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-594e2ecc-3e14-423b-aa73-ee385521d9d9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:31.034691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-594e2ecc-3e14-423b-aa73-ee385521d9d9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 330ffac4-6847-4284-aba3-e438b631a218] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:31.104747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-594e2ecc-3e14-423b-aa73-ee385521d9d9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:31.107559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-594e2ecc-3e14-423b-aa73-ee385521d9d9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:31.110470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-594e2ecc-3e14-423b-aa73-ee385521d9d9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:31.112884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-594e2ecc-3e14-423b-aa73-ee385521d9d9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:31.132988 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1fc42ad2-a74e-4870-beb2-902918048b65 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.132855 Feb 19 20:58:31.138016 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1021/2120] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:30 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:31.152366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4726b3fb-e27b-4df1-baea-945d15e6073c tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:31.157430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4726b3fb-e27b-4df1-baea-945d15e6073c tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:31.166110 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-594e2ecc-3e14-423b-aa73-ee385521d9d9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] HTTP exception thrown: Instance 330ffac4-6847-4284-aba3-e438b631a218 could not be found. Feb 19 20:58:31.172554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4726b3fb-e27b-4df1-baea-945d15e6073c tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:31.177932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4726b3fb-e27b-4df1-baea-945d15e6073c tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:31.179742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-594e2ecc-3e14-423b-aa73-ee385521d9d9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Returning 404 to user: Instance 330ffac4-6847-4284-aba3-e438b631a218 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:58:31.180896 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-594e2ecc-3e14-423b-aa73-ee385521d9d9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218" status: 404 len: 111 microversion: 2.1 time: 0.151087 Feb 19 20:58:31.181947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4726b3fb-e27b-4df1-baea-945d15e6073c tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:31.187046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4726b3fb-e27b-4df1-baea-945d15e6073c tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:31.191798 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1100/2121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:31 2022] GET /compute/v2.1/servers/330ffac4-6847-4284-aba3-e438b631a218 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:31.200267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d1471f93-72ff-4a62-a882-9e055c57afc0 req-81343d40-aa91-4fcf-8e58-9521be39a2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac13892-70a3-4a7f-b7a8-a0cd9169d0b5", "name": "network-vif-plugged", "status": "completed", "tag": "835957bc-cf48-4628-ac6b-011383e9ecd7"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:31.215271 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:31.215271 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:31.241949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d1471f93-72ff-4a62-a882-9e055c57afc0 req-81343d40-aa91-4fcf-8e58-9521be39a2f7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:31.251451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d1471f93-72ff-4a62-a882-9e055c57afc0 req-81343d40-aa91-4fcf-8e58-9521be39a2f7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:31.278910 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d1471f93-72ff-4a62-a882-9e055c57afc0 req-81343d40-aa91-4fcf-8e58-9521be39a2f7 service nova] Creating event network-vif-plugged:835957bc-cf48-4628-ac6b-011383e9ecd7 for instance eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 on nch2-master-1 Feb 19 20:58:31.307525 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d1471f93-72ff-4a62-a882-9e055c57afc0 req-81343d40-aa91-4fcf-8e58-9521be39a2f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114295 Feb 19 20:58:31.313831 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1101/2122] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:31.321787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a2c68b6-87ec-465f-a0e2-cbe6aeeb21cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:31.326892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a2c68b6-87ec-465f-a0e2-cbe6aeeb21cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:31.338662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a2c68b6-87ec-465f-a0e2-cbe6aeeb21cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:31.340636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a2c68b6-87ec-465f-a0e2-cbe6aeeb21cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:31.342312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a2c68b6-87ec-465f-a0e2-cbe6aeeb21cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:31.348651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a2c68b6-87ec-465f-a0e2-cbe6aeeb21cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:32.198602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a2c68b6-87ec-465f-a0e2-cbe6aeeb21cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:32.211187 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a2c68b6-87ec-465f-a0e2-cbe6aeeb21cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1317 microversion: 2.1 time: 0.895682 Feb 19 20:58:32.212386 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1102/2123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:31 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1317 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:32.228832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d87b538b-9cfc-4cc9-8d10-12c197c115f9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:32.229469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d87b538b-9cfc-4cc9-8d10-12c197c115f9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] [instance: 9678da86-446e-4e8a-8bde-75d9478d3ecf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:32.229599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4726b3fb-e27b-4df1-baea-945d15e6073c tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:32.238877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d87b538b-9cfc-4cc9-8d10-12c197c115f9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:32.240709 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4726b3fb-e27b-4df1-baea-945d15e6073c tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1511 microversion: 2.1 time: 1.101336 Feb 19 20:58:32.240951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d87b538b-9cfc-4cc9-8d10-12c197c115f9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:32.242379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d87b538b-9cfc-4cc9-8d10-12c197c115f9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:32.246430 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1022/2124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:31 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1511 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:32.246859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d87b538b-9cfc-4cc9-8d10-12c197c115f9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:32.268762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a831d137-cfd4-490e-8fb9-b2ef2b18042c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:32.273293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a831d137-cfd4-490e-8fb9-b2ef2b18042c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:32.277873 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-d87b538b-9cfc-4cc9-8d10-12c197c115f9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] HTTP exception thrown: Instance 9678da86-446e-4e8a-8bde-75d9478d3ecf could not be found. Feb 19 20:58:32.278761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d87b538b-9cfc-4cc9-8d10-12c197c115f9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] Returning 404 to user: Instance 9678da86-446e-4e8a-8bde-75d9478d3ecf could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:58:32.279803 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d87b538b-9cfc-4cc9-8d10-12c197c115f9 tempest-MultipleCreateTestJSON-1195871442 tempest-MultipleCreateTestJSON-1195871442-project] 10.222.0.30 "GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf" status: 404 len: 111 microversion: 2.1 time: 0.065786 Feb 19 20:58:32.281861 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1103/2125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:32 2022] GET /compute/v2.1/servers/9678da86-446e-4e8a-8bde-75d9478d3ecf => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:32.303867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a831d137-cfd4-490e-8fb9-b2ef2b18042c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:32.305352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3bf353c0-562a-4e84-a48e-e0f80e3b6e85 req-c8447f00-337f-4e37-9196-5130ece59355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9678da86-446e-4e8a-8bde-75d9478d3ecf", "name": "network-vif-deleted", "tag": "c0ad5b33-b1ef-47b6-9a56-eaa61e73c963"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:32.308711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a831d137-cfd4-490e-8fb9-b2ef2b18042c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:32.310658 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:32.310658 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:32.311513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a831d137-cfd4-490e-8fb9-b2ef2b18042c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:32.311973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a831d137-cfd4-490e-8fb9-b2ef2b18042c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:32.334113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3bf353c0-562a-4e84-a48e-e0f80e3b6e85 req-c8447f00-337f-4e37-9196-5130ece59355 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:32.334494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3bf353c0-562a-4e84-a48e-e0f80e3b6e85 req-c8447f00-337f-4e37-9196-5130ece59355 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:32.366479 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3bf353c0-562a-4e84-a48e-e0f80e3b6e85 req-c8447f00-337f-4e37-9196-5130ece59355 service nova] Creating event network-vif-deleted:c0ad5b33-b1ef-47b6-9a56-eaa61e73c963 for instance 9678da86-446e-4e8a-8bde-75d9478d3ecf on nch1-master-1 Feb 19 20:58:32.381251 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3bf353c0-562a-4e84-a48e-e0f80e3b6e85 req-c8447f00-337f-4e37-9196-5130ece59355 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096021 Feb 19 20:58:32.392991 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1104/2126] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:32.401042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-be2945d5-67ba-472c-b516-63d4833358ae tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64676ce940>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:32.511428 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-be2945d5-67ba-472c-b516-63d4833358ae tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.116592 Feb 19 20:58:32.512225 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1105/2127] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:32 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:33.232083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5bdbbaf-30b0-4ef4-93a1-65c40890943f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:33.235081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a5bdbbaf-30b0-4ef4-93a1-65c40890943f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:33.251975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5bdbbaf-30b0-4ef4-93a1-65c40890943f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:33.257792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5bdbbaf-30b0-4ef4-93a1-65c40890943f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:33.263750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5bdbbaf-30b0-4ef4-93a1-65c40890943f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:33.264453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5bdbbaf-30b0-4ef4-93a1-65c40890943f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:33.271347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a831d137-cfd4-490e-8fb9-b2ef2b18042c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:33.278958 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a831d137-cfd4-490e-8fb9-b2ef2b18042c tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 1.029373 Feb 19 20:58:33.296168 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1023/2128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:32 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:33.313562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-846588bf-4b51-41a8-94ff-0cc89e13b231 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:33.314462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-846588bf-4b51-41a8-94ff-0cc89e13b231 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:33.327310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846588bf-4b51-41a8-94ff-0cc89e13b231 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:33.329223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846588bf-4b51-41a8-94ff-0cc89e13b231 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:33.330236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846588bf-4b51-41a8-94ff-0cc89e13b231 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:33.334361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846588bf-4b51-41a8-94ff-0cc89e13b231 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:34.338060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-846588bf-4b51-41a8-94ff-0cc89e13b231 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:34.354840 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-846588bf-4b51-41a8-94ff-0cc89e13b231 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1511 microversion: 2.1 time: 1.057161 Feb 19 20:58:34.363353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a5bdbbaf-30b0-4ef4-93a1-65c40890943f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:34.367644 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1024/2129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:33 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1511 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:34.385144 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a5bdbbaf-30b0-4ef4-93a1-65c40890943f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1317 microversion: 2.1 time: 1.159321 Feb 19 20:58:34.389926 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1106/2130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:33 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1317 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:58:34.400589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-31274678-bf8f-4ac1-a296-7ac4de908740 req-7997da8d-65bf-4b42-a857-990eaa4c166e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c69ff896-e0c9-463d-ac90-7b19f8f7d912", "name": "network-vif-plugged", "status": "completed", "tag": "6c8ecc50-2b75-491a-8873-0464b03ecc0d"}, {"server_uuid": "0c58f78c-bd41-4570-86ec-a9d3a898e1b4", "name": "network-vif-plugged", "status": "completed", "tag": "296aa138-ed01-4c5c-b1dd-57c160938115"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:34.408408 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:34.408408 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:34.409503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b969c9d1-1a79-45fb-a8e8-6ad6c1cd25f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467748d30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:34.454601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-31274678-bf8f-4ac1-a296-7ac4de908740 req-7997da8d-65bf-4b42-a857-990eaa4c166e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:34.464696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-31274678-bf8f-4ac1-a296-7ac4de908740 req-7997da8d-65bf-4b42-a857-990eaa4c166e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:34.508375 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-31274678-bf8f-4ac1-a296-7ac4de908740 req-7997da8d-65bf-4b42-a857-990eaa4c166e service nova] Creating event network-vif-plugged:6c8ecc50-2b75-491a-8873-0464b03ecc0d for instance c69ff896-e0c9-463d-ac90-7b19f8f7d912 on nch2-master-1 Feb 19 20:58:34.509305 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-31274678-bf8f-4ac1-a296-7ac4de908740 req-7997da8d-65bf-4b42-a857-990eaa4c166e service nova] Creating event network-vif-plugged:296aa138-ed01-4c5c-b1dd-57c160938115 for instance 0c58f78c-bd41-4570-86ec-a9d3a898e1b4 on nch2-master-1 Feb 19 20:58:34.517277 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b969c9d1-1a79-45fb-a8e8-6ad6c1cd25f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.121857 Feb 19 20:58:34.518085 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1107/2131] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:34 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:34.522848 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-31274678-bf8f-4ac1-a296-7ac4de908740 req-7997da8d-65bf-4b42-a857-990eaa4c166e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.138944 Feb 19 20:58:34.524022 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1025/2132] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:34.535542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9abb5e18-c4de-4f58-bf26-e936a03c372a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:34.536403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9abb5e18-c4de-4f58-bf26-e936a03c372a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:34.554274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9abb5e18-c4de-4f58-bf26-e936a03c372a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:34.555438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9abb5e18-c4de-4f58-bf26-e936a03c372a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:34.556361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9abb5e18-c4de-4f58-bf26-e936a03c372a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:34.557059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9abb5e18-c4de-4f58-bf26-e936a03c372a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:35.038227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9abb5e18-c4de-4f58-bf26-e936a03c372a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:35.051705 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9abb5e18-c4de-4f58-bf26-e936a03c372a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.522744 Feb 19 20:58:35.052716 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1108/2133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:34 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:35.386071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d2637c7-6728-456b-9cb5-12816236c5b3 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:35.386782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d2637c7-6728-456b-9cb5-12816236c5b3 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:35.406901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36a7f458-56e3-4389-9228-05ed2a7bc1cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:35.408145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-36a7f458-56e3-4389-9228-05ed2a7bc1cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:35.415548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d2637c7-6728-456b-9cb5-12816236c5b3 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:35.423976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d2637c7-6728-456b-9cb5-12816236c5b3 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:35.426573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d2637c7-6728-456b-9cb5-12816236c5b3 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:35.431784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d2637c7-6728-456b-9cb5-12816236c5b3 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:35.433502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36a7f458-56e3-4389-9228-05ed2a7bc1cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:35.434193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36a7f458-56e3-4389-9228-05ed2a7bc1cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:35.441543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36a7f458-56e3-4389-9228-05ed2a7bc1cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:35.446325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36a7f458-56e3-4389-9228-05ed2a7bc1cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:35.743745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8d2637c7-6728-456b-9cb5-12816236c5b3 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927e2fa8122b464a8046bdc5a2c94544', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaac4cd79ca4f808d452057a3216fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:35.759680 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d2637c7-6728-456b-9cb5-12816236c5b3 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 200 len: 1469 microversion: 2.1 time: 0.378809 Feb 19 20:58:35.761877 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1026/2134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:35 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:35.775209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-38ad1c20-8a47-4aba-839d-6d9890eef03d req-be307b98-7932-43a8-abc3-5d7ef4d57368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2442bd9a-30f5-4574-bb24-5f0857fb20ed", "name": "network-vif-deleted", "tag": "f59d1dcd-7b7b-4ed6-84ab-7b2d1fd3a947"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:35.779421 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:35.779421 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:35.799507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-38ad1c20-8a47-4aba-839d-6d9890eef03d req-be307b98-7932-43a8-abc3-5d7ef4d57368 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:35.802061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-38ad1c20-8a47-4aba-839d-6d9890eef03d req-be307b98-7932-43a8-abc3-5d7ef4d57368 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:35.819958 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-38ad1c20-8a47-4aba-839d-6d9890eef03d req-be307b98-7932-43a8-abc3-5d7ef4d57368 service nova] Creating event network-vif-deleted:f59d1dcd-7b7b-4ed6-84ab-7b2d1fd3a947 for instance 2442bd9a-30f5-4574-bb24-5f0857fb20ed on nch2-master-1 Feb 19 20:58:35.827721 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-38ad1c20-8a47-4aba-839d-6d9890eef03d req-be307b98-7932-43a8-abc3-5d7ef4d57368 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063812 Feb 19 20:58:35.828709 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1027/2135] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:35.838139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ceafee4e-8af4-4b4d-8cc3-228b5af7a5ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6474248ee0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:35.946257 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ceafee4e-8af4-4b4d-8cc3-228b5af7a5ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.115649 Feb 19 20:58:35.947227 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1028/2136] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:35 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:36.058751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-36a7f458-56e3-4389-9228-05ed2a7bc1cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:36.066505 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36a7f458-56e3-4389-9228-05ed2a7bc1cd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1317 microversion: 2.1 time: 0.664067 Feb 19 20:58:36.067313 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1109/2137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:35 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1317 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:58:36.070316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-734e55cf-c14b-4a13-ba94-8b5f1e92742d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:36.071187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-734e55cf-c14b-4a13-ba94-8b5f1e92742d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:36.085450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-734e55cf-c14b-4a13-ba94-8b5f1e92742d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:36.086027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-734e55cf-c14b-4a13-ba94-8b5f1e92742d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:36.093966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-734e55cf-c14b-4a13-ba94-8b5f1e92742d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:36.097041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-734e55cf-c14b-4a13-ba94-8b5f1e92742d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:36.599214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-734e55cf-c14b-4a13-ba94-8b5f1e92742d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:36.621259 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-734e55cf-c14b-4a13-ba94-8b5f1e92742d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1199 microversion: 2.1 time: 0.556076 Feb 19 20:58:36.627635 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1029/2138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:36 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1199 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:36.657518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a42ccd6f-73e6-4cc9-8bf5-dae326ab1b95 req-d1191334-2b2c-45aa-9811-9b8419d9eed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f8a307-e082-4ac1-b3db-3860b9e66774", "name": "network-vif-plugged", "status": "completed", "tag": "89832a83-9f4f-4449-b43c-c9fafb143517"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:36.659568 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:36.659568 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:36.689715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a42ccd6f-73e6-4cc9-8bf5-dae326ab1b95 req-d1191334-2b2c-45aa-9811-9b8419d9eed1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:36.689715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a42ccd6f-73e6-4cc9-8bf5-dae326ab1b95 req-d1191334-2b2c-45aa-9811-9b8419d9eed1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:36.733528 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a42ccd6f-73e6-4cc9-8bf5-dae326ab1b95 req-d1191334-2b2c-45aa-9811-9b8419d9eed1 service nova] Creating event network-vif-plugged:89832a83-9f4f-4449-b43c-c9fafb143517 for instance 87f8a307-e082-4ac1-b3db-3860b9e66774 on nch1-master-1 Feb 19 20:58:36.747488 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a42ccd6f-73e6-4cc9-8bf5-dae326ab1b95 req-d1191334-2b2c-45aa-9811-9b8419d9eed1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094056 Feb 19 20:58:36.750753 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1110/2139] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:36.755698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-82ffdd41-6730-4868-91b6-6f651288af1a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:36.756210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-82ffdd41-6730-4868-91b6-6f651288af1a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:36.778605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bcdfd4b1-b814-481c-8f1d-93391d496556 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:36.779314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bcdfd4b1-b814-481c-8f1d-93391d496556 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] [instance: 2442bd9a-30f5-4574-bb24-5f0857fb20ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:36.782432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82ffdd41-6730-4868-91b6-6f651288af1a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:36.783049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82ffdd41-6730-4868-91b6-6f651288af1a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:36.783901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82ffdd41-6730-4868-91b6-6f651288af1a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:36.784357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82ffdd41-6730-4868-91b6-6f651288af1a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:36.809961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bcdfd4b1-b814-481c-8f1d-93391d496556 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:36.810379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bcdfd4b1-b814-481c-8f1d-93391d496556 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:36.811187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bcdfd4b1-b814-481c-8f1d-93391d496556 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:36.811626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bcdfd4b1-b814-481c-8f1d-93391d496556 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:36.846596 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-82ffdd41-6730-4868-91b6-6f651288af1a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] HTTP exception thrown: Instance d13c63f9-b079-4f3b-9187-bfddac8c9749 could not be found. Feb 19 20:58:36.864981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-82ffdd41-6730-4868-91b6-6f651288af1a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Returning 404 to user: Instance d13c63f9-b079-4f3b-9187-bfddac8c9749 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:58:36.866152 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-82ffdd41-6730-4868-91b6-6f651288af1a tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 404 len: 111 microversion: 2.42 time: 0.116372 Feb 19 20:58:36.869897 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1030/2140] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:58:36 2022] DELETE /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:58:36.877470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-809765077", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "81f242f2-1080-48a8-9d1e-339d4894947e"}], "security_groups": [{"name": "tempest-securitygroup--1000879777"}], "key_name": "tempest-keypair-165546861", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:36.885379 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-bcdfd4b1-b814-481c-8f1d-93391d496556 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] HTTP exception thrown: Instance 2442bd9a-30f5-4574-bb24-5f0857fb20ed could not be found. Feb 19 20:58:36.885985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bcdfd4b1-b814-481c-8f1d-93391d496556 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] Returning 404 to user: Instance 2442bd9a-30f5-4574-bb24-5f0857fb20ed could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:58:36.886824 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bcdfd4b1-b814-481c-8f1d-93391d496556 tempest-VolumesAdminNegativeTest-637257177 tempest-VolumesAdminNegativeTest-637257177-project] 10.222.0.30 "GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed" status: 404 len: 111 microversion: 2.1 time: 0.112660 Feb 19 20:58:36.887779 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1111/2141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:36 2022] GET /compute/v2.1/servers/2442bd9a-30f5-4574-bb24-5f0857fb20ed => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:58:36.895044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b5943479-5224-4b3c-b8cf-f4a4d41deba6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:36.895662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b5943479-5224-4b3c-b8cf-f4a4d41deba6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] [instance: d13c63f9-b079-4f3b-9187-bfddac8c9749] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:36.916769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5943479-5224-4b3c-b8cf-f4a4d41deba6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:36.921264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5943479-5224-4b3c-b8cf-f4a4d41deba6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:36.922240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5943479-5224-4b3c-b8cf-f4a4d41deba6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:36.922689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5943479-5224-4b3c-b8cf-f4a4d41deba6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:36.960285 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-b5943479-5224-4b3c-b8cf-f4a4d41deba6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] HTTP exception thrown: Instance d13c63f9-b079-4f3b-9187-bfddac8c9749 could not be found. Feb 19 20:58:36.960908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b5943479-5224-4b3c-b8cf-f4a4d41deba6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] Returning 404 to user: Instance d13c63f9-b079-4f3b-9187-bfddac8c9749 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:58:36.961748 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b5943479-5224-4b3c-b8cf-f4a4d41deba6 tempest-TaggedBootDevicesTest_v242-1053603382 tempest-TaggedBootDevicesTest_v242-1053603382-project] 10.222.0.30 "GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749" status: 404 len: 111 microversion: 2.42 time: 0.072959 Feb 19 20:58:36.966244 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1112/2142] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:58:36 2022] GET /compute/v2.1/servers/d13c63f9-b079-4f3b-9187-bfddac8c9749 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:58:36.973705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44c7b683-e12a-4d57-80dc-2ea22b26c7c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64678e2ca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:37.166968 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44c7b683-e12a-4d57-80dc-2ea22b26c7c3 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.199612 Feb 19 20:58:37.173421 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1113/2143] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:36 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:37.181740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6d072777-0af6-4e6e-b64d-cdd2193809aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:37.182356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6d072777-0af6-4e6e-b64d-cdd2193809aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:37.215154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d072777-0af6-4e6e-b64d-cdd2193809aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:37.215604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d072777-0af6-4e6e-b64d-cdd2193809aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:37.216439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d072777-0af6-4e6e-b64d-cdd2193809aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:37.216881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d072777-0af6-4e6e-b64d-cdd2193809aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:37.315590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] validate_networks() for [('81f242f2-1080-48a8-9d1e-339d4894947e', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:58:37.852926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6d072777-0af6-4e6e-b64d-cdd2193809aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:37.872926 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6d072777-0af6-4e6e-b64d-cdd2193809aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1317 microversion: 2.1 time: 0.693880 Feb 19 20:58:37.876956 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1114/2144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:37 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1317 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:37.889428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-01e14103-68eb-43b0-ade9-502bd4d48761 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:37.890857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-01e14103-68eb-43b0-ade9-502bd4d48761 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:37.909745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01e14103-68eb-43b0-ade9-502bd4d48761 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:37.910597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01e14103-68eb-43b0-ade9-502bd4d48761 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:37.911927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01e14103-68eb-43b0-ade9-502bd4d48761 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:37.912998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01e14103-68eb-43b0-ade9-502bd4d48761 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:38.679028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-01e14103-68eb-43b0-ade9-502bd4d48761 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:38.687706 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-01e14103-68eb-43b0-ade9-502bd4d48761 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1382 microversion: 2.1 time: 0.809256 Feb 19 20:58:38.690728 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1115/2145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:37 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1382 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:38.700475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-057782ed-5813-43bf-b755-17c31c434efc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467748dc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:38.746128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Getting quotas for project 5b11084a5a46488cbb721afa4256a6bd. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:38.756938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Getting quotas for user 0f88ec14e66c4dafa9aeb5595692a225 and project 5b11084a5a46488cbb721afa4256a6bd. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:38.788014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:58:38.788575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:58:38.789160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:58:38.789721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:58:38.790245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:58:38.802654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:38.803378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:38.804480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:38.805474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:38.830137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Getting quotas for project 5b11084a5a46488cbb721afa4256a6bd. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:38.835611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Getting quotas for user 0f88ec14e66c4dafa9aeb5595692a225 and project 5b11084a5a46488cbb721afa4256a6bd. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:38.846214 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-057782ed-5813-43bf-b755-17c31c434efc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.151716 Feb 19 20:58:38.846816 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1116/2146] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:38 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:38.860714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7d6ed6c-16bd-4d73-a423-8802b6fd0c0d tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:38.861341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d7d6ed6c-16bd-4d73-a423-8802b6fd0c0d tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:38.872291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:58:38.879948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:58:38.890002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7d6ed6c-16bd-4d73-a423-8802b6fd0c0d tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:38.890526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7d6ed6c-16bd-4d73-a423-8802b6fd0c0d tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:38.891569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7d6ed6c-16bd-4d73-a423-8802b6fd0c0d tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:38.892009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7d6ed6c-16bd-4d73-a423-8802b6fd0c0d tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:39.028985 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5aca5f35-9265-4451-bb43-077a1dcb022f tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.160957 Feb 19 20:58:39.029974 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1031/2147] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:58:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:58:39.039235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-460fc0b8-519a-4d09-97ee-fd986f5bafda tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:39.040311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-460fc0b8-519a-4d09-97ee-fd986f5bafda tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:39.052316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-460fc0b8-519a-4d09-97ee-fd986f5bafda tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:39.053927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-460fc0b8-519a-4d09-97ee-fd986f5bafda tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:39.055744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-460fc0b8-519a-4d09-97ee-fd986f5bafda tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:39.056996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-460fc0b8-519a-4d09-97ee-fd986f5bafda tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:39.335062 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d7d6ed6c-16bd-4d73-a423-8802b6fd0c0d tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1533 microversion: 2.1 time: 0.481446 Feb 19 20:58:39.337111 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1117/2148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:38 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1533 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:39.347912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2ac6b24c-fb9e-44a7-9d00-9dad8aef491a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:39.353366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2ac6b24c-fb9e-44a7-9d00-9dad8aef491a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:39.533842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2ac6b24c-fb9e-44a7-9d00-9dad8aef491a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:39.542186 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2ac6b24c-fb9e-44a7-9d00-9dad8aef491a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1276 microversion: 2.1 time: 0.203596 Feb 19 20:58:39.545070 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1118/2149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:39 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:39.555520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aee1ed7c-c179-496d-9ac5-24fb7c23d426 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:39.557346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aee1ed7c-c179-496d-9ac5-24fb7c23d426 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:39.574268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aee1ed7c-c179-496d-9ac5-24fb7c23d426 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:39.575734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aee1ed7c-c179-496d-9ac5-24fb7c23d426 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:39.577450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aee1ed7c-c179-496d-9ac5-24fb7c23d426 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:39.578994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aee1ed7c-c179-496d-9ac5-24fb7c23d426 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:39.616526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-460fc0b8-519a-4d09-97ee-fd986f5bafda tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:39.626484 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-460fc0b8-519a-4d09-97ee-fd986f5bafda tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1466 microversion: 2.1 time: 0.595204 Feb 19 20:58:39.627089 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1032/2150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:39 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1466 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:39.678812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cd577864-28bf-4ab2-a87d-371c800bf5dd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:39.680192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cd577864-28bf-4ab2-a87d-371c800bf5dd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:39.695457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd577864-28bf-4ab2-a87d-371c800bf5dd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:39.725418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd577864-28bf-4ab2-a87d-371c800bf5dd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:39.726422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd577864-28bf-4ab2-a87d-371c800bf5dd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:39.726872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd577864-28bf-4ab2-a87d-371c800bf5dd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:39.895713 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aee1ed7c-c179-496d-9ac5-24fb7c23d426 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1533 microversion: 2.1 time: 0.349282 Feb 19 20:58:39.896307 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1119/2151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:39 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1533 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:39.926826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87f8b3ea-68ea-4de0-b9ee-3f76571a621d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467753f70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:40.035714 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-87f8b3ea-68ea-4de0-b9ee-3f76571a621d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.122612 Feb 19 20:58:40.036298 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1120/2152] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:39 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:40.044402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-be257c05-00bd-49be-a4b9-b7e0078a7f25 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:40.045837 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:40.045837 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:40.047969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be257c05-00bd-49be-a4b9-b7e0078a7f25 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:40.072345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be257c05-00bd-49be-a4b9-b7e0078a7f25 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:40.074721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be257c05-00bd-49be-a4b9-b7e0078a7f25 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:40.075175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be257c05-00bd-49be-a4b9-b7e0078a7f25 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:40.220974 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-be257c05-00bd-49be-a4b9-b7e0078a7f25 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.183557 Feb 19 20:58:40.229866 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1121/2153] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Feb 19 20:58:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:40.260341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-de670661-40b9-4cc6-8a2b-b7c16a728115 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:40.261823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-de670661-40b9-4cc6-8a2b-b7c16a728115 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:40.273164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de670661-40b9-4cc6-8a2b-b7c16a728115 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:40.274244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de670661-40b9-4cc6-8a2b-b7c16a728115 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:40.275626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de670661-40b9-4cc6-8a2b-b7c16a728115 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:40.276568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de670661-40b9-4cc6-8a2b-b7c16a728115 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:40.347994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-de670661-40b9-4cc6-8a2b-b7c16a728115 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lazy-loading 'flavor' on Instance uuid c69ff896-e0c9-463d-ac90-7b19f8f7d912 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:58:40.363235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-de670661-40b9-4cc6-8a2b-b7c16a728115 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Going to try to live migrate instance to nch1-master-1 {{(pid=136094) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 20:58:40.453990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cd577864-28bf-4ab2-a87d-371c800bf5dd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:40.478552 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cd577864-28bf-4ab2-a87d-371c800bf5dd tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 200 len: 1467 microversion: 2.1 time: 0.827565 Feb 19 20:58:40.481029 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1033/2154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:39 2022] GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 1467 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:40.521775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f7da85c-37a0-4273-848a-33e2c8013bb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-443659664"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:40.525508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f7da85c-37a0-4273-848a-33e2c8013bb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:40.542824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f7da85c-37a0-4273-848a-33e2c8013bb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:40.543190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f7da85c-37a0-4273-848a-33e2c8013bb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:40.543998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f7da85c-37a0-4273-848a-33e2c8013bb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:40.554472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f7da85c-37a0-4273-848a-33e2c8013bb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:41.455882 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f7da85c-37a0-4273-848a-33e2c8013bb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "POST /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5/action" status: 202 len: 0 microversion: 2.1 time: 0.959451 Feb 19 20:58:41.471581 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1034/2155] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:58:40 2022] POST /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5/action => generated 0 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 20:58:41.481425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-36f646b1-6d19-41c6-8798-415182b28e29 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:41.512063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-36f646b1-6d19-41c6-8798-415182b28e29 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:41.534778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36f646b1-6d19-41c6-8798-415182b28e29 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:41.538636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36f646b1-6d19-41c6-8798-415182b28e29 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:41.539835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36f646b1-6d19-41c6-8798-415182b28e29 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:41.541144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36f646b1-6d19-41c6-8798-415182b28e29 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:42.225682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-36f646b1-6d19-41c6-8798-415182b28e29 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:42.247625 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-36f646b1-6d19-41c6-8798-415182b28e29 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1346 microversion: 2.1 time: 0.768978 Feb 19 20:58:42.264356 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1035/2156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:41 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1346 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:42.269403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f1c31304-80ac-471e-b9f6-930deefbef41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467b5be50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:42.351730 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f1c31304-80ac-471e-b9f6-930deefbef41 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.086089 Feb 19 20:58:42.353960 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1036/2157] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:42 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:42.360847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8460de2d-050c-47f5-9368-3142fde1fa6e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467a89790>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:42.438146 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8460de2d-050c-47f5-9368-3142fde1fa6e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.083092 Feb 19 20:58:42.444543 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1037/2158] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:42 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:43.269046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d3d3fdd4-17d3-42d0-8605-7279f6c82e4d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:43.270756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d3d3fdd4-17d3-42d0-8605-7279f6c82e4d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:43.277483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d3fdd4-17d3-42d0-8605-7279f6c82e4d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:43.280032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d3fdd4-17d3-42d0-8605-7279f6c82e4d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:43.282230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d3fdd4-17d3-42d0-8605-7279f6c82e4d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:43.286542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d3fdd4-17d3-42d0-8605-7279f6c82e4d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:43.495585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3d3fdd4-17d3-42d0-8605-7279f6c82e4d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:43.520362 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d3d3fdd4-17d3-42d0-8605-7279f6c82e4d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1334 microversion: 2.1 time: 0.256544 Feb 19 20:58:43.543096 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1038/2159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:43 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1334 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:43.930880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-580059462", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "d8017b52-8d0b-4da2-bb30-f24fbe187d92"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:44.023168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] validate_networks() for [('d8017b52-8d0b-4da2-bb30-f24fbe187d92', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:58:44.711043 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-de670661-40b9-4cc6-8a2b-b7c16a728115 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912/action" status: 202 len: 0 microversion: 2.1 time: 4.468374 Feb 19 20:58:44.713213 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1122/2160] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:58:40 2022] POST /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912/action => generated 0 bytes in 4474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:58:44.720323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-faec6018-f395-4ad2-8687-92269ad998cc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467787310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:44.824193 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-faec6018-f395-4ad2-8687-92269ad998cc tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.109283 Feb 19 20:58:44.825214 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1123/2161] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:44 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:44.837997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-86c11315-d54f-4853-8849-20807421282f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467753040>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:44.930032 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-86c11315-d54f-4853-8849-20807421282f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.099773 Feb 19 20:58:44.930907 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1124/2162] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:44 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:45.078899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:58:45.080014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:58:45.080749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:58:45.081705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:58:45.082348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:58:45.098819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:45.105004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:45.106238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:45.106913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:45.150714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Getting quotas for project 2f4aa3e254e944d4a85f2085a89a921b. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:45.157059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Getting quotas for user e94820c6c6d04bcbae0e183cb51aa3b1 and project 2f4aa3e254e944d4a85f2085a89a921b. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:45.185713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:58:45.192244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:58:45.298057 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-29eb3047-91d6-427b-935c-6e8a65b2d2ff tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.753182 Feb 19 20:58:45.299168 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1039/2163] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:58:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:58:45.306606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2fa689e0-a5b5-4c25-9444-5132222f9c13 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:45.307963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2fa689e0-a5b5-4c25-9444-5132222f9c13 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:45.320616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fa689e0-a5b5-4c25-9444-5132222f9c13 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:45.323115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fa689e0-a5b5-4c25-9444-5132222f9c13 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:45.324719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fa689e0-a5b5-4c25-9444-5132222f9c13 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:45.325657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fa689e0-a5b5-4c25-9444-5132222f9c13 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:45.435513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c5d0cd5-7157-4823-92ab-e200480a3921 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Action: 'create', calling method: .version_select at 0x7f646772b3a0>, body: {"keypair": {"name": "tempest-keypair-1478955409"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:45.466384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1c5d0cd5-7157-4823-92ab-e200480a3921 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:45.476675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1c5d0cd5-7157-4823-92ab-e200480a3921 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:45.898758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1c5d0cd5-7157-4823-92ab-e200480a3921 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:45.904436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1c5d0cd5-7157-4823-92ab-e200480a3921 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:45.946158 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c5d0cd5-7157-4823-92ab-e200480a3921 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.013858 Feb 19 20:58:45.947448 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1125/2164] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:58:44 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:45.953379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-db36f51d-eb8d-4065-b40f-40b01a6ce996 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:45.954559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-db36f51d-eb8d-4065-b40f-40b01a6ce996 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:45.966778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db36f51d-eb8d-4065-b40f-40b01a6ce996 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:45.967559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db36f51d-eb8d-4065-b40f-40b01a6ce996 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:45.969458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db36f51d-eb8d-4065-b40f-40b01a6ce996 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:45.970126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db36f51d-eb8d-4065-b40f-40b01a6ce996 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:46.701845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2fa689e0-a5b5-4c25-9444-5132222f9c13 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:46.713581 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2fa689e0-a5b5-4c25-9444-5132222f9c13 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1402 microversion: 2.1 time: 1.410852 Feb 19 20:58:46.715334 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1040/2165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:45 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1402 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:46.723261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40ffac7f-e93e-49f7-8060-4ad78ba7626f tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:46.734776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-40ffac7f-e93e-49f7-8060-4ad78ba7626f tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:46.741998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40ffac7f-e93e-49f7-8060-4ad78ba7626f tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:46.742707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40ffac7f-e93e-49f7-8060-4ad78ba7626f tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:46.743670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40ffac7f-e93e-49f7-8060-4ad78ba7626f tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:46.744270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40ffac7f-e93e-49f7-8060-4ad78ba7626f tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:46.917712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40ffac7f-e93e-49f7-8060-4ad78ba7626f tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:46.928506 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-40ffac7f-e93e-49f7-8060-4ad78ba7626f tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1267 microversion: 2.1 time: 0.209815 Feb 19 20:58:46.929149 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1041/2166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:46 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:46.941226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ef8bf070-3548-441a-8f16-c47b66672c86 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6479261280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:46.964988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-db36f51d-eb8d-4065-b40f-40b01a6ce996 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:46.974011 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-db36f51d-eb8d-4065-b40f-40b01a6ce996 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1392 microversion: 2.1 time: 1.025240 Feb 19 20:58:46.978715 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1126/2167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:45 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1392 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:47.001375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a84cdb0e-1809-4f8d-b4f9-996d6f93625a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467753550>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:47.025202 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ef8bf070-3548-441a-8f16-c47b66672c86 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.093252 Feb 19 20:58:47.027263 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1042/2168] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:46 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:47.039169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-25c23915-5161-445b-89fb-f2bd406a3a38 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Calling method '.version_select at 0x7f6479261ca0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:47.060950 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-25c23915-5161-445b-89fb-f2bd406a3a38 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1478955409" status: 200 len: 692 microversion: 2.1 time: 0.031472 Feb 19 20:58:47.065385 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1043/2169] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 20:58:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1478955409 => generated 692 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:47.076492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6555525b-fbfd-4877-974d-c1a44dde0451 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Calling method '.version_select at 0x7f6479252e50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:47.108741 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a84cdb0e-1809-4f8d-b4f9-996d6f93625a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.119422 Feb 19 20:58:47.110173 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1127/2170] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:46 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:47.119055 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6555525b-fbfd-4877-974d-c1a44dde0451 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478955409" status: 202 len: 0 microversion: 2.1 time: 0.046596 Feb 19 20:58:47.120074 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1044/2171] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 20:58:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478955409 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 20:58:47.129013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fdee7f9a-e6ae-423b-80cf-9543194cda41 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Action: 'create', calling method: .version_select at 0x7f64676fe670>, body: {"keypair": {"name": "tempest-keypair-17297546"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:47.156973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-fdee7f9a-e6ae-423b-80cf-9543194cda41 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:47.169185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-fdee7f9a-e6ae-423b-80cf-9543194cda41 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:47.491258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-fdee7f9a-e6ae-423b-80cf-9543194cda41 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:47.495934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-fdee7f9a-e6ae-423b-80cf-9543194cda41 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:47.545948 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fdee7f9a-e6ae-423b-80cf-9543194cda41 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.420491 Feb 19 20:58:47.547175 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1128/2172] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:58:47 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:47.560183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fe2f2774-bccf-49e9-a67b-3f16a1892649 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Calling method '.version_select at 0x7f6474248280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:47.605680 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fe2f2774-bccf-49e9-a67b-3f16a1892649 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17297546" status: 202 len: 0 microversion: 2.1 time: 0.049557 Feb 19 20:58:47.607195 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1045/2173] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Feb 19 20:58:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17297546 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:58:47.618383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9a34d3a8-7377-4dbb-a829-fdb3b9134767 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Action: 'create', calling method: .version_select at 0x7f6467686160>, body: {"keypair": {"name": "tempest-keypair-1632386013", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:47.637088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-9a34d3a8-7377-4dbb-a829-fdb3b9134767 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:47.647881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-9a34d3a8-7377-4dbb-a829-fdb3b9134767 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:47.696886 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9a34d3a8-7377-4dbb-a829-fdb3b9134767 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.083981 Feb 19 20:58:47.699054 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1129/2174] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Feb 19 20:58:47 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:47.707568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-02a4c5cc-07a2-4687-b4cd-8c36777b4091 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Calling method '.version_select at 0x7f6474347f70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:47.732760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4ecc12be-1744-47c5-ac98-0cded45e1974 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:47.733382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4ecc12be-1744-47c5-ac98-0cded45e1974 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:47.741401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ecc12be-1744-47c5-ac98-0cded45e1974 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:47.741857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ecc12be-1744-47c5-ac98-0cded45e1974 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:47.742657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ecc12be-1744-47c5-ac98-0cded45e1974 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:47.743097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ecc12be-1744-47c5-ac98-0cded45e1974 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:47.754252 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-02a4c5cc-07a2-4687-b4cd-8c36777b4091 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632386013" status: 202 len: 0 microversion: 2.1 time: 0.050224 Feb 19 20:58:47.755317 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1046/2175] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 20:58:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632386013 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:58:47.767117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06825211-dd86-47c9-9776-dd94bf4cc1fd tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Action: 'create', calling method: .version_select at 0x7f64792529d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-604212048"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:47.809772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06825211-dd86-47c9-9776-dd94bf4cc1fd tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:47.815952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06825211-dd86-47c9-9776-dd94bf4cc1fd tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:48.285307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06825211-dd86-47c9-9776-dd94bf4cc1fd tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:48.298357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06825211-dd86-47c9-9776-dd94bf4cc1fd tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:48.335321 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06825211-dd86-47c9-9776-dd94bf4cc1fd tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.573647 Feb 19 20:58:48.336198 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1047/2176] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:58:47 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:48.340760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f3473792-17d7-4689-88df-8db84515d815 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:48.341593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f3473792-17d7-4689-88df-8db84515d815 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:48.356621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3473792-17d7-4689-88df-8db84515d815 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:48.360002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3473792-17d7-4689-88df-8db84515d815 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:48.365346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3473792-17d7-4689-88df-8db84515d815 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:48.366249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3473792-17d7-4689-88df-8db84515d815 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:49.541882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4ecc12be-1744-47c5-ac98-0cded45e1974 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:49.557411 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4ecc12be-1744-47c5-ac98-0cded45e1974 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1402 microversion: 2.1 time: 1.829197 Feb 19 20:58:49.575680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f3473792-17d7-4689-88df-8db84515d815 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:49.584608 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1130/2177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:47 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1402 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:49.592752 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f3473792-17d7-4689-88df-8db84515d815 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1315 microversion: 2.1 time: 1.253957 Feb 19 20:58:49.595787 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1048/2178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:48 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1315 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:49.597391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c6c5375-2259-4576-ad4c-266cddd48a51 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:49.598338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1c6c5375-2259-4576-ad4c-266cddd48a51 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:49.610884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c93be3cb-e3d1-455a-8b5e-8043cd194b4b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6479261430>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:49.618480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c6c5375-2259-4576-ad4c-266cddd48a51 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:49.620252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c6c5375-2259-4576-ad4c-266cddd48a51 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:49.622334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c6c5375-2259-4576-ad4c-266cddd48a51 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:49.625220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c6c5375-2259-4576-ad4c-266cddd48a51 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:49.681445 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c93be3cb-e3d1-455a-8b5e-8043cd194b4b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1414 microversion: 2.1 time: 0.083659 Feb 19 20:58:49.682046 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1049/2179] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:49 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:49.699781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-42908256-d5f5-424c-b17a-a13cc17c452a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64792138b0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:49.774523 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-42908256-d5f5-424c-b17a-a13cc17c452a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.089264 Feb 19 20:58:49.775755 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1050/2180] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:49 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:49.789293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8dee05e-e524-41d2-a26f-74be4dc65578 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Action: 'create', calling method: .version_select at 0x7f6467b5be50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-839006745"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:49.838854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e8dee05e-e524-41d2-a26f-74be4dc65578 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:49.845296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e8dee05e-e524-41d2-a26f-74be4dc65578 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:50.123496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e8dee05e-e524-41d2-a26f-74be4dc65578 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:50.129992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e8dee05e-e524-41d2-a26f-74be4dc65578 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:50.149793 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e8dee05e-e524-41d2-a26f-74be4dc65578 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.371235 Feb 19 20:58:50.152506 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1051/2181] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:58:49 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:50.192969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5dd5a717-3b2f-4498-b55c-481cfa80ae33 req-1bb46453-2368-40b8-8fa8-2e6124914182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d83fa58-4a1d-49bf-abb3-565b32fd4b9f", "tag": "7227c1a7-5a78-4c8d-9abb-0601b9286874"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:50.206800 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:50.206800 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:50.215450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5dd5a717-3b2f-4498-b55c-481cfa80ae33 req-1bb46453-2368-40b8-8fa8-2e6124914182 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:50.215901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5dd5a717-3b2f-4498-b55c-481cfa80ae33 req-1bb46453-2368-40b8-8fa8-2e6124914182 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:50.229051 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5dd5a717-3b2f-4498-b55c-481cfa80ae33 req-1bb46453-2368-40b8-8fa8-2e6124914182 service nova] Creating event network-changed:7227c1a7-5a78-4c8d-9abb-0601b9286874 for instance 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f on nch1-master-1 Feb 19 20:58:50.234171 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5dd5a717-3b2f-4498-b55c-481cfa80ae33 req-1bb46453-2368-40b8-8fa8-2e6124914182 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080123 Feb 19 20:58:50.235496 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1052/2182] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:50.240835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6dc56c54-c2b9-4017-8f35-c1510fccf669 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Action: 'create', calling method: .version_select at 0x7f6467a89310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2122065129"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:50.257639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-6dc56c54-c2b9-4017-8f35-c1510fccf669 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:50.267863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-6dc56c54-c2b9-4017-8f35-c1510fccf669 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:50.313580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c6c5375-2259-4576-ad4c-266cddd48a51 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:50.321477 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c6c5375-2259-4576-ad4c-266cddd48a51 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1392 microversion: 2.1 time: 0.734934 Feb 19 20:58:50.322065 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1131/2183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:49 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1392 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:50.544115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5343a7ee-1582-4a99-bc52-66ca3521fd80 req-885bca2e-ea44-4ee2-ba1f-26bf3f18bb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac13892-70a3-4a7f-b7a8-a0cd9169d0b5", "name": "network-vif-plugged", "status": "completed", "tag": "835957bc-cf48-4628-ac6b-011383e9ecd7"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:50.545803 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:50.545803 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:50.560264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5343a7ee-1582-4a99-bc52-66ca3521fd80 req-885bca2e-ea44-4ee2-ba1f-26bf3f18bb70 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:50.560754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5343a7ee-1582-4a99-bc52-66ca3521fd80 req-885bca2e-ea44-4ee2-ba1f-26bf3f18bb70 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:50.585555 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5343a7ee-1582-4a99-bc52-66ca3521fd80 req-885bca2e-ea44-4ee2-ba1f-26bf3f18bb70 service nova] Creating event network-vif-plugged:835957bc-cf48-4628-ac6b-011383e9ecd7 for instance eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 on nch2-master-1 Feb 19 20:58:50.597138 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5343a7ee-1582-4a99-bc52-66ca3521fd80 req-885bca2e-ea44-4ee2-ba1f-26bf3f18bb70 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053119 Feb 19 20:58:50.598153 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1132/2184] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:58:50.608358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c1b0cf1e-0c6c-4077-9eff-14b8f16ae605 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:50.619687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c1b0cf1e-0c6c-4077-9eff-14b8f16ae605 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:50.626033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1b0cf1e-0c6c-4077-9eff-14b8f16ae605 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:50.626486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1b0cf1e-0c6c-4077-9eff-14b8f16ae605 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:50.627277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1b0cf1e-0c6c-4077-9eff-14b8f16ae605 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:50.627713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1b0cf1e-0c6c-4077-9eff-14b8f16ae605 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:50.800203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-6dc56c54-c2b9-4017-8f35-c1510fccf669 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:50.804987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-6dc56c54-c2b9-4017-8f35-c1510fccf669 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Getting quotas for user 351aab489ec74b039337b89d216e3c0e and project a8c68ae4f3aa48ab8478d0a4019dd481. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:50.839325 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6dc56c54-c2b9-4017-8f35-c1510fccf669 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.602362 Feb 19 20:58:50.844386 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1053/2185] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 20:58:50 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:50.849153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f77072a-d855-4e6a-8494-3a11052e9566 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:50.854730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f77072a-d855-4e6a-8494-3a11052e9566 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:50.868406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f77072a-d855-4e6a-8494-3a11052e9566 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:50.869180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f77072a-d855-4e6a-8494-3a11052e9566 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:50.870258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f77072a-d855-4e6a-8494-3a11052e9566 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:50.870971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f77072a-d855-4e6a-8494-3a11052e9566 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:51.532606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c1b0cf1e-0c6c-4077-9eff-14b8f16ae605 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:51.550268 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c1b0cf1e-0c6c-4077-9eff-14b8f16ae605 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1402 microversion: 2.1 time: 0.950652 Feb 19 20:58:51.555846 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1133/2186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:50 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1402 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:51.562794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f77072a-d855-4e6a-8494-3a11052e9566 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:51.571142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-501c5b9f-df2b-4b6a-8ccd-9ec7466efbdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467686ca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:51.577278 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f77072a-d855-4e6a-8494-3a11052e9566 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1315 microversion: 2.1 time: 0.729484 Feb 19 20:58:51.590246 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1054/2187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:50 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:51.603494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8af05c23-3d62-406b-9c21-58762436e23a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479261d30>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:51.766249 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-501c5b9f-df2b-4b6a-8ccd-9ec7466efbdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1423 microversion: 2.1 time: 0.208628 Feb 19 20:58:51.767274 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1134/2188] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:51 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1423 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:51.777354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3da349fd-63df-45dd-8dcd-570527c7cd80 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Calling method '.version_select at 0x7f6467686b80>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:51.790719 ncdv-master-1 devstack@n-api.service[136094]: WARNING oslo_db.sqlalchemy.utils [None req-3da349fd-63df-45dd-8dcd-570527c7cd80 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 19 20:58:51.799691 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8af05c23-3d62-406b-9c21-58762436e23a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.203605 Feb 19 20:58:51.800737 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1055/2189] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:51 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:51.810731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e656c2df-70c0-4195-85b2-6c4f2bc5adeb tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:51.813959 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3da349fd-63df-45dd-8dcd-570527c7cd80 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1674 microversion: 2.1 time: 0.042748 Feb 19 20:58:51.817820 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1135/2190] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:58:51 2022] GET /compute/v2.1/os-keypairs => generated 1674 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:51.817951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e656c2df-70c0-4195-85b2-6c4f2bc5adeb tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:51.826031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ed79ba41-7aa7-4ec1-9ef9-eec0d575868c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64676e9c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:51.849950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e656c2df-70c0-4195-85b2-6c4f2bc5adeb tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:51.851503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e656c2df-70c0-4195-85b2-6c4f2bc5adeb tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:51.852357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e656c2df-70c0-4195-85b2-6c4f2bc5adeb tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:51.856708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e656c2df-70c0-4195-85b2-6c4f2bc5adeb tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:51.899204 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ed79ba41-7aa7-4ec1-9ef9-eec0d575868c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 200 len: 1423 microversion: 2.1 time: 0.082539 Feb 19 20:58:51.899792 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1136/2191] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:51 2022] GET /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:51.906640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-673677da-75d3-4afa-8dae-0e06a3a9385f tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Calling method '.version_select at 0x7f6467686ca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:51.972723 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-673677da-75d3-4afa-8dae-0e06a3a9385f tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2122065129" status: 202 len: 0 microversion: 2.1 time: 0.069975 Feb 19 20:58:51.973703 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1137/2192] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Feb 19 20:58:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2122065129 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:58:51.982102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0781b394-6a5a-4aad-86ba-ac7c7740c9ca tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f646769ef70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:53.068555 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0781b394-6a5a-4aad-86ba-ac7c7740c9ca tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 204 len: 0 microversion: 2.1 time: 1.093518 Feb 19 20:58:53.072466 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1138/2193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:51 2022] DELETE /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 0 bytes in 1095 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:58:53.074302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7187abc5-6153-406c-a3d2-c4f5ed8b9fd7 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Calling method '.version_select at 0x7f64676fe670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:53.088760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e656c2df-70c0-4195-85b2-6c4f2bc5adeb tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:53.113145 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e656c2df-70c0-4195-85b2-6c4f2bc5adeb tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1392 microversion: 2.1 time: 1.310533 Feb 19 20:58:53.115620 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1056/2194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:51 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1392 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:53.121242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-678ba0b0-4c9c-4b0f-ac8c-31e93c12f0e4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:53.122147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-678ba0b0-4c9c-4b0f-ac8c-31e93c12f0e4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:53.129719 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7187abc5-6153-406c-a3d2-c4f5ed8b9fd7 tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-839006745" status: 202 len: 0 microversion: 2.1 time: 0.056487 Feb 19 20:58:53.131665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-678ba0b0-4c9c-4b0f-ac8c-31e93c12f0e4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:53.132398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-678ba0b0-4c9c-4b0f-ac8c-31e93c12f0e4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:53.133801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-678ba0b0-4c9c-4b0f-ac8c-31e93c12f0e4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:53.134616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-678ba0b0-4c9c-4b0f-ac8c-31e93c12f0e4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:53.135257 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1139/2195] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 20:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-839006745 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:58:53.144379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4dbb466c-b2d5-46d5-a400-cc8b39047ac0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:53.145032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4dbb466c-b2d5-46d5-a400-cc8b39047ac0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:53.156387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4dbb466c-b2d5-46d5-a400-cc8b39047ac0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:53.157011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4dbb466c-b2d5-46d5-a400-cc8b39047ac0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:53.158816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4dbb466c-b2d5-46d5-a400-cc8b39047ac0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:53.159650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4dbb466c-b2d5-46d5-a400-cc8b39047ac0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:54.168526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-678ba0b0-4c9c-4b0f-ac8c-31e93c12f0e4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:54.176365 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-678ba0b0-4c9c-4b0f-ac8c-31e93c12f0e4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1402 microversion: 2.1 time: 1.058895 Feb 19 20:58:54.180767 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1057/2196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:53 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1402 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:54.189492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c677c531-f3bb-42a6-ab0f-a51ed70dd21a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f647421d670>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:54.241516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4dbb466c-b2d5-46d5-a400-cc8b39047ac0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:54.256406 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4dbb466c-b2d5-46d5-a400-cc8b39047ac0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1315 microversion: 2.1 time: 1.114912 Feb 19 20:58:54.257249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1140/2197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:53 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1315 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:54.264003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54a34468-2b97-447e-8a1a-6bc77b100982 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:54.269262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54a34468-2b97-447e-8a1a-6bc77b100982 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:54.276121 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c677c531-f3bb-42a6-ab0f-a51ed70dd21a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.091906 Feb 19 20:58:54.279417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54a34468-2b97-447e-8a1a-6bc77b100982 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:54.282235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54a34468-2b97-447e-8a1a-6bc77b100982 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:54.284149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54a34468-2b97-447e-8a1a-6bc77b100982 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:54.284586 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1058/2198] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:54 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:54.286744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54a34468-2b97-447e-8a1a-6bc77b100982 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:54.293301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d969f9e1-ccdb-4c0c-a5bf-0a0f20a8ffab tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] Calling method '.version_select at 0x7f6479261b80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:54.334381 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d969f9e1-ccdb-4c0c-a5bf-0a0f20a8ffab tempest-KeyPairsV2TestJSON-885943121 tempest-KeyPairsV2TestJSON-885943121-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-604212048" status: 202 len: 0 microversion: 2.1 time: 0.046748 Feb 19 20:58:54.336630 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1059/2199] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 20:58:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-604212048 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:58:54.340950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54a34468-2b97-447e-8a1a-6bc77b100982 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:58:54.349323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-54c0211a-5b6e-481b-9ada-4df3b112b6d3 req-7cf54fd9-bcf6-44c4-977a-973b2b45078a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c69ff896-e0c9-463d-ac90-7b19f8f7d912", "name": "network-vif-unplugged", "status": "completed", "tag": "6c8ecc50-2b75-491a-8873-0464b03ecc0d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:54.357130 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:54.357130 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:58:54.379321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-54c0211a-5b6e-481b-9ada-4df3b112b6d3 req-7cf54fd9-bcf6-44c4-977a-973b2b45078a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:54.380083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-54c0211a-5b6e-481b-9ada-4df3b112b6d3 req-7cf54fd9-bcf6-44c4-977a-973b2b45078a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:54.409335 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-54c0211a-5b6e-481b-9ada-4df3b112b6d3 req-7cf54fd9-bcf6-44c4-977a-973b2b45078a service nova] Creating event network-vif-unplugged:6c8ecc50-2b75-491a-8873-0464b03ecc0d for instance c69ff896-e0c9-463d-ac90-7b19f8f7d912 on nch2-master-1 Feb 19 20:58:54.421652 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-54c0211a-5b6e-481b-9ada-4df3b112b6d3 req-7cf54fd9-bcf6-44c4-977a-973b2b45078a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083336 Feb 19 20:58:54.424761 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1060/2200] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:54.438530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7de4ec74-d34b-4b21-a424-8ca83fd25f87 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:54.439321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7de4ec74-d34b-4b21-a424-8ca83fd25f87 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:54.452942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7de4ec74-d34b-4b21-a424-8ca83fd25f87 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:54.465865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7de4ec74-d34b-4b21-a424-8ca83fd25f87 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:54.468799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7de4ec74-d34b-4b21-a424-8ca83fd25f87 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:54.469800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7de4ec74-d34b-4b21-a424-8ca83fd25f87 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:54.602800 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54a34468-2b97-447e-8a1a-6bc77b100982 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 204 len: 0 microversion: 2.1 time: 0.336131 Feb 19 20:58:54.604299 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1141/2201] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:58:54 2022] DELETE /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:58:54.924057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1067083684", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "0b77203b-47b2-4bd5-a7b7-432923f05242"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:55.057384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] validate_networks() for [('0b77203b-47b2-4bd5-a7b7-432923f05242', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:58:55.924894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7de4ec74-d34b-4b21-a424-8ca83fd25f87 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:55.938869 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7de4ec74-d34b-4b21-a424-8ca83fd25f87 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1392 microversion: 2.1 time: 1.510629 Feb 19 20:58:55.950365 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1061/2202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:54 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1392 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:55.957675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc106e3f-3219-4109-833c-fa430e956ed4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:55.958285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc106e3f-3219-4109-833c-fa430e956ed4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:55.965572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc106e3f-3219-4109-833c-fa430e956ed4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:55.965902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc106e3f-3219-4109-833c-fa430e956ed4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:55.966839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc106e3f-3219-4109-833c-fa430e956ed4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:55.967286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc106e3f-3219-4109-833c-fa430e956ed4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:57.080443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:58:57.081577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:58:57.082222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:58:57.082803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:58:57.083391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:58:57.102161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:57.104397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:57.107994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:57.111145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:57.139705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc106e3f-3219-4109-833c-fa430e956ed4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:57.150202 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc106e3f-3219-4109-833c-fa430e956ed4 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1402 microversion: 2.1 time: 1.197120 Feb 19 20:58:57.150821 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1062/2203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:55 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1402 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:57.171615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca318c0f-8a64-4421-b5ad-bdc87e1040c4 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:57.173293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ca318c0f-8a64-4421-b5ad-bdc87e1040c4 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:57.187541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca318c0f-8a64-4421-b5ad-bdc87e1040c4 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:57.188258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca318c0f-8a64-4421-b5ad-bdc87e1040c4 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:57.189282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca318c0f-8a64-4421-b5ad-bdc87e1040c4 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:57.189901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca318c0f-8a64-4421-b5ad-bdc87e1040c4 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:57.192304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Getting quotas for project b959eb07a97740dca63d3cf3d2ed0a63. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:58:57.214220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Getting quotas for user 5a3a1e86138d41b991f5e44a1e8ae2eb and project b959eb07a97740dca63d3cf3d2ed0a63. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:58:57.250147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:58:57.255461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:58:57.377524 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c8576685-373b-45f6-aedc-a72090cce4b7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.458304 Feb 19 20:58:57.380719 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1142/2204] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:58:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:58:57.389455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bed8c10a-d2a9-4d98-89b6-efdce4218b98 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676fe4c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:57.479768 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bed8c10a-d2a9-4d98-89b6-efdce4218b98 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.097848 Feb 19 20:58:57.480875 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1143/2205] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:57 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:57.490336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-12b4b9cd-ef53-40a5-a038-9e579ea136f3 req-cc64cd0f-66c1-44a0-8ee5-547dbc54fd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c58f78c-bd41-4570-86ec-a9d3a898e1b4", "name": "network-vif-unplugged", "status": "completed", "tag": "296aa138-ed01-4c5c-b1dd-57c160938115"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:57.495339 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:57.495339 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:57.511149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-12b4b9cd-ef53-40a5-a038-9e579ea136f3 req-cc64cd0f-66c1-44a0-8ee5-547dbc54fd71 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:57.513938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-12b4b9cd-ef53-40a5-a038-9e579ea136f3 req-cc64cd0f-66c1-44a0-8ee5-547dbc54fd71 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:57.542155 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-12b4b9cd-ef53-40a5-a038-9e579ea136f3 req-cc64cd0f-66c1-44a0-8ee5-547dbc54fd71 service nova] Creating event network-vif-unplugged:296aa138-ed01-4c5c-b1dd-57c160938115 for instance 0c58f78c-bd41-4570-86ec-a9d3a898e1b4 on nch2-master-1 Feb 19 20:58:57.559552 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-12b4b9cd-ef53-40a5-a038-9e579ea136f3 req-cc64cd0f-66c1-44a0-8ee5-547dbc54fd71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077341 Feb 19 20:58:57.561589 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1144/2206] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:57.566851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca318c0f-8a64-4421-b5ad-bdc87e1040c4 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:57.574010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ff5324d4-6f93-4b78-b6c9-64c9c2ae8340 req-ee157d53-fde4-4efe-9e04-b88ed63f8d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c69ff896-e0c9-463d-ac90-7b19f8f7d912", "tag": "6c8ecc50-2b75-491a-8873-0464b03ecc0d"}, {"name": "network-changed", "server_uuid": "822c2412-fbd7-43c1-995b-c9ef1a76203c", "tag": "93d1f090-a18e-465a-a925-6c32da95879a"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:57.576572 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ca318c0f-8a64-4421-b5ad-bdc87e1040c4 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1315 microversion: 2.1 time: 0.410177 Feb 19 20:58:57.582763 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:57.582763 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:57.593764 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1063/2207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:57 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:57.598523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-80acb9d4-322a-45f6-9afd-4b1bc1c97eb6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:57.599147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-80acb9d4-322a-45f6-9afd-4b1bc1c97eb6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:57.602999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ff5324d4-6f93-4b78-b6c9-64c9c2ae8340 req-ee157d53-fde4-4efe-9e04-b88ed63f8d78 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:57.605883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ff5324d4-6f93-4b78-b6c9-64c9c2ae8340 req-ee157d53-fde4-4efe-9e04-b88ed63f8d78 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:57.623144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80acb9d4-322a-45f6-9afd-4b1bc1c97eb6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:57.626508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80acb9d4-322a-45f6-9afd-4b1bc1c97eb6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:57.629003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80acb9d4-322a-45f6-9afd-4b1bc1c97eb6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:57.629676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80acb9d4-322a-45f6-9afd-4b1bc1c97eb6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:57.639932 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ff5324d4-6f93-4b78-b6c9-64c9c2ae8340 req-ee157d53-fde4-4efe-9e04-b88ed63f8d78 service nova] Creating event network-changed:6c8ecc50-2b75-491a-8873-0464b03ecc0d for instance c69ff896-e0c9-463d-ac90-7b19f8f7d912 on nch2-master-1 Feb 19 20:58:57.642034 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ff5324d4-6f93-4b78-b6c9-64c9c2ae8340 req-ee157d53-fde4-4efe-9e04-b88ed63f8d78 service nova] Creating event network-changed:93d1f090-a18e-465a-a925-6c32da95879a for instance 822c2412-fbd7-43c1-995b-c9ef1a76203c on nch2-master-1 Feb 19 20:58:57.660637 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ff5324d4-6f93-4b78-b6c9-64c9c2ae8340 req-ee157d53-fde4-4efe-9e04-b88ed63f8d78 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.095329 Feb 19 20:58:57.662447 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1145/2208] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:57.679818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-779e2676-732b-4f18-a896-5e7b1def4a9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:57.682994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-779e2676-732b-4f18-a896-5e7b1def4a9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:57.926103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-779e2676-732b-4f18-a896-5e7b1def4a9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:57.939667 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-779e2676-732b-4f18-a896-5e7b1def4a9d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1208 microversion: 2.1 time: 0.268835 Feb 19 20:58:57.941913 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1146/2209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:57 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1208 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:58.167136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-95d5f5b7-ce36-4480-a311-9a2bf3ca0426 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:58.167779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-95d5f5b7-ce36-4480-a311-9a2bf3ca0426 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:58.175415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95d5f5b7-ce36-4480-a311-9a2bf3ca0426 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:58.175862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95d5f5b7-ce36-4480-a311-9a2bf3ca0426 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:58.191394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95d5f5b7-ce36-4480-a311-9a2bf3ca0426 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:58.191840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-95d5f5b7-ce36-4480-a311-9a2bf3ca0426 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:58.380406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-80acb9d4-322a-45f6-9afd-4b1bc1c97eb6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:58.396195 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-80acb9d4-322a-45f6-9afd-4b1bc1c97eb6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1392 microversion: 2.1 time: 0.798850 Feb 19 20:58:58.396931 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1064/2210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:57 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1392 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:58.495613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-85cf221f-fdb7-4726-a18c-44e308fdd09e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479261f70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:58.576746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-95d5f5b7-ce36-4480-a311-9a2bf3ca0426 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:58.586883 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-95d5f5b7-ce36-4480-a311-9a2bf3ca0426 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1402 microversion: 2.1 time: 0.422160 Feb 19 20:58:58.590104 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1147/2211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:58 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:58.601069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-205a0753-e3ea-4fe4-8c0f-60ed57946d1b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:58.601952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-205a0753-e3ea-4fe4-8c0f-60ed57946d1b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:58.617804 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-85cf221f-fdb7-4726-a18c-44e308fdd09e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.128074 Feb 19 20:58:58.619666 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1065/2212] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:58:58 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:58.623564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-205a0753-e3ea-4fe4-8c0f-60ed57946d1b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:58.623564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-205a0753-e3ea-4fe4-8c0f-60ed57946d1b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:58.623564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-205a0753-e3ea-4fe4-8c0f-60ed57946d1b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:58.623564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-205a0753-e3ea-4fe4-8c0f-60ed57946d1b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:58.964028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-70140d9b-f7d9-4c7a-880b-1a5a2b1b0bbd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:58.965336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-70140d9b-f7d9-4c7a-880b-1a5a2b1b0bbd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:58.980649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70140d9b-f7d9-4c7a-880b-1a5a2b1b0bbd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:58.981487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70140d9b-f7d9-4c7a-880b-1a5a2b1b0bbd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:58.983059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70140d9b-f7d9-4c7a-880b-1a5a2b1b0bbd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:58.983839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70140d9b-f7d9-4c7a-880b-1a5a2b1b0bbd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:59.308809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-70140d9b-f7d9-4c7a-880b-1a5a2b1b0bbd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:59.317249 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-70140d9b-f7d9-4c7a-880b-1a5a2b1b0bbd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1260 microversion: 2.1 time: 0.361411 Feb 19 20:58:59.320419 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1066/2213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:58 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1260 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:58:59.329805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-205a0753-e3ea-4fe4-8c0f-60ed57946d1b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:58:59.363655 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-205a0753-e3ea-4fe4-8c0f-60ed57946d1b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1315 microversion: 2.1 time: 0.769171 Feb 19 20:58:59.366928 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1148/2214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:58 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:58:59.424307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fde5b5a8-39db-4a36-ae40-09cb96ef6624 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:59.425023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fde5b5a8-39db-4a36-ae40-09cb96ef6624 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:59.444254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde5b5a8-39db-4a36-ae40-09cb96ef6624 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:59.444736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde5b5a8-39db-4a36-ae40-09cb96ef6624 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:59.445538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde5b5a8-39db-4a36-ae40-09cb96ef6624 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:59.445980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde5b5a8-39db-4a36-ae40-09cb96ef6624 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:59.605526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-196c76c2-b254-4419-b514-a49aebabbe16 req-afcd2716-2810-4566-a62c-b54a31b87fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d83fa58-4a1d-49bf-abb3-565b32fd4b9f", "name": "network-vif-plugged", "status": "completed", "tag": "7227c1a7-5a78-4c8d-9abb-0601b9286874"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:58:59.607352 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:58:59.607352 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:58:59.618074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-196c76c2-b254-4419-b514-a49aebabbe16 req-afcd2716-2810-4566-a62c-b54a31b87fe8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:59.623649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-196c76c2-b254-4419-b514-a49aebabbe16 req-afcd2716-2810-4566-a62c-b54a31b87fe8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:59.648171 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-196c76c2-b254-4419-b514-a49aebabbe16 req-afcd2716-2810-4566-a62c-b54a31b87fe8 service nova] Creating event network-vif-plugged:7227c1a7-5a78-4c8d-9abb-0601b9286874 for instance 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f on nch1-master-1 Feb 19 20:58:59.660654 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-196c76c2-b254-4419-b514-a49aebabbe16 req-afcd2716-2810-4566-a62c-b54a31b87fe8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058605 Feb 19 20:58:59.665378 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1149/2215] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:58:59.679501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1bce900f-4d4b-4a42-998e-b904beb8ba7a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:58:59.680809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1bce900f-4d4b-4a42-998e-b904beb8ba7a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:58:59.694674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bce900f-4d4b-4a42-998e-b904beb8ba7a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:59.695890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bce900f-4d4b-4a42-998e-b904beb8ba7a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:58:59.699754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bce900f-4d4b-4a42-998e-b904beb8ba7a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:58:59.700424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bce900f-4d4b-4a42-998e-b904beb8ba7a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:00.465886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fde5b5a8-39db-4a36-ae40-09cb96ef6624 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:00.477475 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fde5b5a8-39db-4a36-ae40-09cb96ef6624 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1392 microversion: 2.1 time: 1.067179 Feb 19 20:59:00.490068 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1067/2216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:59 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1392 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:00.508411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ebb262f8-35fd-4894-9fe7-98f2b8e9e0bf tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6474248160>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:00.616188 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ebb262f8-35fd-4894-9fe7-98f2b8e9e0bf tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.114473 Feb 19 20:59:00.618491 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1068/2217] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:00 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:00.629676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6f16b8b6-0c11-4662-a7fa-d129116da2a7 req-7c4faf8f-9b19-4249-89df-a1b9483bf2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c58f78c-bd41-4570-86ec-a9d3a898e1b4", "name": "network-vif-deleted", "tag": "296aa138-ed01-4c5c-b1dd-57c160938115"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:00.638480 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:00.638480 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:00.663976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6f16b8b6-0c11-4662-a7fa-d129116da2a7 req-7c4faf8f-9b19-4249-89df-a1b9483bf2e3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:00.664732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6f16b8b6-0c11-4662-a7fa-d129116da2a7 req-7c4faf8f-9b19-4249-89df-a1b9483bf2e3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:00.722314 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6f16b8b6-0c11-4662-a7fa-d129116da2a7 req-7c4faf8f-9b19-4249-89df-a1b9483bf2e3 service nova] Creating event network-vif-deleted:296aa138-ed01-4c5c-b1dd-57c160938115 for instance 0c58f78c-bd41-4570-86ec-a9d3a898e1b4 on nch2-master-1 Feb 19 20:59:00.753868 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6f16b8b6-0c11-4662-a7fa-d129116da2a7 req-7c4faf8f-9b19-4249-89df-a1b9483bf2e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132047 Feb 19 20:59:00.758403 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1069/2218] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:00.791006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-52dc07fb-173d-44f3-a9a2-32c1d987aa7c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:00.795445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-52dc07fb-173d-44f3-a9a2-32c1d987aa7c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:00.836709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52dc07fb-173d-44f3-a9a2-32c1d987aa7c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:00.838094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52dc07fb-173d-44f3-a9a2-32c1d987aa7c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:00.842719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52dc07fb-173d-44f3-a9a2-32c1d987aa7c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:00.845496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52dc07fb-173d-44f3-a9a2-32c1d987aa7c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:01.298121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-52dc07fb-173d-44f3-a9a2-32c1d987aa7c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:01.309124 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-52dc07fb-173d-44f3-a9a2-32c1d987aa7c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1266 microversion: 2.1 time: 0.547437 Feb 19 20:59:01.312010 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1070/2219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:00 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1266 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:01.329153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6555af4f-72fa-4fbd-9ed2-c3fc2059b8b6 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:01.330127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6555af4f-72fa-4fbd-9ed2-c3fc2059b8b6 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:01.339678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6555af4f-72fa-4fbd-9ed2-c3fc2059b8b6 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:01.342147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6555af4f-72fa-4fbd-9ed2-c3fc2059b8b6 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:01.345354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6555af4f-72fa-4fbd-9ed2-c3fc2059b8b6 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:01.346260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6555af4f-72fa-4fbd-9ed2-c3fc2059b8b6 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:01.597927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1bce900f-4d4b-4a42-998e-b904beb8ba7a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:01.619204 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1bce900f-4d4b-4a42-998e-b904beb8ba7a tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1402 microversion: 2.1 time: 1.947364 Feb 19 20:59:01.620630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1150/2220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:58:59 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1402 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:01.634888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1325bb20-f933-4d0a-a78d-e38a70ad065d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:01.636009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1325bb20-f933-4d0a-a78d-e38a70ad065d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:01.646608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1325bb20-f933-4d0a-a78d-e38a70ad065d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:01.647293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1325bb20-f933-4d0a-a78d-e38a70ad065d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:01.648211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1325bb20-f933-4d0a-a78d-e38a70ad065d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:01.648780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1325bb20-f933-4d0a-a78d-e38a70ad065d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:01.875343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6555af4f-72fa-4fbd-9ed2-c3fc2059b8b6 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:01.893874 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6555af4f-72fa-4fbd-9ed2-c3fc2059b8b6 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1315 microversion: 2.1 time: 0.579729 Feb 19 20:59:01.897803 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1071/2221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:01 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:01.935969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-39b9da47-50d0-4cac-b892-64f099cc5de0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467c51160>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:02.049215 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-39b9da47-50d0-4cac-b892-64f099cc5de0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.147247 Feb 19 20:59:02.050034 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1072/2222] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:01 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:02.256833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1325bb20-f933-4d0a-a78d-e38a70ad065d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:02.265054 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1325bb20-f933-4d0a-a78d-e38a70ad065d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1392 microversion: 2.1 time: 0.642863 Feb 19 20:59:02.267663 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1151/2223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:01 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1392 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:02.332352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1367ec30-1400-48dd-b506-db4d30576deb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:02.333480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1367ec30-1400-48dd-b506-db4d30576deb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:02.345076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1367ec30-1400-48dd-b506-db4d30576deb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:02.345626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1367ec30-1400-48dd-b506-db4d30576deb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:02.349301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1367ec30-1400-48dd-b506-db4d30576deb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:02.350063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1367ec30-1400-48dd-b506-db4d30576deb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:02.523999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-131718474", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "7f4d1bd2-7867-41b6-a166-75a5069b5549"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:02.665912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] validate_networks() for [('7f4d1bd2-7867-41b6-a166-75a5069b5549', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:59:03.379479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1367ec30-1400-48dd-b506-db4d30576deb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:03.392778 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1367ec30-1400-48dd-b506-db4d30576deb tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1308 microversion: 2.1 time: 1.064341 Feb 19 20:59:03.393373 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1152/2224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:02 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1308 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:03.418365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7caf6990-76e0-433d-9cee-d02c0c3aa957 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:03.418980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7caf6990-76e0-433d-9cee-d02c0c3aa957 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:03.450293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7caf6990-76e0-433d-9cee-d02c0c3aa957 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:03.451971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7caf6990-76e0-433d-9cee-d02c0c3aa957 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:03.453290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7caf6990-76e0-433d-9cee-d02c0c3aa957 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:03.455992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7caf6990-76e0-433d-9cee-d02c0c3aa957 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:04.795246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7caf6990-76e0-433d-9cee-d02c0c3aa957 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:04.807307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7caf6990-76e0-433d-9cee-d02c0c3aa957 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1588 microversion: 2.1 time: 1.412114 Feb 19 20:59:04.821008 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1153/2225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:03 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1588 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:04.849458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-09e78761-ae36-40f3-b2e7-a23149eb377a tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:04.851268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-09e78761-ae36-40f3-b2e7-a23149eb377a tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:04.866633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09e78761-ae36-40f3-b2e7-a23149eb377a tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:04.867326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09e78761-ae36-40f3-b2e7-a23149eb377a tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:04.868470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09e78761-ae36-40f3-b2e7-a23149eb377a tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:04.884083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09e78761-ae36-40f3-b2e7-a23149eb377a tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:05.182784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:59:05.183538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:59:05.183958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:59:05.184687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:59:05.185409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:59:05.208703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:05.210014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:05.213463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:05.215381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:05.276311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Getting quotas for project 24560083d7dd474c820b48343b65c206. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:59:05.289030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Getting quotas for user 67bb649ed4a840b58f2f081adc27ad48 and project 24560083d7dd474c820b48343b65c206. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:59:05.322365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:59:05.326180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:59:05.392521 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8def9982-fcfa-4a51-94d6-4d41374a2065 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.207281 Feb 19 20:59:05.398863 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1073/2226] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:59:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 20:59:05.404547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f4c47321-4885-460f-b248-7f1a69ea8295 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479252c10>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:05.463208 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f4c47321-4885-460f-b248-7f1a69ea8295 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.062086 Feb 19 20:59:05.464389 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1074/2227] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:05 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:05.472171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1d6c789f-7e72-4d18-b4d8-bbb5efcb461e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:05.473161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1d6c789f-7e72-4d18-b4d8-bbb5efcb461e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:05.480457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d6c789f-7e72-4d18-b4d8-bbb5efcb461e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:05.481199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d6c789f-7e72-4d18-b4d8-bbb5efcb461e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:05.482285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d6c789f-7e72-4d18-b4d8-bbb5efcb461e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:05.482987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d6c789f-7e72-4d18-b4d8-bbb5efcb461e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:05.488816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-09e78761-ae36-40f3-b2e7-a23149eb377a tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:05.511977 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-09e78761-ae36-40f3-b2e7-a23149eb377a tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1315 microversion: 2.1 time: 0.689507 Feb 19 20:59:05.512619 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1154/2228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:04 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:05.537327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-824658e3-95a1-4a6f-9694-71881b450263 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:05.545358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-824658e3-95a1-4a6f-9694-71881b450263 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:05.571140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-824658e3-95a1-4a6f-9694-71881b450263 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:05.571605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-824658e3-95a1-4a6f-9694-71881b450263 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:05.577790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-824658e3-95a1-4a6f-9694-71881b450263 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:05.579497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-824658e3-95a1-4a6f-9694-71881b450263 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:05.913701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1d6c789f-7e72-4d18-b4d8-bbb5efcb461e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:05.947004 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1d6c789f-7e72-4d18-b4d8-bbb5efcb461e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1382 microversion: 2.1 time: 0.478985 Feb 19 20:59:05.948724 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1075/2229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:05 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1382 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:05.985591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4645718-3ff6-4351-ae7c-e43d7c4e0f87 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:05.986354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e4645718-3ff6-4351-ae7c-e43d7c4e0f87 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:06.001299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4645718-3ff6-4351-ae7c-e43d7c4e0f87 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:06.001795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4645718-3ff6-4351-ae7c-e43d7c4e0f87 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:06.007337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4645718-3ff6-4351-ae7c-e43d7c4e0f87 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:06.008318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4645718-3ff6-4351-ae7c-e43d7c4e0f87 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:06.380359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-824658e3-95a1-4a6f-9694-71881b450263 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:06.399872 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-824658e3-95a1-4a6f-9694-71881b450263 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1308 microversion: 2.1 time: 0.878960 Feb 19 20:59:06.409863 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1155/2230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:05 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1308 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:06.428282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0eec47c7-d817-4f6f-b0f9-ac80cac39828 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:06.428955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0eec47c7-d817-4f6f-b0f9-ac80cac39828 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:06.510715 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e4645718-3ff6-4351-ae7c-e43d7c4e0f87 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.545069 Feb 19 20:59:06.517715 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1076/2231] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 20:59:05 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f/os-interface => generated 284 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:06.522274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7e2b0f8f-b968-4dba-a51b-3cc9bcb9dee6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '.version_select at 0x7f6467b5b040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:06.524524 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:06.524524 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:06.530035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e2b0f8f-b968-4dba-a51b-3cc9bcb9dee6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:06.545255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e2b0f8f-b968-4dba-a51b-3cc9bcb9dee6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:06.577621 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7e2b0f8f-b968-4dba-a51b-3cc9bcb9dee6 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.058739 Feb 19 20:59:06.578245 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1077/2232] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 20:59:06 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:06.595613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-594ca3b3-8e2b-4983-a8fe-540fcf839065 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467ae7280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:06.737632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0eec47c7-d817-4f6f-b0f9-ac80cac39828 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:06.748041 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0eec47c7-d817-4f6f-b0f9-ac80cac39828 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1224 microversion: 2.1 time: 0.337085 Feb 19 20:59:06.755013 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1156/2233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:06 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1224 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:06.766074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-12e1c2f4-8b1b-4c5c-84b8-d9f9de7b3195 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:06.770690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-12e1c2f4-8b1b-4c5c-84b8-d9f9de7b3195 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:06.783699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12e1c2f4-8b1b-4c5c-84b8-d9f9de7b3195 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:06.784153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12e1c2f4-8b1b-4c5c-84b8-d9f9de7b3195 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:06.784985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12e1c2f4-8b1b-4c5c-84b8-d9f9de7b3195 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:06.785410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12e1c2f4-8b1b-4c5c-84b8-d9f9de7b3195 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:06.816730 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-594ca3b3-8e2b-4983-a8fe-540fcf839065 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.225969 Feb 19 20:59:06.824930 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1078/2234] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:06 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:06.841252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-366c0aba-ea83-4d76-9a26-1b301fc8f491 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:06.862236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-366c0aba-ea83-4d76-9a26-1b301fc8f491 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:06.901895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-366c0aba-ea83-4d76-9a26-1b301fc8f491 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:06.902637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-366c0aba-ea83-4d76-9a26-1b301fc8f491 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:06.922650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-366c0aba-ea83-4d76-9a26-1b301fc8f491 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:06.926678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-366c0aba-ea83-4d76-9a26-1b301fc8f491 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:07.688065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-12e1c2f4-8b1b-4c5c-84b8-d9f9de7b3195 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:07.705577 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-12e1c2f4-8b1b-4c5c-84b8-d9f9de7b3195 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1315 microversion: 2.1 time: 0.949178 Feb 19 20:59:07.706171 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1157/2235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:06 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1315 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:07.717010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b96fe8d1-e054-4b22-9bfc-506212ea2be0 req-217c3899-497c-40bf-9c9b-8187babb0804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25db99dd-04b8-4486-9f09-dbbb9bcaf223", "tag": "5973c52c-0226-472a-bd61-7d7925752963"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:07.728184 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:07.728184 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:07.758617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b96fe8d1-e054-4b22-9bfc-506212ea2be0 req-217c3899-497c-40bf-9c9b-8187babb0804 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:07.759421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b96fe8d1-e054-4b22-9bfc-506212ea2be0 req-217c3899-497c-40bf-9c9b-8187babb0804 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:07.798449 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b96fe8d1-e054-4b22-9bfc-506212ea2be0 req-217c3899-497c-40bf-9c9b-8187babb0804 service nova] Creating event network-changed:5973c52c-0226-472a-bd61-7d7925752963 for instance 25db99dd-04b8-4486-9f09-dbbb9bcaf223 on nch1-master-1 Feb 19 20:59:07.809310 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b96fe8d1-e054-4b22-9bfc-506212ea2be0 req-217c3899-497c-40bf-9c9b-8187babb0804 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094866 Feb 19 20:59:07.810539 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1158/2236] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:07.820170 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-366c0aba-ea83-4d76-9a26-1b301fc8f491 tempest-LiveMigrationTest-480741307 tempest-LiveMigrationTest-480741307-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1533 microversion: 2.1 time: 0.999608 Feb 19 20:59:07.827500 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1079/2237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:06 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1533 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:07.835479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-bb30f8a8-f381-4718-883e-03e41bd9e21a req-2b978d34-72e0-4517-97c6-1b1ab00344df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822c2412-fbd7-43c1-995b-c9ef1a76203c", "name": "network-vif-plugged", "status": "completed", "tag": "93d1f090-a18e-465a-a925-6c32da95879a"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:07.837543 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:07.837543 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:07.850039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bb30f8a8-f381-4718-883e-03e41bd9e21a req-2b978d34-72e0-4517-97c6-1b1ab00344df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:07.851139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bb30f8a8-f381-4718-883e-03e41bd9e21a req-2b978d34-72e0-4517-97c6-1b1ab00344df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:07.866190 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-bb30f8a8-f381-4718-883e-03e41bd9e21a req-2b978d34-72e0-4517-97c6-1b1ab00344df service nova] Creating event network-vif-plugged:93d1f090-a18e-465a-a925-6c32da95879a for instance 822c2412-fbd7-43c1-995b-c9ef1a76203c on nch2-master-1 Feb 19 20:59:07.867249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-47d11ebb-e08e-448e-94d2-05f29b399297 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:07.870823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-47d11ebb-e08e-448e-94d2-05f29b399297 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:07.873365 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-bb30f8a8-f381-4718-883e-03e41bd9e21a req-2b978d34-72e0-4517-97c6-1b1ab00344df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042310 Feb 19 20:59:07.875181 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1159/2238] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:07.883671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f2c3fa36-ff10-421c-8802-4c6d3bced4f2 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:07.884734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f2c3fa36-ff10-421c-8802-4c6d3bced4f2 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:07.893144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2c3fa36-ff10-421c-8802-4c6d3bced4f2 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:07.895240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2c3fa36-ff10-421c-8802-4c6d3bced4f2 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:07.895240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2c3fa36-ff10-421c-8802-4c6d3bced4f2 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:07.895608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2c3fa36-ff10-421c-8802-4c6d3bced4f2 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:07.912635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-47d11ebb-e08e-448e-94d2-05f29b399297 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:07.913719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-47d11ebb-e08e-448e-94d2-05f29b399297 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:07.935897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-47d11ebb-e08e-448e-94d2-05f29b399297 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:07.941743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-47d11ebb-e08e-448e-94d2-05f29b399297 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:08.070877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f2c3fa36-ff10-421c-8802-4c6d3bced4f2 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:08.090257 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f2c3fa36-ff10-421c-8802-4c6d3bced4f2 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1282 microversion: 2.1 time: 0.212170 Feb 19 20:59:08.091325 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1160/2239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:07 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1282 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:08.106129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d56e2aad-2b67-439b-ba93-ff67c14551ae tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676e9670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:08.205822 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d56e2aad-2b67-439b-ba93-ff67c14551ae tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.112464 Feb 19 20:59:08.208619 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1161/2240] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:08 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:08.225590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dc57fcfd-4eaa-4afa-a252-53795f33f962 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:08.227096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dc57fcfd-4eaa-4afa-a252-53795f33f962 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:08.249913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc57fcfd-4eaa-4afa-a252-53795f33f962 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:08.251492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc57fcfd-4eaa-4afa-a252-53795f33f962 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:08.255982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc57fcfd-4eaa-4afa-a252-53795f33f962 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:08.256720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc57fcfd-4eaa-4afa-a252-53795f33f962 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:08.346131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dc57fcfd-4eaa-4afa-a252-53795f33f962 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:08.549874 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dc57fcfd-4eaa-4afa-a252-53795f33f962 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 204 len: 0 microversion: 2.1 time: 0.338690 Feb 19 20:59:08.551511 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1162/2241] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:59:08 2022] DELETE /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:08.559389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5a39cee7-bae3-4488-8f25-30a892e5b643 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:08.573059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5a39cee7-bae3-4488-8f25-30a892e5b643 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:08.580255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a39cee7-bae3-4488-8f25-30a892e5b643 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:08.580748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a39cee7-bae3-4488-8f25-30a892e5b643 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:08.581797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a39cee7-bae3-4488-8f25-30a892e5b643 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:08.582085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a39cee7-bae3-4488-8f25-30a892e5b643 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:08.597791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-47d11ebb-e08e-448e-94d2-05f29b399297 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:08.615176 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-47d11ebb-e08e-448e-94d2-05f29b399297 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1308 microversion: 2.1 time: 0.783024 Feb 19 20:59:08.616240 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1080/2242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:07 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1308 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:08.724407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-35c71aae-64d9-4d9a-a819-db316725f70b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:08.725619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-35c71aae-64d9-4d9a-a819-db316725f70b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:08.737992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35c71aae-64d9-4d9a-a819-db316725f70b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:08.738586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35c71aae-64d9-4d9a-a819-db316725f70b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:08.741247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35c71aae-64d9-4d9a-a819-db316725f70b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:08.741815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35c71aae-64d9-4d9a-a819-db316725f70b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:09.265187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5a39cee7-bae3-4488-8f25-30a892e5b643 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:09.285880 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5a39cee7-bae3-4488-8f25-30a892e5b643 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1388 microversion: 2.1 time: 0.730882 Feb 19 20:59:09.289432 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1163/2243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:08 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1388 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:09.302163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2e45d50d-22db-41f7-99ba-72aee332cf75 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:09.303074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2e45d50d-22db-41f7-99ba-72aee332cf75 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:09.312359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e45d50d-22db-41f7-99ba-72aee332cf75 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:09.315840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e45d50d-22db-41f7-99ba-72aee332cf75 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:09.317229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e45d50d-22db-41f7-99ba-72aee332cf75 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:09.322728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e45d50d-22db-41f7-99ba-72aee332cf75 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:09.628492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2e45d50d-22db-41f7-99ba-72aee332cf75 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:09.636409 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2e45d50d-22db-41f7-99ba-72aee332cf75 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1282 microversion: 2.1 time: 0.345462 Feb 19 20:59:09.637252 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1164/2244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:09 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1282 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:09.643617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3a41dfa7-f91a-4696-810f-00b53e419ffe tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64745a5ee0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:09.686941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-35c71aae-64d9-4d9a-a819-db316725f70b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:09.695171 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-35c71aae-64d9-4d9a-a819-db316725f70b tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1315 microversion: 2.1 time: 0.974933 Feb 19 20:59:09.699205 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1081/2245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:08 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1315 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:09.733144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a49b6ea7-2686-4d94-afc5-8869b6cbcb1e tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:09.734585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a49b6ea7-2686-4d94-afc5-8869b6cbcb1e tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:09.736795 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3a41dfa7-f91a-4696-810f-00b53e419ffe tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.098319 Feb 19 20:59:09.737858 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1165/2246] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:09 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:09.744501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-25c0da67-2ae1-4b44-aa7d-7fe3caac93c7 req-f4e7d5b1-a3a5-49ad-b9f9-b769516ac93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d83fa58-4a1d-49bf-abb3-565b32fd4b9f", "tag": "7227c1a7-5a78-4c8d-9abb-0601b9286874"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:09.744736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a49b6ea7-2686-4d94-afc5-8869b6cbcb1e tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:09.746494 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:09.746494 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:09.746986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a49b6ea7-2686-4d94-afc5-8869b6cbcb1e tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:09.747822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a49b6ea7-2686-4d94-afc5-8869b6cbcb1e tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:09.748268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a49b6ea7-2686-4d94-afc5-8869b6cbcb1e tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:09.755117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-25c0da67-2ae1-4b44-aa7d-7fe3caac93c7 req-f4e7d5b1-a3a5-49ad-b9f9-b769516ac93a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:09.755828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-25c0da67-2ae1-4b44-aa7d-7fe3caac93c7 req-f4e7d5b1-a3a5-49ad-b9f9-b769516ac93a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:09.789703 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-25c0da67-2ae1-4b44-aa7d-7fe3caac93c7 req-f4e7d5b1-a3a5-49ad-b9f9-b769516ac93a service nova] Creating event network-changed:7227c1a7-5a78-4c8d-9abb-0601b9286874 for instance 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f on nch1-master-1 Feb 19 20:59:09.799643 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-25c0da67-2ae1-4b44-aa7d-7fe3caac93c7 req-f4e7d5b1-a3a5-49ad-b9f9-b769516ac93a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059699 Feb 19 20:59:09.800841 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1166/2247] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:09.806944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6c814181-1936-4f8d-9615-7016c26af86b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:09.807915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6c814181-1936-4f8d-9615-7016c26af86b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:09.832568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c814181-1936-4f8d-9615-7016c26af86b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:09.833510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c814181-1936-4f8d-9615-7016c26af86b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:09.834981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c814181-1936-4f8d-9615-7016c26af86b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:09.835580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c814181-1936-4f8d-9615-7016c26af86b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:10.943809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a49b6ea7-2686-4d94-afc5-8869b6cbcb1e tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:10.958874 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a49b6ea7-2686-4d94-afc5-8869b6cbcb1e tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1588 microversion: 2.1 time: 1.249213 Feb 19 20:59:10.964831 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1082/2248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:09 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1588 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:10.985158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b48f2e4b-3de1-4e83-95c9-a2caf6113707 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:10.989789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b48f2e4b-3de1-4e83-95c9-a2caf6113707 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:11.013786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b48f2e4b-3de1-4e83-95c9-a2caf6113707 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:11.025849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b48f2e4b-3de1-4e83-95c9-a2caf6113707 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:11.027045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b48f2e4b-3de1-4e83-95c9-a2caf6113707 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:11.027684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b48f2e4b-3de1-4e83-95c9-a2caf6113707 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:11.031323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6c814181-1936-4f8d-9615-7016c26af86b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:11.040994 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6c814181-1936-4f8d-9615-7016c26af86b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1308 microversion: 2.1 time: 1.238734 Feb 19 20:59:11.046247 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1167/2249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:09 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1308 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:11.060049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27499d59-6459-47e8-afb7-a2116ab87bd9 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:11.060965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-27499d59-6459-47e8-afb7-a2116ab87bd9 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:11.074557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27499d59-6459-47e8-afb7-a2116ab87bd9 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:11.075014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27499d59-6459-47e8-afb7-a2116ab87bd9 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:11.075812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27499d59-6459-47e8-afb7-a2116ab87bd9 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:11.076242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27499d59-6459-47e8-afb7-a2116ab87bd9 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:11.831338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-27499d59-6459-47e8-afb7-a2116ab87bd9 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:11.846787 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-27499d59-6459-47e8-afb7-a2116ab87bd9 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.799134 Feb 19 20:59:11.858467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b48f2e4b-3de1-4e83-95c9-a2caf6113707 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:11.859357 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1168/2250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:11 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:11.864265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4509e8f0-4165-49f5-82a8-4efbc5141103 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:11.865160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4509e8f0-4165-49f5-82a8-4efbc5141103 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:11.872674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4509e8f0-4165-49f5-82a8-4efbc5141103 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:11.873397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4509e8f0-4165-49f5-82a8-4efbc5141103 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:11.876862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4509e8f0-4165-49f5-82a8-4efbc5141103 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:11.877459 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b48f2e4b-3de1-4e83-95c9-a2caf6113707 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1388 microversion: 2.1 time: 0.904258 Feb 19 20:59:11.877785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4509e8f0-4165-49f5-82a8-4efbc5141103 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:11.887341 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1083/2251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:10 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1388 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:11.889186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d9733f92-6584-4223-922d-2fc4b3e53209 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f647922a700>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:11.999568 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d9733f92-6584-4223-922d-2fc4b3e53209 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.117588 Feb 19 20:59:12.000907 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1084/2252] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:11 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:12.063236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d0c32368-8595-4cb6-b613-80a769c69eaf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:12.064788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d0c32368-8595-4cb6-b613-80a769c69eaf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:12.077030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0c32368-8595-4cb6-b613-80a769c69eaf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:12.079310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0c32368-8595-4cb6-b613-80a769c69eaf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:12.081472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0c32368-8595-4cb6-b613-80a769c69eaf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:12.082526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0c32368-8595-4cb6-b613-80a769c69eaf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:12.524421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4509e8f0-4165-49f5-82a8-4efbc5141103 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:12.580321 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4509e8f0-4165-49f5-82a8-4efbc5141103 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1503 microversion: 2.1 time: 0.719531 Feb 19 20:59:12.594167 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1169/2253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:11 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1503 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:12.620115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aab1d010-f0d9-4dbb-bb39-29772175c3d9 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:12.634457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aab1d010-f0d9-4dbb-bb39-29772175c3d9 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:12.675870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aab1d010-f0d9-4dbb-bb39-29772175c3d9 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:12.676525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aab1d010-f0d9-4dbb-bb39-29772175c3d9 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:12.686456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aab1d010-f0d9-4dbb-bb39-29772175c3d9 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:12.687531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aab1d010-f0d9-4dbb-bb39-29772175c3d9 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:12.918032 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aab1d010-f0d9-4dbb-bb39-29772175c3d9 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "DELETE /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.309693 Feb 19 20:59:12.920542 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1170/2254] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Feb 19 20:59:12 2022] DELETE /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c/os-server-password => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:12.933012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-99d1d5c3-d348-41a0-8fcb-62085a66792c req-1babdfd0-a4fc-4c1a-ab40-e3d7e50e34df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "678cfc25-63c2-4957-8e09-95a21fee7156", "tag": "bc5b020a-585b-4eec-90c5-2e83ef2c9c96"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:12.936375 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:12.936375 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:12.945076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d0c32368-8595-4cb6-b613-80a769c69eaf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:12.950927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-99d1d5c3-d348-41a0-8fcb-62085a66792c req-1babdfd0-a4fc-4c1a-ab40-e3d7e50e34df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:12.951756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-99d1d5c3-d348-41a0-8fcb-62085a66792c req-1babdfd0-a4fc-4c1a-ab40-e3d7e50e34df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:12.956599 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d0c32368-8595-4cb6-b613-80a769c69eaf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1308 microversion: 2.1 time: 0.897026 Feb 19 20:59:12.960288 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1085/2255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:12 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1308 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:12.966728 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-99d1d5c3-d348-41a0-8fcb-62085a66792c req-1babdfd0-a4fc-4c1a-ab40-e3d7e50e34df service nova] Creating event network-changed:bc5b020a-585b-4eec-90c5-2e83ef2c9c96 for instance 678cfc25-63c2-4957-8e09-95a21fee7156 on nch2-master-1 Feb 19 20:59:12.973157 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-99d1d5c3-d348-41a0-8fcb-62085a66792c req-1babdfd0-a4fc-4c1a-ab40-e3d7e50e34df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050649 Feb 19 20:59:12.974350 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1171/2256] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:12.980292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-74902b3f-4b87-4dc3-9ce8-20c9d2e9aa38 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:12.980946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-74902b3f-4b87-4dc3-9ce8-20c9d2e9aa38 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:13.020312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74902b3f-4b87-4dc3-9ce8-20c9d2e9aa38 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:13.021752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74902b3f-4b87-4dc3-9ce8-20c9d2e9aa38 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:13.024693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74902b3f-4b87-4dc3-9ce8-20c9d2e9aa38 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:13.026445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74902b3f-4b87-4dc3-9ce8-20c9d2e9aa38 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:13.436039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1313205859", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "29d948e3-e288-426b-84ab-e762c1fec299"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:13.508489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-74902b3f-4b87-4dc3-9ce8-20c9d2e9aa38 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:13.550305 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-74902b3f-4b87-4dc3-9ce8-20c9d2e9aa38 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.559960 Feb 19 20:59:13.551250 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1086/2257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:12 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:13.570608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-690591c8-1657-4af0-8f28-9b33f58a722d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:13.570608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-690591c8-1657-4af0-8f28-9b33f58a722d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:13.594166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-690591c8-1657-4af0-8f28-9b33f58a722d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:13.596582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-690591c8-1657-4af0-8f28-9b33f58a722d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:13.597577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-690591c8-1657-4af0-8f28-9b33f58a722d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:13.598555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-690591c8-1657-4af0-8f28-9b33f58a722d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:13.670007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] validate_networks() for [('29d948e3-e288-426b-84ab-e762c1fec299', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:59:13.738143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-690591c8-1657-4af0-8f28-9b33f58a722d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:13.748186 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-690591c8-1657-4af0-8f28-9b33f58a722d tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 200 len: 1184 microversion: 2.1 time: 0.195540 Feb 19 20:59:13.749848 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1087/2258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:13 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 1184 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:13.755936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6c0f1dc0-6b13-4d64-9124-c149837979b0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:13.756670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6c0f1dc0-6b13-4d64-9124-c149837979b0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:13.763660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c0f1dc0-6b13-4d64-9124-c149837979b0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:13.767583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c0f1dc0-6b13-4d64-9124-c149837979b0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:13.769055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c0f1dc0-6b13-4d64-9124-c149837979b0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:13.769709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c0f1dc0-6b13-4d64-9124-c149837979b0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:13.800866 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6c0f1dc0-6b13-4d64-9124-c149837979b0 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.049501 Feb 19 20:59:13.802307 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1088/2259] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 20:59:13 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c/os-server-password => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:59:13.815265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-df6dc9cd-e0dd-4f70-9de5-35dba7156054 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479252dc0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:14.167526 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-df6dc9cd-e0dd-4f70-9de5-35dba7156054 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1452 microversion: 2.1 time: 0.363877 Feb 19 20:59:14.168466 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1089/2260] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:13 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1452 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:14.184727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a198259e-f15f-456e-9239-6a2991a2a048 req-6fd1ef87-68d6-43ed-ab3c-92f35b3806a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c69ff896-e0c9-463d-ac90-7b19f8f7d912", "name": "network-vif-deleted", "tag": "6c8ecc50-2b75-491a-8873-0464b03ecc0d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:14.189229 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:14.189229 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:14.201900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a198259e-f15f-456e-9239-6a2991a2a048 req-6fd1ef87-68d6-43ed-ab3c-92f35b3806a4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:14.202970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a198259e-f15f-456e-9239-6a2991a2a048 req-6fd1ef87-68d6-43ed-ab3c-92f35b3806a4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:14.238256 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a198259e-f15f-456e-9239-6a2991a2a048 req-6fd1ef87-68d6-43ed-ab3c-92f35b3806a4 service nova] Creating event network-vif-deleted:6c8ecc50-2b75-491a-8873-0464b03ecc0d for instance c69ff896-e0c9-463d-ac90-7b19f8f7d912 on nch1-master-1 Feb 19 20:59:14.257336 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a198259e-f15f-456e-9239-6a2991a2a048 req-6fd1ef87-68d6-43ed-ab3c-92f35b3806a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084738 Feb 19 20:59:14.258321 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1090/2261] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:14.271035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb75627f-72cb-40ca-8293-066ec21e2eef tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:14.275632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb75627f-72cb-40ca-8293-066ec21e2eef tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:14.289027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb75627f-72cb-40ca-8293-066ec21e2eef tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:14.291847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb75627f-72cb-40ca-8293-066ec21e2eef tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:14.293585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb75627f-72cb-40ca-8293-066ec21e2eef tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:14.294285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb75627f-72cb-40ca-8293-066ec21e2eef tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:14.356475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb75627f-72cb-40ca-8293-066ec21e2eef tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:14.535339 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb75627f-72cb-40ca-8293-066ec21e2eef tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "DELETE /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 204 len: 0 microversion: 2.1 time: 0.274345 Feb 19 20:59:14.542639 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1091/2262] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:59:14 2022] DELETE /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:14.563715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-92b4d725-7191-4297-8188-88f30a5d2faa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:14.572415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-92b4d725-7191-4297-8188-88f30a5d2faa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:14.590891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:59:14.591744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:59:14.593502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:59:14.594084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:59:14.594668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:59:14.600535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92b4d725-7191-4297-8188-88f30a5d2faa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:14.602486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92b4d725-7191-4297-8188-88f30a5d2faa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:14.606425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92b4d725-7191-4297-8188-88f30a5d2faa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:14.606883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92b4d725-7191-4297-8188-88f30a5d2faa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:14.627026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:14.627473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:14.628284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:14.628743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:14.686927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Getting quotas for project 46068d17334344098e88ad0cc3e0eebb. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:59:14.708435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Getting quotas for user 6d0f3497fc80496499ed3d927823ce0c and project 46068d17334344098e88ad0cc3e0eebb. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:59:14.760935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:59:14.763587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:59:14.842436 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e97322af-6083-4b77-b298-400c03ac2f14 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.866401 Feb 19 20:59:14.843629 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1172/2263] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:59:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:59:14.855743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68e7c4f8-47dc-4d19-aac3-93791e432e14 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:14.856447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-68e7c4f8-47dc-4d19-aac3-93791e432e14 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:14.880236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68e7c4f8-47dc-4d19-aac3-93791e432e14 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:14.880707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68e7c4f8-47dc-4d19-aac3-93791e432e14 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:14.881495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68e7c4f8-47dc-4d19-aac3-93791e432e14 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:14.894739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68e7c4f8-47dc-4d19-aac3-93791e432e14 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:14.968885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-92b4d725-7191-4297-8188-88f30a5d2faa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:14.984789 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-92b4d725-7191-4297-8188-88f30a5d2faa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1308 microversion: 2.1 time: 0.442554 Feb 19 20:59:14.986328 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1092/2264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:14 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:14.998634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-463e2e1c-b6d6-4baa-818c-4d16d15f5a90 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:15.003709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-463e2e1c-b6d6-4baa-818c-4d16d15f5a90 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:15.024552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-463e2e1c-b6d6-4baa-818c-4d16d15f5a90 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:15.025691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-463e2e1c-b6d6-4baa-818c-4d16d15f5a90 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:15.029217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-463e2e1c-b6d6-4baa-818c-4d16d15f5a90 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:15.029678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-463e2e1c-b6d6-4baa-818c-4d16d15f5a90 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:15.194243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-68e7c4f8-47dc-4d19-aac3-93791e432e14 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:15.210032 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-68e7c4f8-47dc-4d19-aac3-93791e432e14 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1509 microversion: 2.1 time: 0.362600 Feb 19 20:59:15.210944 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1173/2265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:14 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1509 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:15.216000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6672a141-695c-46d7-9806-80769257d207 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:15.229597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6672a141-695c-46d7-9806-80769257d207 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c69ff896-e0c9-463d-ac90-7b19f8f7d912] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:15.240003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6672a141-695c-46d7-9806-80769257d207 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:15.241192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6672a141-695c-46d7-9806-80769257d207 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:15.242549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6672a141-695c-46d7-9806-80769257d207 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:15.243968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6672a141-695c-46d7-9806-80769257d207 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:15.261443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-6672a141-695c-46d7-9806-80769257d207 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] HTTP exception thrown: Instance c69ff896-e0c9-463d-ac90-7b19f8f7d912 could not be found. Feb 19 20:59:15.262351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6672a141-695c-46d7-9806-80769257d207 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Returning 404 to user: Instance c69ff896-e0c9-463d-ac90-7b19f8f7d912 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:15.263406 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6672a141-695c-46d7-9806-80769257d207 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912" status: 404 len: 111 microversion: 2.1 time: 0.051539 Feb 19 20:59:15.265746 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1174/2266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:15 2022] GET /compute/v2.1/servers/c69ff896-e0c9-463d-ac90-7b19f8f7d912 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:15.275767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-463e2e1c-b6d6-4baa-818c-4d16d15f5a90 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:15.277067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4f0b303-5e3a-40cc-889b-c68429338a93 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:15.278287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e4f0b303-5e3a-40cc-889b-c68429338a93 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:15.285719 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-463e2e1c-b6d6-4baa-818c-4d16d15f5a90 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.297063 Feb 19 20:59:15.286855 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1093/2267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:14 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:15.291555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13cdc189-bc2a-4e77-94b5-c9ad0028ed0b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791bbd30>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:15.343296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e4f0b303-5e3a-40cc-889b-c68429338a93 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:15.351432 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e4f0b303-5e3a-40cc-889b-c68429338a93 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1217 microversion: 2.1 time: 0.084358 Feb 19 20:59:15.353197 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1175/2268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:15 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:15.459854 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13cdc189-bc2a-4e77-94b5-c9ad0028ed0b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1461 microversion: 2.1 time: 0.171718 Feb 19 20:59:15.461219 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1094/2269] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:15 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1461 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:15.475391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8e1b203b-ddf3-4e92-b56f-2ea332e1a31c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676864c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:15.529926 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8e1b203b-ddf3-4e92-b56f-2ea332e1a31c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 200 len: 1461 microversion: 2.1 time: 0.059324 Feb 19 20:59:15.531260 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1176/2270] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:15 2022] GET /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 1461 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:15.544692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2dab2ed6-74a7-4f09-a273-c5813198c0f5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:15.545467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2dab2ed6-74a7-4f09-a273-c5813198c0f5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:15.553307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dab2ed6-74a7-4f09-a273-c5813198c0f5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:15.553863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dab2ed6-74a7-4f09-a273-c5813198c0f5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:15.554826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dab2ed6-74a7-4f09-a273-c5813198c0f5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:15.555890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dab2ed6-74a7-4f09-a273-c5813198c0f5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:15.703793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2dab2ed6-74a7-4f09-a273-c5813198c0f5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:15.711462 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2dab2ed6-74a7-4f09-a273-c5813198c0f5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 200 len: 1480 microversion: 2.1 time: 0.170831 Feb 19 20:59:15.711968 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1095/2271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:15 2022] GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 1480 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:16.001612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e1e042e0-224b-4e85-8bd7-c668d106e3bf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:16.002249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e1e042e0-224b-4e85-8bd7-c668d106e3bf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:16.008146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1e042e0-224b-4e85-8bd7-c668d106e3bf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.008626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1e042e0-224b-4e85-8bd7-c668d106e3bf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.009399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1e042e0-224b-4e85-8bd7-c668d106e3bf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.009832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1e042e0-224b-4e85-8bd7-c668d106e3bf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.172850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e1e042e0-224b-4e85-8bd7-c668d106e3bf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:16.181391 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e1e042e0-224b-4e85-8bd7-c668d106e3bf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1308 microversion: 2.1 time: 0.183403 Feb 19 20:59:16.182172 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1177/2272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:15 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:16.228973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c45c2d10-83ca-4ae5-9101-0717f731bc7c tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:16.229585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c45c2d10-83ca-4ae5-9101-0717f731bc7c tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:16.236390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c45c2d10-83ca-4ae5-9101-0717f731bc7c tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.236987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c45c2d10-83ca-4ae5-9101-0717f731bc7c tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.237612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c45c2d10-83ca-4ae5-9101-0717f731bc7c tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.238307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c45c2d10-83ca-4ae5-9101-0717f731bc7c tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.304545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d1757757-5247-4c2f-bd4c-1e5179e72b5b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:16.305479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d1757757-5247-4c2f-bd4c-1e5179e72b5b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:16.319063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1757757-5247-4c2f-bd4c-1e5179e72b5b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.319593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1757757-5247-4c2f-bd4c-1e5179e72b5b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.320895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1757757-5247-4c2f-bd4c-1e5179e72b5b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.321499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1757757-5247-4c2f-bd4c-1e5179e72b5b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.459064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c45c2d10-83ca-4ae5-9101-0717f731bc7c tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:16.466734 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c45c2d10-83ca-4ae5-9101-0717f731bc7c tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1509 microversion: 2.1 time: 0.241613 Feb 19 20:59:16.467320 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1096/2273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:16 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:16.478131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-41306c5e-e7ec-45e9-acd6-5c88e42328b6 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:16.478764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-41306c5e-e7ec-45e9-acd6-5c88e42328b6 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:16.493083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41306c5e-e7ec-45e9-acd6-5c88e42328b6 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.493541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41306c5e-e7ec-45e9-acd6-5c88e42328b6 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.494700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41306c5e-e7ec-45e9-acd6-5c88e42328b6 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.494962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-41306c5e-e7ec-45e9-acd6-5c88e42328b6 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.612257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-41306c5e-e7ec-45e9-acd6-5c88e42328b6 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:16.614515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d1757757-5247-4c2f-bd4c-1e5179e72b5b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:16.636262 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-41306c5e-e7ec-45e9-acd6-5c88e42328b6 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1269 microversion: 2.1 time: 0.164644 Feb 19 20:59:16.636800 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d1757757-5247-4c2f-bd4c-1e5179e72b5b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.336552 Feb 19 20:59:16.639343 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1097/2274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:16 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:16.647966 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1178/2275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:16 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:16.734961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cf95b7e0-ed44-4939-a53e-a4e9098c0afc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:16.735578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cf95b7e0-ed44-4939-a53e-a4e9098c0afc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:16.743259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf95b7e0-ed44-4939-a53e-a4e9098c0afc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.743716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf95b7e0-ed44-4939-a53e-a4e9098c0afc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.744602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf95b7e0-ed44-4939-a53e-a4e9098c0afc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.745047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf95b7e0-ed44-4939-a53e-a4e9098c0afc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.954840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9190de51-f92a-4dbc-b6dd-4754b4ef45c9 req-b282b33d-beb1-4ea3-94f4-b2fa602ddc8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25db99dd-04b8-4486-9f09-dbbb9bcaf223", "name": "network-vif-plugged", "status": "completed", "tag": "5973c52c-0226-472a-bd61-7d7925752963"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:16.956533 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:16.956533 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:16.970129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9190de51-f92a-4dbc-b6dd-4754b4ef45c9 req-b282b33d-beb1-4ea3-94f4-b2fa602ddc8d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:16.970825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9190de51-f92a-4dbc-b6dd-4754b4ef45c9 req-b282b33d-beb1-4ea3-94f4-b2fa602ddc8d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:16.984305 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9190de51-f92a-4dbc-b6dd-4754b4ef45c9 req-b282b33d-beb1-4ea3-94f4-b2fa602ddc8d service nova] Creating event network-vif-plugged:5973c52c-0226-472a-bd61-7d7925752963 for instance 25db99dd-04b8-4486-9f09-dbbb9bcaf223 on nch1-master-1 Feb 19 20:59:16.989699 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9190de51-f92a-4dbc-b6dd-4754b4ef45c9 req-b282b33d-beb1-4ea3-94f4-b2fa602ddc8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039058 Feb 19 20:59:16.990661 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1179/2276] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:17.033165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf95b7e0-ed44-4939-a53e-a4e9098c0afc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:17.062737 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cf95b7e0-ed44-4939-a53e-a4e9098c0afc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 200 len: 1467 microversion: 2.1 time: 0.328050 Feb 19 20:59:17.064818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1098/2277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:16 2022] GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 1467 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:17.086427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3a46f7b4-e1aa-4572-814b-71a5f5854934 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-25876579"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:17.087458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3a46f7b4-e1aa-4572-814b-71a5f5854934 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:17.101729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a46f7b4-e1aa-4572-814b-71a5f5854934 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.102200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a46f7b4-e1aa-4572-814b-71a5f5854934 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.102983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a46f7b4-e1aa-4572-814b-71a5f5854934 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.103433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a46f7b4-e1aa-4572-814b-71a5f5854934 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.199370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9fa26c1-e65b-461b-ad39-7302c5dfe354 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:17.199995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9fa26c1-e65b-461b-ad39-7302c5dfe354 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:17.210276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9fa26c1-e65b-461b-ad39-7302c5dfe354 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.212530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9fa26c1-e65b-461b-ad39-7302c5dfe354 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.213351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9fa26c1-e65b-461b-ad39-7302c5dfe354 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.222980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9fa26c1-e65b-461b-ad39-7302c5dfe354 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.512301 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3a46f7b4-e1aa-4572-814b-71a5f5854934 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "POST /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774/action" status: 202 len: 0 microversion: 2.1 time: 0.430471 Feb 19 20:59:17.513462 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1180/2278] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:59:17 2022] POST /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 20:59:17.542498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a9fa26c1-e65b-461b-ad39-7302c5dfe354 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:17.550478 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9fa26c1-e65b-461b-ad39-7302c5dfe354 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1308 microversion: 2.1 time: 0.355383 Feb 19 20:59:17.551073 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1099/2279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:17 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:17.563481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d54d0fd-91d3-451e-a592-78c70fba7395 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:17.564139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b0530bdb-24c6-411d-a450-c761da04e5b9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791bbb80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:17.587542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1d54d0fd-91d3-451e-a592-78c70fba7395 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:17.610729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d54d0fd-91d3-451e-a592-78c70fba7395 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.616631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d54d0fd-91d3-451e-a592-78c70fba7395 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.617569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d54d0fd-91d3-451e-a592-78c70fba7395 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.618024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d54d0fd-91d3-451e-a592-78c70fba7395 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.637924 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b0530bdb-24c6-411d-a450-c761da04e5b9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1451 microversion: 2.1 time: 0.083332 Feb 19 20:59:17.638514 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1100/2280] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:17 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1451 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:17.644087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5270f0e-1af4-4712-9b05-22bcc50077b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:17.647365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b5270f0e-1af4-4712-9b05-22bcc50077b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:17.653866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5270f0e-1af4-4712-9b05-22bcc50077b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.654549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5270f0e-1af4-4712-9b05-22bcc50077b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.656416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5270f0e-1af4-4712-9b05-22bcc50077b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.657033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5270f0e-1af4-4712-9b05-22bcc50077b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.693532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b5270f0e-1af4-4712-9b05-22bcc50077b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:17.757873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d54d0fd-91d3-451e-a592-78c70fba7395 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94820c6c6d04bcbae0e183cb51aa3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4aa3e254e944d4a85f2085a89a921b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:17.771249 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d54d0fd-91d3-451e-a592-78c70fba7395 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 200 len: 1467 microversion: 2.1 time: 0.254404 Feb 19 20:59:17.772822 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1181/2281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:17 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 1467 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:17.787189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-34096f4f-cbef-4de6-8891-9bed93d70965 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:17.797494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-34096f4f-cbef-4de6-8891-9bed93d70965 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:17.805372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34096f4f-cbef-4de6-8891-9bed93d70965 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.806064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34096f4f-cbef-4de6-8891-9bed93d70965 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.807200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34096f4f-cbef-4de6-8891-9bed93d70965 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.807914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34096f4f-cbef-4de6-8891-9bed93d70965 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.834578 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b5270f0e-1af4-4712-9b05-22bcc50077b5 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 204 len: 0 microversion: 2.1 time: 0.194522 Feb 19 20:59:17.835923 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1101/2282] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:59:17 2022] DELETE /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:17.845342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d97492ce-af92-4616-a1b2-4c52fcda6947 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:17.846544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d97492ce-af92-4616-a1b2-4c52fcda6947 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:17.855032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d97492ce-af92-4616-a1b2-4c52fcda6947 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.855724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d97492ce-af92-4616-a1b2-4c52fcda6947 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:17.856802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d97492ce-af92-4616-a1b2-4c52fcda6947 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:17.857406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d97492ce-af92-4616-a1b2-4c52fcda6947 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:18.065411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-34096f4f-cbef-4de6-8891-9bed93d70965 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:18.072702 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-34096f4f-cbef-4de6-8891-9bed93d70965 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.289654 Feb 19 20:59:18.073285 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1182/2283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:17 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:18.085324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d97492ce-af92-4616-a1b2-4c52fcda6947 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:18.087646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e8b2e8ca-468a-481c-a442-bf4699837595 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:18.088815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e8b2e8ca-468a-481c-a442-bf4699837595 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:18.095333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8b2e8ca-468a-481c-a442-bf4699837595 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:18.095793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8b2e8ca-468a-481c-a442-bf4699837595 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:18.096598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8b2e8ca-468a-481c-a442-bf4699837595 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:18.097033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e8b2e8ca-468a-481c-a442-bf4699837595 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:18.097526 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d97492ce-af92-4616-a1b2-4c52fcda6947 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1317 microversion: 2.1 time: 0.260007 Feb 19 20:59:18.098733 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1102/2284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:17 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:18.104161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-911f956b-51c2-40bf-9273-f60846994140 req-294de6cb-220f-4d92-9e64-47422c326d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822c2412-fbd7-43c1-995b-c9ef1a76203c", "name": "network-vif-deleted", "tag": "93d1f090-a18e-465a-a925-6c32da95879a"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:18.106310 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:18.106310 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:18.116551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-911f956b-51c2-40bf-9273-f60846994140 req-294de6cb-220f-4d92-9e64-47422c326d9d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:18.117278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-911f956b-51c2-40bf-9273-f60846994140 req-294de6cb-220f-4d92-9e64-47422c326d9d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:18.129277 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-911f956b-51c2-40bf-9273-f60846994140 req-294de6cb-220f-4d92-9e64-47422c326d9d service nova] Creating event network-vif-deleted:93d1f090-a18e-465a-a925-6c32da95879a for instance 822c2412-fbd7-43c1-995b-c9ef1a76203c on nch2-master-1 Feb 19 20:59:18.134330 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-911f956b-51c2-40bf-9273-f60846994140 req-294de6cb-220f-4d92-9e64-47422c326d9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034494 Feb 19 20:59:18.135164 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1103/2285] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:18.247066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e8b2e8ca-468a-481c-a442-bf4699837595 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:18.255026 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e8b2e8ca-468a-481c-a442-bf4699837595 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1499 microversion: 2.1 time: 0.171586 Feb 19 20:59:18.255606 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1183/2286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:18 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:18.568647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c7e29efe-5e85-48b2-902d-8aba2386cfa9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:18.570037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c7e29efe-5e85-48b2-902d-8aba2386cfa9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:18.579672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c7e29efe-5e85-48b2-902d-8aba2386cfa9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:18.580773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c7e29efe-5e85-48b2-902d-8aba2386cfa9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:18.582078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c7e29efe-5e85-48b2-902d-8aba2386cfa9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:18.583044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c7e29efe-5e85-48b2-902d-8aba2386cfa9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:18.651511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8f2e0817-436d-4e74-bea5-464415e43f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676e5430>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:18.733482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8f2e0817-436d-4e74-bea5-464415e43f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1451 microversion: 2.1 time: 0.085689 Feb 19 20:59:18.734809 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1184/2287] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:18 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1451 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:18.790057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5949715-e725-4a27-a971-4d13c7080de3 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:18.790887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a5949715-e725-4a27-a971-4d13c7080de3 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] [instance: 822c2412-fbd7-43c1-995b-c9ef1a76203c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:18.798789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5949715-e725-4a27-a971-4d13c7080de3 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:18.803435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5949715-e725-4a27-a971-4d13c7080de3 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:18.805286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5949715-e725-4a27-a971-4d13c7080de3 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:18.812528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5949715-e725-4a27-a971-4d13c7080de3 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:18.842682 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a5949715-e725-4a27-a971-4d13c7080de3 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] HTTP exception thrown: Instance 822c2412-fbd7-43c1-995b-c9ef1a76203c could not be found. Feb 19 20:59:18.844127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5949715-e725-4a27-a971-4d13c7080de3 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] Returning 404 to user: Instance 822c2412-fbd7-43c1-995b-c9ef1a76203c could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:18.845670 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a5949715-e725-4a27-a971-4d13c7080de3 tempest-ServerPasswordTestJSON-681477633 tempest-ServerPasswordTestJSON-681477633-project] 10.222.0.30 "GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c" status: 404 len: 111 microversion: 2.1 time: 0.060152 Feb 19 20:59:18.847613 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1185/2288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:18 2022] GET /compute/v2.1/servers/822c2412-fbd7-43c1-995b-c9ef1a76203c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:59:18.855024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-442493de-5890-455e-9e5c-d9f5a3e3ed5c req-395b7f0d-79b0-45d4-bfc6-46953779978c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98bece8-1f3d-4f2a-a0c5-e578fd98011d", "tag": "34fd2bb6-3818-47f3-b209-1132ddb12acf"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:18.856947 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:18.856947 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:18.878377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-442493de-5890-455e-9e5c-d9f5a3e3ed5c req-395b7f0d-79b0-45d4-bfc6-46953779978c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:18.884120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-442493de-5890-455e-9e5c-d9f5a3e3ed5c req-395b7f0d-79b0-45d4-bfc6-46953779978c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:18.896063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c7e29efe-5e85-48b2-902d-8aba2386cfa9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:18.911721 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-442493de-5890-455e-9e5c-d9f5a3e3ed5c req-395b7f0d-79b0-45d4-bfc6-46953779978c service nova] Creating event network-changed:34fd2bb6-3818-47f3-b209-1132ddb12acf for instance f98bece8-1f3d-4f2a-a0c5-e578fd98011d on nch2-master-1 Feb 19 20:59:18.922759 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-442493de-5890-455e-9e5c-d9f5a3e3ed5c req-395b7f0d-79b0-45d4-bfc6-46953779978c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073341 Feb 19 20:59:18.925562 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c7e29efe-5e85-48b2-902d-8aba2386cfa9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1308 microversion: 2.1 time: 0.356303 Feb 19 20:59:18.925906 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1186/2289] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:18.929016 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1104/2290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:18 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:19.041461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e75eafab-0970-495e-a3ce-38a24e4d0416 req-03d4c790-1f53-4961-8f12-f63446620b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac13892-70a3-4a7f-b7a8-a0cd9169d0b5", "name": "network-vif-unplugged", "status": "completed", "tag": "835957bc-cf48-4628-ac6b-011383e9ecd7"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:19.042963 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:19.042963 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:19.056982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e75eafab-0970-495e-a3ce-38a24e4d0416 req-03d4c790-1f53-4961-8f12-f63446620b6b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:19.057471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e75eafab-0970-495e-a3ce-38a24e4d0416 req-03d4c790-1f53-4961-8f12-f63446620b6b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:19.080077 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e75eafab-0970-495e-a3ce-38a24e4d0416 req-03d4c790-1f53-4961-8f12-f63446620b6b service nova] Creating event network-vif-unplugged:835957bc-cf48-4628-ac6b-011383e9ecd7 for instance eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 on nch2-master-1 Feb 19 20:59:19.085892 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e75eafab-0970-495e-a3ce-38a24e4d0416 req-03d4c790-1f53-4961-8f12-f63446620b6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048646 Feb 19 20:59:19.087593 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1187/2291] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:19.091893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7e1e4ea1-c302-4a13-956e-9865f4a53ad4 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:19.093699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7e1e4ea1-c302-4a13-956e-9865f4a53ad4 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:19.100833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e1e4ea1-c302-4a13-956e-9865f4a53ad4 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:19.101497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e1e4ea1-c302-4a13-956e-9865f4a53ad4 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:19.102528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e1e4ea1-c302-4a13-956e-9865f4a53ad4 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:19.103130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e1e4ea1-c302-4a13-956e-9865f4a53ad4 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:19.118070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8ef1166a-8a08-4ae4-93da-9588af3dbf05 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:19.118913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8ef1166a-8a08-4ae4-93da-9588af3dbf05 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:19.129484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ef1166a-8a08-4ae4-93da-9588af3dbf05 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:19.130597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ef1166a-8a08-4ae4-93da-9588af3dbf05 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:19.131933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ef1166a-8a08-4ae4-93da-9588af3dbf05 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:19.133639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ef1166a-8a08-4ae4-93da-9588af3dbf05 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:19.538471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7e1e4ea1-c302-4a13-956e-9865f4a53ad4 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:19.557860 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7e1e4ea1-c302-4a13-956e-9865f4a53ad4 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.471931 Feb 19 20:59:19.559137 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1105/2292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:19 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:19.565587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57ffa20b-0d4e-47cd-8685-f15f6f5d1d55 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:19.566328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57ffa20b-0d4e-47cd-8685-f15f6f5d1d55 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:19.575165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57ffa20b-0d4e-47cd-8685-f15f6f5d1d55 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:19.575904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57ffa20b-0d4e-47cd-8685-f15f6f5d1d55 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:19.576736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57ffa20b-0d4e-47cd-8685-f15f6f5d1d55 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:19.577361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57ffa20b-0d4e-47cd-8685-f15f6f5d1d55 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:19.593490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8ef1166a-8a08-4ae4-93da-9588af3dbf05 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:19.605311 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8ef1166a-8a08-4ae4-93da-9588af3dbf05 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1317 microversion: 2.1 time: 0.492322 Feb 19 20:59:19.619854 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1188/2293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:19 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:19.747750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e3ed7f1-7b65-4d76-bf14-487dc85ddb02 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676b3670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:19.806033 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6e3ed7f1-7b65-4d76-bf14-487dc85ddb02 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1451 microversion: 2.1 time: 0.062446 Feb 19 20:59:19.813411 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1189/2294] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:19 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1451 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:19.945626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-03de4482-2f4e-4de4-8656-7bd6738dc671 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:19.946703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-03de4482-2f4e-4de4-8656-7bd6738dc671 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:19.969801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03de4482-2f4e-4de4-8656-7bd6738dc671 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:19.972942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03de4482-2f4e-4de4-8656-7bd6738dc671 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:19.974076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03de4482-2f4e-4de4-8656-7bd6738dc671 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:19.974675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03de4482-2f4e-4de4-8656-7bd6738dc671 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:20.073024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-57ffa20b-0d4e-47cd-8685-f15f6f5d1d55 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:20.082050 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57ffa20b-0d4e-47cd-8685-f15f6f5d1d55 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 200 len: 1457 microversion: 2.1 time: 0.521729 Feb 19 20:59:20.083279 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1106/2295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:19 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 1457 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:20.284300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-03de4482-2f4e-4de4-8656-7bd6738dc671 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:20.292025 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-03de4482-2f4e-4de4-8656-7bd6738dc671 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1485 microversion: 2.1 time: 0.352133 Feb 19 20:59:20.292634 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1190/2296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:19 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1485 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:20.309784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-93bc9a92-c030-4b13-a33a-b772d4b93db4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:20.311813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-93bc9a92-c030-4b13-a33a-b772d4b93db4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:20.322204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93bc9a92-c030-4b13-a33a-b772d4b93db4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:20.331449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93bc9a92-c030-4b13-a33a-b772d4b93db4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:20.337569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93bc9a92-c030-4b13-a33a-b772d4b93db4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:20.338235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93bc9a92-c030-4b13-a33a-b772d4b93db4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:20.397753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-93bc9a92-c030-4b13-a33a-b772d4b93db4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lazy-loading 'flavor' on Instance uuid 25db99dd-04b8-4486-9f09-dbbb9bcaf223 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:20.546510 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-93bc9a92-c030-4b13-a33a-b772d4b93db4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223/action" status: 202 len: 0 microversion: 2.1 time: 0.241138 Feb 19 20:59:20.547826 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1107/2297] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:59:20 2022] POST /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:59:20.556744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-39b76c68-dc74-46b1-a8ac-ec3741ed22ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:20.557750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-39b76c68-dc74-46b1-a8ac-ec3741ed22ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:20.565898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-39b76c68-dc74-46b1-a8ac-ec3741ed22ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:20.566919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-39b76c68-dc74-46b1-a8ac-ec3741ed22ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:20.568080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-39b76c68-dc74-46b1-a8ac-ec3741ed22ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:20.568898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-39b76c68-dc74-46b1-a8ac-ec3741ed22ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:20.582598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f9285792-9f13-4fdf-9f6a-8d47db4b0af8 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:20.586199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f9285792-9f13-4fdf-9f6a-8d47db4b0af8 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:20.603178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f9285792-9f13-4fdf-9f6a-8d47db4b0af8 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:20.603626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f9285792-9f13-4fdf-9f6a-8d47db4b0af8 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:20.613309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f9285792-9f13-4fdf-9f6a-8d47db4b0af8 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:20.613888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f9285792-9f13-4fdf-9f6a-8d47db4b0af8 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:20.862564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-39b76c68-dc74-46b1-a8ac-ec3741ed22ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:20.872759 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-39b76c68-dc74-46b1-a8ac-ec3741ed22ce tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1493 microversion: 2.1 time: 0.319844 Feb 19 20:59:20.873761 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1191/2298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:20 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1493 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:20.879858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-06352230-b559-49c3-a514-46cf3f51da7b tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:20.880925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-06352230-b559-49c3-a514-46cf3f51da7b tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:20.891218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06352230-b559-49c3-a514-46cf3f51da7b tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:20.892105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06352230-b559-49c3-a514-46cf3f51da7b tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:20.894186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06352230-b559-49c3-a514-46cf3f51da7b tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:20.895015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06352230-b559-49c3-a514-46cf3f51da7b tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:20.937491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f9285792-9f13-4fdf-9f6a-8d47db4b0af8 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:20.946431 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f9285792-9f13-4fdf-9f6a-8d47db4b0af8 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.374941 Feb 19 20:59:20.967107 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1108/2299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:20 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:20.971831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b0b63ca5-2a5a-4d7f-8e3c-853a38b63ac7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6474248670>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:21.024150 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b0b63ca5-2a5a-4d7f-8e3c-853a38b63ac7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1451 microversion: 2.1 time: 0.055619 Feb 19 20:59:21.025775 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1109/2300] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:20 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1451 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:21.034645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-1b2a27b7-98f6-4775-bea3-a068fd01ed2e req-c177d212-f3a2-477a-a62a-64d6775667a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b048357b-44b4-4c70-8ed5-96deddc7d40e", "name": "network-vif-deleted", "tag": "59f45170-96d5-43f5-8368-d97e4afa51dc"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:21.050786 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:21.050786 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:21.063398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-06352230-b559-49c3-a514-46cf3f51da7b tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:21.069064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1b2a27b7-98f6-4775-bea3-a068fd01ed2e req-c177d212-f3a2-477a-a62a-64d6775667a8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.069926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1b2a27b7-98f6-4775-bea3-a068fd01ed2e req-c177d212-f3a2-477a-a62a-64d6775667a8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.071538 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-06352230-b559-49c3-a514-46cf3f51da7b tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1317 microversion: 2.1 time: 0.195953 Feb 19 20:59:21.072461 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1192/2301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:20 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:21.091494 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-1b2a27b7-98f6-4775-bea3-a068fd01ed2e req-c177d212-f3a2-477a-a62a-64d6775667a8 service nova] Creating event network-vif-deleted:59f45170-96d5-43f5-8368-d97e4afa51dc for instance b048357b-44b4-4c70-8ed5-96deddc7d40e on nch2-master-1 Feb 19 20:59:21.098099 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-1b2a27b7-98f6-4775-bea3-a068fd01ed2e req-c177d212-f3a2-477a-a62a-64d6775667a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069220 Feb 19 20:59:21.099289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ee71b767-941d-45b8-9e09-8cb17a399179 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:21.099898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ee71b767-941d-45b8-9e09-8cb17a399179 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: b048357b-44b4-4c70-8ed5-96deddc7d40e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:21.101122 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1110/2302] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:21.106685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee71b767-941d-45b8-9e09-8cb17a399179 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.107140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee71b767-941d-45b8-9e09-8cb17a399179 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.107960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee71b767-941d-45b8-9e09-8cb17a399179 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.113970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee71b767-941d-45b8-9e09-8cb17a399179 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.135830 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ee71b767-941d-45b8-9e09-8cb17a399179 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] HTTP exception thrown: Instance b048357b-44b4-4c70-8ed5-96deddc7d40e could not be found. Feb 19 20:59:21.136450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ee71b767-941d-45b8-9e09-8cb17a399179 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Returning 404 to user: Instance b048357b-44b4-4c70-8ed5-96deddc7d40e could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:21.137279 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ee71b767-941d-45b8-9e09-8cb17a399179 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e" status: 404 len: 111 microversion: 2.1 time: 0.042011 Feb 19 20:59:21.137832 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1193/2303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:21 2022] GET /compute/v2.1/servers/b048357b-44b4-4c70-8ed5-96deddc7d40e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:59:21.146191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-37e5c534-2cbd-40af-92a9-e17011c45a2a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:21.146987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-37e5c534-2cbd-40af-92a9-e17011c45a2a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:21.153631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37e5c534-2cbd-40af-92a9-e17011c45a2a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.154082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37e5c534-2cbd-40af-92a9-e17011c45a2a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.155144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37e5c534-2cbd-40af-92a9-e17011c45a2a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.155508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-37e5c534-2cbd-40af-92a9-e17011c45a2a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.187948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-37e5c534-2cbd-40af-92a9-e17011c45a2a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:21.278913 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-37e5c534-2cbd-40af-92a9-e17011c45a2a tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 204 len: 0 microversion: 2.1 time: 0.136170 Feb 19 20:59:21.279507 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1111/2304] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:59:21 2022] DELETE /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:21.287679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b8c9f62f-e0e7-4af3-bd9d-abd113f19317 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:21.288280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b8c9f62f-e0e7-4af3-bd9d-abd113f19317 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:21.295458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8c9f62f-e0e7-4af3-bd9d-abd113f19317 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.296685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8c9f62f-e0e7-4af3-bd9d-abd113f19317 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.297467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8c9f62f-e0e7-4af3-bd9d-abd113f19317 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.298149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8c9f62f-e0e7-4af3-bd9d-abd113f19317 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.472503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b8c9f62f-e0e7-4af3-bd9d-abd113f19317 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:21.480585 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b8c9f62f-e0e7-4af3-bd9d-abd113f19317 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1485 microversion: 2.1 time: 0.196276 Feb 19 20:59:21.482477 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1194/2305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:21 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1485 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:21.891038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-53bb8ab1-8cde-495e-90b2-7204c88d8d9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:21.892975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-53bb8ab1-8cde-495e-90b2-7204c88d8d9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:21.899925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53bb8ab1-8cde-495e-90b2-7204c88d8d9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.900383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53bb8ab1-8cde-495e-90b2-7204c88d8d9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.901172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53bb8ab1-8cde-495e-90b2-7204c88d8d9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.905787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53bb8ab1-8cde-495e-90b2-7204c88d8d9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.964709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3b3a7373-633b-40ff-8099-470eda375ccd tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:21.966124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3b3a7373-633b-40ff-8099-470eda375ccd tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:21.975113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b3a7373-633b-40ff-8099-470eda375ccd tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.975834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b3a7373-633b-40ff-8099-470eda375ccd tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:21.977006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b3a7373-633b-40ff-8099-470eda375ccd tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:21.977639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b3a7373-633b-40ff-8099-470eda375ccd tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:22.313265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53bb8ab1-8cde-495e-90b2-7204c88d8d9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:22.321532 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-53bb8ab1-8cde-495e-90b2-7204c88d8d9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 200 len: 1476 microversion: 2.1 time: 0.434981 Feb 19 20:59:22.327979 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1112/2306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:21 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:22.341201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e94dbfcc-2271-4dba-90af-a5d767ed6b07 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467cda3a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:22.392564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3b3a7373-633b-40ff-8099-470eda375ccd tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:22.403433 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3b3a7373-633b-40ff-8099-470eda375ccd tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.442931 Feb 19 20:59:22.417436 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1195/2307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:21 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:22.417436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6244729e-7cdf-4954-94ce-c7265cd10964 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:22.417436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6244729e-7cdf-4954-94ce-c7265cd10964 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:22.435003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6244729e-7cdf-4954-94ce-c7265cd10964 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:22.435472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6244729e-7cdf-4954-94ce-c7265cd10964 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:22.437059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6244729e-7cdf-4954-94ce-c7265cd10964 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:22.438545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6244729e-7cdf-4954-94ce-c7265cd10964 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:22.449423 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e94dbfcc-2271-4dba-90af-a5d767ed6b07 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1451 microversion: 2.1 time: 0.120284 Feb 19 20:59:22.450167 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1113/2308] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:22 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1451 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:22.458532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-212f0bb8-4672-447a-8e19-a9c568583301 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1989186877"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:22.459810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-212f0bb8-4672-447a-8e19-a9c568583301 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:22.478790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212f0bb8-4672-447a-8e19-a9c568583301 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:22.482158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212f0bb8-4672-447a-8e19-a9c568583301 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:22.484948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212f0bb8-4672-447a-8e19-a9c568583301 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:22.486275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212f0bb8-4672-447a-8e19-a9c568583301 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:22.710999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6244729e-7cdf-4954-94ce-c7265cd10964 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:22.718346 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6244729e-7cdf-4954-94ce-c7265cd10964 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1317 microversion: 2.1 time: 0.312944 Feb 19 20:59:22.718918 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1196/2309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:22 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:23.001799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-400222703", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "687ed01e-e68f-4aea-9a19-f332516d898b"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:23.032886 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-212f0bb8-4672-447a-8e19-a9c568583301 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223/action" status: 202 len: 0 microversion: 2.1 time: 0.577778 Feb 19 20:59:23.034699 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1114/2310] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:59:22 2022] POST /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 20:59:23.045692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:23.047208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:23.060288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:23.061533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:23.062746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:23.063523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:23.112296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:23.113524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:23.114202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lazy-loading 'fault' on Instance uuid c65e4283-9a5c-4b89-a006-7e6727e92f45 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:23.158919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] validate_networks() for [('687ed01e-e68f-4aea-9a19-f332516d898b', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:59:23.415028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:23.432883 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-76d93f2f-65a8-4ac3-b6ab-307a7f9628fa tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 200 len: 1300 microversion: 2.1 time: 0.396542 Feb 19 20:59:23.443379 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1115/2311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:23 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 1300 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:23.443379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2f06c6be-6dfd-44a8-ba5f-bf3f53bb19f7 req-b74cfa52-081f-4e73-83e8-6bcd1e067d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678cfc25-63c2-4957-8e09-95a21fee7156", "name": "network-vif-plugged", "status": "completed", "tag": "bc5b020a-585b-4eec-90c5-2e83ef2c9c96"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:23.443379 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:23.443379 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:23.452977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2f06c6be-6dfd-44a8-ba5f-bf3f53bb19f7 req-b74cfa52-081f-4e73-83e8-6bcd1e067d58 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:23.453525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2f06c6be-6dfd-44a8-ba5f-bf3f53bb19f7 req-b74cfa52-081f-4e73-83e8-6bcd1e067d58 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:23.465735 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2f06c6be-6dfd-44a8-ba5f-bf3f53bb19f7 req-b74cfa52-081f-4e73-83e8-6bcd1e067d58 service nova] Creating event network-vif-plugged:bc5b020a-585b-4eec-90c5-2e83ef2c9c96 for instance 678cfc25-63c2-4957-8e09-95a21fee7156 on nch2-master-1 Feb 19 20:59:23.471674 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2f06c6be-6dfd-44a8-ba5f-bf3f53bb19f7 req-b74cfa52-081f-4e73-83e8-6bcd1e067d58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036758 Feb 19 20:59:23.472480 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1116/2312] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:23.478788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f5677799-c523-4f7f-bc1d-49becc3a20d9 req-5be5add8-015b-40d9-895e-00438c4985d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65e4283-9a5c-4b89-a006-7e6727e92f45", "name": "network-vif-deleted", "tag": "36f49322-08ea-4d05-b1fa-2357653ca8be"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:23.480466 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:23.480466 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:23.492510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f5677799-c523-4f7f-bc1d-49becc3a20d9 req-5be5add8-015b-40d9-895e-00438c4985d0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:23.493370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f5677799-c523-4f7f-bc1d-49becc3a20d9 req-5be5add8-015b-40d9-895e-00438c4985d0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:23.510742 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f5677799-c523-4f7f-bc1d-49becc3a20d9 req-5be5add8-015b-40d9-895e-00438c4985d0 service nova] Creating event network-vif-deleted:36f49322-08ea-4d05-b1fa-2357653ca8be for instance c65e4283-9a5c-4b89-a006-7e6727e92f45 on nch1-master-1 Feb 19 20:59:23.516712 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f5677799-c523-4f7f-bc1d-49becc3a20d9 req-5be5add8-015b-40d9-895e-00438c4985d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042210 Feb 19 20:59:23.517672 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1117/2313] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:23.523606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-96fa146e-3a4e-454a-8bb4-158eddffc93c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6479261160>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:23.589713 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-96fa146e-3a4e-454a-8bb4-158eddffc93c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1440 microversion: 2.1 time: 0.070208 Feb 19 20:59:23.596046 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1118/2314] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:23 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1440 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:23.596226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a21d52b3-7404-4d91-89e6-56a798065327 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:23.597082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a21d52b3-7404-4d91-89e6-56a798065327 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:23.609665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a21d52b3-7404-4d91-89e6-56a798065327 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:23.610140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a21d52b3-7404-4d91-89e6-56a798065327 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:23.610954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a21d52b3-7404-4d91-89e6-56a798065327 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:23.611392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a21d52b3-7404-4d91-89e6-56a798065327 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.016514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a21d52b3-7404-4d91-89e6-56a798065327 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:24.026809 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a21d52b3-7404-4d91-89e6-56a798065327 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.435372 Feb 19 20:59:24.031363 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1119/2315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:23 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:24.040293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e20a5673-da67-447f-af65-c0c61d0f12b8 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479226820>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:24.115236 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e20a5673-da67-447f-af65-c0c61d0f12b8 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1451 microversion: 2.1 time: 0.081290 Feb 19 20:59:24.116468 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1120/2316] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:24 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1451 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:24.121832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b7296352-625e-4d48-a1db-c81f5b121fa5 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:24.122561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b7296352-625e-4d48-a1db-c81f5b121fa5 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:24.130082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7296352-625e-4d48-a1db-c81f5b121fa5 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.130688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7296352-625e-4d48-a1db-c81f5b121fa5 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.131734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7296352-625e-4d48-a1db-c81f5b121fa5 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.132453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7296352-625e-4d48-a1db-c81f5b121fa5 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.141062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:59:24.141652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:59:24.141928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:59:24.142336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:59:24.142756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:59:24.154738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.156266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.157310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.157911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.177543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Getting quotas for project fea74080450a434fb28f53a0a28d5627. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:59:24.185634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Getting quotas for user ae01e28f534446c09c6dfbe2871d36f9 and project fea74080450a434fb28f53a0a28d5627. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:59:24.199234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:59:24.201652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:59:24.276937 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dcb3e329-11b3-46aa-bd71-f24f19429b5d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.551268 Feb 19 20:59:24.277830 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1197/2317] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 20:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 20:59:24.290622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82c15f27-7565-4d5b-a50f-36a325ef1399 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:24.291800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-82c15f27-7565-4d5b-a50f-36a325ef1399 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:24.336321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b7296352-625e-4d48-a1db-c81f5b121fa5 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:24.345484 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b7296352-625e-4d48-a1db-c81f5b121fa5 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1317 microversion: 2.1 time: 0.227778 Feb 19 20:59:24.356611 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1121/2318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:24 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:24.428610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-82c15f27-7565-4d5b-a50f-36a325ef1399 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:24.440253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-82c15f27-7565-4d5b-a50f-36a325ef1399 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:24.444028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-82c15f27-7565-4d5b-a50f-36a325ef1399 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:24.451089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c0833372-006f-4deb-900c-3a29b730a7c1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:24.453437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c0833372-006f-4deb-900c-3a29b730a7c1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: c65e4283-9a5c-4b89-a006-7e6727e92f45] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:24.464656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0833372-006f-4deb-900c-3a29b730a7c1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.465113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0833372-006f-4deb-900c-3a29b730a7c1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.465914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0833372-006f-4deb-900c-3a29b730a7c1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.466469 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-82c15f27-7565-4d5b-a50f-36a325ef1399 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1261 microversion: 2.26 time: 0.174922 Feb 19 20:59:24.467102 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1198/2319] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:24 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:24.477500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0833372-006f-4deb-900c-3a29b730a7c1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.484082 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c0833372-006f-4deb-900c-3a29b730a7c1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] HTTP exception thrown: Instance c65e4283-9a5c-4b89-a006-7e6727e92f45 could not be found. Feb 19 20:59:24.484802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c0833372-006f-4deb-900c-3a29b730a7c1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Returning 404 to user: Instance c65e4283-9a5c-4b89-a006-7e6727e92f45 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:24.485660 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c0833372-006f-4deb-900c-3a29b730a7c1 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45" status: 404 len: 111 microversion: 2.1 time: 0.038972 Feb 19 20:59:24.494915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6174788a-2135-4c00-a16e-de32b786590e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:24.495418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6174788a-2135-4c00-a16e-de32b786590e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:24.501090 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1122/2320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:24 2022] GET /compute/v2.1/servers/c65e4283-9a5c-4b89-a006-7e6727e92f45 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 20:59:24.502725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6174788a-2135-4c00-a16e-de32b786590e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.503752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6174788a-2135-4c00-a16e-de32b786590e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.504611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6174788a-2135-4c00-a16e-de32b786590e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.505053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6174788a-2135-4c00-a16e-de32b786590e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.539480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6174788a-2135-4c00-a16e-de32b786590e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:24.606168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-29b05c77-6abf-4c24-9b4a-e79588624a44 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6479131e50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:24.678517 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-29b05c77-6abf-4c24-9b4a-e79588624a44 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1440 microversion: 2.1 time: 0.078573 Feb 19 20:59:24.684529 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1123/2321] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:24 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1440 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:24.766488 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6174788a-2135-4c00-a16e-de32b786590e tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 204 len: 0 microversion: 2.1 time: 0.275490 Feb 19 20:59:24.767370 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1199/2322] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:59:24 2022] DELETE /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:24.774824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-136fa224-bbf7-483e-99c3-8041358203ca tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:24.775432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-136fa224-bbf7-483e-99c3-8041358203ca tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:24.806567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-136fa224-bbf7-483e-99c3-8041358203ca tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.807427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-136fa224-bbf7-483e-99c3-8041358203ca tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:24.811022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-136fa224-bbf7-483e-99c3-8041358203ca tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:24.812233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-136fa224-bbf7-483e-99c3-8041358203ca tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:25.048246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-020808ac-ec15-4759-bc5b-99e4e34df4bf tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:25.048907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-020808ac-ec15-4759-bc5b-99e4e34df4bf tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:25.055123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-020808ac-ec15-4759-bc5b-99e4e34df4bf tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:25.062715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-020808ac-ec15-4759-bc5b-99e4e34df4bf tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:25.064350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-020808ac-ec15-4759-bc5b-99e4e34df4bf tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:25.064966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-020808ac-ec15-4759-bc5b-99e4e34df4bf tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:25.068856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-136fa224-bbf7-483e-99c3-8041358203ca tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:25.090760 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-136fa224-bbf7-483e-99c3-8041358203ca tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1501 microversion: 2.1 time: 0.319436 Feb 19 20:59:25.101800 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1124/2323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:24 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1501 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:25.128985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-010ce8ae-6cb7-46c7-8f62-edd6799fdd1c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f647922aa60>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:25.213117 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-010ce8ae-6cb7-46c7-8f62-edd6799fdd1c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1451 microversion: 2.1 time: 0.087973 Feb 19 20:59:25.219389 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1125/2324] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:25 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1451 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:25.364830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8166bff7-69e4-40ed-8834-509cd2c85bc2 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:25.365875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8166bff7-69e4-40ed-8834-509cd2c85bc2 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:25.375992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8166bff7-69e4-40ed-8834-509cd2c85bc2 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:25.378898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8166bff7-69e4-40ed-8834-509cd2c85bc2 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:25.380008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8166bff7-69e4-40ed-8834-509cd2c85bc2 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:25.380723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8166bff7-69e4-40ed-8834-509cd2c85bc2 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:25.496174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-020808ac-ec15-4759-bc5b-99e4e34df4bf tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:25.509231 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-020808ac-ec15-4759-bc5b-99e4e34df4bf tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1324 microversion: 2.1 time: 0.463654 Feb 19 20:59:25.511119 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1200/2325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:25 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:25.526873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:25.528205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:25.541796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:25.542627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:25.543834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:25.544275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:25.709212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:25.725663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:25.732138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:25.732138 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1dbfd8b8-760f-4094-accc-8b3d6c56b77e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1313 microversion: 2.26 time: 0.214854 Feb 19 20:59:25.732138 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1201/2326] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:25 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:25.737606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9b3c3c0a-478a-4e8a-a90f-1ac53db84cc2 req-393cafb7-a25f-4685-a868-f6d2788f0d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f8a307-e082-4ac1-b3db-3860b9e66774", "name": "network-vif-plugged", "status": "completed", "tag": "89832a83-9f4f-4449-b43c-c9fafb143517"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:25.739177 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:25.739177 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:25.765736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9b3c3c0a-478a-4e8a-a90f-1ac53db84cc2 req-393cafb7-a25f-4685-a868-f6d2788f0d1a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:25.766183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9b3c3c0a-478a-4e8a-a90f-1ac53db84cc2 req-393cafb7-a25f-4685-a868-f6d2788f0d1a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:25.786510 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9b3c3c0a-478a-4e8a-a90f-1ac53db84cc2 req-393cafb7-a25f-4685-a868-f6d2788f0d1a service nova] Creating event network-vif-plugged:89832a83-9f4f-4449-b43c-c9fafb143517 for instance 87f8a307-e082-4ac1-b3db-3860b9e66774 on nch1-master-1 Feb 19 20:59:25.792531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9b3c3c0a-478a-4e8a-a90f-1ac53db84cc2 req-393cafb7-a25f-4685-a868-f6d2788f0d1a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061262 Feb 19 20:59:25.792531 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1202/2327] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:25.798038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b8ee73f-ad86-48f6-9d92-d4c9d49fabdd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64676e5ee0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:25.859705 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b8ee73f-ad86-48f6-9d92-d4c9d49fabdd tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1440 microversion: 2.1 time: 0.066359 Feb 19 20:59:25.860721 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1203/2328] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:25 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1440 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:26.100182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8166bff7-69e4-40ed-8834-509cd2c85bc2 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:26.108673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0ec69d64-23bd-44cd-879b-f50985a6e5f3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:26.110452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0ec69d64-23bd-44cd-879b-f50985a6e5f3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:26.110697 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8166bff7-69e4-40ed-8834-509cd2c85bc2 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1317 microversion: 2.1 time: 0.750281 Feb 19 20:59:26.112648 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1126/2329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:25 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:26.122884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ec69d64-23bd-44cd-879b-f50985a6e5f3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:26.124480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ec69d64-23bd-44cd-879b-f50985a6e5f3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:26.125537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ec69d64-23bd-44cd-879b-f50985a6e5f3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:26.126686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ec69d64-23bd-44cd-879b-f50985a6e5f3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:26.227913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4066e3f6-fa9c-4889-aa67-f9e80a076b2c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479200550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:26.283541 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4066e3f6-fa9c-4889-aa67-f9e80a076b2c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1451 microversion: 2.1 time: 0.060654 Feb 19 20:59:26.284744 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1127/2330] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:26 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1451 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:26.530371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d93d1326-12b9-44c3-b853-e04f789df47a tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:26.531402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d93d1326-12b9-44c3-b853-e04f789df47a tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:26.544185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d93d1326-12b9-44c3-b853-e04f789df47a tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:26.545031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d93d1326-12b9-44c3-b853-e04f789df47a tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:26.551516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d93d1326-12b9-44c3-b853-e04f789df47a tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:26.553047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d93d1326-12b9-44c3-b853-e04f789df47a tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:27.048710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0ec69d64-23bd-44cd-879b-f50985a6e5f3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d694f3e8da440a9a1cac8ca2de030e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63acbd462dfc418fab3fbeedccacb9c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:27.058836 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0ec69d64-23bd-44cd-879b-f50985a6e5f3 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 200 len: 1501 microversion: 2.1 time: 0.954611 Feb 19 20:59:27.064079 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1204/2331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:26 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 1501 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:27.079672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:27.080847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:27.096747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:27.097308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:27.099067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:27.102790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:27.130331 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d93d1326-12b9-44c3-b853-e04f789df47a tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:27.144098 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d93d1326-12b9-44c3-b853-e04f789df47a tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1520 microversion: 2.1 time: 0.618151 Feb 19 20:59:27.144995 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1128/2332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:26 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1520 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:27.162474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dfad768c-d0a5-4030-87f8-e66e7c4cc72b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64791bbb80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:27.275605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:27.295673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:27.302093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:27.303738 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-75d162bf-ea0f-4fe4-94d1-892b366952bb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1319 microversion: 2.26 time: 0.233802 Feb 19 20:59:27.318503 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1205/2333] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:27 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:27.325869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82392ec7-7cb8-4649-b548-52af62412b80 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:27.327958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-82392ec7-7cb8-4649-b548-52af62412b80 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:27.334850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82392ec7-7cb8-4649-b548-52af62412b80 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:27.336655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82392ec7-7cb8-4649-b548-52af62412b80 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:27.337338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82392ec7-7cb8-4649-b548-52af62412b80 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:27.338175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82392ec7-7cb8-4649-b548-52af62412b80 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:27.899928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-82392ec7-7cb8-4649-b548-52af62412b80 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:27.912093 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-82392ec7-7cb8-4649-b548-52af62412b80 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1317 microversion: 2.1 time: 0.591919 Feb 19 20:59:27.916095 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1206/2334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:27 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:27.928208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e9273d46-f9ff-414e-a87c-dd06f8ed14d1 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:27.929081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e9273d46-f9ff-414e-a87c-dd06f8ed14d1 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:27.942462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9273d46-f9ff-414e-a87c-dd06f8ed14d1 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:27.943506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9273d46-f9ff-414e-a87c-dd06f8ed14d1 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:27.946548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9273d46-f9ff-414e-a87c-dd06f8ed14d1 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:27.948095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9273d46-f9ff-414e-a87c-dd06f8ed14d1 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:28.003704 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e9273d46-f9ff-414e-a87c-dd06f8ed14d1 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] HTTP exception thrown: Action 999 not found Feb 19 20:59:28.004647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e9273d46-f9ff-414e-a87c-dd06f8ed14d1 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Returning 404 to user: Action 999 not found {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:28.005986 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e9273d46-f9ff-414e-a87c-dd06f8ed14d1 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.086701 Feb 19 20:59:28.016000 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1207/2335] 10.222.0.30 () {58 vars in 1307 bytes} [Sat Feb 19 20:59:27 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156/os-instance-actions/999 => generated 66 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 20:59:28.021583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0db8630c-34e5-41be-b267-396cc8954add tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676728b0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:36.587212 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dfad768c-d0a5-4030-87f8-e66e7c4cc72b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1440 microversion: 2.1 time: 9.440539 Feb 19 20:59:36.588093 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1129/2336] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:27 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1440 bytes in 9442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:36.593104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-7bbdd3ae-0ff6-4b8c-bce6-b010bb2dd880 req-a87bc32d-ad99-4227-9671-2b79bd49fc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa80efa-1c90-4f4a-bb66-91e6e91c9db9", "name": "network-vif-deleted", "tag": "29196269-26de-4888-9bd6-bdcde982f91c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:36.594651 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:36.594651 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:36.600382 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0db8630c-34e5-41be-b267-396cc8954add tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1460 microversion: 2.1 time: 8.582487 Feb 19 20:59:36.609170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7bbdd3ae-0ff6-4b8c-bce6-b010bb2dd880 req-a87bc32d-ad99-4227-9671-2b79bd49fc10 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:36.609876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7bbdd3ae-0ff6-4b8c-bce6-b010bb2dd880 req-a87bc32d-ad99-4227-9671-2b79bd49fc10 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:36.610023 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1208/2337] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:28 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1460 bytes in 8593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:36.615683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b908a14-a43b-4809-9a1e-ea4fd4e5dfb5 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '.version_select at 0x7f6467ed1550>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:36.616338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7b908a14-a43b-4809-9a1e-ea4fd4e5dfb5 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 4ab47807-4530-4911-8838-f86aea532d47] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:36.622789 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-7b908a14-a43b-4809-9a1e-ea4fd4e5dfb5 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] HTTP exception thrown: Instance 4ab47807-4530-4911-8838-f86aea532d47 could not be found. Feb 19 20:59:36.623374 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-7bbdd3ae-0ff6-4b8c-bce6-b010bb2dd880 req-a87bc32d-ad99-4227-9671-2b79bd49fc10 service nova] Creating event network-vif-deleted:29196269-26de-4888-9bd6-bdcde982f91c for instance 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 on nch1-master-1 Feb 19 20:59:36.623537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b908a14-a43b-4809-9a1e-ea4fd4e5dfb5 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Returning 404 to user: Instance 4ab47807-4530-4911-8838-f86aea532d47 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:36.624435 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b908a14-a43b-4809-9a1e-ea4fd4e5dfb5 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/4ab47807-4530-4911-8838-f86aea532d47/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.013244 Feb 19 20:59:36.629607 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1209/2338] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Feb 19 20:59:36 2022] GET /compute/v2.1/servers/4ab47807-4530-4911-8838-f86aea532d47/os-instance-actions => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:36.631138 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-7bbdd3ae-0ff6-4b8c-bce6-b010bb2dd880 req-a87bc32d-ad99-4227-9671-2b79bd49fc10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041824 Feb 19 20:59:36.632459 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1130/2339] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:36.635549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-006ed395-0350-41b5-bcdb-eda9e56f09e6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:36.636491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-006ed395-0350-41b5-bcdb-eda9e56f09e6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] [instance: 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:36.640225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:36.641179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:36.644315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006ed395-0350-41b5-bcdb-eda9e56f09e6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:36.644814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006ed395-0350-41b5-bcdb-eda9e56f09e6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:36.645605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006ed395-0350-41b5-bcdb-eda9e56f09e6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:36.646103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-006ed395-0350-41b5-bcdb-eda9e56f09e6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:36.648638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:36.649287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:36.650260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:36.650868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:36.661179 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-006ed395-0350-41b5-bcdb-eda9e56f09e6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] HTTP exception thrown: Instance 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 could not be found. Feb 19 20:59:36.662307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-006ed395-0350-41b5-bcdb-eda9e56f09e6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] Returning 404 to user: Instance 5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:36.663151 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-006ed395-0350-41b5-bcdb-eda9e56f09e6 tempest-LiveMigrationTest-819722215 tempest-LiveMigrationTest-819722215-project] 10.222.0.30 "GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9" status: 404 len: 111 microversion: 2.1 time: 0.031780 Feb 19 20:59:36.677314 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1210/2340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:36 2022] GET /compute/v2.1/servers/5aa80efa-1c90-4f4a-bb66-91e6e91c9db9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:36.689075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f034e6a4-3e73-41d9-9cba-5fc49df822ac req-15f0056a-6698-4148-a76d-2adac64bf7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98bece8-1f3d-4f2a-a0c5-e578fd98011d", "name": "network-vif-plugged", "status": "completed", "tag": "34fd2bb6-3818-47f3-b209-1132ddb12acf"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:36.694127 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:36.694127 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:36.710575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f034e6a4-3e73-41d9-9cba-5fc49df822ac req-15f0056a-6698-4148-a76d-2adac64bf7bd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:36.711284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f034e6a4-3e73-41d9-9cba-5fc49df822ac req-15f0056a-6698-4148-a76d-2adac64bf7bd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:36.738132 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f034e6a4-3e73-41d9-9cba-5fc49df822ac req-15f0056a-6698-4148-a76d-2adac64bf7bd service nova] Creating event network-vif-plugged:34fd2bb6-3818-47f3-b209-1132ddb12acf for instance f98bece8-1f3d-4f2a-a0c5-e578fd98011d on nch2-master-1 Feb 19 20:59:36.743897 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f034e6a4-3e73-41d9-9cba-5fc49df822ac req-15f0056a-6698-4148-a76d-2adac64bf7bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065251 Feb 19 20:59:36.744794 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1211/2341] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:36.751129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0680ef0-a5fb-4292-8bf8-42df06a397dd tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:36.752064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d0680ef0-a5fb-4292-8bf8-42df06a397dd tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:36.770810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0680ef0-a5fb-4292-8bf8-42df06a397dd tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:36.771616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0680ef0-a5fb-4292-8bf8-42df06a397dd tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:36.772801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0680ef0-a5fb-4292-8bf8-42df06a397dd tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:36.773441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0680ef0-a5fb-4292-8bf8-42df06a397dd tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:37.086003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:37.099896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:37.101824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:37.107056 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-05b4d1d6-57cd-4180-96cc-6c74aeef6206 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1361 microversion: 2.26 time: 0.473452 Feb 19 20:59:37.108032 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1131/2342] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:36 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1361 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:37.113165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-94043fd7-408c-4868-a1ef-a7a1805f06c3 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791bbd30>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:37.186569 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-94043fd7-408c-4868-a1ef-a7a1805f06c3 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 200 len: 1460 microversion: 2.1 time: 0.076625 Feb 19 20:59:37.187551 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1132/2343] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:37 2022] GET /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 1460 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:37.208957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bcd3e961-3735-43d4-9753-88fdc5689751 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:37.220051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d0680ef0-a5fb-4292-8bf8-42df06a397dd tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:37.234046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bcd3e961-3735-43d4-9753-88fdc5689751 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:37.241665 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d0680ef0-a5fb-4292-8bf8-42df06a397dd tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1317 microversion: 2.1 time: 0.494563 Feb 19 20:59:37.245413 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1212/2344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:36 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:37.252706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bf3eb8ae-36c8-429d-9f71-0236c7527c92 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:37.262452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bf3eb8ae-36c8-429d-9f71-0236c7527c92 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:37.263071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcd3e961-3735-43d4-9753-88fdc5689751 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:37.263749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcd3e961-3735-43d4-9753-88fdc5689751 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:37.266184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcd3e961-3735-43d4-9753-88fdc5689751 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:37.269352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcd3e961-3735-43d4-9753-88fdc5689751 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:37.289443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf3eb8ae-36c8-429d-9f71-0236c7527c92 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:37.289924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf3eb8ae-36c8-429d-9f71-0236c7527c92 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:37.292631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf3eb8ae-36c8-429d-9f71-0236c7527c92 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:37.294036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf3eb8ae-36c8-429d-9f71-0236c7527c92 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:37.329498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bcd3e961-3735-43d4-9753-88fdc5689751 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:37.466973 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bcd3e961-3735-43d4-9753-88fdc5689751 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "DELETE /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 204 len: 0 microversion: 2.1 time: 0.277779 Feb 19 20:59:37.469994 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1133/2345] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:59:37 2022] DELETE /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:37.486678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-25e2be19-e3ab-424a-a929-bc2f00fde9cb tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:37.487629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-25e2be19-e3ab-424a-a929-bc2f00fde9cb tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:37.494798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25e2be19-e3ab-424a-a929-bc2f00fde9cb tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:37.495488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25e2be19-e3ab-424a-a929-bc2f00fde9cb tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:37.496576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25e2be19-e3ab-424a-a929-bc2f00fde9cb tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:37.497204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25e2be19-e3ab-424a-a929-bc2f00fde9cb tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:37.605492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bf3eb8ae-36c8-429d-9f71-0236c7527c92 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:37.615224 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bf3eb8ae-36c8-429d-9f71-0236c7527c92 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1466 microversion: 2.1 time: 0.368381 Feb 19 20:59:37.619161 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1213/2346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:37 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1466 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:37.625786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87063c23-96fd-4dff-a42e-0762989f3b73 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64676ef310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:37.706746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-25e2be19-e3ab-424a-a929-bc2f00fde9cb tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:37.722907 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-25e2be19-e3ab-424a-a929-bc2f00fde9cb tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1526 microversion: 2.1 time: 0.247539 Feb 19 20:59:37.732100 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1134/2347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:37 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1526 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:37.737750 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-87063c23-96fd-4dff-a42e-0762989f3b73 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1440 microversion: 2.1 time: 0.117242 Feb 19 20:59:37.739245 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1214/2348] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:37 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1440 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:37.742072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9ca618d6-bcd8-4da2-a6e4-65c57275af31 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1692354473"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:37.743587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9ca618d6-bcd8-4da2-a6e4-65c57275af31 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:37.752983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ca618d6-bcd8-4da2-a6e4-65c57275af31 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:37.754142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ca618d6-bcd8-4da2-a6e4-65c57275af31 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:37.755214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ca618d6-bcd8-4da2-a6e4-65c57275af31 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:37.755861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ca618d6-bcd8-4da2-a6e4-65c57275af31 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:38.126208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:38.127076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:38.128113 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9ca618d6-bcd8-4da2-a6e4-65c57275af31 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "POST /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5/action" status: 202 len: 0 microversion: 2.1 time: 0.389356 Feb 19 20:59:38.129661 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1135/2349] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 20:59:37 2022] POST /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 20:59:38.146562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:38.146988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bf0244b8-f5c1-4361-851d-1083709b04af tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791405e0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:38.147119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:38.147951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:38.148429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:38.237358 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bf0244b8-f5c1-4361-851d-1083709b04af tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.099813 Feb 19 20:59:38.239677 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1136/2350] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:38 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:38.268375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0716a01e-24a6-4b46-8407-7231ef268737 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:38.276097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0716a01e-24a6-4b46-8407-7231ef268737 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:38.290653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0716a01e-24a6-4b46-8407-7231ef268737 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:38.296383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0716a01e-24a6-4b46-8407-7231ef268737 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:38.297582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0716a01e-24a6-4b46-8407-7231ef268737 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:38.298198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0716a01e-24a6-4b46-8407-7231ef268737 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:38.479104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:38.497021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:38.499927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:38.501588 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-397c4a67-b06d-4794-b89c-c03fa01a52f8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1361 microversion: 2.26 time: 0.378973 Feb 19 20:59:38.502729 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1215/2351] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:38 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 20:59:38.590775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0716a01e-24a6-4b46-8407-7231ef268737 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:38.605350 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0716a01e-24a6-4b46-8407-7231ef268737 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1317 microversion: 2.1 time: 0.345140 Feb 19 20:59:38.617121 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1137/2352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:38 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:38.723715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-760f3003-1056-4e1e-83e8-7edc3054d7c8 req-e8a2e660-f3a8-4a08-8866-d546ff7e9117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865e08cc-66df-4714-978b-6a5270911752", "tag": "c8e3499c-127e-4ea3-9777-6c1f44ebdcea"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:38.726997 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:38.726997 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:38.756859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-51808488-9742-4eff-8f7c-d4fcd142b496 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:38.758016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-51808488-9742-4eff-8f7c-d4fcd142b496 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:38.766497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-760f3003-1056-4e1e-83e8-7edc3054d7c8 req-e8a2e660-f3a8-4a08-8866-d546ff7e9117 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:38.768481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-51808488-9742-4eff-8f7c-d4fcd142b496 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:38.769151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-51808488-9742-4eff-8f7c-d4fcd142b496 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:38.770153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-51808488-9742-4eff-8f7c-d4fcd142b496 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:38.770408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-760f3003-1056-4e1e-83e8-7edc3054d7c8 req-e8a2e660-f3a8-4a08-8866-d546ff7e9117 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:38.772500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-51808488-9742-4eff-8f7c-d4fcd142b496 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:38.797067 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-760f3003-1056-4e1e-83e8-7edc3054d7c8 req-e8a2e660-f3a8-4a08-8866-d546ff7e9117 service nova] Creating event network-changed:c8e3499c-127e-4ea3-9777-6c1f44ebdcea for instance 865e08cc-66df-4714-978b-6a5270911752 on nch1-master-1 Feb 19 20:59:38.813585 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-760f3003-1056-4e1e-83e8-7edc3054d7c8 req-e8a2e660-f3a8-4a08-8866-d546ff7e9117 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099769 Feb 19 20:59:38.816438 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1216/2353] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:38.829271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b8779caf-858e-441a-845a-161646d29d62 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f646772b160>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:38.914050 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b8779caf-858e-441a-845a-161646d29d62 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1440 microversion: 2.1 time: 0.096141 Feb 19 20:59:38.914976 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1217/2354] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:38 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:38.928721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c3771f43-d480-4aea-98b0-3bd642edb0c9 req-a882d524-f359-4a35-9811-256c0572c16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25db99dd-04b8-4486-9f09-dbbb9bcaf223", "name": "network-vif-plugged", "status": "completed", "tag": "5973c52c-0226-472a-bd61-7d7925752963"}, {"server_uuid": "865e08cc-66df-4714-978b-6a5270911752", "name": "network-vif-plugged", "status": "completed", "tag": "c8e3499c-127e-4ea3-9777-6c1f44ebdcea"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:38.935441 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:38.935441 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:38.961696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c3771f43-d480-4aea-98b0-3bd642edb0c9 req-a882d524-f359-4a35-9811-256c0572c16a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:38.962732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c3771f43-d480-4aea-98b0-3bd642edb0c9 req-a882d524-f359-4a35-9811-256c0572c16a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:39.003848 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c3771f43-d480-4aea-98b0-3bd642edb0c9 req-a882d524-f359-4a35-9811-256c0572c16a service nova] Creating event network-vif-plugged:5973c52c-0226-472a-bd61-7d7925752963 for instance 25db99dd-04b8-4486-9f09-dbbb9bcaf223 on nch1-master-1 Feb 19 20:59:39.006803 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c3771f43-d480-4aea-98b0-3bd642edb0c9 req-a882d524-f359-4a35-9811-256c0572c16a service nova] Creating event network-vif-plugged:c8e3499c-127e-4ea3-9777-6c1f44ebdcea for instance 865e08cc-66df-4714-978b-6a5270911752 on nch1-master-1 Feb 19 20:59:39.028055 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c3771f43-d480-4aea-98b0-3bd642edb0c9 req-a882d524-f359-4a35-9811-256c0572c16a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.109674 Feb 19 20:59:39.035336 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1218/2355] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:39.254173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-80c35213-2c97-40d8-b8fb-0ef673860658 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f646768f550>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:39.335158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-51808488-9742-4eff-8f7c-d4fcd142b496 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:39.342068 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-80c35213-2c97-40d8-b8fb-0ef673860658 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.093140 Feb 19 20:59:39.345864 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1219/2356] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:39 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:39.355161 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-51808488-9742-4eff-8f7c-d4fcd142b496 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1526 microversion: 2.1 time: 0.609504 Feb 19 20:59:39.356057 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1138/2357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:38 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1526 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:39.523680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:39.524468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:39.586228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:39.586923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:39.588144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:39.588845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:39.623096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7fa117b6-bdb5-4eeb-a213-a88e1d6e7065 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:39.624106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7fa117b6-bdb5-4eeb-a213-a88e1d6e7065 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:39.637947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fa117b6-bdb5-4eeb-a213-a88e1d6e7065 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:39.638769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fa117b6-bdb5-4eeb-a213-a88e1d6e7065 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:39.639784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fa117b6-bdb5-4eeb-a213-a88e1d6e7065 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:39.640569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fa117b6-bdb5-4eeb-a213-a88e1d6e7065 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.238114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:40.272911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:40.274439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:40.275598 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ea7c5c2-a7e9-4554-82bc-cf08a379d59f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1361 microversion: 2.26 time: 0.759717 Feb 19 20:59:40.286826 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1220/2358] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:39 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1361 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:40.291449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-10827eed-92a9-47cf-aa1e-0d4307bbc2f0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6479128280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:40.336193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7fa117b6-bdb5-4eeb-a213-a88e1d6e7065 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:40.353761 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-10827eed-92a9-47cf-aa1e-0d4307bbc2f0 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1440 microversion: 2.1 time: 0.065749 Feb 19 20:59:40.359937 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1221/2359] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:40 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1440 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:40.364508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0fa70afe-aa63-4c71-b977-cbcd70cdfff9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467672820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:40.384568 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7fa117b6-bdb5-4eeb-a213-a88e1d6e7065 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1505 microversion: 2.1 time: 0.753454 Feb 19 20:59:40.390600 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1139/2360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:39 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1505 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:40.416317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9140d44-5f4b-4934-ba19-ad86cd63550b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:40.417101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9140d44-5f4b-4934-ba19-ad86cd63550b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:40.436458 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0fa70afe-aa63-4c71-b977-cbcd70cdfff9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.080612 Feb 19 20:59:40.436937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9140d44-5f4b-4934-ba19-ad86cd63550b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.437667 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1222/2361] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:40 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:40.439520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9140d44-5f4b-4934-ba19-ad86cd63550b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.442420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eff98df3-3945-44f2-adf4-8f90f6687aaa tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:40.442924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eff98df3-3945-44f2-adf4-8f90f6687aaa tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:40.443806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9140d44-5f4b-4934-ba19-ad86cd63550b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.444514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9140d44-5f4b-4934-ba19-ad86cd63550b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.471464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eff98df3-3945-44f2-adf4-8f90f6687aaa tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.471953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eff98df3-3945-44f2-adf4-8f90f6687aaa tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.472801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eff98df3-3945-44f2-adf4-8f90f6687aaa tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.473245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eff98df3-3945-44f2-adf4-8f90f6687aaa tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.533185 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eff98df3-3945-44f2-adf4-8f90f6687aaa tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d/ips" status: 200 len: 108 microversion: 2.1 time: 0.091862 Feb 19 20:59:40.534294 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1223/2362] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 20:59:40 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d/ips => generated 108 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:40.547819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44ea3a19-efe3-4dec-b70e-f82b505c208f tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:40.548759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-44ea3a19-efe3-4dec-b70e-f82b505c208f tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:40.574218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44ea3a19-efe3-4dec-b70e-f82b505c208f tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.575212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44ea3a19-efe3-4dec-b70e-f82b505c208f tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.578706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44ea3a19-efe3-4dec-b70e-f82b505c208f tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.579237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44ea3a19-efe3-4dec-b70e-f82b505c208f tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.630641 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44ea3a19-efe3-4dec-b70e-f82b505c208f tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d/ips" status: 200 len: 108 microversion: 2.1 time: 0.087392 Feb 19 20:59:40.631231 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1224/2363] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 20:59:40 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d/ips => generated 108 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:59:40.647739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0ebd7b49-e611-4cb0-a824-766e6d98bc31 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:40.651369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0ebd7b49-e611-4cb0-a824-766e6d98bc31 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:40.664754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ebd7b49-e611-4cb0-a824-766e6d98bc31 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.665258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ebd7b49-e611-4cb0-a824-766e6d98bc31 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.666081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ebd7b49-e611-4cb0-a824-766e6d98bc31 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.666527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ebd7b49-e611-4cb0-a824-766e6d98bc31 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.732970 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0ebd7b49-e611-4cb0-a824-766e6d98bc31 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d/ips/tempest-ServerAddressesTestJSON-806442681-network" status: 200 len: 93 microversion: 2.1 time: 0.091985 Feb 19 20:59:40.741035 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1225/2364] 10.222.0.30 () {58 vars in 1397 bytes} [Sat Feb 19 20:59:40 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d/ips/tempest-ServerAddressesTestJSON-806442681-network => generated 93 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 20:59:40.757037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e13d4019-8e8c-4d8b-aef4-c55c9c2200c3 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:40.758753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e13d4019-8e8c-4d8b-aef4-c55c9c2200c3 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:40.772932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e13d4019-8e8c-4d8b-aef4-c55c9c2200c3 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.773507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e13d4019-8e8c-4d8b-aef4-c55c9c2200c3 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.774323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e13d4019-8e8c-4d8b-aef4-c55c9c2200c3 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:40.774983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e13d4019-8e8c-4d8b-aef4-c55c9c2200c3 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:40.785030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a9140d44-5f4b-4934-ba19-ad86cd63550b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:40.795674 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9140d44-5f4b-4934-ba19-ad86cd63550b tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1526 microversion: 2.1 time: 0.402151 Feb 19 20:59:40.796262 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1140/2365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:40 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1526 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:40.844594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e13d4019-8e8c-4d8b-aef4-c55c9c2200c3 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:41.060183 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e13d4019-8e8c-4d8b-aef4-c55c9c2200c3 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 204 len: 0 microversion: 2.1 time: 0.313509 Feb 19 20:59:41.061435 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1226/2366] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:59:40 2022] DELETE /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:41.066006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2719e53f-94fd-4fe5-a9f3-505069f1c9ee req-4e3aa283-5798-4724-af3a-2d39f4d2aa46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678cfc25-63c2-4957-8e09-95a21fee7156", "name": "network-vif-deleted", "tag": "bc5b020a-585b-4eec-90c5-2e83ef2c9c96"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:41.069973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0a8c31c-8a84-4ebc-841a-9206d5e3fdc7 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:41.071227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d0a8c31c-8a84-4ebc-841a-9206d5e3fdc7 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:41.071370 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:41.071370 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:41.082593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0a8c31c-8a84-4ebc-841a-9206d5e3fdc7 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.083484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0a8c31c-8a84-4ebc-841a-9206d5e3fdc7 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.084810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0a8c31c-8a84-4ebc-841a-9206d5e3fdc7 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.085435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0a8c31c-8a84-4ebc-841a-9206d5e3fdc7 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.109124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2719e53f-94fd-4fe5-a9f3-505069f1c9ee req-4e3aa283-5798-4724-af3a-2d39f4d2aa46 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.112925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2719e53f-94fd-4fe5-a9f3-505069f1c9ee req-4e3aa283-5798-4724-af3a-2d39f4d2aa46 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.149812 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2719e53f-94fd-4fe5-a9f3-505069f1c9ee req-4e3aa283-5798-4724-af3a-2d39f4d2aa46 service nova] Creating event network-vif-deleted:bc5b020a-585b-4eec-90c5-2e83ef2c9c96 for instance 678cfc25-63c2-4957-8e09-95a21fee7156 on nch2-master-1 Feb 19 20:59:41.168240 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2719e53f-94fd-4fe5-a9f3-505069f1c9ee req-4e3aa283-5798-4724-af3a-2d39f4d2aa46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114200 Feb 19 20:59:41.171434 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1141/2367] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:41.299274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:41.303120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:41.321527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.321900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.324122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.324811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.369612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d0a8c31c-8a84-4ebc-841a-9206d5e3fdc7 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:41.382862 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d0a8c31c-8a84-4ebc-841a-9206d5e3fdc7 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1511 microversion: 2.1 time: 0.317243 Feb 19 20:59:41.384103 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1227/2368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:41 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:41.407592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-afbc630c-19a6-42ce-96bd-633f20d677c4 req-3bc36c37-11dd-47eb-b93e-ca0e553efa3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f8a307-e082-4ac1-b3db-3860b9e66774", "name": "network-vif-unplugged", "status": "completed", "tag": "89832a83-9f4f-4449-b43c-c9fafb143517"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:41.409478 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:41.409478 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:41.422110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-afbc630c-19a6-42ce-96bd-633f20d677c4 req-3bc36c37-11dd-47eb-b93e-ca0e553efa3b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.422901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-afbc630c-19a6-42ce-96bd-633f20d677c4 req-3bc36c37-11dd-47eb-b93e-ca0e553efa3b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.438022 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-afbc630c-19a6-42ce-96bd-633f20d677c4 req-3bc36c37-11dd-47eb-b93e-ca0e553efa3b service nova] Creating event network-vif-unplugged:89832a83-9f4f-4449-b43c-c9fafb143517 for instance 87f8a307-e082-4ac1-b3db-3860b9e66774 on nch1-master-1 Feb 19 20:59:41.446761 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-afbc630c-19a6-42ce-96bd-633f20d677c4 req-3bc36c37-11dd-47eb-b93e-ca0e553efa3b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060835 Feb 19 20:59:41.448144 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1228/2369] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:41.466053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4c4bd6f-46b3-4f8b-90c8-eccff20f4e9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64676b31f0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:41.569213 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e4c4bd6f-46b3-4f8b-90c8-eccff20f4e9a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1440 microversion: 2.1 time: 0.119342 Feb 19 20:59:41.570284 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1229/2370] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:41 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1440 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:41.581518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-12503a10-b3bf-4241-aaa3-75ae7602c69b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676744c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:41.674585 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-12503a10-b3bf-4241-aaa3-75ae7602c69b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.103262 Feb 19 20:59:41.682919 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1230/2371] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:41 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:41.776507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:41.788550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:41.790817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:41.792459 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6af772bd-455b-4abf-a184-995bfdeec3eb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1544 microversion: 2.26 time: 0.500579 Feb 19 20:59:41.797732 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1142/2372] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:41 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1544 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:41.815643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:41.816653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:41.822463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f6479146d30>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:41.829971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.830420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.831206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.831701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.854722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.855453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.857120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:41.866037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.866811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.868839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.869529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.901794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.903152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.928282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.929122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.954086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:41.954977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:41.955180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lazy-loading 'fault' on Instance uuid 678cfc25-63c2-4957-8e09-95a21fee7156 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:41.974382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:42.002445 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b9e20977-9e3f-45a4-a1a2-39d057ea7b6c tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-1874141987" status: 201 len: 0 microversion: 2.26 time: 0.191320 Feb 19 20:59:42.003956 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1143/2373] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Feb 19 20:59:41 2022] PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-1874141987 => generated 0 bytes in 193 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Feb 19 20:59:42.026528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67bb649ed4a840b58f2f081adc27ad48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24560083d7dd474c820b48343b65c206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:42.032571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d86c0a6-3e94-4965-980b-885be00629cb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f6479183ee0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.039643 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-873691b1-c4e7-4146-b87e-ef4a2838b645 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 200 len: 1314 microversion: 2.1 time: 0.229293 Feb 19 20:59:42.046568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d86c0a6-3e94-4965-980b-885be00629cb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.048026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d86c0a6-3e94-4965-980b-885be00629cb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.051374 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1231/2374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:41 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:42.066758 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d86c0a6-3e94-4965-980b-885be00629cb tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-1874141987" status: 204 len: 0 microversion: 2.26 time: 0.057217 Feb 19 20:59:42.067654 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1144/2375] 10.222.0.30 () {60 vars in 1360 bytes} [Sat Feb 19 20:59:42 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-1874141987 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:59:42.077212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f64676b3280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.088424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.089183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.089802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:42.096878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.097453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.098356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.099145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.130218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.130666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.155366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:42.216533 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-42f8ec06-131a-4a80-83ab-59cf69b5da7e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 204 len: 0 microversion: 2.26 time: 0.143780 Feb 19 20:59:42.217751 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1232/2376] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Feb 19 20:59:42 2022] DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:59:42.228077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9e1925e-71ad-4d4b-9c2b-9d1036751fc2 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f647922a0d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.238098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9e1925e-71ad-4d4b-9c2b-9d1036751fc2 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.238572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9e1925e-71ad-4d4b-9c2b-9d1036751fc2 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.249928 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9e1925e-71ad-4d4b-9c2b-9d1036751fc2 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 200 len: 12 microversion: 2.26 time: 0.026504 Feb 19 20:59:42.251157 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1145/2377] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Feb 19 20:59:42 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:42.263438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f646769e3a0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.306580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.308496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.311929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:42.322258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.323167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.324273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.325039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.361083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.361565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.384519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.387326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.400074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-30fd4fc7-caed-476e-b1f2-d5b16d63486a tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.404209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-30fd4fc7-caed-476e-b1f2-d5b16d63486a tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:42.411642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30fd4fc7-caed-476e-b1f2-d5b16d63486a tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.412123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30fd4fc7-caed-476e-b1f2-d5b16d63486a tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.412997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30fd4fc7-caed-476e-b1f2-d5b16d63486a tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.413464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30fd4fc7-caed-476e-b1f2-d5b16d63486a tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.443716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:42.464999 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e3ff00aa-606a-436a-b61d-27cae159ddde tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-433325799" status: 201 len: 0 microversion: 2.26 time: 0.206860 Feb 19 20:59:42.464999 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1233/2378] 10.222.0.30 () {62 vars in 1376 bytes} [Sat Feb 19 20:59:42 2022] PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-433325799 => generated 0 bytes in 208 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Feb 19 20:59:42.474175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8a375fa3-d161-4b10-b8b9-2bb6a6f7dba9 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f64676e9d30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.486938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a375fa3-d161-4b10-b8b9-2bb6a6f7dba9 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.487400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a375fa3-d161-4b10-b8b9-2bb6a6f7dba9 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.499021 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8a375fa3-d161-4b10-b8b9-2bb6a6f7dba9 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 200 len: 35 microversion: 2.26 time: 0.028783 Feb 19 20:59:42.500221 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1234/2379] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Feb 19 20:59:42 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 35 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:42.518154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f6467672940>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.530376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.531047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.531616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:42.538915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.539372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.540174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.540654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.581410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.581868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.614230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:42.633240 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b8b4d903-4a9d-4fb9-a024-b4b2f5d7dad6 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-433325799" status: 204 len: 0 microversion: 2.26 time: 0.122726 Feb 19 20:59:42.634171 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1235/2380] 10.222.0.30 () {60 vars in 1360 bytes} [Sat Feb 19 20:59:42 2022] DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-433325799 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:59:42.634812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-30fd4fc7-caed-476e-b1f2-d5b16d63486a tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:42.644124 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-30fd4fc7-caed-476e-b1f2-d5b16d63486a tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1511 microversion: 2.1 time: 0.247613 Feb 19 20:59:42.644756 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1146/2381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:42 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:42.653772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab223b4e-dd91-4138-b0fd-70da387249b2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64676fe310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.659088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66434dab-ba4c-4d62-a550-5bdd04f31c9b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f64791401f0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.668801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66434dab-ba4c-4d62-a550-5bdd04f31c9b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.669463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66434dab-ba4c-4d62-a550-5bdd04f31c9b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.679435 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-66434dab-ba4c-4d62-a550-5bdd04f31c9b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 200 len: 12 microversion: 2.26 time: 0.024557 Feb 19 20:59:42.686094 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1147/2382] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Feb 19 20:59:42 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:42.690788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b9c998a7-7cae-4ac1-8714-c83c52db6cd3 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791409d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.715831 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab223b4e-dd91-4138-b0fd-70da387249b2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1449 microversion: 2.1 time: 0.080529 Feb 19 20:59:42.723165 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1236/2383] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:42 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1449 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:42.723165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f64676729d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.730797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.731256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.731781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:42.737516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.737961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.738725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.739162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.757344 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b9c998a7-7cae-4ac1-8714-c83c52db6cd3 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.069934 Feb 19 20:59:42.758113 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1148/2384] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:42 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:42.766751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.767204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.768555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-77e8fe84-2852-4fce-b780-0412d69a5367 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64743475e0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.784102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:42.806240 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a4328f6-3e1d-4bbd-a7f8-de1229a8e3ce tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 204 len: 0 microversion: 2.26 time: 0.087562 Feb 19 20:59:42.807235 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1237/2385] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Feb 19 20:59:42 2022] DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:59:42.818435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f64676e9d30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.828560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.829315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.829916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:42.835600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.835891 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-77e8fe84-2852-4fce-b780-0412d69a5367 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 200 len: 1449 microversion: 2.1 time: 0.075879 Feb 19 20:59:42.836472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.836913 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1149/2386] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:42 2022] GET /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 1449 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:42.841935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.842633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.850865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1caa6987-2272-40f2-a9fc-ea243235105b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6479226ca0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.875014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.875533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.887033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.887377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.917594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:42.948410 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-216f11a7-9d6a-4fff-bf42-cac8dbf20e1b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-1661326377" status: 201 len: 0 microversion: 2.26 time: 0.134592 Feb 19 20:59:42.956051 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1238/2387] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Feb 19 20:59:42 2022] PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-1661326377 => generated 0 bytes in 143 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Feb 19 20:59:42.962712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f6467686e50>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:42.976303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.976799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.977437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:42.986680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.987320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:42.988255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:42.988850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.042571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.043196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.066901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.067383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.113352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:43.154077 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e67955fa-977d-4890-8c6e-3c0caa25693d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-1400875628" status: 201 len: 0 microversion: 2.26 time: 0.196399 Feb 19 20:59:43.155510 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1239/2388] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Feb 19 20:59:42 2022] PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-1400875628 => generated 0 bytes in 199 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Feb 19 20:59:43.162139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0325074b-534a-4a90-8d61-0372fd766ac6 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:43.163104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0325074b-534a-4a90-8d61-0372fd766ac6 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] [instance: 678cfc25-63c2-4957-8e09-95a21fee7156] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:43.175128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0325074b-534a-4a90-8d61-0372fd766ac6 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.175585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0325074b-534a-4a90-8d61-0372fd766ac6 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.177132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0325074b-534a-4a90-8d61-0372fd766ac6 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.177930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0325074b-534a-4a90-8d61-0372fd766ac6 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.235550 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0325074b-534a-4a90-8d61-0372fd766ac6 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] HTTP exception thrown: Instance 678cfc25-63c2-4957-8e09-95a21fee7156 could not be found. Feb 19 20:59:43.236362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0325074b-534a-4a90-8d61-0372fd766ac6 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] Returning 404 to user: Instance 678cfc25-63c2-4957-8e09-95a21fee7156 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:43.237555 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0325074b-534a-4a90-8d61-0372fd766ac6 tempest-InstanceActionsNegativeTestJSON-716262759 tempest-InstanceActionsNegativeTestJSON-716262759-project] 10.222.0.30 "GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156" status: 404 len: 111 microversion: 2.1 time: 0.080998 Feb 19 20:59:43.238700 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1240/2389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:43 2022] GET /compute/v2.1/servers/678cfc25-63c2-4957-8e09-95a21fee7156 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:43.260078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f6479141ca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:43.283277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.289458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.290030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:43.299675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.300593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.301843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.302792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.347440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.348712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.378695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:43.414184 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c1177d06-c68a-4700-992b-ad27904d9036 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 204 len: 0 microversion: 2.26 time: 0.174204 Feb 19 20:59:43.422863 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1241/2390] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Feb 19 20:59:43 2022] DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:59:43.430532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7952c81e-f98c-48af-87c1-a74a50c0a8dc tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f6479141dc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:43.463160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7952c81e-f98c-48af-87c1-a74a50c0a8dc tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.463966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7952c81e-f98c-48af-87c1-a74a50c0a8dc tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.490361 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7952c81e-f98c-48af-87c1-a74a50c0a8dc tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 200 len: 12 microversion: 2.26 time: 0.065319 Feb 19 20:59:43.493905 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1242/2391] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Feb 19 20:59:43 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:43.507039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f6467672430>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:43.531684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.532138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.532685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:43.552130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.552754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.556599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.557054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.612168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.613842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.640445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:43.670476 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df2616c1-32bc-4e2c-adae-51f0ce95086f tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 204 len: 0 microversion: 2.26 time: 0.171444 Feb 19 20:59:43.676041 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1243/2392] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Feb 19 20:59:43 2022] DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 19 20:59:43.948281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2a17c8ec-99ae-4d54-800a-139e3031e84b tempest-QuotaClassesAdminTestJSON-1158466044 tempest-QuotaClassesAdminTestJSON-1158466044-project-admin] Calling method '.version_select at 0x7f6479110280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:43.949225 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:43.949225 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:43.963077 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2a17c8ec-99ae-4d54-800a-139e3031e84b tempest-QuotaClassesAdminTestJSON-1158466044 tempest-QuotaClassesAdminTestJSON-1158466044-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.290714 Feb 19 20:59:43.969278 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1244/2393] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Feb 19 20:59:43 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:43.974151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0f052e87-6277-4606-9f98-1c539199cc09 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:43.974777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0f052e87-6277-4606-9f98-1c539199cc09 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:43.982240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f052e87-6277-4606-9f98-1c539199cc09 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.983144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f052e87-6277-4606-9f98-1c539199cc09 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:43.984229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f052e87-6277-4606-9f98-1c539199cc09 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:43.984960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f052e87-6277-4606-9f98-1c539199cc09 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:44.146420 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1caa6987-2272-40f2-a9fc-ea243235105b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 204 len: 0 microversion: 2.1 time: 1.300931 Feb 19 20:59:44.147025 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1150/2394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:42 2022] DELETE /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 0 bytes in 1303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:44.153813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f6479226a60>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:44.163795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:44.164696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:44.165418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:44.177567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:44.178766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:44.179858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:44.180568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:44.215067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:44.216597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:44.232642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:44.234117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:44.265524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:44.296180 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b80cd173-c341-469e-9bfc-15f266fb157b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-605388934" status: 201 len: 0 microversion: 2.26 time: 0.147672 Feb 19 20:59:44.297427 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1151/2395] 10.222.0.30 () {62 vars in 1376 bytes} [Sat Feb 19 20:59:44 2022] PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-605388934 => generated 0 bytes in 149 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Feb 19 20:59:44.315408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cc33bae5-4301-457e-8303-76f0f858eede tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479183b80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:44.387882 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cc33bae5-4301-457e-8303-76f0f858eede tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.082240 Feb 19 20:59:44.396419 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1152/2396] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:44 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:44.403858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb843a99-aef7-4e95-961b-3824c5137af7 tempest-QuotaClassesAdminTestJSON-1158466044 tempest-QuotaClassesAdminTestJSON-1158466044-project-admin] Action: 'update', calling method: .version_select at 0x7f6479140280>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:44.406574 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:44.406574 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:44.990166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0f052e87-6277-4606-9f98-1c539199cc09 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0f3497fc80496499ed3d927823ce0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46068d17334344098e88ad0cc3e0eebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:45.000750 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0f052e87-6277-4606-9f98-1c539199cc09 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 200 len: 1511 microversion: 2.1 time: 1.030312 Feb 19 20:59:45.005589 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1245/2397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:43 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 1511 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:45.011778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b28bb2be-dab6-4114-b0d6-2e8d1b74b744 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:45.014210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b28bb2be-dab6-4114-b0d6-2e8d1b74b744 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:45.024977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b28bb2be-dab6-4114-b0d6-2e8d1b74b744 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.028221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b28bb2be-dab6-4114-b0d6-2e8d1b74b744 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.033945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b28bb2be-dab6-4114-b0d6-2e8d1b74b744 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.034606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b28bb2be-dab6-4114-b0d6-2e8d1b74b744 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.083689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b28bb2be-dab6-4114-b0d6-2e8d1b74b744 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:45.177933 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb843a99-aef7-4e95-961b-3824c5137af7 tempest-QuotaClassesAdminTestJSON-1158466044 tempest-QuotaClassesAdminTestJSON-1158466044-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.779707 Feb 19 20:59:45.180557 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1153/2398] 10.222.0.30 () {60 vars in 1205 bytes} [Sat Feb 19 20:59:44 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:45.186524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f64791451f0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:45.197289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.198134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.199057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:45.213503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.234076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.238829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.239418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.272795 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b28bb2be-dab6-4114-b0d6-2e8d1b74b744 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 204 len: 0 microversion: 2.1 time: 0.265461 Feb 19 20:59:45.273694 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1246/2399] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:59:45 2022] DELETE /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:45.295937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-db9cfcc2-2a73-43ab-8e78-ff303ee109b5 tempest-QuotaClassesAdminTestJSON-1158466044 tempest-QuotaClassesAdminTestJSON-1158466044-project-admin] Calling method '.version_select at 0x7f6479106550>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:45.298509 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:45.298509 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:45.306006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.306799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.319964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.320857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.321652 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-db9cfcc2-2a73-43ab-8e78-ff303ee109b5 tempest-QuotaClassesAdminTestJSON-1158466044 tempest-QuotaClassesAdminTestJSON-1158466044-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.046683 Feb 19 20:59:45.322240 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1247/2400] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Feb 19 20:59:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:45.338939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-85c677c0-f778-4b9c-8ed9-5ee546890f4f tempest-QuotaClassesAdminTestJSON-1158466044 tempest-QuotaClassesAdminTestJSON-1158466044-project-admin] Action: 'update', calling method: .version_select at 0x7f6479106ca0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:45.343887 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:45.343887 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:45.358619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:45.396789 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-044a8171-72c0-412a-9705-8fd29035b7ab tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-338996451" status: 201 len: 0 microversion: 2.26 time: 0.214622 Feb 19 20:59:45.400585 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1154/2401] 10.222.0.30 () {62 vars in 1376 bytes} [Sat Feb 19 20:59:45 2022] PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags/tempest-tag-338996451 => generated 0 bytes in 219 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Feb 19 20:59:45.408195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bd523b5a-244b-411c-94e7-b2e99e3955b5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479140790>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:45.485801 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bd523b5a-244b-411c-94e7-b2e99e3955b5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.084074 Feb 19 20:59:45.486889 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1155/2402] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:45 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:45.499446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Action: 'update_all', calling method: .version_select at 0x7f6479146940>, body: {"tags": ["tempest-tag-1781925588", "tempest-tag-613222976"]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:45.512214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.518425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.519132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:45.535016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.535480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.536309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.536781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.600448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.602801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.650427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:45.655714 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-85c677c0-f778-4b9c-8ed9-5ee546890f4f tempest-QuotaClassesAdminTestJSON-1158466044 tempest-QuotaClassesAdminTestJSON-1158466044-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.320685 Feb 19 20:59:45.657133 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1248/2403] 10.222.0.30 () {60 vars in 1205 bytes} [Sat Feb 19 20:59:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:45.674479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab2981ec-c2a7-4009-9320-6e0d71ddeb08 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:45.682562 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1ee495b8-a727-470b-b73b-61ee378a6708 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 200 len: 61 microversion: 2.26 time: 0.194420 Feb 19 20:59:45.684556 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:45.684556 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:45.691466 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1156/2404] 10.222.0.30 () {62 vars in 1311 bytes} [Sat Feb 19 20:59:45 2022] PUT /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 61 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:45.692246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ab2981ec-c2a7-4009-9320-6e0d71ddeb08 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:45.694000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ab2981ec-c2a7-4009-9320-6e0d71ddeb08 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Searching by: {'deleted': False, 'project_id': '5b11084a5a46488cbb721afa4256a6bd'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:59:45.704896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c60ea3a1-8bff-4b4d-8230-099ab4516159 req-d10bf037-ecce-4e0b-9f51-441a8b2d1be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98bece8-1f3d-4f2a-a0c5-e578fd98011d", "name": "network-vif-deleted", "tag": "34fd2bb6-3818-47f3-b209-1132ddb12acf"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:45.706800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab2981ec-c2a7-4009-9320-6e0d71ddeb08 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.707462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab2981ec-c2a7-4009-9320-6e0d71ddeb08 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.708619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab2981ec-c2a7-4009-9320-6e0d71ddeb08 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.709298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab2981ec-c2a7-4009-9320-6e0d71ddeb08 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.709431 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:45.709431 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:45.729267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c60ea3a1-8bff-4b4d-8230-099ab4516159 req-d10bf037-ecce-4e0b-9f51-441a8b2d1be6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.744576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-ab2981ec-c2a7-4009-9320-6e0d71ddeb08 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:59:45.746983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c60ea3a1-8bff-4b4d-8230-099ab4516159 req-d10bf037-ecce-4e0b-9f51-441a8b2d1be6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.763709 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c60ea3a1-8bff-4b4d-8230-099ab4516159 req-d10bf037-ecce-4e0b-9f51-441a8b2d1be6 service nova] Creating event network-vif-deleted:34fd2bb6-3818-47f3-b209-1132ddb12acf for instance f98bece8-1f3d-4f2a-a0c5-e578fd98011d on nch2-master-1 Feb 19 20:59:45.770146 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c60ea3a1-8bff-4b4d-8230-099ab4516159 req-d10bf037-ecce-4e0b-9f51-441a8b2d1be6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077249 Feb 19 20:59:45.778222 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1157/2405] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:45.783944 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab2981ec-c2a7-4009-9320-6e0d71ddeb08 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.125377 Feb 19 20:59:45.785318 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1249/2406] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 20:59:45 2022] GET /compute/v2.1/servers => generated 339 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:45.787297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1676957536", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "0b77203b-47b2-4bd5-a7b7-432923f05242"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:45.793909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5605fcd-f01c-461b-8214-6907a131779d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f6467753790>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:45.818076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5605fcd-f01c-461b-8214-6907a131779d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.833951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5605fcd-f01c-461b-8214-6907a131779d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.866797 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5605fcd-f01c-461b-8214-6907a131779d tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 200 len: 61 microversion: 2.26 time: 0.079327 Feb 19 20:59:45.877147 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1250/2407] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Feb 19 20:59:45 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 61 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:45.893179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] validate_networks() for [('0b77203b-47b2-4bd5-a7b7-432923f05242', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 20:59:45.894365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:45.906465 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:45.906465 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:45.907592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:45.908376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Searching by: {'deleted': False, 'project_id': '5b11084a5a46488cbb721afa4256a6bd'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 20:59:45.924940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.925531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.926647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:45.928691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:45.983210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 20:59:46.081931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:46.091244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.092042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.423507 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b496a6a4-9d11-443a-8ddb-d09e858ebf5b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.544699 Feb 19 20:59:46.424090 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1251/2408] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 20:59:45 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:46.428729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '.version_select at 0x7f64676b3310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:46.438318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.439077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.448217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:46.462050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.463738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.469684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.470374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.513838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.514811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.558586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'flavor' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:46.586324 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4cc9ea81-e02e-4d4f-84a3-9d9943807d85 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags" status: 204 len: 0 microversion: 2.26 time: 0.160169 Feb 19 20:59:46.588579 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1252/2409] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Feb 19 20:59:46 2022] DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:59:46.595462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f4c15a6-5c04-4273-b1be-506588f2f958 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:46.598019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2f4c15a6-5c04-4273-b1be-506588f2f958 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] [instance: f98bece8-1f3d-4f2a-a0c5-e578fd98011d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:46.616030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f4c15a6-5c04-4273-b1be-506588f2f958 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.616846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f4c15a6-5c04-4273-b1be-506588f2f958 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.619706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f4c15a6-5c04-4273-b1be-506588f2f958 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.620360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f4c15a6-5c04-4273-b1be-506588f2f958 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.678319 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-2f4c15a6-5c04-4273-b1be-506588f2f958 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] HTTP exception thrown: Instance f98bece8-1f3d-4f2a-a0c5-e578fd98011d could not be found. Feb 19 20:59:46.678922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f4c15a6-5c04-4273-b1be-506588f2f958 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] Returning 404 to user: Instance f98bece8-1f3d-4f2a-a0c5-e578fd98011d could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:46.679753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f4c15a6-5c04-4273-b1be-506588f2f958 tempest-ServerAddressesTestJSON-1313360835 tempest-ServerAddressesTestJSON-1313360835-project] 10.222.0.30 "GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d" status: 404 len: 111 microversion: 2.1 time: 0.089987 Feb 19 20:59:46.680301 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1253/2410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:46 2022] GET /compute/v2.1/servers/f98bece8-1f3d-4f2a-a0c5-e578fd98011d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:46.689803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3cff578f-faec-448d-abab-e36643d35271 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:46.706038 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3cff578f-faec-448d-abab-e36643d35271 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020807 Feb 19 20:59:46.706909 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1254/2411] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 20:59:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:46.711304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b2403b1-c9d7-4b7b-92fe-e06a6277501e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64790c0040>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:46.798533 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b2403b1-c9d7-4b7b-92fe-e06a6277501e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.090513 Feb 19 20:59:46.804726 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1255/2412] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:46 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:46.808222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 20:59:46.808762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 20:59:46.809594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6708e48c-d83c-46aa-b870-c0010d7bbf0e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:46.809732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 20:59:46.810081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6708e48c-d83c-46aa-b870-c0010d7bbf0e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:46.810214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 20:59:46.810501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 20:59:46.823053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.824087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.826543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.827665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.829820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6708e48c-d83c-46aa-b870-c0010d7bbf0e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.832565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6708e48c-d83c-46aa-b870-c0010d7bbf0e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.833280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6708e48c-d83c-46aa-b870-c0010d7bbf0e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:46.836304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6708e48c-d83c-46aa-b870-c0010d7bbf0e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:46.850296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Getting quotas for project b959eb07a97740dca63d3cf3d2ed0a63. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 20:59:46.858925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Getting quotas for user 5a3a1e86138d41b991f5e44a1e8ae2eb and project b959eb07a97740dca63d3cf3d2ed0a63. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 20:59:46.883417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 20:59:46.888229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 20:59:46.984176 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1944d0a-4349-42bc-91c4-05c929759437 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.203470 Feb 19 20:59:46.985521 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1158/2413] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:59:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 20:59:46.992356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c666f2dc-f441-495c-b618-333559f79f71 req-753fa4a9-5efa-42f3-b47e-4e8693fbe281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac13892-70a3-4a7f-b7a8-a0cd9169d0b5", "name": "network-vif-plugged", "status": "completed", "tag": "835957bc-cf48-4628-ac6b-011383e9ecd7"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:46.995286 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:46.995286 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:47.006751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c666f2dc-f441-495c-b618-333559f79f71 req-753fa4a9-5efa-42f3-b47e-4e8693fbe281 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:47.007522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c666f2dc-f441-495c-b618-333559f79f71 req-753fa4a9-5efa-42f3-b47e-4e8693fbe281 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:47.024848 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c666f2dc-f441-495c-b618-333559f79f71 req-753fa4a9-5efa-42f3-b47e-4e8693fbe281 service nova] Creating event network-vif-plugged:835957bc-cf48-4628-ac6b-011383e9ecd7 for instance eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 on nch2-master-1 Feb 19 20:59:47.046537 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c666f2dc-f441-495c-b618-333559f79f71 req-753fa4a9-5efa-42f3-b47e-4e8693fbe281 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047314 Feb 19 20:59:47.049798 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1159/2414] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:47.085817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-60d5c215-2417-43c2-b6ae-8e86e9e81e9e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:47.086948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-60d5c215-2417-43c2-b6ae-8e86e9e81e9e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:47.187242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-60d5c215-2417-43c2-b6ae-8e86e9e81e9e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:47.195850 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-60d5c215-2417-43c2-b6ae-8e86e9e81e9e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1208 microversion: 2.1 time: 0.129952 Feb 19 20:59:47.199006 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1160/2415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:47 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:47.206490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-99be10a9-f83f-494b-beb4-214af85a7253 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:47.206922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-99be10a9-f83f-494b-beb4-214af85a7253 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:47.227447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99be10a9-f83f-494b-beb4-214af85a7253 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:47.231023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99be10a9-f83f-494b-beb4-214af85a7253 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:47.234444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99be10a9-f83f-494b-beb4-214af85a7253 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:47.235088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99be10a9-f83f-494b-beb4-214af85a7253 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:47.282027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6708e48c-d83c-46aa-b870-c0010d7bbf0e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:47.306901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-99be10a9-f83f-494b-beb4-214af85a7253 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 20:59:47.448645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6708e48c-d83c-46aa-b870-c0010d7bbf0e tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 204 len: 0 microversion: 2.26 time: 0.642308 Feb 19 20:59:47.450253 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1256/2416] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 20:59:46 2022] DELETE /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 20:59:47.461124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:47.462044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:47.472141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:47.473385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:47.474261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:47.474778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:47.500781 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-99be10a9-f83f-494b-beb4-214af85a7253 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 204 len: 0 microversion: 2.1 time: 0.299022 Feb 19 20:59:47.502258 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1161/2417] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 20:59:47 2022] DELETE /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 20:59:47.710201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-79414ba3-078a-4daf-937b-c41b49072d2d tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-780320589", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:47.712767 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-79414ba3-078a-4daf-937b-c41b49072d2d tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] HTTP exception thrown: min_count must be <= max_count Feb 19 20:59:47.713847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-79414ba3-078a-4daf-937b-c41b49072d2d tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Returning 400 to user: min_count must be <= max_count {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:47.715059 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-79414ba3-078a-4daf-937b-c41b49072d2d tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.211383 Feb 19 20:59:47.727115 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1162/2418] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:59:47 2022] POST /compute/v2.1/servers => generated 74 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 20:59:47.732191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c93fef7b-0b06-41f2-8c33-de40c5ec788b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:47.733728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c93fef7b-0b06-41f2-8c33-de40c5ec788b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:47.741643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c93fef7b-0b06-41f2-8c33-de40c5ec788b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:47.742178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c93fef7b-0b06-41f2-8c33-de40c5ec788b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:47.743050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c93fef7b-0b06-41f2-8c33-de40c5ec788b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:47.743730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c93fef7b-0b06-41f2-8c33-de40c5ec788b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:47.832338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:47.846332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:47.849372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:47.851951 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54b5647c-28a9-4680-aa1e-57f503a3545b tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1550 microversion: 2.26 time: 0.395924 Feb 19 20:59:47.854592 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1257/2419] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:47 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1550 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:47.859829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68f9bd00-d15e-4668-b6cd-12b8bed35a29 tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-613120549", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "max_count": 0}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:47.861663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68f9bd00-d15e-4668-b6cd-12b8bed35a29 tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:47.863218 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-68f9bd00-d15e-4668-b6cd-12b8bed35a29 tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009158 Feb 19 20:59:47.864159 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1258/2420] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:59:47 2022] POST /compute/v2.1/servers => generated 130 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:59:47.878768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-62e7bcb5-b7c4-4417-95cd-4823e167cfb7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f646766eee0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:47.940072 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-62e7bcb5-b7c4-4417-95cd-4823e167cfb7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.069144 Feb 19 20:59:47.945854 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1259/2421] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:47 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:47.945854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6c689c4e-fdd8-4950-92d7-be371d0092c9 tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2084202718", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "max_count": 2.5}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:47.947268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6c689c4e-fdd8-4950-92d7-be371d0092c9 tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:47.948318 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6c689c4e-fdd8-4950-92d7-be371d0092c9 tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006059 Feb 19 20:59:47.949137 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1260/2422] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:59:47 2022] POST /compute/v2.1/servers => generated 139 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:59:48.022950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9c3f6b1c-2b29-4251-90c6-39480e89abed tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-163176248", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "min_count": 0}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:48.025772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9c3f6b1c-2b29-4251-90c6-39480e89abed tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:48.027023 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9c3f6b1c-2b29-4251-90c6-39480e89abed tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013810 Feb 19 20:59:48.029503 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1261/2423] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:59:48 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:59:48.117868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fbeb5b10-afc1-4a6f-863a-621a8ddef677 tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1884180847", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "min_count": 2.5}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:48.120640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fbeb5b10-afc1-4a6f-863a-621a8ddef677 tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:48.123008 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fbeb5b10-afc1-4a6f-863a-621a8ddef677 tempest-MultipleCreateNegativeTestJSON-875453722 tempest-MultipleCreateNegativeTestJSON-875453722-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016683 Feb 19 20:59:48.132434 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1262/2424] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 20:59:48 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:59:48.146224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c93fef7b-0b06-41f2-8c33-de40c5ec788b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:48.153620 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c93fef7b-0b06-41f2-8c33-de40c5ec788b tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1712 microversion: 2.1 time: 0.425324 Feb 19 20:59:48.165088 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1163/2425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:47 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1712 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:48.215601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ebd4d30-0563-468f-af1c-ed890445ca14 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:48.216209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ebd4d30-0563-468f-af1c-ed890445ca14 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:48.232039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ebd4d30-0563-468f-af1c-ed890445ca14 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:48.234245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ebd4d30-0563-468f-af1c-ed890445ca14 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:48.236404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ebd4d30-0563-468f-af1c-ed890445ca14 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:48.239866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ebd4d30-0563-468f-af1c-ed890445ca14 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:48.416905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-0f197785-c9d3-42f6-ae6c-4188e8c5601c req-4e9a14f1-cff5-4b58-bed6-17c45f8cb383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25db99dd-04b8-4486-9f09-dbbb9bcaf223", "name": "network-vif-deleted", "tag": "5973c52c-0226-472a-bd61-7d7925752963"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:48.418745 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:48.418745 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:48.434931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0f197785-c9d3-42f6-ae6c-4188e8c5601c req-4e9a14f1-cff5-4b58-bed6-17c45f8cb383 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:48.435789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0f197785-c9d3-42f6-ae6c-4188e8c5601c req-4e9a14f1-cff5-4b58-bed6-17c45f8cb383 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:48.458951 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-0f197785-c9d3-42f6-ae6c-4188e8c5601c req-4e9a14f1-cff5-4b58-bed6-17c45f8cb383 service nova] Creating event network-vif-deleted:5973c52c-0226-472a-bd61-7d7925752963 for instance 25db99dd-04b8-4486-9f09-dbbb9bcaf223 on nch1-master-1 Feb 19 20:59:48.478626 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-0f197785-c9d3-42f6-ae6c-4188e8c5601c req-4e9a14f1-cff5-4b58-bed6-17c45f8cb383 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065207 Feb 19 20:59:48.479652 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1164/2426] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 20:59:48.491437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ebd4d30-0563-468f-af1c-ed890445ca14 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:48.501843 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ebd4d30-0563-468f-af1c-ed890445ca14 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1260 microversion: 2.1 time: 0.288869 Feb 19 20:59:48.502698 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1263/2427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:48 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:48.871670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:48.872971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:48.884589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:48.885042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:48.885838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:48.886272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:48.953732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5721b44a-3c9c-4fed-8362-dcc80e909e9d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64790c0ca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:49.040453 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5721b44a-3c9c-4fed-8362-dcc80e909e9d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.090676 Feb 19 20:59:49.046493 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1264/2428] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:48 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:49.183527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-67791c5d-8e5e-4bb8-aa49-7ee57fee8adc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:49.184865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-67791c5d-8e5e-4bb8-aa49-7ee57fee8adc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:49.200927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67791c5d-8e5e-4bb8-aa49-7ee57fee8adc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:49.201388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67791c5d-8e5e-4bb8-aa49-7ee57fee8adc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:49.202984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67791c5d-8e5e-4bb8-aa49-7ee57fee8adc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:49.203318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67791c5d-8e5e-4bb8-aa49-7ee57fee8adc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:50.040704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:50.052162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:50.055569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:50.059316 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1f193690-6555-4194-8d47-d5d5065a9d12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1550 microversion: 2.26 time: 1.192009 Feb 19 20:59:50.065399 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1165/2429] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:48 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1550 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:50.086180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-10db7d76-5d34-4c96-bbb3-3095d7de0990 req-4e774325-a6a1-4b16-b04e-4047a689122d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25db99dd-04b8-4486-9f09-dbbb9bcaf223", "name": "network-vif-unplugged", "status": "completed", "tag": "5973c52c-0226-472a-bd61-7d7925752963"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:50.088266 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:50.088266 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:50.111117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-10db7d76-5d34-4c96-bbb3-3095d7de0990 req-4e774325-a6a1-4b16-b04e-4047a689122d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:50.114997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-10db7d76-5d34-4c96-bbb3-3095d7de0990 req-4e774325-a6a1-4b16-b04e-4047a689122d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:50.144286 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-10db7d76-5d34-4c96-bbb3-3095d7de0990 req-4e774325-a6a1-4b16-b04e-4047a689122d service nova] Creating event network-vif-unplugged:5973c52c-0226-472a-bd61-7d7925752963 for instance 25db99dd-04b8-4486-9f09-dbbb9bcaf223 on nch1-master-1 Feb 19 20:59:50.180418 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-10db7d76-5d34-4c96-bbb3-3095d7de0990 req-4e774325-a6a1-4b16-b04e-4047a689122d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112933 Feb 19 20:59:50.184148 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1166/2430] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:50.199773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-05efa61c-cf01-4478-85c1-3055ad53ac39 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:50.205347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-05efa61c-cf01-4478-85c1-3055ad53ac39 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:50.229252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05efa61c-cf01-4478-85c1-3055ad53ac39 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:50.229742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05efa61c-cf01-4478-85c1-3055ad53ac39 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:50.230583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05efa61c-cf01-4478-85c1-3055ad53ac39 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:50.231025 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05efa61c-cf01-4478-85c1-3055ad53ac39 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:51.237533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-67791c5d-8e5e-4bb8-aa49-7ee57fee8adc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:51.253145 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-67791c5d-8e5e-4bb8-aa49-7ee57fee8adc tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1712 microversion: 2.1 time: 2.073158 Feb 19 20:59:51.254869 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1265/2431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:49 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1712 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:51.268088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-889f2562-ea3e-49e6-891f-c421f28b5d83 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479128820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:51.345328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-05efa61c-cf01-4478-85c1-3055ad53ac39 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:51.360993 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-05efa61c-cf01-4478-85c1-3055ad53ac39 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1266 microversion: 2.1 time: 1.175139 Feb 19 20:59:51.361801 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1167/2432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:50 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1266 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:51.375519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:51.376380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:51.388589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:51.389294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:51.391848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:51.393361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:51.413402 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-889f2562-ea3e-49e6-891f-c421f28b5d83 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.156030 Feb 19 20:59:51.414003 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1266/2433] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:51 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:52.044781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:52.060011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:52.063460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:52.066549 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d85fec84-20b7-43a8-b1a9-1f254ec27c12 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1550 microversion: 2.26 time: 0.701703 Feb 19 20:59:52.070190 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1168/2434] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:51 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1550 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:52.271762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7033517a-9eba-4958-b6e9-da3d559d2ecf tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:52.272624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7033517a-9eba-4958-b6e9-da3d559d2ecf tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:52.322516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7033517a-9eba-4958-b6e9-da3d559d2ecf tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:52.322982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7033517a-9eba-4958-b6e9-da3d559d2ecf tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:52.324126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7033517a-9eba-4958-b6e9-da3d559d2ecf tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:52.324612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7033517a-9eba-4958-b6e9-da3d559d2ecf tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:52.377991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-29a6e7b3-b8dd-45f4-b947-51a3ee453960 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:52.379303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-29a6e7b3-b8dd-45f4-b947-51a3ee453960 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:52.391336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29a6e7b3-b8dd-45f4-b947-51a3ee453960 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:52.392104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29a6e7b3-b8dd-45f4-b947-51a3ee453960 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:52.393343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29a6e7b3-b8dd-45f4-b947-51a3ee453960 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:52.397602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29a6e7b3-b8dd-45f4-b947-51a3ee453960 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:52.637616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-29a6e7b3-b8dd-45f4-b947-51a3ee453960 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:52.650935 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-29a6e7b3-b8dd-45f4-b947-51a3ee453960 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1266 microversion: 2.1 time: 0.276800 Feb 19 20:59:52.653545 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1169/2435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:52 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:52.660696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a5646666-ad14-4c0c-a89c-32b91116b3e9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467dbec10>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:52.670861 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7033517a-9eba-4958-b6e9-da3d559d2ecf tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:52.688163 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7033517a-9eba-4958-b6e9-da3d559d2ecf tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1644 microversion: 2.1 time: 0.420537 Feb 19 20:59:52.691135 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1267/2436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:52 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1644 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:52.802565 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a5646666-ad14-4c0c-a89c-32b91116b3e9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.145450 Feb 19 20:59:52.804642 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1170/2437] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:52 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:53.072500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-120772ba-7430-44b3-9fd9-c745f5cb95e8 req-3cf831df-ef41-45d2-b95b-904ac551070b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865e08cc-66df-4714-978b-6a5270911752", "name": "network-vif-deleted", "tag": "c8e3499c-127e-4ea3-9777-6c1f44ebdcea"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:53.077441 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:53.077441 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:53.091532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:53.093195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:53.113877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:53.117926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:53.124253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:53.126457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:53.127409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-120772ba-7430-44b3-9fd9-c745f5cb95e8 req-3cf831df-ef41-45d2-b95b-904ac551070b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:53.128568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-120772ba-7430-44b3-9fd9-c745f5cb95e8 req-3cf831df-ef41-45d2-b95b-904ac551070b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:53.161862 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-120772ba-7430-44b3-9fd9-c745f5cb95e8 req-3cf831df-ef41-45d2-b95b-904ac551070b service nova] Creating event network-vif-deleted:c8e3499c-127e-4ea3-9777-6c1f44ebdcea for instance 865e08cc-66df-4714-978b-6a5270911752 on nch1-master-1 Feb 19 20:59:53.173874 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-120772ba-7430-44b3-9fd9-c745f5cb95e8 req-3cf831df-ef41-45d2-b95b-904ac551070b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108618 Feb 19 20:59:53.177612 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1268/2438] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:53.199078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:53.199869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:53.200672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lazy-loading 'fault' on Instance uuid 865e08cc-66df-4714-978b-6a5270911752 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 20:59:53.308701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:53.327602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:53.330084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae01e28f534446c09c6dfbe2871d36f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea74080450a434fb28f53a0a28d5627', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:53.332119 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ce7b91f-b88a-4407-9b46-b4f12a6ca587 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 200 len: 1351 microversion: 2.26 time: 0.249343 Feb 19 20:59:53.334042 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1171/2439] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:53 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 1351 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 20:59:53.671841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c95b39de-f1f9-4725-87c1-9535714e3e89 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:53.672670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c95b39de-f1f9-4725-87c1-9535714e3e89 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:53.686565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c95b39de-f1f9-4725-87c1-9535714e3e89 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:53.688491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c95b39de-f1f9-4725-87c1-9535714e3e89 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:53.689553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c95b39de-f1f9-4725-87c1-9535714e3e89 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:53.689946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c95b39de-f1f9-4725-87c1-9535714e3e89 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:53.706157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fbb11bb8-fc5d-4a7c-a7c6-da7e764cd066 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:53.708188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fbb11bb8-fc5d-4a7c-a7c6-da7e764cd066 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:53.715893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbb11bb8-fc5d-4a7c-a7c6-da7e764cd066 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:53.716687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbb11bb8-fc5d-4a7c-a7c6-da7e764cd066 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:53.718475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbb11bb8-fc5d-4a7c-a7c6-da7e764cd066 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:53.719121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbb11bb8-fc5d-4a7c-a7c6-da7e764cd066 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:54.094826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fbb11bb8-fc5d-4a7c-a7c6-da7e764cd066 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f88ec14e66c4dafa9aeb5595692a225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11084a5a46488cbb721afa4256a6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:54.107080 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fbb11bb8-fc5d-4a7c-a7c6-da7e764cd066 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 200 len: 1644 microversion: 2.1 time: 0.404523 Feb 19 20:59:54.119332 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1172/2440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:53 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 1644 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:54.132012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-855d5486-ec87-48b1-889d-7c967cb645f0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791594c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:54.223731 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-855d5486-ec87-48b1-889d-7c967cb645f0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.105462 Feb 19 20:59:54.235774 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1173/2441] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:54 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:54.351318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f3d3d5d2-7269-4f1d-9ee7-8db7c843fce8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:54.352295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f3d3d5d2-7269-4f1d-9ee7-8db7c843fce8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] [instance: 865e08cc-66df-4714-978b-6a5270911752] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:54.359667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3d3d5d2-7269-4f1d-9ee7-8db7c843fce8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:54.363585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3d3d5d2-7269-4f1d-9ee7-8db7c843fce8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:54.364761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3d3d5d2-7269-4f1d-9ee7-8db7c843fce8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:54.365445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3d3d5d2-7269-4f1d-9ee7-8db7c843fce8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:54.397683 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f3d3d5d2-7269-4f1d-9ee7-8db7c843fce8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] HTTP exception thrown: Instance 865e08cc-66df-4714-978b-6a5270911752 could not be found. Feb 19 20:59:54.398814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f3d3d5d2-7269-4f1d-9ee7-8db7c843fce8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] Returning 404 to user: Instance 865e08cc-66df-4714-978b-6a5270911752 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:54.399889 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f3d3d5d2-7269-4f1d-9ee7-8db7c843fce8 tempest-ServerTagsTestJSON-612928119 tempest-ServerTagsTestJSON-612928119-project] 10.222.0.30 "GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752" status: 404 len: 111 microversion: 2.26 time: 0.052898 Feb 19 20:59:54.402086 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1174/2442] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 20:59:54 2022] GET /compute/v2.1/servers/865e08cc-66df-4714-978b-6a5270911752 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 20:59:55.041279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c95b39de-f1f9-4725-87c1-9535714e3e89 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:55.054315 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c95b39de-f1f9-4725-87c1-9535714e3e89 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1308 microversion: 2.1 time: 1.387944 Feb 19 20:59:55.054865 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1269/2443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:53 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1308 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:55.133576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-911b6968-ee1d-4cec-85b8-1cdbf83f174d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:55.134827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-911b6968-ee1d-4cec-85b8-1cdbf83f174d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] [instance: 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:55.158262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-911b6968-ee1d-4cec-85b8-1cdbf83f174d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:55.159228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-911b6968-ee1d-4cec-85b8-1cdbf83f174d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:55.160101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-911b6968-ee1d-4cec-85b8-1cdbf83f174d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:55.160576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-911b6968-ee1d-4cec-85b8-1cdbf83f174d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:55.189642 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-911b6968-ee1d-4cec-85b8-1cdbf83f174d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] HTTP exception thrown: Instance 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f could not be found. Feb 19 20:59:55.190169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-911b6968-ee1d-4cec-85b8-1cdbf83f174d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Returning 404 to user: Instance 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 20:59:55.198679 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-911b6968-ee1d-4cec-85b8-1cdbf83f174d tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f" status: 404 len: 111 microversion: 2.1 time: 0.065978 Feb 19 20:59:55.200492 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1175/2444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:55 2022] GET /compute/v2.1/servers/7d83fa58-4a1d-49bf-abb3-565b32fd4b9f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 20:59:55.208903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8de8d8db-cf2c-4c4d-95d0-07a644405504 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] Calling method '.version_select at 0x7f646769e3a0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:55.243494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-96a3db93-74e2-4c60-8d48-e09e78cb6aeb tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467552310>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:55.273514 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8de8d8db-cf2c-4c4d-95d0-07a644405504 tempest-ServersTestManualDisk-1656506787 tempest-ServersTestManualDisk-1656506787-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165546861" status: 202 len: 0 microversion: 2.1 time: 0.067370 Feb 19 20:59:55.276192 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1270/2445] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 20:59:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165546861 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 20:59:55.322758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f4e1548a-2067-4c50-94a6-6d995f9c8e5e req-ced96e8c-4572-4e39-8cd0-fd305a2d44b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d83fa58-4a1d-49bf-abb3-565b32fd4b9f", "name": "network-vif-deleted", "tag": "7227c1a7-5a78-4c8d-9abb-0601b9286874"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:55.324196 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-96a3db93-74e2-4c60-8d48-e09e78cb6aeb tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.083549 Feb 19 20:59:55.324978 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1176/2446] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:55 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 20:59:55.333343 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:55.333343 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 20:59:55.348289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f4e1548a-2067-4c50-94a6-6d995f9c8e5e req-ced96e8c-4572-4e39-8cd0-fd305a2d44b4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:55.351788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f4e1548a-2067-4c50-94a6-6d995f9c8e5e req-ced96e8c-4572-4e39-8cd0-fd305a2d44b4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:55.403686 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f4e1548a-2067-4c50-94a6-6d995f9c8e5e req-ced96e8c-4572-4e39-8cd0-fd305a2d44b4 service nova] Creating event network-vif-deleted:7227c1a7-5a78-4c8d-9abb-0601b9286874 for instance 7d83fa58-4a1d-49bf-abb3-565b32fd4b9f on nch1-master-1 Feb 19 20:59:55.416071 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f4e1548a-2067-4c50-94a6-6d995f9c8e5e req-ced96e8c-4572-4e39-8cd0-fd305a2d44b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102530 Feb 19 20:59:55.417791 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1271/2447] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:56.070802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4007c273-4a9d-42d5-9df4-902098b4ab3c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:56.071417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4007c273-4a9d-42d5-9df4-902098b4ab3c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:56.083940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4007c273-4a9d-42d5-9df4-902098b4ab3c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:56.085106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4007c273-4a9d-42d5-9df4-902098b4ab3c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:56.088913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4007c273-4a9d-42d5-9df4-902098b4ab3c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:56.092924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4007c273-4a9d-42d5-9df4-902098b4ab3c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:56.343341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f9f15869-0808-477e-84a2-3e46deba3aa7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479106820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:56.427321 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f9f15869-0808-477e-84a2-3e46deba3aa7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.091905 Feb 19 20:59:56.446362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1272/2448] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:56 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:57.448366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87d7dcfc-eece-486f-86ca-865c2912e810 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f646769e790>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:57.536860 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-87d7dcfc-eece-486f-86ca-865c2912e810 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.095861 Feb 19 20:59:57.553393 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1273/2449] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:57 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:57.855366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4007c273-4a9d-42d5-9df4-902098b4ab3c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 20:59:57.880966 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4007c273-4a9d-42d5-9df4-902098b4ab3c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1308 microversion: 2.1 time: 1.812705 Feb 19 20:59:57.882068 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1177/2450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:56 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1308 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:58.566715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-55ffb54a-18c3-409a-9876-185c8b39b0bf tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791065e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:58.648000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-55ffb54a-18c3-409a-9876-185c8b39b0bf tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.084711 Feb 19 20:59:58.648626 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1274/2451] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:58 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 20:59:58.856811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8acd4de3-a3d8-4e4f-b0d5-14a79c0b9ee3 req-070f82a9-7ba4-46bb-9202-d583955d0e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26788c55-0376-4c70-af46-b4853592d264", "tag": "689af9d2-853d-4b31-abfa-6ed20c13392b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 20:59:58.859620 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 20:59:58.859620 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 20:59:58.871704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8acd4de3-a3d8-4e4f-b0d5-14a79c0b9ee3 req-070f82a9-7ba4-46bb-9202-d583955d0e0d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:58.871833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8acd4de3-a3d8-4e4f-b0d5-14a79c0b9ee3 req-070f82a9-7ba4-46bb-9202-d583955d0e0d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:58.900974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ebe3d71-7dbe-4ee7-98be-b6ab6611c46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:58.901708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ebe3d71-7dbe-4ee7-98be-b6ab6611c46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 20:59:58.915056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ebe3d71-7dbe-4ee7-98be-b6ab6611c46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:58.915513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ebe3d71-7dbe-4ee7-98be-b6ab6611c46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:58.925397 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8acd4de3-a3d8-4e4f-b0d5-14a79c0b9ee3 req-070f82a9-7ba4-46bb-9202-d583955d0e0d service nova] Creating event network-changed:689af9d2-853d-4b31-abfa-6ed20c13392b for instance 26788c55-0376-4c70-af46-b4853592d264 on nch2-master-1 Feb 19 20:59:58.926621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ebe3d71-7dbe-4ee7-98be-b6ab6611c46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 20:59:58.928010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ebe3d71-7dbe-4ee7-98be-b6ab6611c46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 20:59:58.952377 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8acd4de3-a3d8-4e4f-b0d5-14a79c0b9ee3 req-070f82a9-7ba4-46bb-9202-d583955d0e0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098499 Feb 19 20:59:58.975735 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1178/2452] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 20:59:59.662465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13875078-716e-4037-b1c0-7e4b516ab48c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467546310>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 20:59:59.756054 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13875078-716e-4037-b1c0-7e4b516ab48c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.097820 Feb 19 20:59:59.757782 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1179/2453] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 20:59:59 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:00.400775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ebe3d71-7dbe-4ee7-98be-b6ab6611c46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:00.414240 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ebe3d71-7dbe-4ee7-98be-b6ab6611c46e tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1308 microversion: 2.1 time: 1.517010 Feb 19 21:00:00.428207 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1275/2454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 20:59:58 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1308 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:00.770191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8661a4e8-bf2a-4be9-986a-32b772d68084 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479128670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:00.853847 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8661a4e8-bf2a-4be9-986a-32b772d68084 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.087136 Feb 19 21:00:00.854527 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1276/2455] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:00 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:00.924624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dc643645-84f7-4111-9920-2ef0128f724b tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Action: 'create', calling method: .version_select at 0x7f64791a0550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1132907813"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:01.435457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fabb2483-bbdc-44f9-930c-e535f2bdad45 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:01.437121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fabb2483-bbdc-44f9-930c-e535f2bdad45 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:01.455965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fabb2483-bbdc-44f9-930c-e535f2bdad45 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:01.458935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fabb2483-bbdc-44f9-930c-e535f2bdad45 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:01.459797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fabb2483-bbdc-44f9-930c-e535f2bdad45 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:01.460245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fabb2483-bbdc-44f9-930c-e535f2bdad45 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:01.616680 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dc643645-84f7-4111-9920-2ef0128f724b tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.994811 Feb 19 21:00:01.617851 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1180/2456] 10.222.0.30 () {60 vars in 1154 bytes} [Sat Feb 19 21:00:00 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 997 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 19 21:00:01.630780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-356b8970-6e6b-41cc-9d82-0ebf6445aa83 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f6467c433a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:01.719826 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-356b8970-6e6b-41cc-9d82-0ebf6445aa83 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497" status: 200 len: 338 microversion: 2.1 time: 0.094630 Feb 19 21:00:01.721468 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1181/2457] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:00:01 2022] GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497 => generated 338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:00:01.866820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5195bea7-ae39-4f6a-8e49-6de72f875d7d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467546790>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:01.946681 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5195bea7-ae39-4f6a-8e49-6de72f875d7d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.083310 Feb 19 21:00:01.947310 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1182/2458] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:01 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:02.733882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2ec61d5-7f58-4809-9e6a-45560f419c45 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f647922a4c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:02.807605 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c2ec61d5-7f58-4809-9e6a-45560f419c45 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497" status: 200 len: 339 microversion: 2.1 time: 0.078964 Feb 19 21:00:02.808714 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1183/2459] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:00:02 2022] GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497 => generated 339 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:02.820218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dd6ae480-0711-4861-9646-9ff82511b077 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Action: 'create', calling method: .version_select at 0x7f647915d430>, body: {"snapshot": {"volume_id": "f1132d59-f94e-4586-93d5-288ce89a4497", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1637429843"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:02.903316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fabb2483-bbdc-44f9-930c-e535f2bdad45 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:02.918234 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fabb2483-bbdc-44f9-930c-e535f2bdad45 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1308 microversion: 2.1 time: 1.487003 Feb 19 21:00:02.919392 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1277/2460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:01 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1308 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:02.960462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5da77508-ee0b-4517-9ef1-8ae48f8cd55f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479106430>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:03.043226 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5da77508-ee0b-4517-9ef1-8ae48f8cd55f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.085119 Feb 19 21:00:03.046184 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1278/2461] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:02 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:03.266579 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dd6ae480-0711-4861-9646-9ff82511b077 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.449998 Feb 19 21:00:03.267459 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1184/2462] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Feb 19 21:00:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:03.277509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41c2b45e-a74a-498b-a7de-da9f02d65a35 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f6479106dc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:03.395571 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41c2b45e-a74a-498b-a7de-da9f02d65a35 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2" status: 200 len: 287 microversion: 2.1 time: 0.121816 Feb 19 21:00:03.398244 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1279/2463] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:00:03 2022] GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:03.455917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d9795c50-700b-4a1c-b0f2-e95324ae51f2 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f647915df70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:03.610673 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d9795c50-700b-4a1c-b0f2-e95324ae51f2 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.170255 Feb 19 21:00:03.616519 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1185/2464] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Feb 19 21:00:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:03.626870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b319e65e-7587-44be-967e-077098ae975f tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f646769e040>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:03.733540 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b319e65e-7587-44be-967e-077098ae975f tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2" status: 200 len: 287 microversion: 2.1 time: 0.110595 Feb 19 21:00:03.734948 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1280/2465] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:00:03 2022] GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:03.941370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-85d61b3c-1153-4dfe-ba2e-3e18759b0dbf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:03.942556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-85d61b3c-1153-4dfe-ba2e-3e18759b0dbf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:03.954880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85d61b3c-1153-4dfe-ba2e-3e18759b0dbf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:03.963926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85d61b3c-1153-4dfe-ba2e-3e18759b0dbf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:03.964912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85d61b3c-1153-4dfe-ba2e-3e18759b0dbf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:03.965366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85d61b3c-1153-4dfe-ba2e-3e18759b0dbf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:04.059884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-85c173b5-a3e6-4666-90cf-a8264bef60f8 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676ce310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:04.180582 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-85c173b5-a3e6-4666-90cf-a8264bef60f8 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.125045 Feb 19 21:00:04.182289 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1281/2466] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:04 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:04.745706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96ff4ae5-24b7-4b67-ad8b-d1fefb2fb363 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f64676ef1f0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:04.809719 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96ff4ae5-24b7-4b67-ad8b-d1fefb2fb363 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2" status: 200 len: 288 microversion: 2.1 time: 0.067337 Feb 19 21:00:04.811419 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1282/2467] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:00:04 2022] GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2 => generated 288 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:00:04.822290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a091f0ae-0a9a-4764-a995-15fcfe029e24 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f64676ce8b0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:04.867945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-85d61b3c-1153-4dfe-ba2e-3e18759b0dbf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:04.879726 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-85d61b3c-1153-4dfe-ba2e-3e18759b0dbf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1308 microversion: 2.1 time: 0.940531 Feb 19 21:00:04.880457 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1186/2468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:03 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1308 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:04.934578 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a091f0ae-0a9a-4764-a995-15fcfe029e24 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2" status: 202 len: 0 microversion: 2.1 time: 0.116875 Feb 19 21:00:04.936190 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1283/2469] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 21:00:04 2022] DELETE /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:00:04.946044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b32c070a-1d59-4edc-ac20-65e2bdf24440 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f6467503940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:05.044640 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b32c070a-1d59-4edc-ac20-65e2bdf24440 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2" status: 200 len: 287 microversion: 2.1 time: 0.103529 Feb 19 21:00:05.045667 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1187/2470] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:00:04 2022] GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:05.196801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d018ead5-18be-4fbf-ac19-12451b9445e2 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64790c04c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:05.271476 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d018ead5-18be-4fbf-ac19-12451b9445e2 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.079067 Feb 19 21:00:05.272237 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1284/2471] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:05 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:05.905708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-42495ea7-c376-4539-a0b4-9b0cc21508f7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:05.907051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-42495ea7-c376-4539-a0b4-9b0cc21508f7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:05.917859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42495ea7-c376-4539-a0b4-9b0cc21508f7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:05.921029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42495ea7-c376-4539-a0b4-9b0cc21508f7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:05.922089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42495ea7-c376-4539-a0b4-9b0cc21508f7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:05.925612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42495ea7-c376-4539-a0b4-9b0cc21508f7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:06.056737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e154a41d-268b-4096-a5a9-d344df126dee tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f64676ce5e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:06.108534 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e154a41d-268b-4096-a5a9-d344df126dee tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2" status: 200 len: 287 microversion: 2.1 time: 0.055469 Feb 19 21:00:06.109389 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1285/2472] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:00:06 2022] GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:00:06.286445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2ede45f4-59c0-4d7d-bd4c-4181f4e45ec6 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64790ae280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:06.365359 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2ede45f4-59c0-4d7d-bd4c-4181f4e45ec6 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.083327 Feb 19 21:00:06.368100 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1286/2473] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:06 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:07.119435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98eed4b4-34e0-4665-b175-005804761acf tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f64676ce280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:07.182563 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-98eed4b4-34e0-4665-b175-005804761acf tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] HTTP exception thrown: Snapshot 07399a84-ac61-4690-9afe-73ac81b18aa2 could not be found. Feb 19 21:00:07.182563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98eed4b4-34e0-4665-b175-005804761acf tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Returning 404 to user: Snapshot 07399a84-ac61-4690-9afe-73ac81b18aa2 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:07.182563 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-98eed4b4-34e0-4665-b175-005804761acf tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2" status: 404 len: 111 microversion: 2.1 time: 0.065864 Feb 19 21:00:07.182563 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1287/2474] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:00:07 2022] GET /compute/v2.1/os-snapshots/07399a84-ac61-4690-9afe-73ac81b18aa2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:00:07.294607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-610355180", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:07.397453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] validate_networks() for [('8d71791f-d141-4701-a95a-c6109bae943e', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:00:08.190476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-42495ea7-c376-4539-a0b4-9b0cc21508f7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:08.199543 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-42495ea7-c376-4539-a0b4-9b0cc21508f7 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1308 microversion: 2.1 time: 2.306203 Feb 19 21:00:08.202450 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1188/2475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:05 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1308 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:08.213490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f6467503ee0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:08.355188 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5d86dbf9-3be9-4ea4-aa23-b32a018dca52 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497" status: 202 len: 0 microversion: 2.1 time: 0.151263 Feb 19 21:00:08.355781 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1189/2476] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:00:08 2022] DELETE /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:00:08.360667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2a5e6f9-2694-4629-beb0-958ba58d91af tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479140940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:08.438234 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c2a5e6f9-2694-4629-beb0-958ba58d91af tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.081396 Feb 19 21:00:08.439418 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1190/2477] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:08 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:08.452218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-90e0b8d3-fa60-4175-bc14-682d9ff388be tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f6467546c10>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:08.596017 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-90e0b8d3-fa60-4175-bc14-682d9ff388be tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497" status: 200 len: 338 microversion: 2.1 time: 0.151831 Feb 19 21:00:08.596617 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1191/2478] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:00:08 2022] GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497 => generated 338 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:09.223808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e7cc0610-8fa8-4730-8066-69d5f9d5a635 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:09.224529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e7cc0610-8fa8-4730-8066-69d5f9d5a635 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:09.236664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7cc0610-8fa8-4730-8066-69d5f9d5a635 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:09.237104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7cc0610-8fa8-4730-8066-69d5f9d5a635 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:09.237899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7cc0610-8fa8-4730-8066-69d5f9d5a635 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:09.245193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7cc0610-8fa8-4730-8066-69d5f9d5a635 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:09.547958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:00:09.548567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:00:09.548846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:00:09.549660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:00:09.550255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:00:09.568851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:09.570281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:09.580540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:09.583456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:09.637731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Getting quotas for project c2c91d99923e44a9b49c306044837e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:09.653275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Getting quotas for user e6e829f8edf3477dbc070d33ae8a6613 and project c2c91d99923e44a9b49c306044837e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:09.707012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:00:09.715309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:00:09.749497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e7cc0610-8fa8-4730-8066-69d5f9d5a635 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:09.769198 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e7cc0610-8fa8-4730-8066-69d5f9d5a635 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1308 microversion: 2.1 time: 0.554249 Feb 19 21:00:09.782153 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1192/2479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:09 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:09.800104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2dce09b8-4f87-4289-bd5f-74d00936b9a5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791595e0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:09.838516 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ae713a02-43e4-4543-ac8f-97598f70c7e0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.653170 Feb 19 21:00:09.848906 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1288/2480] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:00:09.859928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-afc12750-d13a-435f-b64c-507c2c49ce0c tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f646764d280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:09.930808 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-afc12750-d13a-435f-b64c-507c2c49ce0c tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] HTTP exception thrown: Volume f1132d59-f94e-4586-93d5-288ce89a4497 could not be found. Feb 19 21:00:09.931949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-afc12750-d13a-435f-b64c-507c2c49ce0c tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Returning 404 to user: Volume f1132d59-f94e-4586-93d5-288ce89a4497 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:09.932827 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-afc12750-d13a-435f-b64c-507c2c49ce0c tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497" status: 404 len: 109 microversion: 2.1 time: 0.082477 Feb 19 21:00:09.933373 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1289/2481] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:00:09 2022] GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:09.936706 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2dce09b8-4f87-4289-bd5f-74d00936b9a5 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.152677 Feb 19 21:00:09.937569 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1193/2482] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:09 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:09.939537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0abcf7e1-5f20-4281-b7dc-84d1b1566183 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:09.940155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0abcf7e1-5f20-4281-b7dc-84d1b1566183 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:09.954529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-890bb27c-2cd1-4e0d-91f9-3d28d093c467 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f64791a0430>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:10.055892 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-890bb27c-2cd1-4e0d-91f9-3d28d093c467 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] HTTP exception thrown: Volume f1132d59-f94e-4586-93d5-288ce89a4497 could not be found. Feb 19 21:00:10.056364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-890bb27c-2cd1-4e0d-91f9-3d28d093c467 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Returning 404 to user: Volume f1132d59-f94e-4586-93d5-288ce89a4497 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:10.057299 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-890bb27c-2cd1-4e0d-91f9-3d28d093c467 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497" status: 404 len: 109 microversion: 2.1 time: 0.117539 Feb 19 21:00:10.057949 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1194/2483] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:00:09 2022] DELETE /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:10.068211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71462550-2f1a-4a39-80d6-0298dad11cc6 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Calling method '.version_select at 0x7f6467d30940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:10.148556 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-71462550-2f1a-4a39-80d6-0298dad11cc6 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] HTTP exception thrown: Volume f1132d59-f94e-4586-93d5-288ce89a4497 could not be found. Feb 19 21:00:10.149371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71462550-2f1a-4a39-80d6-0298dad11cc6 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] Returning 404 to user: Volume f1132d59-f94e-4586-93d5-288ce89a4497 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:10.151265 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71462550-2f1a-4a39-80d6-0298dad11cc6 tempest-VolumesSnapshotsTestJSON-376452767 tempest-VolumesSnapshotsTestJSON-376452767-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497" status: 404 len: 109 microversion: 2.1 time: 0.088443 Feb 19 21:00:10.152466 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1195/2484] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:00:10 2022] GET /compute/v2.1/os-volumes/f1132d59-f94e-4586-93d5-288ce89a4497 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:00:10.279959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0abcf7e1-5f20-4281-b7dc-84d1b1566183 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:10.296431 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0abcf7e1-5f20-4281-b7dc-84d1b1566183 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1221 microversion: 2.1 time: 0.360713 Feb 19 21:00:10.320364 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1290/2485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:09 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1221 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:10.428307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1264480478", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:10.586243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] validate_networks() for [('8d71791f-d141-4701-a95a-c6109bae943e', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:00:10.802922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5b6e5a2e-1b8c-4661-a81f-1e1da932f27c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:10.804292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5b6e5a2e-1b8c-4661-a81f-1e1da932f27c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:10.819693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b6e5a2e-1b8c-4661-a81f-1e1da932f27c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:10.832937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b6e5a2e-1b8c-4661-a81f-1e1da932f27c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:10.834264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b6e5a2e-1b8c-4661-a81f-1e1da932f27c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:10.834815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b6e5a2e-1b8c-4661-a81f-1e1da932f27c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:12.605929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5b6e5a2e-1b8c-4661-a81f-1e1da932f27c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:12.623094 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5b6e5a2e-1b8c-4661-a81f-1e1da932f27c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1308 microversion: 2.1 time: 1.824122 Feb 19 21:00:12.623959 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1291/2486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:10 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1308 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:12.628829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c70e59a9-68c7-4fea-b62f-e29ccf8bb4f7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676ef790>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:12.705301 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c70e59a9-68c7-4fea-b62f-e29ccf8bb4f7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1453 microversion: 2.1 time: 0.079847 Feb 19 21:00:12.705977 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1292/2487] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:12 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:12.961187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1e593221-e21a-45cb-a042-8c7e3e4b4738 req-1bcc1a6a-984c-422c-93c6-bec199eeb71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26788c55-0376-4c70-af46-b4853592d264", "name": "network-vif-plugged", "status": "completed", "tag": "689af9d2-853d-4b31-abfa-6ed20c13392b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:12.962916 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:12.962916 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:00:12.977978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1e593221-e21a-45cb-a042-8c7e3e4b4738 req-1bcc1a6a-984c-422c-93c6-bec199eeb71c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:12.978814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1e593221-e21a-45cb-a042-8c7e3e4b4738 req-1bcc1a6a-984c-422c-93c6-bec199eeb71c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:13.003376 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1e593221-e21a-45cb-a042-8c7e3e4b4738 req-1bcc1a6a-984c-422c-93c6-bec199eeb71c service nova] Creating event network-vif-plugged:689af9d2-853d-4b31-abfa-6ed20c13392b for instance 26788c55-0376-4c70-af46-b4853592d264 on nch2-master-1 Feb 19 21:00:13.049410 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1e593221-e21a-45cb-a042-8c7e3e4b4738 req-1bcc1a6a-984c-422c-93c6-bec199eeb71c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080395 Feb 19 21:00:13.058274 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1293/2488] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:00:13.641057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9a053482-ea8d-444f-8f8b-b43b5a752c80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:13.642770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9a053482-ea8d-444f-8f8b-b43b5a752c80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:13.663041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a053482-ea8d-444f-8f8b-b43b5a752c80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:13.668455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a053482-ea8d-444f-8f8b-b43b5a752c80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:13.669665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a053482-ea8d-444f-8f8b-b43b5a752c80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:13.670867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a053482-ea8d-444f-8f8b-b43b5a752c80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:14.879244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9a053482-ea8d-444f-8f8b-b43b5a752c80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:14.892999 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9a053482-ea8d-444f-8f8b-b43b5a752c80 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1308 microversion: 2.1 time: 1.251853 Feb 19 21:00:14.903092 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1294/2489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:13 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1308 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:14.913757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fc4d3dc7-07ec-4ea0-b2f9-05ea072d1a2c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676ef8b0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:14.991328 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fc4d3dc7-07ec-4ea0-b2f9-05ea072d1a2c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1462 microversion: 2.1 time: 0.086609 Feb 19 21:00:14.997381 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1295/2490] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:14 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:15.010416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f55a9b55-10db-46c3-b92f-8f0bb4274797 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467ed4820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:15.131708 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f55a9b55-10db-46c3-b92f-8f0bb4274797 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 200 len: 1462 microversion: 2.1 time: 0.127052 Feb 19 21:00:15.140550 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1296/2491] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:15 2022] GET /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 1462 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:15.164020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4eb01d7f-d304-4d8a-ae3e-aa8823466b85 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:15.164993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4eb01d7f-d304-4d8a-ae3e-aa8823466b85 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:15.179072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eb01d7f-d304-4d8a-ae3e-aa8823466b85 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:15.179891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eb01d7f-d304-4d8a-ae3e-aa8823466b85 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:15.182081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eb01d7f-d304-4d8a-ae3e-aa8823466b85 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:15.184137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eb01d7f-d304-4d8a-ae3e-aa8823466b85 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:15.257639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:00:15.258294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:00:15.258767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:00:15.259307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:00:15.259881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:00:15.304250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:15.304805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:15.306956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:15.307977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:15.369855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Getting quotas for project c2c91d99923e44a9b49c306044837e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:15.394131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Getting quotas for user e6e829f8edf3477dbc070d33ae8a6613 and project c2c91d99923e44a9b49c306044837e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:15.461706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:00:15.472456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:00:15.692857 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3fcd5dbd-559d-470e-b2a0-62948abd5196 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.279176 Feb 19 21:00:15.694268 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1196/2492] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 5281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:00:15.711551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-276b9774-8af8-42c9-a638-6b776ddbce29 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:15.715418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-276b9774-8af8-42c9-a638-6b776ddbce29 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:15.849998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-276b9774-8af8-42c9-a638-6b776ddbce29 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:15.865425 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-276b9774-8af8-42c9-a638-6b776ddbce29 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1222 microversion: 2.1 time: 0.160360 Feb 19 21:00:15.880655 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1197/2493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:15 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:15.913328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6dda4625-1337-400e-adb4-3a2a77f8cdf9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:15.914393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6dda4625-1337-400e-adb4-3a2a77f8cdf9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:15.952549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6dda4625-1337-400e-adb4-3a2a77f8cdf9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:15.958054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6dda4625-1337-400e-adb4-3a2a77f8cdf9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:15.959204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6dda4625-1337-400e-adb4-3a2a77f8cdf9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:15.960095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6dda4625-1337-400e-adb4-3a2a77f8cdf9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:16.415556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4eb01d7f-d304-4d8a-ae3e-aa8823466b85 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:16.425204 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4eb01d7f-d304-4d8a-ae3e-aa8823466b85 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 200 len: 1467 microversion: 2.1 time: 1.282836 Feb 19 21:00:16.434059 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1297/2494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:15 2022] GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 1467 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:16.452674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c97859dc-9513-47dc-b1dc-80fb48c98933 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467777e50>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:16.670403 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c97859dc-9513-47dc-b1dc-80fb48c98933 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images?changes-since=2022-02-19T20%3A58%3A08Z" status: 200 len: 1901 microversion: 2.1 time: 0.221262 Feb 19 21:00:16.676444 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1298/2495] 10.222.0.30 () {58 vars in 1198 bytes} [Sat Feb 19 21:00:16 2022] GET /compute/v2.1/images?changes-since=2022-02-19T20%3A58%3A08Z => generated 1901 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:16.816378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6dda4625-1337-400e-adb4-3a2a77f8cdf9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:16.828892 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6dda4625-1337-400e-adb4-3a2a77f8cdf9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1486 microversion: 2.1 time: 0.921658 Feb 19 21:00:16.833271 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1198/2496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:15 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1486 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:16.857967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8990a155-4de0-4b85-a8b5-3b582f6c729a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467513550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:17.003782 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8990a155-4de0-4b85-a8b5-3b582f6c729a tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-278447828" status: 200 len: 484 microversion: 2.1 time: 0.169062 Feb 19 21:00:17.004404 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1199/2497] 10.222.0.30 () {58 vars in 1228 bytes} [Sat Feb 19 21:00:16 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-278447828 => generated 484 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:17.018155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a2117f5-12db-41ef-ac2a-1ad4cd2ffe02 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-718663992"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:17.019518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a2117f5-12db-41ef-ac2a-1ad4cd2ffe02 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:17.027779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2117f5-12db-41ef-ac2a-1ad4cd2ffe02 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:17.028533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2117f5-12db-41ef-ac2a-1ad4cd2ffe02 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:17.030032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2117f5-12db-41ef-ac2a-1ad4cd2ffe02 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:17.031273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2117f5-12db-41ef-ac2a-1ad4cd2ffe02 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:17.338995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-78041f6d-c199-4b4c-9e08-42e36f79ddba tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'create', calling method: .version_select at 0x7f646766e670>, body: {"keypair": {"name": "tempest-keypair-1970095653"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:17.385436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-78041f6d-c199-4b4c-9e08-42e36f79ddba tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:17.418588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-78041f6d-c199-4b4c-9e08-42e36f79ddba tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for user fad7207822c04fc289709200d7e2bd2d and project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:17.591361 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a2117f5-12db-41ef-ac2a-1ad4cd2ffe02 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "POST /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264/action" status: 202 len: 0 microversion: 2.1 time: 0.576314 Feb 19 21:00:17.604316 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1200/2498] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:00:17 2022] POST /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 21:00:17.621121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fde4a664-e556-45e1-bf88-56ccc769da3d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:17.623495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fde4a664-e556-45e1-bf88-56ccc769da3d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:17.638147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde4a664-e556-45e1-bf88-56ccc769da3d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:17.645031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde4a664-e556-45e1-bf88-56ccc769da3d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:17.646295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde4a664-e556-45e1-bf88-56ccc769da3d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:17.649108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde4a664-e556-45e1-bf88-56ccc769da3d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:17.907415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-78041f6d-c199-4b4c-9e08-42e36f79ddba tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:17.922572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-78041f6d-c199-4b4c-9e08-42e36f79ddba tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for user fad7207822c04fc289709200d7e2bd2d and project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:17.976944 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-78041f6d-c199-4b4c-9e08-42e36f79ddba tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.298903 Feb 19 21:00:17.978041 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1299/2499] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:00:16 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:17.987506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c908678-d508-4290-9251-1f1833f851aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64677b89d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:18.467416 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c908678-d508-4290-9251-1f1833f851aa tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images?server=eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 200 len: 957 microversion: 2.1 time: 0.486879 Feb 19 21:00:18.474374 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1300/2500] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 21:00:17 2022] GET /compute/v2.1/images?server=eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 957 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:18.485390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a43f3364-b09e-42e3-a288-391a5ad0e527 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64676e5f70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:18.548757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fde4a664-e556-45e1-bf88-56ccc769da3d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:18.560409 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fde4a664-e556-45e1-bf88-56ccc769da3d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1282 microversion: 2.1 time: 0.951216 Feb 19 21:00:18.560605 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a43f3364-b09e-42e3-a288-391a5ad0e527 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e" status: 200 len: 1413 microversion: 2.1 time: 0.084379 Feb 19 21:00:18.561420 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1301/2501] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:18 2022] GET /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:18.573206 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1201/2502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:17 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1282 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:18.575087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd454f6d-dd0d-4ea1-ace1-a3c78168a1eb tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64677b8d30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:18.579306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dfac7764-886d-48cc-a8f5-05f5f690d120 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467555ee0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:18.671894 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd454f6d-dd0d-4ea1-ace1-a3c78168a1eb tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 483 microversion: 2.1 time: 0.108730 Feb 19 21:00:18.672918 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1302/2503] 10.222.0.30 () {58 vars in 1316 bytes} [Sat Feb 19 21:00:18 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 483 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:18.688376 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dfac7764-886d-48cc-a8f5-05f5f690d120 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e" status: 200 len: 1413 microversion: 2.1 time: 0.113970 Feb 19 21:00:18.692014 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1202/2504] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:18 2022] GET /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:18.697831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b903069-bdf9-4d76-9749-38b80eb808a6 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f646766e940>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:18.709015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-53281edd-3495-4735-9ce8-65491ba2f3aa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64675134c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:18.777423 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b903069-bdf9-4d76-9749-38b80eb808a6 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 483 microversion: 2.1 time: 0.090216 Feb 19 21:00:18.778528 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1303/2505] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Feb 19 21:00:18 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 483 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:18.797127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e2093da-7d20-4b14-8dd5-f0cb9d0a158e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467ed43a0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:19.039136 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-53281edd-3495-4735-9ce8-65491ba2f3aa tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e" status: 204 len: 0 microversion: 2.1 time: 0.334151 Feb 19 21:00:19.040345 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1203/2506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:18 2022] DELETE /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:19.045523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-3409cc4e-d69d-43b5-a8f8-3115bba2e899 req-77f02389-146d-4323-bf25-596cbf3583f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac13892-70a3-4a7f-b7a8-a0cd9169d0b5", "name": "network-vif-unplugged", "status": "completed", "tag": "835957bc-cf48-4628-ac6b-011383e9ecd7"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:19.047799 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:19.047799 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:19.089296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3409cc4e-d69d-43b5-a8f8-3115bba2e899 req-77f02389-146d-4323-bf25-596cbf3583f0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:19.089881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3409cc4e-d69d-43b5-a8f8-3115bba2e899 req-77f02389-146d-4323-bf25-596cbf3583f0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:19.150512 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3409cc4e-d69d-43b5-a8f8-3115bba2e899 req-77f02389-146d-4323-bf25-596cbf3583f0 service nova] Creating event network-vif-unplugged:835957bc-cf48-4628-ac6b-011383e9ecd7 for instance eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 on nch2-master-1 Feb 19 21:00:19.153438 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5e2093da-7d20-4b14-8dd5-f0cb9d0a158e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.363214 Feb 19 21:00:19.156472 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1304/2507] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 21:00:18 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:19.173378 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-3409cc4e-d69d-43b5-a8f8-3115bba2e899 req-77f02389-146d-4323-bf25-596cbf3583f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129392 Feb 19 21:00:19.176091 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1204/2508] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:19.178732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0b3a4311-443d-4f2b-a439-4236b90afcb4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f646766e040>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:19.190515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5dfabd8-ff54-4a60-a1f8-d2e67db70c71 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467546280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:19.267008 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0b3a4311-443d-4f2b-a439-4236b90afcb4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Image not found. Feb 19 21:00:19.268071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0b3a4311-443d-4f2b-a439-4236b90afcb4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:19.275625 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0b3a4311-443d-4f2b-a439-4236b90afcb4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e" status: 404 len: 62 microversion: 2.1 time: 0.111839 Feb 19 21:00:19.276854 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1305/2509] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:19 2022] GET /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:19.297241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2372ef21-7e51-439a-82cf-354d0ac3dca9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:19.298548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2372ef21-7e51-439a-82cf-354d0ac3dca9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:19.325644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2372ef21-7e51-439a-82cf-354d0ac3dca9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:19.326898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2372ef21-7e51-439a-82cf-354d0ac3dca9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:19.329875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2372ef21-7e51-439a-82cf-354d0ac3dca9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:19.331503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2372ef21-7e51-439a-82cf-354d0ac3dca9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:19.472388 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b5dfabd8-ff54-4a60-a1f8-d2e67db70c71 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.296831 Feb 19 21:00:19.473209 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1205/2510] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 21:00:19 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:19.492012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-537a2c44-c750-4987-9189-384e2011a538 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791594c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:19.575310 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-537a2c44-c750-4987-9189-384e2011a538 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.091661 Feb 19 21:00:19.578119 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1206/2511] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 21:00:19 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:19.592897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-16d50359-e8e3-4009-9bf7-620d497cfcce tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:19.595058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-16d50359-e8e3-4009-9bf7-620d497cfcce tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:19.616407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16d50359-e8e3-4009-9bf7-620d497cfcce tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:19.618759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16d50359-e8e3-4009-9bf7-620d497cfcce tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:19.621635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16d50359-e8e3-4009-9bf7-620d497cfcce tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:19.624276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16d50359-e8e3-4009-9bf7-620d497cfcce tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:19.833760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-16d50359-e8e3-4009-9bf7-620d497cfcce tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:19.853293 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-16d50359-e8e3-4009-9bf7-620d497cfcce tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1280 microversion: 2.1 time: 0.272532 Feb 19 21:00:19.856084 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1207/2512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:19 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:19.874760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad202f09-1013-454f-8fb0-484301016842 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64675133a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:20.042096 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad202f09-1013-454f-8fb0-484301016842 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/detail?changes-since=2022-02-19T20%3A58%3A03Z" status: 200 len: 6325 microversion: 2.1 time: 0.183575 Feb 19 21:00:20.056236 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1208/2513] 10.222.0.30 () {58 vars in 1219 bytes} [Sat Feb 19 21:00:19 2022] GET /compute/v2.1/images/detail?changes-since=2022-02-19T20%3A58%3A03Z => generated 6325 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:20.249328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-04d3cc9e-8c6b-4fbf-8419-b9f8b29a9a19 tempest-FloatingIPDetailsNegativeTestJSON-1216080724 tempest-FloatingIPDetailsNegativeTestJSON-1216080724-project] Calling method '.version_select at 0x7f6467503b80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:20.367448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-04d3cc9e-8c6b-4fbf-8419-b9f8b29a9a19 tempest-FloatingIPDetailsNegativeTestJSON-1216080724 tempest-FloatingIPDetailsNegativeTestJSON-1216080724-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ee6ce5e9-f8da-43b4-9ecd-ccf05a0c361d could not be found", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:00:20.369283 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-04d3cc9e-8c6b-4fbf-8419-b9f8b29a9a19 tempest-FloatingIPDetailsNegativeTestJSON-1216080724 tempest-FloatingIPDetailsNegativeTestJSON-1216080724-project] HTTP exception thrown: Floating IP not found for ID ee6ce5e9-f8da-43b4-9ecd-ccf05a0c361d Feb 19 21:00:20.370261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-04d3cc9e-8c6b-4fbf-8419-b9f8b29a9a19 tempest-FloatingIPDetailsNegativeTestJSON-1216080724 tempest-FloatingIPDetailsNegativeTestJSON-1216080724-project] Returning 404 to user: Floating IP not found for ID ee6ce5e9-f8da-43b4-9ecd-ccf05a0c361d {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:20.371558 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-04d3cc9e-8c6b-4fbf-8419-b9f8b29a9a19 tempest-FloatingIPDetailsNegativeTestJSON-1216080724 tempest-FloatingIPDetailsNegativeTestJSON-1216080724-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/ee6ce5e9-f8da-43b4-9ecd-ccf05a0c361d" status: 404 len: 111 microversion: 2.1 time: 0.313648 Feb 19 21:00:20.372804 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1209/2514] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Feb 19 21:00:20 2022] GET /compute/v2.1/os-floating-ips/ee6ce5e9-f8da-43b4-9ecd-ccf05a0c361d => generated 111 bytes in 315 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:20.381807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b39b01ea-12a1-4a8a-b8e6-bbd0c011f13e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479159280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:20.526708 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b39b01ea-12a1-4a8a-b8e6-bbd0c011f13e tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-278447828" status: 200 len: 664 microversion: 2.1 time: 0.149660 Feb 19 21:00:20.536680 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1210/2515] 10.222.0.30 () {58 vars in 1249 bytes} [Sat Feb 19 21:00:20 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-278447828 => generated 664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:20.542172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-01cb54d4-d597-444f-80b6-92e5280bcac2 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64675133a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:20.622143 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-01cb54d4-d597-444f-80b6-92e5280bcac2 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1463 microversion: 2.1 time: 0.083967 Feb 19 21:00:20.626834 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1211/2516] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Feb 19 21:00:20 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1463 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:20.635197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7161ab6e-1944-47ed-82a8-bdd77e4bb5dc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467546040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:20.675414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2372ef21-7e51-439a-82cf-354d0ac3dca9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:20.688674 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2372ef21-7e51-439a-82cf-354d0ac3dca9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1498 microversion: 2.1 time: 1.401863 Feb 19 21:00:20.702062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1306/2517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:19 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1498 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:20.721377 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7161ab6e-1944-47ed-82a8-bdd77e4bb5dc tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1463 microversion: 2.1 time: 0.089678 Feb 19 21:00:20.722009 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1212/2518] 10.222.0.30 () {58 vars in 1323 bytes} [Sat Feb 19 21:00:20 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1463 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:20.736941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d705e311-415b-44aa-9f78-caf7e717bfb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676ce8b0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:20.873502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-74d4c832-8e9c-4474-a259-8a31710add0f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:20.874216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-74d4c832-8e9c-4474-a259-8a31710add0f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:20.882242 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d705e311-415b-44aa-9f78-caf7e717bfb0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.150689 Feb 19 21:00:20.883762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74d4c832-8e9c-4474-a259-8a31710add0f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:20.885535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74d4c832-8e9c-4474-a259-8a31710add0f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:20.887405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74d4c832-8e9c-4474-a259-8a31710add0f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:20.887977 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1307/2519] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Feb 19 21:00:20 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:20.889410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74d4c832-8e9c-4474-a259-8a31710add0f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:20.906239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-054284f5-c457-4e1e-8aba-2668f0f2793d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6479106dc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:21.010365 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-054284f5-c457-4e1e-8aba-2668f0f2793d tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.109324 Feb 19 21:00:21.011248 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1308/2520] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Feb 19 21:00:20 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:21.024216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d92f0ea5-033e-400c-a1c7-6b4a1ff74753 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676ce820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:21.084877 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d92f0ea5-033e-400c-a1c7-6b4a1ff74753 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/f75529b9-2911-475e-b974-4af06053c17c" status: 200 len: 784 microversion: 2.1 time: 0.064404 Feb 19 21:00:21.086149 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1309/2521] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:00:21 2022] GET /compute/v2.1/images/f75529b9-2911-475e-b974-4af06053c17c => generated 784 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:00:21.100578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f0e486a-2aad-4c10-b3dd-a24941c652ae tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467686700>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:21.167512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f0e486a-2aad-4c10-b3dd-a24941c652ae tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.070375 Feb 19 21:00:21.168912 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1310/2522] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 21:00:21 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:21.183763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7d2b741d-6130-45ef-865b-056a326da445 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f6467ed4160>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:21.696754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-74d4c832-8e9c-4474-a259-8a31710add0f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:21.730174 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-74d4c832-8e9c-4474-a259-8a31710add0f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1322 microversion: 2.1 time: 0.860452 Feb 19 21:00:21.741517 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1213/2523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:20 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1322 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:21.749338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-152f22ca-9d35-48e3-8741-fb71c5ed2bdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:21.754478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-152f22ca-9d35-48e3-8741-fb71c5ed2bdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:21.782536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-152f22ca-9d35-48e3-8741-fb71c5ed2bdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:21.785672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-152f22ca-9d35-48e3-8741-fb71c5ed2bdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:21.789126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-152f22ca-9d35-48e3-8741-fb71c5ed2bdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:21.790360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-152f22ca-9d35-48e3-8741-fb71c5ed2bdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:23.264635 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7d2b741d-6130-45ef-865b-056a326da445 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "DELETE /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084" status: 204 len: 0 microversion: 2.1 time: 2.086096 Feb 19 21:00:23.265323 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1311/2524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:21 2022] DELETE /compute/v2.1/images/8915f52f-a1b6-439c-8220-c45acbff7084 => generated 0 bytes in 2088 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:23.272399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4b0aa43f-569a-404b-a7cd-591100ba57bf req-2fad0a4a-91fb-41be-a4dc-286ca1938eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df03445-3277-48bd-be5b-c8503c33714d", "tag": "7c930953-29d6-4047-8f78-0d1f65f29d0b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:23.274567 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:23.274567 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:00:23.331473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4b0aa43f-569a-404b-a7cd-591100ba57bf req-2fad0a4a-91fb-41be-a4dc-286ca1938eeb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:23.336672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4b0aa43f-569a-404b-a7cd-591100ba57bf req-2fad0a4a-91fb-41be-a4dc-286ca1938eeb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:23.405336 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4b0aa43f-569a-404b-a7cd-591100ba57bf req-2fad0a4a-91fb-41be-a4dc-286ca1938eeb service nova] Creating event network-changed:7c930953-29d6-4047-8f78-0d1f65f29d0b for instance 2df03445-3277-48bd-be5b-c8503c33714d on nch1-master-1 Feb 19 21:00:23.439522 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4b0aa43f-569a-404b-a7cd-591100ba57bf req-2fad0a4a-91fb-41be-a4dc-286ca1938eeb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172603 Feb 19 21:00:23.448257 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1312/2525] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:23.470268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1169002752", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10d49579-ce64-4d24-a5f5-a01170b84f25"}], "security_groups": [{"name": "tempest-securitygroup--1603684618"}], "key_name": "tempest-keypair-1970095653", "user_data": "}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:23.621703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-152f22ca-9d35-48e3-8741-fb71c5ed2bdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:23.630079 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-152f22ca-9d35-48e3-8741-fb71c5ed2bdf tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1504 microversion: 2.1 time: 1.887087 Feb 19 21:00:23.630658 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1214/2526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:21 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1504 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:23.657133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-39b74774-0d5a-4bff-a0cb-63b2de4be65f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:23.659743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-39b74774-0d5a-4bff-a0cb-63b2de4be65f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:23.677212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39b74774-0d5a-4bff-a0cb-63b2de4be65f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:23.693698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39b74774-0d5a-4bff-a0cb-63b2de4be65f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:23.695837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39b74774-0d5a-4bff-a0cb-63b2de4be65f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:23.700440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39b74774-0d5a-4bff-a0cb-63b2de4be65f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:24.348074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] validate_networks() for [('10d49579-ce64-4d24-a5f5-a01170b84f25', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:00:24.457664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-39b74774-0d5a-4bff-a0cb-63b2de4be65f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:24.465708 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-39b74774-0d5a-4bff-a0cb-63b2de4be65f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1322 microversion: 2.1 time: 0.824288 Feb 19 21:00:24.466305 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1215/2527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:23 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1322 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:24.482147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d4d3617-4f9e-4ab9-828c-2121f62552c6 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f647915d280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:26.287663 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d4d3617-4f9e-4ab9-828c-2121f62552c6 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "DELETE /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7" status: 204 len: 0 microversion: 2.1 time: 1.808758 Feb 19 21:00:26.289483 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1216/2528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:24 2022] DELETE /compute/v2.1/images/56c14ca2-4c52-4785-87ec-a7a2212113d7 => generated 0 bytes in 1822 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:26.297492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5cf85fd7-2423-4603-a29c-0db794afb61a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:26.298441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5cf85fd7-2423-4603-a29c-0db794afb61a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:26.329928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cf85fd7-2423-4603-a29c-0db794afb61a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:26.330553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cf85fd7-2423-4603-a29c-0db794afb61a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:26.331507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cf85fd7-2423-4603-a29c-0db794afb61a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:26.332050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cf85fd7-2423-4603-a29c-0db794afb61a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:27.653291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:00:27.654831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:00:27.656065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:00:27.656737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:00:27.657606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:00:27.676755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:27.677770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:27.681682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:27.682412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:27.730572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:27.746177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for user fad7207822c04fc289709200d7e2bd2d and project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:27.781816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:00:27.784914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:00:27.867365 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1a6bc0c0-2f47-4385-ac89-2ca9b3123037 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.413261 Feb 19 21:00:27.868400 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1313/2529] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 4417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:00:28.093267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5cf85fd7-2423-4603-a29c-0db794afb61a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:28.104843 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5cf85fd7-2423-4603-a29c-0db794afb61a tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1486 microversion: 2.1 time: 1.811496 Feb 19 21:00:28.110286 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1217/2530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:26 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1486 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:28.116184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a76dcb1d-c85a-4718-91b0-18573b494297 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:28.117075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a76dcb1d-c85a-4718-91b0-18573b494297 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:28.126500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a76dcb1d-c85a-4718-91b0-18573b494297 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:28.127674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a76dcb1d-c85a-4718-91b0-18573b494297 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:28.128719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a76dcb1d-c85a-4718-91b0-18573b494297 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:28.130193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a76dcb1d-c85a-4718-91b0-18573b494297 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:28.378621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-339915089", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "7bfee3f1-aa1f-482a-be0c-a77ae359bd88"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:28.496508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] validate_networks() for [('7bfee3f1-aa1f-482a-be0c-a77ae359bd88', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:00:28.751206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a76dcb1d-c85a-4718-91b0-18573b494297 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:28.773645 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a76dcb1d-c85a-4718-91b0-18573b494297 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1322 microversion: 2.1 time: 0.661092 Feb 19 21:00:28.777112 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1218/2531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:28 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:28.796718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0e06709d-7cfd-4d52-a17a-b8022209e151 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f647915ddc0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:29.900772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:00:29.901253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:00:29.901574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:00:29.902093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:00:29.902622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:00:29.920997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:29.921799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:29.922823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:29.924055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:29.964485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Getting quotas for project a72053a62e744590945ce7fd8a1f33ae. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:30.002378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Getting quotas for user 7e219f40a5174a76a7ae73622dafbbd9 and project a72053a62e744590945ce7fd8a1f33ae. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:30.075654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:00:30.085125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:00:30.236885 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e1e327eb-19a7-4681-b096-125f3c96ce87 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.363838 Feb 19 21:00:30.238670 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1314/2532] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:00:30.249073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0b60a60e-e7f5-4a54-94c6-93dca4070d78 req-e3cef169-9098-4235-9f0a-2b3aa859219d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95227559-6479-49fb-8e4b-4b3d7cf582c9", "tag": "ff12d8e1-9359-4461-ae10-7ce54f84b0e6"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:30.252609 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:30.252609 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:00:30.290898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0b60a60e-e7f5-4a54-94c6-93dca4070d78 req-e3cef169-9098-4235-9f0a-2b3aa859219d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:30.294735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0b60a60e-e7f5-4a54-94c6-93dca4070d78 req-e3cef169-9098-4235-9f0a-2b3aa859219d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:30.334448 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0e06709d-7cfd-4d52-a17a-b8022209e151 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "DELETE /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838" status: 204 len: 0 microversion: 2.1 time: 1.554911 Feb 19 21:00:30.335935 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1219/2533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:28 2022] DELETE /compute/v2.1/images/65a867d9-33b6-4a12-9a3b-e1edaf678838 => generated 0 bytes in 1558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:30.342891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cf3f53c5-8627-449a-a1f3-5f768c9b7252 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:30.343923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cf3f53c5-8627-449a-a1f3-5f768c9b7252 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:30.347729 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0b60a60e-e7f5-4a54-94c6-93dca4070d78 req-e3cef169-9098-4235-9f0a-2b3aa859219d service nova] Creating event network-changed:ff12d8e1-9359-4461-ae10-7ce54f84b0e6 for instance 95227559-6479-49fb-8e4b-4b3d7cf582c9 on nch1-master-1 Feb 19 21:00:30.357887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf3f53c5-8627-449a-a1f3-5f768c9b7252 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:30.360799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf3f53c5-8627-449a-a1f3-5f768c9b7252 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:30.362001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf3f53c5-8627-449a-a1f3-5f768c9b7252 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:30.363532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf3f53c5-8627-449a-a1f3-5f768c9b7252 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:30.365035 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0b60a60e-e7f5-4a54-94c6-93dca4070d78 req-e3cef169-9098-4235-9f0a-2b3aa859219d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122427 Feb 19 21:00:30.365835 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1315/2534] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:30.385839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-90e84b2f-d546-4265-a1ee-d35a668c4e9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:30.389143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-90e84b2f-d546-4265-a1ee-d35a668c4e9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:30.407948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90e84b2f-d546-4265-a1ee-d35a668c4e9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:30.408436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90e84b2f-d546-4265-a1ee-d35a668c4e9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:30.411112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90e84b2f-d546-4265-a1ee-d35a668c4e9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:30.411484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90e84b2f-d546-4265-a1ee-d35a668c4e9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:30.523142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-90e84b2f-d546-4265-a1ee-d35a668c4e9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:00:30.652037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf3f53c5-8627-449a-a1f3-5f768c9b7252 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:30.664956 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cf3f53c5-8627-449a-a1f3-5f768c9b7252 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1299 microversion: 2.1 time: 0.327623 Feb 19 21:00:30.668027 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1220/2535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:30 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1299 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:30.679215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c0abc375-1afb-4e94-afd7-1f7223a88e4b req-f374c65e-9579-4e49-b66f-d65325b1a732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26788c55-0376-4c70-af46-b4853592d264", "name": "network-vif-plugged", "status": "completed", "tag": "689af9d2-853d-4b31-abfa-6ed20c13392b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:30.681157 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:30.681157 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:30.691353 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c0abc375-1afb-4e94-afd7-1f7223a88e4b req-f374c65e-9579-4e49-b66f-d65325b1a732 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:30.692837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c0abc375-1afb-4e94-afd7-1f7223a88e4b req-f374c65e-9579-4e49-b66f-d65325b1a732 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:30.733133 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c0abc375-1afb-4e94-afd7-1f7223a88e4b req-f374c65e-9579-4e49-b66f-d65325b1a732 service nova] Creating event network-vif-plugged:689af9d2-853d-4b31-abfa-6ed20c13392b for instance 26788c55-0376-4c70-af46-b4853592d264 on nch2-master-1 Feb 19 21:00:30.744878 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c0abc375-1afb-4e94-afd7-1f7223a88e4b req-f374c65e-9579-4e49-b66f-d65325b1a732 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067946 Feb 19 21:00:30.747668 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1221/2536] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:30.754718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5db57dd0-e3a8-4e52-9fd6-7f608ec89e88 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:30.758073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5db57dd0-e3a8-4e52-9fd6-7f608ec89e88 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:30.760362 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-90e84b2f-d546-4265-a1ee-d35a668c4e9c tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 204 len: 0 microversion: 2.1 time: 0.392106 Feb 19 21:00:30.761713 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1316/2537] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:00:30 2022] DELETE /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:30.779578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ae66bee0-aa6a-49b9-92b8-0099f411aeca tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:30.782319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5db57dd0-e3a8-4e52-9fd6-7f608ec89e88 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:30.783249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5db57dd0-e3a8-4e52-9fd6-7f608ec89e88 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:30.783497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae66bee0-aa6a-49b9-92b8-0099f411aeca tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:30.784529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5db57dd0-e3a8-4e52-9fd6-7f608ec89e88 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:30.785255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5db57dd0-e3a8-4e52-9fd6-7f608ec89e88 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:31.059290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ae66bee0-aa6a-49b9-92b8-0099f411aeca tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:31.071534 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ae66bee0-aa6a-49b9-92b8-0099f411aeca tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1224 microversion: 2.1 time: 0.308283 Feb 19 21:00:31.085019 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1317/2538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:30 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1224 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:31.095901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83bb839f-9da1-4dae-9b8e-c632cfea5529 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:31.118303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83bb839f-9da1-4dae-9b8e-c632cfea5529 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:31.146201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83bb839f-9da1-4dae-9b8e-c632cfea5529 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:31.149183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83bb839f-9da1-4dae-9b8e-c632cfea5529 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:31.150156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83bb839f-9da1-4dae-9b8e-c632cfea5529 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:31.160762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83bb839f-9da1-4dae-9b8e-c632cfea5529 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:31.238168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83bb839f-9da1-4dae-9b8e-c632cfea5529 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:00:31.413155 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83bb839f-9da1-4dae-9b8e-c632cfea5529 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "DELETE /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 204 len: 0 microversion: 2.1 time: 0.326546 Feb 19 21:00:31.414363 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1318/2539] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:00:31 2022] DELETE /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:31.421409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aa3658f3-9128-4e96-b8da-5121450d1674 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64790aeca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:31.485541 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-aa3658f3-9128-4e96-b8da-5121450d1674 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Image not found. Feb 19 21:00:31.486218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aa3658f3-9128-4e96-b8da-5121450d1674 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:31.487131 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aa3658f3-9128-4e96-b8da-5121450d1674 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e" status: 404 len: 62 microversion: 2.1 time: 0.071893 Feb 19 21:00:31.487877 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1319/2540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:31 2022] DELETE /compute/v2.1/images/68e23c62-61b5-4bf2-ba22-c8df1fed255e => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:31.493009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0fc3f781-922c-4aa6-8ab1-6ceb66568f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:31.512113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0fc3f781-922c-4aa6-8ab1-6ceb66568f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:31.541616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fc3f781-922c-4aa6-8ab1-6ceb66568f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:31.542165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fc3f781-922c-4aa6-8ab1-6ceb66568f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:31.552536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fc3f781-922c-4aa6-8ab1-6ceb66568f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:31.553074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fc3f781-922c-4aa6-8ab1-6ceb66568f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:31.847249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5db57dd0-e3a8-4e52-9fd6-7f608ec89e88 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:31.864884 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5db57dd0-e3a8-4e52-9fd6-7f608ec89e88 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1322 microversion: 2.1 time: 1.113752 Feb 19 21:00:31.866254 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1222/2541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:30 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1322 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:31.881315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-377df6d4-b9d4-423b-a315-5fc427fe129d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:31.883241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-377df6d4-b9d4-423b-a315-5fc427fe129d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:31.897970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377df6d4-b9d4-423b-a315-5fc427fe129d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:31.899271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377df6d4-b9d4-423b-a315-5fc427fe129d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:31.901156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377df6d4-b9d4-423b-a315-5fc427fe129d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:31.901994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377df6d4-b9d4-423b-a315-5fc427fe129d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:31.971039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-377df6d4-b9d4-423b-a315-5fc427fe129d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:00:32.095199 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.compute.api [None req-377df6d4-b9d4-423b-a315-5fc427fe129d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Instance is already in deleting state, ignoring this request Feb 19 21:00:32.096384 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-377df6d4-b9d4-423b-a315-5fc427fe129d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 204 len: 0 microversion: 2.1 time: 0.225693 Feb 19 21:00:32.097673 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1223/2542] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:00:31 2022] DELETE /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:32.106244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f1276392-7041-42be-92d9-d85a3cc703ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:32.116820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f1276392-7041-42be-92d9-d85a3cc703ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:32.126710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1276392-7041-42be-92d9-d85a3cc703ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:32.127561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1276392-7041-42be-92d9-d85a3cc703ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:32.130060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1276392-7041-42be-92d9-d85a3cc703ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:32.130793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1276392-7041-42be-92d9-d85a3cc703ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:32.456650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f1276392-7041-42be-92d9-d85a3cc703ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:32.464283 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f1276392-7041-42be-92d9-d85a3cc703ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1297 microversion: 2.1 time: 0.364578 Feb 19 21:00:32.475828 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1224/2543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:32 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1297 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:32.480630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eb3616d0-7286-4780-821c-927dc845f785 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:32.481260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eb3616d0-7286-4780-821c-927dc845f785 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:32.492608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb3616d0-7286-4780-821c-927dc845f785 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:32.493057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb3616d0-7286-4780-821c-927dc845f785 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:32.493868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb3616d0-7286-4780-821c-927dc845f785 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:32.494305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb3616d0-7286-4780-821c-927dc845f785 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:32.839428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eb3616d0-7286-4780-821c-927dc845f785 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:32.854355 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eb3616d0-7286-4780-821c-927dc845f785 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1282 microversion: 2.1 time: 0.385813 Feb 19 21:00:32.856039 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1225/2544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:32 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1282 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:32.861283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ecae7b26-cc33-4c2c-97ae-4506d6dc2cf1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:32.863159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ecae7b26-cc33-4c2c-97ae-4506d6dc2cf1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:32.870433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ecae7b26-cc33-4c2c-97ae-4506d6dc2cf1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:32.871165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ecae7b26-cc33-4c2c-97ae-4506d6dc2cf1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:32.873901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ecae7b26-cc33-4c2c-97ae-4506d6dc2cf1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:32.874571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ecae7b26-cc33-4c2c-97ae-4506d6dc2cf1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:33.080318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0fc3f781-922c-4aa6-8ab1-6ceb66568f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:33.087734 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0fc3f781-922c-4aa6-8ab1-6ceb66568f7c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1472 microversion: 2.1 time: 1.598668 Feb 19 21:00:33.098616 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1320/2545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:31 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1472 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:33.104147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1770dbb5-b1f5-41d0-aed9-9947169b0ef8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:33.105578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1770dbb5-b1f5-41d0-aed9-9947169b0ef8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:33.117646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1770dbb5-b1f5-41d0-aed9-9947169b0ef8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:33.118459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1770dbb5-b1f5-41d0-aed9-9947169b0ef8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:33.119266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1770dbb5-b1f5-41d0-aed9-9947169b0ef8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:33.119710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1770dbb5-b1f5-41d0-aed9-9947169b0ef8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:33.518745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ecae7b26-cc33-4c2c-97ae-4506d6dc2cf1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:33.526293 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ecae7b26-cc33-4c2c-97ae-4506d6dc2cf1 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1492 microversion: 2.1 time: 0.668840 Feb 19 21:00:33.536415 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1226/2546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:32 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1492 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:33.541629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d1db1ada-b2d9-4d17-9f97-66b71fe1aabc req-4e6bf63b-0aba-40ed-87ca-88fcbc1024bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26788c55-0376-4c70-af46-b4853592d264", "name": "network-vif-unplugged", "status": "completed", "tag": "689af9d2-853d-4b31-abfa-6ed20c13392b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:33.543320 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:33.543320 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:33.565380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d1db1ada-b2d9-4d17-9f97-66b71fe1aabc req-4e6bf63b-0aba-40ed-87ca-88fcbc1024bc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:33.568204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d1db1ada-b2d9-4d17-9f97-66b71fe1aabc req-4e6bf63b-0aba-40ed-87ca-88fcbc1024bc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:33.593669 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d1db1ada-b2d9-4d17-9f97-66b71fe1aabc req-4e6bf63b-0aba-40ed-87ca-88fcbc1024bc service nova] Creating event network-vif-unplugged:689af9d2-853d-4b31-abfa-6ed20c13392b for instance 26788c55-0376-4c70-af46-b4853592d264 on nch2-master-1 Feb 19 21:00:33.598418 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d1db1ada-b2d9-4d17-9f97-66b71fe1aabc req-4e6bf63b-0aba-40ed-87ca-88fcbc1024bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060702 Feb 19 21:00:33.599393 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1227/2547] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:33.604497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3b05129a-90a5-49cb-9281-9fb7a59deeb2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:33.605253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3b05129a-90a5-49cb-9281-9fb7a59deeb2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:33.612389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b05129a-90a5-49cb-9281-9fb7a59deeb2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:33.612854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b05129a-90a5-49cb-9281-9fb7a59deeb2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:33.614114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b05129a-90a5-49cb-9281-9fb7a59deeb2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:33.614233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b05129a-90a5-49cb-9281-9fb7a59deeb2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:33.720182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1770dbb5-b1f5-41d0-aed9-9947169b0ef8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:33.728286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3b05129a-90a5-49cb-9281-9fb7a59deeb2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:33.729229 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1770dbb5-b1f5-41d0-aed9-9947169b0ef8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1322 microversion: 2.1 time: 0.629242 Feb 19 21:00:33.729828 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1321/2548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:33 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1322 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:33.745531 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3b05129a-90a5-49cb-9281-9fb7a59deeb2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1297 microversion: 2.1 time: 0.144923 Feb 19 21:00:33.748537 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1228/2549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:33 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1297 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:33.879128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ddc6b9ae-5894-4ef9-986b-06fe405a9bd0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:33.879994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ddc6b9ae-5894-4ef9-986b-06fe405a9bd0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:33.891331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ddc6b9ae-5894-4ef9-986b-06fe405a9bd0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:33.892547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ddc6b9ae-5894-4ef9-986b-06fe405a9bd0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:33.894296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ddc6b9ae-5894-4ef9-986b-06fe405a9bd0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:33.894909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ddc6b9ae-5894-4ef9-986b-06fe405a9bd0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:34.092122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ddc6b9ae-5894-4ef9-986b-06fe405a9bd0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:34.101574 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ddc6b9ae-5894-4ef9-986b-06fe405a9bd0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1282 microversion: 2.1 time: 0.231822 Feb 19 21:00:34.102170 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1322/2550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:33 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:34.118344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b2e6510-c1d8-4f1f-ac4a-d33c9e6161e0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:34.119295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b2e6510-c1d8-4f1f-ac4a-d33c9e6161e0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:34.137841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b2e6510-c1d8-4f1f-ac4a-d33c9e6161e0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:34.144593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b2e6510-c1d8-4f1f-ac4a-d33c9e6161e0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:34.146824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b2e6510-c1d8-4f1f-ac4a-d33c9e6161e0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:34.147516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b2e6510-c1d8-4f1f-ac4a-d33c9e6161e0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:34.545960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df01c714-2e04-466c-974f-d14a16b9a090 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:34.546600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-df01c714-2e04-466c-974f-d14a16b9a090 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:34.570049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df01c714-2e04-466c-974f-d14a16b9a090 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:34.570522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df01c714-2e04-466c-974f-d14a16b9a090 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:34.575529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df01c714-2e04-466c-974f-d14a16b9a090 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:34.576052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df01c714-2e04-466c-974f-d14a16b9a090 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:34.641624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9b2e6510-c1d8-4f1f-ac4a-d33c9e6161e0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:34.650889 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b2e6510-c1d8-4f1f-ac4a-d33c9e6161e0 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 200 len: 1472 microversion: 2.1 time: 0.549095 Feb 19 21:00:34.663698 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1229/2551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:34 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 1472 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:34.709133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5678a9fa-6e30-4b76-9edf-706f698a6a2f req-d3698e8c-2070-4d48-8fd9-aac609d226aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f8a307-e082-4ac1-b3db-3860b9e66774", "name": "network-vif-deleted", "tag": "89832a83-9f4f-4449-b43c-c9fafb143517"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:34.711009 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:34.711009 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:34.721184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5678a9fa-6e30-4b76-9edf-706f698a6a2f req-d3698e8c-2070-4d48-8fd9-aac609d226aa service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:34.721908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5678a9fa-6e30-4b76-9edf-706f698a6a2f req-d3698e8c-2070-4d48-8fd9-aac609d226aa service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:34.818851 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5678a9fa-6e30-4b76-9edf-706f698a6a2f req-d3698e8c-2070-4d48-8fd9-aac609d226aa service nova] Creating event network-vif-deleted:89832a83-9f4f-4449-b43c-c9fafb143517 for instance 87f8a307-e082-4ac1-b3db-3860b9e66774 on nch1-master-1 Feb 19 21:00:34.832038 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5678a9fa-6e30-4b76-9edf-706f698a6a2f req-d3698e8c-2070-4d48-8fd9-aac609d226aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140054 Feb 19 21:00:34.840997 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1230/2552] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:34.858255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-383251ef-389a-4880-85b2-5698ca567980 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:34.862686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-383251ef-389a-4880-85b2-5698ca567980 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:34.890736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-383251ef-389a-4880-85b2-5698ca567980 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:34.891186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-383251ef-389a-4880-85b2-5698ca567980 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:34.893138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-383251ef-389a-4880-85b2-5698ca567980 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:34.893603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-383251ef-389a-4880-85b2-5698ca567980 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:35.228683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df01c714-2e04-466c-974f-d14a16b9a090 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a3a1e86138d41b991f5e44a1e8ae2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b959eb07a97740dca63d3cf3d2ed0a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:35.241528 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df01c714-2e04-466c-974f-d14a16b9a090 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 200 len: 1492 microversion: 2.1 time: 0.698947 Feb 19 21:00:35.241865 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1323/2553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:34 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 1492 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:35.246518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-288556e9-bcae-4d3b-90d8-3ee8ea5566f7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:35.247164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-288556e9-bcae-4d3b-90d8-3ee8ea5566f7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:35.266683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-288556e9-bcae-4d3b-90d8-3ee8ea5566f7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:35.267409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-288556e9-bcae-4d3b-90d8-3ee8ea5566f7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:35.268728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-288556e9-bcae-4d3b-90d8-3ee8ea5566f7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:35.272300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-288556e9-bcae-4d3b-90d8-3ee8ea5566f7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:35.631957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-383251ef-389a-4880-85b2-5698ca567980 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:35.645432 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-383251ef-389a-4880-85b2-5698ca567980 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1322 microversion: 2.1 time: 0.797849 Feb 19 21:00:35.646808 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1231/2554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:34 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1322 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:35.663193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f7baf6ae-3aa8-4f2a-90bb-cc83fdbdbae6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:35.664158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f7baf6ae-3aa8-4f2a-90bb-cc83fdbdbae6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:35.674441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7baf6ae-3aa8-4f2a-90bb-cc83fdbdbae6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:35.674902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7baf6ae-3aa8-4f2a-90bb-cc83fdbdbae6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:35.675707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7baf6ae-3aa8-4f2a-90bb-cc83fdbdbae6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:35.681036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7baf6ae-3aa8-4f2a-90bb-cc83fdbdbae6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:35.971038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-288556e9-bcae-4d3b-90d8-3ee8ea5566f7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:35.978746 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-288556e9-bcae-4d3b-90d8-3ee8ea5566f7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1365 microversion: 2.1 time: 0.735838 Feb 19 21:00:35.979586 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1324/2555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:35 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1365 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:35.985070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-48809e7d-43c1-4fb3-b363-cb895a4056f3 req-a462d6ce-2c21-4f10-a8a9-7321498f7631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95227559-6479-49fb-8e4b-4b3d7cf582c9", "name": "network-vif-plugged", "status": "completed", "tag": "ff12d8e1-9359-4461-ae10-7ce54f84b0e6"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:35.986942 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:35.986942 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:00:35.994989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-48809e7d-43c1-4fb3-b363-cb895a4056f3 req-a462d6ce-2c21-4f10-a8a9-7321498f7631 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:35.995688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-48809e7d-43c1-4fb3-b363-cb895a4056f3 req-a462d6ce-2c21-4f10-a8a9-7321498f7631 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:36.012636 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-48809e7d-43c1-4fb3-b363-cb895a4056f3 req-a462d6ce-2c21-4f10-a8a9-7321498f7631 service nova] Creating event network-vif-plugged:ff12d8e1-9359-4461-ae10-7ce54f84b0e6 for instance 95227559-6479-49fb-8e4b-4b3d7cf582c9 on nch1-master-1 Feb 19 21:00:36.019530 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-48809e7d-43c1-4fb3-b363-cb895a4056f3 req-a462d6ce-2c21-4f10-a8a9-7321498f7631 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038383 Feb 19 21:00:36.038896 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1325/2556] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:36.078977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7a2416eb-18b3-4c7b-bf28-64f25ba2be08 req-a464cb43-3d43-49f5-9d0c-2884bb8fbd08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26788c55-0376-4c70-af46-b4853592d264", "name": "network-vif-deleted", "tag": "689af9d2-853d-4b31-abfa-6ed20c13392b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:36.084551 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:36.084551 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:00:36.107227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7a2416eb-18b3-4c7b-bf28-64f25ba2be08 req-a464cb43-3d43-49f5-9d0c-2884bb8fbd08 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:36.107770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7a2416eb-18b3-4c7b-bf28-64f25ba2be08 req-a464cb43-3d43-49f5-9d0c-2884bb8fbd08 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:36.149276 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7a2416eb-18b3-4c7b-bf28-64f25ba2be08 req-a464cb43-3d43-49f5-9d0c-2884bb8fbd08 service nova] Creating event network-vif-deleted:689af9d2-853d-4b31-abfa-6ed20c13392b for instance 26788c55-0376-4c70-af46-b4853592d264 on nch2-master-1 Feb 19 21:00:36.157764 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7a2416eb-18b3-4c7b-bf28-64f25ba2be08 req-a464cb43-3d43-49f5-9d0c-2884bb8fbd08 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102844 Feb 19 21:00:36.158300 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1326/2557] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:36.172735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41252074-d846-41d7-b8e9-eaf83d17ece7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:36.175355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41252074-d846-41d7-b8e9-eaf83d17ece7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: 87f8a307-e082-4ac1-b3db-3860b9e66774] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:36.193459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41252074-d846-41d7-b8e9-eaf83d17ece7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:36.194215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41252074-d846-41d7-b8e9-eaf83d17ece7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:36.195414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41252074-d846-41d7-b8e9-eaf83d17ece7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:36.197993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41252074-d846-41d7-b8e9-eaf83d17ece7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:36.228774 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-41252074-d846-41d7-b8e9-eaf83d17ece7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] HTTP exception thrown: Instance 87f8a307-e082-4ac1-b3db-3860b9e66774 could not be found. Feb 19 21:00:36.231838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41252074-d846-41d7-b8e9-eaf83d17ece7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Returning 404 to user: Instance 87f8a307-e082-4ac1-b3db-3860b9e66774 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:36.236050 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41252074-d846-41d7-b8e9-eaf83d17ece7 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774" status: 404 len: 111 microversion: 2.1 time: 0.072159 Feb 19 21:00:36.237389 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1327/2558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:36 2022] GET /compute/v2.1/servers/87f8a307-e082-4ac1-b3db-3860b9e66774 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:36.348961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f7baf6ae-3aa8-4f2a-90bb-cc83fdbdbae6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:36.358121 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f7baf6ae-3aa8-4f2a-90bb-cc83fdbdbae6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1324 microversion: 2.1 time: 0.708519 Feb 19 21:00:36.373272 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1232/2559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:35 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1324 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:36.391450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff05e31b-1237-437e-a65a-c52a8c0bd0d9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:36.393437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff05e31b-1237-437e-a65a-c52a8c0bd0d9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:36.414022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff05e31b-1237-437e-a65a-c52a8c0bd0d9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:36.420950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff05e31b-1237-437e-a65a-c52a8c0bd0d9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:36.425899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff05e31b-1237-437e-a65a-c52a8c0bd0d9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:36.426447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff05e31b-1237-437e-a65a-c52a8c0bd0d9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:36.483475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff05e31b-1237-437e-a65a-c52a8c0bd0d9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:00:36.501436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36f5ed62-ce59-4973-89ef-3bc4287759ed tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Action: 'create', calling method: .version_select at 0x7f64677531f0>, body: {"keypair": {"name": "tempest-keypair-855135621"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:36.540027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-36f5ed62-ce59-4973-89ef-3bc4287759ed tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:36.556097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-36f5ed62-ce59-4973-89ef-3bc4287759ed tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:36.733741 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff05e31b-1237-437e-a65a-c52a8c0bd0d9 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 204 len: 0 microversion: 2.1 time: 0.363782 Feb 19 21:00:36.734644 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1233/2560] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:00:36 2022] DELETE /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:36.741358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e58e5a72-8d7c-4380-9cbb-9bd370060f5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:36.747689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e58e5a72-8d7c-4380-9cbb-9bd370060f5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 26788c55-0376-4c70-af46-b4853592d264] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:36.770230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e58e5a72-8d7c-4380-9cbb-9bd370060f5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:36.770691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e58e5a72-8d7c-4380-9cbb-9bd370060f5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:36.771499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e58e5a72-8d7c-4380-9cbb-9bd370060f5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:36.771933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e58e5a72-8d7c-4380-9cbb-9bd370060f5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:36.793004 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-e58e5a72-8d7c-4380-9cbb-9bd370060f5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Instance 26788c55-0376-4c70-af46-b4853592d264 could not be found. Feb 19 21:00:36.801340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e58e5a72-8d7c-4380-9cbb-9bd370060f5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Instance 26788c55-0376-4c70-af46-b4853592d264 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:36.802448 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e58e5a72-8d7c-4380-9cbb-9bd370060f5b tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264" status: 404 len: 111 microversion: 2.1 time: 0.066478 Feb 19 21:00:36.803170 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1234/2561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:36 2022] GET /compute/v2.1/servers/26788c55-0376-4c70-af46-b4853592d264 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:36.810896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6419b593-c748-4eb3-bf24-d6a734ac9f28 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:36.813962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6419b593-c748-4eb3-bf24-d6a734ac9f28 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:36.832173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6419b593-c748-4eb3-bf24-d6a734ac9f28 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:36.832972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6419b593-c748-4eb3-bf24-d6a734ac9f28 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:36.834246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6419b593-c748-4eb3-bf24-d6a734ac9f28 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:36.834961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6419b593-c748-4eb3-bf24-d6a734ac9f28 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:37.376427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6419b593-c748-4eb3-bf24-d6a734ac9f28 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:37.392848 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6419b593-c748-4eb3-bf24-d6a734ac9f28 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1322 microversion: 2.1 time: 0.588356 Feb 19 21:00:37.395969 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1235/2562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:36 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1322 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:37.410453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fed545f3-6799-460b-83a2-3101a950201b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:37.410453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fed545f3-6799-460b-83a2-3101a950201b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:37.424005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fed545f3-6799-460b-83a2-3101a950201b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:37.424609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fed545f3-6799-460b-83a2-3101a950201b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:37.425541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fed545f3-6799-460b-83a2-3101a950201b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:37.426096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fed545f3-6799-460b-83a2-3101a950201b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:37.455123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-36f5ed62-ce59-4973-89ef-3bc4287759ed tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:37.472912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-36f5ed62-ce59-4973-89ef-3bc4287759ed tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:37.507315 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36f5ed62-ce59-4973-89ef-3bc4287759ed tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 1.268636 Feb 19 21:00:37.508229 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1328/2563] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Feb 19 21:00:36 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1270 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:37.512858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bd016c7b-982a-4c6d-b10b-de92180999f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f64676e9dc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:37.540014 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-bd016c7b-982a-4c6d-b10b-de92180999f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Image not found. Feb 19 21:00:37.540876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bd016c7b-982a-4c6d-b10b-de92180999f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:37.541931 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bd016c7b-982a-4c6d-b10b-de92180999f2 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59" status: 404 len: 62 microversion: 2.1 time: 0.032563 Feb 19 21:00:37.543018 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1329/2564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:37 2022] DELETE /compute/v2.1/images/d3b4adaf-6d1a-4994-a86b-09cf44930c59 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:37.837703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6f18befd-7f01-432d-a0e4-7231c70b435a req-9ce01350-5f7c-46b0-a5b5-0812889708f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:37.839215 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:37.839215 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:00:37.852523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6f18befd-7f01-432d-a0e4-7231c70b435a req-9ce01350-5f7c-46b0-a5b5-0812889708f4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:37.852982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6f18befd-7f01-432d-a0e4-7231c70b435a req-9ce01350-5f7c-46b0-a5b5-0812889708f4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:37.875860 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6f18befd-7f01-432d-a0e4-7231c70b435a req-9ce01350-5f7c-46b0-a5b5-0812889708f4 service nova] Creating event network-changed:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:00:37.894529 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6f18befd-7f01-432d-a0e4-7231c70b435a req-9ce01350-5f7c-46b0-a5b5-0812889708f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350073 Feb 19 21:00:37.900626 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1330/2565] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:37.909712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c9c348cf-64ff-4703-907e-ae51c482928a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:37.911841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c9c348cf-64ff-4703-907e-ae51c482928a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:37.925922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9c348cf-64ff-4703-907e-ae51c482928a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:37.926717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9c348cf-64ff-4703-907e-ae51c482928a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:37.927612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9c348cf-64ff-4703-907e-ae51c482928a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:37.928065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9c348cf-64ff-4703-907e-ae51c482928a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:37.963129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fed545f3-6799-460b-83a2-3101a950201b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:37.971479 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fed545f3-6799-460b-83a2-3101a950201b tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 200 len: 1473 microversion: 2.1 time: 0.574053 Feb 19 21:00:37.971949 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1236/2566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:37 2022] GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 1473 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:37.978451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-662cf7b3-f6c2-4136-bf57-e98fc00fc683 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:37.979070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-662cf7b3-f6c2-4136-bf57-e98fc00fc683 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:37.999274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-662cf7b3-f6c2-4136-bf57-e98fc00fc683 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:37.999976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-662cf7b3-f6c2-4136-bf57-e98fc00fc683 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.001744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-662cf7b3-f6c2-4136-bf57-e98fc00fc683 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:38.002365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-662cf7b3-f6c2-4136-bf57-e98fc00fc683 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.224579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c9c348cf-64ff-4703-907e-ae51c482928a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:38.233343 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c9c348cf-64ff-4703-907e-ae51c482928a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1365 microversion: 2.1 time: 0.331218 Feb 19 21:00:38.246855 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1331/2567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:37 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:38.255364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7803f46d-c78e-49c7-9fc2-6110fec4be39 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f64676ef820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:38.260807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-662cf7b3-f6c2-4136-bf57-e98fc00fc683 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:38.271046 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-662cf7b3-f6c2-4136-bf57-e98fc00fc683 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1324 microversion: 2.1 time: 0.298054 Feb 19 21:00:38.271363 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7803f46d-c78e-49c7-9fc2-6110fec4be39 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-855135621" status: 200 len: 706 microversion: 2.2 time: 0.022944 Feb 19 21:00:38.273813 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1237/2569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:37 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:38.277920 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1332/2569] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Feb 19 21:00:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-855135621 => generated 706 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:38.301632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6d57f146-26fe-44b7-a247-0a2fa1019ce4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:38.302362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6d57f146-26fe-44b7-a247-0a2fa1019ce4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:38.308470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d57f146-26fe-44b7-a247-0a2fa1019ce4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:38.308735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b9af02de-d5d9-4c55-b923-9c3ef9a79123 req-0f015593-5b28-4697-b161-60edfa313927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df03445-3277-48bd-be5b-c8503c33714d", "name": "network-vif-plugged", "status": "completed", "tag": "7c930953-29d6-4047-8f78-0d1f65f29d0b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:38.309246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d57f146-26fe-44b7-a247-0a2fa1019ce4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.311234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d57f146-26fe-44b7-a247-0a2fa1019ce4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:38.311809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d57f146-26fe-44b7-a247-0a2fa1019ce4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.312804 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:38.312804 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:00:38.333696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b9af02de-d5d9-4c55-b923-9c3ef9a79123 req-0f015593-5b28-4697-b161-60edfa313927 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:38.336006 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-6d57f146-26fe-44b7-a247-0a2fa1019ce4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Instance 25db99dd-04b8-4486-9f09-dbbb9bcaf223 could not be found. Feb 19 21:00:38.336919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6d57f146-26fe-44b7-a247-0a2fa1019ce4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Instance 25db99dd-04b8-4486-9f09-dbbb9bcaf223 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:38.338078 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6d57f146-26fe-44b7-a247-0a2fa1019ce4 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 404 len: 111 microversion: 2.1 time: 0.047940 Feb 19 21:00:38.341775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b9af02de-d5d9-4c55-b923-9c3ef9a79123 req-0f015593-5b28-4697-b161-60edfa313927 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.342353 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1238/2570] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:00:38 2022] DELETE /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:38.348379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-50fd988d-0eb3-4552-837a-ce924ac7ec4f req-535b8ac3-205f-4abe-8b64-0d34c0ab9d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3efa67c8-3252-425b-8367-d3f479832357", "tag": "09c89639-efa3-4a90-ae46-d10a6795fa74"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:38.350357 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:38.350357 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:38.358765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-50fd988d-0eb3-4552-837a-ce924ac7ec4f req-535b8ac3-205f-4abe-8b64-0d34c0ab9d1c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:38.359765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-50fd988d-0eb3-4552-837a-ce924ac7ec4f req-535b8ac3-205f-4abe-8b64-0d34c0ab9d1c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.373566 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-50fd988d-0eb3-4552-837a-ce924ac7ec4f req-535b8ac3-205f-4abe-8b64-0d34c0ab9d1c service nova] Creating event network-changed:09c89639-efa3-4a90-ae46-d10a6795fa74 for instance 3efa67c8-3252-425b-8367-d3f479832357 on nch2-master-1 Feb 19 21:00:38.379023 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-50fd988d-0eb3-4552-837a-ce924ac7ec4f req-535b8ac3-205f-4abe-8b64-0d34c0ab9d1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034146 Feb 19 21:00:38.380289 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1239/2571] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:38.385626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-289a45a0-c5ca-4e59-b275-a7bdd6e9e528 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f6467569940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:38.390128 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b9af02de-d5d9-4c55-b923-9c3ef9a79123 req-0f015593-5b28-4697-b161-60edfa313927 service nova] Creating event network-vif-plugged:7c930953-29d6-4047-8f78-0d1f65f29d0b for instance 2df03445-3277-48bd-be5b-c8503c33714d on nch1-master-1 Feb 19 21:00:38.408819 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b9af02de-d5d9-4c55-b923-9c3ef9a79123 req-0f015593-5b28-4697-b161-60edfa313927 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125652 Feb 19 21:00:38.410949 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1333/2572] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:38.412499 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-289a45a0-c5ca-4e59-b275-a7bdd6e9e528 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-855135621" status: 204 len: 0 microversion: 2.2 time: 0.030854 Feb 19 21:00:38.420316 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1240/2573] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Feb 19 21:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-855135621 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:38.425264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e59119d8-96c5-4e15-a529-4a52bfb6cc20 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:38.426013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e59119d8-96c5-4e15-a529-4a52bfb6cc20 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:38.426743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c189fa93-f61a-46dd-bd33-eccdec393625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:38.427552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c189fa93-f61a-46dd-bd33-eccdec393625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 25db99dd-04b8-4486-9f09-dbbb9bcaf223] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:38.440458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e59119d8-96c5-4e15-a529-4a52bfb6cc20 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:38.442039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e59119d8-96c5-4e15-a529-4a52bfb6cc20 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.443913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e59119d8-96c5-4e15-a529-4a52bfb6cc20 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:38.444242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c189fa93-f61a-46dd-bd33-eccdec393625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:38.444859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c189fa93-f61a-46dd-bd33-eccdec393625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.445475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e59119d8-96c5-4e15-a529-4a52bfb6cc20 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.446433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c189fa93-f61a-46dd-bd33-eccdec393625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:38.449088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c189fa93-f61a-46dd-bd33-eccdec393625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:38.477483 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-c189fa93-f61a-46dd-bd33-eccdec393625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Instance 25db99dd-04b8-4486-9f09-dbbb9bcaf223 could not be found. Feb 19 21:00:38.479319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c189fa93-f61a-46dd-bd33-eccdec393625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Instance 25db99dd-04b8-4486-9f09-dbbb9bcaf223 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:38.484251 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c189fa93-f61a-46dd-bd33-eccdec393625 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223" status: 404 len: 111 microversion: 2.1 time: 0.071579 Feb 19 21:00:38.485169 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1334/2574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:38 2022] GET /compute/v2.1/servers/25db99dd-04b8-4486-9f09-dbbb9bcaf223 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:38.491760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f6970f03-1567-421b-b39d-850a744616a5 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Action: 'create', calling method: .version_select at 0x7f64676ef550>, body: {"keypair": {"name": "tempest-keypair-1093453273"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:38.522031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-f6970f03-1567-421b-b39d-850a744616a5 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:38.528549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-f6970f03-1567-421b-b39d-850a744616a5 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:38.972159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-f6970f03-1567-421b-b39d-850a744616a5 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:38.977460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-f6970f03-1567-421b-b39d-850a744616a5 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:39.004948 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f6970f03-1567-421b-b39d-850a744616a5 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.516902 Feb 19 21:00:39.006118 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1335/2575] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Feb 19 21:00:38 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 520 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:39.009651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e59119d8-96c5-4e15-a529-4a52bfb6cc20 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:39.016629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a26f8c8e-b985-4aa6-be37-444ee0dc99e9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f6467753430>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:39.023684 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e59119d8-96c5-4e15-a529-4a52bfb6cc20 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1516 microversion: 2.1 time: 0.604233 Feb 19 21:00:39.025097 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1241/2576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:38 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1516 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:39.032230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5ede2de4-ce50-4aa0-81a0-e430ac7edde4 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:39.032891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5ede2de4-ce50-4aa0-81a0-e430ac7edde4 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:39.045618 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a26f8c8e-b985-4aa6-be37-444ee0dc99e9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Image not found. Feb 19 21:00:39.046370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a26f8c8e-b985-4aa6-be37-444ee0dc99e9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:39.047342 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a26f8c8e-b985-4aa6-be37-444ee0dc99e9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b" status: 404 len: 62 microversion: 2.1 time: 0.040041 Feb 19 21:00:39.048063 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1336/2577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:39 2022] DELETE /compute/v2.1/images/26b0cb09-304f-41a9-8715-f2114123901b => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:39.052880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ede2de4-ce50-4aa0-81a0-e430ac7edde4 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.053344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ede2de4-ce50-4aa0-81a0-e430ac7edde4 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:39.053779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8cf5430f-f83f-4191-a61f-3f1702e7c6de tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f64676ce0d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:39.054157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ede2de4-ce50-4aa0-81a0-e430ac7edde4 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.054603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ede2de4-ce50-4aa0-81a0-e430ac7edde4 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:39.084196 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8cf5430f-f83f-4191-a61f-3f1702e7c6de tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093453273" status: 204 len: 0 microversion: 2.2 time: 0.032165 Feb 19 21:00:39.085017 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1337/2578] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Feb 19 21:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1093453273 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:39.096276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1fb9f0f0-6a4b-48cb-b250-ee620cc1d686 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:39.097297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1fb9f0f0-6a4b-48cb-b250-ee620cc1d686 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:39.104087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fb9f0f0-6a4b-48cb-b250-ee620cc1d686 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.104681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fb9f0f0-6a4b-48cb-b250-ee620cc1d686 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:39.105703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fb9f0f0-6a4b-48cb-b250-ee620cc1d686 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.106084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fb9f0f0-6a4b-48cb-b250-ee620cc1d686 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:39.133657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-1fb9f0f0-6a4b-48cb-b250-ee620cc1d686 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lazy-loading 'flavor' on Instance uuid 95227559-6479-49fb-8e4b-4b3d7cf582c9 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:00:39.275725 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1fb9f0f0-6a4b-48cb-b250-ee620cc1d686 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9/action" status: 200 len: 32 microversion: 2.1 time: 0.184972 Feb 19 21:00:39.276371 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1338/2579] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:00:39 2022] POST /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:00:39.290845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0766ad07-9b84-4c23-9878-645bab533399 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:39.291902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0766ad07-9b84-4c23-9878-645bab533399 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:39.308381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0766ad07-9b84-4c23-9878-645bab533399 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.308831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0766ad07-9b84-4c23-9878-645bab533399 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:39.309883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0766ad07-9b84-4c23-9878-645bab533399 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.311547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0766ad07-9b84-4c23-9878-645bab533399 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:39.345087 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0766ad07-9b84-4c23-9878-645bab533399 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Instance 0c58f78c-bd41-4570-86ec-a9d3a898e1b4 could not be found. Feb 19 21:00:39.345894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0766ad07-9b84-4c23-9878-645bab533399 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Instance 0c58f78c-bd41-4570-86ec-a9d3a898e1b4 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:39.349561 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0766ad07-9b84-4c23-9878-645bab533399 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 404 len: 111 microversion: 2.1 time: 0.064743 Feb 19 21:00:39.360717 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1339/2580] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:00:39 2022] DELETE /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:39.366226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-916bc045-8afc-47b2-8aca-cb6385211ade tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Action: 'create', calling method: .version_select at 0x7f64790c0670>, body: {"keypair": {"name": "tempest-keypair-280702983", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:39.378756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5ede2de4-ce50-4aa0-81a0-e430ac7edde4 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:39.389338 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5ede2de4-ce50-4aa0-81a0-e430ac7edde4 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 200 len: 1473 microversion: 2.1 time: 0.360452 Feb 19 21:00:39.390113 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1242/2581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:39 2022] GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 1473 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:39.394801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-916bc045-8afc-47b2-8aca-cb6385211ade tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:39.396869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f3e17720-4cf4-4041-b7ba-54e3ee04bb92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:39.397727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f3e17720-4cf4-4041-b7ba-54e3ee04bb92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:39.409755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-916bc045-8afc-47b2-8aca-cb6385211ade tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:39.414875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3e17720-4cf4-4041-b7ba-54e3ee04bb92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.418316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3e17720-4cf4-4041-b7ba-54e3ee04bb92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:39.419382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3e17720-4cf4-4041-b7ba-54e3ee04bb92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.420734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3e17720-4cf4-4041-b7ba-54e3ee04bb92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:39.471876 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-916bc045-8afc-47b2-8aca-cb6385211ade tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.109793 Feb 19 21:00:39.477907 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1340/2582] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Feb 19 21:00:39 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Feb 19 21:00:39.484255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-17f93625-b41b-4f6e-baa4-44d458a820ee tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:39.484255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17f93625-b41b-4f6e-baa4-44d458a820ee tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:39.499304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17f93625-b41b-4f6e-baa4-44d458a820ee tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.499769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17f93625-b41b-4f6e-baa4-44d458a820ee tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:39.500597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17f93625-b41b-4f6e-baa4-44d458a820ee tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:39.501040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17f93625-b41b-4f6e-baa4-44d458a820ee tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:40.381329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17f93625-b41b-4f6e-baa4-44d458a820ee tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:40.384042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f3e17720-4cf4-4041-b7ba-54e3ee04bb92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:40.396862 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f3e17720-4cf4-4041-b7ba-54e3ee04bb92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1365 microversion: 2.1 time: 1.003938 Feb 19 21:00:40.406325 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1243/2583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:39 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1365 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:40.407645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-17f93625-b41b-4f6e-baa4-44d458a820ee tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.928486 Feb 19 21:00:40.408447 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1341/2584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:39 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:40.418576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-07a634f7-1b24-4fe7-9231-66bbe8a26475 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:40.418576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-07a634f7-1b24-4fe7-9231-66bbe8a26475 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:40.425881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-827679c8-32b1-4920-955f-96a8b2ac6ed9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:40.426026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07a634f7-1b24-4fe7-9231-66bbe8a26475 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:40.426439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07a634f7-1b24-4fe7-9231-66bbe8a26475 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:40.427294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07a634f7-1b24-4fe7-9231-66bbe8a26475 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:40.429489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-827679c8-32b1-4920-955f-96a8b2ac6ed9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: 0c58f78c-bd41-4570-86ec-a9d3a898e1b4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:40.435511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07a634f7-1b24-4fe7-9231-66bbe8a26475 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:40.453292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-827679c8-32b1-4920-955f-96a8b2ac6ed9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:40.455288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-827679c8-32b1-4920-955f-96a8b2ac6ed9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:40.456471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-827679c8-32b1-4920-955f-96a8b2ac6ed9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:40.457911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-827679c8-32b1-4920-955f-96a8b2ac6ed9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:40.486444 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-827679c8-32b1-4920-955f-96a8b2ac6ed9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Instance 0c58f78c-bd41-4570-86ec-a9d3a898e1b4 could not be found. Feb 19 21:00:40.494467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-827679c8-32b1-4920-955f-96a8b2ac6ed9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Instance 0c58f78c-bd41-4570-86ec-a9d3a898e1b4 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:40.495682 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-827679c8-32b1-4920-955f-96a8b2ac6ed9 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4" status: 404 len: 111 microversion: 2.1 time: 0.076246 Feb 19 21:00:40.500412 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1342/2585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:40 2022] GET /compute/v2.1/servers/0c58f78c-bd41-4570-86ec-a9d3a898e1b4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:40.512095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ffd3e120-137f-4785-a229-f17e6183ac50 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f64790ae940>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:40.548650 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ffd3e120-137f-4785-a229-f17e6183ac50 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280702983" status: 204 len: 0 microversion: 2.2 time: 0.046794 Feb 19 21:00:40.554543 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1343/2586] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Feb 19 21:00:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280702983 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:40.556483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ed81da13-f7d8-4783-9487-44f94684c3f1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:40.557484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ed81da13-f7d8-4783-9487-44f94684c3f1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:40.604313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ed81da13-f7d8-4783-9487-44f94684c3f1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:40.604810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ed81da13-f7d8-4783-9487-44f94684c3f1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:40.605628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ed81da13-f7d8-4783-9487-44f94684c3f1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:40.608954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ed81da13-f7d8-4783-9487-44f94684c3f1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:40.729147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-07a634f7-1b24-4fe7-9231-66bbe8a26475 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:40.744126 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-07a634f7-1b24-4fe7-9231-66bbe8a26475 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1324 microversion: 2.1 time: 0.341874 Feb 19 21:00:40.750157 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1244/2587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:40 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1324 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:40.763627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1cacd82b-5cda-4547-9226-de174c0045f5 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '.version_select at 0x7f647922a280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:40.796623 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-1cacd82b-5cda-4547-9226-de174c0045f5 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Image not found. Feb 19 21:00:40.797225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1cacd82b-5cda-4547-9226-de174c0045f5 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Image not found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:40.798049 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1cacd82b-5cda-4547-9226-de174c0045f5 tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c" status: 404 len: 62 microversion: 2.1 time: 0.046908 Feb 19 21:00:40.798870 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1245/2588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:40 2022] DELETE /compute/v2.1/images/f43d9f3d-1ccc-406c-8cce-2a2da7fffb3c => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:40.804052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a8008a99-b50a-42a1-85ca-85ead0055258 req-956c1c72-b1eb-4d90-9fa2-ae2ad504e3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac13892-70a3-4a7f-b7a8-a0cd9169d0b5", "name": "network-vif-deleted", "tag": "835957bc-cf48-4628-ac6b-011383e9ecd7"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:40.808554 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:40.808554 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:40.828841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a8008a99-b50a-42a1-85ca-85ead0055258 req-956c1c72-b1eb-4d90-9fa2-ae2ad504e3c1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:40.829579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a8008a99-b50a-42a1-85ca-85ead0055258 req-956c1c72-b1eb-4d90-9fa2-ae2ad504e3c1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:40.848458 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a8008a99-b50a-42a1-85ca-85ead0055258 req-956c1c72-b1eb-4d90-9fa2-ae2ad504e3c1 service nova] Creating event network-vif-deleted:835957bc-cf48-4628-ac6b-011383e9ecd7 for instance eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 on nch2-master-1 Feb 19 21:00:40.858438 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a8008a99-b50a-42a1-85ca-85ead0055258 req-956c1c72-b1eb-4d90-9fa2-ae2ad504e3c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057047 Feb 19 21:00:40.859429 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1246/2589] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:40.866136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06184d5c-2dcc-4f5a-b9a4-6ec3899ae2af tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Action: 'create', calling method: .version_select at 0x7f6467524e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-231740896"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:40.882803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06184d5c-2dcc-4f5a-b9a4-6ec3899ae2af tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:40.889801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06184d5c-2dcc-4f5a-b9a4-6ec3899ae2af tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:40.913660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ed81da13-f7d8-4783-9487-44f94684c3f1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5228f69460a3451c90e6254f5c6b6eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0a055a14bb46128600e77140b79b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:40.927051 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ed81da13-f7d8-4783-9487-44f94684c3f1 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 200 len: 1302 microversion: 2.1 time: 0.373224 Feb 19 21:00:40.929641 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1344/2590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:40 2022] GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 1302 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:40.945276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0344a23-3e21-4b4d-9a01-07c438d9325d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:40.949932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0344a23-3e21-4b4d-9a01-07c438d9325d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:40.970312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0344a23-3e21-4b4d-9a01-07c438d9325d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:40.972739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0344a23-3e21-4b4d-9a01-07c438d9325d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:40.974614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0344a23-3e21-4b4d-9a01-07c438d9325d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:40.981114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0344a23-3e21-4b4d-9a01-07c438d9325d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:41.014223 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e0344a23-3e21-4b4d-9a01-07c438d9325d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Instance d927e050-ac38-4b26-8aa5-14f490410068 could not be found. Feb 19 21:00:41.015013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0344a23-3e21-4b4d-9a01-07c438d9325d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Instance d927e050-ac38-4b26-8aa5-14f490410068 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:41.016041 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0344a23-3e21-4b4d-9a01-07c438d9325d tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 404 len: 111 microversion: 2.1 time: 0.084265 Feb 19 21:00:41.020928 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1345/2591] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:00:40 2022] DELETE /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:41.026225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2cffab94-9c1b-478f-b04c-80066bb36bab tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:41.027089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2cffab94-9c1b-478f-b04c-80066bb36bab tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] [instance: d927e050-ac38-4b26-8aa5-14f490410068] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:41.035723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2cffab94-9c1b-478f-b04c-80066bb36bab tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:41.036299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2cffab94-9c1b-478f-b04c-80066bb36bab tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:41.037260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2cffab94-9c1b-478f-b04c-80066bb36bab tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:41.037877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2cffab94-9c1b-478f-b04c-80066bb36bab tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:41.055091 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-2cffab94-9c1b-478f-b04c-80066bb36bab tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] HTTP exception thrown: Instance d927e050-ac38-4b26-8aa5-14f490410068 could not be found. Feb 19 21:00:41.055860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2cffab94-9c1b-478f-b04c-80066bb36bab tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] Returning 404 to user: Instance d927e050-ac38-4b26-8aa5-14f490410068 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:41.056834 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2cffab94-9c1b-478f-b04c-80066bb36bab tempest-ImagesTestJSON-1552767521 tempest-ImagesTestJSON-1552767521-project] 10.222.0.30 "GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068" status: 404 len: 111 microversion: 2.1 time: 0.034811 Feb 19 21:00:41.062407 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1346/2592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:41 2022] GET /compute/v2.1/servers/d927e050-ac38-4b26-8aa5-14f490410068 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:41.141432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06184d5c-2dcc-4f5a-b9a4-6ec3899ae2af tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:41.151763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06184d5c-2dcc-4f5a-b9a4-6ec3899ae2af tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:41.168209 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06184d5c-2dcc-4f5a-b9a4-6ec3899ae2af tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.307510 Feb 19 21:00:41.168874 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1247/2593] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Feb 19 21:00:40 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 309 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:41.179043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4413131c-0eda-4f21-bf63-689091ac2e3a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Action: 'create', calling method: .version_select at 0x7f64790c04c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1367605394"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:41.198687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4413131c-0eda-4f21-bf63-689091ac2e3a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:41.204810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4413131c-0eda-4f21-bf63-689091ac2e3a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:41.367156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4413131c-0eda-4f21-bf63-689091ac2e3a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:41.372155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4413131c-0eda-4f21-bf63-689091ac2e3a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:41.387406 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4413131c-0eda-4f21-bf63-689091ac2e3a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.211949 Feb 19 21:00:41.388675 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1347/2594] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Feb 19 21:00:41 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:00:41.405297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad888c95-e04d-48c0-b54a-49dbe5e2abb8 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Action: 'create', calling method: .version_select at 0x7f64675555e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1089345181"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:41.416824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-66b0ec06-41a1-4a81-adf7-b971913e2047 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:41.421129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-66b0ec06-41a1-4a81-adf7-b971913e2047 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:41.433484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-66b0ec06-41a1-4a81-adf7-b971913e2047 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:41.436071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-66b0ec06-41a1-4a81-adf7-b971913e2047 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:41.437097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-66b0ec06-41a1-4a81-adf7-b971913e2047 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:41.437545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-66b0ec06-41a1-4a81-adf7-b971913e2047 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:41.456963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ad888c95-e04d-48c0-b54a-49dbe5e2abb8 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:41.482753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ad888c95-e04d-48c0-b54a-49dbe5e2abb8 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:41.778445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ad888c95-e04d-48c0-b54a-49dbe5e2abb8 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:41.785540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ad888c95-e04d-48c0-b54a-49dbe5e2abb8 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:41.806257 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad888c95-e04d-48c0-b54a-49dbe5e2abb8 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.410434 Feb 19 21:00:41.807223 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1248/2595] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Feb 19 21:00:41 2022] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 412 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:41.812925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f82cacd8-d35c-4019-99e1-f2e7e55f32f9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:41.813816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f82cacd8-d35c-4019-99e1-f2e7e55f32f9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:41.822087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f82cacd8-d35c-4019-99e1-f2e7e55f32f9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:41.823168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f82cacd8-d35c-4019-99e1-f2e7e55f32f9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:41.824292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f82cacd8-d35c-4019-99e1-f2e7e55f32f9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:41.824975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f82cacd8-d35c-4019-99e1-f2e7e55f32f9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:41.954866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-66b0ec06-41a1-4a81-adf7-b971913e2047 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:41.963231 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-66b0ec06-41a1-4a81-adf7-b971913e2047 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1365 microversion: 2.1 time: 0.553200 Feb 19 21:00:41.969191 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1348/2596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:41 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1365 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:41.973751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4a607a43-25ad-4a14-b31d-a36438d8ceeb tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:41.974365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4a607a43-25ad-4a14-b31d-a36438d8ceeb tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:41.987665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a607a43-25ad-4a14-b31d-a36438d8ceeb tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:41.988059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a607a43-25ad-4a14-b31d-a36438d8ceeb tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:41.993599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a607a43-25ad-4a14-b31d-a36438d8ceeb tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:41.994056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a607a43-25ad-4a14-b31d-a36438d8ceeb tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:42.181722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f82cacd8-d35c-4019-99e1-f2e7e55f32f9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:42.203531 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f82cacd8-d35c-4019-99e1-f2e7e55f32f9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.395175 Feb 19 21:00:42.204642 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1249/2597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:41 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:42.218787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ef3f791-a924-4cd2-a8b8-8f27ee40193e tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f6467503040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:42.223498 ncdv-master-1 devstack@n-api.service[136095]: WARNING oslo_db.sqlalchemy.utils [None req-8ef3f791-a924-4cd2-a8b8-8f27ee40193e tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 19 21:00:42.233161 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ef3f791-a924-4cd2-a8b8-8f27ee40193e tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1723 microversion: 2.2 time: 0.027439 Feb 19 21:00:42.233766 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1250/2598] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Feb 19 21:00:42 2022] GET /compute/v2.1/os-keypairs => generated 1723 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:42.239638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-32a30b4c-9e7b-4f5e-8ee1-5167134073db tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:42.240825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-32a30b4c-9e7b-4f5e-8ee1-5167134073db tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] [instance: eac13892-70a3-4a7f-b7a8-a0cd9169d0b5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:42.249204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32a30b4c-9e7b-4f5e-8ee1-5167134073db tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:42.250006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32a30b4c-9e7b-4f5e-8ee1-5167134073db tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:42.251292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32a30b4c-9e7b-4f5e-8ee1-5167134073db tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:42.251941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32a30b4c-9e7b-4f5e-8ee1-5167134073db tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:42.270744 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-32a30b4c-9e7b-4f5e-8ee1-5167134073db tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] HTTP exception thrown: Instance eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 could not be found. Feb 19 21:00:42.271626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-32a30b4c-9e7b-4f5e-8ee1-5167134073db tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Returning 404 to user: Instance eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:42.272663 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-32a30b4c-9e7b-4f5e-8ee1-5167134073db tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5" status: 404 len: 111 microversion: 2.1 time: 0.037829 Feb 19 21:00:42.273712 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1251/2599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:42 2022] GET /compute/v2.1/servers/eac13892-70a3-4a7f-b7a8-a0cd9169d0b5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:42.281697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e3cc95b-d92e-4c47-9e82-fd8c1d3cb1d7 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f6467555f70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:42.288770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a607a43-25ad-4a14-b31d-a36438d8ceeb tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:42.301797 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4a607a43-25ad-4a14-b31d-a36438d8ceeb tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1324 microversion: 2.1 time: 0.331440 Feb 19 21:00:42.303555 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1349/2600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:41 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:42.305969 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e3cc95b-d92e-4c47-9e82-fd8c1d3cb1d7 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1089345181" status: 204 len: 0 microversion: 2.2 time: 0.030923 Feb 19 21:00:42.306990 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1252/2601] 10.222.0.30 () {60 vars in 1320 bytes} [Sat Feb 19 21:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1089345181 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:42.314828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dcde8fbc-a066-4274-84e4-3c2864c50f93 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f646769edc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:42.322703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-917b9a73-403d-4f3d-be34-58e43beb2d56 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f647922aca0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:42.365516 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-917b9a73-403d-4f3d-be34-58e43beb2d56 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1367605394" status: 204 len: 0 microversion: 2.2 time: 0.052590 Feb 19 21:00:42.366654 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1253/2602] 10.222.0.30 () {60 vars in 1320 bytes} [Sat Feb 19 21:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1367605394 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:42.376451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f3c4ae21-fef5-4271-8da2-f29aea937965 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f6467521ca0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:42.396269 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f3c4ae21-fef5-4271-8da2-f29aea937965 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-231740896" status: 204 len: 0 microversion: 2.2 time: 0.023989 Feb 19 21:00:42.397350 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1254/2603] 10.222.0.30 () {60 vars in 1317 bytes} [Sat Feb 19 21:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-231740896 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:42.409919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-60dd075d-bbd5-4aff-8bcb-538441efe27a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Action: 'create', calling method: .version_select at 0x7f6467513d30>, body: {"keypair": {"name": "tempest-keypair-522910332"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:42.428878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-60dd075d-bbd5-4aff-8bcb-538441efe27a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:42.435843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-60dd075d-bbd5-4aff-8bcb-538441efe27a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:42.794741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-60dd075d-bbd5-4aff-8bcb-538441efe27a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:42.800065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-60dd075d-bbd5-4aff-8bcb-538441efe27a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:42.819280 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-60dd075d-bbd5-4aff-8bcb-538441efe27a tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.415660 Feb 19 21:00:42.820377 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1255/2604] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Feb 19 21:00:42 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 418 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:42.834355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1257c961-21c9-4a3a-b7a0-4db0d46ed91d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f6467524f70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:42.845315 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1257c961-21c9-4a3a-b7a0-4db0d46ed91d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-522910332" status: 200 len: 706 microversion: 2.2 time: 0.019115 Feb 19 21:00:42.846490 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1256/2605] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Feb 19 21:00:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-522910332 => generated 706 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:42.859314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-64e3b9d5-0fc2-4a20-b19d-3eafb7133f4c tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f6467503550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:42.862169 ncdv-master-1 devstack@n-api.service[136095]: WARNING oslo_db.sqlalchemy.utils [None req-64e3b9d5-0fc2-4a20-b19d-3eafb7133f4c tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 19 21:00:42.870056 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-64e3b9d5-0fc2-4a20-b19d-3eafb7133f4c tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 563 microversion: 2.2 time: 0.015353 Feb 19 21:00:42.876416 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1257/2606] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Feb 19 21:00:42 2022] GET /compute/v2.1/os-keypairs => generated 563 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:42.881467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76645144-5b8b-4734-b796-99efd8e581ed tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f6467531c10>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:42.911848 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-76645144-5b8b-4734-b796-99efd8e581ed tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522910332" status: 204 len: 0 microversion: 2.2 time: 0.033926 Feb 19 21:00:42.912769 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1258/2607] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Feb 19 21:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522910332 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:42.924873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Action: 'create', calling method: .version_select at 0x7f6467531700>, body: {"keypair": {"name": "tempest-keypair-2083674059", "type": "x509"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:42.942715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:42.948308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:42.964808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.processutils [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpsgl83qpa/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsgl83qpa/temp.key -subj /CN=8a3840a896784f8ba53135b4e0b69ff3 -extensions v3_req_client {{(pid=136095) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:00:42.992053 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dcde8fbc-a066-4274-84e4-3c2864c50f93 tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "DELETE /compute/v2.1/images/e8397b1d-9136-445e-8cbc-e88cc9e2a086" status: 204 len: 0 microversion: 2.1 time: 0.686818 Feb 19 21:00:42.992877 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1350/2608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:42 2022] DELETE /compute/v2.1/images/e8397b1d-9136-445e-8cbc-e88cc9e2a086 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:42.999804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-35e2c613-4570-4055-843b-9521179fe51a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:43.000764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-35e2c613-4570-4055-843b-9521179fe51a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:43.007214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35e2c613-4570-4055-843b-9521179fe51a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:43.007811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35e2c613-4570-4055-843b-9521179fe51a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:43.008849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35e2c613-4570-4055-843b-9521179fe51a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:43.009360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35e2c613-4570-4055-843b-9521179fe51a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:43.303331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-35e2c613-4570-4055-843b-9521179fe51a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:43.314369 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-35e2c613-4570-4055-843b-9521179fe51a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1365 microversion: 2.1 time: 0.320316 Feb 19 21:00:43.317668 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1351/2609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:42 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:43.324354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-55da8726-caa2-4cf3-a68a-933b5734565c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64676ce820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:43.334654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.processutils [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpsgl83qpa/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsgl83qpa/temp.key -subj /CN=8a3840a896784f8ba53135b4e0b69ff3 -extensions v3_req_client" returned: 0 in 0.369s {{(pid=136095) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:00:43.335604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.processutils [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpsgl83qpa/temp.key -password pass: {{(pid=136095) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 19 21:00:43.389248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.processutils [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpsgl83qpa/temp.key -password pass:" returned: 0 in 0.053s {{(pid=136095) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 19 21:00:43.475943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:43.484820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Getting quotas for user 8a3840a896784f8ba53135b4e0b69ff3 and project 06bdf3b5a58d4dd7bdb8a4c060271591. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:43.524949 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c376d59c-2289-44cd-b4fb-8dcddb69303d tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.604195 Feb 19 21:00:43.525957 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1259/2610] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Feb 19 21:00:42 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 606 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:43.535222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fbbde0a9-87c9-4265-928c-458ab80d6ce0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:43.536053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fbbde0a9-87c9-4265-928c-458ab80d6ce0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:43.545649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbbde0a9-87c9-4265-928c-458ab80d6ce0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:43.546579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbbde0a9-87c9-4265-928c-458ab80d6ce0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:43.547780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbbde0a9-87c9-4265-928c-458ab80d6ce0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:43.548490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbbde0a9-87c9-4265-928c-458ab80d6ce0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:43.805678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fbbde0a9-87c9-4265-928c-458ab80d6ce0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:43.820817 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fbbde0a9-87c9-4265-928c-458ab80d6ce0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.292987 Feb 19 21:00:43.822182 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1260/2611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:43 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:43.828355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4c74f6d-9632-44a6-88cf-3ac64e700e13 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:43.830426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e4c74f6d-9632-44a6-88cf-3ac64e700e13 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:43.838014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4c74f6d-9632-44a6-88cf-3ac64e700e13 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:43.839015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4c74f6d-9632-44a6-88cf-3ac64e700e13 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:43.839977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4c74f6d-9632-44a6-88cf-3ac64e700e13 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:43.840906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4c74f6d-9632-44a6-88cf-3ac64e700e13 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:44.052816 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-55da8726-caa2-4cf3-a68a-933b5734565c tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "DELETE /compute/v2.1/images/36e9b14f-f68c-4729-bc61-ce0d46c4a36c" status: 204 len: 0 microversion: 2.1 time: 0.732844 Feb 19 21:00:44.053661 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1352/2612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:43 2022] DELETE /compute/v2.1/images/36e9b14f-f68c-4729-bc61-ce0d46c4a36c => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:44.058244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c1fac344-513d-4196-b85f-306c35668e34 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f64676e9820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:44.069675 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c1fac344-513d-4196-b85f-306c35668e34 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-2083674059" status: 200 len: 1534 microversion: 2.2 time: 0.014568 Feb 19 21:00:44.075320 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1353/2613] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Feb 19 21:00:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2083674059 => generated 1534 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:44.085121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7de72c1c-36e1-4d7c-bb99-f0752e78140f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] Calling method '.version_select at 0x7f64791281f0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:44.120702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e4c74f6d-9632-44a6-88cf-3ac64e700e13 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:44.130529 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e4c74f6d-9632-44a6-88cf-3ac64e700e13 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1324 microversion: 2.1 time: 0.306782 Feb 19 21:00:44.141058 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1261/2614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:43 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1324 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:44.151361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-46c63103-f71e-469c-b7ec-dd7e6c2d23f0 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f6467531280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:44.163977 ncdv-master-1 devstack@n-api.service[136095]: WARNING oslo_db.sqlalchemy.utils [None req-46c63103-f71e-469c-b7ec-dd7e6c2d23f0 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 19 21:00:44.178176 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-46c63103-f71e-469c-b7ec-dd7e6c2d23f0 tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.035896 Feb 19 21:00:44.178799 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1262/2615] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Feb 19 21:00:44 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:44.196364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1b51a79a-d8f0-402a-a1ea-c6712bd52e0c tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] Calling method '.version_select at 0x7f6479159550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:44.246677 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1b51a79a-d8f0-402a-a1ea-c6712bd52e0c tempest-KeyPairsV22TestJSON-591247099 tempest-KeyPairsV22TestJSON-591247099-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083674059" status: 204 len: 0 microversion: 2.2 time: 0.058713 Feb 19 21:00:44.247278 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1263/2616] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Feb 19 21:00:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083674059 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:44.257503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-9d6e8c24-be6d-4d6e-ae24-41c52bb61a2e req-cffbcf88-400f-4be6-9f8b-b66db1355526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3efa67c8-3252-425b-8367-d3f479832357", "name": "network-vif-plugged", "status": "completed", "tag": "09c89639-efa3-4a90-ae46-d10a6795fa74"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:44.259411 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:44.259411 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:44.280282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9d6e8c24-be6d-4d6e-ae24-41c52bb61a2e req-cffbcf88-400f-4be6-9f8b-b66db1355526 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:44.280779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9d6e8c24-be6d-4d6e-ae24-41c52bb61a2e req-cffbcf88-400f-4be6-9f8b-b66db1355526 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:44.305175 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-9d6e8c24-be6d-4d6e-ae24-41c52bb61a2e req-cffbcf88-400f-4be6-9f8b-b66db1355526 service nova] Creating event network-vif-plugged:09c89639-efa3-4a90-ae46-d10a6795fa74 for instance 3efa67c8-3252-425b-8367-d3f479832357 on nch2-master-1 Feb 19 21:00:44.315777 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-9d6e8c24-be6d-4d6e-ae24-41c52bb61a2e req-cffbcf88-400f-4be6-9f8b-b66db1355526 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066774 Feb 19 21:00:44.316423 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1264/2617] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:44.788198 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-59a272a3-3d21-4e17-a4fe-d2e15b931503 tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] 10.222.0.30 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.470567 Feb 19 21:00:44.790002 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1265/2618] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Feb 19 21:00:44 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 19 21:00:44.803198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-106cc8b0-19c0-4e25-9727-f86ef6ed776d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:44.814429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-106cc8b0-19c0-4e25-9727-f86ef6ed776d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:44.837515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-106cc8b0-19c0-4e25-9727-f86ef6ed776d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:44.840654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-106cc8b0-19c0-4e25-9727-f86ef6ed776d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:44.841540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-106cc8b0-19c0-4e25-9727-f86ef6ed776d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:44.841987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-106cc8b0-19c0-4e25-9727-f86ef6ed776d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:44.941718 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7de72c1c-36e1-4d7c-bb99-f0752e78140f tempest-ListImageFiltersTestJSON-801007413 tempest-ListImageFiltersTestJSON-801007413-project] 10.222.0.30 "DELETE /compute/v2.1/images/56b994d5-d167-40cd-b0b3-8f83538ee3ed" status: 204 len: 0 microversion: 2.1 time: 0.866716 Feb 19 21:00:44.942469 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1354/2619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:44 2022] DELETE /compute/v2.1/images/56b994d5-d167-40cd-b0b3-8f83538ee3ed => generated 0 bytes in 871 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:00:44.953429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f39317c9-5dc8-4862-8383-a12a867c9cf6 tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Calling method '.version_select at 0x7f6479128c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:45.019224 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-f39317c9-5dc8-4862-8383-a12a867c9cf6 tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] HTTP exception thrown: Image not found. Feb 19 21:00:45.021113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f39317c9-5dc8-4862-8383-a12a867c9cf6 tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:45.022868 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f39317c9-5dc8-4862-8383-a12a867c9cf6 tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] 10.222.0.30 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.079463 Feb 19 21:00:45.024282 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1355/2620] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Feb 19 21:00:44 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:45.037821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b8ba3104-cd49-4a7d-8c31-38c0f3f38075 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:45.038453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b8ba3104-cd49-4a7d-8c31-38c0f3f38075 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:45.057400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8ba3104-cd49-4a7d-8c31-38c0f3f38075 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:45.058045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8ba3104-cd49-4a7d-8c31-38c0f3f38075 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:45.068226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8ba3104-cd49-4a7d-8c31-38c0f3f38075 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:45.068796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8ba3104-cd49-4a7d-8c31-38c0f3f38075 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:45.239957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-106cc8b0-19c0-4e25-9727-f86ef6ed776d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:45.252106 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-106cc8b0-19c0-4e25-9727-f86ef6ed776d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1365 microversion: 2.1 time: 0.458638 Feb 19 21:00:45.256703 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1266/2621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:44 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:45.268448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-824ac2ce-3574-413a-a6fa-d0d96734bd7f tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Calling method '.version_select at 0x7f6479163430>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:45.305563 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-824ac2ce-3574-413a-a6fa-d0d96734bd7f tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] HTTP exception thrown: Image not found. Feb 19 21:00:45.306393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-824ac2ce-3574-413a-a6fa-d0d96734bd7f tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Returning 404 to user: Image not found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:45.307934 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-824ac2ce-3574-413a-a6fa-d0d96734bd7f tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] 10.222.0.30 "DELETE /compute/v2.1/images/c9627a89-f566-4b13-9ba1-557e4284a82j" status: 404 len: 62 microversion: 2.1 time: 0.050129 Feb 19 21:00:45.308954 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1267/2622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:45 2022] DELETE /compute/v2.1/images/c9627a89-f566-4b13-9ba1-557e4284a82j => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:45.320110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3ff682f2-8dce-4a32-bb28-85a34e51cda6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:45.321420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3ff682f2-8dce-4a32-bb28-85a34e51cda6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:45.335187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ff682f2-8dce-4a32-bb28-85a34e51cda6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:45.344269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ff682f2-8dce-4a32-bb28-85a34e51cda6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:45.345381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ff682f2-8dce-4a32-bb28-85a34e51cda6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:45.345973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ff682f2-8dce-4a32-bb28-85a34e51cda6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:45.621260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b8ba3104-cd49-4a7d-8c31-38c0f3f38075 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:45.642269 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b8ba3104-cd49-4a7d-8c31-38c0f3f38075 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.616288 Feb 19 21:00:45.645196 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1356/2623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:45 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:45.653083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-40a537ca-952b-4bad-bd89-398a13f33277 tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Calling method '.version_select at 0x7f64676efaf0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:45.681977 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-40a537ca-952b-4bad-bd89-398a13f33277 tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] HTTP exception thrown: Image not found. Feb 19 21:00:45.683379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-40a537ca-952b-4bad-bd89-398a13f33277 tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:45.686250 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-40a537ca-952b-4bad-bd89-398a13f33277 tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] 10.222.0.30 "DELETE /compute/v2.1/images/120a900a-5bbf-4d0e-aa94-83f7674db8601" status: 404 len: 62 microversion: 2.1 time: 0.038049 Feb 19 21:00:45.687891 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1357/2624] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:00:45 2022] DELETE /compute/v2.1/images/120a900a-5bbf-4d0e-aa94-83f7674db8601 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:45.700101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c374286c-9bbd-43bd-9c2a-f816a1a963cc tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Calling method '.version_select at 0x7f64791285e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:45.735670 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-c374286c-9bbd-43bd-9c2a-f816a1a963cc tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] HTTP exception thrown: Image not found. Feb 19 21:00:45.736270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c374286c-9bbd-43bd-9c2a-f816a1a963cc tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:45.737157 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c374286c-9bbd-43bd-9c2a-f816a1a963cc tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] 10.222.0.30 "DELETE /compute/v2.1/images/tempest-invalid-882957442" status: 404 len: 62 microversion: 2.1 time: 0.044186 Feb 19 21:00:45.738137 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1358/2625] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Feb 19 21:00:45 2022] DELETE /compute/v2.1/images/tempest-invalid-882957442 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:45.751746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-adbf84e9-7d39-4f8b-b700-4923484a3d4d tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Calling method '.version_select at 0x7f64676ef5e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:45.755120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3ff682f2-8dce-4a32-bb28-85a34e51cda6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:45.779657 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3ff682f2-8dce-4a32-bb28-85a34e51cda6 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1324 microversion: 2.1 time: 0.463520 Feb 19 21:00:45.784085 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1268/2626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:45 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:45.794906 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-adbf84e9-7d39-4f8b-b700-4923484a3d4d tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] HTTP exception thrown: Image not found. Feb 19 21:00:45.795951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-adbf84e9-7d39-4f8b-b700-4923484a3d4d tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:45.796912 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-adbf84e9-7d39-4f8b-b700-4923484a3d4d tempest-ImagesDeleteNegativeTestJSON-1455890435 tempest-ImagesDeleteNegativeTestJSON-1455890435-project] 10.222.0.30 "DELETE /compute/v2.1/images/76e25d8f-2a69-48e3-a732-26df3381231a" status: 404 len: 62 microversion: 2.1 time: 0.053591 Feb 19 21:00:45.798148 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1359/2627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:45 2022] DELETE /compute/v2.1/images/76e25d8f-2a69-48e3-a732-26df3381231a => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 19 21:00:46.272485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-49990f50-c134-432e-b4a5-97495b53536d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:46.273671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-49990f50-c134-432e-b4a5-97495b53536d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:46.282173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49990f50-c134-432e-b4a5-97495b53536d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:46.282632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49990f50-c134-432e-b4a5-97495b53536d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:46.283525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49990f50-c134-432e-b4a5-97495b53536d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:46.283902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49990f50-c134-432e-b4a5-97495b53536d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:46.591766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-49990f50-c134-432e-b4a5-97495b53536d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:46.601151 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-49990f50-c134-432e-b4a5-97495b53536d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1365 microversion: 2.1 time: 0.332438 Feb 19 21:00:46.608725 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1269/2628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:46 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:46.658763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1526024c-c1c5-4448-a9d1-abc0dbba98c1 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:46.659372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1526024c-c1c5-4448-a9d1-abc0dbba98c1 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:46.668362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1526024c-c1c5-4448-a9d1-abc0dbba98c1 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:46.668984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1526024c-c1c5-4448-a9d1-abc0dbba98c1 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:46.670789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1526024c-c1c5-4448-a9d1-abc0dbba98c1 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:46.671464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1526024c-c1c5-4448-a9d1-abc0dbba98c1 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:46.798536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c0a01154-6132-4953-b008-12370b4b0653 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:46.799439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c0a01154-6132-4953-b008-12370b4b0653 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:46.818259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0a01154-6132-4953-b008-12370b4b0653 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:46.818732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0a01154-6132-4953-b008-12370b4b0653 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:46.825052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0a01154-6132-4953-b008-12370b4b0653 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:46.825512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0a01154-6132-4953-b008-12370b4b0653 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:47.077769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1526024c-c1c5-4448-a9d1-abc0dbba98c1 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:47.090286 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1526024c-c1c5-4448-a9d1-abc0dbba98c1 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.434546 Feb 19 21:00:47.092010 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1360/2629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:46 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:47.095490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c0a01154-6132-4953-b008-12370b4b0653 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:47.105445 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c0a01154-6132-4953-b008-12370b4b0653 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1521 microversion: 2.1 time: 0.311138 Feb 19 21:00:47.106532 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1270/2630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:46 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:47.123874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ca161a87-e4a6-458e-814e-312eeb4398c0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:47.124634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ca161a87-e4a6-458e-814e-312eeb4398c0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:47.131295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca161a87-e4a6-458e-814e-312eeb4398c0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:47.131939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca161a87-e4a6-458e-814e-312eeb4398c0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:47.132763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca161a87-e4a6-458e-814e-312eeb4398c0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:47.133344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca161a87-e4a6-458e-814e-312eeb4398c0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:47.162115 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ca161a87-e4a6-458e-814e-312eeb4398c0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] HTTP exception thrown: Instance is not a member of specified network Feb 19 21:00:47.162942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ca161a87-e4a6-458e-814e-312eeb4398c0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Returning 404 to user: Instance is not a member of specified network {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:47.164003 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ca161a87-e4a6-458e-814e-312eeb4398c0 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.043987 Feb 19 21:00:47.165376 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1361/2631] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:00:47 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357/ips/invalid => generated 91 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:47.175060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-62a29ebd-5eac-4b1f-9884-6ac5c0c35f32 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:47.175557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-62a29ebd-5eac-4b1f-9884-6ac5c0c35f32 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Failed to fetch instance by id 999 {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2871}} Feb 19 21:00:47.176085 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-62a29ebd-5eac-4b1f-9884-6ac5c0c35f32 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] HTTP exception thrown: Instance 999 could not be found. Feb 19 21:00:47.176783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-62a29ebd-5eac-4b1f-9884-6ac5c0c35f32 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Returning 404 to user: Instance 999 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:47.177574 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-62a29ebd-5eac-4b1f-9884-6ac5c0c35f32 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.006763 Feb 19 21:00:47.178323 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1271/2632] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Feb 19 21:00:47 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:00:47.187442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4ec0a6dc-c954-4815-8370-4bad7f315805 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:47.188113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4ec0a6dc-c954-4815-8370-4bad7f315805 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:47.194515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ec0a6dc-c954-4815-8370-4bad7f315805 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:47.195198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ec0a6dc-c954-4815-8370-4bad7f315805 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:47.196136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ec0a6dc-c954-4815-8370-4bad7f315805 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:47.196744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ec0a6dc-c954-4815-8370-4bad7f315805 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:47.233926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4ec0a6dc-c954-4815-8370-4bad7f315805 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:00:47.339422 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4ec0a6dc-c954-4815-8370-4bad7f315805 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 204 len: 0 microversion: 2.1 time: 0.155633 Feb 19 21:00:47.340503 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1362/2633] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:00:47 2022] DELETE /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:00:47.351893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-093f99c4-1592-4b89-9954-aebbfe3d3da8 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:47.352298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-093f99c4-1592-4b89-9954-aebbfe3d3da8 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:47.365000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-093f99c4-1592-4b89-9954-aebbfe3d3da8 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:47.365783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-093f99c4-1592-4b89-9954-aebbfe3d3da8 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:47.366572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-093f99c4-1592-4b89-9954-aebbfe3d3da8 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:47.367015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-093f99c4-1592-4b89-9954-aebbfe3d3da8 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:47.594703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-093f99c4-1592-4b89-9954-aebbfe3d3da8 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:47.602818 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-093f99c4-1592-4b89-9954-aebbfe3d3da8 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1527 microversion: 2.1 time: 0.255108 Feb 19 21:00:47.605491 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1272/2634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:47 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1527 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:47.621404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c60e72c3-11aa-4091-a52a-8b26f2ff17cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:47.622372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c60e72c3-11aa-4091-a52a-8b26f2ff17cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:47.630399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c60e72c3-11aa-4091-a52a-8b26f2ff17cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:47.631125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c60e72c3-11aa-4091-a52a-8b26f2ff17cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:47.632112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c60e72c3-11aa-4091-a52a-8b26f2ff17cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:47.632769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c60e72c3-11aa-4091-a52a-8b26f2ff17cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:47.862159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c60e72c3-11aa-4091-a52a-8b26f2ff17cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:47.871482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c60e72c3-11aa-4091-a52a-8b26f2ff17cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1365 microversion: 2.1 time: 0.254972 Feb 19 21:00:47.873280 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1363/2635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:47 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:48.108243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d2ff0cd-cc9e-486a-ab4b-a17769f3fecb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:48.108876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1d2ff0cd-cc9e-486a-ab4b-a17769f3fecb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:48.116598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d2ff0cd-cc9e-486a-ab4b-a17769f3fecb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.120876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d2ff0cd-cc9e-486a-ab4b-a17769f3fecb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.122299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d2ff0cd-cc9e-486a-ab4b-a17769f3fecb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.122957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d2ff0cd-cc9e-486a-ab4b-a17769f3fecb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.358992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e7438569-50be-4c56-95f5-28f076d0e007 tempest-AbsoluteLimitsTestJSON-335879847 tempest-AbsoluteLimitsTestJSON-335879847-project] Calling method '.version_select at 0x7f6467569940>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:48.371534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7438569-50be-4c56-95f5-28f076d0e007 tempest-AbsoluteLimitsTestJSON-335879847 tempest-AbsoluteLimitsTestJSON-335879847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.372944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7438569-50be-4c56-95f5-28f076d0e007 tempest-AbsoluteLimitsTestJSON-335879847 tempest-AbsoluteLimitsTestJSON-335879847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.374061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7438569-50be-4c56-95f5-28f076d0e007 tempest-AbsoluteLimitsTestJSON-335879847 tempest-AbsoluteLimitsTestJSON-335879847-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.374745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7438569-50be-4c56-95f5-28f076d0e007 tempest-AbsoluteLimitsTestJSON-335879847 tempest-AbsoluteLimitsTestJSON-335879847-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.395451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d2ff0cd-cc9e-486a-ab4b-a17769f3fecb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:48.405465 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d2ff0cd-cc9e-486a-ab4b-a17769f3fecb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.298587 Feb 19 21:00:48.406888 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1364/2636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:48 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:48.423625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0b9d2517-7607-4f57-967c-82f70739a028 req-89697cdc-e60d-491b-b4fd-c07e08148191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "name": "network-vif-plugged", "status": "completed", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:48.425937 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:48.425937 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:00:48.433378 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e7438569-50be-4c56-95f5-28f076d0e007 tempest-AbsoluteLimitsTestJSON-335879847 tempest-AbsoluteLimitsTestJSON-335879847-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.370550 Feb 19 21:00:48.436490 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1273/2637] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Feb 19 21:00:48 2022] GET /compute/v2.1/limits => generated 511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:48.447138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0b9d2517-7607-4f57-967c-82f70739a028 req-89697cdc-e60d-491b-b4fd-c07e08148191 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.448020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0b9d2517-7607-4f57-967c-82f70739a028 req-89697cdc-e60d-491b-b4fd-c07e08148191 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.466249 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0b9d2517-7607-4f57-967c-82f70739a028 req-89697cdc-e60d-491b-b4fd-c07e08148191 service nova] Creating event network-vif-plugged:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:00:48.472486 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0b9d2517-7607-4f57-967c-82f70739a028 req-89697cdc-e60d-491b-b4fd-c07e08148191 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064096 Feb 19 21:00:48.473363 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1365/2638] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:48.622228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c2b5dbe-d51c-452e-b7ec-4707e7d7c4cf tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:48.623008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7c2b5dbe-d51c-452e-b7ec-4707e7d7c4cf tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:48.633427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c2b5dbe-d51c-452e-b7ec-4707e7d7c4cf tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.634224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c2b5dbe-d51c-452e-b7ec-4707e7d7c4cf tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.640028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c2b5dbe-d51c-452e-b7ec-4707e7d7c4cf tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.640657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c2b5dbe-d51c-452e-b7ec-4707e7d7c4cf tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.940671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7c2b5dbe-d51c-452e-b7ec-4707e7d7c4cf tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:48.951115 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c2b5dbe-d51c-452e-b7ec-4707e7d7c4cf tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1527 microversion: 2.1 time: 0.332311 Feb 19 21:00:48.952054 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1366/2639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:48 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1527 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:48.956776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e39953c-6a90-42bd-be9a-930581f0339c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:48.957379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e39953c-6a90-42bd-be9a-930581f0339c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:48.963415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e39953c-6a90-42bd-be9a-930581f0339c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.963871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e39953c-6a90-42bd-be9a-930581f0339c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.964755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e39953c-6a90-42bd-be9a-930581f0339c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.965343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e39953c-6a90-42bd-be9a-930581f0339c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.988868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e74eadb3-f5d9-451f-971c-fb0bd9e9cab2 tempest-AZV2TestJSON-1356933494 tempest-AZV2TestJSON-1356933494-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:48.990905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e74eadb3-f5d9-451f-971c-fb0bd9e9cab2 tempest-AZV2TestJSON-1356933494 tempest-AZV2TestJSON-1356933494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.991562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e74eadb3-f5d9-451f-971c-fb0bd9e9cab2 tempest-AZV2TestJSON-1356933494 tempest-AZV2TestJSON-1356933494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:48.992891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e74eadb3-f5d9-451f-971c-fb0bd9e9cab2 tempest-AZV2TestJSON-1356933494 tempest-AZV2TestJSON-1356933494-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:48.993515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e74eadb3-f5d9-451f-971c-fb0bd9e9cab2 tempest-AZV2TestJSON-1356933494 tempest-AZV2TestJSON-1356933494-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:49.047499 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e74eadb3-f5d9-451f-971c-fb0bd9e9cab2 tempest-AZV2TestJSON-1356933494 tempest-AZV2TestJSON-1356933494-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.434541 Feb 19 21:00:49.049333 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1274/2640] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Feb 19 21:00:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:00:49.171289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e39953c-6a90-42bd-be9a-930581f0339c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:49.181690 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e39953c-6a90-42bd-be9a-930581f0339c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1365 microversion: 2.1 time: 0.228341 Feb 19 21:00:49.182903 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1367/2641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:48 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:49.423952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d5158947-6e3e-4755-864d-b744106b21b6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:49.426062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d5158947-6e3e-4755-864d-b744106b21b6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:49.436105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5158947-6e3e-4755-864d-b744106b21b6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:49.436870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5158947-6e3e-4755-864d-b744106b21b6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:49.437954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5158947-6e3e-4755-864d-b744106b21b6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:49.438868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5158947-6e3e-4755-864d-b744106b21b6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:49.617101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d5158947-6e3e-4755-864d-b744106b21b6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:49.629011 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d5158947-6e3e-4755-864d-b744106b21b6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.209624 Feb 19 21:00:49.629675 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1275/2642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:49 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:49.968271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-90c2b18e-54be-4fc4-8aca-ea77a809cb3d tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:49.968918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-90c2b18e-54be-4fc4-8aca-ea77a809cb3d tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:49.977680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90c2b18e-54be-4fc4-8aca-ea77a809cb3d tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:49.978473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90c2b18e-54be-4fc4-8aca-ea77a809cb3d tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:49.980318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90c2b18e-54be-4fc4-8aca-ea77a809cb3d tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:49.981218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90c2b18e-54be-4fc4-8aca-ea77a809cb3d tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:49.991313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1264594389", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:50.086663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:00:50.237387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-90c2b18e-54be-4fc4-8aca-ea77a809cb3d tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e219f40a5174a76a7ae73622dafbbd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72053a62e744590945ce7fd8a1f33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:50.254136 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-90c2b18e-54be-4fc4-8aca-ea77a809cb3d tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 200 len: 1485 microversion: 2.1 time: 0.289865 Feb 19 21:00:50.255300 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1276/2643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:49 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 1485 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:50.268817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bb789794-5e24-4623-84f4-6d4664f9aee7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:50.269688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bb789794-5e24-4623-84f4-6d4664f9aee7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:50.277233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb789794-5e24-4623-84f4-6d4664f9aee7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:50.279984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb789794-5e24-4623-84f4-6d4664f9aee7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:50.281727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb789794-5e24-4623-84f4-6d4664f9aee7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:50.283418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb789794-5e24-4623-84f4-6d4664f9aee7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:50.689600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:00:50.690263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:00:50.690901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:00:50.691921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:00:50.692224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:00:50.713491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:50.713491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:50.714858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:50.715149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:50.738222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Getting quotas for project 25f76e9ca2f54ad98c30b0dc6351be5c. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:00:50.743743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Getting quotas for user 9596b0d7c4a1461db4bbe63e2524f0e1 and project 25f76e9ca2f54ad98c30b0dc6351be5c. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:00:50.767094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bb789794-5e24-4623-84f4-6d4664f9aee7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:50.771846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:00:50.774646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:00:50.789040 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bb789794-5e24-4623-84f4-6d4664f9aee7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1551 microversion: 2.1 time: 0.532188 Feb 19 21:00:50.790421 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1277/2644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:50 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1551 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:50.806032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5c2b2f67-dcac-4e62-9188-a73c69e0b5cb req-cb46b821-77d3-407b-86ab-14b5271595dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3efa67c8-3252-425b-8367-d3f479832357", "name": "network-vif-deleted", "tag": "09c89639-efa3-4a90-ae46-d10a6795fa74"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:50.808141 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:50.808141 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:50.824358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5c2b2f67-dcac-4e62-9188-a73c69e0b5cb req-cb46b821-77d3-407b-86ab-14b5271595dc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:50.826519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5c2b2f67-dcac-4e62-9188-a73c69e0b5cb req-cb46b821-77d3-407b-86ab-14b5271595dc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:50.850220 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5c2b2f67-dcac-4e62-9188-a73c69e0b5cb req-cb46b821-77d3-407b-86ab-14b5271595dc service nova] Creating event network-vif-deleted:09c89639-efa3-4a90-ae46-d10a6795fa74 for instance 3efa67c8-3252-425b-8367-d3f479832357 on nch2-master-1 Feb 19 21:00:50.860860 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e09f2202-74bf-4fa8-9279-6bdecf0187cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.196420 Feb 19 21:00:50.861515 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1368/2645] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:00:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:00:50.865361 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5c2b2f67-dcac-4e62-9188-a73c69e0b5cb req-cb46b821-77d3-407b-86ab-14b5271595dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073452 Feb 19 21:00:50.869130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-85d60528-bc19-4143-bc7a-c6100ae266c6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:50.869593 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1278/2646] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:50.874625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-85d60528-bc19-4143-bc7a-c6100ae266c6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:50.878685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-687a8dda-828b-42ac-a693-023d30e487c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:50.884541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-687a8dda-828b-42ac-a693-023d30e487c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:50.902232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85d60528-bc19-4143-bc7a-c6100ae266c6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:50.905733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85d60528-bc19-4143-bc7a-c6100ae266c6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:50.907526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85d60528-bc19-4143-bc7a-c6100ae266c6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:50.922398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85d60528-bc19-4143-bc7a-c6100ae266c6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:50.930023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-687a8dda-828b-42ac-a693-023d30e487c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:50.933572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-687a8dda-828b-42ac-a693-023d30e487c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:50.937207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-687a8dda-828b-42ac-a693-023d30e487c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:50.938179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-687a8dda-828b-42ac-a693-023d30e487c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:51.280273 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-687a8dda-828b-42ac-a693-023d30e487c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.409003 Feb 19 21:00:51.280940 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1279/2647] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:00:50 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/os-interface => generated 284 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:51.294905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ddc694f9-8729-4464-8b64-0acf58089168 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:51.295526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ddc694f9-8729-4464-8b64-0acf58089168 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:51.384324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ddc694f9-8729-4464-8b64-0acf58089168 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:51.400863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-85d60528-bc19-4143-bc7a-c6100ae266c6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:51.411446 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-85d60528-bc19-4143-bc7a-c6100ae266c6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.547127 Feb 19 21:00:51.412808 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ddc694f9-8729-4464-8b64-0acf58089168 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1217 microversion: 2.1 time: 0.129091 Feb 19 21:00:51.423116 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1369/2648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:50 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:51.428032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-857f88f5-4092-4ed7-8c80-95eea3524245 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:51.428566 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1280/2649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:51 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:51.429216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-857f88f5-4092-4ed7-8c80-95eea3524245 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] [instance: 3efa67c8-3252-425b-8367-d3f479832357] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:51.440171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-857f88f5-4092-4ed7-8c80-95eea3524245 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:51.440791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-857f88f5-4092-4ed7-8c80-95eea3524245 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:51.441895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-857f88f5-4092-4ed7-8c80-95eea3524245 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:51.442659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-857f88f5-4092-4ed7-8c80-95eea3524245 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:51.459330 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-857f88f5-4092-4ed7-8c80-95eea3524245 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] HTTP exception thrown: Instance 3efa67c8-3252-425b-8367-d3f479832357 could not be found. Feb 19 21:00:51.460222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-857f88f5-4092-4ed7-8c80-95eea3524245 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] Returning 404 to user: Instance 3efa67c8-3252-425b-8367-d3f479832357 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:00:51.461563 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-857f88f5-4092-4ed7-8c80-95eea3524245 tempest-ServerAddressesNegativeTestJSON-1936661614 tempest-ServerAddressesNegativeTestJSON-1936661614-project] 10.222.0.30 "GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357" status: 404 len: 111 microversion: 2.1 time: 0.036930 Feb 19 21:00:51.466219 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1370/2650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:51 2022] GET /compute/v2.1/servers/3efa67c8-3252-425b-8367-d3f479832357 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:00:52.429170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad00dcee-c70e-4f4f-b191-1546405c7ba0 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:52.429765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e5dc0521-6817-4c0a-b682-bc4c836ad5fd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:52.430102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ad00dcee-c70e-4f4f-b191-1546405c7ba0 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:52.430195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e5dc0521-6817-4c0a-b682-bc4c836ad5fd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:52.442987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad00dcee-c70e-4f4f-b191-1546405c7ba0 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:52.443444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad00dcee-c70e-4f4f-b191-1546405c7ba0 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:52.444251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad00dcee-c70e-4f4f-b191-1546405c7ba0 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:52.445694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad00dcee-c70e-4f4f-b191-1546405c7ba0 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:52.452197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5dc0521-6817-4c0a-b682-bc4c836ad5fd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:52.452713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5dc0521-6817-4c0a-b682-bc4c836ad5fd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:52.455952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5dc0521-6817-4c0a-b682-bc4c836ad5fd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:52.458056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5dc0521-6817-4c0a-b682-bc4c836ad5fd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:52.613668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ad00dcee-c70e-4f4f-b191-1546405c7ba0 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:52.628770 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ad00dcee-c70e-4f4f-b191-1546405c7ba0 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1287 microversion: 2.1 time: 0.203179 Feb 19 21:00:52.629708 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1371/2651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:52 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1287 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:53.171096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e5dc0521-6817-4c0a-b682-bc4c836ad5fd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:53.179783 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e5dc0521-6817-4c0a-b682-bc4c836ad5fd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.754279 Feb 19 21:00:53.195492 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1281/2652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:52 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:53.654726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f03a5d1-3e34-4e8f-8a0e-2a6864c64dc3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:53.656111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f03a5d1-3e34-4e8f-8a0e-2a6864c64dc3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:53.670609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f03a5d1-3e34-4e8f-8a0e-2a6864c64dc3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:53.671358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f03a5d1-3e34-4e8f-8a0e-2a6864c64dc3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:53.672550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f03a5d1-3e34-4e8f-8a0e-2a6864c64dc3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:53.673145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f03a5d1-3e34-4e8f-8a0e-2a6864c64dc3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:53.820005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f03a5d1-3e34-4e8f-8a0e-2a6864c64dc3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:53.831990 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f03a5d1-3e34-4e8f-8a0e-2a6864c64dc3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1275 microversion: 2.1 time: 0.186974 Feb 19 21:00:53.833440 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1372/2653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:53 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:54.199248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a087b17e-b77a-4fb2-a7ab-6ba9b5f9c2a2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:54.199874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a087b17e-b77a-4fb2-a7ab-6ba9b5f9c2a2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:54.209827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a087b17e-b77a-4fb2-a7ab-6ba9b5f9c2a2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:54.212018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a087b17e-b77a-4fb2-a7ab-6ba9b5f9c2a2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:54.212880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a087b17e-b77a-4fb2-a7ab-6ba9b5f9c2a2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:54.214975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a087b17e-b77a-4fb2-a7ab-6ba9b5f9c2a2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:54.609414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2f39786-ea97-4f45-8514-6d9eb7e82e85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:54.609900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b2f39786-ea97-4f45-8514-6d9eb7e82e85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:54.613651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a087b17e-b77a-4fb2-a7ab-6ba9b5f9c2a2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:54.616813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2f39786-ea97-4f45-8514-6d9eb7e82e85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:54.618285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2f39786-ea97-4f45-8514-6d9eb7e82e85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:54.619261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2f39786-ea97-4f45-8514-6d9eb7e82e85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:54.619925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2f39786-ea97-4f45-8514-6d9eb7e82e85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:54.624775 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a087b17e-b77a-4fb2-a7ab-6ba9b5f9c2a2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.429472 Feb 19 21:00:54.626890 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1282/2654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:54 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:54.649199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-71baaacb-1774-49bc-99ff-bca89dda10da req-c41159ca-2446-47c9-8730-509d05f83d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:54.657932 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:54.657932 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:54.682493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-71baaacb-1774-49bc-99ff-bca89dda10da req-c41159ca-2446-47c9-8730-509d05f83d66 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:54.683239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-71baaacb-1774-49bc-99ff-bca89dda10da req-c41159ca-2446-47c9-8730-509d05f83d66 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:54.712692 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-71baaacb-1774-49bc-99ff-bca89dda10da req-c41159ca-2446-47c9-8730-509d05f83d66 service nova] Creating event network-changed:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:00:54.727085 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-71baaacb-1774-49bc-99ff-bca89dda10da req-c41159ca-2446-47c9-8730-509d05f83d66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097673 Feb 19 21:00:54.727949 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1283/2655] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:00:54.854382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-05353419-248d-4fc9-bbe3-e8066621f887 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:54.855589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-05353419-248d-4fc9-bbe3-e8066621f887 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:54.860166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b2f39786-ea97-4f45-8514-6d9eb7e82e85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:54.869326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05353419-248d-4fc9-bbe3-e8066621f887 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:54.869777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05353419-248d-4fc9-bbe3-e8066621f887 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:54.871618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05353419-248d-4fc9-bbe3-e8066621f887 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:54.873033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05353419-248d-4fc9-bbe3-e8066621f887 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:54.893186 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2f39786-ea97-4f45-8514-6d9eb7e82e85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1551 microversion: 2.1 time: 0.284932 Feb 19 21:00:54.897476 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1373/2656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:54 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1551 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:54.918244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e09e7b90-529c-49a7-a557-0730e871347d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:54.918939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e09e7b90-529c-49a7-a557-0730e871347d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:54.937350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e09e7b90-529c-49a7-a557-0730e871347d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:54.939310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e09e7b90-529c-49a7-a557-0730e871347d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:54.940551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e09e7b90-529c-49a7-a557-0730e871347d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:54.942575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e09e7b90-529c-49a7-a557-0730e871347d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:55.103042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-05353419-248d-4fc9-bbe3-e8066621f887 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:55.111087 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-05353419-248d-4fc9-bbe3-e8066621f887 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1275 microversion: 2.1 time: 0.264146 Feb 19 21:00:55.121699 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1284/2657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:54 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:55.401333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e09e7b90-529c-49a7-a557-0730e871347d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:55.438340 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e09e7b90-529c-49a7-a557-0730e871347d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1551 microversion: 2.1 time: 0.527689 Feb 19 21:00:55.453136 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1374/2658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:54 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1551 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:55.642732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6fffc69a-01b4-4899-8d3b-15e3b74209e4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:55.643960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6fffc69a-01b4-4899-8d3b-15e3b74209e4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:55.662855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6fffc69a-01b4-4899-8d3b-15e3b74209e4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:55.663555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6fffc69a-01b4-4899-8d3b-15e3b74209e4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:55.664545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6fffc69a-01b4-4899-8d3b-15e3b74209e4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:55.666935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6fffc69a-01b4-4899-8d3b-15e3b74209e4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:56.140225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-30a45ad9-aa40-4cc4-aede-4e4a5c60c720 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:56.141648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30a45ad9-aa40-4cc4-aede-4e4a5c60c720 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:56.155544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30a45ad9-aa40-4cc4-aede-4e4a5c60c720 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:56.158409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30a45ad9-aa40-4cc4-aede-4e4a5c60c720 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:56.161855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30a45ad9-aa40-4cc4-aede-4e4a5c60c720 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:56.162336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30a45ad9-aa40-4cc4-aede-4e4a5c60c720 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:56.650187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6fffc69a-01b4-4899-8d3b-15e3b74209e4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:56.658802 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6fffc69a-01b4-4899-8d3b-15e3b74209e4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 1.019571 Feb 19 21:00:56.671976 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1285/2659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:55 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:56.671976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a3c70d85-6aea-4a24-97e0-f53bc2a87f55 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:56.671976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a3c70d85-6aea-4a24-97e0-f53bc2a87f55 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:56.691685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3c70d85-6aea-4a24-97e0-f53bc2a87f55 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:56.692138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3c70d85-6aea-4a24-97e0-f53bc2a87f55 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:56.693360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3c70d85-6aea-4a24-97e0-f53bc2a87f55 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:56.695946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3c70d85-6aea-4a24-97e0-f53bc2a87f55 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:57.094743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-30a45ad9-aa40-4cc4-aede-4e4a5c60c720 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:57.104510 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-30a45ad9-aa40-4cc4-aede-4e4a5c60c720 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1317 microversion: 2.1 time: 0.970567 Feb 19 21:00:57.105118 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1375/2660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:56 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1317 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:57.261399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a3c70d85-6aea-4a24-97e0-f53bc2a87f55 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:57.278597 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a3c70d85-6aea-4a24-97e0-f53bc2a87f55 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1551 microversion: 2.1 time: 0.607187 Feb 19 21:00:57.284547 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1286/2661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:56 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1551 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:57.676082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd05acea-a53d-4926-99f6-d18e05b58a02 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:57.676747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dd05acea-a53d-4926-99f6-d18e05b58a02 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:57.700026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd05acea-a53d-4926-99f6-d18e05b58a02 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:57.702025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd05acea-a53d-4926-99f6-d18e05b58a02 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:57.709315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd05acea-a53d-4926-99f6-d18e05b58a02 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:57.709784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd05acea-a53d-4926-99f6-d18e05b58a02 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:58.020826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-137b4356-8dc7-46ed-ba05-bcc3c52a1c98 req-5355bf4c-2c21-41f5-9c20-258a4502a65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8ab6fb-0631-4ea1-b58f-e22572722a52", "tag": "57f2a797-1cfe-462b-a115-d8f0563b8044"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:00:58.024126 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:00:58.024126 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:00:58.040509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-137b4356-8dc7-46ed-ba05-bcc3c52a1c98 req-5355bf4c-2c21-41f5-9c20-258a4502a65d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:58.043728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-137b4356-8dc7-46ed-ba05-bcc3c52a1c98 req-5355bf4c-2c21-41f5-9c20-258a4502a65d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:58.083357 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-137b4356-8dc7-46ed-ba05-bcc3c52a1c98 req-5355bf4c-2c21-41f5-9c20-258a4502a65d service nova] Creating event network-changed:57f2a797-1cfe-462b-a115-d8f0563b8044 for instance bd8ab6fb-0631-4ea1-b58f-e22572722a52 on nch2-master-1 Feb 19 21:00:58.102730 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-137b4356-8dc7-46ed-ba05-bcc3c52a1c98 req-5355bf4c-2c21-41f5-9c20-258a4502a65d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087808 Feb 19 21:00:58.108788 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1287/2662] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:00:58.127484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1665c762-7fb8-49e4-85a5-983b2ae3408c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:58.128292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1665c762-7fb8-49e4-85a5-983b2ae3408c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:58.148730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1665c762-7fb8-49e4-85a5-983b2ae3408c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:58.149241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1665c762-7fb8-49e4-85a5-983b2ae3408c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:58.156777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1665c762-7fb8-49e4-85a5-983b2ae3408c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:58.158585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1665c762-7fb8-49e4-85a5-983b2ae3408c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:58.516273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dd05acea-a53d-4926-99f6-d18e05b58a02 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:58.526840 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dd05acea-a53d-4926-99f6-d18e05b58a02 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.854341 Feb 19 21:00:58.529544 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1376/2663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:57 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:58.547241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2c5a2997-88d9-479c-aeff-1cff2bbb2a8c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:58.547965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2c5a2997-88d9-479c-aeff-1cff2bbb2a8c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:58.557995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c5a2997-88d9-479c-aeff-1cff2bbb2a8c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:58.558694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c5a2997-88d9-479c-aeff-1cff2bbb2a8c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:58.562048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c5a2997-88d9-479c-aeff-1cff2bbb2a8c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:58.562920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c5a2997-88d9-479c-aeff-1cff2bbb2a8c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:59.187216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1665c762-7fb8-49e4-85a5-983b2ae3408c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:59.207641 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1665c762-7fb8-49e4-85a5-983b2ae3408c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1317 microversion: 2.1 time: 1.089286 Feb 19 21:00:59.222254 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1288/2664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:58 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1317 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:00:59.367650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2c5a2997-88d9-479c-aeff-1cff2bbb2a8c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:00:59.402090 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2c5a2997-88d9-479c-aeff-1cff2bbb2a8c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.871459 Feb 19 21:00:59.403291 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1377/2665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:58 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:00:59.423178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2ec2cc80-d031-4fdd-9685-10570c9458e1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:59.424107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2ec2cc80-d031-4fdd-9685-10570c9458e1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:59.439003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ec2cc80-d031-4fdd-9685-10570c9458e1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:59.439476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ec2cc80-d031-4fdd-9685-10570c9458e1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:59.440299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ec2cc80-d031-4fdd-9685-10570c9458e1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:59.440769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ec2cc80-d031-4fdd-9685-10570c9458e1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:59.548271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f1b4c11-3183-4ee1-a4bd-b13271c1906f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:00:59.549057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f1b4c11-3183-4ee1-a4bd-b13271c1906f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:00:59.557752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f1b4c11-3183-4ee1-a4bd-b13271c1906f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:59.558213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f1b4c11-3183-4ee1-a4bd-b13271c1906f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:00:59.561482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f1b4c11-3183-4ee1-a4bd-b13271c1906f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:00:59.563623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f1b4c11-3183-4ee1-a4bd-b13271c1906f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:00.952092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f1b4c11-3183-4ee1-a4bd-b13271c1906f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:00.962000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f1b4c11-3183-4ee1-a4bd-b13271c1906f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 1.417765 Feb 19 21:01:00.963101 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1378/2666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:59 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:00.968143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2ec2cc80-d031-4fdd-9685-10570c9458e1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:00.970089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-12d6d793-51d9-41d2-8137-daf2a812510e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:00.970853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-12d6d793-51d9-41d2-8137-daf2a812510e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:00.979150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12d6d793-51d9-41d2-8137-daf2a812510e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:00.979867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12d6d793-51d9-41d2-8137-daf2a812510e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:00.981111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12d6d793-51d9-41d2-8137-daf2a812510e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:00.982007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12d6d793-51d9-41d2-8137-daf2a812510e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:00.985403 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2ec2cc80-d031-4fdd-9685-10570c9458e1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 1.565870 Feb 19 21:01:00.988877 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1289/2667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:00:59 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:01.391918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-442e2e48-770d-4163-80bd-16b08449cae0 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Action: 'create', calling method: .version_select at 0x7f64674bf790>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1571927369", "policies": ["affinity"]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:01.429783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-442e2e48-770d-4163-80bd-16b08449cae0 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:01.436932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-442e2e48-770d-4163-80bd-16b08449cae0 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:01.490327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-442e2e48-770d-4163-80bd-16b08449cae0 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:01.495859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-442e2e48-770d-4163-80bd-16b08449cae0 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:01.510374 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-442e2e48-770d-4163-80bd-16b08449cae0 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.517323 Feb 19 21:01:01.517316 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1290/2668] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Feb 19 21:01:00 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:01.522608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e327c208-fdb9-495c-8ee8-b1e5a8d06863 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1555139881"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:01.524502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e327c208-fdb9-495c-8ee8-b1e5a8d06863 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:01.598922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-12d6d793-51d9-41d2-8137-daf2a812510e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:01.607570 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-12d6d793-51d9-41d2-8137-daf2a812510e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1317 microversion: 2.1 time: 0.642652 Feb 19 21:01:01.608039 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1379/2669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:00 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:01.612470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab081baf-5ba3-43ab-98e2-264a3d951625 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Action: 'create', calling method: .version_select at 0x7f6467753430>, body: {"server_group": {"name": "tempest-server-group-322304341", "policies": ["affinity"]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:01.635199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ab081baf-5ba3-43ab-98e2-264a3d951625 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:01.648300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ab081baf-5ba3-43ab-98e2-264a3d951625 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:01.734905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ab081baf-5ba3-43ab-98e2-264a3d951625 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:01.741253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ab081baf-5ba3-43ab-98e2-264a3d951625 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:01.763964 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab081baf-5ba3-43ab-98e2-264a3d951625 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.153708 Feb 19 21:01:01.769265 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1380/2670] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Feb 19 21:01:01 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:01.781033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-81c96580-f124-4c93-a757-78e7efe0db33 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Action: 'create', calling method: .version_select at 0x7f6467ed30d0>, body: {"server_group": {"name": "tempest-server-group-322304341", "policies": ["affinity"]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:01.844260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e327c208-fdb9-495c-8ee8-b1e5a8d06863 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:01.852023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e327c208-fdb9-495c-8ee8-b1e5a8d06863 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:01.853073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e327c208-fdb9-495c-8ee8-b1e5a8d06863 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:01.853536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e327c208-fdb9-495c-8ee8-b1e5a8d06863 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:01.858049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-81c96580-f124-4c93-a757-78e7efe0db33 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:01.868629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-81c96580-f124-4c93-a757-78e7efe0db33 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:01.979804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-81c96580-f124-4c93-a757-78e7efe0db33 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:01.992144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-81c96580-f124-4c93-a757-78e7efe0db33 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:02.021621 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-81c96580-f124-4c93-a757-78e7efe0db33 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.248925 Feb 19 21:01:02.023649 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1381/2671] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Feb 19 21:01:01 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:02.036268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6c8700b0-9edd-4033-90be-ed60696993dd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:02.037271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6c8700b0-9edd-4033-90be-ed60696993dd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:02.055638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c8700b0-9edd-4033-90be-ed60696993dd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:02.056275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c8700b0-9edd-4033-90be-ed60696993dd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:02.057211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c8700b0-9edd-4033-90be-ed60696993dd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:02.059212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c8700b0-9edd-4033-90be-ed60696993dd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:02.267671 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e327c208-fdb9-495c-8ee8-b1e5a8d06863 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.748639 Feb 19 21:01:02.299391 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1291/2672] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:01 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Feb 19 21:01:02.316236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e504f34e-9a93-4f6a-8515-97edf1e2a412 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:02.367773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e504f34e-9a93-4f6a-8515-97edf1e2a412 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/a26ba2e3-8629-42af-9f7f-fdd93434c7ba" status: 204 len: 0 microversion: 2.1 time: 0.064022 Feb 19 21:01:02.369178 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1292/2673] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:01:02 2022] DELETE /compute/v2.1/os-server-groups/a26ba2e3-8629-42af-9f7f-fdd93434c7ba => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:01:02.387280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-53a3b195-88ab-4cc3-9f74-73ad89a6b51b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:02.413229 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-53a3b195-88ab-4cc3-9f74-73ad89a6b51b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.037465 Feb 19 21:01:02.413814 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1293/2674] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:01:02 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:02.449307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c323f609-70a6-4514-a393-e48176738c8f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:02.487892 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c323f609-70a6-4514-a393-e48176738c8f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/e15252f4-9c41-411f-ae8c-a5770554aff0" status: 204 len: 0 microversion: 2.1 time: 0.065880 Feb 19 21:01:02.489579 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1294/2675] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:01:02 2022] DELETE /compute/v2.1/os-server-groups/e15252f4-9c41-411f-ae8c-a5770554aff0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:01:02.499609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad897222-3b0b-443e-b918-647f506667af tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:02.512461 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad897222-3b0b-443e-b918-647f506667af tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.017970 Feb 19 21:01:02.513549 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1295/2676] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:01:02 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:02.526169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b9fe645a-d3d0-486d-a0c5-eac0147b867b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Action: 'create', calling method: .version_select at 0x7f64674bf5e0>, body: {"server_group": {"name": "tempest-server-group-1991575480", "policies": ["affinity"]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:02.550084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b9fe645a-d3d0-486d-a0c5-eac0147b867b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:02.557094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b9fe645a-d3d0-486d-a0c5-eac0147b867b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:02.584323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6c8700b0-9edd-4033-90be-ed60696993dd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:02.593468 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6c8700b0-9edd-4033-90be-ed60696993dd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.567757 Feb 19 21:01:02.610573 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1382/2677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:02 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:02.624203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe457aca-846b-4da8-a3af-c3445f2c4922 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:02.625374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fe457aca-846b-4da8-a3af-c3445f2c4922 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:02.631187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b9fe645a-d3d0-486d-a0c5-eac0147b867b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:02.635459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe457aca-846b-4da8-a3af-c3445f2c4922 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:02.639600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe457aca-846b-4da8-a3af-c3445f2c4922 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:02.643086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe457aca-846b-4da8-a3af-c3445f2c4922 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:02.643757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe457aca-846b-4da8-a3af-c3445f2c4922 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:02.644217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b9fe645a-d3d0-486d-a0c5-eac0147b867b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:02.671849 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b9fe645a-d3d0-486d-a0c5-eac0147b867b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.150492 Feb 19 21:01:02.677396 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1296/2678] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Feb 19 21:01:02 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:02.683962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-926bf04b-fd73-4dde-867e-18c4224da15b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:02.722754 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-926bf04b-fd73-4dde-867e-18c4224da15b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/571efb11-ed71-4cbb-bf3f-77d63d8a0817" status: 204 len: 0 microversion: 2.1 time: 0.043722 Feb 19 21:01:02.723830 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1297/2679] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:01:02 2022] DELETE /compute/v2.1/os-server-groups/571efb11-ed71-4cbb-bf3f-77d63d8a0817 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:01:02.738319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7a7d620a-7e16-425a-9556-b774923dcb2f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:02.758627 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7a7d620a-7e16-425a-9556-b774923dcb2f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027132 Feb 19 21:01:02.764440 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1298/2680] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:01:02 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:02.776020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-070da81f-9184-4293-b766-2f542bb11dfe tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Action: 'create', calling method: .version_select at 0x7f64675243a0>, body: {"server_group": {"name": "tempest-server-group-954383865", "policies": ["anti-affinity"]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:02.811135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-070da81f-9184-4293-b766-2f542bb11dfe tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:02.823689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-070da81f-9184-4293-b766-2f542bb11dfe tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:02.921981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-070da81f-9184-4293-b766-2f542bb11dfe tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:02.956651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-070da81f-9184-4293-b766-2f542bb11dfe tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_groups'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:02.995453 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-070da81f-9184-4293-b766-2f542bb11dfe tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.223997 Feb 19 21:01:02.995953 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1299/2681] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Feb 19 21:01:02 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:01:03.012824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1889c5ef-0fb4-428f-8415-c99afcfe7b1b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:03.081527 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1889c5ef-0fb4-428f-8415-c99afcfe7b1b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/6bfe1340-c0e8-4647-a455-0269a029da97" status: 204 len: 0 microversion: 2.1 time: 0.077363 Feb 19 21:01:03.085723 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1300/2682] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:01:03 2022] DELETE /compute/v2.1/os-server-groups/6bfe1340-c0e8-4647-a455-0269a029da97 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:01:03.091102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f7d63f48-8662-412b-a427-b22556ea8c33 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:03.114039 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f7d63f48-8662-412b-a427-b22556ea8c33 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027189 Feb 19 21:01:03.128678 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1301/2683] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:01:03 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:03.324910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1865486176", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "e50462f1-2728-4b94-911d-a92c71aefe29"}]}, "os:scheduler_hints": {"group": "b0453a23-1214-45dd-b28e-fc925310bb7f"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:03.428524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] validate_networks() for [('e50462f1-2728-4b94-911d-a92c71aefe29', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:01:03.623020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe457aca-846b-4da8-a3af-c3445f2c4922 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:03.632429 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fe457aca-846b-4da8-a3af-c3445f2c4922 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1317 microversion: 2.1 time: 1.012458 Feb 19 21:01:03.635223 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1383/2684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:02 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1317 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:03.641646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-008bf359-28e5-406c-ac04-6f4e683eda2a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:03.642266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-008bf359-28e5-406c-ac04-6f4e683eda2a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:03.661140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-008bf359-28e5-406c-ac04-6f4e683eda2a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:03.661579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-008bf359-28e5-406c-ac04-6f4e683eda2a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:03.663898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-008bf359-28e5-406c-ac04-6f4e683eda2a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:03.667703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-008bf359-28e5-406c-ac04-6f4e683eda2a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:04.407044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-008bf359-28e5-406c-ac04-6f4e683eda2a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:04.423844 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-008bf359-28e5-406c-ac04-6f4e683eda2a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 0.778708 Feb 19 21:01:04.424530 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1384/2685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:03 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:04.649130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6afd4377-8da8-427e-9c9c-3f5422f0e7d5 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:04.650745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6afd4377-8da8-427e-9c9c-3f5422f0e7d5 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:04.662538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6afd4377-8da8-427e-9c9c-3f5422f0e7d5 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:04.663228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6afd4377-8da8-427e-9c9c-3f5422f0e7d5 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:04.664869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6afd4377-8da8-427e-9c9c-3f5422f0e7d5 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:04.666738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6afd4377-8da8-427e-9c9c-3f5422f0e7d5 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:05.073796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:01:05.074389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:01:05.074657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:01:05.076442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:01:05.077027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:01:05.104439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:05.107457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:05.109309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:05.111194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:05.158583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:05.167330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:05.200990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:01:05.206478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:01:05.296777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=136095) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Feb 19 21:01:05.316436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6afd4377-8da8-427e-9c9c-3f5422f0e7d5 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:05.327400 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6afd4377-8da8-427e-9c9c-3f5422f0e7d5 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1317 microversion: 2.1 time: 0.682360 Feb 19 21:01:05.338610 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1385/2686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:04 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:05.342292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_group_members'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:05.351666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_group_members'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:05.443715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98e0e6ea-99c2-4402-b612-02eeee32ddbd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:05.444360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98e0e6ea-99c2-4402-b612-02eeee32ddbd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:05.456038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98e0e6ea-99c2-4402-b612-02eeee32ddbd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:05.456556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98e0e6ea-99c2-4402-b612-02eeee32ddbd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:05.457248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_group_members'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:05.461502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98e0e6ea-99c2-4402-b612-02eeee32ddbd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:05.462912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98e0e6ea-99c2-4402-b612-02eeee32ddbd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:05.470348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Getting quotas for user 9569b0a569a745e797618d42bad7c795 and project 65cfeab9ddf04555a7e2fdb0ee8ebc42. Resources: {'server_group_members'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:05.582732 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d07aa4ed-58e8-4eb2-9d6f-b437b598bb45 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.260004 Feb 19 21:01:05.591637 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1302/2687] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:01:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:01:05.605300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-79d0d8e4-c437-4929-9d08-e98eddbceb54 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:05.607914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-79d0d8e4-c437-4929-9d08-e98eddbceb54 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:06.165636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79d0d8e4-c437-4929-9d08-e98eddbceb54 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:06.177205 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-79d0d8e4-c437-4929-9d08-e98eddbceb54 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1213 microversion: 2.1 time: 0.583196 Feb 19 21:01:06.190148 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1303/2688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:05 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1213 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:06.359370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-04365d3e-9e9e-4016-9b56-a6f09d9cb345 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:06.360359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-04365d3e-9e9e-4016-9b56-a6f09d9cb345 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:06.384781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04365d3e-9e9e-4016-9b56-a6f09d9cb345 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:06.385262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04365d3e-9e9e-4016-9b56-a6f09d9cb345 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:06.386092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04365d3e-9e9e-4016-9b56-a6f09d9cb345 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:06.386533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04365d3e-9e9e-4016-9b56-a6f09d9cb345 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:07.480751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-98e0e6ea-99c2-4402-b612-02eeee32ddbd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:07.490693 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-98e0e6ea-99c2-4402-b612-02eeee32ddbd tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 2.052845 Feb 19 21:01:07.502755 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1386/2689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:05 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:07.509501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c154bd5-6bd9-4d1c-aa0c-58b410578db7 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:07.510422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3c154bd5-6bd9-4d1c-aa0c-58b410578db7 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:07.518670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c154bd5-6bd9-4d1c-aa0c-58b410578db7 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:07.519317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c154bd5-6bd9-4d1c-aa0c-58b410578db7 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:07.520281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c154bd5-6bd9-4d1c-aa0c-58b410578db7 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:07.520909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c154bd5-6bd9-4d1c-aa0c-58b410578db7 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:07.588931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-04365d3e-9e9e-4016-9b56-a6f09d9cb345 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:07.602480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-04365d3e-9e9e-4016-9b56-a6f09d9cb345 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1317 microversion: 2.1 time: 1.261909 Feb 19 21:01:07.603569 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1304/2690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:06 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1317 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:07.679148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3c154bd5-6bd9-4d1c-aa0c-58b410578db7 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:07.718961 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3c154bd5-6bd9-4d1c-aa0c-58b410578db7 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1265 microversion: 2.1 time: 0.213216 Feb 19 21:01:07.721383 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1387/2691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:07 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:08.120369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6d37e91c-f4b8-493f-a1bc-12cfb6fbd832 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Action: 'create', calling method: .version_select at 0x7f6467513a60>, body: {"keypair": {"name": "tempest-keypair-1175642816"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:08.153179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-6d37e91c-f4b8-493f-a1bc-12cfb6fbd832 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Getting quotas for project 4aca9e397c334bb997f450e919088286. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:08.162425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-6d37e91c-f4b8-493f-a1bc-12cfb6fbd832 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Getting quotas for user a36b20fc4b8b4b71aea23626d52cefa9 and project 4aca9e397c334bb997f450e919088286. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:08.512860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e869eb2a-c567-477a-b0d5-3ca4b47fb4f2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:08.514060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e869eb2a-c567-477a-b0d5-3ca4b47fb4f2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:08.524363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e869eb2a-c567-477a-b0d5-3ca4b47fb4f2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:08.525096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e869eb2a-c567-477a-b0d5-3ca4b47fb4f2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:08.528752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e869eb2a-c567-477a-b0d5-3ca4b47fb4f2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:08.529374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e869eb2a-c567-477a-b0d5-3ca4b47fb4f2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:08.640424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-6d37e91c-f4b8-493f-a1bc-12cfb6fbd832 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Getting quotas for project 4aca9e397c334bb997f450e919088286. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:08.646651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-6d37e91c-f4b8-493f-a1bc-12cfb6fbd832 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Getting quotas for user a36b20fc4b8b4b71aea23626d52cefa9 and project 4aca9e397c334bb997f450e919088286. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:08.666546 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6d37e91c-f4b8-493f-a1bc-12cfb6fbd832 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.060078 Feb 19 21:01:08.668179 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1305/2692] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:01:07 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:08.676063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-62b966b3-5d45-415c-8b74-e8fe530d73e8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:08.678143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-62b966b3-5d45-415c-8b74-e8fe530d73e8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:08.686091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-62b966b3-5d45-415c-8b74-e8fe530d73e8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:08.686785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-62b966b3-5d45-415c-8b74-e8fe530d73e8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:08.687888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-62b966b3-5d45-415c-8b74-e8fe530d73e8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:08.688575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-62b966b3-5d45-415c-8b74-e8fe530d73e8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:09.500107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-62b966b3-5d45-415c-8b74-e8fe530d73e8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:09.514809 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-62b966b3-5d45-415c-8b74-e8fe530d73e8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1317 microversion: 2.1 time: 0.844506 Feb 19 21:01:09.515702 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1306/2693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:08 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1317 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:09.579242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e869eb2a-c567-477a-b0d5-3ca4b47fb4f2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:09.593944 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e869eb2a-c567-477a-b0d5-3ca4b47fb4f2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1522 microversion: 2.1 time: 1.085591 Feb 19 21:01:09.598141 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1388/2694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:08 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1522 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:09.652828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ea597320-3c2a-4fcb-bb20-4743cd8ee10c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:09.655304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ea597320-3c2a-4fcb-bb20-4743cd8ee10c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:09.673033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ea597320-3c2a-4fcb-bb20-4743cd8ee10c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:09.677190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ea597320-3c2a-4fcb-bb20-4743cd8ee10c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:09.678232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ea597320-3c2a-4fcb-bb20-4743cd8ee10c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:09.681159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ea597320-3c2a-4fcb-bb20-4743cd8ee10c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:10.011112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ea597320-3c2a-4fcb-bb20-4743cd8ee10c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:10.027226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-fbb97823-5ead-4986-9dc0-070a0a15ebc3 req-c7d486c5-b08a-4b1e-8ae9-0a781370031f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8ab6fb-0631-4ea1-b58f-e22572722a52", "name": "network-vif-plugged", "status": "completed", "tag": "57f2a797-1cfe-462b-a115-d8f0563b8044"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:10.030036 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:10.030036 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:01:10.032586 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ea597320-3c2a-4fcb-bb20-4743cd8ee10c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1271 microversion: 2.1 time: 0.432606 Feb 19 21:01:10.033818 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1389/2695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:09 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1271 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:10.057402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fbb97823-5ead-4986-9dc0-070a0a15ebc3 req-c7d486c5-b08a-4b1e-8ae9-0a781370031f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:10.062962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fbb97823-5ead-4986-9dc0-070a0a15ebc3 req-c7d486c5-b08a-4b1e-8ae9-0a781370031f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:10.109721 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fbb97823-5ead-4986-9dc0-070a0a15ebc3 req-c7d486c5-b08a-4b1e-8ae9-0a781370031f service nova] Creating event network-vif-plugged:57f2a797-1cfe-462b-a115-d8f0563b8044 for instance bd8ab6fb-0631-4ea1-b58f-e22572722a52 on nch2-master-1 Feb 19 21:01:10.123538 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-fbb97823-5ead-4986-9dc0-070a0a15ebc3 req-c7d486c5-b08a-4b1e-8ae9-0a781370031f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.602108 Feb 19 21:01:10.126154 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1307/2696] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:10.532947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-99cda441-d164-43df-bcc6-bb72c1c303df tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:10.533569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-99cda441-d164-43df-bcc6-bb72c1c303df tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:10.548249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99cda441-d164-43df-bcc6-bb72c1c303df tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:10.548729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99cda441-d164-43df-bcc6-bb72c1c303df tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:10.549552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99cda441-d164-43df-bcc6-bb72c1c303df tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:10.549982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99cda441-d164-43df-bcc6-bb72c1c303df tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:10.616677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7b1d94a5-d584-4d78-8579-f011d8923e39 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:10.618465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7b1d94a5-d584-4d78-8579-f011d8923e39 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:10.631437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7b1d94a5-d584-4d78-8579-f011d8923e39 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:10.632448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7b1d94a5-d584-4d78-8579-f011d8923e39 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:10.633426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7b1d94a5-d584-4d78-8579-f011d8923e39 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:10.634141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7b1d94a5-d584-4d78-8579-f011d8923e39 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:11.360071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7b1d94a5-d584-4d78-8579-f011d8923e39 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:11.373791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-99cda441-d164-43df-bcc6-bb72c1c303df tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:11.382029 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7b1d94a5-d584-4d78-8579-f011d8923e39 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1502 microversion: 2.1 time: 0.769217 Feb 19 21:01:11.384015 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1308/2697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:10 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1502 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:11.384193 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-99cda441-d164-43df-bcc6-bb72c1c303df tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1317 microversion: 2.1 time: 0.855571 Feb 19 21:01:11.398129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-133032a7-980b-4c54-bda6-3c2329d7bd49 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:11.398368 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1390/2698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:10 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:11.400768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-133032a7-980b-4c54-bda6-3c2329d7bd49 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:11.419633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-907c210c-060e-43c3-b95e-f5a23a1974cb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:11.420919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-907c210c-060e-43c3-b95e-f5a23a1974cb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:11.426190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-133032a7-980b-4c54-bda6-3c2329d7bd49 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:11.428173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-133032a7-980b-4c54-bda6-3c2329d7bd49 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:11.430289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-907c210c-060e-43c3-b95e-f5a23a1974cb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:11.430748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-907c210c-060e-43c3-b95e-f5a23a1974cb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:11.431540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-907c210c-060e-43c3-b95e-f5a23a1974cb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:11.432015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-907c210c-060e-43c3-b95e-f5a23a1974cb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:11.432171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-133032a7-980b-4c54-bda6-3c2329d7bd49 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:11.435830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-133032a7-980b-4c54-bda6-3c2329d7bd49 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:12.232276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-133032a7-980b-4c54-bda6-3c2329d7bd49 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:12.241411 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-133032a7-980b-4c54-bda6-3c2329d7bd49 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 0.855152 Feb 19 21:01:12.247127 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1309/2699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:11 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:12.253581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-907c210c-060e-43c3-b95e-f5a23a1974cb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:12.265654 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-907c210c-060e-43c3-b95e-f5a23a1974cb tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1515 microversion: 2.1 time: 0.847615 Feb 19 21:01:12.266611 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1391/2700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:11 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1515 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:12.289534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9fd0bddc-9e31-4600-b874-61bd2af7712a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:12.291923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9fd0bddc-9e31-4600-b874-61bd2af7712a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 0479e00d-8c65-4442-ab13-71e915c67172] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:12.298807 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9fd0bddc-9e31-4600-b874-61bd2af7712a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] HTTP exception thrown: Instance 0479e00d-8c65-4442-ab13-71e915c67172 could not be found. Feb 19 21:01:12.299710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9fd0bddc-9e31-4600-b874-61bd2af7712a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Returning 404 to user: Instance 0479e00d-8c65-4442-ab13-71e915c67172 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:12.302728 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9fd0bddc-9e31-4600-b874-61bd2af7712a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/0479e00d-8c65-4442-ab13-71e915c67172/action" status: 404 len: 111 microversion: 2.1 time: 0.016375 Feb 19 21:01:12.312653 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1310/2701] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:12 2022] POST /compute/v2.1/servers/0479e00d-8c65-4442-ab13-71e915c67172/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:12.315967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3634b9ce-9ccc-4058-916b-8de832eb6d18 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:12.316818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3634b9ce-9ccc-4058-916b-8de832eb6d18 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:12.329677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3634b9ce-9ccc-4058-916b-8de832eb6d18 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:12.330041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3634b9ce-9ccc-4058-916b-8de832eb6d18 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:12.330862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3634b9ce-9ccc-4058-916b-8de832eb6d18 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:12.331305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3634b9ce-9ccc-4058-916b-8de832eb6d18 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:12.414239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b12acc27-2269-4265-a9b5-f80414e3edca tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:12.416402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b12acc27-2269-4265-a9b5-f80414e3edca tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:12.430381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b12acc27-2269-4265-a9b5-f80414e3edca tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:12.436501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b12acc27-2269-4265-a9b5-f80414e3edca tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:12.437782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b12acc27-2269-4265-a9b5-f80414e3edca tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:12.441630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b12acc27-2269-4265-a9b5-f80414e3edca tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:12.573331 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3634b9ce-9ccc-4058-916b-8de832eb6d18 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action" status: 202 len: 0 microversion: 2.1 time: 0.261269 Feb 19 21:01:12.576896 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1392/2702] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:12 2022] POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:01:12.593499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dfd55d59-2d43-4c93-9bca-4ff1dc5020b4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:12.595077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dfd55d59-2d43-4c93-9bca-4ff1dc5020b4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:12.613228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dfd55d59-2d43-4c93-9bca-4ff1dc5020b4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:12.614018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dfd55d59-2d43-4c93-9bca-4ff1dc5020b4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:12.617224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dfd55d59-2d43-4c93-9bca-4ff1dc5020b4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:12.619621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dfd55d59-2d43-4c93-9bca-4ff1dc5020b4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:12.931989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b12acc27-2269-4265-a9b5-f80414e3edca tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:12.955152 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b12acc27-2269-4265-a9b5-f80414e3edca tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1317 microversion: 2.1 time: 0.539782 Feb 19 21:01:12.957094 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1311/2703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:12 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:13.203194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-feae3e72-882d-4c6a-97be-9ce1f058e753 req-a8f8ca57-4ee6-4c12-88d6-25bd146f72f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "name": "network-vif-plugged", "status": "completed", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:13.208552 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:13.208552 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:01:13.236477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-feae3e72-882d-4c6a-97be-9ce1f058e753 req-a8f8ca57-4ee6-4c12-88d6-25bd146f72f6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:13.241766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-feae3e72-882d-4c6a-97be-9ce1f058e753 req-a8f8ca57-4ee6-4c12-88d6-25bd146f72f6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:13.277255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dfd55d59-2d43-4c93-9bca-4ff1dc5020b4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:13.295628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-feae3e72-882d-4c6a-97be-9ce1f058e753 req-a8f8ca57-4ee6-4c12-88d6-25bd146f72f6 service nova] Creating event network-vif-plugged:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:01:13.296059 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dfd55d59-2d43-4c93-9bca-4ff1dc5020b4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1520 microversion: 2.1 time: 0.713920 Feb 19 21:01:13.301788 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1393/2704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:12 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1520 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:13.313522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-caad7249-f617-44b9-a95d-99461c107cc9 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:13.317010 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-feae3e72-882d-4c6a-97be-9ce1f058e753 req-a8f8ca57-4ee6-4c12-88d6-25bd146f72f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119268 Feb 19 21:01:13.321057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-caad7249-f617-44b9-a95d-99461c107cc9 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:13.321519 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1312/2705] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:13.336710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-caad7249-f617-44b9-a95d-99461c107cc9 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:13.338813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-caad7249-f617-44b9-a95d-99461c107cc9 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:13.348536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-caad7249-f617-44b9-a95d-99461c107cc9 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:13.349241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-caad7249-f617-44b9-a95d-99461c107cc9 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:13.979038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40edc1b0-5c77-4feb-9a7e-f0ee99fe6b2b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:13.980966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-40edc1b0-5c77-4feb-9a7e-f0ee99fe6b2b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:13.997900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40edc1b0-5c77-4feb-9a7e-f0ee99fe6b2b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:13.998373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40edc1b0-5c77-4feb-9a7e-f0ee99fe6b2b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:14.002161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40edc1b0-5c77-4feb-9a7e-f0ee99fe6b2b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:14.002697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40edc1b0-5c77-4feb-9a7e-f0ee99fe6b2b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:14.023373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-caad7249-f617-44b9-a95d-99461c107cc9 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:14.036877 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-caad7249-f617-44b9-a95d-99461c107cc9 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 0.733661 Feb 19 21:01:14.040722 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1394/2706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:13 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:14.322329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-905c107a-e0a4-438d-af8a-b1944336b61f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:14.323396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-905c107a-e0a4-438d-af8a-b1944336b61f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:14.378196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40edc1b0-5c77-4feb-9a7e-f0ee99fe6b2b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:14.383379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-905c107a-e0a4-438d-af8a-b1944336b61f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:14.384938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-905c107a-e0a4-438d-af8a-b1944336b61f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:14.386989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-905c107a-e0a4-438d-af8a-b1944336b61f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:14.391888 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-40edc1b0-5c77-4feb-9a7e-f0ee99fe6b2b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1466 microversion: 2.1 time: 0.421869 Feb 19 21:01:14.393447 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1313/2707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:13 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1466 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:14.393560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-905c107a-e0a4-438d-af8a-b1944336b61f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:14.431902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-850627be-1571-40fa-9f76-908530c8e3bc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-475734173", "metadata": {"image_type": "test"}}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:14.441039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-850627be-1571-40fa-9f76-908530c8e3bc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:14.473363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-850627be-1571-40fa-9f76-908530c8e3bc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:14.476603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-850627be-1571-40fa-9f76-908530c8e3bc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:14.477915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-850627be-1571-40fa-9f76-908530c8e3bc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:14.483610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-850627be-1571-40fa-9f76-908530c8e3bc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:14.704233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-850627be-1571-40fa-9f76-908530c8e3bc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Getting quotas for project 25f76e9ca2f54ad98c30b0dc6351be5c. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:14.721047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-850627be-1571-40fa-9f76-908530c8e3bc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Getting quotas for user 9596b0d7c4a1461db4bbe63e2524f0e1 and project 25f76e9ca2f54ad98c30b0dc6351be5c. Resources: dict_keys(['metadata_items']) {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:15.031651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-905c107a-e0a4-438d-af8a-b1944336b61f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:15.047080 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-905c107a-e0a4-438d-af8a-b1944336b61f tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1500 microversion: 2.1 time: 0.732746 Feb 19 21:01:15.065023 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1395/2708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:14 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1500 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:15.095555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1013425d-08b1-4844-8416-d372bf417962 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:15.097699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1013425d-08b1-4844-8416-d372bf417962 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:15.128887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1013425d-08b1-4844-8416-d372bf417962 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:15.129620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1013425d-08b1-4844-8416-d372bf417962 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:15.136368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1013425d-08b1-4844-8416-d372bf417962 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:15.140648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1013425d-08b1-4844-8416-d372bf417962 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:15.363907 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-850627be-1571-40fa-9f76-908530c8e3bc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "POST /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52/action" status: 202 len: 0 microversion: 2.1 time: 0.953303 Feb 19 21:01:15.364593 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1314/2709] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:14 2022] POST /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52/action => generated 0 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 21:01:15.385545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:15.386892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:15.427610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:15.431330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:15.436388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:15.437135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:15.513505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lazy-loading 'flavor' on Instance uuid 2df03445-3277-48bd-be5b-c8503c33714d {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:01:15.543600 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] HTTP exception thrown: Cannot 'rescue' instance 2df03445-3277-48bd-be5b-c8503c33714d while it is in vm_state paused Feb 19 21:01:15.545177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Returning 409 to user: Cannot 'rescue' instance 2df03445-3277-48bd-be5b-c8503c33714d while it is in vm_state paused {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:15.550453 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2fdad014-9a2b-47dd-bc31-00855706d182 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action" status: 409 len: 144 microversion: 2.1 time: 0.184698 Feb 19 21:01:15.551293 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1315/2710] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:15 2022] POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action => generated 144 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:01:15.554053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1013425d-08b1-4844-8416-d372bf417962 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:15.558495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4ae19d23-4878-459b-b89c-c2767c766c72 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f64674bf550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:15.563869 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1013425d-08b1-4844-8416-d372bf417962 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 0.497434 Feb 19 21:01:15.585739 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1396/2711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:15 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:15.604668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0aae8699-f0ad-4bd6-811d-864aad67484d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:15.605736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0aae8699-f0ad-4bd6-811d-864aad67484d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:15.618478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0aae8699-f0ad-4bd6-811d-864aad67484d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:15.619804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0aae8699-f0ad-4bd6-811d-864aad67484d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:15.625238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0aae8699-f0ad-4bd6-811d-864aad67484d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:15.626483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0aae8699-f0ad-4bd6-811d-864aad67484d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:15.651109 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4ae19d23-4878-459b-b89c-c2767c766c72 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.098613 Feb 19 21:01:15.652001 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1316/2712] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:15 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:15.843713 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0aae8699-f0ad-4bd6-811d-864aad67484d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action" status: 202 len: 0 microversion: 2.1 time: 0.241300 Feb 19 21:01:15.845869 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1397/2713] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:15 2022] POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:01:15.854455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f80a6c73-3500-411f-a573-476c02baf43d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:15.855288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f80a6c73-3500-411f-a573-476c02baf43d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:15.867826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f80a6c73-3500-411f-a573-476c02baf43d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:15.868287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f80a6c73-3500-411f-a573-476c02baf43d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:15.869115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f80a6c73-3500-411f-a573-476c02baf43d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:15.869557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f80a6c73-3500-411f-a573-476c02baf43d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:16.261879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3f5ecfe7-a044-425c-b746-48a1a72e8014 req-26b8808b-0233-4878-b486-ea715881ff09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c663bc1c-0a0d-471d-a5f7-c78f30fd46dd", "tag": "49b75fb4-dfb4-4181-9310-47d14081f43e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:16.264644 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:16.264644 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:01:16.277727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3f5ecfe7-a044-425c-b746-48a1a72e8014 req-26b8808b-0233-4878-b486-ea715881ff09 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:16.285818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3f5ecfe7-a044-425c-b746-48a1a72e8014 req-26b8808b-0233-4878-b486-ea715881ff09 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:16.316934 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3f5ecfe7-a044-425c-b746-48a1a72e8014 req-26b8808b-0233-4878-b486-ea715881ff09 service nova] Creating event network-changed:49b75fb4-dfb4-4181-9310-47d14081f43e for instance c663bc1c-0a0d-471d-a5f7-c78f30fd46dd on nch1-master-1 Feb 19 21:01:16.350061 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3f5ecfe7-a044-425c-b746-48a1a72e8014 req-26b8808b-0233-4878-b486-ea715881ff09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094917 Feb 19 21:01:16.355253 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1398/2714] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Feb 19 21:01:16.463888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f80a6c73-3500-411f-a573-476c02baf43d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:16.478602 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f80a6c73-3500-411f-a573-476c02baf43d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1507 microversion: 2.1 time: 0.626147 Feb 19 21:01:16.479603 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1317/2715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:15 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:16.585260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c1c92593-a810-4501-915b-a21596e38cb5 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:16.586502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c1c92593-a810-4501-915b-a21596e38cb5 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:16.601217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1c92593-a810-4501-915b-a21596e38cb5 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:16.603793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1c92593-a810-4501-915b-a21596e38cb5 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:16.609140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1c92593-a810-4501-915b-a21596e38cb5 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:16.613754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1c92593-a810-4501-915b-a21596e38cb5 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:16.671591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-38a368f1-e97f-44c1-b635-1bcb7ec8ec3b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f64675134c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:16.757428 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-38a368f1-e97f-44c1-b635-1bcb7ec8ec3b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.095119 Feb 19 21:01:16.763152 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1318/2716] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:16 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:16.922418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c1c92593-a810-4501-915b-a21596e38cb5 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:16.933402 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c1c92593-a810-4501-915b-a21596e38cb5 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 0.351938 Feb 19 21:01:16.935363 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1399/2717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:16 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:17.501429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f049399-dc8d-4f9f-b4d7-4b3c31d5b06b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:17.503394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f049399-dc8d-4f9f-b4d7-4b3c31d5b06b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:17.521561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f049399-dc8d-4f9f-b4d7-4b3c31d5b06b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:17.522034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f049399-dc8d-4f9f-b4d7-4b3c31d5b06b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:17.522856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f049399-dc8d-4f9f-b4d7-4b3c31d5b06b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:17.523306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f049399-dc8d-4f9f-b4d7-4b3c31d5b06b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:17.773040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d6185709-e88c-4586-9300-45492ccdb9ac tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f64742c81f0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:17.904381 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d6185709-e88c-4586-9300-45492ccdb9ac tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.137366 Feb 19 21:01:17.913220 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1400/2718] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:17 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:17.951075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e44e58e-4d4c-4493-b37e-becc070d286f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:17.952029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5e44e58e-4d4c-4493-b37e-becc070d286f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:17.969902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e44e58e-4d4c-4493-b37e-becc070d286f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:17.970708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e44e58e-4d4c-4493-b37e-becc070d286f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:17.973074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e44e58e-4d4c-4493-b37e-becc070d286f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:17.976816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e44e58e-4d4c-4493-b37e-becc070d286f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:18.365877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f049399-dc8d-4f9f-b4d7-4b3c31d5b06b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:18.383548 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f049399-dc8d-4f9f-b4d7-4b3c31d5b06b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1515 microversion: 2.1 time: 0.883230 Feb 19 21:01:18.386681 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1319/2719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:17 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1515 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:18.536780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e44e58e-4d4c-4493-b37e-becc070d286f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:18.558387 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5e44e58e-4d4c-4493-b37e-becc070d286f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 0.610815 Feb 19 21:01:18.560911 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1401/2720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:17 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:18.919190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d9441342-7200-4c52-864b-f871747e74cc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f647915d430>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:19.029274 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d9441342-7200-4c52-864b-f871747e74cc tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.113404 Feb 19 21:01:19.029274 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1320/2721] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:18 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:19.579826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e2843d6-d6c1-45c7-a8ab-343fd784a4b6 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:19.581677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e2843d6-d6c1-45c7-a8ab-343fd784a4b6 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:19.604299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e2843d6-d6c1-45c7-a8ab-343fd784a4b6 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:19.604849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e2843d6-d6c1-45c7-a8ab-343fd784a4b6 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:19.609753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e2843d6-d6c1-45c7-a8ab-343fd784a4b6 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:19.611973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e2843d6-d6c1-45c7-a8ab-343fd784a4b6 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:20.042091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-320b77c7-3f7b-41c0-8c85-a5b7b31b816f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467546040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:20.149473 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-320b77c7-3f7b-41c0-8c85-a5b7b31b816f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.111025 Feb 19 21:01:20.150400 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1321/2722] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:20 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:20.202243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d28220e5-451f-4565-a32d-b82a26a3e996 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:20.203415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d28220e5-451f-4565-a32d-b82a26a3e996 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:20.227199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e2843d6-d6c1-45c7-a8ab-343fd784a4b6 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:20.240768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d28220e5-451f-4565-a32d-b82a26a3e996 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:20.241414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d28220e5-451f-4565-a32d-b82a26a3e996 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:20.245882 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e2843d6-d6c1-45c7-a8ab-343fd784a4b6 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 0.672583 Feb 19 21:01:20.254026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d28220e5-451f-4565-a32d-b82a26a3e996 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:20.254807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d28220e5-451f-4565-a32d-b82a26a3e996 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:20.258723 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1402/2723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:19 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:20.378687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-d28220e5-451f-4565-a32d-b82a26a3e996 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lazy-loading 'flavor' on Instance uuid 2df03445-3277-48bd-be5b-c8503c33714d {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:01:20.729368 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d28220e5-451f-4565-a32d-b82a26a3e996 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action" status: 200 len: 32 microversion: 2.1 time: 0.493136 Feb 19 21:01:20.733444 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1322/2724] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:20 2022] POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action => generated 32 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 21:01:20.739894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bcf0cb3f-26b5-4135-8c7f-73745c61b558 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:20.740529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bcf0cb3f-26b5-4135-8c7f-73745c61b558 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:20.753351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bcf0cb3f-26b5-4135-8c7f-73745c61b558 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:20.765716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bcf0cb3f-26b5-4135-8c7f-73745c61b558 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:20.766701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bcf0cb3f-26b5-4135-8c7f-73745c61b558 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:20.767163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bcf0cb3f-26b5-4135-8c7f-73745c61b558 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:21.105528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-635946812", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "140e3dd6-5cb8-49ac-9612-4920dd5c0ab1"}, {"uuid": "5e0bfbcc-d428-4b6d-ad90-6bbb4e5a9e78"}, {"uuid": "140e3dd6-5cb8-49ac-9612-4920dd5c0ab1"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:21.243264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] validate_networks() for [('140e3dd6-5cb8-49ac-9612-4920dd5c0ab1', None, None, None, None, None), ('5e0bfbcc-d428-4b6d-ad90-6bbb4e5a9e78', None, None, None, None, None), ('140e3dd6-5cb8-49ac-9612-4920dd5c0ab1', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:01:22.041903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bcf0cb3f-26b5-4135-8c7f-73745c61b558 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:22.055290 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bcf0cb3f-26b5-4135-8c7f-73745c61b558 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 1.318923 Feb 19 21:01:22.057530 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1403/2725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:20 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:22.073759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d3b71f43-21eb-4dd3-bacb-4ff6566355a3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6474454af0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:22.160688 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d3b71f43-21eb-4dd3-bacb-4ff6566355a3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.102022 Feb 19 21:01:22.161558 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1404/2726] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:22 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:22.171940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-91ff0707-b843-4f7f-9149-c41f45759f93 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:22.188456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-91ff0707-b843-4f7f-9149-c41f45759f93 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:22.214223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91ff0707-b843-4f7f-9149-c41f45759f93 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:22.218172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91ff0707-b843-4f7f-9149-c41f45759f93 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:22.221079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91ff0707-b843-4f7f-9149-c41f45759f93 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:22.224834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91ff0707-b843-4f7f-9149-c41f45759f93 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:23.405152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-91ff0707-b843-4f7f-9149-c41f45759f93 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:23.423302 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-91ff0707-b843-4f7f-9149-c41f45759f93 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 1.249994 Feb 19 21:01:23.438812 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1405/2727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:22 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:23.459623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-593889891", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e65a0dad-e542-4761-ba20-2506e5992b4e"}], "security_groups": [{"name": "tempest-securitygroup--689653357"}], "key_name": "tempest-keypair-1175642816", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5aa1fdcb-18e6-4c5b-b6cb-6766c637168b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:24.032365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] validate_networks() for [('e65a0dad-e542-4761-ba20-2506e5992b4e', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:01:25.389522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:01:25.389957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:01:25.390440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:01:25.390767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:01:25.391190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:01:25.437511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:25.438167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:25.439506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:25.439615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:25.499612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Getting quotas for project 0a67095fabac457da3239e727c92e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:25.507427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Getting quotas for user 71f534f513ef45d29629b913de461f23 and project 0a67095fabac457da3239e727c92e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:25.546189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:01:25.564670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:01:25.673740 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aab71059-3553-4f8f-b645-f5ea656576ae tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.573200 Feb 19 21:01:25.674643 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1323/2728] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:01:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:01:25.689492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f4de778a-1aa1-49c2-b1fc-ddc2ea76e80a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:25.693110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f4de778a-1aa1-49c2-b1fc-ddc2ea76e80a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:25.711017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4de778a-1aa1-49c2-b1fc-ddc2ea76e80a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:25.712918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4de778a-1aa1-49c2-b1fc-ddc2ea76e80a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:25.716000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4de778a-1aa1-49c2-b1fc-ddc2ea76e80a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:25.716835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4de778a-1aa1-49c2-b1fc-ddc2ea76e80a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:26.139918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Getting quotas for project 4aca9e397c334bb997f450e919088286. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:26.183142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Getting quotas for user a36b20fc4b8b4b71aea23626d52cefa9 and project 4aca9e397c334bb997f450e919088286. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:26.254499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:01:26.258456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:01:26.261955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:01:26.264765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:01:26.267439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:01:26.310663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:26.312134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:26.314078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:26.330801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:26.378703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f4de778a-1aa1-49c2-b1fc-ddc2ea76e80a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:26.391572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Getting quotas for project 4aca9e397c334bb997f450e919088286. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:01:26.398319 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f4de778a-1aa1-49c2-b1fc-ddc2ea76e80a tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 0.716964 Feb 19 21:01:26.421816 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1324/2729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:25 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:26.437337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b3c7cb73-ed07-4512-b86c-8a92f4f85d5c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f64675460d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:26.444032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Getting quotas for user a36b20fc4b8b4b71aea23626d52cefa9 and project 4aca9e397c334bb997f450e919088286. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:01:26.622508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:01:26.625103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5aa1fdcb-18e6-4c5b-b6cb-6766c637168b',volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:01:27.206037 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5ce65352-8a3d-4c39-b82d-f80dd5cf09f2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.764003 Feb 19 21:01:27.233713 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1406/2730] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:01:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 3794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:01:27.269809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bb174715-0feb-49e3-bdc5-e657e3f825b3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:27.282519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bb174715-0feb-49e3-bdc5-e657e3f825b3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:27.301451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb174715-0feb-49e3-bdc5-e657e3f825b3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:27.321889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb174715-0feb-49e3-bdc5-e657e3f825b3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:27.324586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb174715-0feb-49e3-bdc5-e657e3f825b3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:27.330399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bb174715-0feb-49e3-bdc5-e657e3f825b3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:27.955508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bb174715-0feb-49e3-bdc5-e657e3f825b3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:27.963603 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bb174715-0feb-49e3-bdc5-e657e3f825b3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 0.727077 Feb 19 21:01:27.972371 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1407/2731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:27 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:27.990917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8e43780e-88eb-465a-8e83-17246e8238b5 req-95b2ba11-e684-40c6-bab2-2afc477f8839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8ab6fb-0631-4ea1-b58f-e22572722a52", "name": "network-vif-plugged", "status": "completed", "tag": "57f2a797-1cfe-462b-a115-d8f0563b8044"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:27.997223 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:27.997223 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:01:28.013549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8e43780e-88eb-465a-8e83-17246e8238b5 req-95b2ba11-e684-40c6-bab2-2afc477f8839 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:28.014395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8e43780e-88eb-465a-8e83-17246e8238b5 req-95b2ba11-e684-40c6-bab2-2afc477f8839 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:28.068684 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8e43780e-88eb-465a-8e83-17246e8238b5 req-95b2ba11-e684-40c6-bab2-2afc477f8839 service nova] Creating event network-vif-plugged:57f2a797-1cfe-462b-a115-d8f0563b8044 for instance bd8ab6fb-0631-4ea1-b58f-e22572722a52 on nch2-master-1 Feb 19 21:01:28.085145 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8e43780e-88eb-465a-8e83-17246e8238b5 req-95b2ba11-e684-40c6-bab2-2afc477f8839 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101107 Feb 19 21:01:28.087647 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1408/2732] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:28.095800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-262266ad-eb61-4614-ad33-c88740b5b27b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:28.111278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-262266ad-eb61-4614-ad33-c88740b5b27b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:28.130422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-262266ad-eb61-4614-ad33-c88740b5b27b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:28.133114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-262266ad-eb61-4614-ad33-c88740b5b27b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:28.134069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-262266ad-eb61-4614-ad33-c88740b5b27b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:28.135204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-262266ad-eb61-4614-ad33-c88740b5b27b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:28.318392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-262266ad-eb61-4614-ad33-c88740b5b27b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:28.357925 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-262266ad-eb61-4614-ad33-c88740b5b27b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1272 microversion: 2.1 time: 0.263388 Feb 19 21:01:28.362805 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1409/2733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:28 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1272 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:28.380129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a55ee29b-0277-4b5d-b151-6f4f3f728859 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:28.384697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a55ee29b-0277-4b5d-b151-6f4f3f728859 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:28.411820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a55ee29b-0277-4b5d-b151-6f4f3f728859 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:28.413928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a55ee29b-0277-4b5d-b151-6f4f3f728859 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:28.415173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a55ee29b-0277-4b5d-b151-6f4f3f728859 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:28.416227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a55ee29b-0277-4b5d-b151-6f4f3f728859 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:28.618740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a55ee29b-0277-4b5d-b151-6f4f3f728859 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:28.628758 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a55ee29b-0277-4b5d-b151-6f4f3f728859 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1171 microversion: 2.1 time: 0.264082 Feb 19 21:01:28.640991 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1410/2734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:28 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1171 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:28.662088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cecdb14d-13a1-44c8-9f3f-f99f12677f96 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:28.664043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cecdb14d-13a1-44c8-9f3f-f99f12677f96 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:28.685686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cecdb14d-13a1-44c8-9f3f-f99f12677f96 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:28.689321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cecdb14d-13a1-44c8-9f3f-f99f12677f96 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:28.691724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cecdb14d-13a1-44c8-9f3f-f99f12677f96 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:28.708876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cecdb14d-13a1-44c8-9f3f-f99f12677f96 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:29.184794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cecdb14d-13a1-44c8-9f3f-f99f12677f96 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:29.197426 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cecdb14d-13a1-44c8-9f3f-f99f12677f96 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 0.554965 Feb 19 21:01:29.209145 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1411/2735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:28 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:29.222958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f51df454-4950-4e6a-8871-3d393894d84c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:29.233288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f51df454-4950-4e6a-8871-3d393894d84c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:29.251884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f51df454-4950-4e6a-8871-3d393894d84c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:29.254684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f51df454-4950-4e6a-8871-3d393894d84c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:29.255718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f51df454-4950-4e6a-8871-3d393894d84c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:29.259924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f51df454-4950-4e6a-8871-3d393894d84c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:29.758496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f51df454-4950-4e6a-8871-3d393894d84c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:29.782146 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f51df454-4950-4e6a-8871-3d393894d84c tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 0.570462 Feb 19 21:01:29.794795 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1412/2736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:29 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:29.833429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6ca7cf71-0e03-4ba3-b02e-462d648e4d06 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:29.835773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6ca7cf71-0e03-4ba3-b02e-462d648e4d06 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:29.855253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ca7cf71-0e03-4ba3-b02e-462d648e4d06 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:29.868241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ca7cf71-0e03-4ba3-b02e-462d648e4d06 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:29.869228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ca7cf71-0e03-4ba3-b02e-462d648e4d06 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:29.869792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ca7cf71-0e03-4ba3-b02e-462d648e4d06 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:30.259016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6ca7cf71-0e03-4ba3-b02e-462d648e4d06 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:30.269897 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6ca7cf71-0e03-4ba3-b02e-462d648e4d06 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1312 microversion: 2.1 time: 0.461191 Feb 19 21:01:30.279081 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1413/2737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:29 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1312 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:30.287665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e5d0c529-18ad-47cf-8e9c-755fffd05285 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:30.293151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e5d0c529-18ad-47cf-8e9c-755fffd05285 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:30.308617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5d0c529-18ad-47cf-8e9c-755fffd05285 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:30.310080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5d0c529-18ad-47cf-8e9c-755fffd05285 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:30.311278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5d0c529-18ad-47cf-8e9c-755fffd05285 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:30.311869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5d0c529-18ad-47cf-8e9c-755fffd05285 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:30.439788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e5d0c529-18ad-47cf-8e9c-755fffd05285 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:30.453262 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e5d0c529-18ad-47cf-8e9c-755fffd05285 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1237 microversion: 2.1 time: 0.169904 Feb 19 21:01:30.458392 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1414/2738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:30 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1237 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:30.471767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-29800c1e-66b2-4114-8056-ea6cf80e15ba req-41514b2b-5b8f-4a30-b611-26ff261e1729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c663bc1c-0a0d-471d-a5f7-c78f30fd46dd", "name": "network-vif-plugged", "status": "completed", "tag": "49b75fb4-dfb4-4181-9310-47d14081f43e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:30.475721 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:30.475721 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:01:30.492097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-29800c1e-66b2-4114-8056-ea6cf80e15ba req-41514b2b-5b8f-4a30-b611-26ff261e1729 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:30.493756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-29800c1e-66b2-4114-8056-ea6cf80e15ba req-41514b2b-5b8f-4a30-b611-26ff261e1729 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:30.528768 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-29800c1e-66b2-4114-8056-ea6cf80e15ba req-41514b2b-5b8f-4a30-b611-26ff261e1729 service nova] Creating event network-vif-plugged:49b75fb4-dfb4-4181-9310-47d14081f43e for instance c663bc1c-0a0d-471d-a5f7-c78f30fd46dd on nch1-master-1 Feb 19 21:01:30.542400 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-29800c1e-66b2-4114-8056-ea6cf80e15ba req-41514b2b-5b8f-4a30-b611-26ff261e1729 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081422 Feb 19 21:01:30.552095 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1415/2739] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:30.589883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd81db52-8815-4f57-8e8c-79ba1ba5dd1b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:30.596768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cd81db52-8815-4f57-8e8c-79ba1ba5dd1b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:30.630426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd81db52-8815-4f57-8e8c-79ba1ba5dd1b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:30.633360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd81db52-8815-4f57-8e8c-79ba1ba5dd1b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:30.634563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd81db52-8815-4f57-8e8c-79ba1ba5dd1b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:30.637536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd81db52-8815-4f57-8e8c-79ba1ba5dd1b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:31.203401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cd81db52-8815-4f57-8e8c-79ba1ba5dd1b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:31.215206 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd81db52-8815-4f57-8e8c-79ba1ba5dd1b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 0.660031 Feb 19 21:01:31.219642 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1416/2740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:30 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:31.234308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-621348d5-5952-4cd1-82ef-8e2f029f2777 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:31.240250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-621348d5-5952-4cd1-82ef-8e2f029f2777 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:31.260260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-621348d5-5952-4cd1-82ef-8e2f029f2777 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:31.264322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-621348d5-5952-4cd1-82ef-8e2f029f2777 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:31.268137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-621348d5-5952-4cd1-82ef-8e2f029f2777 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:31.268926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-621348d5-5952-4cd1-82ef-8e2f029f2777 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:31.746624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-621348d5-5952-4cd1-82ef-8e2f029f2777 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:31.746624 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-621348d5-5952-4cd1-82ef-8e2f029f2777 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1313 microversion: 2.1 time: 0.499451 Feb 19 21:01:31.746624 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1417/2741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:31 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:31.746624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8a471241-0f0b-4e02-bd38-f2cc76ddb027 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:31.746624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8a471241-0f0b-4e02-bd38-f2cc76ddb027 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:31.757898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a471241-0f0b-4e02-bd38-f2cc76ddb027 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:31.758693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a471241-0f0b-4e02-bd38-f2cc76ddb027 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:31.759748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a471241-0f0b-4e02-bd38-f2cc76ddb027 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:31.760738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a471241-0f0b-4e02-bd38-f2cc76ddb027 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:32.098212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8a471241-0f0b-4e02-bd38-f2cc76ddb027 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:32.118380 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8a471241-0f0b-4e02-bd38-f2cc76ddb027 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1312 microversion: 2.1 time: 0.381450 Feb 19 21:01:32.122473 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1418/2742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:31 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:32.134336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1990d12-84c9-42fe-90d3-f9c5621bb19a tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:32.135581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b1990d12-84c9-42fe-90d3-f9c5621bb19a tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:32.149354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1990d12-84c9-42fe-90d3-f9c5621bb19a tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:32.149797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1990d12-84c9-42fe-90d3-f9c5621bb19a tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:32.150587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1990d12-84c9-42fe-90d3-f9c5621bb19a tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:32.151019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1990d12-84c9-42fe-90d3-f9c5621bb19a tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:32.321264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b1990d12-84c9-42fe-90d3-f9c5621bb19a tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:32.331290 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b1990d12-84c9-42fe-90d3-f9c5621bb19a tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1225 microversion: 2.1 time: 0.206840 Feb 19 21:01:32.339610 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1419/2743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:32 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1225 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:32.352078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-13fedb8a-7444-4683-9743-7ddfb291e664 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:32.352971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-13fedb8a-7444-4683-9743-7ddfb291e664 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:32.369043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13fedb8a-7444-4683-9743-7ddfb291e664 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:32.369919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13fedb8a-7444-4683-9743-7ddfb291e664 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:32.375519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13fedb8a-7444-4683-9743-7ddfb291e664 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:32.376383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13fedb8a-7444-4683-9743-7ddfb291e664 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:32.828722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-13fedb8a-7444-4683-9743-7ddfb291e664 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:32.836880 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-13fedb8a-7444-4683-9743-7ddfb291e664 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 0.495712 Feb 19 21:01:32.845467 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1420/2744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:32 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:32.850270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4be5fe11-e762-4020-84bb-1225885182aa tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:32.859147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4be5fe11-e762-4020-84bb-1225885182aa tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:32.877882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4be5fe11-e762-4020-84bb-1225885182aa tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:32.880981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4be5fe11-e762-4020-84bb-1225885182aa tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:32.881837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4be5fe11-e762-4020-84bb-1225885182aa tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:32.882540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4be5fe11-e762-4020-84bb-1225885182aa tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:33.294846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4be5fe11-e762-4020-84bb-1225885182aa tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:33.304510 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4be5fe11-e762-4020-84bb-1225885182aa tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1499 microversion: 2.1 time: 0.457698 Feb 19 21:01:33.310184 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1421/2745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:32 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1499 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:33.315236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-06a8c7c7-b51d-4b20-8ea0-fa0229da2233 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:33.319581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-06a8c7c7-b51d-4b20-8ea0-fa0229da2233 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:33.339775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06a8c7c7-b51d-4b20-8ea0-fa0229da2233 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:33.342208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06a8c7c7-b51d-4b20-8ea0-fa0229da2233 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:33.344768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06a8c7c7-b51d-4b20-8ea0-fa0229da2233 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:33.360073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06a8c7c7-b51d-4b20-8ea0-fa0229da2233 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:33.739825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-06a8c7c7-b51d-4b20-8ea0-fa0229da2233 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:33.749591 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-06a8c7c7-b51d-4b20-8ea0-fa0229da2233 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1333 microversion: 2.1 time: 0.437698 Feb 19 21:01:33.754441 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1422/2746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:33 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1333 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:33.759057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e9df754f-cd9e-4394-92db-e245c5999094 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:33.796891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.compute.server_groups [None req-e9df754f-cd9e-4394-92db-e245c5999094 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Querying cell 661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) for 1 instances {{(pid=136094) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 19 21:01:33.797731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9df754f-cd9e-4394-92db-e245c5999094 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:33.798193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9df754f-cd9e-4394-92db-e245c5999094 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:33.861706 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e9df754f-cd9e-4394-92db-e245c5999094 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/b0453a23-1214-45dd-b28e-fc925310bb7f" status: 200 len: 222 microversion: 2.1 time: 0.105997 Feb 19 21:01:33.873155 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1423/2747] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 21:01:33 2022] GET /compute/v2.1/os-server-groups/b0453a23-1214-45dd-b28e-fc925310bb7f => generated 222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:33.877907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-08fdf3a1-1fe0-43cf-aea1-63b499be94fb tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:33.878654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-08fdf3a1-1fe0-43cf-aea1-63b499be94fb tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:33.886701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08fdf3a1-1fe0-43cf-aea1-63b499be94fb tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:33.887318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08fdf3a1-1fe0-43cf-aea1-63b499be94fb tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:33.887999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08fdf3a1-1fe0-43cf-aea1-63b499be94fb tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:33.888475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08fdf3a1-1fe0-43cf-aea1-63b499be94fb tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:34.070102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-08fdf3a1-1fe0-43cf-aea1-63b499be94fb tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:34.080087 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-08fdf3a1-1fe0-43cf-aea1-63b499be94fb tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.205754 Feb 19 21:01:34.080739 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1424/2748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:33 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:34.096691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c4577e2a-d7e4-4b03-b27f-20a9b50a7274 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:34.097356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c4577e2a-d7e4-4b03-b27f-20a9b50a7274 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:34.105060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4577e2a-d7e4-4b03-b27f-20a9b50a7274 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:34.105492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4577e2a-d7e4-4b03-b27f-20a9b50a7274 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:34.106915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4577e2a-d7e4-4b03-b27f-20a9b50a7274 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:34.108423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4577e2a-d7e4-4b03-b27f-20a9b50a7274 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:34.451574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c4577e2a-d7e4-4b03-b27f-20a9b50a7274 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:34.461114 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c4577e2a-d7e4-4b03-b27f-20a9b50a7274 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 0.368343 Feb 19 21:01:34.463308 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1425/2749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:34 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:34.473705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cb396f4c-1eb3-43b3-8b45-9d90f45f551f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:34.476748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cb396f4c-1eb3-43b3-8b45-9d90f45f551f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:34.490838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb396f4c-1eb3-43b3-8b45-9d90f45f551f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:34.492184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb396f4c-1eb3-43b3-8b45-9d90f45f551f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:34.508964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb396f4c-1eb3-43b3-8b45-9d90f45f551f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:34.511481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb396f4c-1eb3-43b3-8b45-9d90f45f551f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:34.620433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cb396f4c-1eb3-43b3-8b45-9d90f45f551f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:01:34.897522 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cb396f4c-1eb3-43b3-8b45-9d90f45f551f tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 204 len: 0 microversion: 2.1 time: 0.431905 Feb 19 21:01:34.899701 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1426/2750] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:01:34 2022] DELETE /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:01:34.914652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41b673cf-bf46-4f16-908a-3cb223521a1c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:34.915378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41b673cf-bf46-4f16-908a-3cb223521a1c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:34.943843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41b673cf-bf46-4f16-908a-3cb223521a1c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:34.948263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41b673cf-bf46-4f16-908a-3cb223521a1c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:34.949380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41b673cf-bf46-4f16-908a-3cb223521a1c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:34.952966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41b673cf-bf46-4f16-908a-3cb223521a1c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:35.355016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-41b673cf-bf46-4f16-908a-3cb223521a1c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:35.372753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41b673cf-bf46-4f16-908a-3cb223521a1c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1333 microversion: 2.1 time: 0.470776 Feb 19 21:01:35.373370 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1427/2751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:34 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1333 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:35.415633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e18a42cd-3b5a-4849-a52f-803be08cd8ec tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:35.415633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e18a42cd-3b5a-4849-a52f-803be08cd8ec tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:35.430989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e18a42cd-3b5a-4849-a52f-803be08cd8ec tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:35.431753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e18a42cd-3b5a-4849-a52f-803be08cd8ec tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:35.433638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e18a42cd-3b5a-4849-a52f-803be08cd8ec tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:35.435180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e18a42cd-3b5a-4849-a52f-803be08cd8ec tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:35.808249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e18a42cd-3b5a-4849-a52f-803be08cd8ec tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:35.826668 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e18a42cd-3b5a-4849-a52f-803be08cd8ec tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1505 microversion: 2.1 time: 0.437684 Feb 19 21:01:35.829216 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1428/2752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:35 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:35.866822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-52c3d569-00af-4877-8a2c-ec96b39f1d78 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:35.867915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-52c3d569-00af-4877-8a2c-ec96b39f1d78 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:35.925980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52c3d569-00af-4877-8a2c-ec96b39f1d78 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:35.930305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52c3d569-00af-4877-8a2c-ec96b39f1d78 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:35.937639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52c3d569-00af-4877-8a2c-ec96b39f1d78 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:35.948369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52c3d569-00af-4877-8a2c-ec96b39f1d78 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:36.542505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-52c3d569-00af-4877-8a2c-ec96b39f1d78 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:36.550270 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-52c3d569-00af-4877-8a2c-ec96b39f1d78 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.719324 Feb 19 21:01:36.556490 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1429/2753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:35 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:36.566633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6027ad1f-dfaf-433f-86ad-ee9d5e928e92 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:36.575561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6027ad1f-dfaf-433f-86ad-ee9d5e928e92 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:36.598881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6027ad1f-dfaf-433f-86ad-ee9d5e928e92 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:36.599963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6027ad1f-dfaf-433f-86ad-ee9d5e928e92 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:36.600922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6027ad1f-dfaf-433f-86ad-ee9d5e928e92 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:36.601363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6027ad1f-dfaf-433f-86ad-ee9d5e928e92 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:37.455035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6027ad1f-dfaf-433f-86ad-ee9d5e928e92 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:37.466215 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6027ad1f-dfaf-433f-86ad-ee9d5e928e92 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1501 microversion: 2.1 time: 0.907393 Feb 19 21:01:37.469971 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1430/2754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:36 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1501 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:37.491611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f5e2ce9-5df7-4662-a641-cff552d4cad9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:37.505197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f5e2ce9-5df7-4662-a641-cff552d4cad9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:37.523759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f5e2ce9-5df7-4662-a641-cff552d4cad9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:37.524199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f5e2ce9-5df7-4662-a641-cff552d4cad9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:37.526494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f5e2ce9-5df7-4662-a641-cff552d4cad9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:37.530174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f5e2ce9-5df7-4662-a641-cff552d4cad9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.123249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f5e2ce9-5df7-4662-a641-cff552d4cad9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:38.158746 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f5e2ce9-5df7-4662-a641-cff552d4cad9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.672712 Feb 19 21:01:38.164064 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1431/2755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:37 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:38.170611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e72a71ed-5172-4278-b9ae-08a11ac2e3b8 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:38.176792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e72a71ed-5172-4278-b9ae-08a11ac2e3b8 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:38.193458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e72a71ed-5172-4278-b9ae-08a11ac2e3b8 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.193929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e72a71ed-5172-4278-b9ae-08a11ac2e3b8 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.194738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e72a71ed-5172-4278-b9ae-08a11ac2e3b8 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.195180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e72a71ed-5172-4278-b9ae-08a11ac2e3b8 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.268770 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b3c7cb73-ed07-4512-b86c-8a92f4f85d5c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 11.845324 Feb 19 21:01:38.269735 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1325/2756] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:26 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 11847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:38.368842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e72a71ed-5172-4278-b9ae-08a11ac2e3b8 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9569b0a569a745e797618d42bad7c795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cfeab9ddf04555a7e2fdb0ee8ebc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:38.381342 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e72a71ed-5172-4278-b9ae-08a11ac2e3b8 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 200 len: 1463 microversion: 2.1 time: 0.215852 Feb 19 21:01:38.384946 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1432/2757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:38 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 1463 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:38.410771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36c0a783-67b0-4929-ac6a-20dd24790c01 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a51d125-779d-4161-9229-3d61c08f7a7d"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:38.425268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-36c0a783-67b0-4929-ac6a-20dd24790c01 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:38.443782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36c0a783-67b0-4929-ac6a-20dd24790c01 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.461058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36c0a783-67b0-4929-ac6a-20dd24790c01 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.466710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36c0a783-67b0-4929-ac6a-20dd24790c01 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.467374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36c0a783-67b0-4929-ac6a-20dd24790c01 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.548556 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-36c0a783-67b0-4929-ac6a-20dd24790c01 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] HTTP exception thrown: Cannot 'attach_volume' instance 2df03445-3277-48bd-be5b-c8503c33714d while it is in vm_state rescued Feb 19 21:01:38.550964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36c0a783-67b0-4929-ac6a-20dd24790c01 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Returning 409 to user: Cannot 'attach_volume' instance 2df03445-3277-48bd-be5b-c8503c33714d while it is in vm_state rescued {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:38.553709 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36c0a783-67b0-4929-ac6a-20dd24790c01 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.165348 Feb 19 21:01:38.557583 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1433/2758] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:01:38 2022] POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments => generated 152 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:01:38.565195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7f9c9f47-aba2-4aac-94c3-10b9fabbd549 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:38.568402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7f9c9f47-aba2-4aac-94c3-10b9fabbd549 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:38.582980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f9c9f47-aba2-4aac-94c3-10b9fabbd549 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.584871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f9c9f47-aba2-4aac-94c3-10b9fabbd549 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.587345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f9c9f47-aba2-4aac-94c3-10b9fabbd549 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.588848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f9c9f47-aba2-4aac-94c3-10b9fabbd549 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.773796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-bb6e44b6-6b2f-4dfe-84ee-1ac5f6501a63 req-9d5c68ed-6038-4abe-940c-a86354505d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9440fe13-0931-4b97-a7cb-ec215645eb5a", "tag": "5522f49c-1f87-419c-bb79-a02284fc44b4"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:38.777054 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:38.777054 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:01:38.854319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-bb6e44b6-6b2f-4dfe-84ee-1ac5f6501a63 req-9d5c68ed-6038-4abe-940c-a86354505d67 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.859487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-bb6e44b6-6b2f-4dfe-84ee-1ac5f6501a63 req-9d5c68ed-6038-4abe-940c-a86354505d67 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.890663 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-bb6e44b6-6b2f-4dfe-84ee-1ac5f6501a63 req-9d5c68ed-6038-4abe-940c-a86354505d67 service nova] Creating event network-changed:5522f49c-1f87-419c-bb79-a02284fc44b4 for instance 9440fe13-0931-4b97-a7cb-ec215645eb5a on nch2-master-1 Feb 19 21:01:38.909164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7f9c9f47-aba2-4aac-94c3-10b9fabbd549 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:38.919407 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7f9c9f47-aba2-4aac-94c3-10b9fabbd549 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.358929 Feb 19 21:01:38.924906 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-bb6e44b6-6b2f-4dfe-84ee-1ac5f6501a63 req-9d5c68ed-6038-4abe-940c-a86354505d67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.647370 Feb 19 21:01:38.927364 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1326/2759] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:38.935612 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1434/2760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:38 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:38.946427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c609fb1-7520-4435-8698-84a464aa7dd6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:38.949592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-82d8dc8c-42ef-4120-8f5f-7a2257ec1b57 req-f17ada20-bd17-4d30-b0aa-b337959c4745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c663bc1c-0a0d-471d-a5f7-c78f30fd46dd", "name": "network-vif-deleted", "tag": "49b75fb4-dfb4-4181-9310-47d14081f43e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:38.952192 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:38.952192 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:01:38.955802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3c609fb1-7520-4435-8698-84a464aa7dd6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:38.962199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-82d8dc8c-42ef-4120-8f5f-7a2257ec1b57 req-f17ada20-bd17-4d30-b0aa-b337959c4745 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.967426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-82d8dc8c-42ef-4120-8f5f-7a2257ec1b57 req-f17ada20-bd17-4d30-b0aa-b337959c4745 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.992571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c609fb1-7520-4435-8698-84a464aa7dd6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.994973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c609fb1-7520-4435-8698-84a464aa7dd6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:38.996038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c609fb1-7520-4435-8698-84a464aa7dd6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:38.996723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c609fb1-7520-4435-8698-84a464aa7dd6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:39.002010 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-82d8dc8c-42ef-4120-8f5f-7a2257ec1b57 req-f17ada20-bd17-4d30-b0aa-b337959c4745 service nova] Creating event network-vif-deleted:49b75fb4-dfb4-4181-9310-47d14081f43e for instance c663bc1c-0a0d-471d-a5f7-c78f30fd46dd on nch1-master-1 Feb 19 21:01:39.023392 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-82d8dc8c-42ef-4120-8f5f-7a2257ec1b57 req-f17ada20-bd17-4d30-b0aa-b337959c4745 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085853 Feb 19 21:01:39.024486 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1435/2761] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:39.034714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0b828f4d-7c97-4d56-8d7a-657d205987ed tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:39.039826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0b828f4d-7c97-4d56-8d7a-657d205987ed tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:39.054417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b828f4d-7c97-4d56-8d7a-657d205987ed tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:39.055138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b828f4d-7c97-4d56-8d7a-657d205987ed tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:39.058823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b828f4d-7c97-4d56-8d7a-657d205987ed tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:39.059738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b828f4d-7c97-4d56-8d7a-657d205987ed tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:39.272529 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0b828f4d-7c97-4d56-8d7a-657d205987ed tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action" status: 202 len: 0 microversion: 2.1 time: 0.241817 Feb 19 21:01:39.273589 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1436/2762] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:39 2022] POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:01:39.282504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3fd1d9a1-b177-4824-925e-eab6ce1eab9e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:39.283648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3fd1d9a1-b177-4824-925e-eab6ce1eab9e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:39.291910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fd1d9a1-b177-4824-925e-eab6ce1eab9e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:39.305017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fd1d9a1-b177-4824-925e-eab6ce1eab9e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:39.312346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fd1d9a1-b177-4824-925e-eab6ce1eab9e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:39.312346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fd1d9a1-b177-4824-925e-eab6ce1eab9e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:39.355731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c609fb1-7520-4435-8698-84a464aa7dd6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:39.367047 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c609fb1-7520-4435-8698-84a464aa7dd6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.438192 Feb 19 21:01:39.372959 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1327/2763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:38 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:39.384110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-27ec7dc9-024e-467b-beb9-c9e3db238291 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:39.392223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-27ec7dc9-024e-467b-beb9-c9e3db238291 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:39.410446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27ec7dc9-024e-467b-beb9-c9e3db238291 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:39.421156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27ec7dc9-024e-467b-beb9-c9e3db238291 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:39.422655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27ec7dc9-024e-467b-beb9-c9e3db238291 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:39.423914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27ec7dc9-024e-467b-beb9-c9e3db238291 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.277043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-27ec7dc9-024e-467b-beb9-c9e3db238291 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:40.285453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3fd1d9a1-b177-4824-925e-eab6ce1eab9e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:40.296305 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3fd1d9a1-b177-4824-925e-eab6ce1eab9e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 1.020915 Feb 19 21:01:40.299119 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-27ec7dc9-024e-467b-beb9-c9e3db238291 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1509 microversion: 2.1 time: 0.923114 Feb 19 21:01:40.300467 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1437/2764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:39 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:40.302628 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1328/2765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:39 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1509 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:40.307361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-808513a2-6b28-4896-a3b6-e7b412a2a480 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:40.308236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-808513a2-6b28-4896-a3b6-e7b412a2a480 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:40.314174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-859eb6fd-5ea0-4b88-91c2-9baf258e8d68 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467776310>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:40.325854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-808513a2-6b28-4896-a3b6-e7b412a2a480 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.326230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-808513a2-6b28-4896-a3b6-e7b412a2a480 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.327300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-808513a2-6b28-4896-a3b6-e7b412a2a480 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.328002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-808513a2-6b28-4896-a3b6-e7b412a2a480 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.343392 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-808513a2-6b28-4896-a3b6-e7b412a2a480 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] HTTP exception thrown: Instance c663bc1c-0a0d-471d-a5f7-c78f30fd46dd could not be found. Feb 19 21:01:40.344399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-808513a2-6b28-4896-a3b6-e7b412a2a480 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Returning 404 to user: Instance c663bc1c-0a0d-471d-a5f7-c78f30fd46dd could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:40.345524 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-808513a2-6b28-4896-a3b6-e7b412a2a480 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 404 len: 111 microversion: 2.1 time: 0.041762 Feb 19 21:01:40.346318 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1329/2766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:40 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:40.357221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-415c193d-84d2-4b46-874d-3cdf77ef4252 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:40.358745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-415c193d-84d2-4b46-874d-3cdf77ef4252 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:40.370792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-415c193d-84d2-4b46-874d-3cdf77ef4252 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.371690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-415c193d-84d2-4b46-874d-3cdf77ef4252 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.372843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-415c193d-84d2-4b46-874d-3cdf77ef4252 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.373805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-415c193d-84d2-4b46-874d-3cdf77ef4252 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.383666 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-859eb6fd-5ea0-4b88-91c2-9baf258e8d68 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.081804 Feb 19 21:01:40.390662 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1438/2767] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:40 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:40.390662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df642683-e4f0-4567-8c27-7f52a382fc62 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:40.439909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.compute.server_groups [None req-df642683-e4f0-4567-8c27-7f52a382fc62 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Querying cell 661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) for 1 instances {{(pid=136094) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 19 21:01:40.441180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df642683-e4f0-4567-8c27-7f52a382fc62 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.441852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df642683-e4f0-4567-8c27-7f52a382fc62 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.453200 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df642683-e4f0-4567-8c27-7f52a382fc62 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.067281 Feb 19 21:01:40.454461 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1439/2768] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:01:40 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:40.460681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a9e5e59f-a1ec-4425-9eb8-16b477b9fb19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:40.461705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a9e5e59f-a1ec-4425-9eb8-16b477b9fb19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:40.469153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9e5e59f-a1ec-4425-9eb8-16b477b9fb19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.469947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9e5e59f-a1ec-4425-9eb8-16b477b9fb19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.471017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9e5e59f-a1ec-4425-9eb8-16b477b9fb19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.471674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9e5e59f-a1ec-4425-9eb8-16b477b9fb19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.924856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-415c193d-84d2-4b46-874d-3cdf77ef4252 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:40.932569 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-415c193d-84d2-4b46-874d-3cdf77ef4252 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.584882 Feb 19 21:01:40.934231 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1330/2769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:40 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:40.943026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a9e5e59f-a1ec-4425-9eb8-16b477b9fb19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:40.947077 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a9e5e59f-a1ec-4425-9eb8-16b477b9fb19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.491362 Feb 19 21:01:40.947662 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1440/2770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:40 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:40.952562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d30ef8ab-d4c6-4e20-acf1-e8a0de8181ad tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:40.964692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-183ec8f4-00e9-4cbb-b1bb-04bfaac8dd3a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1292650417"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:40.966458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-183ec8f4-00e9-4cbb-b1bb-04bfaac8dd3a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:40.977324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-183ec8f4-00e9-4cbb-b1bb-04bfaac8dd3a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.978428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-183ec8f4-00e9-4cbb-b1bb-04bfaac8dd3a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.979470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-183ec8f4-00e9-4cbb-b1bb-04bfaac8dd3a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.980230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-183ec8f4-00e9-4cbb-b1bb-04bfaac8dd3a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:40.984842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.compute.server_groups [None req-d30ef8ab-d4c6-4e20-acf1-e8a0de8181ad tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Querying cell 661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) for 1 instances {{(pid=136095) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 19 21:01:40.988830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d30ef8ab-d4c6-4e20-acf1-e8a0de8181ad tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:40.989397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d30ef8ab-d4c6-4e20-acf1-e8a0de8181ad tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.015336 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d30ef8ab-d4c6-4e20-acf1-e8a0de8181ad tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/b0453a23-1214-45dd-b28e-fc925310bb7f" status: 200 len: 184 microversion: 2.1 time: 0.068511 Feb 19 21:01:41.016406 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1331/2771] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 21:01:40 2022] GET /compute/v2.1/os-server-groups/b0453a23-1214-45dd-b28e-fc925310bb7f => generated 184 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:41.027350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-0ddebb33-a0cf-407b-824c-d7e538c628c0 req-80782ae4-6e0c-4630-b7d7-542c5559b72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "457783d2-8dc2-4522-80cf-081a6a013e17", "tag": "53f0c9b6-2a6b-4f8e-8fff-82ecf9fa570f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:41.049800 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:41.049800 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:01:41.064892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0ddebb33-a0cf-407b-824c-d7e538c628c0 req-80782ae4-6e0c-4630-b7d7-542c5559b72c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:41.069274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0ddebb33-a0cf-407b-824c-d7e538c628c0 req-80782ae4-6e0c-4630-b7d7-542c5559b72c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.089405 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-0ddebb33-a0cf-407b-824c-d7e538c628c0 req-80782ae4-6e0c-4630-b7d7-542c5559b72c service nova] Creating event network-changed:53f0c9b6-2a6b-4f8e-8fff-82ecf9fa570f for instance 457783d2-8dc2-4522-80cf-081a6a013e17 on nch2-master-1 Feb 19 21:01:41.103256 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-0ddebb33-a0cf-407b-824c-d7e538c628c0 req-80782ae4-6e0c-4630-b7d7-542c5559b72c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085378 Feb 19 21:01:41.106933 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1332/2772] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:41.118021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1009716-ba17-4437-ba66-1843f776f850 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:41.120218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1009716-ba17-4437-ba66-1843f776f850 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:41.143938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1009716-ba17-4437-ba66-1843f776f850 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:41.144609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1009716-ba17-4437-ba66-1843f776f850 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.145691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1009716-ba17-4437-ba66-1843f776f850 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:41.147203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1009716-ba17-4437-ba66-1843f776f850 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.166769 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-e1009716-ba17-4437-ba66-1843f776f850 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] HTTP exception thrown: Instance c663bc1c-0a0d-471d-a5f7-c78f30fd46dd could not be found. Feb 19 21:01:41.178651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1009716-ba17-4437-ba66-1843f776f850 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Returning 404 to user: Instance c663bc1c-0a0d-471d-a5f7-c78f30fd46dd could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:41.179996 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1009716-ba17-4437-ba66-1843f776f850 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 404 len: 111 microversion: 2.1 time: 0.071640 Feb 19 21:01:41.181231 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1333/2773] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:01:41 2022] DELETE /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:41.191396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7640fd66-d8a5-4e33-b50f-05f3d45efff3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:41.192384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7640fd66-d8a5-4e33-b50f-05f3d45efff3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] [instance: c663bc1c-0a0d-471d-a5f7-c78f30fd46dd] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:41.204921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7640fd66-d8a5-4e33-b50f-05f3d45efff3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:41.205615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7640fd66-d8a5-4e33-b50f-05f3d45efff3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.206759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7640fd66-d8a5-4e33-b50f-05f3d45efff3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:41.207423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7640fd66-d8a5-4e33-b50f-05f3d45efff3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.228629 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-7640fd66-d8a5-4e33-b50f-05f3d45efff3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] HTTP exception thrown: Instance c663bc1c-0a0d-471d-a5f7-c78f30fd46dd could not be found. Feb 19 21:01:41.232526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7640fd66-d8a5-4e33-b50f-05f3d45efff3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Returning 404 to user: Instance c663bc1c-0a0d-471d-a5f7-c78f30fd46dd could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:41.233823 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7640fd66-d8a5-4e33-b50f-05f3d45efff3 tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd" status: 404 len: 111 microversion: 2.1 time: 0.048087 Feb 19 21:01:41.236761 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1334/2774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:41 2022] GET /compute/v2.1/servers/c663bc1c-0a0d-471d-a5f7-c78f30fd46dd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:41.246467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8b974b78-5df9-4e24-ac3b-69b342c1ea3a tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:41.268014 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8b974b78-5df9-4e24-ac3b-69b342c1ea3a tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] HTTP exception thrown: Instance group 6bfe1340-c0e8-4647-a455-0269a029da97 could not be found. Feb 19 21:01:41.269014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8b974b78-5df9-4e24-ac3b-69b342c1ea3a tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Returning 404 to user: Instance group 6bfe1340-c0e8-4647-a455-0269a029da97 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:41.270335 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8b974b78-5df9-4e24-ac3b-69b342c1ea3a tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/6bfe1340-c0e8-4647-a455-0269a029da97" status: 404 len: 117 microversion: 2.1 time: 0.031720 Feb 19 21:01:41.271492 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1335/2775] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:01:41 2022] DELETE /compute/v2.1/os-server-groups/6bfe1340-c0e8-4647-a455-0269a029da97 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:41.284152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66f2192f-72f0-41a3-aaa4-efbba3a159fd tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:41.303405 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-66f2192f-72f0-41a3-aaa4-efbba3a159fd tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] HTTP exception thrown: Instance group 571efb11-ed71-4cbb-bf3f-77d63d8a0817 could not be found. Feb 19 21:01:41.304028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66f2192f-72f0-41a3-aaa4-efbba3a159fd tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Returning 404 to user: Instance group 571efb11-ed71-4cbb-bf3f-77d63d8a0817 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:41.306006 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-66f2192f-72f0-41a3-aaa4-efbba3a159fd tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/571efb11-ed71-4cbb-bf3f-77d63d8a0817" status: 404 len: 117 microversion: 2.1 time: 0.026360 Feb 19 21:01:41.309179 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1336/2776] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:01:41 2022] DELETE /compute/v2.1/os-server-groups/571efb11-ed71-4cbb-bf3f-77d63d8a0817 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:41.316294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ecd4ebd9-e42e-4547-b906-4d20b261aceb tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:41.331450 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-ecd4ebd9-e42e-4547-b906-4d20b261aceb tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] HTTP exception thrown: Instance group e15252f4-9c41-411f-ae8c-a5770554aff0 could not be found. Feb 19 21:01:41.334212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ecd4ebd9-e42e-4547-b906-4d20b261aceb tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Returning 404 to user: Instance group e15252f4-9c41-411f-ae8c-a5770554aff0 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:41.336136 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ecd4ebd9-e42e-4547-b906-4d20b261aceb tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/e15252f4-9c41-411f-ae8c-a5770554aff0" status: 404 len: 117 microversion: 2.1 time: 0.023455 Feb 19 21:01:41.338539 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1337/2777] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:01:41 2022] DELETE /compute/v2.1/os-server-groups/e15252f4-9c41-411f-ae8c-a5770554aff0 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:41.357627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-528f3a49-3716-4041-896b-9c5700558871 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:41.361073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-528f3a49-3716-4041-896b-9c5700558871 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:41.381070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-528f3a49-3716-4041-896b-9c5700558871 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:41.381783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-528f3a49-3716-4041-896b-9c5700558871 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.383847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-528f3a49-3716-4041-896b-9c5700558871 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:41.384774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-528f3a49-3716-4041-896b-9c5700558871 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.663856 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-183ec8f4-00e9-4cbb-b1bb-04bfaac8dd3a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.702402 Feb 19 21:01:41.692255 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1441/2778] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:40 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Feb 19 21:01:41.709430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-40bee7f5-21d8-4d55-876e-49adce36a986 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:41.710348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-40bee7f5-21d8-4d55-876e-49adce36a986 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:41.733883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40bee7f5-21d8-4d55-876e-49adce36a986 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:41.735103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40bee7f5-21d8-4d55-876e-49adce36a986 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.736288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40bee7f5-21d8-4d55-876e-49adce36a986 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:41.737175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40bee7f5-21d8-4d55-876e-49adce36a986 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:41.887431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-528f3a49-3716-4041-896b-9c5700558871 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:41.899226 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-528f3a49-3716-4041-896b-9c5700558871 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.559438 Feb 19 21:01:41.907900 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1338/2779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:41 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:41.915349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-99db3cd0-44d3-4522-a8a5-8deccb6ec87d tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:41.952019 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-99db3cd0-44d3-4522-a8a5-8deccb6ec87d tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] HTTP exception thrown: Instance group a26ba2e3-8629-42af-9f7f-fdd93434c7ba could not be found. Feb 19 21:01:41.953153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-99db3cd0-44d3-4522-a8a5-8deccb6ec87d tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Returning 404 to user: Instance group a26ba2e3-8629-42af-9f7f-fdd93434c7ba could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:41.954063 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-99db3cd0-44d3-4522-a8a5-8deccb6ec87d tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/a26ba2e3-8629-42af-9f7f-fdd93434c7ba" status: 404 len: 117 microversion: 2.1 time: 0.044833 Feb 19 21:01:41.956240 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1339/2780] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:01:41 2022] DELETE /compute/v2.1/os-server-groups/a26ba2e3-8629-42af-9f7f-fdd93434c7ba => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:01:42.012067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-70b0509a-7e0e-4ee0-814a-b6f728ed84a4 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6479213670>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:42.098436 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-70b0509a-7e0e-4ee0-814a-b6f728ed84a4 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.134746 Feb 19 21:01:42.099661 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1340/2781] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:41 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:42.106152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-323b52b5-4307-4815-8ef7-116c43b1a96e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:42.106984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-323b52b5-4307-4815-8ef7-116c43b1a96e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:42.118591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-323b52b5-4307-4815-8ef7-116c43b1a96e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:42.119304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-323b52b5-4307-4815-8ef7-116c43b1a96e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:42.121740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-323b52b5-4307-4815-8ef7-116c43b1a96e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:42.123462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-323b52b5-4307-4815-8ef7-116c43b1a96e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:42.363019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-40bee7f5-21d8-4d55-876e-49adce36a986 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:42.374319 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-40bee7f5-21d8-4d55-876e-49adce36a986 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1509 microversion: 2.1 time: 0.680403 Feb 19 21:01:42.390236 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1442/2782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:41 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1509 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:42.407968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d090e941-4b0f-4228-a6cc-13addc55d18b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:42.471668 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d090e941-4b0f-4228-a6cc-13addc55d18b tempest-ServerGroupTestJSON-176659396 tempest-ServerGroupTestJSON-176659396-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/b0453a23-1214-45dd-b28e-fc925310bb7f" status: 204 len: 0 microversion: 2.1 time: 0.079190 Feb 19 21:01:42.472630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1443/2783] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Feb 19 21:01:42 2022] DELETE /compute/v2.1/os-server-groups/b0453a23-1214-45dd-b28e-fc925310bb7f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:01:42.480313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-64a24bf2-65b7-4ef4-8d71-c3db38bb6eac req-ddbcf8a0-5af2-4e4a-9d75-19b8b8c0af30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "name": "network-vif-unplugged", "status": "completed", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:42.486851 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:42.486851 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:01:42.507880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-64a24bf2-65b7-4ef4-8d71-c3db38bb6eac req-ddbcf8a0-5af2-4e4a-9d75-19b8b8c0af30 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:42.509192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-64a24bf2-65b7-4ef4-8d71-c3db38bb6eac req-ddbcf8a0-5af2-4e4a-9d75-19b8b8c0af30 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:42.535250 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-64a24bf2-65b7-4ef4-8d71-c3db38bb6eac req-ddbcf8a0-5af2-4e4a-9d75-19b8b8c0af30 service nova] Creating event network-vif-unplugged:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:01:42.553101 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-64a24bf2-65b7-4ef4-8d71-c3db38bb6eac req-ddbcf8a0-5af2-4e4a-9d75-19b8b8c0af30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076947 Feb 19 21:01:42.556744 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1444/2784] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:42.565428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-323b52b5-4307-4815-8ef7-116c43b1a96e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:42.577448 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-323b52b5-4307-4815-8ef7-116c43b1a96e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.476119 Feb 19 21:01:42.580861 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1341/2785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:42 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:42.929635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-06150d01-791f-4905-a7af-acbdac51ec5a tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:42.930670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-06150d01-791f-4905-a7af-acbdac51ec5a tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:42.947927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06150d01-791f-4905-a7af-acbdac51ec5a tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:42.950191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06150d01-791f-4905-a7af-acbdac51ec5a tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:42.953195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06150d01-791f-4905-a7af-acbdac51ec5a tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:42.957361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06150d01-791f-4905-a7af-acbdac51ec5a tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:43.129926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-79d5899f-2437-4eb9-a4c1-251a4cdecb41 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f64675318b0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:43.224496 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-79d5899f-2437-4eb9-a4c1-251a4cdecb41 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.115439 Feb 19 21:01:43.229592 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1342/2786] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:43 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:43.246829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-bf1851fd-cb7d-471a-91e9-780f9bc22186 req-6631ef3f-3de3-41c6-ba7c-cee9155fb852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "457783d2-8dc2-4522-80cf-081a6a013e17", "tag": "ff871375-e78c-4d10-8106-2a234a325971"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:43.254937 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:43.254937 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:01:43.288712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-bf1851fd-cb7d-471a-91e9-780f9bc22186 req-6631ef3f-3de3-41c6-ba7c-cee9155fb852 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:43.289345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-bf1851fd-cb7d-471a-91e9-780f9bc22186 req-6631ef3f-3de3-41c6-ba7c-cee9155fb852 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:43.324183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-06150d01-791f-4905-a7af-acbdac51ec5a tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:43.331455 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-bf1851fd-cb7d-471a-91e9-780f9bc22186 req-6631ef3f-3de3-41c6-ba7c-cee9155fb852 service nova] Creating event network-changed:ff871375-e78c-4d10-8106-2a234a325971 for instance 457783d2-8dc2-4522-80cf-081a6a013e17 on nch2-master-1 Feb 19 21:01:43.338157 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-bf1851fd-cb7d-471a-91e9-780f9bc22186 req-6631ef3f-3de3-41c6-ba7c-cee9155fb852 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107060 Feb 19 21:01:43.339458 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1343/2787] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:43.347875 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-06150d01-791f-4905-a7af-acbdac51ec5a tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.425724 Feb 19 21:01:43.353818 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1445/2788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:42 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:43.405462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45baffea-0d0a-4d92-8bfe-e39052f36275 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:43.406440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-45baffea-0d0a-4d92-8bfe-e39052f36275 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:43.430685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45baffea-0d0a-4d92-8bfe-e39052f36275 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:43.433836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45baffea-0d0a-4d92-8bfe-e39052f36275 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:43.434725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45baffea-0d0a-4d92-8bfe-e39052f36275 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:43.435289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45baffea-0d0a-4d92-8bfe-e39052f36275 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:43.608321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cda0a47e-ff3e-49e2-99bb-a0648ea24ba8 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:43.610219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cda0a47e-ff3e-49e2-99bb-a0648ea24ba8 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:43.633402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cda0a47e-ff3e-49e2-99bb-a0648ea24ba8 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:43.638497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cda0a47e-ff3e-49e2-99bb-a0648ea24ba8 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:43.641065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cda0a47e-ff3e-49e2-99bb-a0648ea24ba8 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:43.645368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cda0a47e-ff3e-49e2-99bb-a0648ea24ba8 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:43.722048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-45baffea-0d0a-4d92-8bfe-e39052f36275 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:43.734448 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45baffea-0d0a-4d92-8bfe-e39052f36275 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1515 microversion: 2.1 time: 0.343603 Feb 19 21:01:43.739855 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1344/2789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:43 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1515 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:44.112116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cda0a47e-ff3e-49e2-99bb-a0648ea24ba8 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:44.147969 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cda0a47e-ff3e-49e2-99bb-a0648ea24ba8 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.549747 Feb 19 21:01:44.149176 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1446/2790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:43 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:44.241665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-793737b3-8b57-499f-96fa-5341cc875a44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6479204040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:44.334533 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-793737b3-8b57-499f-96fa-5341cc875a44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.097560 Feb 19 21:01:44.340026 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1345/2791] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:44 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:44.381514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-859d1354-9980-4bf5-8226-0b48b80f805e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:44.383552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-859d1354-9980-4bf5-8226-0b48b80f805e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:44.433105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-859d1354-9980-4bf5-8226-0b48b80f805e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:44.433769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-859d1354-9980-4bf5-8226-0b48b80f805e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:44.439552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-859d1354-9980-4bf5-8226-0b48b80f805e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:44.440224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-859d1354-9980-4bf5-8226-0b48b80f805e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:44.829592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-859d1354-9980-4bf5-8226-0b48b80f805e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:44.840091 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-859d1354-9980-4bf5-8226-0b48b80f805e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.471585 Feb 19 21:01:44.841959 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1447/2792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:44 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:45.169706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-85fbed19-789a-40d5-9015-7283b631560b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:45.170489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-85fbed19-789a-40d5-9015-7283b631560b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:45.189091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85fbed19-789a-40d5-9015-7283b631560b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:45.189702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85fbed19-789a-40d5-9015-7283b631560b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:45.194052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85fbed19-789a-40d5-9015-7283b631560b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:45.195076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85fbed19-789a-40d5-9015-7283b631560b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:45.356276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0bfdcb91-adb6-4fa4-ae90-056e721d086c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467e933a0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:45.426611 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0bfdcb91-adb6-4fa4-ae90-056e721d086c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.074503 Feb 19 21:01:45.427618 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1448/2793] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:45 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:45.438768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ff0bc68a-57bd-4a61-b2cc-6ea9483521db req-2a950222-dd48-4c69-abfe-7ceac3178d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "457783d2-8dc2-4522-80cf-081a6a013e17", "tag": "b9f99142-6fa5-417a-bb09-98abb27cd0be"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:45.441878 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:45.441878 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:01:45.461147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ff0bc68a-57bd-4a61-b2cc-6ea9483521db req-2a950222-dd48-4c69-abfe-7ceac3178d46 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:45.464623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ff0bc68a-57bd-4a61-b2cc-6ea9483521db req-2a950222-dd48-4c69-abfe-7ceac3178d46 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:45.500226 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ff0bc68a-57bd-4a61-b2cc-6ea9483521db req-2a950222-dd48-4c69-abfe-7ceac3178d46 service nova] Creating event network-changed:b9f99142-6fa5-417a-bb09-98abb27cd0be for instance 457783d2-8dc2-4522-80cf-081a6a013e17 on nch2-master-1 Feb 19 21:01:45.507897 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ff0bc68a-57bd-4a61-b2cc-6ea9483521db req-2a950222-dd48-4c69-abfe-7ceac3178d46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078791 Feb 19 21:01:45.509935 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1449/2794] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:45.546600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-94a593cd-1c31-4461-98a8-a91b679bba77 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:45.552906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-94a593cd-1c31-4461-98a8-a91b679bba77 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:45.577017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-85fbed19-789a-40d5-9015-7283b631560b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:45.591314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a593cd-1c31-4461-98a8-a91b679bba77 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:45.597676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a593cd-1c31-4461-98a8-a91b679bba77 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:45.599018 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-85fbed19-789a-40d5-9015-7283b631560b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.436402 Feb 19 21:01:45.603895 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1346/2795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:45 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:45.608812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a593cd-1c31-4461-98a8-a91b679bba77 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:45.610404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a593cd-1c31-4461-98a8-a91b679bba77 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:45.862713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ce55f12-dd31-4af3-a265-ae6fd4019508 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:45.863441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8ce55f12-dd31-4af3-a265-ae6fd4019508 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:45.881687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce55f12-dd31-4af3-a265-ae6fd4019508 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:45.887712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce55f12-dd31-4af3-a265-ae6fd4019508 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:45.891860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce55f12-dd31-4af3-a265-ae6fd4019508 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:45.898395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ce55f12-dd31-4af3-a265-ae6fd4019508 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:46.031692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-94a593cd-1c31-4461-98a8-a91b679bba77 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:46.042276 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-94a593cd-1c31-4461-98a8-a91b679bba77 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1515 microversion: 2.1 time: 0.528118 Feb 19 21:01:46.043243 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1450/2796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:45 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1515 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:46.064870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aed146c7-103d-4b73-ba02-11fcb7868c65"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:46.066234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:46.074045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:46.075747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:46.077067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:46.077697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:46.289589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8ce55f12-dd31-4af3-a265-ae6fd4019508 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:46.308766 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ce55f12-dd31-4af3-a265-ae6fd4019508 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.449508 Feb 19 21:01:46.310826 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1347/2797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:45 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:46.439347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-778bba74-f884-44aa-ba59-27710e744b40 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6474347550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:46.530093 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-778bba74-f884-44aa-ba59-27710e744b40 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1423 microversion: 2.1 time: 0.094835 Feb 19 21:01:46.531029 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1348/2798] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:46 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:46.539604 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ee27c5f5-280b-4af1-95a9-65aafe1ec861 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481311 Feb 19 21:01:46.540844 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1451/2799] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:01:46 2022] POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:01:46.623575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1c539e4c-8207-4039-894d-2465778bae47 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:46.624441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1c539e4c-8207-4039-894d-2465778bae47 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:46.635870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c539e4c-8207-4039-894d-2465778bae47 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:46.636540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c539e4c-8207-4039-894d-2465778bae47 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:46.639485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c539e4c-8207-4039-894d-2465778bae47 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:46.640097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c539e4c-8207-4039-894d-2465778bae47 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:46.906914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1c539e4c-8207-4039-894d-2465778bae47 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:46.925931 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1c539e4c-8207-4039-894d-2465778bae47 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.295619 Feb 19 21:01:46.937557 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1349/2800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:46 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:47.328500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0989fb51-cb16-4846-91ce-d7db8b5382a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:47.329980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0989fb51-cb16-4846-91ce-d7db8b5382a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:47.338370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0989fb51-cb16-4846-91ce-d7db8b5382a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:47.339124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0989fb51-cb16-4846-91ce-d7db8b5382a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:47.342249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0989fb51-cb16-4846-91ce-d7db8b5382a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:47.342936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0989fb51-cb16-4846-91ce-d7db8b5382a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:47.544919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-137ffd1a-fdc2-4176-b8c9-3f984dd5f4b9 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6479213f70>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:47.615628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-137ffd1a-fdc2-4176-b8c9-3f984dd5f4b9 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1432 microversion: 2.1 time: 0.075585 Feb 19 21:01:47.625396 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1350/2801] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:47 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1432 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:47.632991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-09073fc2-8b5d-4709-9323-4255f835e1a2 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f64791409d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:47.675126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0989fb51-cb16-4846-91ce-d7db8b5382a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:47.705755 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0989fb51-cb16-4846-91ce-d7db8b5382a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.382179 Feb 19 21:01:47.713392 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-09073fc2-8b5d-4709-9323-4255f835e1a2 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 200 len: 1432 microversion: 2.1 time: 0.086290 Feb 19 21:01:47.714655 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1351/2802] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:47 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 1432 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:47.725055 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1452/2803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:47 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:47.740506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-56dc22b7-845e-4e09-9622-fbcfa24ba48a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:47.742778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-56dc22b7-845e-4e09-9622-fbcfa24ba48a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:47.751291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56dc22b7-845e-4e09-9622-fbcfa24ba48a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:47.752107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56dc22b7-845e-4e09-9622-fbcfa24ba48a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:47.753573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56dc22b7-845e-4e09-9622-fbcfa24ba48a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:47.763156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56dc22b7-845e-4e09-9622-fbcfa24ba48a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:47.939325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-56dc22b7-845e-4e09-9622-fbcfa24ba48a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:47.948167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-332c32ec-8461-4954-85ca-35920372e19c tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:47.948561 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-56dc22b7-845e-4e09-9622-fbcfa24ba48a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1479 microversion: 2.1 time: 0.223665 Feb 19 21:01:47.949444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-332c32ec-8461-4954-85ca-35920372e19c tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:47.955613 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1352/2804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:47 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1479 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:47.958356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-332c32ec-8461-4954-85ca-35920372e19c tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:47.958872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-332c32ec-8461-4954-85ca-35920372e19c tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:47.959742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-332c32ec-8461-4954-85ca-35920372e19c tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:47.960264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-332c32ec-8461-4954-85ca-35920372e19c tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:48.143424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-332c32ec-8461-4954-85ca-35920372e19c tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:48.165891 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-332c32ec-8461-4954-85ca-35920372e19c tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.221601 Feb 19 21:01:48.168289 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1453/2805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:47 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:48.305645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f347d793-04ef-4c09-94b2-b87ca5d689ac req-489b801c-c0b1-4709-a246-1d0af532039c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9440fe13-0931-4b97-a7cb-ec215645eb5a", "name": "network-vif-plugged", "status": "completed", "tag": "5522f49c-1f87-419c-bb79-a02284fc44b4"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:48.311408 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:48.311408 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:01:48.319673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f347d793-04ef-4c09-94b2-b87ca5d689ac req-489b801c-c0b1-4709-a246-1d0af532039c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:48.320638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f347d793-04ef-4c09-94b2-b87ca5d689ac req-489b801c-c0b1-4709-a246-1d0af532039c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:48.335821 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f347d793-04ef-4c09-94b2-b87ca5d689ac req-489b801c-c0b1-4709-a246-1d0af532039c service nova] Creating event network-vif-plugged:5522f49c-1f87-419c-bb79-a02284fc44b4 for instance 9440fe13-0931-4b97-a7cb-ec215645eb5a on nch2-master-1 Feb 19 21:01:48.342464 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f347d793-04ef-4c09-94b2-b87ca5d689ac req-489b801c-c0b1-4709-a246-1d0af532039c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040782 Feb 19 21:01:48.343954 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1353/2806] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:48.737800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-610c8edf-ead3-4585-93c8-1782bda5cb7b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:48.738501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-610c8edf-ead3-4585-93c8-1782bda5cb7b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:48.750654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-610c8edf-ead3-4585-93c8-1782bda5cb7b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:48.752156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-610c8edf-ead3-4585-93c8-1782bda5cb7b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:48.753958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-610c8edf-ead3-4585-93c8-1782bda5cb7b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:48.755113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-610c8edf-ead3-4585-93c8-1782bda5cb7b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:48.971230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8944bcf9-9737-4a46-b3d1-077f8b46ad88 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:48.972624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8944bcf9-9737-4a46-b3d1-077f8b46ad88 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:48.980773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8944bcf9-9737-4a46-b3d1-077f8b46ad88 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:48.981315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8944bcf9-9737-4a46-b3d1-077f8b46ad88 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:48.982604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8944bcf9-9737-4a46-b3d1-077f8b46ad88 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:48.983194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8944bcf9-9737-4a46-b3d1-077f8b46ad88 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:49.427241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-610c8edf-ead3-4585-93c8-1782bda5cb7b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:49.435171 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-610c8edf-ead3-4585-93c8-1782bda5cb7b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.704863 Feb 19 21:01:49.445818 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1454/2807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:48 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:49.445818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2e62d3c-55b1-439c-88b8-729904daebb7 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:49.445818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b2e62d3c-55b1-439c-88b8-729904daebb7 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:49.450538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2e62d3c-55b1-439c-88b8-729904daebb7 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:49.451237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2e62d3c-55b1-439c-88b8-729904daebb7 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:49.452197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2e62d3c-55b1-439c-88b8-729904daebb7 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:49.452939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2e62d3c-55b1-439c-88b8-729904daebb7 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:49.602178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8944bcf9-9737-4a46-b3d1-077f8b46ad88 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:49.611470 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8944bcf9-9737-4a46-b3d1-077f8b46ad88 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1466 microversion: 2.1 time: 0.647269 Feb 19 21:01:49.617960 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1354/2808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:48 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1466 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:49.642753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-30700ad2-ab90-4f71-91e0-d1a1eae45269 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f647922a040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:49.695321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b2e62d3c-55b1-439c-88b8-729904daebb7 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:49.708769 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2e62d3c-55b1-439c-88b8-729904daebb7 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.269162 Feb 19 21:01:49.709709 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1455/2809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:49 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:49.749096 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-30700ad2-ab90-4f71-91e0-d1a1eae45269 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/f75529b9-2911-475e-b974-4af06053c17c" status: 200 len: 784 microversion: 2.1 time: 0.112841 Feb 19 21:01:49.749711 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1355/2810] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:49 2022] GET /compute/v2.1/images/f75529b9-2911-475e-b974-4af06053c17c => generated 784 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:01:49.761270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d71f450f-c3c2-463f-8e5f-e0ddad8c065b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:49.772059 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d71f450f-c3c2-463f-8e5f-e0ddad8c065b tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014407 Feb 19 21:01:49.773237 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1456/2811] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 21:01:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:49.787985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e15942fd-3a95-49ea-92f5-478da29834ef tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f64791409d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:50.027133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-39dc98ec-4863-47c6-af3f-a95150ad5bd4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:50.028785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-39dc98ec-4863-47c6-af3f-a95150ad5bd4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:50.049256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-39dc98ec-4863-47c6-af3f-a95150ad5bd4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:50.049713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-39dc98ec-4863-47c6-af3f-a95150ad5bd4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:50.050499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-39dc98ec-4863-47c6-af3f-a95150ad5bd4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:50.050935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-39dc98ec-4863-47c6-af3f-a95150ad5bd4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:50.096282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-39dc98ec-4863-47c6-af3f-a95150ad5bd4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lazy-loading 'flavor' on Instance uuid 2df03445-3277-48bd-be5b-c8503c33714d {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:01:50.332833 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-39dc98ec-4863-47c6-af3f-a95150ad5bd4 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action" status: 200 len: 32 microversion: 2.1 time: 0.316281 Feb 19 21:01:50.345473 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1457/2812] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:50 2022] POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action => generated 32 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 21:01:50.368068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5c980e69-8c24-40a0-a003-1da9a7599ec6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:50.371326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5c980e69-8c24-40a0-a003-1da9a7599ec6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:50.400829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c980e69-8c24-40a0-a003-1da9a7599ec6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:50.402268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c980e69-8c24-40a0-a003-1da9a7599ec6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:50.404021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c980e69-8c24-40a0-a003-1da9a7599ec6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:50.405175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c980e69-8c24-40a0-a003-1da9a7599ec6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:50.818913 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e15942fd-3a95-49ea-92f5-478da29834ef tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "DELETE /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 204 len: 0 microversion: 2.1 time: 1.036463 Feb 19 21:01:50.824405 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1356/2813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:49 2022] DELETE /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:01:50.837790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e34234a8-5740-4b64-b278-31254568feb3 req-86c39cec-4d2a-4b86-9aae-5d3834996799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "name": "network-vif-plugged", "status": "completed", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:50.841638 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:50.841638 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:01:50.852772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e34234a8-5740-4b64-b278-31254568feb3 req-86c39cec-4d2a-4b86-9aae-5d3834996799 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:50.853628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e34234a8-5740-4b64-b278-31254568feb3 req-86c39cec-4d2a-4b86-9aae-5d3834996799 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:50.869459 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e34234a8-5740-4b64-b278-31254568feb3 req-86c39cec-4d2a-4b86-9aae-5d3834996799 service nova] Creating event network-vif-plugged:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:01:50.877822 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e34234a8-5740-4b64-b278-31254568feb3 req-86c39cec-4d2a-4b86-9aae-5d3834996799 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050670 Feb 19 21:01:50.880208 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1357/2814] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:50.886094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-14ce2035-80ea-42b8-bc3e-f2fc0ff31b66 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:50.887716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-14ce2035-80ea-42b8-bc3e-f2fc0ff31b66 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:50.896580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14ce2035-80ea-42b8-bc3e-f2fc0ff31b66 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:50.897559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14ce2035-80ea-42b8-bc3e-f2fc0ff31b66 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:50.898626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14ce2035-80ea-42b8-bc3e-f2fc0ff31b66 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:50.899290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14ce2035-80ea-42b8-bc3e-f2fc0ff31b66 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:51.329218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5c980e69-8c24-40a0-a003-1da9a7599ec6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:51.362151 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5c980e69-8c24-40a0-a003-1da9a7599ec6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 1.008920 Feb 19 21:01:51.368148 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1458/2815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:50 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:51.382280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ac56b20e-d36c-4f07-aa77-70b5ac6f4772 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:51.383033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ac56b20e-d36c-4f07-aa77-70b5ac6f4772 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:51.394680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac56b20e-d36c-4f07-aa77-70b5ac6f4772 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:51.398588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac56b20e-d36c-4f07-aa77-70b5ac6f4772 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:51.399737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac56b20e-d36c-4f07-aa77-70b5ac6f4772 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:51.400321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac56b20e-d36c-4f07-aa77-70b5ac6f4772 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:51.451798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-14ce2035-80ea-42b8-bc3e-f2fc0ff31b66 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:51.467459 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-14ce2035-80ea-42b8-bc3e-f2fc0ff31b66 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.585572 Feb 19 21:01:51.468437 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1358/2816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:50 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:51.474580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-be317ab1-2a05-4675-8229-e2c7cedd99cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f647917f4c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:51.500860 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-be317ab1-2a05-4675-8229-e2c7cedd99cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] HTTP exception thrown: Image not found. Feb 19 21:01:51.501722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-be317ab1-2a05-4675-8229-e2c7cedd99cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Returning 404 to user: Image not found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:01:51.502791 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-be317ab1-2a05-4675-8229-e2c7cedd99cb tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 404 len: 62 microversion: 2.1 time: 0.032657 Feb 19 21:01:51.503885 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1359/2817] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:51 2022] GET /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:01:51.516724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f56a639-d565-44b2-9c31-f0cecf5b61f8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1163821396"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:51.518189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f56a639-d565-44b2-9c31-f0cecf5b61f8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:51.532877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f56a639-d565-44b2-9c31-f0cecf5b61f8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:51.534197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f56a639-d565-44b2-9c31-f0cecf5b61f8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:51.535161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f56a639-d565-44b2-9c31-f0cecf5b61f8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:51.535685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f56a639-d565-44b2-9c31-f0cecf5b61f8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:51.920415 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8f56a639-d565-44b2-9c31-f0cecf5b61f8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "POST /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52/action" status: 202 len: 0 microversion: 2.1 time: 0.400168 Feb 19 21:01:51.922240 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1360/2818] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:01:51 2022] POST /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 21:01:51.948594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-da0f2105-a812-4c38-998c-cf97c82f02b3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6479213430>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:52.021570 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-da0f2105-a812-4c38-998c-cf97c82f02b3 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.086851 Feb 19 21:01:52.022448 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1361/2819] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:51 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:52.333694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ac56b20e-d36c-4f07-aa77-70b5ac6f4772 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:52.341904 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ac56b20e-d36c-4f07-aa77-70b5ac6f4772 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1292 microversion: 2.1 time: 0.972627 Feb 19 21:01:52.348804 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1459/2820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:51 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1292 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:52.385620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13ede0fd-040c-4c32-8512-fcc772d474c7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:52.386265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-13ede0fd-040c-4c32-8512-fcc772d474c7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:52.401823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13ede0fd-040c-4c32-8512-fcc772d474c7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:52.402283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13ede0fd-040c-4c32-8512-fcc772d474c7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:52.403707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13ede0fd-040c-4c32-8512-fcc772d474c7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:52.404155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13ede0fd-040c-4c32-8512-fcc772d474c7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:52.489012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84d89e43-143c-468c-89bb-339d9d5adbd9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:52.489904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-84d89e43-143c-468c-89bb-339d9d5adbd9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:52.499190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84d89e43-143c-468c-89bb-339d9d5adbd9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:52.499942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84d89e43-143c-468c-89bb-339d9d5adbd9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:52.501308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84d89e43-143c-468c-89bb-339d9d5adbd9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:52.502265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84d89e43-143c-468c-89bb-339d9d5adbd9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:52.889457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13ede0fd-040c-4c32-8512-fcc772d474c7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:52.905286 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13ede0fd-040c-4c32-8512-fcc772d474c7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 0.523694 Feb 19 21:01:52.915691 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1362/2821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:52 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:52.947368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84d89e43-143c-468c-89bb-339d9d5adbd9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:52.961231 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84d89e43-143c-468c-89bb-339d9d5adbd9 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.477793 Feb 19 21:01:52.962749 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1460/2822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:52 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:52.989591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-314f7deb-9c56-47fb-93fe-ff3d4d6e9a0e req-19cdb5a8-d7c0-44d2-b2b4-df6420e272ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8ab6fb-0631-4ea1-b58f-e22572722a52", "name": "network-vif-unplugged", "status": "completed", "tag": "57f2a797-1cfe-462b-a115-d8f0563b8044"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:52.991981 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:52.991981 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:01:53.001350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-314f7deb-9c56-47fb-93fe-ff3d4d6e9a0e req-19cdb5a8-d7c0-44d2-b2b4-df6420e272ab service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:53.002061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-314f7deb-9c56-47fb-93fe-ff3d4d6e9a0e req-19cdb5a8-d7c0-44d2-b2b4-df6420e272ab service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:53.027033 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-314f7deb-9c56-47fb-93fe-ff3d4d6e9a0e req-19cdb5a8-d7c0-44d2-b2b4-df6420e272ab service nova] Creating event network-vif-unplugged:57f2a797-1cfe-462b-a115-d8f0563b8044 for instance bd8ab6fb-0631-4ea1-b58f-e22572722a52 on nch2-master-1 Feb 19 21:01:53.037698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3e23a22e-ee4f-414b-ac2f-2c8c372a0c6e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467dfbe50>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:53.052834 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-314f7deb-9c56-47fb-93fe-ff3d4d6e9a0e req-19cdb5a8-d7c0-44d2-b2b4-df6420e272ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066767 Feb 19 21:01:53.054280 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1363/2823] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:53.103030 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3e23a22e-ee4f-414b-ac2f-2c8c372a0c6e tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.070476 Feb 19 21:01:53.114784 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1461/2824] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:53 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:53.359745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58b1dbb4-4494-46df-82f8-39be0035ec50 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:53.360929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-58b1dbb4-4494-46df-82f8-39be0035ec50 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:53.373381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58b1dbb4-4494-46df-82f8-39be0035ec50 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:53.375333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58b1dbb4-4494-46df-82f8-39be0035ec50 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:53.376181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58b1dbb4-4494-46df-82f8-39be0035ec50 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:53.378410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58b1dbb4-4494-46df-82f8-39be0035ec50 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:53.928400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0ff41a67-290a-4ad6-aa37-ad85c7b5ae23 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:53.929180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0ff41a67-290a-4ad6-aa37-ad85c7b5ae23 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:53.941373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ff41a67-290a-4ad6-aa37-ad85c7b5ae23 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:53.945679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ff41a67-290a-4ad6-aa37-ad85c7b5ae23 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:53.946644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ff41a67-290a-4ad6-aa37-ad85c7b5ae23 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:53.947796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ff41a67-290a-4ad6-aa37-ad85c7b5ae23 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:54.184938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-58b1dbb4-4494-46df-82f8-39be0035ec50 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:54.203525 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-58b1dbb4-4494-46df-82f8-39be0035ec50 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1482 microversion: 2.1 time: 0.843264 Feb 19 21:01:54.212783 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1364/2825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:53 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1482 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:54.221417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ec1a6c6f-f446-43ed-b0b1-455582881b9d tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:54.225323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ec1a6c6f-f446-43ed-b0b1-455582881b9d tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:54.250766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec1a6c6f-f446-43ed-b0b1-455582881b9d tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:54.252691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec1a6c6f-f446-43ed-b0b1-455582881b9d tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:54.260585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec1a6c6f-f446-43ed-b0b1-455582881b9d tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:54.261750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec1a6c6f-f446-43ed-b0b1-455582881b9d tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:54.634950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0ff41a67-290a-4ad6-aa37-ad85c7b5ae23 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:54.664788 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0ff41a67-290a-4ad6-aa37-ad85c7b5ae23 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 0.745280 Feb 19 21:01:54.674285 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1462/2826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:53 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:01:54.704460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-522093e1-1fbf-48c4-9c10-393202369db8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467eea3a0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:54.714653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ec1a6c6f-f446-43ed-b0b1-455582881b9d tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:54.728478 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ec1a6c6f-f446-43ed-b0b1-455582881b9d tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.521803 Feb 19 21:01:54.730201 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1365/2827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:54 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:54.747595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c146a70b-219e-4bf1-823c-5adecad30187 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:54.748584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c146a70b-219e-4bf1-823c-5adecad30187 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:54.767417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c146a70b-219e-4bf1-823c-5adecad30187 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:54.769389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c146a70b-219e-4bf1-823c-5adecad30187 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:54.771050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c146a70b-219e-4bf1-823c-5adecad30187 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:54.772315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c146a70b-219e-4bf1-823c-5adecad30187 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:54.799142 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-522093e1-1fbf-48c4-9c10-393202369db8 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.122493 Feb 19 21:01:54.803925 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1463/2828] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:54 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:55.325865 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c146a70b-219e-4bf1-823c-5adecad30187 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.589027 Feb 19 21:01:55.327773 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1366/2829] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:01:54 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a/os-interface => generated 284 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:55.692320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-703182d6-ffdd-4c23-aa35-4a504c03e76b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:55.693053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-703182d6-ffdd-4c23-aa35-4a504c03e76b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:55.705629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-703182d6-ffdd-4c23-aa35-4a504c03e76b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:55.706150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-703182d6-ffdd-4c23-aa35-4a504c03e76b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:55.707015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-703182d6-ffdd-4c23-aa35-4a504c03e76b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:55.707514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-703182d6-ffdd-4c23-aa35-4a504c03e76b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:55.749860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fecc472d-8c82-403a-be9a-760aced842d6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:55.750764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fecc472d-8c82-403a-be9a-760aced842d6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:55.763213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fecc472d-8c82-403a-be9a-760aced842d6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:55.772185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fecc472d-8c82-403a-be9a-760aced842d6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:55.774349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fecc472d-8c82-403a-be9a-760aced842d6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:55.779082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fecc472d-8c82-403a-be9a-760aced842d6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:57.212961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-703182d6-ffdd-4c23-aa35-4a504c03e76b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:57.227503 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-703182d6-ffdd-4c23-aa35-4a504c03e76b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 1.538919 Feb 19 21:01:57.228723 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1464/2830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:55 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:57.246803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5483aaf8-104b-4480-9504-674f29783623 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467eea5e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:57.310869 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5483aaf8-104b-4480-9504-674f29783623 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.080343 Feb 19 21:01:57.311477 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1465/2831] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:57 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:57.367157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fecc472d-8c82-403a-be9a-760aced842d6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:57.382628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fecc472d-8c82-403a-be9a-760aced842d6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 1.638668 Feb 19 21:01:57.385434 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1367/2832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:55 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:58.245586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6a1e06b5-7066-468b-ac5f-bc0267736304 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:58.246829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6a1e06b5-7066-468b-ac5f-bc0267736304 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:58.271383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a1e06b5-7066-468b-ac5f-bc0267736304 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:58.271971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a1e06b5-7066-468b-ac5f-bc0267736304 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:58.272877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a1e06b5-7066-468b-ac5f-bc0267736304 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:58.273301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a1e06b5-7066-468b-ac5f-bc0267736304 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:58.326658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a0fde149-8e73-4738-978e-d5f9ab556594 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6479200700>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:58.486453 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a0fde149-8e73-4738-978e-d5f9ab556594 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.164156 Feb 19 21:01:58.487202 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1368/2833] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:58 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:58.506140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-461e70e8-1848-4d32-badc-14a2514ddbfb tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:58.511444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-461e70e8-1848-4d32-badc-14a2514ddbfb tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:58.529353 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-461e70e8-1848-4d32-badc-14a2514ddbfb tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:58.533588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-461e70e8-1848-4d32-badc-14a2514ddbfb tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:58.541357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-461e70e8-1848-4d32-badc-14a2514ddbfb tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:58.542037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-461e70e8-1848-4d32-badc-14a2514ddbfb tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:59.031043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6a1e06b5-7066-468b-ac5f-bc0267736304 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:59.043141 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6a1e06b5-7066-468b-ac5f-bc0267736304 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 0.802071 Feb 19 21:01:59.046058 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1466/2834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:58 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:59.061880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96c92ff7-40d2-4012-b9a4-2267a3c8736b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:59.065841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-96c92ff7-40d2-4012-b9a4-2267a3c8736b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:01:59.080128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c92ff7-40d2-4012-b9a4-2267a3c8736b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:59.080736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c92ff7-40d2-4012-b9a4-2267a3c8736b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:59.081808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c92ff7-40d2-4012-b9a4-2267a3c8736b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:59.083130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c92ff7-40d2-4012-b9a4-2267a3c8736b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:59.416106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-461e70e8-1848-4d32-badc-14a2514ddbfb tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:59.429330 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-461e70e8-1848-4d32-badc-14a2514ddbfb tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.940388 Feb 19 21:01:59.436664 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1369/2835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:58 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:59.467071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-de00b2b5-b03a-4743-8471-d13e222752d3 req-dbf26bc6-9634-4d45-b73c-b8889e8d5821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9440fe13-0931-4b97-a7cb-ec215645eb5a", "tag": "5522f49c-1f87-419c-bb79-a02284fc44b4"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:01:59.475064 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:01:59.475064 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:01:59.508643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-de00b2b5-b03a-4743-8471-d13e222752d3 req-dbf26bc6-9634-4d45-b73c-b8889e8d5821 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:01:59.514453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-de00b2b5-b03a-4743-8471-d13e222752d3 req-dbf26bc6-9634-4d45-b73c-b8889e8d5821 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:01:59.546815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-96c92ff7-40d2-4012-b9a4-2267a3c8736b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:01:59.555956 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96c92ff7-40d2-4012-b9a4-2267a3c8736b tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1482 microversion: 2.1 time: 0.505587 Feb 19 21:01:59.564083 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1467/2836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:01:59 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1482 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:59.567998 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-de00b2b5-b03a-4743-8471-d13e222752d3 req-dbf26bc6-9634-4d45-b73c-b8889e8d5821 service nova] Creating event network-changed:5522f49c-1f87-419c-bb79-a02284fc44b4 for instance 9440fe13-0931-4b97-a7cb-ec215645eb5a on nch2-master-1 Feb 19 21:01:59.585838 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-de00b2b5-b03a-4743-8471-d13e222752d3 req-dbf26bc6-9634-4d45-b73c-b8889e8d5821 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143550 Feb 19 21:01:59.586475 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1370/2837] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:01:59.595868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b54b99d-4517-4901-8ed8-0773ae38fafd tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6474454c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:01:59.706531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b54b99d-4517-4901-8ed8-0773ae38fafd tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.141070 Feb 19 21:01:59.707126 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1468/2838] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:01:59 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:01:59.945694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-532953821", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:00.063772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c74825b1-3822-4637-80b1-c49479b769a6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:00.064731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c74825b1-3822-4637-80b1-c49479b769a6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:00.076849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c74825b1-3822-4637-80b1-c49479b769a6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:00.077497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c74825b1-3822-4637-80b1-c49479b769a6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:00.078513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c74825b1-3822-4637-80b1-c49479b769a6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:00.078776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] validate_networks() for [('e71ef3e2-ffea-48b1-add4-7381a9421313', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:02:00.080482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c74825b1-3822-4637-80b1-c49479b769a6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:00.528053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c74825b1-3822-4637-80b1-c49479b769a6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:00.541451 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c74825b1-3822-4637-80b1-c49479b769a6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 0.482061 Feb 19 21:02:00.542042 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1469/2839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:00 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:00.547066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-608212438", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "b2b08d58-ef61-4880-94a7-4dce88778bec"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:00.653413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] validate_networks() for [('b2b08d58-ef61-4880-94a7-4dce88778bec', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:02:02.063545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:02:02.068966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:02:02.069487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:02:02.070069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:02:02.070624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:02:02.097306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:02.097760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:02.101954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:02.105485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:02.144099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Getting quotas for project c03769052a6d4b21ad5a0dc4ce5e15fd. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:02:02.157498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Getting quotas for user 0f073c8403c445029976989a1848060f and project c03769052a6d4b21ad5a0dc4ce5e15fd. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:02:02.179673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:02:02.182722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:02:02.370118 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1995b63-8dd9-4405-bbd3-f6cb3f814cd4 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.740360 Feb 19 21:02:02.385959 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1371/2840] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:01:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:02:02.452818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4b6debb7-5a82-418a-883d-82f5f042e307 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:02.455715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4b6debb7-5a82-418a-883d-82f5f042e307 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:02.473292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:02:02.473883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:02:02.474195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:02:02.474625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:02:02.475020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:02:02.514913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:02.515368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:02.516174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:02.516751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:02.525690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b6debb7-5a82-418a-883d-82f5f042e307 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:02.526211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b6debb7-5a82-418a-883d-82f5f042e307 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:02.527041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b6debb7-5a82-418a-883d-82f5f042e307 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:02.527510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b6debb7-5a82-418a-883d-82f5f042e307 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:02.585129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Getting quotas for project c3e2bd0a55e44ee2802a7b95678c9d60. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:02:02.597939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Getting quotas for user bb812b1b093045b1aaa3ce9e3334ff4d and project c3e2bd0a55e44ee2802a7b95678c9d60. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:02:02.634903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:02:02.639730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:02:02.853630 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54ca1d73-a483-4972-8e4f-90627fd43609 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.309946 Feb 19 21:02:02.854305 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1470/2841] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:02:02.894764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a9a9ded5-c63f-4514-86ad-a93c9fe5c429 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467daa670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:02.989563 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a9a9ded5-c63f-4514-86ad-a93c9fe5c429 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.110024 Feb 19 21:02:02.990347 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1471/2842] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:02 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:03.001889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7c1aabf7-bcf6-4fcb-b254-df5b84a30307 req-4b4c0854-5e6f-4885-a6df-efb15574c94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457783d2-8dc2-4522-80cf-081a6a013e17", "name": "network-vif-plugged", "status": "completed", "tag": "b9f99142-6fa5-417a-bb09-98abb27cd0be"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:03.008942 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:03.008942 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:03.027176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7c1aabf7-bcf6-4fcb-b254-df5b84a30307 req-4b4c0854-5e6f-4885-a6df-efb15574c94a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:03.028191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7c1aabf7-bcf6-4fcb-b254-df5b84a30307 req-4b4c0854-5e6f-4885-a6df-efb15574c94a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:03.036084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4b6debb7-5a82-418a-883d-82f5f042e307 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:03.044029 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4b6debb7-5a82-418a-883d-82f5f042e307 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.655331 Feb 19 21:02:03.064485 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1372/2843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:02 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:03.072006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e22734ae-51b8-4ef9-957d-5fa7ff772808 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:03.081815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e22734ae-51b8-4ef9-957d-5fa7ff772808 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:03.094291 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7c1aabf7-bcf6-4fcb-b254-df5b84a30307 req-4b4c0854-5e6f-4885-a6df-efb15574c94a service nova] Creating event network-vif-plugged:b9f99142-6fa5-417a-bb09-98abb27cd0be for instance 457783d2-8dc2-4522-80cf-081a6a013e17 on nch2-master-1 Feb 19 21:02:03.094554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e22734ae-51b8-4ef9-957d-5fa7ff772808 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:03.095042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e22734ae-51b8-4ef9-957d-5fa7ff772808 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:03.096005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e22734ae-51b8-4ef9-957d-5fa7ff772808 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:03.096842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e22734ae-51b8-4ef9-957d-5fa7ff772808 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:03.108963 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7c1aabf7-bcf6-4fcb-b254-df5b84a30307 req-4b4c0854-5e6f-4885-a6df-efb15574c94a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117221 Feb 19 21:02:03.110082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1472/2844] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:03.125111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ce44e351-f5a5-4ec6-aa80-d3f029bed9d1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:03.126905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ce44e351-f5a5-4ec6-aa80-d3f029bed9d1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:03.368862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ce44e351-f5a5-4ec6-aa80-d3f029bed9d1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:03.412925 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ce44e351-f5a5-4ec6-aa80-d3f029bed9d1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1222 microversion: 2.1 time: 0.289375 Feb 19 21:02:03.419166 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1473/2845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:03 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1222 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:03.452989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bd579e6f-f27a-455c-9b3f-0ebd81baa61b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:03.456058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bd579e6f-f27a-455c-9b3f-0ebd81baa61b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:03.768409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bd579e6f-f27a-455c-9b3f-0ebd81baa61b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:03.776000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bd579e6f-f27a-455c-9b3f-0ebd81baa61b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1213 microversion: 2.1 time: 0.353924 Feb 19 21:02:03.783937 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1474/2846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:03 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1213 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:03.799328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e22734ae-51b8-4ef9-957d-5fa7ff772808 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:03.811882 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e22734ae-51b8-4ef9-957d-5fa7ff772808 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 0.745067 Feb 19 21:02:03.825139 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1373/2847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:03 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:04.003616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-48417690-11c0-4d4c-918c-53e73cdaa43f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f647457a670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:04.065109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-20564194-4503-4c5c-ba2e-58236d07a83c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:04.066078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-20564194-4503-4c5c-ba2e-58236d07a83c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:04.107788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20564194-4503-4c5c-ba2e-58236d07a83c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:04.108246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20564194-4503-4c5c-ba2e-58236d07a83c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:04.110262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20564194-4503-4c5c-ba2e-58236d07a83c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:04.116483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20564194-4503-4c5c-ba2e-58236d07a83c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:04.515394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-20564194-4503-4c5c-ba2e-58236d07a83c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:04.529369 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-20564194-4503-4c5c-ba2e-58236d07a83c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 0.470871 Feb 19 21:02:04.531202 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1374/2848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:04 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:04.537595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad86d9fc-18af-4ca5-8052-ff3679403bf9 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:04.538799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ad86d9fc-18af-4ca5-8052-ff3679403bf9 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:04.556098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad86d9fc-18af-4ca5-8052-ff3679403bf9 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:04.556966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad86d9fc-18af-4ca5-8052-ff3679403bf9 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:04.557947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad86d9fc-18af-4ca5-8052-ff3679403bf9 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:04.558547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad86d9fc-18af-4ca5-8052-ff3679403bf9 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:04.744718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ad86d9fc-18af-4ca5-8052-ff3679403bf9 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:04.756611 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad86d9fc-18af-4ca5-8052-ff3679403bf9 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1282 microversion: 2.1 time: 0.223974 Feb 19 21:02:04.775544 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1375/2849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:04 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1282 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:04.800928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-866838e4-0593-4dba-a575-8a40675fdbce tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:04.801910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-866838e4-0593-4dba-a575-8a40675fdbce tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:04.820878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-866838e4-0593-4dba-a575-8a40675fdbce tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:04.821720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-866838e4-0593-4dba-a575-8a40675fdbce tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:04.825307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-866838e4-0593-4dba-a575-8a40675fdbce tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:04.831885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-866838e4-0593-4dba-a575-8a40675fdbce tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:05.159238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-866838e4-0593-4dba-a575-8a40675fdbce tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:05.172276 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-866838e4-0593-4dba-a575-8a40675fdbce tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1265 microversion: 2.1 time: 0.375150 Feb 19 21:02:05.187283 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1376/2850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:04 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:05.200433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-07f11523-8ff5-4a70-bf4f-8d2f1864bad9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:05.201697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-07f11523-8ff5-4a70-bf4f-8d2f1864bad9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:05.222271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07f11523-8ff5-4a70-bf4f-8d2f1864bad9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:05.226704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07f11523-8ff5-4a70-bf4f-8d2f1864bad9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:05.228428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07f11523-8ff5-4a70-bf4f-8d2f1864bad9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:05.229039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07f11523-8ff5-4a70-bf4f-8d2f1864bad9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:06.294328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-07f11523-8ff5-4a70-bf4f-8d2f1864bad9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:06.310556 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-07f11523-8ff5-4a70-bf4f-8d2f1864bad9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 1.121100 Feb 19 21:02:06.311793 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1377/2851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:05 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:06.326082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-951d0640-0eb9-402d-aa29-aeb570b8ee7f req-6dcb5f9c-ec8e-4407-8dc6-94e70e605cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457783d2-8dc2-4522-80cf-081a6a013e17", "name": "network-vif-plugged", "status": "completed", "tag": "53f0c9b6-2a6b-4f8e-8fff-82ecf9fa570f"}, {"server_uuid": "457783d2-8dc2-4522-80cf-081a6a013e17", "name": "network-vif-plugged", "status": "completed", "tag": "ff871375-e78c-4d10-8106-2a234a325971"}, {"server_uuid": "bd8ab6fb-0631-4ea1-b58f-e22572722a52", "name": "network-vif-plugged", "status": "completed", "tag": "57f2a797-1cfe-462b-a115-d8f0563b8044"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:06.328758 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:06.328758 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:06.337725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-951d0640-0eb9-402d-aa29-aeb570b8ee7f req-6dcb5f9c-ec8e-4407-8dc6-94e70e605cef service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:06.338669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-951d0640-0eb9-402d-aa29-aeb570b8ee7f req-6dcb5f9c-ec8e-4407-8dc6-94e70e605cef service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:06.354635 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-951d0640-0eb9-402d-aa29-aeb570b8ee7f req-6dcb5f9c-ec8e-4407-8dc6-94e70e605cef service nova] Creating event network-vif-plugged:53f0c9b6-2a6b-4f8e-8fff-82ecf9fa570f for instance 457783d2-8dc2-4522-80cf-081a6a013e17 on nch2-master-1 Feb 19 21:02:06.356663 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-951d0640-0eb9-402d-aa29-aeb570b8ee7f req-6dcb5f9c-ec8e-4407-8dc6-94e70e605cef service nova] Creating event network-vif-plugged:ff871375-e78c-4d10-8106-2a234a325971 for instance 457783d2-8dc2-4522-80cf-081a6a013e17 on nch2-master-1 Feb 19 21:02:06.357708 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-951d0640-0eb9-402d-aa29-aeb570b8ee7f req-6dcb5f9c-ec8e-4407-8dc6-94e70e605cef service nova] Creating event network-vif-plugged:57f2a797-1cfe-462b-a115-d8f0563b8044 for instance bd8ab6fb-0631-4ea1-b58f-e22572722a52 on nch2-master-1 Feb 19 21:02:06.365250 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-951d0640-0eb9-402d-aa29-aeb570b8ee7f req-6dcb5f9c-ec8e-4407-8dc6-94e70e605cef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050899 Feb 19 21:02:06.366272 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1378/2852] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:06.373078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-138041d6-846d-4cdb-9b2d-e6f7eaf4b1a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:06.374212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-138041d6-846d-4cdb-9b2d-e6f7eaf4b1a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:06.383447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-138041d6-846d-4cdb-9b2d-e6f7eaf4b1a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:06.384177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-138041d6-846d-4cdb-9b2d-e6f7eaf4b1a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:06.385777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-138041d6-846d-4cdb-9b2d-e6f7eaf4b1a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:06.388047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-138041d6-846d-4cdb-9b2d-e6f7eaf4b1a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:07.596921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-138041d6-846d-4cdb-9b2d-e6f7eaf4b1a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:07.613383 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-138041d6-846d-4cdb-9b2d-e6f7eaf4b1a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1354 microversion: 2.1 time: 1.245427 Feb 19 21:02:07.628417 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1379/2853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:06 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1354 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:07.641578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a7afebdd-8b29-42e9-8dbf-8f3ccd6c9657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:07.642386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a7afebdd-8b29-42e9-8dbf-8f3ccd6c9657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:07.654452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7afebdd-8b29-42e9-8dbf-8f3ccd6c9657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:07.655084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7afebdd-8b29-42e9-8dbf-8f3ccd6c9657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:07.656056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7afebdd-8b29-42e9-8dbf-8f3ccd6c9657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:07.659834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7afebdd-8b29-42e9-8dbf-8f3ccd6c9657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:08.559599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a7afebdd-8b29-42e9-8dbf-8f3ccd6c9657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:08.572885 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a7afebdd-8b29-42e9-8dbf-8f3ccd6c9657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1322 microversion: 2.1 time: 0.943137 Feb 19 21:02:08.583883 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1380/2854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:07 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1322 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:08.610245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cac0e73c-fd4e-4872-82b6-30b7570174a6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:08.610979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cac0e73c-fd4e-4872-82b6-30b7570174a6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:08.621936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cac0e73c-fd4e-4872-82b6-30b7570174a6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:08.624185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cac0e73c-fd4e-4872-82b6-30b7570174a6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:08.625250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cac0e73c-fd4e-4872-82b6-30b7570174a6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:08.629655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cac0e73c-fd4e-4872-82b6-30b7570174a6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:08.995354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cac0e73c-fd4e-4872-82b6-30b7570174a6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:09.010734 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cac0e73c-fd4e-4872-82b6-30b7570174a6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1313 microversion: 2.1 time: 0.417418 Feb 19 21:02:09.011987 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1381/2855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:08 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:09.022978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a1236082-77de-4f9a-bba9-b7d97d7ceaff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:09.023971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a1236082-77de-4f9a-bba9-b7d97d7ceaff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:09.032093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1236082-77de-4f9a-bba9-b7d97d7ceaff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:09.032929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1236082-77de-4f9a-bba9-b7d97d7ceaff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:09.034603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1236082-77de-4f9a-bba9-b7d97d7ceaff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:09.035366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1236082-77de-4f9a-bba9-b7d97d7ceaff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:09.376199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a1236082-77de-4f9a-bba9-b7d97d7ceaff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:09.400452 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a1236082-77de-4f9a-bba9-b7d97d7ceaff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 0.384572 Feb 19 21:02:09.401833 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1382/2856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:09 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:09.414469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d1f2cdc1-f92b-4e16-9e04-9ae99b4b181f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:09.415480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d1f2cdc1-f92b-4e16-9e04-9ae99b4b181f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:09.433162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1f2cdc1-f92b-4e16-9e04-9ae99b4b181f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:09.434682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1f2cdc1-f92b-4e16-9e04-9ae99b4b181f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:09.436734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1f2cdc1-f92b-4e16-9e04-9ae99b4b181f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:09.437928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1f2cdc1-f92b-4e16-9e04-9ae99b4b181f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:10.240420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d1f2cdc1-f92b-4e16-9e04-9ae99b4b181f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:10.262446 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d1f2cdc1-f92b-4e16-9e04-9ae99b4b181f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1803 microversion: 2.1 time: 0.858527 Feb 19 21:02:10.279324 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1383/2857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:09 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1803 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:10.284924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-35676277-2bf8-4c95-bd3f-b2f525a23301 req-b7a64aa8-78d9-4584-b274-be0612b30c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed99b5a-d90f-48ef-bfe9-97ccd625993c", "tag": "4a3185d0-44de-46bc-a6a9-47a19835dc9d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:10.294561 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:10.294561 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:10.316485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-35676277-2bf8-4c95-bd3f-b2f525a23301 req-b7a64aa8-78d9-4584-b274-be0612b30c19 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:10.317371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-35676277-2bf8-4c95-bd3f-b2f525a23301 req-b7a64aa8-78d9-4584-b274-be0612b30c19 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:10.342471 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-35676277-2bf8-4c95-bd3f-b2f525a23301 req-b7a64aa8-78d9-4584-b274-be0612b30c19 service nova] Creating event network-changed:4a3185d0-44de-46bc-a6a9-47a19835dc9d for instance 1ed99b5a-d90f-48ef-bfe9-97ccd625993c on nch1-master-1 Feb 19 21:02:10.355581 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-35676277-2bf8-4c95-bd3f-b2f525a23301 req-b7a64aa8-78d9-4584-b274-be0612b30c19 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071984 Feb 19 21:02:10.357047 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1384/2858] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:10.375928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7dfe73ad-897c-4af1-8a7f-a2d4b3d58d31 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:10.377016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7dfe73ad-897c-4af1-8a7f-a2d4b3d58d31 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:10.392822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dfe73ad-897c-4af1-8a7f-a2d4b3d58d31 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:10.394807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dfe73ad-897c-4af1-8a7f-a2d4b3d58d31 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:10.395804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dfe73ad-897c-4af1-8a7f-a2d4b3d58d31 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:10.396926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dfe73ad-897c-4af1-8a7f-a2d4b3d58d31 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:11.114261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7dfe73ad-897c-4af1-8a7f-a2d4b3d58d31 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:11.143266 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7dfe73ad-897c-4af1-8a7f-a2d4b3d58d31 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1322 microversion: 2.1 time: 0.784742 Feb 19 21:02:11.144253 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1385/2859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:10 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1322 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:11.149050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5970a6da-2254-4c00-b9f1-c2ece5bf4892 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:11.150020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5970a6da-2254-4c00-b9f1-c2ece5bf4892 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:11.159660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5970a6da-2254-4c00-b9f1-c2ece5bf4892 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:11.160344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5970a6da-2254-4c00-b9f1-c2ece5bf4892 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:11.161390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5970a6da-2254-4c00-b9f1-c2ece5bf4892 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:11.161993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5970a6da-2254-4c00-b9f1-c2ece5bf4892 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:11.637596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5970a6da-2254-4c00-b9f1-c2ece5bf4892 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:11.650964 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5970a6da-2254-4c00-b9f1-c2ece5bf4892 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1313 microversion: 2.1 time: 0.505481 Feb 19 21:02:11.651569 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1386/2860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:11 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:11.687422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-591d0ca4-2de9-4c0d-9fc2-9aa1f2fe980c req-eeb80660-d3a8-4919-a939-0410cd71761a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9768e057-90fb-4013-8fe7-fb1a08cb3838", "tag": "87bdd6b6-d465-456b-9e9c-92f5a5657f7e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:11.694665 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:11.694665 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:11.719826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-591d0ca4-2de9-4c0d-9fc2-9aa1f2fe980c req-eeb80660-d3a8-4919-a939-0410cd71761a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:11.723341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-591d0ca4-2de9-4c0d-9fc2-9aa1f2fe980c req-eeb80660-d3a8-4919-a939-0410cd71761a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:11.762064 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-591d0ca4-2de9-4c0d-9fc2-9aa1f2fe980c req-eeb80660-d3a8-4919-a939-0410cd71761a service nova] Creating event network-changed:87bdd6b6-d465-456b-9e9c-92f5a5657f7e for instance 9768e057-90fb-4013-8fe7-fb1a08cb3838 on nch1-master-1 Feb 19 21:02:11.804727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-591d0ca4-2de9-4c0d-9fc2-9aa1f2fe980c req-eeb80660-d3a8-4919-a939-0410cd71761a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123282 Feb 19 21:02:11.809015 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1387/2861] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:11.850897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-60865bde-613a-478b-935d-bf501ea939f8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:11.852232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-60865bde-613a-478b-935d-bf501ea939f8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:11.882551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-60865bde-613a-478b-935d-bf501ea939f8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:11.882955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-60865bde-613a-478b-935d-bf501ea939f8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:11.883779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-60865bde-613a-478b-935d-bf501ea939f8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:11.884342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-60865bde-613a-478b-935d-bf501ea939f8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:11.948448 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-60865bde-613a-478b-935d-bf501ea939f8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17/ips" status: 200 len: 217 microversion: 2.1 time: 0.136987 Feb 19 21:02:11.959601 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1388/2862] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:02:11 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17/ips => generated 217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:11.967407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06a965d8-d473-4180-90d3-3aec1f25e4e5 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:11.968426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06a965d8-d473-4180-90d3-3aec1f25e4e5 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:11.976876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a965d8-d473-4180-90d3-3aec1f25e4e5 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:11.977410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a965d8-d473-4180-90d3-3aec1f25e4e5 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:11.978870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a965d8-d473-4180-90d3-3aec1f25e4e5 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:11.979688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06a965d8-d473-4180-90d3-3aec1f25e4e5 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:12.446468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-06a965d8-d473-4180-90d3-3aec1f25e4e5 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:12.471843 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06a965d8-d473-4180-90d3-3aec1f25e4e5 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 0.501642 Feb 19 21:02:12.479452 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1389/2863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:11 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:12.591538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ee54860b-38d6-4dc8-86ce-f0ad97feb7a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:12.593613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ee54860b-38d6-4dc8-86ce-f0ad97feb7a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:12.616549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee54860b-38d6-4dc8-86ce-f0ad97feb7a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:12.620518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee54860b-38d6-4dc8-86ce-f0ad97feb7a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:12.622959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee54860b-38d6-4dc8-86ce-f0ad97feb7a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:12.632687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee54860b-38d6-4dc8-86ce-f0ad97feb7a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:12.710147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ee54860b-38d6-4dc8-86ce-f0ad97feb7a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:02:12.934019 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ee54860b-38d6-4dc8-86ce-f0ad97feb7a8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "DELETE /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 204 len: 0 microversion: 2.1 time: 0.446025 Feb 19 21:02:12.934755 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1390/2864] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:02:12 2022] DELETE /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:02:12.947162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9966887-2888-478d-bd10-588079f8c909 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:12.947963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9966887-2888-478d-bd10-588079f8c909 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:12.957305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9966887-2888-478d-bd10-588079f8c909 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:12.957763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9966887-2888-478d-bd10-588079f8c909 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:12.958676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9966887-2888-478d-bd10-588079f8c909 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:12.959177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9966887-2888-478d-bd10-588079f8c909 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:13.255101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a9966887-2888-478d-bd10-588079f8c909 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:13.266769 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9966887-2888-478d-bd10-588079f8c909 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1322 microversion: 2.1 time: 0.323450 Feb 19 21:02:13.266971 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1391/2865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:12 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:13.272277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4af254c4-81ad-4e92-b90f-b8ba46a3d687 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:13.272919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4af254c4-81ad-4e92-b90f-b8ba46a3d687 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:13.281003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4af254c4-81ad-4e92-b90f-b8ba46a3d687 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:13.281463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4af254c4-81ad-4e92-b90f-b8ba46a3d687 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:13.282264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4af254c4-81ad-4e92-b90f-b8ba46a3d687 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:13.282712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4af254c4-81ad-4e92-b90f-b8ba46a3d687 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:13.537476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4af254c4-81ad-4e92-b90f-b8ba46a3d687 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:13.548533 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4af254c4-81ad-4e92-b90f-b8ba46a3d687 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1313 microversion: 2.1 time: 0.280071 Feb 19 21:02:13.549756 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1392/2866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:13 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:13.554840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-268948fa-a3da-45b9-9ca5-2d026abb7bed tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:13.555720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-268948fa-a3da-45b9-9ca5-2d026abb7bed tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:13.563376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-268948fa-a3da-45b9-9ca5-2d026abb7bed tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:13.564301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-268948fa-a3da-45b9-9ca5-2d026abb7bed tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:13.565607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-268948fa-a3da-45b9-9ca5-2d026abb7bed tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:13.566277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-268948fa-a3da-45b9-9ca5-2d026abb7bed tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:14.123826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-268948fa-a3da-45b9-9ca5-2d026abb7bed tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:14.145049 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-268948fa-a3da-45b9-9ca5-2d026abb7bed tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1809 microversion: 2.1 time: 0.593024 Feb 19 21:02:14.149268 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1393/2867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:13 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1809 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:14.162175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e9444c1e-7131-47a7-9092-ffdaf5c6b302 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:14.162850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e9444c1e-7131-47a7-9092-ffdaf5c6b302 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:14.179504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9444c1e-7131-47a7-9092-ffdaf5c6b302 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:14.179976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9444c1e-7131-47a7-9092-ffdaf5c6b302 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:14.181154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9444c1e-7131-47a7-9092-ffdaf5c6b302 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:14.183092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9444c1e-7131-47a7-9092-ffdaf5c6b302 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:14.495359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e9444c1e-7131-47a7-9092-ffdaf5c6b302 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:14.505701 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e9444c1e-7131-47a7-9092-ffdaf5c6b302 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1567 microversion: 2.1 time: 0.355282 Feb 19 21:02:14.511382 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1394/2868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:14 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1567 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:14.518575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5bb99db9-66a8-4af8-a252-0f5398a8fe9e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:14.519480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5bb99db9-66a8-4af8-a252-0f5398a8fe9e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:14.546400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bb99db9-66a8-4af8-a252-0f5398a8fe9e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:14.546860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bb99db9-66a8-4af8-a252-0f5398a8fe9e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:14.547685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bb99db9-66a8-4af8-a252-0f5398a8fe9e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:14.548127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5bb99db9-66a8-4af8-a252-0f5398a8fe9e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:14.906637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5bb99db9-66a8-4af8-a252-0f5398a8fe9e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:14.915638 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5bb99db9-66a8-4af8-a252-0f5398a8fe9e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1322 microversion: 2.1 time: 0.402283 Feb 19 21:02:14.920075 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1395/2869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:14 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:14.926428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cc46f150-3199-4aae-b842-3a5288a55ede tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:14.928722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cc46f150-3199-4aae-b842-3a5288a55ede tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:14.950620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc46f150-3199-4aae-b842-3a5288a55ede tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:14.951356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc46f150-3199-4aae-b842-3a5288a55ede tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:14.952287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc46f150-3199-4aae-b842-3a5288a55ede tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:14.953011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc46f150-3199-4aae-b842-3a5288a55ede tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:15.489660 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-48417690-11c0-4d4c-918c-53e73cdaa43f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 11.490309 Feb 19 21:02:15.490387 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1475/2870] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:03 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 11492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:15.501388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3d440937-a75c-416e-98cf-edfb067e7287 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:15.502008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3d440937-a75c-416e-98cf-edfb067e7287 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:15.515780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cc46f150-3199-4aae-b842-3a5288a55ede tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:15.518414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d440937-a75c-416e-98cf-edfb067e7287 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:15.519020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d440937-a75c-416e-98cf-edfb067e7287 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:15.521374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d440937-a75c-416e-98cf-edfb067e7287 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:15.522071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d440937-a75c-416e-98cf-edfb067e7287 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:15.528603 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cc46f150-3199-4aae-b842-3a5288a55ede tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1313 microversion: 2.1 time: 0.607119 Feb 19 21:02:15.544674 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1396/2871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:14 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:15.561534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45a95660-eecc-4cc2-b402-8c09de6c8326 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:15.571490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-45a95660-eecc-4cc2-b402-8c09de6c8326 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:15.579518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45a95660-eecc-4cc2-b402-8c09de6c8326 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:15.579977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45a95660-eecc-4cc2-b402-8c09de6c8326 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:15.580804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45a95660-eecc-4cc2-b402-8c09de6c8326 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:15.581254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45a95660-eecc-4cc2-b402-8c09de6c8326 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:16.225956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-45a95660-eecc-4cc2-b402-8c09de6c8326 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:16.240010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3d440937-a75c-416e-98cf-edfb067e7287 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:16.251247 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45a95660-eecc-4cc2-b402-8c09de6c8326 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1547 microversion: 2.1 time: 0.690690 Feb 19 21:02:16.252203 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1397/2872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:15 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1547 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:16.253259 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3d440937-a75c-416e-98cf-edfb067e7287 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1809 microversion: 2.1 time: 0.761826 Feb 19 21:02:16.255862 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1476/2873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:15 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1809 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:16.271593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-24e05ad4-621f-4d67-a9ba-f8ffe844e825 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:16.274824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f3c6ddf-fb95-4a1b-9eaf-075f3e93f29f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:16.276117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-24e05ad4-621f-4d67-a9ba-f8ffe844e825 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:16.282494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9f3c6ddf-fb95-4a1b-9eaf-075f3e93f29f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:16.301601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24e05ad4-621f-4d67-a9ba-f8ffe844e825 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:16.305616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24e05ad4-621f-4d67-a9ba-f8ffe844e825 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:16.306470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24e05ad4-621f-4d67-a9ba-f8ffe844e825 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:16.306919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24e05ad4-621f-4d67-a9ba-f8ffe844e825 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:16.308265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f3c6ddf-fb95-4a1b-9eaf-075f3e93f29f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:16.309786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f3c6ddf-fb95-4a1b-9eaf-075f3e93f29f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:16.311665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f3c6ddf-fb95-4a1b-9eaf-075f3e93f29f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:16.312118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f3c6ddf-fb95-4a1b-9eaf-075f3e93f29f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:17.318678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-24e05ad4-621f-4d67-a9ba-f8ffe844e825 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:17.326863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9f3c6ddf-fb95-4a1b-9eaf-075f3e93f29f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:17.331909 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-24e05ad4-621f-4d67-a9ba-f8ffe844e825 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 1.077408 Feb 19 21:02:17.333196 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1398/2874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:16 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:17.345752 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f3c6ddf-fb95-4a1b-9eaf-075f3e93f29f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1322 microversion: 2.1 time: 1.087793 Feb 19 21:02:17.346953 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1477/2875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:16 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1322 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:17.350212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8bc2de0-28e8-4246-8a24-b04049f7a58c tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:17.350927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e8bc2de0-28e8-4246-8a24-b04049f7a58c tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:17.358753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8bc2de0-28e8-4246-8a24-b04049f7a58c tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:17.359490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8bc2de0-28e8-4246-8a24-b04049f7a58c tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:17.360783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8bc2de0-28e8-4246-8a24-b04049f7a58c tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:17.361547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8bc2de0-28e8-4246-8a24-b04049f7a58c tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:17.367105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-47e7b891-07ab-4873-b55c-bf72487cd867 req-f38cccf7-26ed-4381-99ea-ae0c735b499b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457783d2-8dc2-4522-80cf-081a6a013e17", "name": "network-vif-deleted", "tag": "ff871375-e78c-4d10-8106-2a234a325971"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:17.375264 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:17.375264 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:17.396216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-47e7b891-07ab-4873-b55c-bf72487cd867 req-f38cccf7-26ed-4381-99ea-ae0c735b499b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:17.400443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-47e7b891-07ab-4873-b55c-bf72487cd867 req-f38cccf7-26ed-4381-99ea-ae0c735b499b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:17.433427 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-47e7b891-07ab-4873-b55c-bf72487cd867 req-f38cccf7-26ed-4381-99ea-ae0c735b499b service nova] Creating event network-vif-deleted:ff871375-e78c-4d10-8106-2a234a325971 for instance 457783d2-8dc2-4522-80cf-081a6a013e17 on nch2-master-1 Feb 19 21:02:17.453031 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-47e7b891-07ab-4873-b55c-bf72487cd867 req-f38cccf7-26ed-4381-99ea-ae0c735b499b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102669 Feb 19 21:02:17.454142 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1478/2876] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:17.473007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-443dfa26-42cf-4ead-be7c-2aa14396af24 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467ee94c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:17.523852 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-e8bc2de0-28e8-4246-8a24-b04049f7a58c tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] HTTP exception thrown: Cannot 'detach_volume' instance 2df03445-3277-48bd-be5b-c8503c33714d while it is in vm_state rescued Feb 19 21:02:17.524806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8bc2de0-28e8-4246-8a24-b04049f7a58c tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Returning 409 to user: Cannot 'detach_volume' instance 2df03445-3277-48bd-be5b-c8503c33714d while it is in vm_state rescued {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:17.525817 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e8bc2de0-28e8-4246-8a24-b04049f7a58c tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments/aed146c7-103d-4b73-ba02-11fcb7868c65" status: 409 len: 152 microversion: 2.1 time: 0.191557 Feb 19 21:02:17.528414 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1399/2877] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:02:17 2022] DELETE /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments/aed146c7-103d-4b73-ba02-11fcb7868c65 => generated 152 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:02:17.550155 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-443dfa26-42cf-4ead-be7c-2aa14396af24 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.094593 Feb 19 21:02:17.551332 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1479/2878] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:17 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:17.556891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dde42bc6-4784-4751-8166-3a40e637044e tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:17.557511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd3e1726-2891-4594-ab52-eab13768b6d8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:17.559748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fd3e1726-2891-4594-ab52-eab13768b6d8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:17.564817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dde42bc6-4784-4751-8166-3a40e637044e tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:17.568155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd3e1726-2891-4594-ab52-eab13768b6d8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:17.568848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd3e1726-2891-4594-ab52-eab13768b6d8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:17.569964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd3e1726-2891-4594-ab52-eab13768b6d8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:17.570572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd3e1726-2891-4594-ab52-eab13768b6d8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:17.596846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dde42bc6-4784-4751-8166-3a40e637044e tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:17.597308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dde42bc6-4784-4751-8166-3a40e637044e tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:17.598293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dde42bc6-4784-4751-8166-3a40e637044e tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:17.598991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dde42bc6-4784-4751-8166-3a40e637044e tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.184636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fd3e1726-2891-4594-ab52-eab13768b6d8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:18.210476 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fd3e1726-2891-4594-ab52-eab13768b6d8 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 200 len: 1609 microversion: 2.1 time: 0.658000 Feb 19 21:02:18.211441 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1480/2879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:17 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 1609 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:18.221467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bc801fda-a3d2-4bfb-86ef-d2e504d4c127 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:18.230703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bc801fda-a3d2-4bfb-86ef-d2e504d4c127 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:18.251796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc801fda-a3d2-4bfb-86ef-d2e504d4c127 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:18.255818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc801fda-a3d2-4bfb-86ef-d2e504d4c127 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.258199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc801fda-a3d2-4bfb-86ef-d2e504d4c127 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:18.259195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc801fda-a3d2-4bfb-86ef-d2e504d4c127 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.294943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dde42bc6-4784-4751-8166-3a40e637044e tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:18.306762 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dde42bc6-4784-4751-8166-3a40e637044e tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1313 microversion: 2.1 time: 0.777055 Feb 19 21:02:18.323818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1400/2880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:17 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1313 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:18.340949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-fc204eef-0a96-456a-a886-c2a039825079 req-a4f33d37-99c7-434e-8a00-2c84cd76dce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed99b5a-d90f-48ef-bfe9-97ccd625993c", "name": "network-vif-plugged", "status": "completed", "tag": "4a3185d0-44de-46bc-a6a9-47a19835dc9d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:18.343078 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:18.343078 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:18.362694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fc204eef-0a96-456a-a886-c2a039825079 req-a4f33d37-99c7-434e-8a00-2c84cd76dce7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:18.363107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fc204eef-0a96-456a-a886-c2a039825079 req-a4f33d37-99c7-434e-8a00-2c84cd76dce7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.377852 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fc204eef-0a96-456a-a886-c2a039825079 req-a4f33d37-99c7-434e-8a00-2c84cd76dce7 service nova] Creating event network-vif-plugged:4a3185d0-44de-46bc-a6a9-47a19835dc9d for instance 1ed99b5a-d90f-48ef-bfe9-97ccd625993c on nch1-master-1 Feb 19 21:02:18.388450 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-fc204eef-0a96-456a-a886-c2a039825079 req-a4f33d37-99c7-434e-8a00-2c84cd76dce7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059897 Feb 19 21:02:18.390244 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1401/2881] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:18.397654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d7043f1f-3a63-41ef-ad70-7d510ed450ea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:18.399277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d7043f1f-3a63-41ef-ad70-7d510ed450ea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:18.407158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d7043f1f-3a63-41ef-ad70-7d510ed450ea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:18.408374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d7043f1f-3a63-41ef-ad70-7d510ed450ea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.409747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d7043f1f-3a63-41ef-ad70-7d510ed450ea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:18.410377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d7043f1f-3a63-41ef-ad70-7d510ed450ea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.441689 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bc801fda-a3d2-4bfb-86ef-d2e504d4c127 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action" status: 202 len: 0 microversion: 2.1 time: 0.224709 Feb 19 21:02:18.447855 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1481/2882] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:02:18 2022] POST /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:02:18.468653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f204837-a077-4478-bd24-fa7c4b350959 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:18.470659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f204837-a077-4478-bd24-fa7c4b350959 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:18.484912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f204837-a077-4478-bd24-fa7c4b350959 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:18.489577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f204837-a077-4478-bd24-fa7c4b350959 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.490678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f204837-a077-4478-bd24-fa7c4b350959 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:18.493270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f204837-a077-4478-bd24-fa7c4b350959 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.865508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d7043f1f-3a63-41ef-ad70-7d510ed450ea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:18.878776 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d7043f1f-3a63-41ef-ad70-7d510ed450ea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.486353 Feb 19 21:02:18.880046 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1402/2883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:18 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:18.886502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f181a16d-8400-4dc4-8c5d-2e3390bfd64d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:18.888548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f181a16d-8400-4dc4-8c5d-2e3390bfd64d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:18.896417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f181a16d-8400-4dc4-8c5d-2e3390bfd64d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:18.897134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f181a16d-8400-4dc4-8c5d-2e3390bfd64d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.898648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f181a16d-8400-4dc4-8c5d-2e3390bfd64d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:18.899995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f181a16d-8400-4dc4-8c5d-2e3390bfd64d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:18.953683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1f204837-a077-4478-bd24-fa7c4b350959 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:18.963666 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f204837-a077-4478-bd24-fa7c4b350959 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1322 microversion: 2.1 time: 0.514230 Feb 19 21:02:18.966573 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1482/2884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:18 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:18.972949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8bfc0860-ba59-4404-b2c8-10a08b0c4dee tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467d2d280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:19.071887 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8bfc0860-ba59-4404-b2c8-10a08b0c4dee tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.104015 Feb 19 21:02:19.079397 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1483/2885] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:18 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:19.085591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2c4daf80-30e2-45a6-8d83-4d07ebf82130 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1023683699"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:19.086842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2c4daf80-30e2-45a6-8d83-4d07ebf82130 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:19.096031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c4daf80-30e2-45a6-8d83-4d07ebf82130 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:19.096616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c4daf80-30e2-45a6-8d83-4d07ebf82130 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:19.097543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c4daf80-30e2-45a6-8d83-4d07ebf82130 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:19.098096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c4daf80-30e2-45a6-8d83-4d07ebf82130 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:19.134859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f181a16d-8400-4dc4-8c5d-2e3390bfd64d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:19.149285 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f181a16d-8400-4dc4-8c5d-2e3390bfd64d tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1555 microversion: 2.1 time: 0.267604 Feb 19 21:02:19.155842 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1403/2886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:18 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1555 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:19.232904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c70a5e2a-5007-4279-b048-69b2b590df02 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:19.233709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c70a5e2a-5007-4279-b048-69b2b590df02 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:19.245325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c70a5e2a-5007-4279-b048-69b2b590df02 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:19.248145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c70a5e2a-5007-4279-b048-69b2b590df02 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:19.249600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c70a5e2a-5007-4279-b048-69b2b590df02 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:19.250248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c70a5e2a-5007-4279-b048-69b2b590df02 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:19.283578 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c70a5e2a-5007-4279-b048-69b2b590df02 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] HTTP exception thrown: Instance 457783d2-8dc2-4522-80cf-081a6a013e17 could not be found. Feb 19 21:02:19.284708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c70a5e2a-5007-4279-b048-69b2b590df02 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Returning 404 to user: Instance 457783d2-8dc2-4522-80cf-081a6a013e17 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:19.285719 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c70a5e2a-5007-4279-b048-69b2b590df02 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 404 len: 111 microversion: 2.1 time: 0.058216 Feb 19 21:02:19.288253 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1404/2887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:19 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:02:19.328485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-627918f4-d5c3-4bd7-810b-daaf55dd4183 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:19.330067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-627918f4-d5c3-4bd7-810b-daaf55dd4183 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:19.343407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-627918f4-d5c3-4bd7-810b-daaf55dd4183 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:19.344207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-627918f4-d5c3-4bd7-810b-daaf55dd4183 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:19.347638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-627918f4-d5c3-4bd7-810b-daaf55dd4183 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:19.348160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-627918f4-d5c3-4bd7-810b-daaf55dd4183 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:19.576261 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2c4daf80-30e2-45a6-8d83-4d07ebf82130 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.495334 Feb 19 21:02:19.583060 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1484/2888] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:02:19 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Feb 19 21:02:19.594707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5dbcf771-b9a6-4d21-a1f3-933673479963 req-758a2175-1d5e-401a-a0f4-203c0f1f2f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457783d2-8dc2-4522-80cf-081a6a013e17", "name": "network-vif-deleted", "tag": "53f0c9b6-2a6b-4f8e-8fff-82ecf9fa570f"}, {"server_uuid": "457783d2-8dc2-4522-80cf-081a6a013e17", "name": "network-vif-deleted", "tag": "b9f99142-6fa5-417a-bb09-98abb27cd0be"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:19.598586 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:19.598586 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:19.614920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5dbcf771-b9a6-4d21-a1f3-933673479963 req-758a2175-1d5e-401a-a0f4-203c0f1f2f45 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:19.616465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5dbcf771-b9a6-4d21-a1f3-933673479963 req-758a2175-1d5e-401a-a0f4-203c0f1f2f45 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:19.643650 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5dbcf771-b9a6-4d21-a1f3-933673479963 req-758a2175-1d5e-401a-a0f4-203c0f1f2f45 service nova] Creating event network-vif-deleted:53f0c9b6-2a6b-4f8e-8fff-82ecf9fa570f for instance 457783d2-8dc2-4522-80cf-081a6a013e17 on nch2-master-1 Feb 19 21:02:19.644820 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5dbcf771-b9a6-4d21-a1f3-933673479963 req-758a2175-1d5e-401a-a0f4-203c0f1f2f45 service nova] Creating event network-vif-deleted:b9f99142-6fa5-417a-bb09-98abb27cd0be for instance 457783d2-8dc2-4522-80cf-081a6a013e17 on nch2-master-1 Feb 19 21:02:19.662069 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5dbcf771-b9a6-4d21-a1f3-933673479963 req-758a2175-1d5e-401a-a0f4-203c0f1f2f45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073365 Feb 19 21:02:19.664323 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1485/2889] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:19.673770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f603bcf4-7b97-4c90-b4bd-552dbce1ce57 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:19.675467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f603bcf4-7b97-4c90-b4bd-552dbce1ce57 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:19.686725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f603bcf4-7b97-4c90-b4bd-552dbce1ce57 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:19.688451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f603bcf4-7b97-4c90-b4bd-552dbce1ce57 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:19.690754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f603bcf4-7b97-4c90-b4bd-552dbce1ce57 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:19.691454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f603bcf4-7b97-4c90-b4bd-552dbce1ce57 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:20.000776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-627918f4-d5c3-4bd7-810b-daaf55dd4183 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:20.014349 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-627918f4-d5c3-4bd7-810b-daaf55dd4183 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1313 microversion: 2.1 time: 0.687656 Feb 19 21:02:20.016697 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1405/2890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:19 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:20.028303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-03a6877c-4a4b-46e6-86f1-64b8fe8f9eaa tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:20.033234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-03a6877c-4a4b-46e6-86f1-64b8fe8f9eaa tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:20.048895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03a6877c-4a4b-46e6-86f1-64b8fe8f9eaa tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:20.050986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03a6877c-4a4b-46e6-86f1-64b8fe8f9eaa tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:20.053064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03a6877c-4a4b-46e6-86f1-64b8fe8f9eaa tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:20.055616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03a6877c-4a4b-46e6-86f1-64b8fe8f9eaa tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:20.196235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f603bcf4-7b97-4c90-b4bd-552dbce1ce57 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:20.227097 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f603bcf4-7b97-4c90-b4bd-552dbce1ce57 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.560256 Feb 19 21:02:20.228860 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1486/2891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:19 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:20.246821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-89c42e95-ee95-44db-b2bf-5f1413b90aa7 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6479106a60>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:20.325058 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-89c42e95-ee95-44db-b2bf-5f1413b90aa7 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.093110 Feb 19 21:02:20.325666 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1487/2892] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:20 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:20.341158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a0c677b-be12-42eb-a693-b611b2cedbf9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:20.342300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a0c677b-be12-42eb-a693-b611b2cedbf9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:20.351166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0c677b-be12-42eb-a693-b611b2cedbf9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:20.352413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0c677b-be12-42eb-a693-b611b2cedbf9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:20.354344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0c677b-be12-42eb-a693-b611b2cedbf9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:20.355065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0c677b-be12-42eb-a693-b611b2cedbf9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:20.487407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-03a6877c-4a4b-46e6-86f1-64b8fe8f9eaa tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:20.501058 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-03a6877c-4a4b-46e6-86f1-64b8fe8f9eaa tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1517 microversion: 2.1 time: 0.483226 Feb 19 21:02:20.505509 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1406/2893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:20 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1517 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:20.526413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b0b7f47f-2594-453f-85de-c7ae691b2be4 req-189d7eb4-fe56-46ac-b91a-4dd592f03ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9768e057-90fb-4013-8fe7-fb1a08cb3838", "name": "network-vif-plugged", "status": "completed", "tag": "87bdd6b6-d465-456b-9e9c-92f5a5657f7e"}, {"server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "name": "network-vif-unplugged", "status": "completed", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:20.533105 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:20.533105 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:20.544995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b0b7f47f-2594-453f-85de-c7ae691b2be4 req-189d7eb4-fe56-46ac-b91a-4dd592f03ce5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:20.545695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b0b7f47f-2594-453f-85de-c7ae691b2be4 req-189d7eb4-fe56-46ac-b91a-4dd592f03ce5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:20.579246 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b0b7f47f-2594-453f-85de-c7ae691b2be4 req-189d7eb4-fe56-46ac-b91a-4dd592f03ce5 service nova] Creating event network-vif-plugged:87bdd6b6-d465-456b-9e9c-92f5a5657f7e for instance 9768e057-90fb-4013-8fe7-fb1a08cb3838 on nch1-master-1 Feb 19 21:02:20.581308 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b0b7f47f-2594-453f-85de-c7ae691b2be4 req-189d7eb4-fe56-46ac-b91a-4dd592f03ce5 service nova] Creating event network-vif-unplugged:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:02:20.607075 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b0b7f47f-2594-453f-85de-c7ae691b2be4 req-189d7eb4-fe56-46ac-b91a-4dd592f03ce5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.098191 Feb 19 21:02:20.607941 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1407/2894] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:20.647458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9421c394-b270-430f-8fbb-03eed0b692e5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:20.650140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9421c394-b270-430f-8fbb-03eed0b692e5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:20.665535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9421c394-b270-430f-8fbb-03eed0b692e5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:20.666464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9421c394-b270-430f-8fbb-03eed0b692e5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:20.667573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9421c394-b270-430f-8fbb-03eed0b692e5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:20.669038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9421c394-b270-430f-8fbb-03eed0b692e5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:20.713605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-9421c394-b270-430f-8fbb-03eed0b692e5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lazy-loading 'flavor' on Instance uuid 1ed99b5a-d90f-48ef-bfe9-97ccd625993c {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:02:20.794988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a0c677b-be12-42eb-a693-b611b2cedbf9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:20.804852 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a0c677b-be12-42eb-a693-b611b2cedbf9 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1555 microversion: 2.1 time: 0.478139 Feb 19 21:02:20.814320 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1488/2895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:20 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1555 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:20.864490 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9421c394-b270-430f-8fbb-03eed0b692e5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action" status: 200 len: 32 microversion: 2.1 time: 0.234390 Feb 19 21:02:20.865168 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1408/2896] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:02:20 2022] POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:02:20.878972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36db35f2-3f64-4f67-998e-0ab46d399c5f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:20.879607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-36db35f2-3f64-4f67-998e-0ab46d399c5f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:20.898967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36db35f2-3f64-4f67-998e-0ab46d399c5f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:20.899357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36db35f2-3f64-4f67-998e-0ab46d399c5f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:20.900172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36db35f2-3f64-4f67-998e-0ab46d399c5f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:20.900641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36db35f2-3f64-4f67-998e-0ab46d399c5f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:21.032720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bf1bf2d9-307b-470d-afae-170ac135311f tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:21.034355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bf1bf2d9-307b-470d-afae-170ac135311f tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:21.049582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf1bf2d9-307b-470d-afae-170ac135311f tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:21.051184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf1bf2d9-307b-470d-afae-170ac135311f tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:21.052779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf1bf2d9-307b-470d-afae-170ac135311f tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:21.053439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf1bf2d9-307b-470d-afae-170ac135311f tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:21.332131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-36db35f2-3f64-4f67-998e-0ab46d399c5f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:21.347042 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36db35f2-3f64-4f67-998e-0ab46d399c5f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.474585 Feb 19 21:02:21.364437 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1489/2897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:20 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:21.380688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b27f7c9a-4996-42f9-ad68-2fde2f4e4e05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:21.381755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b27f7c9a-4996-42f9-ad68-2fde2f4e4e05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:21.393546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bf1bf2d9-307b-470d-afae-170ac135311f tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:21.397895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b27f7c9a-4996-42f9-ad68-2fde2f4e4e05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:21.400610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b27f7c9a-4996-42f9-ad68-2fde2f4e4e05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:21.400610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b27f7c9a-4996-42f9-ad68-2fde2f4e4e05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:21.400610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b27f7c9a-4996-42f9-ad68-2fde2f4e4e05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:21.404376 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bf1bf2d9-307b-470d-afae-170ac135311f tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1313 microversion: 2.1 time: 0.375165 Feb 19 21:02:21.415349 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1409/2898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:21 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:21.419675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a3def2b-f7a1-45d0-9302-c262adbbe6c2 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6479261280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:21.477661 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a3def2b-f7a1-45d0-9302-c262adbbe6c2 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1429 microversion: 2.1 time: 0.061961 Feb 19 21:02:21.478555 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1410/2899] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:21 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1429 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:21.796778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b27f7c9a-4996-42f9-ad68-2fde2f4e4e05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:21.813270 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b27f7c9a-4996-42f9-ad68-2fde2f4e4e05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.446936 Feb 19 21:02:21.829598 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1490/2900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:21 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:21.831649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae81854d-d7f2-4c0a-9523-42bf351c61f8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:21.832274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae81854d-d7f2-4c0a-9523-42bf351c61f8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:21.857479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae81854d-d7f2-4c0a-9523-42bf351c61f8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:21.858197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae81854d-d7f2-4c0a-9523-42bf351c61f8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:21.864145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae81854d-d7f2-4c0a-9523-42bf351c61f8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:21.875384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae81854d-d7f2-4c0a-9523-42bf351c61f8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:22.373298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-11b1d92e-f76b-44b9-8b81-cc8cae87dc4c tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:22.374148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-11b1d92e-f76b-44b9-8b81-cc8cae87dc4c tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:22.382117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11b1d92e-f76b-44b9-8b81-cc8cae87dc4c tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:22.383178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11b1d92e-f76b-44b9-8b81-cc8cae87dc4c tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:22.385538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11b1d92e-f76b-44b9-8b81-cc8cae87dc4c tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:22.386757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11b1d92e-f76b-44b9-8b81-cc8cae87dc4c tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:22.535249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae81854d-d7f2-4c0a-9523-42bf351c61f8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:22.551378 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae81854d-d7f2-4c0a-9523-42bf351c61f8 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1555 microversion: 2.1 time: 0.721479 Feb 19 21:02:22.553104 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1411/2901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:21 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1555 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:22.570849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5e188f95-66f7-4194-a891-1779096d86ab tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:22.571731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5e188f95-66f7-4194-a891-1779096d86ab tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:22.587212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e188f95-66f7-4194-a891-1779096d86ab tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:22.587676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e188f95-66f7-4194-a891-1779096d86ab tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:22.588510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e188f95-66f7-4194-a891-1779096d86ab tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:22.592991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e188f95-66f7-4194-a891-1779096d86ab tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:22.917211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11b1d92e-f76b-44b9-8b81-cc8cae87dc4c tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:22.934319 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-11b1d92e-f76b-44b9-8b81-cc8cae87dc4c tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.566108 Feb 19 21:02:22.948846 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1491/2902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:22 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:22.948846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-948d40e9-c04e-4df6-a7d9-4f826f4ca466 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467dd10d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:23.051621 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-948d40e9-c04e-4df6-a7d9-4f826f4ca466 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1438 microversion: 2.1 time: 0.112932 Feb 19 21:02:23.052659 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1492/2903] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:22 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:23.075253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d8b491e7-5226-476a-891f-d0d3303c892e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:23.076785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8b491e7-5226-476a-891f-d0d3303c892e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:23.094060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8b491e7-5226-476a-891f-d0d3303c892e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:23.094797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8b491e7-5226-476a-891f-d0d3303c892e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:23.096392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8b491e7-5226-476a-891f-d0d3303c892e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:23.101267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8b491e7-5226-476a-891f-d0d3303c892e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:23.544303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5e188f95-66f7-4194-a891-1779096d86ab tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:23.573591 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5e188f95-66f7-4194-a891-1779096d86ab tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1498 microversion: 2.1 time: 1.017175 Feb 19 21:02:23.588465 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1412/2904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:22 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1498 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:23.602645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e6d0c84a-0397-498c-af9a-79b360eda4b4 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467a89b80>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:23.748120 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e6d0c84a-0397-498c-af9a-79b360eda4b4 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 200 len: 1438 microversion: 2.1 time: 0.158581 Feb 19 21:02:23.761092 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1413/2905] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:02:23 2022] GET /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 1438 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:23.765720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae60a123-cad4-460f-ba32-722b9e2ce133 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:23.766559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae60a123-cad4-460f-ba32-722b9e2ce133 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:23.790411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae60a123-cad4-460f-ba32-722b9e2ce133 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:23.791130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae60a123-cad4-460f-ba32-722b9e2ce133 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:23.792101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae60a123-cad4-460f-ba32-722b9e2ce133 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:23.792760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae60a123-cad4-460f-ba32-722b9e2ce133 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:23.808104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8b491e7-5226-476a-891f-d0d3303c892e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:23.846041 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d8b491e7-5226-476a-891f-d0d3303c892e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1687 microversion: 2.1 time: 0.791146 Feb 19 21:02:23.857781 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1493/2906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:23 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1687 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:23.860785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f7a9020-1816-4b27-b676-b084f1edbf9c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:23.866061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2f7a9020-1816-4b27-b676-b084f1edbf9c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:23.882924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f7a9020-1816-4b27-b676-b084f1edbf9c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:23.886059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f7a9020-1816-4b27-b676-b084f1edbf9c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:23.890439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f7a9020-1816-4b27-b676-b084f1edbf9c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:23.890904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f7a9020-1816-4b27-b676-b084f1edbf9c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:24.710066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae60a123-cad4-460f-ba32-722b9e2ce133 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:24.721321 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae60a123-cad4-460f-ba32-722b9e2ce133 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1561 microversion: 2.1 time: 0.959427 Feb 19 21:02:24.722402 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1414/2907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:23 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1561 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:24.728168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7148bb36-fc00-49de-9969-7ba7533a60f6 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:24.729253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7148bb36-fc00-49de-9969-7ba7533a60f6 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:24.739177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f7a9020-1816-4b27-b676-b084f1edbf9c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:24.755028 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f7a9020-1816-4b27-b676-b084f1edbf9c tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1466 microversion: 2.1 time: 0.905658 Feb 19 21:02:24.757835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7148bb36-fc00-49de-9969-7ba7533a60f6 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:24.758600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7148bb36-fc00-49de-9969-7ba7533a60f6 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:24.759698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7148bb36-fc00-49de-9969-7ba7533a60f6 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:24.760205 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1494/2908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:23 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1466 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:24.765024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4562168d-a10a-434b-a043-6d8cff9ead73 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:24.765531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4562168d-a10a-434b-a043-6d8cff9ead73 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:24.767745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7148bb36-fc00-49de-9969-7ba7533a60f6 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:24.776755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4562168d-a10a-434b-a043-6d8cff9ead73 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:24.777540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4562168d-a10a-434b-a043-6d8cff9ead73 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:24.778556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4562168d-a10a-434b-a043-6d8cff9ead73 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:24.779159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4562168d-a10a-434b-a043-6d8cff9ead73 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:24.838751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4562168d-a10a-434b-a043-6d8cff9ead73 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:02:24.957763 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4562168d-a10a-434b-a043-6d8cff9ead73 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 204 len: 0 microversion: 2.1 time: 0.195950 Feb 19 21:02:24.958281 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1495/2909] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:02:24 2022] DELETE /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:02:24.963694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4719956c-f499-488d-b36c-4503cccedca9 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467776f70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:25.111657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7148bb36-fc00-49de-9969-7ba7533a60f6 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:25.125513 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7148bb36-fc00-49de-9969-7ba7533a60f6 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.401137 Feb 19 21:02:25.142339 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1415/2910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:24 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:25.149538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-558c6521-9598-4c66-92f5-0e1ac3d8dac3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:25.150164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-558c6521-9598-4c66-92f5-0e1ac3d8dac3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:25.157872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-558c6521-9598-4c66-92f5-0e1ac3d8dac3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.158422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-558c6521-9598-4c66-92f5-0e1ac3d8dac3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.159276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-558c6521-9598-4c66-92f5-0e1ac3d8dac3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.159805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-558c6521-9598-4c66-92f5-0e1ac3d8dac3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.486407 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4719956c-f499-488d-b36c-4503cccedca9 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "DELETE /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698" status: 204 len: 0 microversion: 2.1 time: 0.526550 Feb 19 21:02:25.487199 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1496/2911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:24 2022] DELETE /compute/v2.1/images/d83a1385-0713-430f-a42a-5de56914b698 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:02:25.493711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:25.494426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:25.502907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.503401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.504430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.504891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.581133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-558c6521-9598-4c66-92f5-0e1ac3d8dac3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:25.591849 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-558c6521-9598-4c66-92f5-0e1ac3d8dac3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1687 microversion: 2.1 time: 0.447302 Feb 19 21:02:25.592821 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1416/2912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:25 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1687 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:25.598144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a6f1080b-5b33-4744-82cb-00916e8c78c2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:25.598759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a6f1080b-5b33-4744-82cb-00916e8c78c2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:25.605143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6f1080b-5b33-4744-82cb-00916e8c78c2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.606475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6f1080b-5b33-4744-82cb-00916e8c78c2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.608686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6f1080b-5b33-4744-82cb-00916e8c78c2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.609279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6f1080b-5b33-4744-82cb-00916e8c78c2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.609927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lazy-loading 'services' on Instance uuid 2df03445-3277-48bd-be5b-c8503c33714d {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:02:25.767161 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ee04e3d1-5592-4411-80e9-dd8bdd40e36b tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments/aed146c7-103d-4b73-ba02-11fcb7868c65" status: 202 len: 0 microversion: 2.1 time: 0.278344 Feb 19 21:02:25.768581 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1497/2913] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:02:25 2022] DELETE /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments/aed146c7-103d-4b73-ba02-11fcb7868c65 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:02:25.775552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f37659a7-bcca-4eaa-b321-5a6b054d1a10 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '.version_select at 0x7f6467d2d280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:25.807254 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-f37659a7-bcca-4eaa-b321-5a6b054d1a10 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] HTTP exception thrown: Image not found. Feb 19 21:02:25.808077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f37659a7-bcca-4eaa-b321-5a6b054d1a10 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:25.820105 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f37659a7-bcca-4eaa-b321-5a6b054d1a10 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "DELETE /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3" status: 404 len: 62 microversion: 2.1 time: 0.038922 Feb 19 21:02:25.821324 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1498/2914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:25 2022] DELETE /compute/v2.1/images/87a047c3-1870-47e8-80f9-839daabb83d3 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:02:25.830326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9ea12413-9db2-4460-b3aa-7803fe1caaac tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:25.831694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9ea12413-9db2-4460-b3aa-7803fe1caaac tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:25.846990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ea12413-9db2-4460-b3aa-7803fe1caaac tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.848551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ea12413-9db2-4460-b3aa-7803fe1caaac tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.851223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ea12413-9db2-4460-b3aa-7803fe1caaac tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.852283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ea12413-9db2-4460-b3aa-7803fe1caaac tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.891112 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9ea12413-9db2-4460-b3aa-7803fe1caaac tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068047 Feb 19 21:02:25.896385 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1499/2915] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:02:25 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:25.911190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6151f42d-da0c-495c-b25f-dc57af155d03 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:25.912239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6151f42d-da0c-495c-b25f-dc57af155d03 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:25.924523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6151f42d-da0c-495c-b25f-dc57af155d03 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.924979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6151f42d-da0c-495c-b25f-dc57af155d03 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.925805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6151f42d-da0c-495c-b25f-dc57af155d03 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:25.926521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6151f42d-da0c-495c-b25f-dc57af155d03 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:25.978189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6151f42d-da0c-495c-b25f-dc57af155d03 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:02:26.141077 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6151f42d-da0c-495c-b25f-dc57af155d03 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 204 len: 0 microversion: 2.1 time: 0.235136 Feb 19 21:02:26.145398 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1500/2916] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:02:25 2022] DELETE /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:02:26.154406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c5867a54-0354-472f-be80-f0396aa0477b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:26.156910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c5867a54-0354-472f-be80-f0396aa0477b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:26.172157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c5867a54-0354-472f-be80-f0396aa0477b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:26.172888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c5867a54-0354-472f-be80-f0396aa0477b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:26.173994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c5867a54-0354-472f-be80-f0396aa0477b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:26.175094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c5867a54-0354-472f-be80-f0396aa0477b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:26.344592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a6f1080b-5b33-4744-82cb-00916e8c78c2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:26.359678 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a6f1080b-5b33-4744-82cb-00916e8c78c2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1504 microversion: 2.1 time: 0.765782 Feb 19 21:02:26.362372 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1417/2917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:25 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1504 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:26.370742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2ab38f46-6c93-411a-b44e-6de017e7bf44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:26.372825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2ab38f46-6c93-411a-b44e-6de017e7bf44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:26.393367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ab38f46-6c93-411a-b44e-6de017e7bf44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:26.393989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ab38f46-6c93-411a-b44e-6de017e7bf44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:26.396976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ab38f46-6c93-411a-b44e-6de017e7bf44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:26.398165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ab38f46-6c93-411a-b44e-6de017e7bf44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:26.624996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c5867a54-0354-472f-be80-f0396aa0477b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:26.632644 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c5867a54-0354-472f-be80-f0396aa0477b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.485497 Feb 19 21:02:26.633238 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1501/2918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:26 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:26.646955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0e459aa6-a406-4b31-b32d-b8e51801d82f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:26.647530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0e459aa6-a406-4b31-b32d-b8e51801d82f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:26.659087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0e459aa6-a406-4b31-b32d-b8e51801d82f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:26.659541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0e459aa6-a406-4b31-b32d-b8e51801d82f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:26.660389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0e459aa6-a406-4b31-b32d-b8e51801d82f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:26.660901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0e459aa6-a406-4b31-b32d-b8e51801d82f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.012029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2ab38f46-6c93-411a-b44e-6de017e7bf44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:27.025124 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2ab38f46-6c93-411a-b44e-6de017e7bf44 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1472 microversion: 2.1 time: 0.661361 Feb 19 21:02:27.025737 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1418/2919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:26 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1472 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:27.041254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58daee78-2e9c-406e-9512-89df343fd211 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:27.046447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-58daee78-2e9c-406e-9512-89df343fd211 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:27.063366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58daee78-2e9c-406e-9512-89df343fd211 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.063830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58daee78-2e9c-406e-9512-89df343fd211 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.064696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58daee78-2e9c-406e-9512-89df343fd211 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.065148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58daee78-2e9c-406e-9512-89df343fd211 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.157670 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-58daee78-2e9c-406e-9512-89df343fd211 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130813 Feb 19 21:02:27.158381 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1419/2920] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:02:27 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:02:27.169392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1892140972", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "f41c994e-c961-4e3f-bdb7-f2f814e202f3"}, {"uuid": "792a9f6e-77ad-42ce-a625-d55aabe06157"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:27.221942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0e459aa6-a406-4b31-b32d-b8e51801d82f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:27.237646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] validate_networks() for [('f41c994e-c961-4e3f-bdb7-f2f814e202f3', None, None, None, None, None), ('792a9f6e-77ad-42ce-a625-d55aabe06157', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:02:27.242543 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0e459aa6-a406-4b31-b32d-b8e51801d82f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1687 microversion: 2.1 time: 0.607479 Feb 19 21:02:27.250986 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1502/2921] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:26 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1687 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:27.276165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-272a86bf-0c4a-4f9c-82cb-0ccfb632bca7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:27.280807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-272a86bf-0c4a-4f9c-82cb-0ccfb632bca7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:27.288278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-272a86bf-0c4a-4f9c-82cb-0ccfb632bca7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.289057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-272a86bf-0c4a-4f9c-82cb-0ccfb632bca7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.291098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-272a86bf-0c4a-4f9c-82cb-0ccfb632bca7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.292069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-272a86bf-0c4a-4f9c-82cb-0ccfb632bca7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.323840 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-272a86bf-0c4a-4f9c-82cb-0ccfb632bca7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] HTTP exception thrown: Cannot 'reboot' instance 95227559-6479-49fb-8e4b-4b3d7cf582c9 while it is in vm_state rescued Feb 19 21:02:27.324841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-272a86bf-0c4a-4f9c-82cb-0ccfb632bca7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Returning 409 to user: Cannot 'reboot' instance 95227559-6479-49fb-8e4b-4b3d7cf582c9 while it is in vm_state rescued {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:27.326206 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-272a86bf-0c4a-4f9c-82cb-0ccfb632bca7 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9/action" status: 409 len: 145 microversion: 2.1 time: 0.058064 Feb 19 21:02:27.331625 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1503/2922] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:02:27 2022] POST /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9/action => generated 145 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 19 21:02:27.337939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a191ba8e-ee9e-449d-b6c2-46efade49190 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f75529b9-2911-475e-b974-4af06053c17c"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:27.340209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a191ba8e-ee9e-449d-b6c2-46efade49190 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:27.348549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a191ba8e-ee9e-449d-b6c2-46efade49190 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.349380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a191ba8e-ee9e-449d-b6c2-46efade49190 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.350424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a191ba8e-ee9e-449d-b6c2-46efade49190 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.351043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a191ba8e-ee9e-449d-b6c2-46efade49190 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.397607 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a191ba8e-ee9e-449d-b6c2-46efade49190 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] HTTP exception thrown: Cannot 'rebuild' instance 95227559-6479-49fb-8e4b-4b3d7cf582c9 while it is in vm_state rescued Feb 19 21:02:27.398728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a191ba8e-ee9e-449d-b6c2-46efade49190 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Returning 409 to user: Cannot 'rebuild' instance 95227559-6479-49fb-8e4b-4b3d7cf582c9 while it is in vm_state rescued {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:27.399984 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a191ba8e-ee9e-449d-b6c2-46efade49190 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "POST /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9/action" status: 409 len: 146 microversion: 2.1 time: 0.066936 Feb 19 21:02:27.400822 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1504/2923] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:02:27 2022] POST /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9/action => generated 146 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:02:27.414707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f47f9b93-5a04-4418-9e9c-0bb90db8c024 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:27.415444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f47f9b93-5a04-4418-9e9c-0bb90db8c024 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:27.424150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f47f9b93-5a04-4418-9e9c-0bb90db8c024 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.424711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f47f9b93-5a04-4418-9e9c-0bb90db8c024 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.427070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f47f9b93-5a04-4418-9e9c-0bb90db8c024 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.427978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f47f9b93-5a04-4418-9e9c-0bb90db8c024 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.597307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f47f9b93-5a04-4418-9e9c-0bb90db8c024 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:27.623878 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f47f9b93-5a04-4418-9e9c-0bb90db8c024 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 200 len: 1462 microversion: 2.1 time: 0.213053 Feb 19 21:02:27.626282 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1505/2924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:27 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 1462 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:27.640414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-fb517846-df2e-4fe2-a911-22296c35413d req-df81f415-27d6-47c2-b80b-c155d97088d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9768e057-90fb-4013-8fe7-fb1a08cb3838", "name": "network-vif-deleted", "tag": "87bdd6b6-d465-456b-9e9c-92f5a5657f7e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:27.645183 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:27.645183 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:27.665544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fb517846-df2e-4fe2-a911-22296c35413d req-df81f415-27d6-47c2-b80b-c155d97088d7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.666125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fb517846-df2e-4fe2-a911-22296c35413d req-df81f415-27d6-47c2-b80b-c155d97088d7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.683427 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-fb517846-df2e-4fe2-a911-22296c35413d req-df81f415-27d6-47c2-b80b-c155d97088d7 service nova] Creating event network-vif-deleted:87bdd6b6-d465-456b-9e9c-92f5a5657f7e for instance 9768e057-90fb-4013-8fe7-fb1a08cb3838 on nch1-master-1 Feb 19 21:02:27.690940 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-fb517846-df2e-4fe2-a911-22296c35413d req-df81f415-27d6-47c2-b80b-c155d97088d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062899 Feb 19 21:02:27.692133 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1506/2925] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:27.709536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2e20cb8e-1227-4845-b772-eace4a988399 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:27.710599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2e20cb8e-1227-4845-b772-eace4a988399 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:27.724636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e20cb8e-1227-4845-b772-eace4a988399 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.738375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e20cb8e-1227-4845-b772-eace4a988399 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:27.742180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e20cb8e-1227-4845-b772-eace4a988399 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:27.742997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e20cb8e-1227-4845-b772-eace4a988399 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:28.577523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2e20cb8e-1227-4845-b772-eace4a988399 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:28.592179 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2e20cb8e-1227-4845-b772-eace4a988399 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.897575 Feb 19 21:02:28.598204 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1507/2926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:27 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:28.610499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-130f18e1-e082-4541-94d7-37805a138d42 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:28.611470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-130f18e1-e082-4541-94d7-37805a138d42 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:28.623471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-130f18e1-e082-4541-94d7-37805a138d42 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:28.624607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-130f18e1-e082-4541-94d7-37805a138d42 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:28.625757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-130f18e1-e082-4541-94d7-37805a138d42 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:28.626919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-130f18e1-e082-4541-94d7-37805a138d42 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:28.910513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:02:28.911107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:02:28.911598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:02:28.912095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:02:28.912783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:02:28.938147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:28.944525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:28.944525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:28.944525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:28.971827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-130f18e1-e082-4541-94d7-37805a138d42 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:28.983254 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-130f18e1-e082-4541-94d7-37805a138d42 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1472 microversion: 2.1 time: 0.382258 Feb 19 21:02:28.983943 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1508/2927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:28 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1472 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:28.990125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2c8aa394-c820-4c66-bf82-698ce71bf1e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:28.991155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2c8aa394-c820-4c66-bf82-698ce71bf1e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:29.001410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c8aa394-c820-4c66-bf82-698ce71bf1e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:29.002501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c8aa394-c820-4c66-bf82-698ce71bf1e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:29.003780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c8aa394-c820-4c66-bf82-698ce71bf1e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:29.004383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c8aa394-c820-4c66-bf82-698ce71bf1e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:29.010090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Getting quotas for project 0a67095fabac457da3239e727c92e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:02:29.037098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Getting quotas for user 71f534f513ef45d29629b913de461f23 and project 0a67095fabac457da3239e727c92e4ab. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:02:29.077734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:02:29.084686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:02:29.253191 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3a48b34f-0f90-4b08-a961-5cb3806f128f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.093199 Feb 19 21:02:29.254793 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1420/2928] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:02:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:02:29.264486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ba9bfe20-22ea-41e3-a2d8-397f8920c776 req-617202c6-959b-4feb-b3d1-6729c95debf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8ab6fb-0631-4ea1-b58f-e22572722a52", "name": "network-vif-unplugged", "status": "completed", "tag": "57f2a797-1cfe-462b-a115-d8f0563b8044"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:29.267472 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:29.267472 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:29.285410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ba9bfe20-22ea-41e3-a2d8-397f8920c776 req-617202c6-959b-4feb-b3d1-6729c95debf0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:29.286658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ba9bfe20-22ea-41e3-a2d8-397f8920c776 req-617202c6-959b-4feb-b3d1-6729c95debf0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:29.310655 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ba9bfe20-22ea-41e3-a2d8-397f8920c776 req-617202c6-959b-4feb-b3d1-6729c95debf0 service nova] Creating event network-vif-unplugged:57f2a797-1cfe-462b-a115-d8f0563b8044 for instance bd8ab6fb-0631-4ea1-b58f-e22572722a52 on nch2-master-1 Feb 19 21:02:29.317346 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ba9bfe20-22ea-41e3-a2d8-397f8920c776 req-617202c6-959b-4feb-b3d1-6729c95debf0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060396 Feb 19 21:02:29.318622 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1421/2929] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:29.325554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f6849078-7ffc-4347-8f0e-5145525ae0fb tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:29.326307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f6849078-7ffc-4347-8f0e-5145525ae0fb tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: 9768e057-90fb-4013-8fe7-fb1a08cb3838] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:29.333759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6849078-7ffc-4347-8f0e-5145525ae0fb tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:29.334221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6849078-7ffc-4347-8f0e-5145525ae0fb tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:29.335054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6849078-7ffc-4347-8f0e-5145525ae0fb tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:29.336095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6849078-7ffc-4347-8f0e-5145525ae0fb tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:29.354943 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f6849078-7ffc-4347-8f0e-5145525ae0fb tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] HTTP exception thrown: Instance 9768e057-90fb-4013-8fe7-fb1a08cb3838 could not be found. Feb 19 21:02:29.356136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f6849078-7ffc-4347-8f0e-5145525ae0fb tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Returning 404 to user: Instance 9768e057-90fb-4013-8fe7-fb1a08cb3838 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:29.361737 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f6849078-7ffc-4347-8f0e-5145525ae0fb tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838" status: 404 len: 111 microversion: 2.1 time: 0.037143 Feb 19 21:02:29.361737 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1422/2930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:29 2022] GET /compute/v2.1/servers/9768e057-90fb-4013-8fe7-fb1a08cb3838 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:02:29.375593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-22ce7679-935a-42e6-811c-5ccfb57d77a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:29.376782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-22ce7679-935a-42e6-811c-5ccfb57d77a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:29.415339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2c8aa394-c820-4c66-bf82-698ce71bf1e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:29.430363 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2c8aa394-c820-4c66-bf82-698ce71bf1e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1687 microversion: 2.1 time: 0.444260 Feb 19 21:02:29.431778 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1509/2931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:28 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1687 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:29.452113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1164953804", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "b2b08d58-ef61-4880-94a7-4dce88778bec"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:29.535825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] validate_networks() for [('b2b08d58-ef61-4880-94a7-4dce88778bec', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:02:29.550577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-22ce7679-935a-42e6-811c-5ccfb57d77a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:29.561261 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-22ce7679-935a-42e6-811c-5ccfb57d77a0 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1213 microversion: 2.1 time: 0.200963 Feb 19 21:02:29.573318 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1423/2932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:29 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1213 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:29.613824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d494a722-ba59-4bf0-ab99-aff0f47bfc7a tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:29.614530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d494a722-ba59-4bf0-ab99-aff0f47bfc7a tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:29.631460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d494a722-ba59-4bf0-ab99-aff0f47bfc7a tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:29.631918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d494a722-ba59-4bf0-ab99-aff0f47bfc7a tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:29.632822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d494a722-ba59-4bf0-ab99-aff0f47bfc7a tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:29.633342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d494a722-ba59-4bf0-ab99-aff0f47bfc7a tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:30.347812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d494a722-ba59-4bf0-ab99-aff0f47bfc7a tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:30.361103 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d494a722-ba59-4bf0-ab99-aff0f47bfc7a tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.752720 Feb 19 21:02:30.365479 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1424/2933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:29 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:30.374563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b98db118-1168-440d-b083-007c4504be7f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:30.382281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b98db118-1168-440d-b083-007c4504be7f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:30.406332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b98db118-1168-440d-b083-007c4504be7f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:30.406745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b98db118-1168-440d-b083-007c4504be7f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:30.407755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b98db118-1168-440d-b083-007c4504be7f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:30.408403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b98db118-1168-440d-b083-007c4504be7f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:30.478038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:02:30.479249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:02:30.479907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:02:30.481156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:02:30.481736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:02:30.508251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:30.509007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:30.510841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:30.513955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:30.570520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Getting quotas for project c3e2bd0a55e44ee2802a7b95678c9d60. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:02:30.592057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Getting quotas for user bb812b1b093045b1aaa3ce9e3334ff4d and project c3e2bd0a55e44ee2802a7b95678c9d60. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:02:30.625582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:02:30.628549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:02:30.740545 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a4f045b-da4f-4608-ae87-e2f0f4166f95 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294400 Feb 19 21:02:30.740991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b98db118-1168-440d-b083-007c4504be7f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:30.747129 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1510/2934] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:02:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:02:30.753247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-720cd3e1-b9c9-495f-8b4f-aeac142de1c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:30.753973 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b98db118-1168-440d-b083-007c4504be7f tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1472 microversion: 2.1 time: 0.387238 Feb 19 21:02:30.754359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-720cd3e1-b9c9-495f-8b4f-aeac142de1c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:30.758974 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1425/2935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:30 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:30.764463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca6ec516-6718-45b4-8c8a-ef9383a9e713 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:30.770815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720cd3e1-b9c9-495f-8b4f-aeac142de1c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:30.771555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720cd3e1-b9c9-495f-8b4f-aeac142de1c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:30.772608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720cd3e1-b9c9-495f-8b4f-aeac142de1c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:30.773289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-720cd3e1-b9c9-495f-8b4f-aeac142de1c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:30.778209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ca6ec516-6718-45b4-8c8a-ef9383a9e713 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:30.787893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca6ec516-6718-45b4-8c8a-ef9383a9e713 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:30.788417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca6ec516-6718-45b4-8c8a-ef9383a9e713 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:30.789197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca6ec516-6718-45b4-8c8a-ef9383a9e713 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:30.789641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca6ec516-6718-45b4-8c8a-ef9383a9e713 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:30.987413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca6ec516-6718-45b4-8c8a-ef9383a9e713 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:31.001656 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ca6ec516-6718-45b4-8c8a-ef9383a9e713 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1265 microversion: 2.1 time: 0.236289 Feb 19 21:02:31.025509 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1426/2936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:30 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:31.037940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d4ed7093-d2b3-414d-a850-936aef201efd tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:31.039279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d4ed7093-d2b3-414d-a850-936aef201efd tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:31.178446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d4ed7093-d2b3-414d-a850-936aef201efd tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:31.187885 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d4ed7093-d2b3-414d-a850-936aef201efd tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1214 microversion: 2.1 time: 0.160501 Feb 19 21:02:31.192948 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1427/2937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:31 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:31.322967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-720cd3e1-b9c9-495f-8b4f-aeac142de1c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:31.336769 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-720cd3e1-b9c9-495f-8b4f-aeac142de1c2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1687 microversion: 2.1 time: 0.588083 Feb 19 21:02:31.338938 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1511/2938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:30 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1687 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:31.383764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e670b7e2-1a98-48ed-9989-348f66b59da8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:31.385137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e670b7e2-1a98-48ed-9989-348f66b59da8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:31.400381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d9c5b50c-b3df-4ec5-ae6d-437f3e9e49c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:31.400902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d9c5b50c-b3df-4ec5-ae6d-437f3e9e49c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:31.420853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e670b7e2-1a98-48ed-9989-348f66b59da8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:31.424166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9c5b50c-b3df-4ec5-ae6d-437f3e9e49c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:31.425903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9c5b50c-b3df-4ec5-ae6d-437f3e9e49c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:31.426274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e670b7e2-1a98-48ed-9989-348f66b59da8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:31.430979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e670b7e2-1a98-48ed-9989-348f66b59da8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:31.431617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9c5b50c-b3df-4ec5-ae6d-437f3e9e49c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:31.432303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e670b7e2-1a98-48ed-9989-348f66b59da8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:31.432962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9c5b50c-b3df-4ec5-ae6d-437f3e9e49c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:31.509974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d9c5b50c-b3df-4ec5-ae6d-437f3e9e49c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:02:31.737613 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d9c5b50c-b3df-4ec5-ae6d-437f3e9e49c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 204 len: 0 microversion: 2.1 time: 0.341797 Feb 19 21:02:31.738906 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1512/2939] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:02:31 2022] DELETE /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:02:31.751246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b8641d86-38a5-4435-94e9-8fe69f2ed509 req-29a356b0-34e2-4634-a76a-9d267327ffe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8ab6fb-0631-4ea1-b58f-e22572722a52", "name": "network-vif-deleted", "tag": "57f2a797-1cfe-462b-a115-d8f0563b8044"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:31.753751 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:31.753751 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:31.770379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b8641d86-38a5-4435-94e9-8fe69f2ed509 req-29a356b0-34e2-4634-a76a-9d267327ffe5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:31.770838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b8641d86-38a5-4435-94e9-8fe69f2ed509 req-29a356b0-34e2-4634-a76a-9d267327ffe5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:31.794909 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b8641d86-38a5-4435-94e9-8fe69f2ed509 req-29a356b0-34e2-4634-a76a-9d267327ffe5 service nova] Creating event network-vif-deleted:57f2a797-1cfe-462b-a115-d8f0563b8044 for instance bd8ab6fb-0631-4ea1-b58f-e22572722a52 on nch2-master-1 Feb 19 21:02:31.806675 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b8641d86-38a5-4435-94e9-8fe69f2ed509 req-29a356b0-34e2-4634-a76a-9d267327ffe5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066243 Feb 19 21:02:31.820450 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1513/2940] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:31.828848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4d0fbaca-9c86-483e-9e54-34e0bb8795b2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:31.834415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4d0fbaca-9c86-483e-9e54-34e0bb8795b2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:31.854033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d0fbaca-9c86-483e-9e54-34e0bb8795b2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:31.854139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d0fbaca-9c86-483e-9e54-34e0bb8795b2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:31.854877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d0fbaca-9c86-483e-9e54-34e0bb8795b2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:31.855884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d0fbaca-9c86-483e-9e54-34e0bb8795b2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:31.867273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e670b7e2-1a98-48ed-9989-348f66b59da8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:31.878935 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e670b7e2-1a98-48ed-9989-348f66b59da8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.499964 Feb 19 21:02:31.881622 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1428/2941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:31 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:31.886396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:31.887763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:31.895329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:31.896364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:31.909867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:31.910562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.016369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.017086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.017726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lazy-loading 'fault' on Instance uuid bd8ab6fb-0631-4ea1-b58f-e22572722a52 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:02:32.130829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9596b0d7c4a1461db4bbe63e2524f0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f76e9ca2f54ad98c30b0dc6351be5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:32.138875 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c4867a3-59b8-49af-9a88-0bf96b8ff91a tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 200 len: 1307 microversion: 2.1 time: 0.256042 Feb 19 21:02:32.159606 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1429/2942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:31 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 1307 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:32.168727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ddcccc3c-0493-4bce-a4ee-d22e592cc5b3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:32.171216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ddcccc3c-0493-4bce-a4ee-d22e592cc5b3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:32.188053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddcccc3c-0493-4bce-a4ee-d22e592cc5b3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.200218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddcccc3c-0493-4bce-a4ee-d22e592cc5b3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.201315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddcccc3c-0493-4bce-a4ee-d22e592cc5b3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.201780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddcccc3c-0493-4bce-a4ee-d22e592cc5b3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.339293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ddcccc3c-0493-4bce-a4ee-d22e592cc5b3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:32.353183 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ddcccc3c-0493-4bce-a4ee-d22e592cc5b3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1271 microversion: 2.1 time: 0.192064 Feb 19 21:02:32.366821 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1430/2943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:32 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:32.373773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b09b5bbc-3fd5-416d-98a9-c99914435577 req-a11dcd14-e56c-4fae-8672-9071fdea1164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "name": "network-vif-plugged", "status": "completed", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:32.377409 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:32.377409 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:32.389594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b09b5bbc-3fd5-416d-98a9-c99914435577 req-a11dcd14-e56c-4fae-8672-9071fdea1164 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.390779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b09b5bbc-3fd5-416d-98a9-c99914435577 req-a11dcd14-e56c-4fae-8672-9071fdea1164 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.409863 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b09b5bbc-3fd5-416d-98a9-c99914435577 req-a11dcd14-e56c-4fae-8672-9071fdea1164 service nova] Creating event network-vif-plugged:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:02:32.416150 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b09b5bbc-3fd5-416d-98a9-c99914435577 req-a11dcd14-e56c-4fae-8672-9071fdea1164 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047826 Feb 19 21:02:32.417124 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1431/2944] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:32.421015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4d0fbaca-9c86-483e-9e54-34e0bb8795b2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:32.425314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cbee77a7-69a4-4083-8dd0-a6a8545a06cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:32.426210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cbee77a7-69a4-4083-8dd0-a6a8545a06cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:32.431816 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4d0fbaca-9c86-483e-9e54-34e0bb8795b2 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1508 microversion: 2.1 time: 0.609110 Feb 19 21:02:32.437473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbee77a7-69a4-4083-8dd0-a6a8545a06cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.438163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbee77a7-69a4-4083-8dd0-a6a8545a06cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.439719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbee77a7-69a4-4083-8dd0-a6a8545a06cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.440531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cbee77a7-69a4-4083-8dd0-a6a8545a06cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.446530 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1514/2945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:31 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1508 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:32.452832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-014866e7-0876-439f-8a2f-5997e6e067aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:32.453722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-014866e7-0876-439f-8a2f-5997e6e067aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:32.462328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-014866e7-0876-439f-8a2f-5997e6e067aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.463342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-014866e7-0876-439f-8a2f-5997e6e067aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.464421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-014866e7-0876-439f-8a2f-5997e6e067aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.465612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-014866e7-0876-439f-8a2f-5997e6e067aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.672406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cbee77a7-69a4-4083-8dd0-a6a8545a06cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:32.682580 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cbee77a7-69a4-4083-8dd0-a6a8545a06cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1266 microversion: 2.1 time: 0.262316 Feb 19 21:02:32.684688 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1432/2946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:32 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:32.898984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d98f3e5f-6be1-4fc9-a8b1-9975c0803376 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:32.899986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d98f3e5f-6be1-4fc9-a8b1-9975c0803376 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:32.915083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-014866e7-0876-439f-8a2f-5997e6e067aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:32.921777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d98f3e5f-6be1-4fc9-a8b1-9975c0803376 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.927294 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-014866e7-0876-439f-8a2f-5997e6e067aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.479377 Feb 19 21:02:32.938281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d98f3e5f-6be1-4fc9-a8b1-9975c0803376 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.938281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d98f3e5f-6be1-4fc9-a8b1-9975c0803376 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:32.938281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d98f3e5f-6be1-4fc9-a8b1-9975c0803376 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:32.938810 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1515/2947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:32 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:33.120147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d98f3e5f-6be1-4fc9-a8b1-9975c0803376 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:33.136169 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d98f3e5f-6be1-4fc9-a8b1-9975c0803376 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.240314 Feb 19 21:02:33.137561 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1433/2948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:32 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:33.160581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5400ce3-c9bf-41e5-80cf-88357a4b9003 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:33.161761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d5400ce3-c9bf-41e5-80cf-88357a4b9003 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] [instance: bd8ab6fb-0631-4ea1-b58f-e22572722a52] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:33.170968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5400ce3-c9bf-41e5-80cf-88357a4b9003 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:33.171952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5400ce3-c9bf-41e5-80cf-88357a4b9003 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:33.172993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5400ce3-c9bf-41e5-80cf-88357a4b9003 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:33.173908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5400ce3-c9bf-41e5-80cf-88357a4b9003 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:33.238527 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-d5400ce3-c9bf-41e5-80cf-88357a4b9003 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] HTTP exception thrown: Instance bd8ab6fb-0631-4ea1-b58f-e22572722a52 could not be found. Feb 19 21:02:33.239874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5400ce3-c9bf-41e5-80cf-88357a4b9003 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] Returning 404 to user: Instance bd8ab6fb-0631-4ea1-b58f-e22572722a52 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:33.242146 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5400ce3-c9bf-41e5-80cf-88357a4b9003 tempest-ImagesOneServerTestJSON-1282656098 tempest-ImagesOneServerTestJSON-1282656098-project] 10.222.0.30 "GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52" status: 404 len: 111 microversion: 2.1 time: 0.086519 Feb 19 21:02:33.245024 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1516/2949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:33 2022] GET /compute/v2.1/servers/bd8ab6fb-0631-4ea1-b58f-e22572722a52 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:02:33.374501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1ba62f60-d8f6-4a47-be3f-95e317101ba6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:33.375856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1ba62f60-d8f6-4a47-be3f-95e317101ba6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:33.405876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ba62f60-d8f6-4a47-be3f-95e317101ba6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:33.406519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ba62f60-d8f6-4a47-be3f-95e317101ba6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:33.407533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ba62f60-d8f6-4a47-be3f-95e317101ba6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:33.407980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ba62f60-d8f6-4a47-be3f-95e317101ba6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:33.454557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f25b5337-e3a6-490e-a25f-716e9e7a1c90 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:33.455360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f25b5337-e3a6-490e-a25f-716e9e7a1c90 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:33.470575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f25b5337-e3a6-490e-a25f-716e9e7a1c90 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:33.471139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f25b5337-e3a6-490e-a25f-716e9e7a1c90 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:33.471993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f25b5337-e3a6-490e-a25f-716e9e7a1c90 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:33.472465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f25b5337-e3a6-490e-a25f-716e9e7a1c90 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:33.595183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1ba62f60-d8f6-4a47-be3f-95e317101ba6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:33.609644 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1ba62f60-d8f6-4a47-be3f-95e317101ba6 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1271 microversion: 2.1 time: 0.242049 Feb 19 21:02:33.610672 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1434/2950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:33 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:33.707605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0ecc2af9-88e7-4c2a-9821-48114f0c0867 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:33.709486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0ecc2af9-88e7-4c2a-9821-48114f0c0867 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:33.721596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ecc2af9-88e7-4c2a-9821-48114f0c0867 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:33.724958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ecc2af9-88e7-4c2a-9821-48114f0c0867 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:33.727213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ecc2af9-88e7-4c2a-9821-48114f0c0867 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:33.742270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ecc2af9-88e7-4c2a-9821-48114f0c0867 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:33.973070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f25b5337-e3a6-490e-a25f-716e9e7a1c90 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:33.981374 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f25b5337-e3a6-490e-a25f-716e9e7a1c90 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1508 microversion: 2.1 time: 0.530655 Feb 19 21:02:33.982016 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1517/2951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:33 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:34.010031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4eeed88f-8364-4bcf-a665-018e993dca5f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:34.010643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4eeed88f-8364-4bcf-a665-018e993dca5f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:34.017891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eeed88f-8364-4bcf-a665-018e993dca5f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:34.018591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eeed88f-8364-4bcf-a665-018e993dca5f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:34.021429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eeed88f-8364-4bcf-a665-018e993dca5f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:34.022209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eeed88f-8364-4bcf-a665-018e993dca5f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:34.050647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0ecc2af9-88e7-4c2a-9821-48114f0c0867 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:34.094081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0ecc2af9-88e7-4c2a-9821-48114f0c0867 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1272 microversion: 2.1 time: 0.385296 Feb 19 21:02:34.100676 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1435/2952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:33 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1272 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:34.155090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3be0b772-e2d6-4cbb-979d-1df2a5ccaa72 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:34.156679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3be0b772-e2d6-4cbb-979d-1df2a5ccaa72 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:34.190922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3be0b772-e2d6-4cbb-979d-1df2a5ccaa72 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:34.191718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3be0b772-e2d6-4cbb-979d-1df2a5ccaa72 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:34.196367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3be0b772-e2d6-4cbb-979d-1df2a5ccaa72 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:34.197039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3be0b772-e2d6-4cbb-979d-1df2a5ccaa72 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:34.360596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4eeed88f-8364-4bcf-a665-018e993dca5f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:34.372275 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4eeed88f-8364-4bcf-a665-018e993dca5f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.377302 Feb 19 21:02:34.375051 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1518/2953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:33 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:34.630490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-99beb0b9-7d41-4759-9a5b-feed8e3513e3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:34.631127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-99beb0b9-7d41-4759-9a5b-feed8e3513e3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:34.644123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99beb0b9-7d41-4759-9a5b-feed8e3513e3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:34.644677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99beb0b9-7d41-4759-9a5b-feed8e3513e3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:34.645478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99beb0b9-7d41-4759-9a5b-feed8e3513e3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:34.657140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99beb0b9-7d41-4759-9a5b-feed8e3513e3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:34.967816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3be0b772-e2d6-4cbb-979d-1df2a5ccaa72 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:34.999812 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3be0b772-e2d6-4cbb-979d-1df2a5ccaa72 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.849556 Feb 19 21:02:35.014470 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1436/2954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:34 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:35.035648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e100556f-f16e-4bd6-98aa-b709efc22e54 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:35.036412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e100556f-f16e-4bd6-98aa-b709efc22e54 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:35.054927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e100556f-f16e-4bd6-98aa-b709efc22e54 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:35.059388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e100556f-f16e-4bd6-98aa-b709efc22e54 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:35.061886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e100556f-f16e-4bd6-98aa-b709efc22e54 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:35.063784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e100556f-f16e-4bd6-98aa-b709efc22e54 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:35.297618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-99beb0b9-7d41-4759-9a5b-feed8e3513e3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:35.307837 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-99beb0b9-7d41-4759-9a5b-feed8e3513e3 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1313 microversion: 2.1 time: 0.683315 Feb 19 21:02:35.339230 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1519/2955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:34 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:35.344898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-38a6c9b2-2a14-4c07-aefd-0e4917240f27 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:35.345523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-38a6c9b2-2a14-4c07-aefd-0e4917240f27 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:35.363909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38a6c9b2-2a14-4c07-aefd-0e4917240f27 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:35.364420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38a6c9b2-2a14-4c07-aefd-0e4917240f27 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:35.365242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38a6c9b2-2a14-4c07-aefd-0e4917240f27 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:35.365683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38a6c9b2-2a14-4c07-aefd-0e4917240f27 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:35.509497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e100556f-f16e-4bd6-98aa-b709efc22e54 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:35.522527 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e100556f-f16e-4bd6-98aa-b709efc22e54 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1508 microversion: 2.1 time: 0.502451 Feb 19 21:02:35.526591 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1437/2956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:35 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1508 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:35.540520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3334e00c-e332-4b12-bcbd-9561258317ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:35.541175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3334e00c-e332-4b12-bcbd-9561258317ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:35.557335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3334e00c-e332-4b12-bcbd-9561258317ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:35.558984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3334e00c-e332-4b12-bcbd-9561258317ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:35.561992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3334e00c-e332-4b12-bcbd-9561258317ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:35.562453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3334e00c-e332-4b12-bcbd-9561258317ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:35.585407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-38a6c9b2-2a14-4c07-aefd-0e4917240f27 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:35.599527 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-38a6c9b2-2a14-4c07-aefd-0e4917240f27 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1272 microversion: 2.1 time: 0.257677 Feb 19 21:02:35.601150 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1520/2957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:35 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:35.837245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3334e00c-e332-4b12-bcbd-9561258317ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:35.846690 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3334e00c-e332-4b12-bcbd-9561258317ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.318343 Feb 19 21:02:35.847911 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1438/2958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:35 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:36.022228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c20bd6e2-0b56-42b5-9f90-0f5e3f7f4a33 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:36.022859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c20bd6e2-0b56-42b5-9f90-0f5e3f7f4a33 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:36.033015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c20bd6e2-0b56-42b5-9f90-0f5e3f7f4a33 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:36.033466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c20bd6e2-0b56-42b5-9f90-0f5e3f7f4a33 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:36.034270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c20bd6e2-0b56-42b5-9f90-0f5e3f7f4a33 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:36.034710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c20bd6e2-0b56-42b5-9f90-0f5e3f7f4a33 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:36.333654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a31424e4-d16e-419c-96a4-53ecc976761e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:36.334251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a31424e4-d16e-419c-96a4-53ecc976761e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:36.358836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a31424e4-d16e-419c-96a4-53ecc976761e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:36.359325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a31424e4-d16e-419c-96a4-53ecc976761e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:36.360494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a31424e4-d16e-419c-96a4-53ecc976761e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:36.361141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a31424e4-d16e-419c-96a4-53ecc976761e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:36.565377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c20bd6e2-0b56-42b5-9f90-0f5e3f7f4a33 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:36.585469 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c20bd6e2-0b56-42b5-9f90-0f5e3f7f4a33 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.565251 Feb 19 21:02:36.591768 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1521/2959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:36 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:36.599745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aa12ed24-bb98-4b6a-ac98-3e1debe427d6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:36.599745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aa12ed24-bb98-4b6a-ac98-3e1debe427d6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:36.625835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa12ed24-bb98-4b6a-ac98-3e1debe427d6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:36.626286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa12ed24-bb98-4b6a-ac98-3e1debe427d6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:36.627087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa12ed24-bb98-4b6a-ac98-3e1debe427d6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:36.627554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa12ed24-bb98-4b6a-ac98-3e1debe427d6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:36.779807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a31424e4-d16e-419c-96a4-53ecc976761e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:36.790977 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a31424e4-d16e-419c-96a4-53ecc976761e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.458925 Feb 19 21:02:36.802425 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1439/2960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:36 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:36.809468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c0f712a5-97ad-4fa2-ac53-8110609daa74 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:36.809468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c0f712a5-97ad-4fa2-ac53-8110609daa74 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:36.820093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0f712a5-97ad-4fa2-ac53-8110609daa74 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:36.820898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0f712a5-97ad-4fa2-ac53-8110609daa74 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:36.821993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0f712a5-97ad-4fa2-ac53-8110609daa74 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:36.822783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0f712a5-97ad-4fa2-ac53-8110609daa74 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:37.093504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa12ed24-bb98-4b6a-ac98-3e1debe427d6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:37.110805 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aa12ed24-bb98-4b6a-ac98-3e1debe427d6 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1508 microversion: 2.1 time: 0.517825 Feb 19 21:02:37.113493 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1522/2961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:36 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1508 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:37.140172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cc5edc80-d1ab-4dd7-af12-4008fb56f599 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:37.141601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cc5edc80-d1ab-4dd7-af12-4008fb56f599 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:37.153995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc5edc80-d1ab-4dd7-af12-4008fb56f599 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:37.155784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc5edc80-d1ab-4dd7-af12-4008fb56f599 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:37.156623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc5edc80-d1ab-4dd7-af12-4008fb56f599 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:37.157287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc5edc80-d1ab-4dd7-af12-4008fb56f599 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:37.231466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c0f712a5-97ad-4fa2-ac53-8110609daa74 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:37.250910 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c0f712a5-97ad-4fa2-ac53-8110609daa74 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1314 microversion: 2.1 time: 0.447262 Feb 19 21:02:37.254661 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1440/2962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:36 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:37.453482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cc5edc80-d1ab-4dd7-af12-4008fb56f599 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:37.473949 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cc5edc80-d1ab-4dd7-af12-4008fb56f599 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.358804 Feb 19 21:02:37.477988 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1523/2963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:37 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:37.607725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1ee3c455-4900-432e-b0d1-d94b3d744c61 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:37.608602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1ee3c455-4900-432e-b0d1-d94b3d744c61 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:37.619567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4e1f42b7-7e0a-4875-ac25-c2b7b0f899db req-be87a084-753e-4b1e-aadb-dbd2336f05db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95227559-6479-49fb-8e4b-4b3d7cf582c9", "name": "network-vif-deleted", "tag": "ff12d8e1-9359-4461-ae10-7ce54f84b0e6"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:37.626873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee3c455-4900-432e-b0d1-d94b3d744c61 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:37.630126 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:37.630126 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:37.631583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee3c455-4900-432e-b0d1-d94b3d744c61 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:37.635570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee3c455-4900-432e-b0d1-d94b3d744c61 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:37.638565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1ee3c455-4900-432e-b0d1-d94b3d744c61 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:37.648425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4e1f42b7-7e0a-4875-ac25-c2b7b0f899db req-be87a084-753e-4b1e-aadb-dbd2336f05db service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:37.648899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4e1f42b7-7e0a-4875-ac25-c2b7b0f899db req-be87a084-753e-4b1e-aadb-dbd2336f05db service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:37.673903 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4e1f42b7-7e0a-4875-ac25-c2b7b0f899db req-be87a084-753e-4b1e-aadb-dbd2336f05db service nova] Creating event network-vif-deleted:ff12d8e1-9359-4461-ae10-7ce54f84b0e6 for instance 95227559-6479-49fb-8e4b-4b3d7cf582c9 on nch1-master-1 Feb 19 21:02:37.682259 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4e1f42b7-7e0a-4875-ac25-c2b7b0f899db req-be87a084-753e-4b1e-aadb-dbd2336f05db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066578 Feb 19 21:02:37.687171 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1524/2964] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:37.812531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-585d50a2-bda1-494a-9941-4ec859591400 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:37.813863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-585d50a2-bda1-494a-9941-4ec859591400 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:37.846429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-585d50a2-bda1-494a-9941-4ec859591400 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:37.847347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-585d50a2-bda1-494a-9941-4ec859591400 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:37.848892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-585d50a2-bda1-494a-9941-4ec859591400 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:37.849778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-585d50a2-bda1-494a-9941-4ec859591400 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:38.209076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1ee3c455-4900-432e-b0d1-d94b3d744c61 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:38.218063 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1ee3c455-4900-432e-b0d1-d94b3d744c61 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.614862 Feb 19 21:02:38.220817 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1441/2965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:37 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:38.234692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:38.235632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:38.242360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:38.243915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:38.245022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:38.245816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:38.277612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-585d50a2-bda1-494a-9941-4ec859591400 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:38.282959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:38.283656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:38.284320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lazy-loading 'fault' on Instance uuid 95227559-6479-49fb-8e4b-4b3d7cf582c9 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:02:38.285274 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-585d50a2-bda1-494a-9941-4ec859591400 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.479873 Feb 19 21:02:38.285861 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1525/2966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:37 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:38.305197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-94ce1e01-3f64-45e5-b6f6-63035beab8a2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:38.305817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-94ce1e01-3f64-45e5-b6f6-63035beab8a2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:38.326121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94ce1e01-3f64-45e5-b6f6-63035beab8a2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:38.326566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94ce1e01-3f64-45e5-b6f6-63035beab8a2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:38.327361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94ce1e01-3f64-45e5-b6f6-63035beab8a2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:38.327976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94ce1e01-3f64-45e5-b6f6-63035beab8a2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:38.372235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:38.413788 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8aac540a-e011-4829-884d-b88eb1ea94c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 200 len: 1312 microversion: 2.1 time: 0.186392 Feb 19 21:02:38.414498 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1442/2967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:38 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:38.504059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e6ee6e9c-1a3d-41c5-89c3-3806c25732b2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:38.506597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e6ee6e9c-1a3d-41c5-89c3-3806c25732b2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:38.515148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6ee6e9c-1a3d-41c5-89c3-3806c25732b2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:38.515999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6ee6e9c-1a3d-41c5-89c3-3806c25732b2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:38.517616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6ee6e9c-1a3d-41c5-89c3-3806c25732b2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:38.518140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6ee6e9c-1a3d-41c5-89c3-3806c25732b2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:38.805476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-94ce1e01-3f64-45e5-b6f6-63035beab8a2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:38.822352 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-94ce1e01-3f64-45e5-b6f6-63035beab8a2 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1314 microversion: 2.1 time: 0.522971 Feb 19 21:02:38.836999 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1526/2968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:38 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:39.011130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e6ee6e9c-1a3d-41c5-89c3-3806c25732b2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:39.026158 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e6ee6e9c-1a3d-41c5-89c3-3806c25732b2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.532863 Feb 19 21:02:39.027220 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1443/2969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:38 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:39.240617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5d7a9834-f3c6-472c-b9dd-b2fa904cb3b3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:39.241529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5d7a9834-f3c6-472c-b9dd-b2fa904cb3b3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:39.257024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d7a9834-f3c6-472c-b9dd-b2fa904cb3b3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:39.257858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d7a9834-f3c6-472c-b9dd-b2fa904cb3b3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:39.259013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d7a9834-f3c6-472c-b9dd-b2fa904cb3b3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:39.265562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d7a9834-f3c6-472c-b9dd-b2fa904cb3b3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:39.305477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d51cae7b-9077-415f-a161-7b0878b53a32 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:39.306332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d51cae7b-9077-415f-a161-7b0878b53a32 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:39.322569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d51cae7b-9077-415f-a161-7b0878b53a32 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:39.323535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d51cae7b-9077-415f-a161-7b0878b53a32 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:39.326857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d51cae7b-9077-415f-a161-7b0878b53a32 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:39.329043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d51cae7b-9077-415f-a161-7b0878b53a32 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:40.377174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d51cae7b-9077-415f-a161-7b0878b53a32 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:40.391526 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d51cae7b-9077-415f-a161-7b0878b53a32 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 1.093828 Feb 19 21:02:40.392158 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1444/2970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:39 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:40.393083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5d7a9834-f3c6-472c-b9dd-b2fa904cb3b3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:40.409311 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5d7a9834-f3c6-472c-b9dd-b2fa904cb3b3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 1.173721 Feb 19 21:02:40.409671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-acc6d2e8-d7bb-43c7-ae5e-b3b6eb311a43 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:40.410222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-acc6d2e8-d7bb-43c7-ae5e-b3b6eb311a43 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 95227559-6479-49fb-8e4b-4b3d7cf582c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:40.414221 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1527/2971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:39 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:40.420149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acc6d2e8-d7bb-43c7-ae5e-b3b6eb311a43 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:40.421376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acc6d2e8-d7bb-43c7-ae5e-b3b6eb311a43 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:40.422094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acc6d2e8-d7bb-43c7-ae5e-b3b6eb311a43 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:40.422751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acc6d2e8-d7bb-43c7-ae5e-b3b6eb311a43 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:40.426574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-81c5e889-7a2b-4a7d-b6be-b74647d34869 req-c7d0edc0-1d3e-498f-9455-7b41484fa277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c832d7-1492-4fe5-8f8a-411cc1c49a74", "tag": "ef05e742-e00b-4308-af0a-e4dc13084ce0"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:40.428471 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:40.428471 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:40.449300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-81c5e889-7a2b-4a7d-b6be-b74647d34869 req-c7d0edc0-1d3e-498f-9455-7b41484fa277 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:40.449792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-81c5e889-7a2b-4a7d-b6be-b74647d34869 req-c7d0edc0-1d3e-498f-9455-7b41484fa277 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:40.452472 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-acc6d2e8-d7bb-43c7-ae5e-b3b6eb311a43 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] HTTP exception thrown: Instance 95227559-6479-49fb-8e4b-4b3d7cf582c9 could not be found. Feb 19 21:02:40.453597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-acc6d2e8-d7bb-43c7-ae5e-b3b6eb311a43 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Returning 404 to user: Instance 95227559-6479-49fb-8e4b-4b3d7cf582c9 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:40.454873 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-acc6d2e8-d7bb-43c7-ae5e-b3b6eb311a43 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9" status: 404 len: 111 microversion: 2.1 time: 0.052316 Feb 19 21:02:40.455505 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1445/2972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:40 2022] GET /compute/v2.1/servers/95227559-6479-49fb-8e4b-4b3d7cf582c9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:02:40.460447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5063af5e-d05d-4f3f-a5ba-214339de8682 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:40.461302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5063af5e-d05d-4f3f-a5ba-214339de8682 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:40.469586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5063af5e-d05d-4f3f-a5ba-214339de8682 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:40.470622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5063af5e-d05d-4f3f-a5ba-214339de8682 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:40.471611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5063af5e-d05d-4f3f-a5ba-214339de8682 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:40.472454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5063af5e-d05d-4f3f-a5ba-214339de8682 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:40.477109 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-81c5e889-7a2b-4a7d-b6be-b74647d34869 req-c7d0edc0-1d3e-498f-9455-7b41484fa277 service nova] Creating event network-changed:ef05e742-e00b-4308-af0a-e4dc13084ce0 for instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 on nch2-master-1 Feb 19 21:02:40.483809 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-81c5e889-7a2b-4a7d-b6be-b74647d34869 req-c7d0edc0-1d3e-498f-9455-7b41484fa277 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067816 Feb 19 21:02:40.484517 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1528/2973] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:40.732772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1263634310", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "0ece0e80-c125-4eb8-a568-1d9e97f806cd"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:40.818416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] validate_networks() for [('0ece0e80-c125-4eb8-a568-1d9e97f806cd', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:02:41.237785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5063af5e-d05d-4f3f-a5ba-214339de8682 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:41.275455 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5063af5e-d05d-4f3f-a5ba-214339de8682 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1314 microversion: 2.1 time: 0.818822 Feb 19 21:02:41.280805 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1446/2974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:40 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:41.305077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0da2660b-1049-4b8f-8566-8a1d7738eed3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:41.306279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0da2660b-1049-4b8f-8566-8a1d7738eed3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:41.316253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0da2660b-1049-4b8f-8566-8a1d7738eed3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:41.317916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0da2660b-1049-4b8f-8566-8a1d7738eed3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:41.318959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0da2660b-1049-4b8f-8566-8a1d7738eed3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:41.319606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0da2660b-1049-4b8f-8566-8a1d7738eed3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:42.057415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0da2660b-1049-4b8f-8566-8a1d7738eed3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:42.073507 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0da2660b-1049-4b8f-8566-8a1d7738eed3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.780638 Feb 19 21:02:42.075117 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1447/2975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:41 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:42.079864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-742c3794-4238-4237-869d-0459a29d0108 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:42.080394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-742c3794-4238-4237-869d-0459a29d0108 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:42.100255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-742c3794-4238-4237-869d-0459a29d0108 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:42.100747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-742c3794-4238-4237-869d-0459a29d0108 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:42.101727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-742c3794-4238-4237-869d-0459a29d0108 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:42.102181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-742c3794-4238-4237-869d-0459a29d0108 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:42.159843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-742c3794-4238-4237-869d-0459a29d0108 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:02:42.356760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:02:42.359165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:02:42.360349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:02:42.361356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:02:42.362767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:02:42.367867 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-742c3794-4238-4237-869d-0459a29d0108 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 204 len: 0 microversion: 2.1 time: 0.291398 Feb 19 21:02:42.372953 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1448/2976] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:02:42 2022] DELETE /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:02:42.378508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:42.379366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:42.380980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:42.381651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:42.389871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4dc85d3d-9d40-4d70-acd4-c45fcb0c4f84 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:42.393661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4dc85d3d-9d40-4d70-acd4-c45fcb0c4f84 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:42.409637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4dc85d3d-9d40-4d70-acd4-c45fcb0c4f84 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:42.410096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4dc85d3d-9d40-4d70-acd4-c45fcb0c4f84 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:42.411903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for project 8d34faf6add7400690171f1d097d5f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:02:42.420743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for user 5b13848e363e44b9927525ca9ca6fe81 and project 8d34faf6add7400690171f1d097d5f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:02:42.422209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4dc85d3d-9d40-4d70-acd4-c45fcb0c4f84 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:42.422776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4dc85d3d-9d40-4d70-acd4-c45fcb0c4f84 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:42.438203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:02:42.443488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:02:42.535093 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-30b114c7-5396-4dc5-b37c-875ccd33a1b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.048285 Feb 19 21:02:42.536292 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1529/2977] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:02:42.542397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-865fe653-7916-4aeb-9827-ee78b216dad5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:42.543891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-865fe653-7916-4aeb-9827-ee78b216dad5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:42.554151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-865fe653-7916-4aeb-9827-ee78b216dad5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:42.554862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-865fe653-7916-4aeb-9827-ee78b216dad5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:42.555767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-865fe653-7916-4aeb-9827-ee78b216dad5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:42.556490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-865fe653-7916-4aeb-9827-ee78b216dad5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.046499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4dc85d3d-9d40-4d70-acd4-c45fcb0c4f84 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:43.059502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-865fe653-7916-4aeb-9827-ee78b216dad5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:43.072169 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4dc85d3d-9d40-4d70-acd4-c45fcb0c4f84 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.697616 Feb 19 21:02:43.073590 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1449/2978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:42 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:43.085509 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-865fe653-7916-4aeb-9827-ee78b216dad5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.544807 Feb 19 21:02:43.089095 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1530/2979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:42 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:43.098277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5cedf050-317c-4088-955f-02aa295fc1e7 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:43.099061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5cedf050-317c-4088-955f-02aa295fc1e7 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:43.109983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84722165-1d54-45c5-b5eb-0374cd6bb667 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:43.112694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-84722165-1d54-45c5-b5eb-0374cd6bb667 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:43.113290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cedf050-317c-4088-955f-02aa295fc1e7 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:43.115158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cedf050-317c-4088-955f-02aa295fc1e7 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.116263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cedf050-317c-4088-955f-02aa295fc1e7 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:43.118970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cedf050-317c-4088-955f-02aa295fc1e7 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.133736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84722165-1d54-45c5-b5eb-0374cd6bb667 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:43.134649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84722165-1d54-45c5-b5eb-0374cd6bb667 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.137086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84722165-1d54-45c5-b5eb-0374cd6bb667 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:43.138069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84722165-1d54-45c5-b5eb-0374cd6bb667 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.537435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84722165-1d54-45c5-b5eb-0374cd6bb667 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:43.552739 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84722165-1d54-45c5-b5eb-0374cd6bb667 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 0.454580 Feb 19 21:02:43.553561 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1531/2980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:43 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:43.559303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-36f42295-f154-4337-b02f-1bec8595ac8d req-138fca61-a7e5-4076-b254-96c8ac9ce797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61315ad-086f-4a49-b685-c13202a03d98", "tag": "e7e4d47d-1952-43ba-83d8-7a0c6b1cebb2"}, {"name": "network-changed", "server_uuid": "d9c832d7-1492-4fe5-8f8a-411cc1c49a74", "tag": "eb5ca4e0-1823-4105-bad9-89b1262047ff"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:43.561011 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:43.561011 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:43.566648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5cedf050-317c-4088-955f-02aa295fc1e7 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:43.579634 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5cedf050-317c-4088-955f-02aa295fc1e7 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1314 microversion: 2.1 time: 0.504360 Feb 19 21:02:43.580243 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1450/2981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:43 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:43.589227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-adb96e4f-66c6-44f8-9eff-4a06537a3bd2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:43.589227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-adb96e4f-66c6-44f8-9eff-4a06537a3bd2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:43.599926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-36f42295-f154-4337-b02f-1bec8595ac8d req-138fca61-a7e5-4076-b254-96c8ac9ce797 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:43.604722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-36f42295-f154-4337-b02f-1bec8595ac8d req-138fca61-a7e5-4076-b254-96c8ac9ce797 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.611162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adb96e4f-66c6-44f8-9eff-4a06537a3bd2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:43.611609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adb96e4f-66c6-44f8-9eff-4a06537a3bd2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.615658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adb96e4f-66c6-44f8-9eff-4a06537a3bd2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:43.616134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adb96e4f-66c6-44f8-9eff-4a06537a3bd2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.634667 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-36f42295-f154-4337-b02f-1bec8595ac8d req-138fca61-a7e5-4076-b254-96c8ac9ce797 service nova] Creating event network-changed:e7e4d47d-1952-43ba-83d8-7a0c6b1cebb2 for instance e61315ad-086f-4a49-b685-c13202a03d98 on nch2-master-1 Feb 19 21:02:43.642028 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-36f42295-f154-4337-b02f-1bec8595ac8d req-138fca61-a7e5-4076-b254-96c8ac9ce797 service nova] Creating event network-changed:eb5ca4e0-1823-4105-bad9-89b1262047ff for instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 on nch2-master-1 Feb 19 21:02:43.651016 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-36f42295-f154-4337-b02f-1bec8595ac8d req-138fca61-a7e5-4076-b254-96c8ac9ce797 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.094626 Feb 19 21:02:43.652940 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1532/2982] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:43.678406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4395c2df-d5aa-410e-bcaa-ccf355386e5b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:43.684673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4395c2df-d5aa-410e-bcaa-ccf355386e5b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:43.712255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-adb96e4f-66c6-44f8-9eff-4a06537a3bd2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:43.712418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4395c2df-d5aa-410e-bcaa-ccf355386e5b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:43.712418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4395c2df-d5aa-410e-bcaa-ccf355386e5b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.716694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4395c2df-d5aa-410e-bcaa-ccf355386e5b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:43.717172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4395c2df-d5aa-410e-bcaa-ccf355386e5b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:43.723713 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-adb96e4f-66c6-44f8-9eff-4a06537a3bd2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1221 microversion: 2.1 time: 0.136899 Feb 19 21:02:43.732584 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1451/2983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:43 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1221 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:44.095040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-30f4c3bf-daed-4a1c-b72e-a57a1fa00e6b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:44.097044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-30f4c3bf-daed-4a1c-b72e-a57a1fa00e6b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:44.107694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30f4c3bf-daed-4a1c-b72e-a57a1fa00e6b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:44.108456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30f4c3bf-daed-4a1c-b72e-a57a1fa00e6b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:44.115470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30f4c3bf-daed-4a1c-b72e-a57a1fa00e6b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:44.116930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30f4c3bf-daed-4a1c-b72e-a57a1fa00e6b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:44.271044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4395c2df-d5aa-410e-bcaa-ccf355386e5b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:44.290782 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4395c2df-d5aa-410e-bcaa-ccf355386e5b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.635842 Feb 19 21:02:44.291991 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1533/2984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:43 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:44.304541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1e5e2c3a-2172-4beb-be16-a4725f1799f2 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:44.305486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1e5e2c3a-2172-4beb-be16-a4725f1799f2 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:44.320920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e5e2c3a-2172-4beb-be16-a4725f1799f2 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:44.321374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e5e2c3a-2172-4beb-be16-a4725f1799f2 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:44.322183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e5e2c3a-2172-4beb-be16-a4725f1799f2 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:44.322633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e5e2c3a-2172-4beb-be16-a4725f1799f2 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:45.283336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-30f4c3bf-daed-4a1c-b72e-a57a1fa00e6b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:45.301462 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-30f4c3bf-daed-4a1c-b72e-a57a1fa00e6b tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 1.212966 Feb 19 21:02:45.303723 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1452/2985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:44 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:45.320122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9436abcc-3901-4f05-ac6a-a9dd8d7dc0ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:45.321083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9436abcc-3901-4f05-ac6a-a9dd8d7dc0ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:45.331530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9436abcc-3901-4f05-ac6a-a9dd8d7dc0ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:45.331997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9436abcc-3901-4f05-ac6a-a9dd8d7dc0ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:45.333899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9436abcc-3901-4f05-ac6a-a9dd8d7dc0ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:45.334560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9436abcc-3901-4f05-ac6a-a9dd8d7dc0ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:45.361819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1e5e2c3a-2172-4beb-be16-a4725f1799f2 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:45.373441 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1e5e2c3a-2172-4beb-be16-a4725f1799f2 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 1.080023 Feb 19 21:02:45.392166 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1534/2986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:44 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:45.397618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2aba5f01-9f1c-4110-a415-b9afa1d50e3a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:45.398678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2aba5f01-9f1c-4110-a415-b9afa1d50e3a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:45.415340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2aba5f01-9f1c-4110-a415-b9afa1d50e3a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:45.416102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2aba5f01-9f1c-4110-a415-b9afa1d50e3a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:45.417362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2aba5f01-9f1c-4110-a415-b9afa1d50e3a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:45.418810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2aba5f01-9f1c-4110-a415-b9afa1d50e3a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:46.007067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9436abcc-3901-4f05-ac6a-a9dd8d7dc0ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:46.021347 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9436abcc-3901-4f05-ac6a-a9dd8d7dc0ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 0.716129 Feb 19 21:02:46.022056 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1453/2987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:45 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:46.037502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2e54ad23-f10d-41c4-979e-808d0560ccb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:46.038284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2e54ad23-f10d-41c4-979e-808d0560ccb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:46.049450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e54ad23-f10d-41c4-979e-808d0560ccb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:46.049913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e54ad23-f10d-41c4-979e-808d0560ccb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:46.052999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e54ad23-f10d-41c4-979e-808d0560ccb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:46.053463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e54ad23-f10d-41c4-979e-808d0560ccb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:46.171869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2aba5f01-9f1c-4110-a415-b9afa1d50e3a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:46.182254 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2aba5f01-9f1c-4110-a415-b9afa1d50e3a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1314 microversion: 2.1 time: 0.788310 Feb 19 21:02:46.185847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1535/2988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:45 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:46.196820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57cd1f77-8c31-45ab-951c-2bc3400b0443 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:46.197846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-57cd1f77-8c31-45ab-951c-2bc3400b0443 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:46.212959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57cd1f77-8c31-45ab-951c-2bc3400b0443 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:46.213421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57cd1f77-8c31-45ab-951c-2bc3400b0443 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:46.215059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57cd1f77-8c31-45ab-951c-2bc3400b0443 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:46.215655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57cd1f77-8c31-45ab-951c-2bc3400b0443 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:46.590690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2e54ad23-f10d-41c4-979e-808d0560ccb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:46.603488 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2e54ad23-f10d-41c4-979e-808d0560ccb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1325 microversion: 2.1 time: 0.580165 Feb 19 21:02:46.604383 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1454/2989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:46 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:46.619057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ede3c51-1d79-4703-8ff0-ef1f83f94257 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:46.620106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ede3c51-1d79-4703-8ff0-ef1f83f94257 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:46.637204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ede3c51-1d79-4703-8ff0-ef1f83f94257 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:46.637763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ede3c51-1d79-4703-8ff0-ef1f83f94257 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:46.638589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ede3c51-1d79-4703-8ff0-ef1f83f94257 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:46.639084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ede3c51-1d79-4703-8ff0-ef1f83f94257 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:46.867136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57cd1f77-8c31-45ab-951c-2bc3400b0443 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:46.879168 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-57cd1f77-8c31-45ab-951c-2bc3400b0443 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.691439 Feb 19 21:02:46.880378 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1536/2990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:46 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:46.895814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6eb77aa7-15c8-4879-b66e-6a136442bf0f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:46.900702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6eb77aa7-15c8-4879-b66e-6a136442bf0f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:46.914899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb77aa7-15c8-4879-b66e-6a136442bf0f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:46.915903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb77aa7-15c8-4879-b66e-6a136442bf0f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:46.919739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb77aa7-15c8-4879-b66e-6a136442bf0f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:46.920833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb77aa7-15c8-4879-b66e-6a136442bf0f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:47.213501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ede3c51-1d79-4703-8ff0-ef1f83f94257 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:47.238078 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ede3c51-1d79-4703-8ff0-ef1f83f94257 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.625422 Feb 19 21:02:47.242008 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1455/2991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:46 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:47.253711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-1274ea1c-632c-49bd-a25b-71a030d9f138 req-50381982-f331-451c-9e99-08b2dd6b477d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61315ad-086f-4a49-b685-c13202a03d98", "name": "network-vif-plugged", "status": "completed", "tag": "e7e4d47d-1952-43ba-83d8-7a0c6b1cebb2"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:47.260277 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:47.260277 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:47.287263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1274ea1c-632c-49bd-a25b-71a030d9f138 req-50381982-f331-451c-9e99-08b2dd6b477d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:47.289548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1274ea1c-632c-49bd-a25b-71a030d9f138 req-50381982-f331-451c-9e99-08b2dd6b477d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:47.347587 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-1274ea1c-632c-49bd-a25b-71a030d9f138 req-50381982-f331-451c-9e99-08b2dd6b477d service nova] Creating event network-vif-plugged:e7e4d47d-1952-43ba-83d8-7a0c6b1cebb2 for instance e61315ad-086f-4a49-b685-c13202a03d98 on nch2-master-1 Feb 19 21:02:47.361707 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-1274ea1c-632c-49bd-a25b-71a030d9f138 req-50381982-f331-451c-9e99-08b2dd6b477d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115998 Feb 19 21:02:47.363457 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1456/2992] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:47.389899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3bbe621b-09cb-4ed8-b970-82efe7c3b3ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:47.392093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3bbe621b-09cb-4ed8-b970-82efe7c3b3ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:47.408813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bbe621b-09cb-4ed8-b970-82efe7c3b3ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:47.410715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bbe621b-09cb-4ed8-b970-82efe7c3b3ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:47.411825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bbe621b-09cb-4ed8-b970-82efe7c3b3ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:47.414069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bbe621b-09cb-4ed8-b970-82efe7c3b3ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:47.642185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6eb77aa7-15c8-4879-b66e-6a136442bf0f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:47.676224 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6eb77aa7-15c8-4879-b66e-6a136442bf0f tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.792495 Feb 19 21:02:47.689269 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1537/2993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:46 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:47.737736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-40e1fd50-9923-41d6-89ec-a64c866c1e53 req-31c0c676-6281-4db8-8013-b6102314c8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92321eba-8b05-4954-9660-9e95356bb6b3", "tag": "1a064e13-3fb5-4649-98d7-8b53f8bf8480"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:47.756788 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:47.756788 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:47.825093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-40e1fd50-9923-41d6-89ec-a64c866c1e53 req-31c0c676-6281-4db8-8013-b6102314c8ce service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:47.825573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-40e1fd50-9923-41d6-89ec-a64c866c1e53 req-31c0c676-6281-4db8-8013-b6102314c8ce service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:47.842935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3bbe621b-09cb-4ed8-b970-82efe7c3b3ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:47.860010 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3bbe621b-09cb-4ed8-b970-82efe7c3b3ea tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 0.490461 Feb 19 21:02:47.863481 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1457/2994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:47 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:47.883143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a61379d6-b982-4da6-a4c0-08143fc719cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:47.884182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a61379d6-b982-4da6-a4c0-08143fc719cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:47.892207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a61379d6-b982-4da6-a4c0-08143fc719cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:47.892948 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-40e1fd50-9923-41d6-89ec-a64c866c1e53 req-31c0c676-6281-4db8-8013-b6102314c8ce service nova] Creating event network-changed:1a064e13-3fb5-4649-98d7-8b53f8bf8480 for instance 92321eba-8b05-4954-9660-9e95356bb6b3 on nch1-master-1 Feb 19 21:02:47.894771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a61379d6-b982-4da6-a4c0-08143fc719cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:47.898656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a61379d6-b982-4da6-a4c0-08143fc719cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:47.899675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a61379d6-b982-4da6-a4c0-08143fc719cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:47.906938 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-40e1fd50-9923-41d6-89ec-a64c866c1e53 req-31c0c676-6281-4db8-8013-b6102314c8ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214583 Feb 19 21:02:47.907302 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1538/2995] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:47.926187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9611dcd8-7edd-4bd4-987a-3ebf44b26ebe tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:47.926923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9611dcd8-7edd-4bd4-987a-3ebf44b26ebe tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:47.955768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9611dcd8-7edd-4bd4-987a-3ebf44b26ebe tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:47.956322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9611dcd8-7edd-4bd4-987a-3ebf44b26ebe tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:47.957201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9611dcd8-7edd-4bd4-987a-3ebf44b26ebe tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:47.964008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9611dcd8-7edd-4bd4-987a-3ebf44b26ebe tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:48.225866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a61379d6-b982-4da6-a4c0-08143fc719cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:48.239312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a61379d6-b982-4da6-a4c0-08143fc719cf tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1314 microversion: 2.1 time: 0.363955 Feb 19 21:02:48.241622 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1458/2996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:47 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:48.257740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-08cdaa8d-f914-4f0c-a68d-d00b97e1a8c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:48.258796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08cdaa8d-f914-4f0c-a68d-d00b97e1a8c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:48.276545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08cdaa8d-f914-4f0c-a68d-d00b97e1a8c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:48.279301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08cdaa8d-f914-4f0c-a68d-d00b97e1a8c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:48.286043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08cdaa8d-f914-4f0c-a68d-d00b97e1a8c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:48.287752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08cdaa8d-f914-4f0c-a68d-d00b97e1a8c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:48.319117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9611dcd8-7edd-4bd4-987a-3ebf44b26ebe tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:48.335903 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9611dcd8-7edd-4bd4-987a-3ebf44b26ebe tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1325 microversion: 2.1 time: 0.424686 Feb 19 21:02:48.349635 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1539/2997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:47 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1325 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:48.356486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b4654c6-154d-404d-ad9d-b8f36b4fdedd tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:48.357460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9b4654c6-154d-404d-ad9d-b8f36b4fdedd tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:48.366405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b4654c6-154d-404d-ad9d-b8f36b4fdedd tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:48.367331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b4654c6-154d-404d-ad9d-b8f36b4fdedd tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:48.368604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b4654c6-154d-404d-ad9d-b8f36b4fdedd tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:48.369841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b4654c6-154d-404d-ad9d-b8f36b4fdedd tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:48.860744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-08cdaa8d-f914-4f0c-a68d-d00b97e1a8c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:48.868149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9b4654c6-154d-404d-ad9d-b8f36b4fdedd tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:48.873988 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-08cdaa8d-f914-4f0c-a68d-d00b97e1a8c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.627101 Feb 19 21:02:48.877376 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1459/2998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:48 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:48.882609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6fbe671f-e93d-434c-92fb-f45af85c27b5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:48.883729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6fbe671f-e93d-434c-92fb-f45af85c27b5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:48.892370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6fbe671f-e93d-434c-92fb-f45af85c27b5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:48.893114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6fbe671f-e93d-434c-92fb-f45af85c27b5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:48.894655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6fbe671f-e93d-434c-92fb-f45af85c27b5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:48.895660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6fbe671f-e93d-434c-92fb-f45af85c27b5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:48.899935 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b4654c6-154d-404d-ad9d-b8f36b4fdedd tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.528142 Feb 19 21:02:48.910177 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1540/2999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:48 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:48.918845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e880a6eb-289b-4b27-bd79-9553834e30ff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:48.919770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e880a6eb-289b-4b27-bd79-9553834e30ff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:48.937499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e880a6eb-289b-4b27-bd79-9553834e30ff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:48.938126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e880a6eb-289b-4b27-bd79-9553834e30ff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:48.938939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e880a6eb-289b-4b27-bd79-9553834e30ff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:48.939383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e880a6eb-289b-4b27-bd79-9553834e30ff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:49.431812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6fbe671f-e93d-434c-92fb-f45af85c27b5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:49.452745 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6fbe671f-e93d-434c-92fb-f45af85c27b5 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.573932 Feb 19 21:02:49.456011 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1460/3000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:48 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:49.474047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b69c27d1-acd9-49ad-ba1b-10754e4099aa tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:49.475034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b69c27d1-acd9-49ad-ba1b-10754e4099aa tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:49.493004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b69c27d1-acd9-49ad-ba1b-10754e4099aa tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:49.495024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b69c27d1-acd9-49ad-ba1b-10754e4099aa tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:49.496919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b69c27d1-acd9-49ad-ba1b-10754e4099aa tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:49.500478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b69c27d1-acd9-49ad-ba1b-10754e4099aa tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:49.520847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e880a6eb-289b-4b27-bd79-9553834e30ff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:49.592065 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e880a6eb-289b-4b27-bd79-9553834e30ff tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1521 microversion: 2.1 time: 0.688747 Feb 19 21:02:49.608929 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1541/3001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:48 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:49.608929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f93a5ac-1a50-4959-a3a1-cff91c844d75 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:49.608929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f93a5ac-1a50-4959-a3a1-cff91c844d75 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:49.621500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f93a5ac-1a50-4959-a3a1-cff91c844d75 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:49.626531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f93a5ac-1a50-4959-a3a1-cff91c844d75 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:49.627918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f93a5ac-1a50-4959-a3a1-cff91c844d75 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:49.628657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f93a5ac-1a50-4959-a3a1-cff91c844d75 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.003519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b69c27d1-acd9-49ad-ba1b-10754e4099aa tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:50.036732 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b69c27d1-acd9-49ad-ba1b-10754e4099aa tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1499 microversion: 2.1 time: 0.572956 Feb 19 21:02:50.037465 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1461/3002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:49 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1499 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:50.061798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f93a5ac-1a50-4959-a3a1-cff91c844d75 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:50.070951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ba9d0f21-e415-4140-a799-d6e00e9194b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:50.075110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ba9d0f21-e415-4140-a799-d6e00e9194b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:50.081275 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f93a5ac-1a50-4959-a3a1-cff91c844d75 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1325 microversion: 2.1 time: 0.487470 Feb 19 21:02:50.094933 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1542/3003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:49 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1325 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:50.101721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba9d0f21-e415-4140-a799-d6e00e9194b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.103583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba9d0f21-e415-4140-a799-d6e00e9194b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.106424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba9d0f21-e415-4140-a799-d6e00e9194b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.107082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba9d0f21-e415-4140-a799-d6e00e9194b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.107486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0634e081-f468-4ee5-a077-dde9024a6962 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:50.108982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0634e081-f468-4ee5-a077-dde9024a6962 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:50.140982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0634e081-f468-4ee5-a077-dde9024a6962 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.147438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0634e081-f468-4ee5-a077-dde9024a6962 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.148452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0634e081-f468-4ee5-a077-dde9024a6962 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.148923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0634e081-f468-4ee5-a077-dde9024a6962 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.555802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0634e081-f468-4ee5-a077-dde9024a6962 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:50.570373 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0634e081-f468-4ee5-a077-dde9024a6962 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.472573 Feb 19 21:02:50.593405 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1543/3004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:50 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:50.649326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-cf5fe55a-ae71-49ed-97fc-5c7ae466eda7 req-92aee1da-f3c5-4867-a407-b9513825ab78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df03445-3277-48bd-be5b-c8503c33714d", "name": "network-vif-deleted", "tag": "7c930953-29d6-4047-8f78-0d1f65f29d0b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:50.686243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ba9d0f21-e415-4140-a799-d6e00e9194b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:50.701194 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ba9d0f21-e415-4140-a799-d6e00e9194b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.649116 Feb 19 21:02:50.712793 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:50.712793 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:50.715459 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1462/3005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:50 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:50.719851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cf5fe55a-ae71-49ed-97fc-5c7ae466eda7 req-92aee1da-f3c5-4867-a407-b9513825ab78 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.720525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cf5fe55a-ae71-49ed-97fc-5c7ae466eda7 req-92aee1da-f3c5-4867-a407-b9513825ab78 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.722345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fa81d6bb-c41b-4df4-b0db-32cf1b3d8657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:50.723228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fa81d6bb-c41b-4df4-b0db-32cf1b3d8657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:50.730748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa81d6bb-c41b-4df4-b0db-32cf1b3d8657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.733026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa81d6bb-c41b-4df4-b0db-32cf1b3d8657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.734524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa81d6bb-c41b-4df4-b0db-32cf1b3d8657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.735570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa81d6bb-c41b-4df4-b0db-32cf1b3d8657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.763239 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-cf5fe55a-ae71-49ed-97fc-5c7ae466eda7 req-92aee1da-f3c5-4867-a407-b9513825ab78 service nova] Creating event network-vif-deleted:7c930953-29d6-4047-8f78-0d1f65f29d0b for instance 2df03445-3277-48bd-be5b-c8503c33714d on nch1-master-1 Feb 19 21:02:50.772837 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-cf5fe55a-ae71-49ed-97fc-5c7ae466eda7 req-92aee1da-f3c5-4867-a407-b9513825ab78 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171170 Feb 19 21:02:50.774296 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1544/3006] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:50.784469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:50.786161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:50.795973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.798266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.799757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.800459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.847699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:50.849719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:50.850726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lazy-loading 'fault' on Instance uuid 2df03445-3277-48bd-be5b-c8503c33714d {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:02:50.935270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e829f8edf3477dbc070d33ae8a6613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c91d99923e44a9b49c306044837e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:50.948261 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a3f2f86b-f53f-4a60-a2da-472a83fc7470 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 200 len: 1311 microversion: 2.1 time: 0.169930 Feb 19 21:02:50.951543 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1545/3007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:50 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:51.043591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fa81d6bb-c41b-4df4-b0db-32cf1b3d8657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:51.053589 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fa81d6bb-c41b-4df4-b0db-32cf1b3d8657 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.336661 Feb 19 21:02:51.061667 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1463/3008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:50 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:51.112088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8502b718-86da-4c86-a91c-8745873786b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:51.112787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8502b718-86da-4c86-a91c-8745873786b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:51.127558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8502b718-86da-4c86-a91c-8745873786b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.129393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8502b718-86da-4c86-a91c-8745873786b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.130473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8502b718-86da-4c86-a91c-8745873786b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.131801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8502b718-86da-4c86-a91c-8745873786b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.199135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-265cfde1-dc07-448e-826d-727fe89c0c6b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:51.200681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-265cfde1-dc07-448e-826d-727fe89c0c6b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:51.212863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-265cfde1-dc07-448e-826d-727fe89c0c6b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.213828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-265cfde1-dc07-448e-826d-727fe89c0c6b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.216409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-265cfde1-dc07-448e-826d-727fe89c0c6b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.217214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-265cfde1-dc07-448e-826d-727fe89c0c6b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.272672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-265cfde1-dc07-448e-826d-727fe89c0c6b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:02:51.339051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8502b718-86da-4c86-a91c-8745873786b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:51.348471 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8502b718-86da-4c86-a91c-8745873786b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1325 microversion: 2.1 time: 0.249838 Feb 19 21:02:51.358464 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1546/3009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:51 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1325 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:51.397223 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-265cfde1-dc07-448e-826d-727fe89c0c6b tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 204 len: 0 microversion: 2.1 time: 0.206919 Feb 19 21:02:51.398204 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1464/3010] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:02:51 2022] DELETE /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:02:51.407074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4a0a2750-047c-406f-b2c1-ff8dbf388769 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:51.407656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4a0a2750-047c-406f-b2c1-ff8dbf388769 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:51.414459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a0a2750-047c-406f-b2c1-ff8dbf388769 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.414899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a0a2750-047c-406f-b2c1-ff8dbf388769 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.415725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a0a2750-047c-406f-b2c1-ff8dbf388769 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.416158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a0a2750-047c-406f-b2c1-ff8dbf388769 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.591825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae01dd8e-658d-4140-aff8-387631216046 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:51.599099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae01dd8e-658d-4140-aff8-387631216046 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:51.608174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a0a2750-047c-406f-b2c1-ff8dbf388769 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:51.618893 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4a0a2750-047c-406f-b2c1-ff8dbf388769 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1505 microversion: 2.1 time: 0.215271 Feb 19 21:02:51.619654 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1547/3011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:51 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:51.626999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae01dd8e-658d-4140-aff8-387631216046 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.627866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae01dd8e-658d-4140-aff8-387631216046 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.633975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae01dd8e-658d-4140-aff8-387631216046 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.636080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae01dd8e-658d-4140-aff8-387631216046 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.721354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-937415d8-c050-47a0-8e1f-96e3ce9ee64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:51.721906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-937415d8-c050-47a0-8e1f-96e3ce9ee64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:51.734632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-937415d8-c050-47a0-8e1f-96e3ce9ee64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.735202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-937415d8-c050-47a0-8e1f-96e3ce9ee64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.736755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-937415d8-c050-47a0-8e1f-96e3ce9ee64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.738169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-937415d8-c050-47a0-8e1f-96e3ce9ee64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.901440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae01dd8e-658d-4140-aff8-387631216046 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:51.912112 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae01dd8e-658d-4140-aff8-387631216046 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.326438 Feb 19 21:02:51.915449 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1465/3012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:51 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:51.970717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-954636e3-77ee-45e1-8d34-f94b98b353c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:51.971498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-954636e3-77ee-45e1-8d34-f94b98b353c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] [instance: 2df03445-3277-48bd-be5b-c8503c33714d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:51.987125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-954636e3-77ee-45e1-8d34-f94b98b353c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.987901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-954636e3-77ee-45e1-8d34-f94b98b353c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:51.989178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-954636e3-77ee-45e1-8d34-f94b98b353c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:51.989800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-954636e3-77ee-45e1-8d34-f94b98b353c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:52.008796 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-954636e3-77ee-45e1-8d34-f94b98b353c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] HTTP exception thrown: Instance 2df03445-3277-48bd-be5b-c8503c33714d could not be found. Feb 19 21:02:52.009539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-954636e3-77ee-45e1-8d34-f94b98b353c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] Returning 404 to user: Instance 2df03445-3277-48bd-be5b-c8503c33714d could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:52.009685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-937415d8-c050-47a0-8e1f-96e3ce9ee64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:52.010495 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-954636e3-77ee-45e1-8d34-f94b98b353c0 tempest-ServerRescueNegativeTestJSON-301100829 tempest-ServerRescueNegativeTestJSON-301100829-project] 10.222.0.30 "GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d" status: 404 len: 111 microversion: 2.1 time: 0.043972 Feb 19 21:02:52.011597 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1466/3013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:51 2022] GET /compute/v2.1/servers/2df03445-3277-48bd-be5b-c8503c33714d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:02:52.025046 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-937415d8-c050-47a0-8e1f-96e3ce9ee64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1682 microversion: 2.1 time: 0.308220 Feb 19 21:02:52.026269 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1548/3014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:51 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1682 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:52.071626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-48ed57f0-a708-4bff-b51c-f23ed3879f2e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:52.072250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-48ed57f0-a708-4bff-b51c-f23ed3879f2e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:52.083866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48ed57f0-a708-4bff-b51c-f23ed3879f2e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:52.084481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48ed57f0-a708-4bff-b51c-f23ed3879f2e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:52.085273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48ed57f0-a708-4bff-b51c-f23ed3879f2e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:52.087681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48ed57f0-a708-4bff-b51c-f23ed3879f2e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:52.368656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00c5f9b6-bc7e-4aa4-b1e8-61908c2fa224 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:52.369299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-00c5f9b6-bc7e-4aa4-b1e8-61908c2fa224 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:52.385113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00c5f9b6-bc7e-4aa4-b1e8-61908c2fa224 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:52.385648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00c5f9b6-bc7e-4aa4-b1e8-61908c2fa224 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:52.386558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00c5f9b6-bc7e-4aa4-b1e8-61908c2fa224 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:52.388803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00c5f9b6-bc7e-4aa4-b1e8-61908c2fa224 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:52.414825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-48ed57f0-a708-4bff-b51c-f23ed3879f2e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:52.424885 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-48ed57f0-a708-4bff-b51c-f23ed3879f2e tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.357375 Feb 19 21:02:52.440133 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1467/3015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:52 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:52.462177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b3f47b9c-2e03-45b3-a779-cdd028ac5d47 req-6807c475-f997-42c8-85b2-d579a9fc2d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c832d7-1492-4fe5-8f8a-411cc1c49a74", "name": "network-vif-plugged", "status": "completed", "tag": "ef05e742-e00b-4308-af0a-e4dc13084ce0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:52.465484 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:52.465484 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:52.484232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b3f47b9c-2e03-45b3-a779-cdd028ac5d47 req-6807c475-f997-42c8-85b2-d579a9fc2d17 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:52.484764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b3f47b9c-2e03-45b3-a779-cdd028ac5d47 req-6807c475-f997-42c8-85b2-d579a9fc2d17 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:52.507701 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b3f47b9c-2e03-45b3-a779-cdd028ac5d47 req-6807c475-f997-42c8-85b2-d579a9fc2d17 service nova] Creating event network-vif-plugged:ef05e742-e00b-4308-af0a-e4dc13084ce0 for instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 on nch2-master-1 Feb 19 21:02:52.515811 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b3f47b9c-2e03-45b3-a779-cdd028ac5d47 req-6807c475-f997-42c8-85b2-d579a9fc2d17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058019 Feb 19 21:02:52.517156 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1468/3016] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:52.639380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c369588f-2d7c-41f8-bbb9-22559e30b499 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:52.640364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c369588f-2d7c-41f8-bbb9-22559e30b499 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:52.654257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c369588f-2d7c-41f8-bbb9-22559e30b499 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:52.654899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c369588f-2d7c-41f8-bbb9-22559e30b499 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:52.656929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c369588f-2d7c-41f8-bbb9-22559e30b499 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:52.658145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c369588f-2d7c-41f8-bbb9-22559e30b499 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:52.797220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-00c5f9b6-bc7e-4aa4-b1e8-61908c2fa224 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:52.809903 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-00c5f9b6-bc7e-4aa4-b1e8-61908c2fa224 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1325 microversion: 2.1 time: 0.447193 Feb 19 21:02:52.812425 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1549/3017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:52 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1325 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:52.938985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-07b2515d-0f7a-474b-98c6-12be3e798393 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:52.940318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-07b2515d-0f7a-474b-98c6-12be3e798393 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:52.952285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07b2515d-0f7a-474b-98c6-12be3e798393 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:52.953196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07b2515d-0f7a-474b-98c6-12be3e798393 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:52.954959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07b2515d-0f7a-474b-98c6-12be3e798393 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:52.956788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07b2515d-0f7a-474b-98c6-12be3e798393 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:53.379042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c369588f-2d7c-41f8-bbb9-22559e30b499 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:53.390020 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c369588f-2d7c-41f8-bbb9-22559e30b499 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1505 microversion: 2.1 time: 0.754716 Feb 19 21:02:53.390924 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1469/3018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:52 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1505 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:53.397728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-74f7074b-55e9-43bf-a2d5-0a0b0d204af5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:53.398825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-74f7074b-55e9-43bf-a2d5-0a0b0d204af5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:53.407003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74f7074b-55e9-43bf-a2d5-0a0b0d204af5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:53.407557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74f7074b-55e9-43bf-a2d5-0a0b0d204af5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:53.408496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74f7074b-55e9-43bf-a2d5-0a0b0d204af5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:53.409004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74f7074b-55e9-43bf-a2d5-0a0b0d204af5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:53.590193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-07b2515d-0f7a-474b-98c6-12be3e798393 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:53.602870 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-07b2515d-0f7a-474b-98c6-12be3e798393 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.674017 Feb 19 21:02:53.604774 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1550/3019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:52 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:53.612792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8eea2cfb-52d7-4a89-b38b-d05a2cb4ef8b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:53.613657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8eea2cfb-52d7-4a89-b38b-d05a2cb4ef8b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:53.622319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8eea2cfb-52d7-4a89-b38b-d05a2cb4ef8b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:53.622864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8eea2cfb-52d7-4a89-b38b-d05a2cb4ef8b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:53.623731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8eea2cfb-52d7-4a89-b38b-d05a2cb4ef8b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:53.624494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8eea2cfb-52d7-4a89-b38b-d05a2cb4ef8b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:53.743071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-74f7074b-55e9-43bf-a2d5-0a0b0d204af5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:53.753710 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-74f7074b-55e9-43bf-a2d5-0a0b0d204af5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.361416 Feb 19 21:02:53.755206 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1470/3020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:53 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:53.835998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eef8c211-0c79-49e1-8a4d-e62c57d927d3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:53.836671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eef8c211-0c79-49e1-8a4d-e62c57d927d3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:53.857287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eef8c211-0c79-49e1-8a4d-e62c57d927d3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:53.861076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eef8c211-0c79-49e1-8a4d-e62c57d927d3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:53.862272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eef8c211-0c79-49e1-8a4d-e62c57d927d3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:53.862881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eef8c211-0c79-49e1-8a4d-e62c57d927d3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:53.994662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8eea2cfb-52d7-4a89-b38b-d05a2cb4ef8b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:54.013192 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8eea2cfb-52d7-4a89-b38b-d05a2cb4ef8b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.400925 Feb 19 21:02:54.014397 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1551/3021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:53 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:54.019649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d59d15a4-bfb2-4f0f-a43c-89533d8a0544 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:54.020524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d59d15a4-bfb2-4f0f-a43c-89533d8a0544 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:54.029169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d59d15a4-bfb2-4f0f-a43c-89533d8a0544 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:54.030060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d59d15a4-bfb2-4f0f-a43c-89533d8a0544 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:54.037345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d59d15a4-bfb2-4f0f-a43c-89533d8a0544 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:54.038254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d59d15a4-bfb2-4f0f-a43c-89533d8a0544 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:54.552475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eef8c211-0c79-49e1-8a4d-e62c57d927d3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:54.567224 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eef8c211-0c79-49e1-8a4d-e62c57d927d3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1325 microversion: 2.1 time: 0.742346 Feb 19 21:02:54.568918 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1471/3022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:53 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1325 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:54.576996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2a123265-fae2-487b-a089-68b0dd6e3f7a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:54.577961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2a123265-fae2-487b-a089-68b0dd6e3f7a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:54.593425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a123265-fae2-487b-a089-68b0dd6e3f7a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:54.595242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a123265-fae2-487b-a089-68b0dd6e3f7a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:54.596284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a123265-fae2-487b-a089-68b0dd6e3f7a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:54.597709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a123265-fae2-487b-a089-68b0dd6e3f7a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:54.611971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d59d15a4-bfb2-4f0f-a43c-89533d8a0544 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:54.623620 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d59d15a4-bfb2-4f0f-a43c-89533d8a0544 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.607739 Feb 19 21:02:54.624306 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1552/3023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:54 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:54.637603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-911dcd30-7954-4caa-b88d-d1f4de3dc637 req-e0f4211a-4310-4ea5-8f74-c586cc2bdcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c832d7-1492-4fe5-8f8a-411cc1c49a74", "name": "network-vif-plugged", "status": "completed", "tag": "eb5ca4e0-1823-4105-bad9-89b1262047ff"}, {"server_uuid": "92321eba-8b05-4954-9660-9e95356bb6b3", "name": "network-vif-plugged", "status": "completed", "tag": "1a064e13-3fb5-4649-98d7-8b53f8bf8480"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:54.639320 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:54.639320 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:02:54.661563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-911dcd30-7954-4caa-b88d-d1f4de3dc637 req-e0f4211a-4310-4ea5-8f74-c586cc2bdcc2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:54.662014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-911dcd30-7954-4caa-b88d-d1f4de3dc637 req-e0f4211a-4310-4ea5-8f74-c586cc2bdcc2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:54.689004 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-911dcd30-7954-4caa-b88d-d1f4de3dc637 req-e0f4211a-4310-4ea5-8f74-c586cc2bdcc2 service nova] Creating event network-vif-plugged:eb5ca4e0-1823-4105-bad9-89b1262047ff for instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 on nch2-master-1 Feb 19 21:02:54.689976 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-911dcd30-7954-4caa-b88d-d1f4de3dc637 req-e0f4211a-4310-4ea5-8f74-c586cc2bdcc2 service nova] Creating event network-vif-plugged:1a064e13-3fb5-4649-98d7-8b53f8bf8480 for instance 92321eba-8b05-4954-9660-9e95356bb6b3 on nch1-master-1 Feb 19 21:02:54.748189 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-911dcd30-7954-4caa-b88d-d1f4de3dc637 req-e0f4211a-4310-4ea5-8f74-c586cc2bdcc2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114409 Feb 19 21:02:54.752675 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1553/3024] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:54.767730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-845558b2-6556-4588-8ac5-23514b467e91 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:54.770160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-845558b2-6556-4588-8ac5-23514b467e91 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:54.791818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-845558b2-6556-4588-8ac5-23514b467e91 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:54.792663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-845558b2-6556-4588-8ac5-23514b467e91 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:54.797663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-845558b2-6556-4588-8ac5-23514b467e91 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:54.798715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-845558b2-6556-4588-8ac5-23514b467e91 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:55.369098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2a123265-fae2-487b-a089-68b0dd6e3f7a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:55.387984 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2a123265-fae2-487b-a089-68b0dd6e3f7a tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1505 microversion: 2.1 time: 0.814334 Feb 19 21:02:55.398358 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1472/3025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:54 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1505 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:55.438097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-07e7c32d-1022-40e0-b654-9898dec4f2f3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:55.439567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-07e7c32d-1022-40e0-b654-9898dec4f2f3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:55.449101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-845558b2-6556-4588-8ac5-23514b467e91 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:55.457506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07e7c32d-1022-40e0-b654-9898dec4f2f3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:55.458223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07e7c32d-1022-40e0-b654-9898dec4f2f3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:55.461936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07e7c32d-1022-40e0-b654-9898dec4f2f3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:55.462445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07e7c32d-1022-40e0-b654-9898dec4f2f3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:55.462871 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-845558b2-6556-4588-8ac5-23514b467e91 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.702335 Feb 19 21:02:55.472934 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1554/3026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:54 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:55.585866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5fa49dd-d76b-4c70-9c11-59350500a288 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:55.586875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d5fa49dd-d76b-4c70-9c11-59350500a288 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:55.596266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5fa49dd-d76b-4c70-9c11-59350500a288 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:55.597031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5fa49dd-d76b-4c70-9c11-59350500a288 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:55.598129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5fa49dd-d76b-4c70-9c11-59350500a288 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:55.598780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5fa49dd-d76b-4c70-9c11-59350500a288 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:56.047636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-07e7c32d-1022-40e0-b654-9898dec4f2f3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:56.061636 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-07e7c32d-1022-40e0-b654-9898dec4f2f3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1523 microversion: 2.1 time: 0.640670 Feb 19 21:02:56.064946 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1473/3027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:55 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1523 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:56.075404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2654d284-fff4-42b3-b171-b11ad2796f00 req-09676ccc-9e19-4bc4-b7fe-773c763b52cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61315ad-086f-4a49-b685-c13202a03d98", "name": "network-vif-deleted", "tag": "e7e4d47d-1952-43ba-83d8-7a0c6b1cebb2"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:56.082336 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:56.082336 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:56.098123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2654d284-fff4-42b3-b171-b11ad2796f00 req-09676ccc-9e19-4bc4-b7fe-773c763b52cc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:56.099208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2654d284-fff4-42b3-b171-b11ad2796f00 req-09676ccc-9e19-4bc4-b7fe-773c763b52cc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:56.155650 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2654d284-fff4-42b3-b171-b11ad2796f00 req-09676ccc-9e19-4bc4-b7fe-773c763b52cc service nova] Creating event network-vif-deleted:e7e4d47d-1952-43ba-83d8-7a0c6b1cebb2 for instance e61315ad-086f-4a49-b685-c13202a03d98 on nch2-master-1 Feb 19 21:02:56.169761 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2654d284-fff4-42b3-b171-b11ad2796f00 req-09676ccc-9e19-4bc4-b7fe-773c763b52cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102620 Feb 19 21:02:56.170726 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1474/3028] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:56.211355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d5fa49dd-d76b-4c70-9c11-59350500a288 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:56.225344 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5fa49dd-d76b-4c70-9c11-59350500a288 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1325 microversion: 2.1 time: 0.643589 Feb 19 21:02:56.227400 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1555/3029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:55 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1325 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:02:56.399927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a1c13352-d6a0-46fb-a44b-a971e44d8268 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:56.407438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:56.409472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a1c13352-d6a0-46fb-a44b-a971e44d8268 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:56.415530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:56.435520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1c13352-d6a0-46fb-a44b-a971e44d8268 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:56.436181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1c13352-d6a0-46fb-a44b-a971e44d8268 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:56.436788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:56.438348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1c13352-d6a0-46fb-a44b-a971e44d8268 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:56.440104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:56.440879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1c13352-d6a0-46fb-a44b-a971e44d8268 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:56.441989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:56.443805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:56.517076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:56.517623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:56.518221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lazy-loading 'fault' on Instance uuid e61315ad-086f-4a49-b685-c13202a03d98 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:02:56.628813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb812b1b093045b1aaa3ce9e3334ff4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2bd0a55e44ee2802a7b95678c9d60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:56.658919 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f6f0fad-d662-4164-85e1-4763f85737f6 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 200 len: 1304 microversion: 2.1 time: 0.256613 Feb 19 21:02:56.660738 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1556/3030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:56 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 1304 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:56.667963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-da4956b6-ffda-4cf3-a853-b9087bb37a75 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:56.669316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-da4956b6-ffda-4cf3-a853-b9087bb37a75 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:56.737055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da4956b6-ffda-4cf3-a853-b9087bb37a75 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:56.744572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da4956b6-ffda-4cf3-a853-b9087bb37a75 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:56.746322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da4956b6-ffda-4cf3-a853-b9087bb37a75 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:56.748582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da4956b6-ffda-4cf3-a853-b9087bb37a75 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:57.239089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a1c13352-d6a0-46fb-a44b-a971e44d8268 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:57.248165 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a1c13352-d6a0-46fb-a44b-a971e44d8268 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.852669 Feb 19 21:02:57.260630 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1475/3031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:56 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:57.266880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c9e590b8-b96c-4adc-86db-eb11ee237303 req-5b1cfa66-5999-4382-82fd-83efa1ecfbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "name": "network-vif-unplugged", "status": "completed", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:57.269058 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:02:57.269058 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:02:57.286806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c9e590b8-b96c-4adc-86db-eb11ee237303 req-5b1cfa66-5999-4382-82fd-83efa1ecfbd7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:57.287730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c9e590b8-b96c-4adc-86db-eb11ee237303 req-5b1cfa66-5999-4382-82fd-83efa1ecfbd7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:57.304832 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c9e590b8-b96c-4adc-86db-eb11ee237303 req-5b1cfa66-5999-4382-82fd-83efa1ecfbd7 service nova] Creating event network-vif-unplugged:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:02:57.313589 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c9e590b8-b96c-4adc-86db-eb11ee237303 req-5b1cfa66-5999-4382-82fd-83efa1ecfbd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050627 Feb 19 21:02:57.314611 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1476/3032] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:57.320509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13e32d9c-83cd-47d3-8d57-2df7f11b8edd tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:57.321744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-13e32d9c-83cd-47d3-8d57-2df7f11b8edd tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:57.330082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13e32d9c-83cd-47d3-8d57-2df7f11b8edd tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:57.330987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13e32d9c-83cd-47d3-8d57-2df7f11b8edd tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:57.332075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13e32d9c-83cd-47d3-8d57-2df7f11b8edd tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:57.332842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13e32d9c-83cd-47d3-8d57-2df7f11b8edd tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:57.565498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-da4956b6-ffda-4cf3-a853-b9087bb37a75 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:57.580984 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-da4956b6-ffda-4cf3-a853-b9087bb37a75 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1334 microversion: 2.1 time: 0.917608 Feb 19 21:02:57.581857 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1557/3033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:56 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1334 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:57.595637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df18fdd1-ecad-48ee-ac72-f29ba27bfb95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:57.596569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-df18fdd1-ecad-48ee-ac72-f29ba27bfb95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:57.603666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13e32d9c-83cd-47d3-8d57-2df7f11b8edd tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:57.613341 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13e32d9c-83cd-47d3-8d57-2df7f11b8edd tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1503 microversion: 2.1 time: 0.297256 Feb 19 21:02:57.617712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df18fdd1-ecad-48ee-ac72-f29ba27bfb95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:57.618269 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1477/3034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:57 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:57.620134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df18fdd1-ecad-48ee-ac72-f29ba27bfb95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:57.624789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2af6a8b7-51ad-43b7-ad85-11bc71fe5d19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:57.625939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df18fdd1-ecad-48ee-ac72-f29ba27bfb95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:57.626612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df18fdd1-ecad-48ee-ac72-f29ba27bfb95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:57.630299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2af6a8b7-51ad-43b7-ad85-11bc71fe5d19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:57.642681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2af6a8b7-51ad-43b7-ad85-11bc71fe5d19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:57.644762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2af6a8b7-51ad-43b7-ad85-11bc71fe5d19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:57.653027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2af6a8b7-51ad-43b7-ad85-11bc71fe5d19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:57.653816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2af6a8b7-51ad-43b7-ad85-11bc71fe5d19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:58.021878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2af6a8b7-51ad-43b7-ad85-11bc71fe5d19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:58.023919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df18fdd1-ecad-48ee-ac72-f29ba27bfb95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:58.033624 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2af6a8b7-51ad-43b7-ad85-11bc71fe5d19 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.414085 Feb 19 21:02:58.034213 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df18fdd1-ecad-48ee-ac72-f29ba27bfb95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1522 microversion: 2.1 time: 0.440699 Feb 19 21:02:58.035513 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1478/3035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:57 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:58.040366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7510c943-b062-4787-b1c7-c22b75fb1078 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Action: 'create', calling method: .version_select at 0x7f6479200dc0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1283694296", "description": "tempest-description-185832499"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:58.046936 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1558/3036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:57 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:58.067083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a694cece-55ce-4052-9ea7-0035c3784eb0 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:58.068145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a694cece-55ce-4052-9ea7-0035c3784eb0 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] [instance: e61315ad-086f-4a49-b685-c13202a03d98] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:58.076913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a694cece-55ce-4052-9ea7-0035c3784eb0 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:58.078187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a694cece-55ce-4052-9ea7-0035c3784eb0 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:58.080096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a694cece-55ce-4052-9ea7-0035c3784eb0 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:58.080979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a694cece-55ce-4052-9ea7-0035c3784eb0 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:58.099736 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a694cece-55ce-4052-9ea7-0035c3784eb0 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] HTTP exception thrown: Instance e61315ad-086f-4a49-b685-c13202a03d98 could not be found. Feb 19 21:02:58.100492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a694cece-55ce-4052-9ea7-0035c3784eb0 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] Returning 404 to user: Instance e61315ad-086f-4a49-b685-c13202a03d98 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:58.101421 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a694cece-55ce-4052-9ea7-0035c3784eb0 tempest-VolumesActionsTest-2105468990 tempest-VolumesActionsTest-2105468990-project] 10.222.0.30 "GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98" status: 404 len: 111 microversion: 2.1 time: 0.053506 Feb 19 21:02:58.102082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1559/3037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:58 2022] GET /compute/v2.1/servers/e61315ad-086f-4a49-b685-c13202a03d98 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:02:58.112676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1ba17073-9173-4d6f-967b-dc2fa655986f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:58.113615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1ba17073-9173-4d6f-967b-dc2fa655986f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:58.119893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ba17073-9173-4d6f-967b-dc2fa655986f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:58.120483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ba17073-9173-4d6f-967b-dc2fa655986f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:58.121216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ba17073-9173-4d6f-967b-dc2fa655986f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:58.122114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ba17073-9173-4d6f-967b-dc2fa655986f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:58.736487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1ba17073-9173-4d6f-967b-dc2fa655986f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:58.750921 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1ba17073-9173-4d6f-967b-dc2fa655986f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.641749 Feb 19 21:02:58.751999 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1560/3038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:58 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:58.757858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8a40ac91-c084-488d-904b-90b3c4d36dd0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:58.759411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8a40ac91-c084-488d-904b-90b3c4d36dd0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:58.769927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a40ac91-c084-488d-904b-90b3c4d36dd0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:58.770379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a40ac91-c084-488d-904b-90b3c4d36dd0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:58.771181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a40ac91-c084-488d-904b-90b3c4d36dd0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:58.771615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a40ac91-c084-488d-904b-90b3c4d36dd0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:58.875663 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7510c943-b062-4787-b1c7-c22b75fb1078 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.838806 Feb 19 21:02:58.882521 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1479/3039] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:02:58 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:58.892504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6acbc178-41b9-4309-9249-92bc72163fe4 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:58.893347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6acbc178-41b9-4309-9249-92bc72163fe4 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:58.908687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6acbc178-41b9-4309-9249-92bc72163fe4 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:58.911365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6acbc178-41b9-4309-9249-92bc72163fe4 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:58.913345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6acbc178-41b9-4309-9249-92bc72163fe4 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:58.913991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6acbc178-41b9-4309-9249-92bc72163fe4 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:59.143840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8a40ac91-c084-488d-904b-90b3c4d36dd0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:59.153712 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8a40ac91-c084-488d-904b-90b3c4d36dd0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1522 microversion: 2.1 time: 0.400208 Feb 19 21:02:59.155178 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1561/3040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:58 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:59.174817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-863dc96c-06a0-4ece-9953-93e0dd67acd0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:59.177118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-863dc96c-06a0-4ece-9953-93e0dd67acd0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:59.181830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6acbc178-41b9-4309-9249-92bc72163fe4 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:02:59.187614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-863dc96c-06a0-4ece-9953-93e0dd67acd0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:59.188456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-863dc96c-06a0-4ece-9953-93e0dd67acd0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:59.189772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-863dc96c-06a0-4ece-9953-93e0dd67acd0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:59.190468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-863dc96c-06a0-4ece-9953-93e0dd67acd0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:59.191645 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6acbc178-41b9-4309-9249-92bc72163fe4 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1669 microversion: 2.1 time: 0.307908 Feb 19 21:02:59.206554 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1480/3041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:58 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1669 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:02:59.232793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3ba2c4ad-396c-4e94-8ec5-9760357909c3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1283694296"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:59.233700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3ba2c4ad-396c-4e94-8ec5-9760357909c3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:59.246960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ba2c4ad-396c-4e94-8ec5-9760357909c3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:59.247815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ba2c4ad-396c-4e94-8ec5-9760357909c3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:59.249747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ba2c4ad-396c-4e94-8ec5-9760357909c3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:59.250296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ba2c4ad-396c-4e94-8ec5-9760357909c3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:59.420742 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-863dc96c-06a0-4ece-9953-93e0dd67acd0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.263029 Feb 19 21:02:59.424397 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1562/3042] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:02:59 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:02:59.434015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e708c88f-527c-4a39-8e3f-0d63a4be8e4a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1311661694", "metadata": {"": ""}}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:02:59.435838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e708c88f-527c-4a39-8e3f-0d63a4be8e4a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:02:59.437166 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e708c88f-527c-4a39-8e3f-0d63a4be8e4a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action" status: 400 len: 170 microversion: 2.1 time: 0.011390 Feb 19 21:02:59.438586 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1563/3043] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Feb 19 21:02:59 2022] POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action => generated 170 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:02:59.443826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-48877669-0d01-4ee5-b052-7fb40e539ffe tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:59.444767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-48877669-0d01-4ee5-b052-7fb40e539ffe tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:59.464115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48877669-0d01-4ee5-b052-7fb40e539ffe tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:59.465708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48877669-0d01-4ee5-b052-7fb40e539ffe tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:59.470045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48877669-0d01-4ee5-b052-7fb40e539ffe tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:59.470663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48877669-0d01-4ee5-b052-7fb40e539ffe tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:59.512378 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-48877669-0d01-4ee5-b052-7fb40e539ffe tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74/ips" status: 200 len: 179 microversion: 2.1 time: 0.072368 Feb 19 21:02:59.513219 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1564/3044] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:02:59 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74/ips => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:02:59.516873 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.network.security_group_api [None req-3ba2c4ad-396c-4e94-8ec5-9760357909c3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Adding security group 3f7984a6-e7a6-4e8e-9ea7-f774878149d3 to port 4a3185d0-44de-46bc-a6a9-47a19835dc9d Feb 19 21:02:59.521278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36c04364-345c-4f06-bd87-a9b01aef1634 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:02:59.522022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-36c04364-345c-4f06-bd87-a9b01aef1634 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:02:59.533126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36c04364-345c-4f06-bd87-a9b01aef1634 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:59.533675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36c04364-345c-4f06-bd87-a9b01aef1634 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:02:59.534559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36c04364-345c-4f06-bd87-a9b01aef1634 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:02:59.535011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36c04364-345c-4f06-bd87-a9b01aef1634 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:00.468600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-36c04364-345c-4f06-bd87-a9b01aef1634 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:00.485277 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36c04364-345c-4f06-bd87-a9b01aef1634 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1671 microversion: 2.1 time: 0.970559 Feb 19 21:03:00.496790 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1565/3045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:02:59 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1671 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:00.502014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6fa638fc-f1a8-4a7d-a5ab-97be8360deef tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:00.502959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6fa638fc-f1a8-4a7d-a5ab-97be8360deef tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:00.524676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fa638fc-f1a8-4a7d-a5ab-97be8360deef tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:00.525539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fa638fc-f1a8-4a7d-a5ab-97be8360deef tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:00.527128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fa638fc-f1a8-4a7d-a5ab-97be8360deef tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:00.528156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fa638fc-f1a8-4a7d-a5ab-97be8360deef tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:01.590662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6fa638fc-f1a8-4a7d-a5ab-97be8360deef tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:01.610868 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6fa638fc-f1a8-4a7d-a5ab-97be8360deef tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1522 microversion: 2.1 time: 1.112814 Feb 19 21:03:01.611825 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1566/3046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:00 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1522 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:01.617032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-298b1095-0410-4615-8671-dab3b007df3f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:01.626717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-298b1095-0410-4615-8671-dab3b007df3f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:01.640116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-298b1095-0410-4615-8671-dab3b007df3f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:01.643715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-298b1095-0410-4615-8671-dab3b007df3f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:01.649479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-298b1095-0410-4615-8671-dab3b007df3f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:01.650233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-298b1095-0410-4615-8671-dab3b007df3f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:01.748659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-298b1095-0410-4615-8671-dab3b007df3f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:03:01.783975 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3ba2c4ad-396c-4e94-8ec5-9760357909c3 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action" status: 202 len: 0 microversion: 2.1 time: 2.568888 Feb 19 21:03:01.784975 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1481/3047] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:02:59 2022] POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action => generated 0 bytes in 2572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:03:01.802127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a7724006-210f-4ee3-8516-8afdd9b4bfb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:01.808975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a7724006-210f-4ee3-8516-8afdd9b4bfb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:01.822081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7724006-210f-4ee3-8516-8afdd9b4bfb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:01.822867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7724006-210f-4ee3-8516-8afdd9b4bfb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:01.824034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7724006-210f-4ee3-8516-8afdd9b4bfb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:01.824741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7724006-210f-4ee3-8516-8afdd9b4bfb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:01.994646 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-298b1095-0410-4615-8671-dab3b007df3f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 204 len: 0 microversion: 2.1 time: 0.379609 Feb 19 21:03:02.005938 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1567/3048] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:03:01 2022] DELETE /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:03:02.028582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6a61f87b-cbd4-47f7-af16-4a2d8346012e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:02.030235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6a61f87b-cbd4-47f7-af16-4a2d8346012e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:02.046612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a61f87b-cbd4-47f7-af16-4a2d8346012e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:02.047445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a61f87b-cbd4-47f7-af16-4a2d8346012e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:02.048543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a61f87b-cbd4-47f7-af16-4a2d8346012e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:02.053214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a61f87b-cbd4-47f7-af16-4a2d8346012e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:02.524316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6a61f87b-cbd4-47f7-af16-4a2d8346012e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:02.550563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a7724006-210f-4ee3-8516-8afdd9b4bfb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:02.554529 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6a61f87b-cbd4-47f7-af16-4a2d8346012e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1522 microversion: 2.1 time: 0.530613 Feb 19 21:03:02.557445 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1568/3049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:02 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:02.563558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7359143c-54b5-43c7-af6d-cacab9a55f28 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1283694296"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:02.565988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7359143c-54b5-43c7-af6d-cacab9a55f28 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:02.572502 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a7724006-210f-4ee3-8516-8afdd9b4bfb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1671 microversion: 2.1 time: 0.785179 Feb 19 21:03:02.574506 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1482/3050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:01 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1671 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:02.579284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-be810b6a-4a14-471d-bbe8-b0975e7440e2 req-82174ab5-4ce6-411f-8775-1dfac9df7429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed99b5a-d90f-48ef-bfe9-97ccd625993c", "tag": "4a3185d0-44de-46bc-a6a9-47a19835dc9d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:02.581790 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:02.581790 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:03:02.588099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7359143c-54b5-43c7-af6d-cacab9a55f28 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:02.589929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7359143c-54b5-43c7-af6d-cacab9a55f28 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:02.591012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7359143c-54b5-43c7-af6d-cacab9a55f28 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:02.592169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7359143c-54b5-43c7-af6d-cacab9a55f28 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:02.598035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-be810b6a-4a14-471d-bbe8-b0975e7440e2 req-82174ab5-4ce6-411f-8775-1dfac9df7429 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:02.598867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-be810b6a-4a14-471d-bbe8-b0975e7440e2 req-82174ab5-4ce6-411f-8775-1dfac9df7429 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:02.614957 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-be810b6a-4a14-471d-bbe8-b0975e7440e2 req-82174ab5-4ce6-411f-8775-1dfac9df7429 service nova] Creating event network-changed:4a3185d0-44de-46bc-a6a9-47a19835dc9d for instance 1ed99b5a-d90f-48ef-bfe9-97ccd625993c on nch1-master-1 Feb 19 21:03:02.625269 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-be810b6a-4a14-471d-bbe8-b0975e7440e2 req-82174ab5-4ce6-411f-8775-1dfac9df7429 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048646 Feb 19 21:03:02.628478 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1483/3051] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:02.640995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6175bfee-018f-426a-a48b-66d9b5983009 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:02.642055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6175bfee-018f-426a-a48b-66d9b5983009 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:02.679708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6175bfee-018f-426a-a48b-66d9b5983009 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:02.682897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6175bfee-018f-426a-a48b-66d9b5983009 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:02.684856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6175bfee-018f-426a-a48b-66d9b5983009 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:02.685474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6175bfee-018f-426a-a48b-66d9b5983009 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:03.039951 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.network.security_group_api [None req-7359143c-54b5-43c7-af6d-cacab9a55f28 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Removing security group 3f7984a6-e7a6-4e8e-9ea7-f774878149d3 from port 4a3185d0-44de-46bc-a6a9-47a19835dc9d Feb 19 21:03:03.314712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6175bfee-018f-426a-a48b-66d9b5983009 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:03.329113 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6175bfee-018f-426a-a48b-66d9b5983009 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1675 microversion: 2.1 time: 0.695873 Feb 19 21:03:03.329787 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1484/3052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:02 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1675 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:03.371881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d57b60df-a905-4989-8262-978f9ba8a91e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2118247212", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:03.389233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d57b60df-a905-4989-8262-978f9ba8a91e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:03.393753 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d57b60df-a905-4989-8262-978f9ba8a91e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action" status: 400 len: 938 microversion: 2.1 time: 0.048632 Feb 19 21:03:03.394927 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1485/3053] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Feb 19 21:03:03 2022] POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action => generated 938 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:03:03.422018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-acf33b30-e235-48e1-ba5a-e32c669b7423 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:03.423100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-acf33b30-e235-48e1-ba5a-e32c669b7423 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:03.456605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acf33b30-e235-48e1-ba5a-e32c669b7423 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:03.458732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acf33b30-e235-48e1-ba5a-e32c669b7423 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:03.460458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acf33b30-e235-48e1-ba5a-e32c669b7423 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:03.466338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acf33b30-e235-48e1-ba5a-e32c669b7423 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:04.571731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-acf33b30-e235-48e1-ba5a-e32c669b7423 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:04.596434 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-acf33b30-e235-48e1-ba5a-e32c669b7423 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1522 microversion: 2.1 time: 1.180426 Feb 19 21:03:04.597189 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1486/3054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:03 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1522 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:04.609635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eec82393-b3f8-468c-ab01-0f109a26e298 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:04.609635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eec82393-b3f8-468c-ab01-0f109a26e298 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:04.620844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec82393-b3f8-468c-ab01-0f109a26e298 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:04.621296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec82393-b3f8-468c-ab01-0f109a26e298 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:04.622111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec82393-b3f8-468c-ab01-0f109a26e298 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:04.622560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec82393-b3f8-468c-ab01-0f109a26e298 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:05.244186 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7359143c-54b5-43c7-af6d-cacab9a55f28 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action" status: 202 len: 0 microversion: 2.1 time: 2.684467 Feb 19 21:03:05.245024 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1569/3055] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:03:02 2022] POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action => generated 0 bytes in 2686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:03:05.254586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b34ea3da-21ef-4690-af6f-cb8ea4cf3a30 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:05.255091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b34ea3da-21ef-4690-af6f-cb8ea4cf3a30 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:05.270455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b34ea3da-21ef-4690-af6f-cb8ea4cf3a30 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:05.271536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b34ea3da-21ef-4690-af6f-cb8ea4cf3a30 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:05.273901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b34ea3da-21ef-4690-af6f-cb8ea4cf3a30 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:05.274580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b34ea3da-21ef-4690-af6f-cb8ea4cf3a30 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:05.562402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eec82393-b3f8-468c-ab01-0f109a26e298 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:05.585529 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eec82393-b3f8-468c-ab01-0f109a26e298 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.985537 Feb 19 21:03:05.587082 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1487/3056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:04 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:05.593992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-21710d74-2b03-4a95-bf8a-e1bce96f14d5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:05.595271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-21710d74-2b03-4a95-bf8a-e1bce96f14d5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:05.607325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-21710d74-2b03-4a95-bf8a-e1bce96f14d5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:05.608049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-21710d74-2b03-4a95-bf8a-e1bce96f14d5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:05.609549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-21710d74-2b03-4a95-bf8a-e1bce96f14d5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:05.610279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-21710d74-2b03-4a95-bf8a-e1bce96f14d5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:06.424043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b34ea3da-21ef-4690-af6f-cb8ea4cf3a30 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:06.445491 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b34ea3da-21ef-4690-af6f-cb8ea4cf3a30 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1675 microversion: 2.1 time: 1.199225 Feb 19 21:03:06.455078 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1570/3057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:05 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1675 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:06.472516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9118eab7-bb2f-4b17-aa33-1260e09dceed tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Action: 'create', calling method: .version_select at 0x7f647469cca0>, body: {"pool": null} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:07.638964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-21710d74-2b03-4a95-bf8a-e1bce96f14d5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:07.692740 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-21710d74-2b03-4a95-bf8a-e1bce96f14d5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1522 microversion: 2.1 time: 2.100778 Feb 19 21:03:07.695708 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1488/3058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:05 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1522 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:07.717377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4e379fc5-975a-4d37-8ba5-1857d75f4b67 req-0328d12e-a91b-470b-9bd0-972e405e3ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed99b5a-d90f-48ef-bfe9-97ccd625993c", "tag": "4a3185d0-44de-46bc-a6a9-47a19835dc9d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:07.719372 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:07.719372 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:03:07.737070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4e379fc5-975a-4d37-8ba5-1857d75f4b67 req-0328d12e-a91b-470b-9bd0-972e405e3ef0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:07.737787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4e379fc5-975a-4d37-8ba5-1857d75f4b67 req-0328d12e-a91b-470b-9bd0-972e405e3ef0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:07.765347 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4e379fc5-975a-4d37-8ba5-1857d75f4b67 req-0328d12e-a91b-470b-9bd0-972e405e3ef0 service nova] Creating event network-changed:4a3185d0-44de-46bc-a6a9-47a19835dc9d for instance 1ed99b5a-d90f-48ef-bfe9-97ccd625993c on nch1-master-1 Feb 19 21:03:07.765749 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4e379fc5-975a-4d37-8ba5-1857d75f4b67 req-0328d12e-a91b-470b-9bd0-972e405e3ef0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070875 Feb 19 21:03:07.800813 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1489/3059] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:07.806359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-55142b79-5299-4937-b92d-b0ecd2c51d07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:07.807426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-55142b79-5299-4937-b92d-b0ecd2c51d07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:07.856681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55142b79-5299-4937-b92d-b0ecd2c51d07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:07.857710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55142b79-5299-4937-b92d-b0ecd2c51d07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:07.858011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55142b79-5299-4937-b92d-b0ecd2c51d07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:07.858443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55142b79-5299-4937-b92d-b0ecd2c51d07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:08.072139 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-55142b79-5299-4937-b92d-b0ecd2c51d07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 200 len: 145 microversion: 2.1 time: 0.269343 Feb 19 21:03:08.073878 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1490/3060] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:03:07 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 145 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:08.110215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-49a73a03-7aa9-49f4-b113-a66bfa3fadff tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:08.110969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-49a73a03-7aa9-49f4-b113-a66bfa3fadff tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:08.153699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49a73a03-7aa9-49f4-b113-a66bfa3fadff tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:08.163780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49a73a03-7aa9-49f4-b113-a66bfa3fadff tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:08.164943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49a73a03-7aa9-49f4-b113-a66bfa3fadff tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:08.167927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49a73a03-7aa9-49f4-b113-a66bfa3fadff tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:09.126388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-49a73a03-7aa9-49f4-b113-a66bfa3fadff tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:09.153378 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-49a73a03-7aa9-49f4-b113-a66bfa3fadff tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1654 microversion: 2.1 time: 1.056167 Feb 19 21:03:09.155691 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1491/3061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:08 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1654 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:09.166043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71f5dcab-5e7c-4a91-9243-f6ea1dee89c2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:09.169875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71f5dcab-5e7c-4a91-9243-f6ea1dee89c2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:09.172578 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71f5dcab-5e7c-4a91-9243-f6ea1dee89c2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action" status: 400 len: 619 microversion: 2.1 time: 0.015192 Feb 19 21:03:09.173813 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1492/3062] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Feb 19 21:03:09 2022] POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:03:09.183701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-270101ff-45b0-41ee-9c5f-0909207da13f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:09.186309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-270101ff-45b0-41ee-9c5f-0909207da13f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:09.197671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-270101ff-45b0-41ee-9c5f-0909207da13f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:09.200802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-270101ff-45b0-41ee-9c5f-0909207da13f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:09.202567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-270101ff-45b0-41ee-9c5f-0909207da13f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:09.203255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-270101ff-45b0-41ee-9c5f-0909207da13f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:09.867406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-270101ff-45b0-41ee-9c5f-0909207da13f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:09.891549 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-270101ff-45b0-41ee-9c5f-0909207da13f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.716414 Feb 19 21:03:09.895750 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1493/3063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:09 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:09.907745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-135f4f25-5b55-4d3d-a766-e47043f59cb4 req-6e852616-309e-434b-8d5c-19f7cbd15bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c832d7-1492-4fe5-8f8a-411cc1c49a74", "name": "network-vif-unplugged", "status": "completed", "tag": "ef05e742-e00b-4308-af0a-e4dc13084ce0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:09.913813 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:09.913813 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:03:10.044480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-135f4f25-5b55-4d3d-a766-e47043f59cb4 req-6e852616-309e-434b-8d5c-19f7cbd15bd3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:10.048685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-135f4f25-5b55-4d3d-a766-e47043f59cb4 req-6e852616-309e-434b-8d5c-19f7cbd15bd3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:10.120491 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-135f4f25-5b55-4d3d-a766-e47043f59cb4 req-6e852616-309e-434b-8d5c-19f7cbd15bd3 service nova] Creating event network-vif-unplugged:ef05e742-e00b-4308-af0a-e4dc13084ce0 for instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 on nch2-master-1 Feb 19 21:03:10.149006 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-135f4f25-5b55-4d3d-a766-e47043f59cb4 req-6e852616-309e-434b-8d5c-19f7cbd15bd3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.251312 Feb 19 21:03:10.154533 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1494/3064] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:10.185042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bed711d8-23fe-4a0e-aca7-e12f6e39be86 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:10.188045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bed711d8-23fe-4a0e-aca7-e12f6e39be86 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:10.235351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bed711d8-23fe-4a0e-aca7-e12f6e39be86 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:10.236993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bed711d8-23fe-4a0e-aca7-e12f6e39be86 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:10.245782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bed711d8-23fe-4a0e-aca7-e12f6e39be86 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:10.246993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bed711d8-23fe-4a0e-aca7-e12f6e39be86 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:11.311412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bed711d8-23fe-4a0e-aca7-e12f6e39be86 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:11.337083 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bed711d8-23fe-4a0e-aca7-e12f6e39be86 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1522 microversion: 2.1 time: 1.179825 Feb 19 21:03:11.341542 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1495/3065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:10 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1522 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:11.351637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-95e757c5-a7b3-4e6d-bbf1-46fafa2242d2 req-b12305a8-b006-496a-b68b-7ffa0df1265e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c832d7-1492-4fe5-8f8a-411cc1c49a74", "name": "network-vif-deleted", "tag": "eb5ca4e0-1823-4105-bad9-89b1262047ff"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:11.357467 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:11.357467 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:03:11.372830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-95e757c5-a7b3-4e6d-bbf1-46fafa2242d2 req-b12305a8-b006-496a-b68b-7ffa0df1265e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:11.374186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-95e757c5-a7b3-4e6d-bbf1-46fafa2242d2 req-b12305a8-b006-496a-b68b-7ffa0df1265e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:11.409778 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-95e757c5-a7b3-4e6d-bbf1-46fafa2242d2 req-b12305a8-b006-496a-b68b-7ffa0df1265e service nova] Creating event network-vif-deleted:eb5ca4e0-1823-4105-bad9-89b1262047ff for instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 on nch2-master-1 Feb 19 21:03:11.417406 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-95e757c5-a7b3-4e6d-bbf1-46fafa2242d2 req-b12305a8-b006-496a-b68b-7ffa0df1265e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072648 Feb 19 21:03:11.419258 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1496/3066] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:11.430075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-549fc2b7-0111-4c08-ae61-1a2fe6a186f3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:11.434514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-549fc2b7-0111-4c08-ae61-1a2fe6a186f3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:11.453220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-549fc2b7-0111-4c08-ae61-1a2fe6a186f3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:11.453884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-549fc2b7-0111-4c08-ae61-1a2fe6a186f3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:11.455106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-549fc2b7-0111-4c08-ae61-1a2fe6a186f3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:11.460308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-549fc2b7-0111-4c08-ae61-1a2fe6a186f3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:12.207611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-549fc2b7-0111-4c08-ae61-1a2fe6a186f3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:12.226598 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-549fc2b7-0111-4c08-ae61-1a2fe6a186f3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.800479 Feb 19 21:03:12.241425 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1497/3067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:11 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:12.256667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:12.258797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:12.274395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:12.275213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:12.276492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:12.277243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:12.361513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:12.363285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:12.364288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lazy-loading 'fault' on Instance uuid d9c832d7-1492-4fe5-8f8a-411cc1c49a74 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:03:12.517036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f534f513ef45d29629b913de461f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a67095fabac457da3239e727c92e4ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:12.574496 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-84211842-c38f-4e41-b861-1e1f3b883296 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 200 len: 1303 microversion: 2.1 time: 0.324868 Feb 19 21:03:12.580409 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1498/3068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:12 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 1303 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:12.608303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b1db60a9-4f12-4646-8749-f5505c616ec2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:12.615396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b1db60a9-4f12-4646-8749-f5505c616ec2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:12.652446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b1db60a9-4f12-4646-8749-f5505c616ec2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:12.653481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b1db60a9-4f12-4646-8749-f5505c616ec2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:12.657508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b1db60a9-4f12-4646-8749-f5505c616ec2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:12.661787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b1db60a9-4f12-4646-8749-f5505c616ec2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:13.342690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b1db60a9-4f12-4646-8749-f5505c616ec2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:13.357168 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b1db60a9-4f12-4646-8749-f5505c616ec2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1522 microversion: 2.1 time: 0.772929 Feb 19 21:03:13.363186 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1499/3069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:12 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1522 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:13.382113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1bc5fdd0-475d-4120-91a7-b24c10fd0e07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:13.387779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1bc5fdd0-475d-4120-91a7-b24c10fd0e07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:13.417681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1bc5fdd0-475d-4120-91a7-b24c10fd0e07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:13.418444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1bc5fdd0-475d-4120-91a7-b24c10fd0e07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:13.422154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1bc5fdd0-475d-4120-91a7-b24c10fd0e07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:13.422827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1bc5fdd0-475d-4120-91a7-b24c10fd0e07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:13.531927 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9118eab7-bb2f-4b17-aa33-1260e09dceed tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.075459 Feb 19 21:03:13.532973 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1571/3070] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Feb 19 21:03:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:13.538253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-247b6316-5008-43f2-a780-977858870aca tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-263342745"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:13.539649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-247b6316-5008-43f2-a780-977858870aca tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:13.548197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-247b6316-5008-43f2-a780-977858870aca tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:13.549065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-247b6316-5008-43f2-a780-977858870aca tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:13.550489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-247b6316-5008-43f2-a780-977858870aca tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:13.551177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-247b6316-5008-43f2-a780-977858870aca tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:13.820011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1bc5fdd0-475d-4120-91a7-b24c10fd0e07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:13.850813 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1bc5fdd0-475d-4120-91a7-b24c10fd0e07 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.482759 Feb 19 21:03:13.862004 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1500/3071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:13 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:13.894449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-3a822daa-c11b-44dd-b5ad-1616b788ffef req-015e4531-ccfd-470d-b2bf-f73696458729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c832d7-1492-4fe5-8f8a-411cc1c49a74", "name": "network-vif-deleted", "tag": "ef05e742-e00b-4308-af0a-e4dc13084ce0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:13.904238 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:13.904238 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:03:13.940144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3a822daa-c11b-44dd-b5ad-1616b788ffef req-015e4531-ccfd-470d-b2bf-f73696458729 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:13.943705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3a822daa-c11b-44dd-b5ad-1616b788ffef req-015e4531-ccfd-470d-b2bf-f73696458729 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:13.999921 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3a822daa-c11b-44dd-b5ad-1616b788ffef req-015e4531-ccfd-470d-b2bf-f73696458729 service nova] Creating event network-vif-deleted:ef05e742-e00b-4308-af0a-e4dc13084ce0 for instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 on nch2-master-1 Feb 19 21:03:14.015700 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-3a822daa-c11b-44dd-b5ad-1616b788ffef req-015e4531-ccfd-470d-b2bf-f73696458729 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151234 Feb 19 21:03:14.020071 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1501/3072] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:14.050030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.113"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:14.051509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:14.096872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:14.098592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:14.099555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:14.103386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:14.222404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Acquired lock "refresh_cache-1ed99b5a-d90f-48ef-bfe9-97ccd625993c" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 21:03:14.800528 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-247b6316-5008-43f2-a780-977858870aca tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action" status: 202 len: 0 microversion: 2.1 time: 1.266166 Feb 19 21:03:14.811281 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1572/3073] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:03:13 2022] POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 21:03:14.837259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00fd8fce-46ef-4060-ad07-614665d3ef44 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:14.845406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-00fd8fce-46ef-4060-ad07-614665d3ef44 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:14.911712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00fd8fce-46ef-4060-ad07-614665d3ef44 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:14.923051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00fd8fce-46ef-4060-ad07-614665d3ef44 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:14.927014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00fd8fce-46ef-4060-ad07-614665d3ef44 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:14.931051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00fd8fce-46ef-4060-ad07-614665d3ef44 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:15.004827 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-00fd8fce-46ef-4060-ad07-614665d3ef44 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] HTTP exception thrown: Instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 could not be found. Feb 19 21:03:15.005442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00fd8fce-46ef-4060-ad07-614665d3ef44 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Returning 404 to user: Instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:15.006552 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-00fd8fce-46ef-4060-ad07-614665d3ef44 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 404 len: 111 microversion: 2.1 time: 0.196824 Feb 19 21:03:15.007420 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1573/3074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:14 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:15.018255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-11c304bd-ac1d-47df-8ef7-7c550da5004c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:15.019228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-11c304bd-ac1d-47df-8ef7-7c550da5004c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:15.036133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11c304bd-ac1d-47df-8ef7-7c550da5004c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:15.037442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11c304bd-ac1d-47df-8ef7-7c550da5004c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:15.040045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11c304bd-ac1d-47df-8ef7-7c550da5004c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:15.043224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11c304bd-ac1d-47df-8ef7-7c550da5004c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:17.257252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11c304bd-ac1d-47df-8ef7-7c550da5004c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:17.305512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-11c304bd-ac1d-47df-8ef7-7c550da5004c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 2.293709 Feb 19 21:03:17.323444 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1574/3075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:15 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:17.359463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c00de5b6-1380-49ee-862a-d412f8ea62a0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1399439008"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:17.363499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c00de5b6-1380-49ee-862a-d412f8ea62a0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:17.417545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c00de5b6-1380-49ee-862a-d412f8ea62a0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:17.423657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c00de5b6-1380-49ee-862a-d412f8ea62a0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:17.429653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c00de5b6-1380-49ee-862a-d412f8ea62a0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:17.444381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c00de5b6-1380-49ee-862a-d412f8ea62a0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:17.614685 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-c00de5b6-1380-49ee-862a-d412f8ea62a0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Cannot 'createImage' instance 92321eba-8b05-4954-9660-9e95356bb6b3 while it is in task_state image_pending_upload Feb 19 21:03:17.627551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c00de5b6-1380-49ee-862a-d412f8ea62a0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 409 to user: Cannot 'createImage' instance 92321eba-8b05-4954-9660-9e95356bb6b3 while it is in task_state image_pending_upload {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:17.629482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c00de5b6-1380-49ee-862a-d412f8ea62a0 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action" status: 409 len: 165 microversion: 2.1 time: 0.287203 Feb 19 21:03:17.635543 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1575/3076] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:03:17 2022] POST /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3/action => generated 165 bytes in 311 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:03:17.650286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-19761190-1ac9-45aa-84d2-436ee8f79110 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:17.665078 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:17.665078 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:17.671874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-19761190-1ac9-45aa-84d2-436ee8f79110 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:17.676857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-19761190-1ac9-45aa-84d2-436ee8f79110 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Searching by: {'deleted': False, 'project_id': '4aca9e397c334bb997f450e919088286'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:03:17.695539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19761190-1ac9-45aa-84d2-436ee8f79110 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:17.698910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19761190-1ac9-45aa-84d2-436ee8f79110 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:17.702489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19761190-1ac9-45aa-84d2-436ee8f79110 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:17.705258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19761190-1ac9-45aa-84d2-436ee8f79110 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:17.783734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-19761190-1ac9-45aa-84d2-436ee8f79110 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:03:17.895806 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-19761190-1ac9-45aa-84d2-436ee8f79110 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.253604 Feb 19 21:03:17.896756 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1576/3077] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 21:03:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:17.927945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c9db7bfe-4a60-419b-9dd6-3a03f73a4faf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '.version_select at 0x7f6467c51790>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:18.405157 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c9db7bfe-4a60-419b-9dd6-3a03f73a4faf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/images/67bdcfc3-3ed5-45d0-92b5-7c78efe8c1bf" status: 204 len: 0 microversion: 2.1 time: 0.496880 Feb 19 21:03:18.406170 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1577/3078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:17 2022] DELETE /compute/v2.1/images/67bdcfc3-3ed5-45d0-92b5-7c78efe8c1bf => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:03:18.410665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2067029739", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "10d49579-ce64-4d24-a5f5-a01170b84f25"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:18.787857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] validate_networks() for [('10d49579-ce64-4d24-a5f5-a01170b84f25', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:03:19.727124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Building network info cache for instance {{(pid=136095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 21:03:19.938592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:03:19.939048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:03:19.939489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:03:19.940485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:03:19.941507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:03:19.974732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:19.975182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:20.007265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:20.007801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:20.062374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:03:20.076319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for user fad7207822c04fc289709200d7e2bd2d and project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:03:20.114854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:03:20.117641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:03:20.225550 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-98126ad5-5902-4c74-a38e-ea91dca72d7e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.818261 Feb 19 21:03:20.232092 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1578/3079] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:03:20.241462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:20.245618 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:20.245618 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:20.246707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:20.247469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Searching by: {'deleted': False, 'project_id': '4aca9e397c334bb997f450e919088286'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:03:20.276156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:20.286000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:20.287408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:20.288019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:20.348998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:03:20.434721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:20.455247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:20.456062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:21.098462 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-86a283fe-ed7e-4ad9-964b-12dc5af260c5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.870172 Feb 19 21:03:21.100001 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1579/3080] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 21:03:20 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:21.111616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-309af276-ac5f-4dcb-9b37-24d185c839d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:21.112547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-309af276-ac5f-4dcb-9b37-24d185c839d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:21.157443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-309af276-ac5f-4dcb-9b37-24d185c839d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:21.158285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-309af276-ac5f-4dcb-9b37-24d185c839d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:21.173958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-309af276-ac5f-4dcb-9b37-24d185c839d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:21.177331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-309af276-ac5f-4dcb-9b37-24d185c839d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:21.634239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Updating instance_info_cache with network_info: [{"id": "4a3185d0-44de-46bc-a6a9-47a19835dc9d", "address": "fa:16:3e:8d:ee:ae", "network": {"id": "e71ef3e2-ffea-48b1-add4-7381a9421313", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-497211718-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c03769052a6d4b21ad5a0dc4ce5e15fd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4a3185d0-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 21:03:21.663066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Releasing lock "refresh_cache-1ed99b5a-d90f-48ef-bfe9-97ccd625993c" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 21:03:21.664243 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-483d4aa7-e03c-4f3c-83fc-1a276d644806 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action" status: 202 len: 0 microversion: 2.1 time: 7.642728 Feb 19 21:03:21.665430 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1502/3081] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:03:14 2022] POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action => generated 0 bytes in 7645 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 21:03:21.671658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-607c4e7d-63b7-4807-abe2-8f510f056af0 req-107bb09b-b0e0-4672-84b0-03273c0f74a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed99b5a-d90f-48ef-bfe9-97ccd625993c", "tag": "4a3185d0-44de-46bc-a6a9-47a19835dc9d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:21.677270 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:21.677270 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:03:21.702267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-607c4e7d-63b7-4807-abe2-8f510f056af0 req-107bb09b-b0e0-4672-84b0-03273c0f74a0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:21.702726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-607c4e7d-63b7-4807-abe2-8f510f056af0 req-107bb09b-b0e0-4672-84b0-03273c0f74a0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:21.745777 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-607c4e7d-63b7-4807-abe2-8f510f056af0 req-107bb09b-b0e0-4672-84b0-03273c0f74a0 service nova] Creating event network-changed:4a3185d0-44de-46bc-a6a9-47a19835dc9d for instance 1ed99b5a-d90f-48ef-bfe9-97ccd625993c on nch1-master-1 Feb 19 21:03:21.761514 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-607c4e7d-63b7-4807-abe2-8f510f056af0 req-107bb09b-b0e0-4672-84b0-03273c0f74a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093790 Feb 19 21:03:21.771006 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1503/3082] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:21.791484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f1b4bde6-9f36-40fa-8747-9daef3e0bafd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:21.792250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f1b4bde6-9f36-40fa-8747-9daef3e0bafd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:21.813063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1b4bde6-9f36-40fa-8747-9daef3e0bafd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:21.814359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1b4bde6-9f36-40fa-8747-9daef3e0bafd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:21.814998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1b4bde6-9f36-40fa-8747-9daef3e0bafd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:21.815675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1b4bde6-9f36-40fa-8747-9daef3e0bafd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:22.025007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-309af276-ac5f-4dcb-9b37-24d185c839d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:22.034604 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-309af276-ac5f-4dcb-9b37-24d185c839d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1522 microversion: 2.1 time: 0.932989 Feb 19 21:03:22.038979 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1580/3083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:21 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1522 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:22.040827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f1b4bde6-9f36-40fa-8747-9daef3e0bafd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:22.049315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eb7cb41d-2558-4a14-a283-9d5123e6208e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:22.053136 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f1b4bde6-9f36-40fa-8747-9daef3e0bafd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1211 microversion: 2.1 time: 0.280665 Feb 19 21:03:22.071971 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1504/3084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:21 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1211 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:22.072202 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eb7cb41d-2558-4a14-a283-9d5123e6208e tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028564 Feb 19 21:03:22.080197 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1581/3085] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 21:03:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:22.114473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.113"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:22.121897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e242657f-c0bc-4dcf-a996-e6d78e944574 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:22.122479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e242657f-c0bc-4dcf-a996-e6d78e944574 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:22.140064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e242657f-c0bc-4dcf-a996-e6d78e944574 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:22.142572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e242657f-c0bc-4dcf-a996-e6d78e944574 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:22.147826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e242657f-c0bc-4dcf-a996-e6d78e944574 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:22.150320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e242657f-c0bc-4dcf-a996-e6d78e944574 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:22.232289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e242657f-c0bc-4dcf-a996-e6d78e944574 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:03:22.508816 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e242657f-c0bc-4dcf-a996-e6d78e944574 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 204 len: 0 microversion: 2.1 time: 0.425925 Feb 19 21:03:22.516179 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1582/3086] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:03:22 2022] DELETE /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:03:22.527585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bda221a8-b659-4c5f-b036-b49e569ea268 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:22.528212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bda221a8-b659-4c5f-b036-b49e569ea268 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:22.541133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bda221a8-b659-4c5f-b036-b49e569ea268 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:22.544238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bda221a8-b659-4c5f-b036-b49e569ea268 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:22.545132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bda221a8-b659-4c5f-b036-b49e569ea268 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:22.545582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bda221a8-b659-4c5f-b036-b49e569ea268 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:22.672276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bda221a8-b659-4c5f-b036-b49e569ea268 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:03:22.890901 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bda221a8-b659-4c5f-b036-b49e569ea268 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 204 len: 0 microversion: 2.1 time: 0.372669 Feb 19 21:03:22.891881 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1583/3087] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:03:22 2022] DELETE /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:03:22.900711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-039bb5dc-082b-44a9-aafa-b4101aab33b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:22.902278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-039bb5dc-082b-44a9-aafa-b4101aab33b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:22.916344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-039bb5dc-082b-44a9-aafa-b4101aab33b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:22.920575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-039bb5dc-082b-44a9-aafa-b4101aab33b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:22.921564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-039bb5dc-082b-44a9-aafa-b4101aab33b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:22.922191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-039bb5dc-082b-44a9-aafa-b4101aab33b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:23.366924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:23.378600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:23.379051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:23.379889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:23.380790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:24.781880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-039bb5dc-082b-44a9-aafa-b4101aab33b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:24.798432 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-039bb5dc-082b-44a9-aafa-b4101aab33b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 200 len: 1528 microversion: 2.1 time: 1.901801 Feb 19 21:03:24.799682 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1584/3088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:22 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 1528 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:25.139578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8d98dda2-b337-4969-b5ef-b4421f801220 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'create', calling method: .version_select at 0x7f6467c6f4c0>, body: {"keypair": {"name": "tempest-keypair-340226193"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:25.177996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8d98dda2-b337-4969-b5ef-b4421f801220 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:03:25.188956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8d98dda2-b337-4969-b5ef-b4421f801220 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for user a388edbf88ba4749b3abb2a42b750757 and project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:03:25.478576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Acquired lock "refresh_cache-1ed99b5a-d90f-48ef-bfe9-97ccd625993c" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 19 21:03:25.814935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8d98dda2-b337-4969-b5ef-b4421f801220 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:03:25.831582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8d98dda2-b337-4969-b5ef-b4421f801220 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for user a388edbf88ba4749b3abb2a42b750757 and project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:03:25.867099 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8d98dda2-b337-4969-b5ef-b4421f801220 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.065686 Feb 19 21:03:25.868137 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1585/3089] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Feb 19 21:03:24 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1068 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:03:25.881725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c226c8b1-76a5-41fd-8769-193121ff74d5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:25.885237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c226c8b1-76a5-41fd-8769-193121ff74d5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:25.921320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c226c8b1-76a5-41fd-8769-193121ff74d5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:25.924967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c226c8b1-76a5-41fd-8769-193121ff74d5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:25.928951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c226c8b1-76a5-41fd-8769-193121ff74d5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:25.932604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c226c8b1-76a5-41fd-8769-193121ff74d5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:27.530455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c226c8b1-76a5-41fd-8769-193121ff74d5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:27.544922 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c226c8b1-76a5-41fd-8769-193121ff74d5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1607 microversion: 2.1 time: 1.672936 Feb 19 21:03:27.545914 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1586/3090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:25 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1607 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:27.550800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ce5e4be-c38b-4045-af4f-c908c1a9ff24 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:27.561289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ce5e4be-c38b-4045-af4f-c908c1a9ff24 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:27.567784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ce5e4be-c38b-4045-af4f-c908c1a9ff24 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:27.568238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ce5e4be-c38b-4045-af4f-c908c1a9ff24 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:27.569052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ce5e4be-c38b-4045-af4f-c908c1a9ff24 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:27.572596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ce5e4be-c38b-4045-af4f-c908c1a9ff24 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:28.597548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ce5e4be-c38b-4045-af4f-c908c1a9ff24 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:28.626772 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ce5e4be-c38b-4045-af4f-c908c1a9ff24 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1315 microversion: 2.1 time: 1.079186 Feb 19 21:03:28.627454 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1587/3091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:27 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1315 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:28.632510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-bc3d8f96-7029-424c-9b1e-b65684c8800c req-e816bf64-335f-47fb-9434-c023dee499d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92321eba-8b05-4954-9660-9e95356bb6b3", "name": "network-vif-plugged", "status": "completed", "tag": "1a064e13-3fb5-4649-98d7-8b53f8bf8480"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:28.638201 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:28.638201 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:28.656067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bc3d8f96-7029-424c-9b1e-b65684c8800c req-e816bf64-335f-47fb-9434-c023dee499d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:28.663540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bc3d8f96-7029-424c-9b1e-b65684c8800c req-e816bf64-335f-47fb-9434-c023dee499d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:28.684922 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-bc3d8f96-7029-424c-9b1e-b65684c8800c req-e816bf64-335f-47fb-9434-c023dee499d9 service nova] Creating event network-vif-plugged:1a064e13-3fb5-4649-98d7-8b53f8bf8480 for instance 92321eba-8b05-4954-9660-9e95356bb6b3 on nch1-master-1 Feb 19 21:03:28.694430 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-bc3d8f96-7029-424c-9b1e-b65684c8800c req-e816bf64-335f-47fb-9434-c023dee499d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065388 Feb 19 21:03:28.703647 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1588/3092] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:28.709191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c455de90-3b2f-4a3f-9b1e-df82dfb45125 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:28.716373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c455de90-3b2f-4a3f-9b1e-df82dfb45125 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:28.728385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c455de90-3b2f-4a3f-9b1e-df82dfb45125 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:28.729221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c455de90-3b2f-4a3f-9b1e-df82dfb45125 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:28.730731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c455de90-3b2f-4a3f-9b1e-df82dfb45125 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:28.731367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c455de90-3b2f-4a3f-9b1e-df82dfb45125 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:28.769704 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-c455de90-3b2f-4a3f-9b1e-df82dfb45125 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Instance 92321eba-8b05-4954-9660-9e95356bb6b3 could not be found. Feb 19 21:03:28.770627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c455de90-3b2f-4a3f-9b1e-df82dfb45125 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Instance 92321eba-8b05-4954-9660-9e95356bb6b3 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:28.771680 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c455de90-3b2f-4a3f-9b1e-df82dfb45125 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 404 len: 111 microversion: 2.1 time: 0.066466 Feb 19 21:03:28.777455 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1589/3093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:28 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:28.785476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f5cc2d65-541e-4b09-9ed9-2397b6085b53 req-8b6cdb2e-bbcc-4f9c-929b-39a33f8f6a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92321eba-8b05-4954-9660-9e95356bb6b3", "name": "network-vif-deleted", "tag": "1a064e13-3fb5-4649-98d7-8b53f8bf8480"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:28.795119 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:28.795119 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:28.806896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f5cc2d65-541e-4b09-9ed9-2397b6085b53 req-8b6cdb2e-bbcc-4f9c-929b-39a33f8f6a8c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:28.812315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f5cc2d65-541e-4b09-9ed9-2397b6085b53 req-8b6cdb2e-bbcc-4f9c-929b-39a33f8f6a8c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:28.841305 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f5cc2d65-541e-4b09-9ed9-2397b6085b53 req-8b6cdb2e-bbcc-4f9c-929b-39a33f8f6a8c service nova] Creating event network-vif-deleted:1a064e13-3fb5-4649-98d7-8b53f8bf8480 for instance 92321eba-8b05-4954-9660-9e95356bb6b3 on nch1-master-1 Feb 19 21:03:28.850227 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f5cc2d65-541e-4b09-9ed9-2397b6085b53 req-8b6cdb2e-bbcc-4f9c-929b-39a33f8f6a8c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071145 Feb 19 21:03:28.853495 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1590/3094] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:28.869060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-efa64e5e-5d05-428a-be30-9a9ffa74cab2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:28.870192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-efa64e5e-5d05-428a-be30-9a9ffa74cab2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:28.884611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efa64e5e-5d05-428a-be30-9a9ffa74cab2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:28.885411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efa64e5e-5d05-428a-be30-9a9ffa74cab2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:28.886978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efa64e5e-5d05-428a-be30-9a9ffa74cab2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:28.887616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efa64e5e-5d05-428a-be30-9a9ffa74cab2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:29.167333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-efa64e5e-5d05-428a-be30-9a9ffa74cab2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36b20fc4b8b4b71aea23626d52cefa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aca9e397c334bb997f450e919088286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:29.181143 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-efa64e5e-5d05-428a-be30-9a9ffa74cab2 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 200 len: 1540 microversion: 2.1 time: 0.325643 Feb 19 21:03:29.183310 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1591/3095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:28 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 1540 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:29.191123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-28e411c0-4c38-48a1-a79b-545bc8c3aedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'create', calling method: .version_select at 0x7f6467c3e670>, body: {"keypair": {"name": "tempest-keypair-832389035"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:29.216340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-28e411c0-4c38-48a1-a79b-545bc8c3aedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for project 8d34faf6add7400690171f1d097d5f2c. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:03:29.223118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-28e411c0-4c38-48a1-a79b-545bc8c3aedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for user 5b13848e363e44b9927525ca9ca6fe81 and project 8d34faf6add7400690171f1d097d5f2c. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:03:29.458795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-28e411c0-4c38-48a1-a79b-545bc8c3aedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for project 8d34faf6add7400690171f1d097d5f2c. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:03:29.469191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-28e411c0-4c38-48a1-a79b-545bc8c3aedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for user 5b13848e363e44b9927525ca9ca6fe81 and project 8d34faf6add7400690171f1d097d5f2c. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:03:29.506663 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-28e411c0-4c38-48a1-a79b-545bc8c3aedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.321829 Feb 19 21:03:29.507527 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1592/3096] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:03:29 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:29.525485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-79eb184f-b872-4cb5-9a14-33a751142f1f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:29.529769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-79eb184f-b872-4cb5-9a14-33a751142f1f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:29.544922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79eb184f-b872-4cb5-9a14-33a751142f1f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:29.545927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79eb184f-b872-4cb5-9a14-33a751142f1f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:29.548100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79eb184f-b872-4cb5-9a14-33a751142f1f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:29.549415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79eb184f-b872-4cb5-9a14-33a751142f1f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:29.614769 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-79eb184f-b872-4cb5-9a14-33a751142f1f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] HTTP exception thrown: Instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 could not be found. Feb 19 21:03:29.616386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-79eb184f-b872-4cb5-9a14-33a751142f1f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Returning 404 to user: Instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:29.619775 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-79eb184f-b872-4cb5-9a14-33a751142f1f tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 404 len: 111 microversion: 2.1 time: 0.111104 Feb 19 21:03:29.623690 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1593/3097] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:03:29 2022] DELETE /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:29.643452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9458394c-2370-4f21-a4a3-2c8af919af2e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:29.649331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9458394c-2370-4f21-a4a3-2c8af919af2e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: d9c832d7-1492-4fe5-8f8a-411cc1c49a74] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:29.670118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9458394c-2370-4f21-a4a3-2c8af919af2e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:29.675824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9458394c-2370-4f21-a4a3-2c8af919af2e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:29.677056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9458394c-2370-4f21-a4a3-2c8af919af2e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:29.677664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9458394c-2370-4f21-a4a3-2c8af919af2e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:29.714842 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-9458394c-2370-4f21-a4a3-2c8af919af2e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] HTTP exception thrown: Instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 could not be found. Feb 19 21:03:29.720049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9458394c-2370-4f21-a4a3-2c8af919af2e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Returning 404 to user: Instance d9c832d7-1492-4fe5-8f8a-411cc1c49a74 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:29.721263 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9458394c-2370-4f21-a4a3-2c8af919af2e tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74" status: 404 len: 111 microversion: 2.1 time: 0.093466 Feb 19 21:03:29.724548 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1594/3098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:29 2022] GET /compute/v2.1/servers/d9c832d7-1492-4fe5-8f8a-411cc1c49a74 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:29.741867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7bd18b67-04f7-4257-bed6-01f80f044aaf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:29.743210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7bd18b67-04f7-4257-bed6-01f80f044aaf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:29.752635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bd18b67-04f7-4257-bed6-01f80f044aaf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:29.753107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bd18b67-04f7-4257-bed6-01f80f044aaf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:29.761727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bd18b67-04f7-4257-bed6-01f80f044aaf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:29.771525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bd18b67-04f7-4257-bed6-01f80f044aaf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:31.483066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Building network info cache for instance {{(pid=136095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 19 21:03:31.695098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7bd18b67-04f7-4257-bed6-01f80f044aaf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:31.707625 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7bd18b67-04f7-4257-bed6-01f80f044aaf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1315 microversion: 2.1 time: 1.981757 Feb 19 21:03:31.708880 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1595/3099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:29 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1315 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:31.716530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1aa46a78-6c5f-4c2b-a3af-29cd91b6be23 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:31.717302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1aa46a78-6c5f-4c2b-a3af-29cd91b6be23 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:31.727029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1aa46a78-6c5f-4c2b-a3af-29cd91b6be23 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:31.727974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1aa46a78-6c5f-4c2b-a3af-29cd91b6be23 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:31.729001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1aa46a78-6c5f-4c2b-a3af-29cd91b6be23 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:31.730184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1aa46a78-6c5f-4c2b-a3af-29cd91b6be23 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:31.765247 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-1aa46a78-6c5f-4c2b-a3af-29cd91b6be23 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] HTTP exception thrown: Instance 457783d2-8dc2-4522-80cf-081a6a013e17 could not be found. Feb 19 21:03:31.766233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1aa46a78-6c5f-4c2b-a3af-29cd91b6be23 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Returning 404 to user: Instance 457783d2-8dc2-4522-80cf-081a6a013e17 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:31.767443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1aa46a78-6c5f-4c2b-a3af-29cd91b6be23 tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "DELETE /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 404 len: 111 microversion: 2.1 time: 0.057358 Feb 19 21:03:31.768561 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1596/3100] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:03:31 2022] DELETE /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:31.773358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-da9b468f-b23b-4a9a-b180-b8eb32b1b1e5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:31.774369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-da9b468f-b23b-4a9a-b180-b8eb32b1b1e5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] [instance: 9440fe13-0931-4b97-a7cb-ec215645eb5a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:31.782822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da9b468f-b23b-4a9a-b180-b8eb32b1b1e5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:31.783752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da9b468f-b23b-4a9a-b180-b8eb32b1b1e5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:31.785396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da9b468f-b23b-4a9a-b180-b8eb32b1b1e5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:31.786280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da9b468f-b23b-4a9a-b180-b8eb32b1b1e5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:31.836267 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-da9b468f-b23b-4a9a-b180-b8eb32b1b1e5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] HTTP exception thrown: Instance 9440fe13-0931-4b97-a7cb-ec215645eb5a could not be found. Feb 19 21:03:31.836907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-da9b468f-b23b-4a9a-b180-b8eb32b1b1e5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Returning 404 to user: Instance 9440fe13-0931-4b97-a7cb-ec215645eb5a could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:31.837937 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-da9b468f-b23b-4a9a-b180-b8eb32b1b1e5 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a" status: 404 len: 111 microversion: 2.1 time: 0.068042 Feb 19 21:03:31.842017 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1597/3101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:31 2022] GET /compute/v2.1/servers/9440fe13-0931-4b97-a7cb-ec215645eb5a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:31.846737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-247e0309-2bda-4ff1-a633-928764511708 req-97462c6f-0f75-450a-843a-95441ca997b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92321eba-8b05-4954-9660-9e95356bb6b3", "name": "network-vif-unplugged", "status": "completed", "tag": "1a064e13-3fb5-4649-98d7-8b53f8bf8480"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:31.848739 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:31.848739 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:31.856740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-247e0309-2bda-4ff1-a633-928764511708 req-97462c6f-0f75-450a-843a-95441ca997b2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:31.857420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-247e0309-2bda-4ff1-a633-928764511708 req-97462c6f-0f75-450a-843a-95441ca997b2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:31.873009 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-247e0309-2bda-4ff1-a633-928764511708 req-97462c6f-0f75-450a-843a-95441ca997b2 service nova] Creating event network-vif-unplugged:1a064e13-3fb5-4649-98d7-8b53f8bf8480 for instance 92321eba-8b05-4954-9660-9e95356bb6b3 on nch1-master-1 Feb 19 21:03:31.879159 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-247e0309-2bda-4ff1-a633-928764511708 req-97462c6f-0f75-450a-843a-95441ca997b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035861 Feb 19 21:03:31.880475 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1598/3102] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:31.887227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4c39a641-b7d2-4ec6-bf00-9e820f5de669 req-81b70c6b-2042-4410-8fe8-0ab778998732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9440fe13-0931-4b97-a7cb-ec215645eb5a", "name": "network-vif-deleted", "tag": "5522f49c-1f87-419c-bb79-a02284fc44b4"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:31.889232 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:31.889232 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:31.897368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4c39a641-b7d2-4ec6-bf00-9e820f5de669 req-81b70c6b-2042-4410-8fe8-0ab778998732 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:31.897817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4c39a641-b7d2-4ec6-bf00-9e820f5de669 req-81b70c6b-2042-4410-8fe8-0ab778998732 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:31.913197 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4c39a641-b7d2-4ec6-bf00-9e820f5de669 req-81b70c6b-2042-4410-8fe8-0ab778998732 service nova] Creating event network-vif-deleted:5522f49c-1f87-419c-bb79-a02284fc44b4 for instance 9440fe13-0931-4b97-a7cb-ec215645eb5a on nch2-master-1 Feb 19 21:03:31.921767 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4c39a641-b7d2-4ec6-bf00-9e820f5de669 req-81b70c6b-2042-4410-8fe8-0ab778998732 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039534 Feb 19 21:03:31.924675 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1599/3103] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:31.930194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b66a1fb3-bed2-467e-891f-5ff41fd25e9e req-2b444103-4a65-4f2c-beb3-ba91fff054b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed99b5a-d90f-48ef-bfe9-97ccd625993c", "tag": "4a3185d0-44de-46bc-a6a9-47a19835dc9d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:31.931770 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:31.931770 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:31.940287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b66a1fb3-bed2-467e-891f-5ff41fd25e9e req-2b444103-4a65-4f2c-beb3-ba91fff054b7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:31.940819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b66a1fb3-bed2-467e-891f-5ff41fd25e9e req-2b444103-4a65-4f2c-beb3-ba91fff054b7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:31.953355 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b66a1fb3-bed2-467e-891f-5ff41fd25e9e req-2b444103-4a65-4f2c-beb3-ba91fff054b7 service nova] Creating event network-changed:4a3185d0-44de-46bc-a6a9-47a19835dc9d for instance 1ed99b5a-d90f-48ef-bfe9-97ccd625993c on nch1-master-1 Feb 19 21:03:31.958835 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b66a1fb3-bed2-467e-891f-5ff41fd25e9e req-2b444103-4a65-4f2c-beb3-ba91fff054b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032706 Feb 19 21:03:31.959715 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1600/3104] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:31.966363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cede7ba0-6939-4dc5-9205-f6438a7fe19c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:31.967655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cede7ba0-6939-4dc5-9205-f6438a7fe19c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] [instance: 457783d2-8dc2-4522-80cf-081a6a013e17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:31.975748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cede7ba0-6939-4dc5-9205-f6438a7fe19c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:31.976503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cede7ba0-6939-4dc5-9205-f6438a7fe19c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:31.977674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cede7ba0-6939-4dc5-9205-f6438a7fe19c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:31.978302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cede7ba0-6939-4dc5-9205-f6438a7fe19c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:32.002854 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-cede7ba0-6939-4dc5-9205-f6438a7fe19c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] HTTP exception thrown: Instance 457783d2-8dc2-4522-80cf-081a6a013e17 could not be found. Feb 19 21:03:32.003743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cede7ba0-6939-4dc5-9205-f6438a7fe19c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] Returning 404 to user: Instance 457783d2-8dc2-4522-80cf-081a6a013e17 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:32.005222 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cede7ba0-6939-4dc5-9205-f6438a7fe19c tempest-ServersTestMultiNic-1940779768 tempest-ServersTestMultiNic-1940779768-project] 10.222.0.30 "GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17" status: 404 len: 111 microversion: 2.1 time: 0.043702 Feb 19 21:03:32.006564 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1601/3105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:31 2022] GET /compute/v2.1/servers/457783d2-8dc2-4522-80cf-081a6a013e17 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:32.018510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d930394-b0cd-416f-bff9-8a03b52fea89 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] Calling method '.version_select at 0x7f6467bfe940>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:32.054253 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d930394-b0cd-416f-bff9-8a03b52fea89 tempest-ServersTestBootFromVolume-953145761 tempest-ServersTestBootFromVolume-953145761-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175642816" status: 202 len: 0 microversion: 2.1 time: 0.045973 Feb 19 21:03:32.059389 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1602/3106] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:03:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175642816 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:03:32.733316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bf717b93-8e20-42af-af7c-f33177c8ffad tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:32.734174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bf717b93-8e20-42af-af7c-f33177c8ffad tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:32.757403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf717b93-8e20-42af-af7c-f33177c8ffad tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:32.758564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf717b93-8e20-42af-af7c-f33177c8ffad tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:32.761480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf717b93-8e20-42af-af7c-f33177c8ffad tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:32.771011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf717b93-8e20-42af-af7c-f33177c8ffad tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:33.969452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Updating instance_info_cache with network_info: [{"id": "4a3185d0-44de-46bc-a6a9-47a19835dc9d", "address": "fa:16:3e:8d:ee:ae", "network": {"id": "e71ef3e2-ffea-48b1-add4-7381a9421313", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-497211718-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c03769052a6d4b21ad5a0dc4ce5e15fd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4a3185d0-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 21:03:33.981724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Releasing lock "refresh_cache-1ed99b5a-d90f-48ef-bfe9-97ccd625993c" {{(pid=136095) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 19 21:03:33.982849 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6ebba2e1-a0f2-48dd-b334-9d4e31459cb7 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action" status: 202 len: 0 microversion: 2.1 time: 11.915639 Feb 19 21:03:33.983671 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1505/3107] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:03:22 2022] POST /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c/action => generated 0 bytes in 11919 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 21:03:33.995345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5555d7c1-6b42-45c7-abf0-a8d331a07b63 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '.version_select at 0x7f6479140280>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:34.015954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bf717b93-8e20-42af-af7c-f33177c8ffad tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:34.025576 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bf717b93-8e20-42af-af7c-f33177c8ffad tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1315 microversion: 2.1 time: 1.296035 Feb 19 21:03:34.041112 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1603/3108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:32 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1315 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:34.125409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d4f05e37-9d13-4ba8-b8c3-6e89033796c7 req-62b847ad-6d68-48f2-93ee-f3f96493e095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e428fbc5-f80a-4990-810a-97c7cbf53246", "tag": "c58eb122-6243-45f8-9077-813f02b7493e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:34.128247 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:34.128247 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:34.148533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d4f05e37-9d13-4ba8-b8c3-6e89033796c7 req-62b847ad-6d68-48f2-93ee-f3f96493e095 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:34.151849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d4f05e37-9d13-4ba8-b8c3-6e89033796c7 req-62b847ad-6d68-48f2-93ee-f3f96493e095 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:34.178434 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d4f05e37-9d13-4ba8-b8c3-6e89033796c7 req-62b847ad-6d68-48f2-93ee-f3f96493e095 service nova] Creating event network-changed:c58eb122-6243-45f8-9077-813f02b7493e for instance e428fbc5-f80a-4990-810a-97c7cbf53246 on nch2-master-1 Feb 19 21:03:34.193711 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d4f05e37-9d13-4ba8-b8c3-6e89033796c7 req-62b847ad-6d68-48f2-93ee-f3f96493e095 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075079 Feb 19 21:03:34.194928 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1604/3109] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:03:35.048836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5280d06a-d948-44f8-ab68-586af550a9f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:35.050412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5280d06a-d948-44f8-ab68-586af550a9f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:35.059867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5280d06a-d948-44f8-ab68-586af550a9f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:35.060677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5280d06a-d948-44f8-ab68-586af550a9f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:35.062113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5280d06a-d948-44f8-ab68-586af550a9f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:35.062766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5280d06a-d948-44f8-ab68-586af550a9f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:36.313401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5280d06a-d948-44f8-ab68-586af550a9f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:36.326266 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5280d06a-d948-44f8-ab68-586af550a9f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1315 microversion: 2.1 time: 1.280979 Feb 19 21:03:36.328876 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1605/3110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:35 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1315 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:03:36.335533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1913975170", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0af9030-e395-43f9-8a34-dbc361fa9146"}], "security_groups": [{"name": "tempest-securitygroup--1279680771"}], "key_name": "tempest-keypair-340226193", "user_data": "}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:36.572873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] validate_networks() for [('b0af9030-e395-43f9-8a34-dbc361fa9146', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:03:38.322358 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5555d7c1-6b42-45c7-abf0-a8d331a07b63 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/9037e30c-df5a-4376-867f-50332a6baeb3" status: 202 len: 0 microversion: 2.1 time: 4.334238 Feb 19 21:03:38.325330 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1506/3111] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 21:03:33 2022] DELETE /compute/v2.1/os-floating-ips/9037e30c-df5a-4376-867f-50332a6baeb3 => generated 0 bytes in 4338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:03:38.334782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-114851725", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:38.442447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:03:38.443640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:03:38.444283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:03:38.444900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:03:38.445494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:03:38.452684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] validate_networks() for [('0ece0e80-c125-4eb8-a568-1d9e97f806cd', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:03:38.469563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:38.473310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:38.475051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:38.475664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:38.521863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:03:38.539238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for user a388edbf88ba4749b3abb2a42b750757 and project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:03:38.586285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:03:38.589360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:03:38.703091 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d2a28a95-842b-4aca-892b-6530b7bf64ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.371941 Feb 19 21:03:38.703742 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1606/3112] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 21:03:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 21:03:38.713143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-73f78022-b172-4510-908d-681d35f646d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:38.714315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-73f78022-b172-4510-908d-681d35f646d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:38.720588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73f78022-b172-4510-908d-681d35f646d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:38.721316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73f78022-b172-4510-908d-681d35f646d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:38.722303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73f78022-b172-4510-908d-681d35f646d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:38.722905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73f78022-b172-4510-908d-681d35f646d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:39.401008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-73f78022-b172-4510-908d-681d35f646d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:39.411354 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-73f78022-b172-4510-908d-681d35f646d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1315 microversion: 2.1 time: 0.707016 Feb 19 21:03:39.419029 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1607/3113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:38 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:39.430289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b1bead4-e5b0-4027-a29b-0dcb2dbb7b96 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '.version_select at 0x7f6467a12b80>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:39.496864 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:03:39.497817 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 21:03:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Feb 19 21:03:40.093110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:03:40.093942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:03:40.094636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:03:40.095268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:03:40.095906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:03:40.114670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:40.121319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:40.122385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:40.122923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:40.199671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for project 8d34faf6add7400690171f1d097d5f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:03:40.218771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for user 5b13848e363e44b9927525ca9ca6fe81 and project 8d34faf6add7400690171f1d097d5f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:03:40.262440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:03:40.275338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:03:40.337271 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b1bead4-e5b0-4027-a29b-0dcb2dbb7b96 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/3f7984a6-e7a6-4e8e-9ea7-f774878149d3" status: 202 len: 0 microversion: 2.1 time: 0.916698 Feb 19 21:03:40.338097 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1608/3114] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:03:39 2022] DELETE /compute/v2.1/os-security-groups/3f7984a6-e7a6-4e8e-9ea7-f774878149d3 => generated 0 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:03:40.347261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:40.348177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:40.370751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:40.377065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:40.379986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:40.381799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:40.418139 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0afee9d3-f5ab-4e6e-a839-cf251ade0693 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.090859 Feb 19 21:03:40.419639 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1507/3115] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:03:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:03:40.439861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e37be162-2c7f-4734-a6dc-e2e1f2492c62 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:40.453826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e37be162-2c7f-4734-a6dc-e2e1f2492c62 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:40.480835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e37be162-2c7f-4734-a6dc-e2e1f2492c62 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:40.485328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e37be162-2c7f-4734-a6dc-e2e1f2492c62 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:40.486189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e37be162-2c7f-4734-a6dc-e2e1f2492c62 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:40.486629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e37be162-2c7f-4734-a6dc-e2e1f2492c62 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:40.581473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e37be162-2c7f-4734-a6dc-e2e1f2492c62 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:03:40.755043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:40.765783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:40.771648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:40.778657 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5bf58ca5-a736-47f5-8ebe-085f0c102d8b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1333 microversion: 2.20 time: 0.434958 Feb 19 21:03:40.783811 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1609/3116] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:40 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1333 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:40.802859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f67c3b69-e0ed-4398-85d9-64cd2ba32568 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:40.815463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f67c3b69-e0ed-4398-85d9-64cd2ba32568 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:40.875097 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e37be162-2c7f-4734-a6dc-e2e1f2492c62 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 204 len: 0 microversion: 2.1 time: 0.445947 Feb 19 21:03:40.878301 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1508/3117] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:03:40 2022] DELETE /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:03:40.900360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6215a6ac-2e2e-474d-8fdc-f7cbfcd76d72 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:40.906829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6215a6ac-2e2e-474d-8fdc-f7cbfcd76d72 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:40.916373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6215a6ac-2e2e-474d-8fdc-f7cbfcd76d72 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:40.920548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6215a6ac-2e2e-474d-8fdc-f7cbfcd76d72 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:40.921578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6215a6ac-2e2e-474d-8fdc-f7cbfcd76d72 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:40.922063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6215a6ac-2e2e-474d-8fdc-f7cbfcd76d72 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:41.047137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f67c3b69-e0ed-4398-85d9-64cd2ba32568 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:41.066176 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f67c3b69-e0ed-4398-85d9-64cd2ba32568 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1224 microversion: 2.1 time: 0.269179 Feb 19 21:03:41.112868 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1610/3118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:40 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1224 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:41.119918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cc7e7c22-7aa5-484c-adf6-9feb1a6e84f8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:41.125361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cc7e7c22-7aa5-484c-adf6-9feb1a6e84f8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:41.144246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc7e7c22-7aa5-484c-adf6-9feb1a6e84f8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:41.146911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc7e7c22-7aa5-484c-adf6-9feb1a6e84f8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:41.153916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc7e7c22-7aa5-484c-adf6-9feb1a6e84f8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:41.154849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc7e7c22-7aa5-484c-adf6-9feb1a6e84f8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:42.609393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6215a6ac-2e2e-474d-8fdc-f7cbfcd76d72 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:42.644399 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6215a6ac-2e2e-474d-8fdc-f7cbfcd76d72 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1315 microversion: 2.1 time: 1.757401 Feb 19 21:03:42.650083 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1509/3119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:40 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1315 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:42.685599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:42.696539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:42.743914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:42.745916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:42.751607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:42.752969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:42.865231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cc7e7c22-7aa5-484c-adf6-9feb1a6e84f8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:42.913086 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cc7e7c22-7aa5-484c-adf6-9feb1a6e84f8 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1509 microversion: 2.1 time: 1.797230 Feb 19 21:03:42.913762 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1611/3120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:41 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1509 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:42.935542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5bcbbfad-c0ac-4e77-8fe9-2f7020422769 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:42.939718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5bcbbfad-c0ac-4e77-8fe9-2f7020422769 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:42.954518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bcbbfad-c0ac-4e77-8fe9-2f7020422769 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:42.955278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bcbbfad-c0ac-4e77-8fe9-2f7020422769 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:42.958330 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bcbbfad-c0ac-4e77-8fe9-2f7020422769 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:42.958996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bcbbfad-c0ac-4e77-8fe9-2f7020422769 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:43.144117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:43.164382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:43.164874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5bcbbfad-c0ac-4e77-8fe9-2f7020422769 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:43.166807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:43.172628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8575d877-1f8f-4b2f-b0b9-d75ff3d0343b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1339 microversion: 2.20 time: 0.520618 Feb 19 21:03:43.175308 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1510/3121] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:42 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1339 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:43.186529 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5bcbbfad-c0ac-4e77-8fe9-2f7020422769 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1282 microversion: 2.1 time: 0.267857 Feb 19 21:03:43.187387 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1612/3122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:42 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1282 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:43.675655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f49f0936-2a9c-41ce-9812-1eb31a4c4b3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:43.676293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f49f0936-2a9c-41ce-9812-1eb31a4c4b3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:43.689936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f49f0936-2a9c-41ce-9812-1eb31a4c4b3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:43.692443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f49f0936-2a9c-41ce-9812-1eb31a4c4b3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:43.693553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f49f0936-2a9c-41ce-9812-1eb31a4c4b3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:43.696060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f49f0936-2a9c-41ce-9812-1eb31a4c4b3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:43.930900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d95592c-2032-42c3-b5dd-8bb83de87b5b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:43.931528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1d95592c-2032-42c3-b5dd-8bb83de87b5b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:43.942244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d95592c-2032-42c3-b5dd-8bb83de87b5b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:43.942723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d95592c-2032-42c3-b5dd-8bb83de87b5b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:43.943547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d95592c-2032-42c3-b5dd-8bb83de87b5b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:43.957121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d95592c-2032-42c3-b5dd-8bb83de87b5b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:45.168122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f49f0936-2a9c-41ce-9812-1eb31a4c4b3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:45.186861 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f49f0936-2a9c-41ce-9812-1eb31a4c4b3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1315 microversion: 2.1 time: 1.508463 Feb 19 21:03:45.202024 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1511/3123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:43 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1315 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:45.207481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:45.208507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:45.249867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:45.251626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:45.258695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:45.265931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:45.463390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d95592c-2032-42c3-b5dd-8bb83de87b5b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:45.476449 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d95592c-2032-42c3-b5dd-8bb83de87b5b tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1509 microversion: 2.1 time: 1.545496 Feb 19 21:03:45.477728 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1613/3124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:43 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1509 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:45.496022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4a7d4301-c470-43f5-a06f-6277e6c37639 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:45.497329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4a7d4301-c470-43f5-a06f-6277e6c37639 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:45.507331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a7d4301-c470-43f5-a06f-6277e6c37639 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:45.508271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a7d4301-c470-43f5-a06f-6277e6c37639 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:45.509651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a7d4301-c470-43f5-a06f-6277e6c37639 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:45.510893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a7d4301-c470-43f5-a06f-6277e6c37639 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:45.723561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a7d4301-c470-43f5-a06f-6277e6c37639 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:45.735421 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4a7d4301-c470-43f5-a06f-6277e6c37639 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1282 microversion: 2.1 time: 0.256122 Feb 19 21:03:45.740777 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1614/3125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:45 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1282 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:45.750768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9ce92c7d-dfb3-4dc4-9d8e-d0b117b70f92 req-c6719d0c-f36b-4b00-9c36-b9c9638942f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e428fbc5-f80a-4990-810a-97c7cbf53246", "name": "network-vif-plugged", "status": "completed", "tag": "c58eb122-6243-45f8-9077-813f02b7493e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:45.758508 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:45.758508 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:45.768507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9ce92c7d-dfb3-4dc4-9d8e-d0b117b70f92 req-c6719d0c-f36b-4b00-9c36-b9c9638942f8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:45.769714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9ce92c7d-dfb3-4dc4-9d8e-d0b117b70f92 req-c6719d0c-f36b-4b00-9c36-b9c9638942f8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:45.791144 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9ce92c7d-dfb3-4dc4-9d8e-d0b117b70f92 req-c6719d0c-f36b-4b00-9c36-b9c9638942f8 service nova] Creating event network-vif-plugged:c58eb122-6243-45f8-9077-813f02b7493e for instance e428fbc5-f80a-4990-810a-97c7cbf53246 on nch2-master-1 Feb 19 21:03:45.804629 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9ce92c7d-dfb3-4dc4-9d8e-d0b117b70f92 req-c6719d0c-f36b-4b00-9c36-b9c9638942f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060503 Feb 19 21:03:45.806273 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1615/3126] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:46.214027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2046962a-a02f-4493-a6ba-cd684401422d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:46.214775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2046962a-a02f-4493-a6ba-cd684401422d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:46.243846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2046962a-a02f-4493-a6ba-cd684401422d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:46.244305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2046962a-a02f-4493-a6ba-cd684401422d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:46.249737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2046962a-a02f-4493-a6ba-cd684401422d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:46.251050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2046962a-a02f-4493-a6ba-cd684401422d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:46.362946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:46.381793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:46.391542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:46.396863 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-326b3605-cc16-497c-b4bc-bb23ecb3f519 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1407 microversion: 2.20 time: 1.192852 Feb 19 21:03:46.400270 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1512/3127] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:45 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1407 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:46.517052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-91b3dce2-d9a5-45d1-b1c5-da7bff9903f1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:46.518357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-91b3dce2-d9a5-45d1-b1c5-da7bff9903f1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:46.534462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91b3dce2-d9a5-45d1-b1c5-da7bff9903f1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:46.535541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91b3dce2-d9a5-45d1-b1c5-da7bff9903f1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:46.537362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91b3dce2-d9a5-45d1-b1c5-da7bff9903f1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:46.539162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91b3dce2-d9a5-45d1-b1c5-da7bff9903f1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:48.184806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2046962a-a02f-4493-a6ba-cd684401422d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:48.221052 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2046962a-a02f-4493-a6ba-cd684401422d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1315 microversion: 2.1 time: 2.018697 Feb 19 21:03:48.223272 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1616/3128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:46 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1315 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:03:48.236749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f3e9fcaa-6e24-4d85-ad76-a0d058e40f42 req-742d0672-10bb-487a-9ef6-436c0a40fd53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17524174-4cfd-409a-b6f4-15bde7d2c4d1", "tag": "2caf0c43-e8a7-47e8-a90c-390f3b45d82b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:48.239065 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:48.239065 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:48.266100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f3e9fcaa-6e24-4d85-ad76-a0d058e40f42 req-742d0672-10bb-487a-9ef6-436c0a40fd53 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:48.266628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f3e9fcaa-6e24-4d85-ad76-a0d058e40f42 req-742d0672-10bb-487a-9ef6-436c0a40fd53 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:48.280403 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f3e9fcaa-6e24-4d85-ad76-a0d058e40f42 req-742d0672-10bb-487a-9ef6-436c0a40fd53 service nova] Creating event network-changed:2caf0c43-e8a7-47e8-a90c-390f3b45d82b for instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 on nch1-master-1 Feb 19 21:03:48.286881 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f3e9fcaa-6e24-4d85-ad76-a0d058e40f42 req-742d0672-10bb-487a-9ef6-436c0a40fd53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057107 Feb 19 21:03:48.288402 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1617/3129] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:48.295635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-09f405d8-4307-42fb-882e-1e0d470249d6 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:48.296649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-09f405d8-4307-42fb-882e-1e0d470249d6 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:48.299181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91b3dce2-d9a5-45d1-b1c5-da7bff9903f1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f073c8403c445029976989a1848060f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03769052a6d4b21ad5a0dc4ce5e15fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:48.311358 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-91b3dce2-d9a5-45d1-b1c5-da7bff9903f1 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 200 len: 1509 microversion: 2.1 time: 1.818887 Feb 19 21:03:48.324492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09f405d8-4307-42fb-882e-1e0d470249d6 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:48.326426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09f405d8-4307-42fb-882e-1e0d470249d6 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:48.327075 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1513/3130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:46 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 1509 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:48.327890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09f405d8-4307-42fb-882e-1e0d470249d6 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:48.329037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-09f405d8-4307-42fb-882e-1e0d470249d6 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:48.333688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:48.335320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:48.353264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:48.354044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:48.354865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:48.355309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:49.014229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-09f405d8-4307-42fb-882e-1e0d470249d6 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:49.024621 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-09f405d8-4307-42fb-882e-1e0d470249d6 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1324 microversion: 2.1 time: 0.734565 Feb 19 21:03:49.025350 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1618/3131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:48 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1324 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:49.038507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-470f998c-e6ee-4ba8-9198-941727997578 req-9bf64852-5d87-4566-b074-4acc06be2541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed99b5a-d90f-48ef-bfe9-97ccd625993c", "name": "network-vif-deleted", "tag": "4a3185d0-44de-46bc-a6a9-47a19835dc9d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:49.041225 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:49.041225 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:49.049547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-470f998c-e6ee-4ba8-9198-941727997578 req-9bf64852-5d87-4566-b074-4acc06be2541 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:49.050412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-470f998c-e6ee-4ba8-9198-941727997578 req-9bf64852-5d87-4566-b074-4acc06be2541 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:49.063551 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-470f998c-e6ee-4ba8-9198-941727997578 req-9bf64852-5d87-4566-b074-4acc06be2541 service nova] Creating event network-vif-deleted:4a3185d0-44de-46bc-a6a9-47a19835dc9d for instance 1ed99b5a-d90f-48ef-bfe9-97ccd625993c on nch1-master-1 Feb 19 21:03:49.070398 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-470f998c-e6ee-4ba8-9198-941727997578 req-9bf64852-5d87-4566-b074-4acc06be2541 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042812 Feb 19 21:03:49.071193 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1619/3132] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:49.106343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:49.117032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:49.118911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:49.120241 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-81429f8d-fc04-4ec4-8118-23c8cd90657d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1407 microversion: 2.20 time: 0.792091 Feb 19 21:03:49.120998 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1514/3133] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:48 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1407 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:49.240634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4956629e-b415-41f4-ac4e-60749cbd6355 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:49.241627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4956629e-b415-41f4-ac4e-60749cbd6355 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:49.250526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4956629e-b415-41f4-ac4e-60749cbd6355 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:49.250963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4956629e-b415-41f4-ac4e-60749cbd6355 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:49.251941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4956629e-b415-41f4-ac4e-60749cbd6355 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:49.252447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4956629e-b415-41f4-ac4e-60749cbd6355 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:49.337666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-54c33df9-f70a-448a-97df-774b72269c55 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:49.338899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-54c33df9-f70a-448a-97df-774b72269c55 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] [instance: 1ed99b5a-d90f-48ef-bfe9-97ccd625993c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:49.345506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-54c33df9-f70a-448a-97df-774b72269c55 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:49.346320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-54c33df9-f70a-448a-97df-774b72269c55 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:49.347117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-54c33df9-f70a-448a-97df-774b72269c55 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:49.347551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-54c33df9-f70a-448a-97df-774b72269c55 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:49.363020 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-54c33df9-f70a-448a-97df-774b72269c55 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] HTTP exception thrown: Instance 1ed99b5a-d90f-48ef-bfe9-97ccd625993c could not be found. Feb 19 21:03:49.363809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-54c33df9-f70a-448a-97df-774b72269c55 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] Returning 404 to user: Instance 1ed99b5a-d90f-48ef-bfe9-97ccd625993c could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:03:49.364908 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-54c33df9-f70a-448a-97df-774b72269c55 tempest-ServerRescueTestJSONUnderV235-1467185441 tempest-ServerRescueTestJSONUnderV235-1467185441-project] 10.222.0.30 "GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c" status: 404 len: 111 microversion: 2.1 time: 0.031331 Feb 19 21:03:49.365593 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1515/3134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:49 2022] GET /compute/v2.1/servers/1ed99b5a-d90f-48ef-bfe9-97ccd625993c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:03:49.872694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4956629e-b415-41f4-ac4e-60749cbd6355 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:49.881284 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4956629e-b415-41f4-ac4e-60749cbd6355 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1502 microversion: 2.1 time: 0.645553 Feb 19 21:03:49.883194 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1620/3135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:49 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1502 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:49.906321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eb008155-8d96-47f3-8ec6-136635dbd1bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:49.914567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb008155-8d96-47f3-8ec6-136635dbd1bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:49.915432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb008155-8d96-47f3-8ec6-136635dbd1bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:49.944874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eb008155-8d96-47f3-8ec6-136635dbd1bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Going to try to stop instance {{(pid=136095) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:03:49.996239 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eb008155-8d96-47f3-8ec6-136635dbd1bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246/action" status: 202 len: 0 microversion: 2.1 time: 0.097314 Feb 19 21:03:50.007781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-323878d3-7348-440b-92f0-fe79a1a2ae98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:50.008804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-323878d3-7348-440b-92f0-fe79a1a2ae98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:50.014227 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1516/3136] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:03:49 2022] POST /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:03:50.020077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-323878d3-7348-440b-92f0-fe79a1a2ae98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:50.021176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-323878d3-7348-440b-92f0-fe79a1a2ae98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:50.022332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-323878d3-7348-440b-92f0-fe79a1a2ae98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:50.023000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-323878d3-7348-440b-92f0-fe79a1a2ae98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:50.047864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fbc4f11d-b552-459f-9f2f-1df968192fa5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:50.049317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fbc4f11d-b552-459f-9f2f-1df968192fa5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:50.101293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbc4f11d-b552-459f-9f2f-1df968192fa5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:50.101293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbc4f11d-b552-459f-9f2f-1df968192fa5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:50.106827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbc4f11d-b552-459f-9f2f-1df968192fa5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:50.108466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbc4f11d-b552-459f-9f2f-1df968192fa5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:51.232744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-323878d3-7348-440b-92f0-fe79a1a2ae98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:51.253358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fbc4f11d-b552-459f-9f2f-1df968192fa5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:51.262465 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fbc4f11d-b552-459f-9f2f-1df968192fa5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1324 microversion: 2.1 time: 1.222704 Feb 19 21:03:51.265390 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1517/3137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:50 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1324 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:03:51.270318 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-323878d3-7348-440b-92f0-fe79a1a2ae98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 1.266583 Feb 19 21:03:51.273487 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1621/3138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:50 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:51.285796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:51.290739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-30afc942-63e5-4cc9-a2cb-907651525ef1 req-9c0dbcc9-6b14-4aac-9aa8-8a3e574d6749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b717b3c-e160-4a74-aff9-f1396031332d", "tag": "773bb5fe-57ca-4ef3-bcd7-ea37656daaa9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:51.292195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:51.297078 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:51.297078 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:51.309414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:51.311864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:51.314075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:51.314554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:51.316474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-30afc942-63e5-4cc9-a2cb-907651525ef1 req-9c0dbcc9-6b14-4aac-9aa8-8a3e574d6749 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:51.317158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-30afc942-63e5-4cc9-a2cb-907651525ef1 req-9c0dbcc9-6b14-4aac-9aa8-8a3e574d6749 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:51.357107 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-30afc942-63e5-4cc9-a2cb-907651525ef1 req-9c0dbcc9-6b14-4aac-9aa8-8a3e574d6749 service nova] Creating event network-changed:773bb5fe-57ca-4ef3-bcd7-ea37656daaa9 for instance 7b717b3c-e160-4a74-aff9-f1396031332d on nch2-master-1 Feb 19 21:03:51.375389 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-30afc942-63e5-4cc9-a2cb-907651525ef1 req-9c0dbcc9-6b14-4aac-9aa8-8a3e574d6749 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094246 Feb 19 21:03:51.376598 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1622/3139] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:52.004850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:52.019919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:52.022510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:52.023905 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13b10335-6426-4909-85d9-8bfacbfa034a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1407 microversion: 2.20 time: 0.754756 Feb 19 21:03:52.035041 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1518/3140] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:51 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1407 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:52.285048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9fd93771-716e-4327-bd09-f3d9cd9aa7b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:52.286530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9fd93771-716e-4327-bd09-f3d9cd9aa7b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:52.291165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ee8680b-1dc5-4f0e-aea1-d80c7172ec77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:52.292357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ee8680b-1dc5-4f0e-aea1-d80c7172ec77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:52.303811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fd93771-716e-4327-bd09-f3d9cd9aa7b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:52.305684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fd93771-716e-4327-bd09-f3d9cd9aa7b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:52.309084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ee8680b-1dc5-4f0e-aea1-d80c7172ec77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:52.309889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fd93771-716e-4327-bd09-f3d9cd9aa7b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:52.310490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fd93771-716e-4327-bd09-f3d9cd9aa7b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:52.312687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ee8680b-1dc5-4f0e-aea1-d80c7172ec77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:52.314770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ee8680b-1dc5-4f0e-aea1-d80c7172ec77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:52.317425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ee8680b-1dc5-4f0e-aea1-d80c7172ec77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:53.084287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ee8680b-1dc5-4f0e-aea1-d80c7172ec77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:53.098217 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ee8680b-1dc5-4f0e-aea1-d80c7172ec77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 0.808803 Feb 19 21:03:53.100048 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1519/3141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:52 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:53.109663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:53.111191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:53.124769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:53.125709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:53.127085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:53.127972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:53.139737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9fd93771-716e-4327-bd09-f3d9cd9aa7b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:53.150072 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9fd93771-716e-4327-bd09-f3d9cd9aa7b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1324 microversion: 2.1 time: 0.871651 Feb 19 21:03:53.151478 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1623/3142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:52 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1324 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:53.678034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:53.692086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:53.697263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:53.701805 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c3fa24c0-7a0d-4695-a63d-dba465a49a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1407 microversion: 2.20 time: 0.600063 Feb 19 21:03:53.707283 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1520/3143] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:53 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1407 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:54.118064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b4c66fe6-4222-4825-a2c5-e2e9b673524f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:54.118941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b4c66fe6-4222-4825-a2c5-e2e9b673524f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:54.134137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4c66fe6-4222-4825-a2c5-e2e9b673524f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:54.134610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4c66fe6-4222-4825-a2c5-e2e9b673524f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:54.135956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4c66fe6-4222-4825-a2c5-e2e9b673524f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:54.136438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4c66fe6-4222-4825-a2c5-e2e9b673524f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:54.172679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9cfa61f3-2a24-45a8-a9e0-97d4194a837c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:54.174213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9cfa61f3-2a24-45a8-a9e0-97d4194a837c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:54.183550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cfa61f3-2a24-45a8-a9e0-97d4194a837c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:54.184001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cfa61f3-2a24-45a8-a9e0-97d4194a837c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:54.190377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cfa61f3-2a24-45a8-a9e0-97d4194a837c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:54.191170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cfa61f3-2a24-45a8-a9e0-97d4194a837c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:54.780482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9cfa61f3-2a24-45a8-a9e0-97d4194a837c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:54.789704 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9cfa61f3-2a24-45a8-a9e0-97d4194a837c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1324 microversion: 2.1 time: 0.620594 Feb 19 21:03:54.793841 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1521/3144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:54 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1324 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:54.802870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:54.804675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:54.826712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:54.827170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:54.831526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:54.832719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:55.048253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b4c66fe6-4222-4825-a2c5-e2e9b673524f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:55.058572 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b4c66fe6-4222-4825-a2c5-e2e9b673524f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 0.945071 Feb 19 21:03:55.063188 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1624/3145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:54 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:03:55.079406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-439aae9b-4f29-4fbd-9e75-d7cf8d12fa77 req-d8c86318-8353-49eb-991f-ea89cd5c301b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17524174-4cfd-409a-b6f4-15bde7d2c4d1", "name": "network-vif-plugged", "status": "completed", "tag": "2caf0c43-e8a7-47e8-a90c-390f3b45d82b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:55.102137 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:03:55.102137 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:03:55.129673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-439aae9b-4f29-4fbd-9e75-d7cf8d12fa77 req-d8c86318-8353-49eb-991f-ea89cd5c301b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:55.137367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-439aae9b-4f29-4fbd-9e75-d7cf8d12fa77 req-d8c86318-8353-49eb-991f-ea89cd5c301b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:55.182754 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-439aae9b-4f29-4fbd-9e75-d7cf8d12fa77 req-d8c86318-8353-49eb-991f-ea89cd5c301b service nova] Creating event network-vif-plugged:2caf0c43-e8a7-47e8-a90c-390f3b45d82b for instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 on nch1-master-1 Feb 19 21:03:55.204718 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-439aae9b-4f29-4fbd-9e75-d7cf8d12fa77 req-d8c86318-8353-49eb-991f-ea89cd5c301b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138414 Feb 19 21:03:55.210062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1625/3146] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:03:55.516737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:55.530588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:55.533358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:55.540748 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-43843819-6df6-4b26-a90f-64caafde3e62 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1407 microversion: 2.20 time: 0.745706 Feb 19 21:03:55.542206 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1522/3147] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:54 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1407 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:55.606687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1498642488", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "964a709e-2598-41ec-8054-10a918409a96"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:03:55.704092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] validate_networks() for [('964a709e-2598-41ec-8054-10a918409a96', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:03:55.809348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0a864593-5984-4d66-bb91-f727925c0001 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:55.810943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0a864593-5984-4d66-bb91-f727925c0001 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:55.817410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a864593-5984-4d66-bb91-f727925c0001 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:55.818122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a864593-5984-4d66-bb91-f727925c0001 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:55.819244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a864593-5984-4d66-bb91-f727925c0001 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:55.819851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a864593-5984-4d66-bb91-f727925c0001 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:56.575173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0a864593-5984-4d66-bb91-f727925c0001 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:56.593750 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0a864593-5984-4d66-bb91-f727925c0001 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1324 microversion: 2.1 time: 0.788406 Feb 19 21:03:56.597779 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1523/3148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:55 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1324 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:56.613505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-212c50e7-598e-4871-9adb-a6fc0ef0298e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:56.614424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-212c50e7-598e-4871-9adb-a6fc0ef0298e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:56.667196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212c50e7-598e-4871-9adb-a6fc0ef0298e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:56.667964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212c50e7-598e-4871-9adb-a6fc0ef0298e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:56.676231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212c50e7-598e-4871-9adb-a6fc0ef0298e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:56.677020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212c50e7-598e-4871-9adb-a6fc0ef0298e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:57.312612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:03:57.313109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:03:57.313664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:03:57.314187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:03:57.315187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:03:57.332238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:57.340119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:57.344123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:57.344626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:57.397604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Getting quotas for project 3a8136be2d0a4abb81e8038390855add. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:03:57.420544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Getting quotas for user 88188e2c8b6043c0a884ebc8f2663bee and project 3a8136be2d0a4abb81e8038390855add. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:03:57.466443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:03:57.481387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:03:57.548199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-212c50e7-598e-4871-9adb-a6fc0ef0298e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:57.551665 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-190f20e0-8282-47af-ae32-256e6e25883c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.106299 Feb 19 21:03:57.552627 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1626/3149] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 21:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 21:03:57.562627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:57.572014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:57.574001 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-212c50e7-598e-4871-9adb-a6fc0ef0298e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 0.974829 Feb 19 21:03:57.586617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:57.586811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:57.589049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:57.589943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:57.599972 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1524/3150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:56 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:57.635038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-570736a6-9cc8-4f01-8371-650032d182aa tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:57.635772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-570736a6-9cc8-4f01-8371-650032d182aa tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:57.932100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-570736a6-9cc8-4f01-8371-650032d182aa tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:57.944066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-570736a6-9cc8-4f01-8371-650032d182aa tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:57.952483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-570736a6-9cc8-4f01-8371-650032d182aa tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:57.954766 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-570736a6-9cc8-4f01-8371-650032d182aa tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1259 microversion: 2.21 time: 0.352944 Feb 19 21:03:57.959566 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1525/3151] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:57 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1259 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:57.974846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c1e0fe77-3f36-4ef7-9b51-4ed9a32f8ccd tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:57.975981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c1e0fe77-3f36-4ef7-9b51-4ed9a32f8ccd tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:58.011085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1e0fe77-3f36-4ef7-9b51-4ed9a32f8ccd tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:58.013690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1e0fe77-3f36-4ef7-9b51-4ed9a32f8ccd tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:58.015489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1e0fe77-3f36-4ef7-9b51-4ed9a32f8ccd tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:58.016782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1e0fe77-3f36-4ef7-9b51-4ed9a32f8ccd tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:58.653919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:58.675683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:58.678169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:58.680051 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5085ea64-8ac9-4f2c-a539-5e9326ec41b4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1599 microversion: 2.20 time: 1.122160 Feb 19 21:03:58.680867 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1627/3152] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:57 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1599 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:58.686530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5499eae-068f-45f9-a0d0-dd353d21d6cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:58.687873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d5499eae-068f-45f9-a0d0-dd353d21d6cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:58.697036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5499eae-068f-45f9-a0d0-dd353d21d6cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:58.698098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5499eae-068f-45f9-a0d0-dd353d21d6cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:58.699810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5499eae-068f-45f9-a0d0-dd353d21d6cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:58.702878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5499eae-068f-45f9-a0d0-dd353d21d6cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:58.892184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c1e0fe77-3f36-4ef7-9b51-4ed9a32f8ccd tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:58.907131 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c1e0fe77-3f36-4ef7-9b51-4ed9a32f8ccd tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1324 microversion: 2.1 time: 0.945295 Feb 19 21:03:58.908640 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1526/3153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:57 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1324 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:58.917020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bad0d663-36e0-4498-b953-4315c6d516ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:58.917862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bad0d663-36e0-4498-b953-4315c6d516ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:58.926330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bad0d663-36e0-4498-b953-4315c6d516ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:58.927182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bad0d663-36e0-4498-b953-4315c6d516ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:58.928283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bad0d663-36e0-4498-b953-4315c6d516ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:58.929076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bad0d663-36e0-4498-b953-4315c6d516ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:59.148380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d5499eae-068f-45f9-a0d0-dd353d21d6cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:59.166233 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5499eae-068f-45f9-a0d0-dd353d21d6cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 0.484001 Feb 19 21:03:59.168938 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1628/3154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:58 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:03:59.202258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:59.205073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:59.226396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:59.227281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:59.232537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:59.233648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:59.298423 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bad0d663-36e0-4498-b953-4315c6d516ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.387877 Feb 19 21:03:59.300281 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1527/3155] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Feb 19 21:03:58 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-interface => generated 285 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:03:59.739702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:59.752864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:59.754418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:03:59.761531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec2463b6-5b1b-40ef-8368-9db6c60f6c43 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1317 microversion: 2.21 time: 0.587749 Feb 19 21:03:59.761781 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1629/3156] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:03:59 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:03:59.930003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-79d90751-4b89-4078-9461-7234fbc5d13e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:03:59.930629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-79d90751-4b89-4078-9461-7234fbc5d13e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:03:59.952611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79d90751-4b89-4078-9461-7234fbc5d13e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:59.973770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79d90751-4b89-4078-9461-7234fbc5d13e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:03:59.982348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79d90751-4b89-4078-9461-7234fbc5d13e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:03:59.984631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79d90751-4b89-4078-9461-7234fbc5d13e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:00.191171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0e31c911-077a-4b0a-a11a-3ad46eb72e39 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:00.191787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0e31c911-077a-4b0a-a11a-3ad46eb72e39 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:00.201702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0e31c911-077a-4b0a-a11a-3ad46eb72e39 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:00.202153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0e31c911-077a-4b0a-a11a-3ad46eb72e39 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:00.203104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0e31c911-077a-4b0a-a11a-3ad46eb72e39 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:00.203580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0e31c911-077a-4b0a-a11a-3ad46eb72e39 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:00.700738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79d90751-4b89-4078-9461-7234fbc5d13e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:00.724556 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-79d90751-4b89-4078-9461-7234fbc5d13e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1324 microversion: 2.1 time: 0.799492 Feb 19 21:04:00.739254 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1528/3157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:03:59 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1324 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:00.750622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2f8e6262-42a4-4633-a8e3-6b3c6b071731 req-f4cfe251-a198-41f5-939e-91875a4a4d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b717b3c-e160-4a74-aff9-f1396031332d", "name": "network-vif-plugged", "status": "completed", "tag": "773bb5fe-57ca-4ef3-bcd7-ea37656daaa9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:00.753063 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:00.753063 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:04:00.773784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2f8e6262-42a4-4633-a8e3-6b3c6b071731 req-f4cfe251-a198-41f5-939e-91875a4a4d20 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:00.774260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2f8e6262-42a4-4633-a8e3-6b3c6b071731 req-f4cfe251-a198-41f5-939e-91875a4a4d20 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:00.822085 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2f8e6262-42a4-4633-a8e3-6b3c6b071731 req-f4cfe251-a198-41f5-939e-91875a4a4d20 service nova] Creating event network-vif-plugged:773bb5fe-57ca-4ef3-bcd7-ea37656daaa9 for instance 7b717b3c-e160-4a74-aff9-f1396031332d on nch2-master-1 Feb 19 21:04:00.841246 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2f8e6262-42a4-4633-a8e3-6b3c6b071731 req-f4cfe251-a198-41f5-939e-91875a4a4d20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087265 Feb 19 21:04:00.843075 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1529/3158] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:00.851824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:00.852838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:00.855721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0e31c911-077a-4b0a-a11a-3ad46eb72e39 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:00.863905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:00.864643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:00.866134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:00.866853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:00.870658 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0e31c911-077a-4b0a-a11a-3ad46eb72e39 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 0.679852 Feb 19 21:04:00.871374 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1630/3159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:00 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:04:00.966444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:00.980634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:00.985038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:00.987115 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3a92d750-082e-4997-9445-57bb80d105bf tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1317 microversion: 2.21 time: 0.142087 Feb 19 21:04:00.989306 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1530/3160] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:00 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:01.747830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d987f37c-d903-45ee-b5b3-d96332dcea67 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:01.748653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d987f37c-d903-45ee-b5b3-d96332dcea67 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:01.759276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d987f37c-d903-45ee-b5b3-d96332dcea67 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:01.760111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d987f37c-d903-45ee-b5b3-d96332dcea67 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:01.762571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d987f37c-d903-45ee-b5b3-d96332dcea67 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:01.763723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d987f37c-d903-45ee-b5b3-d96332dcea67 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:01.888994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06fdeff6-f56e-4153-954a-69c74f8d7394 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:01.890293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06fdeff6-f56e-4153-954a-69c74f8d7394 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:01.899310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06fdeff6-f56e-4153-954a-69c74f8d7394 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:01.900374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06fdeff6-f56e-4153-954a-69c74f8d7394 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:01.901621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06fdeff6-f56e-4153-954a-69c74f8d7394 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:01.903953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06fdeff6-f56e-4153-954a-69c74f8d7394 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:02.301462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d987f37c-d903-45ee-b5b3-d96332dcea67 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:02.310333 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d987f37c-d903-45ee-b5b3-d96332dcea67 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1324 microversion: 2.1 time: 0.570407 Feb 19 21:04:02.310946 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1631/3161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:01 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1324 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:02.321198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:02.321817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:02.342555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:02.343203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:02.345860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:02.346424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:02.939283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-06fdeff6-f56e-4153-954a-69c74f8d7394 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:02.950359 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06fdeff6-f56e-4153-954a-69c74f8d7394 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 1.066317 Feb 19 21:04:02.951596 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1531/3162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:01 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:04:03.235475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1739128550", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:03.276796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:03.293030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:03.298588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:03.304784 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bfdbdf1e-6ca4-4637-ae11-6a6516bb2f07 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1359 microversion: 2.21 time: 0.986936 Feb 19 21:04:03.305451 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1632/3163] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:02 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1359 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:03.310616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-53d9889d-1313-47bf-8b76-ea7a01869704 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:03.311356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-53d9889d-1313-47bf-8b76-ea7a01869704 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:03.318844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-53d9889d-1313-47bf-8b76-ea7a01869704 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:03.319588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-53d9889d-1313-47bf-8b76-ea7a01869704 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:03.323241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-53d9889d-1313-47bf-8b76-ea7a01869704 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:03.324194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-53d9889d-1313-47bf-8b76-ea7a01869704 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:03.360850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] validate_networks() for [('757b2f5d-0080-4f9a-891f-7b8f3d47ca02', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:04:03.387747 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-53d9889d-1313-47bf-8b76-ea7a01869704 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/ips" status: 200 len: 112 microversion: 2.20 time: 0.079371 Feb 19 21:04:03.388813 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1633/3164] 10.222.0.30 () {60 vars in 1288 bytes} [Sat Feb 19 21:04:03 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/ips => generated 112 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:04:03.393813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e27e5750-1502-4432-8d31-f5044073675e req-b2a92fff-86a7-419b-803e-2ad58d232897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17524174-4cfd-409a-b6f4-15bde7d2c4d1", "tag": "2caf0c43-e8a7-47e8-a90c-390f3b45d82b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:03.416182 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:03.416182 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:03.441399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e27e5750-1502-4432-8d31-f5044073675e req-b2a92fff-86a7-419b-803e-2ad58d232897 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:03.444091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e27e5750-1502-4432-8d31-f5044073675e req-b2a92fff-86a7-419b-803e-2ad58d232897 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:03.469120 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e27e5750-1502-4432-8d31-f5044073675e req-b2a92fff-86a7-419b-803e-2ad58d232897 service nova] Creating event network-changed:2caf0c43-e8a7-47e8-a90c-390f3b45d82b for instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 on nch1-master-1 Feb 19 21:04:03.477472 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e27e5750-1502-4432-8d31-f5044073675e req-b2a92fff-86a7-419b-803e-2ad58d232897 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086929 Feb 19 21:04:03.479418 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1634/3165] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:03.489691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6a4cae95-bebb-4498-92e2-3ec26d52162b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:03.490685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6a4cae95-bebb-4498-92e2-3ec26d52162b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:03.499298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a4cae95-bebb-4498-92e2-3ec26d52162b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:03.500044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a4cae95-bebb-4498-92e2-3ec26d52162b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:03.501175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a4cae95-bebb-4498-92e2-3ec26d52162b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:03.503284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a4cae95-bebb-4498-92e2-3ec26d52162b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:04.294343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6a4cae95-bebb-4498-92e2-3ec26d52162b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:04.304708 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6a4cae95-bebb-4498-92e2-3ec26d52162b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1521 microversion: 2.1 time: 0.822371 Feb 19 21:04:04.305314 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1635/3166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:03 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1521 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:04.320813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-184d7b34-bade-43b9-8e3b-98520f4ea61e req-7dfe341f-ff3e-4134-abf3-32a567e6cd40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9424a60d-94ab-4f65-9532-2bf2781187b0", "tag": "d9df7ee9-307b-45e6-a664-09b2b86bbcc0"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:04.326280 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:04.326280 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:04.342822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-184d7b34-bade-43b9-8e3b-98520f4ea61e req-7dfe341f-ff3e-4134-abf3-32a567e6cd40 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:04.343346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-184d7b34-bade-43b9-8e3b-98520f4ea61e req-7dfe341f-ff3e-4134-abf3-32a567e6cd40 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:04.374164 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-184d7b34-bade-43b9-8e3b-98520f4ea61e req-7dfe341f-ff3e-4134-abf3-32a567e6cd40 service nova] Creating event network-changed:d9df7ee9-307b-45e6-a664-09b2b86bbcc0 for instance 9424a60d-94ab-4f65-9532-2bf2781187b0 on nch1-master-1 Feb 19 21:04:04.400866 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-184d7b34-bade-43b9-8e3b-98520f4ea61e req-7dfe341f-ff3e-4134-abf3-32a567e6cd40 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090785 Feb 19 21:04:04.403963 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1636/3167] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:04.418281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5c8cbef3-8ded-4b9b-a435-7ba52ff4ceee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:04.420100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5c8cbef3-8ded-4b9b-a435-7ba52ff4ceee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:04.444568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c8cbef3-8ded-4b9b-a435-7ba52ff4ceee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:04.445994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c8cbef3-8ded-4b9b-a435-7ba52ff4ceee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:04.451994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c8cbef3-8ded-4b9b-a435-7ba52ff4ceee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:04.453105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c8cbef3-8ded-4b9b-a435-7ba52ff4ceee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:05.273559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5c8cbef3-8ded-4b9b-a435-7ba52ff4ceee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:05.291568 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5c8cbef3-8ded-4b9b-a435-7ba52ff4ceee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 0.881763 Feb 19 21:04:05.292274 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1637/3168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:04 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:05.312767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:05.314298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:05.320934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:05.321704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:05.323239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:05.324637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:05.361463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:04:05.363082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:04:05.363974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:04:05.364586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:04:05.365593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:04:05.389261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:05.390024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:05.391126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:05.391730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:05.418870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Getting quotas for project 5ee065d1c70940cd8caadd525737c593. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:05.425623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Getting quotas for user e36bd5d716db4dba866a1bcd880accb8 and project 5ee065d1c70940cd8caadd525737c593. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:05.441707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:04:05.444589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:04:05.514219 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5dfc4249-e190-4a31-9706-dcd50c6def90 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.561270 Feb 19 21:04:05.521381 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1532/3169] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:04:05.527754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c7d80828-fe91-45b8-bdf1-91ba85784e7b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:05.528968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c7d80828-fe91-45b8-bdf1-91ba85784e7b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:05.539114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c7d80828-fe91-45b8-bdf1-91ba85784e7b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:05.539875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c7d80828-fe91-45b8-bdf1-91ba85784e7b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:05.542269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c7d80828-fe91-45b8-bdf1-91ba85784e7b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:05.542928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c7d80828-fe91-45b8-bdf1-91ba85784e7b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:06.317068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c7d80828-fe91-45b8-bdf1-91ba85784e7b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:06.331433 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c7d80828-fe91-45b8-bdf1-91ba85784e7b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1521 microversion: 2.1 time: 0.807961 Feb 19 21:04:06.332191 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1533/3170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:05 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1521 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:06.344272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:06.354259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:06.364893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-84cc1571-a2ae-4b95-ab30-ea8410016669 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:06.365677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-84cc1571-a2ae-4b95-ab30-ea8410016669 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:06.370837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:06.372030 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2073cb64-262f-4e7b-94dc-15d0daff3c7c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1359 microversion: 2.21 time: 1.065206 Feb 19 21:04:06.372653 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1638/3171] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:05 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1359 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:06.379918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5c5c59e0-17e0-41d6-aac1-2ce914545700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:06.380819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5c5c59e0-17e0-41d6-aac1-2ce914545700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:06.397904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c5c59e0-17e0-41d6-aac1-2ce914545700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:06.407102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c5c59e0-17e0-41d6-aac1-2ce914545700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:06.415706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c5c59e0-17e0-41d6-aac1-2ce914545700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:06.417677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c5c59e0-17e0-41d6-aac1-2ce914545700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:06.532280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-84cc1571-a2ae-4b95-ab30-ea8410016669 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:06.540513 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-84cc1571-a2ae-4b95-ab30-ea8410016669 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1217 microversion: 2.1 time: 0.206852 Feb 19 21:04:06.543722 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1534/3172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:06 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:06.551744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5437b657-4081-44e4-b0b3-d37a408bf69c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1289862080"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:06.553469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5437b657-4081-44e4-b0b3-d37a408bf69c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:06.565114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5437b657-4081-44e4-b0b3-d37a408bf69c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:06.568787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5437b657-4081-44e4-b0b3-d37a408bf69c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:06.570652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5437b657-4081-44e4-b0b3-d37a408bf69c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:06.571627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5437b657-4081-44e4-b0b3-d37a408bf69c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:07.023613 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5437b657-4081-44e4-b0b3-d37a408bf69c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d/action" status: 202 len: 0 microversion: 2.1 time: 0.476429 Feb 19 21:04:07.024284 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1535/3173] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:06 2022] POST /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 21:04:07.036033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d5731bf3-56c3-4f7c-a448-499752c49ee9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '.version_select at 0x7f6467e87310>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:07.094616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5c5c59e0-17e0-41d6-aac1-2ce914545700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:07.108785 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5c5c59e0-17e0-41d6-aac1-2ce914545700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 0.731663 Feb 19 21:04:07.110849 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1639/3174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:06 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:07.269565 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d5731bf3-56c3-4f7c-a448-499752c49ee9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/images/905dfdf3-2f3b-4636-8f3b-6c0226543df4" status: 204 len: 0 microversion: 2.1 time: 0.238087 Feb 19 21:04:07.270781 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1536/3175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:07 2022] DELETE /compute/v2.1/images/905dfdf3-2f3b-4636-8f3b-6c0226543df4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:04:07.295709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-94ce8966-57ef-4888-848c-086b97d339eb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '.version_select at 0x7f6467dd1f70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:07.348914 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-94ce8966-57ef-4888-848c-086b97d339eb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Image not found. Feb 19 21:04:07.349518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-94ce8966-57ef-4888-848c-086b97d339eb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:07.350372 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-94ce8966-57ef-4888-848c-086b97d339eb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/images/905dfdf3-2f3b-4636-8f3b-6c0226543df4" status: 404 len: 62 microversion: 2.1 time: 0.073365 Feb 19 21:04:07.358635 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1640/3176] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Feb 19 21:04:07 2022] GET /compute/v2.1/images/905dfdf3-2f3b-4636-8f3b-6c0226543df4 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:04:07.367484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-93a49150-b1cb-4db3-9f0c-f2fbf0108344 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:07.368432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-93a49150-b1cb-4db3-9f0c-f2fbf0108344 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:07.392878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93a49150-b1cb-4db3-9f0c-f2fbf0108344 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:07.393349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93a49150-b1cb-4db3-9f0c-f2fbf0108344 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:07.394160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93a49150-b1cb-4db3-9f0c-f2fbf0108344 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:07.394699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93a49150-b1cb-4db3-9f0c-f2fbf0108344 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:07.397269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:07.399536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:07.419926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:07.421514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:07.423938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:07.425064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:08.086637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-93a49150-b1cb-4db3-9f0c-f2fbf0108344 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:08.096199 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-93a49150-b1cb-4db3-9f0c-f2fbf0108344 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1533 microversion: 2.1 time: 0.733813 Feb 19 21:04:08.100411 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1537/3177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:07 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1533 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:08.113807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-010ad9a8-813a-4a70-a6c2-27ddeac6cfe6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:08.120737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-010ad9a8-813a-4a70-a6c2-27ddeac6cfe6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:08.127244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-010ad9a8-813a-4a70-a6c2-27ddeac6cfe6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:08.130930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-010ad9a8-813a-4a70-a6c2-27ddeac6cfe6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:08.131969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-010ad9a8-813a-4a70-a6c2-27ddeac6cfe6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:08.133161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-010ad9a8-813a-4a70-a6c2-27ddeac6cfe6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:08.151441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:08.171337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:08.186058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:08.188027 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-af36343c-13e2-4422-8fc9-243d2f501499 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1359 microversion: 2.21 time: 0.801018 Feb 19 21:04:08.204712 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1641/3178] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:07 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1359 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:04:08.225427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5cd2adbf-2dcd-4728-8873-ae1bd2eb2a9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:08.226684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5cd2adbf-2dcd-4728-8873-ae1bd2eb2a9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:08.244870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cd2adbf-2dcd-4728-8873-ae1bd2eb2a9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:08.245215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-010ad9a8-813a-4a70-a6c2-27ddeac6cfe6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:08.250826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cd2adbf-2dcd-4728-8873-ae1bd2eb2a9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:08.254422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cd2adbf-2dcd-4728-8873-ae1bd2eb2a9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:08.255081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cd2adbf-2dcd-4728-8873-ae1bd2eb2a9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:08.256211 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-010ad9a8-813a-4a70-a6c2-27ddeac6cfe6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1275 microversion: 2.1 time: 0.154667 Feb 19 21:04:08.257166 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1538/3179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:08 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:09.123178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c00eeff3-f8c4-4520-a9b2-f5bcb63b8eac tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:09.125346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c00eeff3-f8c4-4520-a9b2-f5bcb63b8eac tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:09.140499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c00eeff3-f8c4-4520-a9b2-f5bcb63b8eac tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:09.140952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c00eeff3-f8c4-4520-a9b2-f5bcb63b8eac tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:09.141743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c00eeff3-f8c4-4520-a9b2-f5bcb63b8eac tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:09.142181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c00eeff3-f8c4-4520-a9b2-f5bcb63b8eac tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:09.330466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5cd2adbf-2dcd-4728-8873-ae1bd2eb2a9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:09.345715 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5cd2adbf-2dcd-4728-8873-ae1bd2eb2a9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 1.139673 Feb 19 21:04:09.346806 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1642/3180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:08 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:09.361599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:09.362613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:09.373686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:09.374702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:09.377032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:09.377847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:09.594000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c00eeff3-f8c4-4520-a9b2-f5bcb63b8eac tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:09.611005 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c00eeff3-f8c4-4520-a9b2-f5bcb63b8eac tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1533 microversion: 2.1 time: 0.494815 Feb 19 21:04:09.612983 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1539/3181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:09 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1533 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:04:09.633366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c35cbdc7-d44b-4f7c-96b7-653437c8d873 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:09.635074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c35cbdc7-d44b-4f7c-96b7-653437c8d873 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:09.643701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c35cbdc7-d44b-4f7c-96b7-653437c8d873 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:09.644711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c35cbdc7-d44b-4f7c-96b7-653437c8d873 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:09.646133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c35cbdc7-d44b-4f7c-96b7-653437c8d873 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:09.647704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c35cbdc7-d44b-4f7c-96b7-653437c8d873 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:09.811439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:09.829603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:09.833080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:09.837218 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ccb0ee18-cf26-4464-89af-f2883010153c tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1359 microversion: 2.21 time: 0.487579 Feb 19 21:04:09.839760 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1643/3182] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:09 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1359 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:10.014273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c35cbdc7-d44b-4f7c-96b7-653437c8d873 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:10.021736 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c35cbdc7-d44b-4f7c-96b7-653437c8d873 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1317 microversion: 2.1 time: 0.407479 Feb 19 21:04:10.032782 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1540/3183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:09 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:10.319682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-1f667ceb-e2f0-49a4-9b71-c99f5b271064 req-5e1338c6-491c-449d-93e5-d64ffd5c4144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9424a60d-94ab-4f65-9532-2bf2781187b0", "name": "network-vif-plugged", "status": "completed", "tag": "d9df7ee9-307b-45e6-a664-09b2b86bbcc0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:10.321491 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:10.321491 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:04:10.342721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1f667ceb-e2f0-49a4-9b71-c99f5b271064 req-5e1338c6-491c-449d-93e5-d64ffd5c4144 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:10.351606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4092c46e-4571-480a-becd-3c1392b7deed tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Action: 'create', calling method: .version_select at 0x7f6467c28160>, body: {"keypair": {"name": "tempest-keypair-194059251"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:10.359085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1f667ceb-e2f0-49a4-9b71-c99f5b271064 req-5e1338c6-491c-449d-93e5-d64ffd5c4144 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:10.399296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4092c46e-4571-480a-becd-3c1392b7deed tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Getting quotas for project 6e59ada015584cc6b980ae55cedc2103. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:10.406780 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-1f667ceb-e2f0-49a4-9b71-c99f5b271064 req-5e1338c6-491c-449d-93e5-d64ffd5c4144 service nova] Creating event network-vif-plugged:d9df7ee9-307b-45e6-a664-09b2b86bbcc0 for instance 9424a60d-94ab-4f65-9532-2bf2781187b0 on nch1-master-1 Feb 19 21:04:10.418766 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-1f667ceb-e2f0-49a4-9b71-c99f5b271064 req-5e1338c6-491c-449d-93e5-d64ffd5c4144 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103010 Feb 19 21:04:10.441134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4092c46e-4571-480a-becd-3c1392b7deed tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Getting quotas for user 59ce7bfa9c454b3389ec787812495827 and project 6e59ada015584cc6b980ae55cedc2103. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:10.447933 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1541/3184] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:04:10.460175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b52a11ee-d993-44b3-9511-d87ce95cd96a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:10.471038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b52a11ee-d993-44b3-9511-d87ce95cd96a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:10.488402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b52a11ee-d993-44b3-9511-d87ce95cd96a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:10.488974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b52a11ee-d993-44b3-9511-d87ce95cd96a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:10.489792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b52a11ee-d993-44b3-9511-d87ce95cd96a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:10.490243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b52a11ee-d993-44b3-9511-d87ce95cd96a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:11.095852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4092c46e-4571-480a-becd-3c1392b7deed tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Getting quotas for project 6e59ada015584cc6b980ae55cedc2103. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:11.112020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4092c46e-4571-480a-becd-3c1392b7deed tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Getting quotas for user 59ce7bfa9c454b3389ec787812495827 and project 6e59ada015584cc6b980ae55cedc2103. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:11.163128 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4092c46e-4571-480a-becd-3c1392b7deed tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.903454 Feb 19 21:04:11.172627 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1644/3185] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:04:10 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:11.178001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0fa0d01b-2fed-42ca-ad2d-e3ffb1b4ce8e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:11.179061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0fa0d01b-2fed-42ca-ad2d-e3ffb1b4ce8e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:11.194938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fa0d01b-2fed-42ca-ad2d-e3ffb1b4ce8e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:11.197112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fa0d01b-2fed-42ca-ad2d-e3ffb1b4ce8e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:11.198378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fa0d01b-2fed-42ca-ad2d-e3ffb1b4ce8e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:11.203016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fa0d01b-2fed-42ca-ad2d-e3ffb1b4ce8e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:11.485843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b52a11ee-d993-44b3-9511-d87ce95cd96a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:11.532738 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b52a11ee-d993-44b3-9511-d87ce95cd96a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 1.068592 Feb 19 21:04:11.544672 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1542/3186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:10 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:11.558474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:11.560275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:11.594145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:11.604633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:11.606121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:11.606789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:11.940166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0fa0d01b-2fed-42ca-ad2d-e3ffb1b4ce8e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:11.954790 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0fa0d01b-2fed-42ca-ad2d-e3ffb1b4ce8e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1539 microversion: 2.1 time: 0.780701 Feb 19 21:04:11.955612 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1645/3187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:11 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1539 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:11.970523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8b4633b8-e4ad-4cac-9856-c5b843457ef3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:11.992206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8b4633b8-e4ad-4cac-9856-c5b843457ef3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:12.010935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b4633b8-e4ad-4cac-9856-c5b843457ef3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:12.017259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b4633b8-e4ad-4cac-9856-c5b843457ef3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:12.018129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b4633b8-e4ad-4cac-9856-c5b843457ef3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:12.019325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b4633b8-e4ad-4cac-9856-c5b843457ef3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:12.328568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:12.345848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:12.348125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:12.349533 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-53806c37-2c3a-4b57-883f-0d6ac83b6de5 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1359 microversion: 2.21 time: 0.802716 Feb 19 21:04:12.351930 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1543/3188] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:11 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1359 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:12.379840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8c8dca08-6358-4464-bc11-68c340a31d64 req-d7c05df7-bd8e-42d4-8cee-3bb69686ba23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63482c29-4a39-4eaa-9bf1-de6107d9b0f0", "tag": "a943b989-5a95-44a3-9a78-35384327a397"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:12.383574 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:12.383574 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:04:12.440441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8c8dca08-6358-4464-bc11-68c340a31d64 req-d7c05df7-bd8e-42d4-8cee-3bb69686ba23 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:12.440922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8c8dca08-6358-4464-bc11-68c340a31d64 req-d7c05df7-bd8e-42d4-8cee-3bb69686ba23 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:12.497515 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8c8dca08-6358-4464-bc11-68c340a31d64 req-d7c05df7-bd8e-42d4-8cee-3bb69686ba23 service nova] Creating event network-changed:a943b989-5a95-44a3-9a78-35384327a397 for instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 on nch1-master-1 Feb 19 21:04:12.534421 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8c8dca08-6358-4464-bc11-68c340a31d64 req-d7c05df7-bd8e-42d4-8cee-3bb69686ba23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168610 Feb 19 21:04:12.556208 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1544/3189] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:12.580197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c96377a8-b29f-41ac-b44f-e2e74e954369 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:12.581220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c96377a8-b29f-41ac-b44f-e2e74e954369 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:12.629097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c96377a8-b29f-41ac-b44f-e2e74e954369 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:12.631489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c96377a8-b29f-41ac-b44f-e2e74e954369 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:12.634395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c96377a8-b29f-41ac-b44f-e2e74e954369 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:12.636896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c96377a8-b29f-41ac-b44f-e2e74e954369 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:12.648020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8b4633b8-e4ad-4cac-9856-c5b843457ef3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:12.661235 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8b4633b8-e4ad-4cac-9856-c5b843457ef3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1317 microversion: 2.1 time: 0.701798 Feb 19 21:04:12.673866 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1646/3190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:11 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1317 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:12.976321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-72f36c0d-5238-498e-9ccf-f51f3e67764b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:12.977000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-72f36c0d-5238-498e-9ccf-f51f3e67764b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:12.995531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72f36c0d-5238-498e-9ccf-f51f3e67764b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:13.002469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72f36c0d-5238-498e-9ccf-f51f3e67764b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:13.009563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72f36c0d-5238-498e-9ccf-f51f3e67764b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:13.011302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72f36c0d-5238-498e-9ccf-f51f3e67764b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:13.564525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c96377a8-b29f-41ac-b44f-e2e74e954369 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:13.582562 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c96377a8-b29f-41ac-b44f-e2e74e954369 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 1.007798 Feb 19 21:04:13.583484 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1545/3191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:12 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:13.595516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:13.603228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:13.625547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:13.626300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:13.627307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:13.632537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:13.783165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-72f36c0d-5238-498e-9ccf-f51f3e67764b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:13.794275 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-72f36c0d-5238-498e-9ccf-f51f3e67764b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1539 microversion: 2.1 time: 0.824023 Feb 19 21:04:13.798075 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1647/3192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:12 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1539 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:13.812272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36b56607-79f3-4ee5-8fb1-5cf34b476e5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:13.813506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-36b56607-79f3-4ee5-8fb1-5cf34b476e5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:13.826843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36b56607-79f3-4ee5-8fb1-5cf34b476e5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:13.831549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36b56607-79f3-4ee5-8fb1-5cf34b476e5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:13.833928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36b56607-79f3-4ee5-8fb1-5cf34b476e5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:13.834729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36b56607-79f3-4ee5-8fb1-5cf34b476e5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:14.786628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-36b56607-79f3-4ee5-8fb1-5cf34b476e5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:14.796559 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36b56607-79f3-4ee5-8fb1-5cf34b476e5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1317 microversion: 2.1 time: 0.992633 Feb 19 21:04:14.806458 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1648/3193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:13 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1317 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:14.813844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1028bf76-6f6a-4dd7-89a4-d93599c57e54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:14.819056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:14.827320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1028bf76-6f6a-4dd7-89a4-d93599c57e54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:14.828288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:14.833114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:14.840761 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f99c29a8-a80b-4925-8c6c-4e88334bf942 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1553 microversion: 2.21 time: 1.255738 Feb 19 21:04:14.841799 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1546/3194] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:13 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1553 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:14.845033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1028bf76-6f6a-4dd7-89a4-d93599c57e54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:14.845606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1028bf76-6f6a-4dd7-89a4-d93599c57e54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:14.846938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1028bf76-6f6a-4dd7-89a4-d93599c57e54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:14.847476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1028bf76-6f6a-4dd7-89a4-d93599c57e54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:14.851122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8273499-74c3-4b28-95a0-d75f8c55c7d9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:14.851959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e8273499-74c3-4b28-95a0-d75f8c55c7d9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:14.882781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8273499-74c3-4b28-95a0-d75f8c55c7d9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:14.883572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8273499-74c3-4b28-95a0-d75f8c55c7d9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:14.885116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8273499-74c3-4b28-95a0-d75f8c55c7d9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:14.886579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8273499-74c3-4b28-95a0-d75f8c55c7d9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:16.252594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1028bf76-6f6a-4dd7-89a4-d93599c57e54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:16.263164 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1028bf76-6f6a-4dd7-89a4-d93599c57e54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 1.455321 Feb 19 21:04:16.268581 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1649/3195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:14 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:16.279608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f8579ddc-c359-4f2e-80df-13c50bbff78e tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:16.279826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f8579ddc-c359-4f2e-80df-13c50bbff78e tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:16.298106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8579ddc-c359-4f2e-80df-13c50bbff78e tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:16.299736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8579ddc-c359-4f2e-80df-13c50bbff78e tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:16.300876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8579ddc-c359-4f2e-80df-13c50bbff78e tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:16.301558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8579ddc-c359-4f2e-80df-13c50bbff78e tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:16.377411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f8579ddc-c359-4f2e-80df-13c50bbff78e tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:04:16.560133 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f8579ddc-c359-4f2e-80df-13c50bbff78e tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 204 len: 0 microversion: 2.21 time: 0.290077 Feb 19 21:04:16.562894 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1650/3196] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:04:16 2022] DELETE /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:04:16.570511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0064f845-69d3-4894-8333-732b90f0527b req-0a819542-8676-4f23-b458-16b0a4e54675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b717b3c-e160-4a74-aff9-f1396031332d", "name": "network-vif-plugged", "status": "completed", "tag": "773bb5fe-57ca-4ef3-bcd7-ea37656daaa9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:16.575460 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:16.575460 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:16.589572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0064f845-69d3-4894-8333-732b90f0527b req-0a819542-8676-4f23-b458-16b0a4e54675 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:16.590025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0064f845-69d3-4894-8333-732b90f0527b req-0a819542-8676-4f23-b458-16b0a4e54675 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:16.606087 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0064f845-69d3-4894-8333-732b90f0527b req-0a819542-8676-4f23-b458-16b0a4e54675 service nova] Creating event network-vif-plugged:773bb5fe-57ca-4ef3-bcd7-ea37656daaa9 for instance 7b717b3c-e160-4a74-aff9-f1396031332d on nch2-master-1 Feb 19 21:04:16.611774 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0064f845-69d3-4894-8333-732b90f0527b req-0a819542-8676-4f23-b458-16b0a4e54675 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046406 Feb 19 21:04:16.612635 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1651/3197] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:16.620059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0f06d7ac-57e0-4a0e-af4a-746c7e696733 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:16.620451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0f06d7ac-57e0-4a0e-af4a-746c7e696733 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:16.628376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f06d7ac-57e0-4a0e-af4a-746c7e696733 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:16.628805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f06d7ac-57e0-4a0e-af4a-746c7e696733 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:16.629673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f06d7ac-57e0-4a0e-af4a-746c7e696733 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:16.630115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f06d7ac-57e0-4a0e-af4a-746c7e696733 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:16.740711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e8273499-74c3-4b28-95a0-d75f8c55c7d9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:16.759395 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e8273499-74c3-4b28-95a0-d75f8c55c7d9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1539 microversion: 2.1 time: 1.916376 Feb 19 21:04:16.760117 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1547/3198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:14 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1539 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:16.773059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:16.774588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:16.784535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:16.785394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:16.801058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:16.804751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:17.413774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0f06d7ac-57e0-4a0e-af4a-746c7e696733 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:17.449057 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0f06d7ac-57e0-4a0e-af4a-746c7e696733 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1317 microversion: 2.1 time: 0.835153 Feb 19 21:04:17.471019 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1652/3199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:16 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1317 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:17.480878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-56fc55f3-3115-4f68-bb94-c100321f3c35 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:17.481594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-56fc55f3-3115-4f68-bb94-c100321f3c35 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:17.489766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-56fc55f3-3115-4f68-bb94-c100321f3c35 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:17.490526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-56fc55f3-3115-4f68-bb94-c100321f3c35 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:17.491552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-56fc55f3-3115-4f68-bb94-c100321f3c35 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:17.492129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-56fc55f3-3115-4f68-bb94-c100321f3c35 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:17.518536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:17.535971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:17.542036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:17.546060 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-59109c9b-38c3-4e20-be27-f812cef694db tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1559 microversion: 2.21 time: 0.780406 Feb 19 21:04:17.565962 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1548/3200] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:16 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1559 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:17.780257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc2f5b4e-e6df-4a56-a662-8346f9518dcb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:17.781112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc2f5b4e-e6df-4a56-a662-8346f9518dcb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:17.807275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc2f5b4e-e6df-4a56-a662-8346f9518dcb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:17.807830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc2f5b4e-e6df-4a56-a662-8346f9518dcb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:17.809032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc2f5b4e-e6df-4a56-a662-8346f9518dcb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:17.809908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc2f5b4e-e6df-4a56-a662-8346f9518dcb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:18.116750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-56fc55f3-3115-4f68-bb94-c100321f3c35 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:18.131103 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-56fc55f3-3115-4f68-bb94-c100321f3c35 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 0.658137 Feb 19 21:04:18.131729 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1653/3201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:17 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:18.469897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc2f5b4e-e6df-4a56-a662-8346f9518dcb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:18.486844 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc2f5b4e-e6df-4a56-a662-8346f9518dcb tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1521 microversion: 2.1 time: 0.712185 Feb 19 21:04:18.487806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74cc3248-cd9e-4ed4-afc1-5fb2b6a4def8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:18.488681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-74cc3248-cd9e-4ed4-afc1-5fb2b6a4def8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:18.489306 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1549/3202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:17 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1521 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:18.502347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74cc3248-cd9e-4ed4-afc1-5fb2b6a4def8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:18.509089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74cc3248-cd9e-4ed4-afc1-5fb2b6a4def8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:18.511386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74cc3248-cd9e-4ed4-afc1-5fb2b6a4def8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:18.514253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74cc3248-cd9e-4ed4-afc1-5fb2b6a4def8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:18.522279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-23b986ba-7c83-419a-9f6e-e47a3d6449d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:18.528466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-23b986ba-7c83-419a-9f6e-e47a3d6449d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:18.548859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23b986ba-7c83-419a-9f6e-e47a3d6449d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:18.550013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23b986ba-7c83-419a-9f6e-e47a3d6449d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:18.556030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23b986ba-7c83-419a-9f6e-e47a3d6449d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:18.559747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23b986ba-7c83-419a-9f6e-e47a3d6449d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:18.648881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-23b986ba-7c83-419a-9f6e-e47a3d6449d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:04:18.855047 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-23b986ba-7c83-419a-9f6e-e47a3d6449d8 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 204 len: 0 microversion: 2.1 time: 0.345997 Feb 19 21:04:18.860448 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1550/3203] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:04:18 2022] DELETE /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:04:18.866883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:18.867890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:18.877122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:18.877849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:18.878924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:18.879528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:19.019732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-74cc3248-cd9e-4ed4-afc1-5fb2b6a4def8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:19.045596 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-74cc3248-cd9e-4ed4-afc1-5fb2b6a4def8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1317 microversion: 2.1 time: 0.562268 Feb 19 21:04:19.046884 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1654/3204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:18 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:19.054559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-dce8d85b-31f4-492b-afdc-4aa2d9613f7c req-5146130d-c725-4d35-8e79-021f01d55c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63482c29-4a39-4eaa-9bf1-de6107d9b0f0", "name": "network-vif-plugged", "status": "completed", "tag": "a943b989-5a95-44a3-9a78-35384327a397"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:19.059788 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:19.059788 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:19.113093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-dce8d85b-31f4-492b-afdc-4aa2d9613f7c req-5146130d-c725-4d35-8e79-021f01d55c1e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:19.113093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-dce8d85b-31f4-492b-afdc-4aa2d9613f7c req-5146130d-c725-4d35-8e79-021f01d55c1e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:19.129581 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-dce8d85b-31f4-492b-afdc-4aa2d9613f7c req-5146130d-c725-4d35-8e79-021f01d55c1e service nova] Creating event network-vif-plugged:a943b989-5a95-44a3-9a78-35384327a397 for instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 on nch1-master-1 Feb 19 21:04:19.153728 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-dce8d85b-31f4-492b-afdc-4aa2d9613f7c req-5146130d-c725-4d35-8e79-021f01d55c1e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100424 Feb 19 21:04:19.156570 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1655/3205] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:19.173622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a116e380-6113-4e3a-a2f5-a1431e7a0fe2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:19.174880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a116e380-6113-4e3a-a2f5-a1431e7a0fe2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:19.192631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a116e380-6113-4e3a-a2f5-a1431e7a0fe2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:19.193786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a116e380-6113-4e3a-a2f5-a1431e7a0fe2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:19.195507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a116e380-6113-4e3a-a2f5-a1431e7a0fe2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:19.196659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a116e380-6113-4e3a-a2f5-a1431e7a0fe2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:19.227140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:19.246601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:19.249002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:19.250707 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8486f243-e11f-4a59-840e-505d4c854901 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1559 microversion: 2.21 time: 0.388377 Feb 19 21:04:19.251629 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1551/3206] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:18 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1559 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:19.260465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98039cbc-bbcc-4c28-928f-1b5fb0c8cc77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:19.261284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-98039cbc-bbcc-4c28-928f-1b5fb0c8cc77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:19.285523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98039cbc-bbcc-4c28-928f-1b5fb0c8cc77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:19.286940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98039cbc-bbcc-4c28-928f-1b5fb0c8cc77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:19.287961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98039cbc-bbcc-4c28-928f-1b5fb0c8cc77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:19.292171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98039cbc-bbcc-4c28-928f-1b5fb0c8cc77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:19.590281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a116e380-6113-4e3a-a2f5-a1431e7a0fe2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:19.596145 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a116e380-6113-4e3a-a2f5-a1431e7a0fe2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1527 microversion: 2.1 time: 0.434330 Feb 19 21:04:19.611689 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1656/3207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:19 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1527 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:19.611689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "14d8226a-6e83-4985-8f30-56d8f0e3e01f"}], "security_groups": [{"name": "tempest-securitygroup--640619504"}], "key_name": "tempest-keypair-194059251", "user_data": "}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:19.656116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98039cbc-bbcc-4c28-928f-1b5fb0c8cc77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:19.688839 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98039cbc-bbcc-4c28-928f-1b5fb0c8cc77 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1512 microversion: 2.1 time: 0.435794 Feb 19 21:04:19.693714 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1552/3208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:19 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1512 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:19.757157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-32dd1732-0ed9-4859-9c2e-9e75465459a0 req-cb29116f-8de9-4a1a-b0a5-9c5701ae6dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9424a60d-94ab-4f65-9532-2bf2781187b0", "name": "network-vif-deleted", "tag": "d9df7ee9-307b-45e6-a664-09b2b86bbcc0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:19.757157 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:19.757157 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:04:19.791425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-32dd1732-0ed9-4859-9c2e-9e75465459a0 req-cb29116f-8de9-4a1a-b0a5-9c5701ae6dad service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:19.792036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-32dd1732-0ed9-4859-9c2e-9e75465459a0 req-cb29116f-8de9-4a1a-b0a5-9c5701ae6dad service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:19.793143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] validate_networks() for [('14d8226a-6e83-4985-8f30-56d8f0e3e01f', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:04:19.832515 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-32dd1732-0ed9-4859-9c2e-9e75465459a0 req-cb29116f-8de9-4a1a-b0a5-9c5701ae6dad service nova] Creating event network-vif-deleted:d9df7ee9-307b-45e6-a664-09b2b86bbcc0 for instance 9424a60d-94ab-4f65-9532-2bf2781187b0 on nch1-master-1 Feb 19 21:04:19.850709 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-32dd1732-0ed9-4859-9c2e-9e75465459a0 req-cb29116f-8de9-4a1a-b0a5-9c5701ae6dad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104432 Feb 19 21:04:19.854904 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1553/3209] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:20.065987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c32c7a5-ba38-4333-a77a-6dff3720bb58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:20.066970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c32c7a5-ba38-4333-a77a-6dff3720bb58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:20.075987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c32c7a5-ba38-4333-a77a-6dff3720bb58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.076619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c32c7a5-ba38-4333-a77a-6dff3720bb58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.078119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c32c7a5-ba38-4333-a77a-6dff3720bb58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.078872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c32c7a5-ba38-4333-a77a-6dff3720bb58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.426505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c32c7a5-ba38-4333-a77a-6dff3720bb58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:20.437874 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c32c7a5-ba38-4333-a77a-6dff3720bb58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1317 microversion: 2.1 time: 0.375330 Feb 19 21:04:20.451797 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1554/3210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:20 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:20.453894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:20.457481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:20.477393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.478261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.480801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.481617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.571663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:04:20.573942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:04:20.574764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:04:20.575410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:04:20.576118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:04:20.587881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.588988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.590336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.590953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lazy-loading 'fault' on Instance uuid 9424a60d-94ab-4f65-9532-2bf2781187b0 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:04:20.591784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.615200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.615674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.644619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Getting quotas for project 6e59ada015584cc6b980ae55cedc2103. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:20.654856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Getting quotas for user 59ce7bfa9c454b3389ec787812495827 and project 6e59ada015584cc6b980ae55cedc2103. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:20.698026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:04:20.700888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:04:20.731032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:20.740787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:20.748363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88188e2c8b6043c0a884ebc8f2663bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8136be2d0a4abb81e8038390855add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:20.753939 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e9c5a06f-644c-4c1b-8e25-61e531242448 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 200 len: 1349 microversion: 2.21 time: 0.310498 Feb 19 21:04:20.756199 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1555/3211] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:20 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 1349 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:20.777174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e124e4d1-6a41-43b0-b8bc-b7039780e5e5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:20.778098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e124e4d1-6a41-43b0-b8bc-b7039780e5e5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:20.801036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e124e4d1-6a41-43b0-b8bc-b7039780e5e5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.803048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e124e4d1-6a41-43b0-b8bc-b7039780e5e5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.804607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e124e4d1-6a41-43b0-b8bc-b7039780e5e5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.805437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e124e4d1-6a41-43b0-b8bc-b7039780e5e5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.855185 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1e6c0bae-7ceb-4e09-bf24-0d01750a57ee tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.252176 Feb 19 21:04:20.855847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1657/3212] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:04:20.865444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c949bf9f-8f84-4b0a-9074-478bd3952a85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:20.867204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c949bf9f-8f84-4b0a-9074-478bd3952a85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:20.886309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c949bf9f-8f84-4b0a-9074-478bd3952a85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.886773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c949bf9f-8f84-4b0a-9074-478bd3952a85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:20.887582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c949bf9f-8f84-4b0a-9074-478bd3952a85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:20.888019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c949bf9f-8f84-4b0a-9074-478bd3952a85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:21.504447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c949bf9f-8f84-4b0a-9074-478bd3952a85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:21.520174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e124e4d1-6a41-43b0-b8bc-b7039780e5e5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:21.521172 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c949bf9f-8f84-4b0a-9074-478bd3952a85 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1489 microversion: 2.1 time: 0.662196 Feb 19 21:04:21.521172 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1658/3213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:20 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1489 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:21.532074 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e124e4d1-6a41-43b0-b8bc-b7039780e5e5 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1527 microversion: 2.1 time: 0.770131 Feb 19 21:04:21.533267 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1556/3214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:20 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1527 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:21.545476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c8c43420-5bb4-426a-b385-b65b0e72d529 req-4f877a56-aebc-4076-8012-5073e40c7767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b717b3c-e160-4a74-aff9-f1396031332d", "name": "network-vif-unplugged", "status": "completed", "tag": "773bb5fe-57ca-4ef3-bcd7-ea37656daaa9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:21.547472 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:21.547472 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:04:21.548384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5e0abed-3654-4a4b-8c62-2259a5d59009 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:21.550113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a5e0abed-3654-4a4b-8c62-2259a5d59009 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:21.561824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5e0abed-3654-4a4b-8c62-2259a5d59009 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:21.562958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5e0abed-3654-4a4b-8c62-2259a5d59009 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:21.564595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5e0abed-3654-4a4b-8c62-2259a5d59009 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:21.565045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5e0abed-3654-4a4b-8c62-2259a5d59009 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:21.566018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c8c43420-5bb4-426a-b385-b65b0e72d529 req-4f877a56-aebc-4076-8012-5073e40c7767 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:21.571192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c8c43420-5bb4-426a-b385-b65b0e72d529 req-4f877a56-aebc-4076-8012-5073e40c7767 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:21.585695 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c8c43420-5bb4-426a-b385-b65b0e72d529 req-4f877a56-aebc-4076-8012-5073e40c7767 service nova] Creating event network-vif-unplugged:773bb5fe-57ca-4ef3-bcd7-ea37656daaa9 for instance 7b717b3c-e160-4a74-aff9-f1396031332d on nch2-master-1 Feb 19 21:04:21.596830 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c8c43420-5bb4-426a-b385-b65b0e72d529 req-4f877a56-aebc-4076-8012-5073e40c7767 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058489 Feb 19 21:04:21.597939 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1557/3215] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:21.607108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9fc9b5c8-86b5-42e6-9bdc-8b568b03d27a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:21.607734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9fc9b5c8-86b5-42e6-9bdc-8b568b03d27a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:21.623748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fc9b5c8-86b5-42e6-9bdc-8b568b03d27a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:21.624437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fc9b5c8-86b5-42e6-9bdc-8b568b03d27a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:21.625483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fc9b5c8-86b5-42e6-9bdc-8b568b03d27a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:21.626132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fc9b5c8-86b5-42e6-9bdc-8b568b03d27a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.242675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a5e0abed-3654-4a4b-8c62-2259a5d59009 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:22.252309 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a5e0abed-3654-4a4b-8c62-2259a5d59009 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1221 microversion: 2.1 time: 0.716703 Feb 19 21:04:22.252938 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1659/3216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:21 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1221 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:22.257671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-930410fc-f908-4349-a09a-ac461c5c5cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:22.261427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-930410fc-f908-4349-a09a-ac461c5c5cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:22.272425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-930410fc-f908-4349-a09a-ac461c5c5cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.273080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-930410fc-f908-4349-a09a-ac461c5c5cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.274072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-930410fc-f908-4349-a09a-ac461c5c5cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.274755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-930410fc-f908-4349-a09a-ac461c5c5cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.353336 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-930410fc-f908-4349-a09a-ac461c5c5cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 200 len: 183 microversion: 2.1 time: 0.098904 Feb 19 21:04:22.354463 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1660/3217] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:22 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:22.360940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5304541b-3095-4f60-aa23-8b8d50afda47 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:22.361671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5304541b-3095-4f60-aa23-8b8d50afda47 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:22.382881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5304541b-3095-4f60-aa23-8b8d50afda47 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.383658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5304541b-3095-4f60-aa23-8b8d50afda47 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.384732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5304541b-3095-4f60-aa23-8b8d50afda47 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.385826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5304541b-3095-4f60-aa23-8b8d50afda47 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.408556 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-5304541b-3095-4f60-aa23-8b8d50afda47 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] HTTP exception thrown: Instance 9424a60d-94ab-4f65-9532-2bf2781187b0 could not be found. Feb 19 21:04:22.410219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5304541b-3095-4f60-aa23-8b8d50afda47 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Returning 404 to user: Instance 9424a60d-94ab-4f65-9532-2bf2781187b0 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:22.411335 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5304541b-3095-4f60-aa23-8b8d50afda47 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 404 len: 111 microversion: 2.21 time: 0.055548 Feb 19 21:04:22.412450 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1661/3218] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:22 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:04:22.417929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-71d986fd-5fdf-4003-b73f-45f9a31eb700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:22.418632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-71d986fd-5fdf-4003-b73f-45f9a31eb700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:22.426712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71d986fd-5fdf-4003-b73f-45f9a31eb700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.427366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71d986fd-5fdf-4003-b73f-45f9a31eb700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.428489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71d986fd-5fdf-4003-b73f-45f9a31eb700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.429123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71d986fd-5fdf-4003-b73f-45f9a31eb700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.690105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9fc9b5c8-86b5-42e6-9bdc-8b568b03d27a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:22.718443 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9fc9b5c8-86b5-42e6-9bdc-8b568b03d27a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 1.119123 Feb 19 21:04:22.719346 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1558/3219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:21 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:22.745355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ed44dab-4fb0-4ee4-8c91-fcea12fdccab tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '.version_select at 0x7f6467d05550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:22.746632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ed44dab-4fb0-4ee4-8c91-fcea12fdccab tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:22.762157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ed44dab-4fb0-4ee4-8c91-fcea12fdccab tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.762949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ed44dab-4fb0-4ee4-8c91-fcea12fdccab tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.764572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ed44dab-4fb0-4ee4-8c91-fcea12fdccab tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.765213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ed44dab-4fb0-4ee4-8c91-fcea12fdccab tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.883628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ed44dab-4fb0-4ee4-8c91-fcea12fdccab tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.162847 Feb 19 21:04:22.884464 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1559/3220] 10.222.0.30 () {60 vars in 1336 bytes} [Sat Feb 19 21:04:22 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0/os-instance-actions => generated 611 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:04:22.893171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f24cd68-b192-491e-960d-e983d9fcc9b3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:22.894029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f24cd68-b192-491e-960d-e983d9fcc9b3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:22.901639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f24cd68-b192-491e-960d-e983d9fcc9b3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.902421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f24cd68-b192-491e-960d-e983d9fcc9b3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:22.903415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f24cd68-b192-491e-960d-e983d9fcc9b3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:22.904026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f24cd68-b192-491e-960d-e983d9fcc9b3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:23.134761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-71d986fd-5fdf-4003-b73f-45f9a31eb700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:23.168798 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-71d986fd-5fdf-4003-b73f-45f9a31eb700 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.751666 Feb 19 21:04:23.169448 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1662/3221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:22 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:23.190908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-165382847", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:23.294191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] validate_networks() for [('757b2f5d-0080-4f9a-891f-7b8f3d47ca02', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:04:23.711815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f24cd68-b192-491e-960d-e983d9fcc9b3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:23.721078 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f24cd68-b192-491e-960d-e983d9fcc9b3 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 200 len: 1527 microversion: 2.1 time: 0.835425 Feb 19 21:04:23.734813 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1560/3222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:22 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 1527 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:23.740028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b6faa965-df14-498c-993f-906f26f7f0d8 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:23.741197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b6faa965-df14-498c-993f-906f26f7f0d8 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:23.747754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6faa965-df14-498c-993f-906f26f7f0d8 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:23.748543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6faa965-df14-498c-993f-906f26f7f0d8 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:23.749548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6faa965-df14-498c-993f-906f26f7f0d8 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:23.750189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6faa965-df14-498c-993f-906f26f7f0d8 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:23.766083 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-b6faa965-df14-498c-993f-906f26f7f0d8 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] HTTP exception thrown: Instance 9424a60d-94ab-4f65-9532-2bf2781187b0 could not be found. Feb 19 21:04:23.767021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b6faa965-df14-498c-993f-906f26f7f0d8 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Returning 404 to user: Instance 9424a60d-94ab-4f65-9532-2bf2781187b0 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:23.768091 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b6faa965-df14-498c-993f-906f26f7f0d8 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 404 len: 111 microversion: 2.21 time: 0.031859 Feb 19 21:04:23.769250 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1561/3223] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:04:23 2022] DELETE /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:04:23.774190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e47b941a-7b5f-4fd7-b525-b66b04ff5bc6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:23.775048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e47b941a-7b5f-4fd7-b525-b66b04ff5bc6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:23.785936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e47b941a-7b5f-4fd7-b525-b66b04ff5bc6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:23.788810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e47b941a-7b5f-4fd7-b525-b66b04ff5bc6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:23.794650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e47b941a-7b5f-4fd7-b525-b66b04ff5bc6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:23.795472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e47b941a-7b5f-4fd7-b525-b66b04ff5bc6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:24.304825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e47b941a-7b5f-4fd7-b525-b66b04ff5bc6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:24.327773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e47b941a-7b5f-4fd7-b525-b66b04ff5bc6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.557131 Feb 19 21:04:24.339707 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1562/3224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:23 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:24.339707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8b094a80-a1bf-4295-a815-b2b2ffadb64c tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:24.339707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8b094a80-a1bf-4295-a815-b2b2ffadb64c tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:24.354085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b094a80-a1bf-4295-a815-b2b2ffadb64c tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:24.354560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b094a80-a1bf-4295-a815-b2b2ffadb64c tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:24.355738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b094a80-a1bf-4295-a815-b2b2ffadb64c tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:24.356055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b094a80-a1bf-4295-a815-b2b2ffadb64c tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:24.588616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:04:24.589198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:04:24.589669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:04:24.590255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:04:24.590744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:04:24.601280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:24.601969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:24.602927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:24.604284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:24.666692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Getting quotas for project 5ee065d1c70940cd8caadd525737c593. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:24.672950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Getting quotas for user e36bd5d716db4dba866a1bcd880accb8 and project 5ee065d1c70940cd8caadd525737c593. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:24.712591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:04:24.715604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:04:24.809194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8b094a80-a1bf-4295-a815-b2b2ffadb64c tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:24.827940 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8b094a80-a1bf-4295-a815-b2b2ffadb64c tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1350 microversion: 2.1 time: 0.495350 Feb 19 21:04:24.829118 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1563/3225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:24 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1350 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:24.838940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e3962168-2006-4ec9-b926-c61a0b4ad881 req-7fa61ee5-945b-42a6-b5fe-7d2334349e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b717b3c-e160-4a74-aff9-f1396031332d", "name": "network-vif-deleted", "tag": "773bb5fe-57ca-4ef3-bcd7-ea37656daaa9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:24.849950 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:24.849950 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:04:24.861102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e3962168-2006-4ec9-b926-c61a0b4ad881 req-7fa61ee5-945b-42a6-b5fe-7d2334349e61 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:24.861976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e3962168-2006-4ec9-b926-c61a0b4ad881 req-7fa61ee5-945b-42a6-b5fe-7d2334349e61 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:24.868862 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-924507c8-6de1-43ab-a4b3-edef91bf60d5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686418 Feb 19 21:04:24.870556 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1663/3226] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:04:24.879312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fcab89bd-6785-4b5a-ad96-b6e800566922 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:24.881374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fcab89bd-6785-4b5a-ad96-b6e800566922 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] [instance: 9424a60d-94ab-4f65-9532-2bf2781187b0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:24.899089 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e3962168-2006-4ec9-b926-c61a0b4ad881 req-7fa61ee5-945b-42a6-b5fe-7d2334349e61 service nova] Creating event network-vif-deleted:773bb5fe-57ca-4ef3-bcd7-ea37656daaa9 for instance 7b717b3c-e160-4a74-aff9-f1396031332d on nch2-master-1 Feb 19 21:04:24.905600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fcab89bd-6785-4b5a-ad96-b6e800566922 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:24.906705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fcab89bd-6785-4b5a-ad96-b6e800566922 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:24.907754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fcab89bd-6785-4b5a-ad96-b6e800566922 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:24.908599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fcab89bd-6785-4b5a-ad96-b6e800566922 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:24.951510 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-fcab89bd-6785-4b5a-ad96-b6e800566922 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] HTTP exception thrown: Instance 9424a60d-94ab-4f65-9532-2bf2781187b0 could not be found. Feb 19 21:04:24.952397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fcab89bd-6785-4b5a-ad96-b6e800566922 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] Returning 404 to user: Instance 9424a60d-94ab-4f65-9532-2bf2781187b0 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:24.955449 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e3962168-2006-4ec9-b926-c61a0b4ad881 req-7fa61ee5-945b-42a6-b5fe-7d2334349e61 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119826 Feb 19 21:04:24.958581 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fcab89bd-6785-4b5a-ad96-b6e800566922 tempest-InstanceActionsV221TestJSON-545651857 tempest-InstanceActionsV221TestJSON-545651857-project] 10.222.0.30 "GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0" status: 404 len: 111 microversion: 2.21 time: 0.081810 Feb 19 21:04:24.959207 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1664/3227] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:24 2022] GET /compute/v2.1/servers/9424a60d-94ab-4f65-9532-2bf2781187b0 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:04:24.965243 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1564/3228] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:24.974638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-eb7a2c91-be9f-4f68-afa3-71d6f9d0055a req-3635ec21-7b80-4794-b2c8-ce8805011327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3addd2f6-24e1-4826-8f84-14355a67d407", "tag": "0f4a2e1e-4de3-4838-87c6-24936b87de02"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:24.976645 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:24.976645 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:24.981055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e2565405-84a5-4b71-9c4b-666a3c097583 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:24.985358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e2565405-84a5-4b71-9c4b-666a3c097583 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:25.003264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2565405-84a5-4b71-9c4b-666a3c097583 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:25.007838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2565405-84a5-4b71-9c4b-666a3c097583 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:25.011678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2565405-84a5-4b71-9c4b-666a3c097583 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:25.012503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2565405-84a5-4b71-9c4b-666a3c097583 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:25.014973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-eb7a2c91-be9f-4f68-afa3-71d6f9d0055a req-3635ec21-7b80-4794-b2c8-ce8805011327 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:25.016588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-eb7a2c91-be9f-4f68-afa3-71d6f9d0055a req-3635ec21-7b80-4794-b2c8-ce8805011327 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:25.049987 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-eb7a2c91-be9f-4f68-afa3-71d6f9d0055a req-3635ec21-7b80-4794-b2c8-ce8805011327 service nova] Creating event network-changed:0f4a2e1e-4de3-4838-87c6-24936b87de02 for instance 3addd2f6-24e1-4826-8f84-14355a67d407 on nch2-master-1 Feb 19 21:04:25.066171 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-eb7a2c91-be9f-4f68-afa3-71d6f9d0055a req-3635ec21-7b80-4794-b2c8-ce8805011327 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097384 Feb 19 21:04:25.072067 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1665/3229] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:25.102895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-440a39b0-4c03-48d5-a0bd-add48ae1c1b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:25.103852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-440a39b0-4c03-48d5-a0bd-add48ae1c1b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:25.121470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-440a39b0-4c03-48d5-a0bd-add48ae1c1b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:25.122394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-440a39b0-4c03-48d5-a0bd-add48ae1c1b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:25.123597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-440a39b0-4c03-48d5-a0bd-add48ae1c1b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:25.124266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-440a39b0-4c03-48d5-a0bd-add48ae1c1b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:25.172200 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-440a39b0-4c03-48d5-a0bd-add48ae1c1b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Instance 7b717b3c-e160-4a74-aff9-f1396031332d could not be found. Feb 19 21:04:25.173278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-440a39b0-4c03-48d5-a0bd-add48ae1c1b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Instance 7b717b3c-e160-4a74-aff9-f1396031332d could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:25.174135 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-440a39b0-4c03-48d5-a0bd-add48ae1c1b1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 404 len: 111 microversion: 2.1 time: 0.100099 Feb 19 21:04:25.191296 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1666/3230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:25 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:04:25.202867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe161877-80c2-4c46-928d-b53fce8407d3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:25.203415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fe161877-80c2-4c46-928d-b53fce8407d3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:25.358664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe161877-80c2-4c46-928d-b53fce8407d3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:25.382226 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fe161877-80c2-4c46-928d-b53fce8407d3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1216 microversion: 2.1 time: 0.186491 Feb 19 21:04:25.386053 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1667/3231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:25 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:25.412009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1772795628", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:25.510636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] validate_networks() for [('0ece0e80-c125-4eb8-a568-1d9e97f806cd', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:04:25.685390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e2565405-84a5-4b71-9c4b-666a3c097583 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:25.697953 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e2565405-84a5-4b71-9c4b-666a3c097583 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.730574 Feb 19 21:04:25.719568 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1565/3232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:24 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:25.732584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b0ae01b2-4ae8-443e-85fc-b79e84ba50f1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:25.740185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b0ae01b2-4ae8-443e-85fc-b79e84ba50f1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:25.751520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0ae01b2-4ae8-443e-85fc-b79e84ba50f1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:25.752083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0ae01b2-4ae8-443e-85fc-b79e84ba50f1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:25.755360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0ae01b2-4ae8-443e-85fc-b79e84ba50f1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:25.755965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0ae01b2-4ae8-443e-85fc-b79e84ba50f1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:26.293369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b0ae01b2-4ae8-443e-85fc-b79e84ba50f1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:26.301786 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b0ae01b2-4ae8-443e-85fc-b79e84ba50f1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.580233 Feb 19 21:04:26.313520 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1566/3233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:25 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:26.337668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19e77511-9c23-4ff2-8f28-e5ca044bc4da tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:26.342498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-19e77511-9c23-4ff2-8f28-e5ca044bc4da tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:26.350070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19e77511-9c23-4ff2-8f28-e5ca044bc4da tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:26.354175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19e77511-9c23-4ff2-8f28-e5ca044bc4da tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:26.359261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19e77511-9c23-4ff2-8f28-e5ca044bc4da tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:26.360210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19e77511-9c23-4ff2-8f28-e5ca044bc4da tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:26.746523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:04:26.747009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:04:26.747520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:04:26.747807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:04:26.748219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:04:26.761562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:26.762510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:26.763777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:26.764523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:26.784742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for project 8d34faf6add7400690171f1d097d5f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:26.789947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Getting quotas for user 5b13848e363e44b9927525ca9ca6fe81 and project 8d34faf6add7400690171f1d097d5f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:26.802855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:04:26.805237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:04:26.861785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-19e77511-9c23-4ff2-8f28-e5ca044bc4da tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:26.863796 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8f7e7eb1-6865-4ed7-b275-612c1e939494 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.458117 Feb 19 21:04:26.864476 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1668/3234] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:04:26.877301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-33a73b8e-7a38-420d-b9d8-d3a5d8b4d497 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:26.877919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-33a73b8e-7a38-420d-b9d8-d3a5d8b4d497 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:26.880613 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-19e77511-9c23-4ff2-8f28-e5ca044bc4da tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1350 microversion: 2.1 time: 0.546456 Feb 19 21:04:26.885453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33a73b8e-7a38-420d-b9d8-d3a5d8b4d497 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:26.886167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33a73b8e-7a38-420d-b9d8-d3a5d8b4d497 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:26.887134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33a73b8e-7a38-420d-b9d8-d3a5d8b4d497 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:26.887710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33a73b8e-7a38-420d-b9d8-d3a5d8b4d497 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:26.894051 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1567/3235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:26 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1350 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:26.903111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1215307488", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "10d49579-ce64-4d24-a5f5-a01170b84f25"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:26.988016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] validate_networks() for [('10d49579-ce64-4d24-a5f5-a01170b84f25', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:04:27.021554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-33a73b8e-7a38-420d-b9d8-d3a5d8b4d497 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:27.029985 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-33a73b8e-7a38-420d-b9d8-d3a5d8b4d497 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1274 microversion: 2.1 time: 0.164073 Feb 19 21:04:27.031254 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1669/3236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:26 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:27.041403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1747688703", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "a7720066-6763-4cf2-8422-94736652addc"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:27.123516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] validate_networks() for [('a7720066-6763-4cf2-8422-94736652addc', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:04:28.437528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:04:28.438874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:04:28.439510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:04:28.440219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:04:28.440810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:04:28.470137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.474283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.476006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.476648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.489452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:04:28.491344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:04:28.491961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:04:28.492504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:04:28.493001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:04:28.502076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Getting quotas for project ba9b396737a34280bdc448a2b0df5a7e. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:28.507907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Getting quotas for user 0edf621841d44514b6082172d15af2a7 and project ba9b396737a34280bdc448a2b0df5a7e. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:28.509736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.512903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.513957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.515919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.523994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:04:28.528561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:04:28.551948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:28.566170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for user fad7207822c04fc289709200d7e2bd2d and project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:28.584198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:04:28.587038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:04:28.622195 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-213710f1-d215-44fd-8357-81e7b31b03d4 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589359 Feb 19 21:04:28.624085 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1670/3237] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:04:28.630859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad24abdb-cbbb-4f51-a364-9fca0ace7bb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:28.631565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ad24abdb-cbbb-4f51-a364-9fca0ace7bb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:28.640879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad24abdb-cbbb-4f51-a364-9fca0ace7bb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.641479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad24abdb-cbbb-4f51-a364-9fca0ace7bb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.642558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad24abdb-cbbb-4f51-a364-9fca0ace7bb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.643360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad24abdb-cbbb-4f51-a364-9fca0ace7bb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.648029 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-225dcb9d-daf7-44ba-bd77-f9029d1e923c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.752554 Feb 19 21:04:28.655448 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1568/3238] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:04:28.664213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-64ed12c0-3d55-4f68-8edb-a2374d4d5d29 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:28.665142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-64ed12c0-3d55-4f68-8edb-a2374d4d5d29 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:28.672679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64ed12c0-3d55-4f68-8edb-a2374d4d5d29 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.673346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64ed12c0-3d55-4f68-8edb-a2374d4d5d29 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.674509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64ed12c0-3d55-4f68-8edb-a2374d4d5d29 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.675043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64ed12c0-3d55-4f68-8edb-a2374d4d5d29 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.777941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ad24abdb-cbbb-4f51-a364-9fca0ace7bb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:28.786130 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ad24abdb-cbbb-4f51-a364-9fca0ace7bb9 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1283 microversion: 2.1 time: 0.160804 Feb 19 21:04:28.790376 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1671/3239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:28 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1283 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:28.801026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b879c515-c36e-4d66-869e-58b9050e5e65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:28.803101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b879c515-c36e-4d66-869e-58b9050e5e65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:28.819484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b879c515-c36e-4d66-869e-58b9050e5e65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.824593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b879c515-c36e-4d66-869e-58b9050e5e65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.825811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b879c515-c36e-4d66-869e-58b9050e5e65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:28.828848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b879c515-c36e-4d66-869e-58b9050e5e65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:28.993259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64ed12c0-3d55-4f68-8edb-a2374d4d5d29 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:29.005020 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-64ed12c0-3d55-4f68-8edb-a2374d4d5d29 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1350 microversion: 2.1 time: 0.347884 Feb 19 21:04:29.015987 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1569/3240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:28 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1350 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:29.094469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b879c515-c36e-4d66-869e-58b9050e5e65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:29.102621 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b879c515-c36e-4d66-869e-58b9050e5e65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1316 microversion: 2.1 time: 0.305682 Feb 19 21:04:29.109112 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1672/3241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:28 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:29.120594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e87e66b3-2154-4ce7-8301-1edb7d930f69 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:29.121227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e87e66b3-2154-4ce7-8301-1edb7d930f69 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:29.214021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e87e66b3-2154-4ce7-8301-1edb7d930f69 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:29.221619 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e87e66b3-2154-4ce7-8301-1edb7d930f69 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1219 microversion: 2.1 time: 0.116411 Feb 19 21:04:29.226877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2131280050", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": "none"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:29.233476 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1673/3242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:29 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:29.239179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-782b2fdf-9689-4672-81bd-64fe478deaa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:29.239808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-782b2fdf-9689-4672-81bd-64fe478deaa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:29.316096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:04:29.316806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:04:29.317417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:04:29.317936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:04:29.318467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:04:29.328707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:29.329380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:29.330310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:29.330854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:29.348847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-782b2fdf-9689-4672-81bd-64fe478deaa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:29.358381 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-782b2fdf-9689-4672-81bd-64fe478deaa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1215 microversion: 2.1 time: 0.123735 Feb 19 21:04:29.359692 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1674/3243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:29 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:29.364973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Getting quotas for project 6192b12536cf4040bfcaac0f1bbdc8bf. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:29.371660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Getting quotas for user 27b29d136ead4a40b9c81787b96c567f and project 6192b12536cf4040bfcaac0f1bbdc8bf. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:29.390363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:04:29.394113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:04:29.448421 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-95733a74-9692-49a5-a080-77a0b7c77269 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.430902 Feb 19 21:04:29.449332 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1570/3244] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 21:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 21:04:29.463465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2650bcc0-c193-4517-8707-bcd502d9bc80 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:29.465391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2650bcc0-c193-4517-8707-bcd502d9bc80 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:29.567540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2650bcc0-c193-4517-8707-bcd502d9bc80 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:29.577500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2650bcc0-c193-4517-8707-bcd502d9bc80 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:29.579445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2650bcc0-c193-4517-8707-bcd502d9bc80 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:29.584499 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2650bcc0-c193-4517-8707-bcd502d9bc80 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1278 microversion: 2.54 time: 0.124580 Feb 19 21:04:29.596896 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1675/3245] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:29 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:29.807260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8b37ed42-f310-472b-a9a4-a4d4defaeedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:29.808105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8b37ed42-f310-472b-a9a4-a4d4defaeedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:29.815704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b37ed42-f310-472b-a9a4-a4d4defaeedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:29.816261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b37ed42-f310-472b-a9a4-a4d4defaeedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:29.817747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b37ed42-f310-472b-a9a4-a4d4defaeedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:29.818573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b37ed42-f310-472b-a9a4-a4d4defaeedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:29.897461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8b37ed42-f310-472b-a9a4-a4d4defaeedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:29.906436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-32b90959-06a9-4338-ad00-204174ae03a6 req-005566b4-a659-4464-bc45-0f0e187b1a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f813a2b-29b5-4a7d-9162-0e5b0971f8d8", "tag": "8691ea74-0542-4326-b0f9-09be241e16e5"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:29.908389 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:29.908389 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:29.919497 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8b37ed42-f310-472b-a9a4-a4d4defaeedf tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1283 microversion: 2.1 time: 0.117078 Feb 19 21:04:29.936258 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1571/3246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:29 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1283 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:29.938452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-32b90959-06a9-4338-ad00-204174ae03a6 req-005566b4-a659-4464-bc45-0f0e187b1a20 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:29.939094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-32b90959-06a9-4338-ad00-204174ae03a6 req-005566b4-a659-4464-bc45-0f0e187b1a20 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:29.952735 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-32b90959-06a9-4338-ad00-204174ae03a6 req-005566b4-a659-4464-bc45-0f0e187b1a20 service nova] Creating event network-changed:8691ea74-0542-4326-b0f9-09be241e16e5 for instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 on nch1-master-1 Feb 19 21:04:29.958342 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-32b90959-06a9-4338-ad00-204174ae03a6 req-005566b4-a659-4464-bc45-0f0e187b1a20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056328 Feb 19 21:04:29.959152 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1676/3247] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:30.026915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e82111fc-4207-404d-9875-fc8040c80aaf tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:30.029696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e82111fc-4207-404d-9875-fc8040c80aaf tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:30.038589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e82111fc-4207-404d-9875-fc8040c80aaf tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:30.039368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e82111fc-4207-404d-9875-fc8040c80aaf tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:30.040406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e82111fc-4207-404d-9875-fc8040c80aaf tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:30.041639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e82111fc-4207-404d-9875-fc8040c80aaf tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:30.123061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a4f3245b-0a25-4b47-8a8a-8cba207a86ec tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:30.123777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a4f3245b-0a25-4b47-8a8a-8cba207a86ec tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:30.137943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4f3245b-0a25-4b47-8a8a-8cba207a86ec tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:30.142980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4f3245b-0a25-4b47-8a8a-8cba207a86ec tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:30.144017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4f3245b-0a25-4b47-8a8a-8cba207a86ec tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:30.145883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4f3245b-0a25-4b47-8a8a-8cba207a86ec tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:30.526048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a4f3245b-0a25-4b47-8a8a-8cba207a86ec tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:30.537381 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a4f3245b-0a25-4b47-8a8a-8cba207a86ec tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1316 microversion: 2.1 time: 0.417905 Feb 19 21:04:30.537919 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1677/3248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:30 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:04:30.551557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6088e247-e0aa-4e95-af58-d9eb5729ea16 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:30.552457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6088e247-e0aa-4e95-af58-d9eb5729ea16 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:30.562458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6088e247-e0aa-4e95-af58-d9eb5729ea16 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:30.564168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6088e247-e0aa-4e95-af58-d9eb5729ea16 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:30.566527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6088e247-e0aa-4e95-af58-d9eb5729ea16 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:30.567638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6088e247-e0aa-4e95-af58-d9eb5729ea16 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:30.778906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6088e247-e0aa-4e95-af58-d9eb5729ea16 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:30.786991 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6088e247-e0aa-4e95-af58-d9eb5729ea16 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1277 microversion: 2.1 time: 0.248025 Feb 19 21:04:30.798047 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1678/3249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:30 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:30.803658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2831a1dc-831a-432c-8b11-54bac243e1d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:30.804614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2831a1dc-831a-432c-8b11-54bac243e1d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:30.817351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2831a1dc-831a-432c-8b11-54bac243e1d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:30.818794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2831a1dc-831a-432c-8b11-54bac243e1d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:30.820103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2831a1dc-831a-432c-8b11-54bac243e1d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:30.821692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2831a1dc-831a-432c-8b11-54bac243e1d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:30.987286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2831a1dc-831a-432c-8b11-54bac243e1d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:30.999919 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2831a1dc-831a-432c-8b11-54bac243e1d3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1273 microversion: 2.1 time: 0.198068 Feb 19 21:04:31.003817 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1679/3250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:30 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:31.010531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:31.017058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:31.018563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e82111fc-4207-404d-9875-fc8040c80aaf tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:31.033759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:31.034130 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e82111fc-4207-404d-9875-fc8040c80aaf tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1350 microversion: 2.1 time: 1.014588 Feb 19 21:04:31.034542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:31.038412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:31.038984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:31.059338 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1572/3251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:30 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1350 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:31.078360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-74576c32-d9a0-4313-809c-b618c7deb3f7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:31.081155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-74576c32-d9a0-4313-809c-b618c7deb3f7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:31.112300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74576c32-d9a0-4313-809c-b618c7deb3f7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:31.114958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74576c32-d9a0-4313-809c-b618c7deb3f7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:31.117975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74576c32-d9a0-4313-809c-b618c7deb3f7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:31.118449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74576c32-d9a0-4313-809c-b618c7deb3f7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:31.177163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:31.199221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:31.201316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:31.202711 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-59056417-82ca-40ab-a7fe-5da8b5b2216d tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1338 microversion: 2.54 time: 0.197621 Feb 19 21:04:31.207089 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1680/3252] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:31 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1338 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:31.556821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7602335d-2e4e-43ce-89ee-25552626e3c1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:31.557463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7602335d-2e4e-43ce-89ee-25552626e3c1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:31.566534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7602335d-2e4e-43ce-89ee-25552626e3c1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:31.567245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7602335d-2e4e-43ce-89ee-25552626e3c1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:31.568103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7602335d-2e4e-43ce-89ee-25552626e3c1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:31.568766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7602335d-2e4e-43ce-89ee-25552626e3c1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:31.709989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-74576c32-d9a0-4313-809c-b618c7deb3f7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:31.719037 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-74576c32-d9a0-4313-809c-b618c7deb3f7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1325 microversion: 2.1 time: 0.657762 Feb 19 21:04:31.720276 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1573/3253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:31 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1325 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:31.805361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0c4cdb93-2b55-487a-ae6b-979454aacc0f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:31.806469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0c4cdb93-2b55-487a-ae6b-979454aacc0f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:31.813569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c4cdb93-2b55-487a-ae6b-979454aacc0f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:31.814405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c4cdb93-2b55-487a-ae6b-979454aacc0f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:31.815444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c4cdb93-2b55-487a-ae6b-979454aacc0f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:31.816155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c4cdb93-2b55-487a-ae6b-979454aacc0f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:31.969056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0c4cdb93-2b55-487a-ae6b-979454aacc0f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:31.977840 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0c4cdb93-2b55-487a-ae6b-979454aacc0f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1277 microversion: 2.1 time: 0.176039 Feb 19 21:04:31.978932 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1574/3254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:31 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:04:32.020834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-17fe3898-c13c-4e9c-ac2c-1b9644f2b5ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:32.023963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-17fe3898-c13c-4e9c-ac2c-1b9644f2b5ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:32.034823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17fe3898-c13c-4e9c-ac2c-1b9644f2b5ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:32.035682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17fe3898-c13c-4e9c-ac2c-1b9644f2b5ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:32.036775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17fe3898-c13c-4e9c-ac2c-1b9644f2b5ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:32.038342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17fe3898-c13c-4e9c-ac2c-1b9644f2b5ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:32.180519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7602335d-2e4e-43ce-89ee-25552626e3c1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:32.195676 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7602335d-2e4e-43ce-89ee-25552626e3c1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1316 microversion: 2.1 time: 0.642930 Feb 19 21:04:32.196598 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1681/3255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:31 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:32.207298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e9dc75b6-f36a-4923-939c-dfbf3a7223f8 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:32.212103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e9dc75b6-f36a-4923-939c-dfbf3a7223f8 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:32.233320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9dc75b6-f36a-4923-939c-dfbf3a7223f8 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:32.235441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9dc75b6-f36a-4923-939c-dfbf3a7223f8 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:32.238040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9dc75b6-f36a-4923-939c-dfbf3a7223f8 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:32.238819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9dc75b6-f36a-4923-939c-dfbf3a7223f8 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:32.575936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-17fe3898-c13c-4e9c-ac2c-1b9644f2b5ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:32.592744 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-17fe3898-c13c-4e9c-ac2c-1b9644f2b5ae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1315 microversion: 2.1 time: 0.579000 Feb 19 21:04:32.593847 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1575/3256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:32 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:32.602388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:32.603845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:32.612249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:32.613063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:32.614252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:32.614856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:32.843316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:32.855004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:32.863954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:32.865616 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-628f4172-4f6c-42e7-ac52-27a260a713e0 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1336 microversion: 2.54 time: 0.270072 Feb 19 21:04:32.866417 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1576/3257] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:32 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1336 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:32.873005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a43156a7-49e2-4ec2-af3a-3576b4ae9e95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:32.873856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a43156a7-49e2-4ec2-af3a-3576b4ae9e95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:32.881563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43156a7-49e2-4ec2-af3a-3576b4ae9e95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:32.882734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43156a7-49e2-4ec2-af3a-3576b4ae9e95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:32.883883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43156a7-49e2-4ec2-af3a-3576b4ae9e95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:32.884580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43156a7-49e2-4ec2-af3a-3576b4ae9e95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:33.017062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e9dc75b6-f36a-4923-939c-dfbf3a7223f8 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:33.042609 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e9dc75b6-f36a-4923-939c-dfbf3a7223f8 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1350 microversion: 2.1 time: 0.841621 Feb 19 21:04:33.043653 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1682/3258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:32 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1350 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:33.051250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-bdb5a37c-0913-47a5-bc90-8866fb76340f req-3c3cb3f1-d82b-4826-8b09-ca0ed2a7589e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa", "tag": "a2e98664-86fb-479c-833e-f1ba8f71db2c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:33.053201 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:33.053201 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:33.064008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bdb5a37c-0913-47a5-bc90-8866fb76340f req-3c3cb3f1-d82b-4826-8b09-ca0ed2a7589e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:33.064941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bdb5a37c-0913-47a5-bc90-8866fb76340f req-3c3cb3f1-d82b-4826-8b09-ca0ed2a7589e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:33.085460 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-bdb5a37c-0913-47a5-bc90-8866fb76340f req-3c3cb3f1-d82b-4826-8b09-ca0ed2a7589e service nova] Creating event network-changed:a2e98664-86fb-479c-833e-f1ba8f71db2c for instance b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa on nch2-master-1 Feb 19 21:04:33.098490 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-bdb5a37c-0913-47a5-bc90-8866fb76340f req-3c3cb3f1-d82b-4826-8b09-ca0ed2a7589e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051882 Feb 19 21:04:33.099245 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1683/3259] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:33.105392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c2289106-5918-4b12-b13c-574ab2ba3e9b tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:33.108471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c2289106-5918-4b12-b13c-574ab2ba3e9b tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:33.115088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2289106-5918-4b12-b13c-574ab2ba3e9b tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:33.115547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2289106-5918-4b12-b13c-574ab2ba3e9b tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:33.116368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2289106-5918-4b12-b13c-574ab2ba3e9b tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:33.116811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2289106-5918-4b12-b13c-574ab2ba3e9b tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:33.750449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a43156a7-49e2-4ec2-af3a-3576b4ae9e95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:33.762192 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a43156a7-49e2-4ec2-af3a-3576b4ae9e95 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1325 microversion: 2.1 time: 0.893208 Feb 19 21:04:33.762992 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1577/3260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:32 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1325 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:33.773209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a14990c-3cdb-4d74-9075-6dbd75be08dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:33.774802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a14990c-3cdb-4d74-9075-6dbd75be08dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:33.781680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a14990c-3cdb-4d74-9075-6dbd75be08dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:33.782448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a14990c-3cdb-4d74-9075-6dbd75be08dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:33.783426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a14990c-3cdb-4d74-9075-6dbd75be08dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:33.784040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a14990c-3cdb-4d74-9075-6dbd75be08dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:33.954902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c2289106-5918-4b12-b13c-574ab2ba3e9b tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:33.971581 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c2289106-5918-4b12-b13c-574ab2ba3e9b tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1319 microversion: 2.1 time: 0.870732 Feb 19 21:04:33.972643 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1684/3261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:33 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1319 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:33.978005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-29a02376-2dce-4193-ae65-d24d20c6a386 req-0a99aa89-4bab-42b6-bb14-3714a199dd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3addd2f6-24e1-4826-8f84-14355a67d407", "name": "network-vif-plugged", "status": "completed", "tag": "0f4a2e1e-4de3-4838-87c6-24936b87de02"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:33.985912 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:33.985912 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:34.002718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-29a02376-2dce-4193-ae65-d24d20c6a386 req-0a99aa89-4bab-42b6-bb14-3714a199dd66 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:34.003158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-29a02376-2dce-4193-ae65-d24d20c6a386 req-0a99aa89-4bab-42b6-bb14-3714a199dd66 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:34.028435 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-29a02376-2dce-4193-ae65-d24d20c6a386 req-0a99aa89-4bab-42b6-bb14-3714a199dd66 service nova] Creating event network-vif-plugged:0f4a2e1e-4de3-4838-87c6-24936b87de02 for instance 3addd2f6-24e1-4826-8f84-14355a67d407 on nch2-master-1 Feb 19 21:04:34.034399 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-29a02376-2dce-4193-ae65-d24d20c6a386 req-0a99aa89-4bab-42b6-bb14-3714a199dd66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060045 Feb 19 21:04:34.035581 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1685/3262] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:34.040907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-79509876-275f-4003-9adc-87d3e86ba154 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:34.041738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-79509876-275f-4003-9adc-87d3e86ba154 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:34.049530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79509876-275f-4003-9adc-87d3e86ba154 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:34.050735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79509876-275f-4003-9adc-87d3e86ba154 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:34.051787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79509876-275f-4003-9adc-87d3e86ba154 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:34.052474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79509876-275f-4003-9adc-87d3e86ba154 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:34.089782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-79509876-275f-4003-9adc-87d3e86ba154 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lazy-loading 'flavor' on Instance uuid 17524174-4cfd-409a-b6f4-15bde7d2c4d1 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:04:34.442769 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-79509876-275f-4003-9adc-87d3e86ba154 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/action" status: 202 len: 0 microversion: 2.20 time: 0.405486 Feb 19 21:04:34.443558 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1686/3263] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 21:04:34 2022] POST /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:04:34.461641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1116dcb0-ffb2-41ba-b958-24fb178a21a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:34.465215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1116dcb0-ffb2-41ba-b958-24fb178a21a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:34.480007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1116dcb0-ffb2-41ba-b958-24fb178a21a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:34.482309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1116dcb0-ffb2-41ba-b958-24fb178a21a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:34.484041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1116dcb0-ffb2-41ba-b958-24fb178a21a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:34.486996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1116dcb0-ffb2-41ba-b958-24fb178a21a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:34.879407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9a14990c-3cdb-4d74-9075-6dbd75be08dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:34.888714 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a14990c-3cdb-4d74-9075-6dbd75be08dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1316 microversion: 2.1 time: 1.124241 Feb 19 21:04:34.889566 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1578/3264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:33 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1316 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:34.894860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:34.895684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:34.904014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:34.904542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:34.905461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:34.905933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:35.052793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:35.064592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:35.065780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:35.067361 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fde9d19c-6205-498b-862a-68e3452ae7db tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1357 microversion: 2.54 time: 0.176708 Feb 19 21:04:35.068576 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1579/3265] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:34 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:35.075021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fd8faed8-f6e5-4402-a4b6-8d8329f53a17 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:35.076002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fd8faed8-f6e5-4402-a4b6-8d8329f53a17 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:35.086927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd8faed8-f6e5-4402-a4b6-8d8329f53a17 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:35.087391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd8faed8-f6e5-4402-a4b6-8d8329f53a17 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:35.088276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd8faed8-f6e5-4402-a4b6-8d8329f53a17 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:35.088744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd8faed8-f6e5-4402-a4b6-8d8329f53a17 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:35.204779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1116dcb0-ffb2-41ba-b958-24fb178a21a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:35.214178 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1116dcb0-ffb2-41ba-b958-24fb178a21a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1315 microversion: 2.1 time: 0.768873 Feb 19 21:04:35.215293 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1687/3266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:34 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1315 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:35.220446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:35.221311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:35.227901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:35.229457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:35.230691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:35.231316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:35.533365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fd8faed8-f6e5-4402-a4b6-8d8329f53a17 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:35.541003 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fd8faed8-f6e5-4402-a4b6-8d8329f53a17 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1350 microversion: 2.1 time: 0.471020 Feb 19 21:04:35.541601 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1580/3267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:35 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1350 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:35.557163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e60ec2d4-a1ea-46f6-baa3-e2d85c7c1830 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:35.557785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e60ec2d4-a1ea-46f6-baa3-e2d85c7c1830 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:35.564269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e60ec2d4-a1ea-46f6-baa3-e2d85c7c1830 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:35.565021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e60ec2d4-a1ea-46f6-baa3-e2d85c7c1830 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:35.565992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e60ec2d4-a1ea-46f6-baa3-e2d85c7c1830 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:35.566615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e60ec2d4-a1ea-46f6-baa3-e2d85c7c1830 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:35.779157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:35.791238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:35.793943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:35.795463 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a0fddfb-f580-48a1-9219-ef5944318f77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1724 microversion: 2.20 time: 0.578839 Feb 19 21:04:35.796463 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1688/3268] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:35 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1724 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:35.801763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-db1a15cb-45f8-451d-b737-c869f1d8961a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:35.802789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-db1a15cb-45f8-451d-b737-c869f1d8961a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:35.813598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db1a15cb-45f8-451d-b737-c869f1d8961a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:35.816417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db1a15cb-45f8-451d-b737-c869f1d8961a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:35.817453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db1a15cb-45f8-451d-b737-c869f1d8961a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:35.818197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db1a15cb-45f8-451d-b737-c869f1d8961a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:36.125680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e60ec2d4-a1ea-46f6-baa3-e2d85c7c1830 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:36.140084 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e60ec2d4-a1ea-46f6-baa3-e2d85c7c1830 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1325 microversion: 2.1 time: 0.586458 Feb 19 21:04:36.161963 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1581/3269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:35 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1325 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:36.179497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-398f6e37-0df7-4445-b48e-c583d59eabbc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Action: 'create', calling method: .version_select at 0x7f6467cd2af0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-230664380"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:36.207453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-398f6e37-0df7-4445-b48e-c583d59eabbc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Getting quotas for project 6192b12536cf4040bfcaac0f1bbdc8bf. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:36.217001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-398f6e37-0df7-4445-b48e-c583d59eabbc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Getting quotas for user 27b29d136ead4a40b9c81787b96c567f and project 6192b12536cf4040bfcaac0f1bbdc8bf. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:36.278945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-db1a15cb-45f8-451d-b737-c869f1d8961a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:36.294161 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-db1a15cb-45f8-451d-b737-c869f1d8961a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1319 microversion: 2.1 time: 0.496202 Feb 19 21:04:36.294810 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1689/3270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:35 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:36.314030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a18c6667-6cf9-426e-9543-9f6ea0c63ce8 req-43d81567-e2aa-4ff8-8e18-04ecfd53019e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8176c128-5636-4ef2-bb6e-0c2af96e882d", "tag": "355bbacc-6aa0-48ce-94d5-58853a8dbe09"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:36.315733 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:36.315733 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:36.334272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a18c6667-6cf9-426e-9543-9f6ea0c63ce8 req-43d81567-e2aa-4ff8-8e18-04ecfd53019e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:36.341491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a18c6667-6cf9-426e-9543-9f6ea0c63ce8 req-43d81567-e2aa-4ff8-8e18-04ecfd53019e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:36.365735 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a18c6667-6cf9-426e-9543-9f6ea0c63ce8 req-43d81567-e2aa-4ff8-8e18-04ecfd53019e service nova] Creating event network-changed:355bbacc-6aa0-48ce-94d5-58853a8dbe09 for instance 8176c128-5636-4ef2-bb6e-0c2af96e882d on nch1-master-1 Feb 19 21:04:36.379732 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a18c6667-6cf9-426e-9543-9f6ea0c63ce8 req-43d81567-e2aa-4ff8-8e18-04ecfd53019e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080241 Feb 19 21:04:36.381612 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1690/3271] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:36.389199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bc78a253-5771-4f4c-8bbc-a2fb3eb7ee38 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:36.389943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bc78a253-5771-4f4c-8bbc-a2fb3eb7ee38 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:36.410731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc78a253-5771-4f4c-8bbc-a2fb3eb7ee38 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:36.412108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc78a253-5771-4f4c-8bbc-a2fb3eb7ee38 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:36.413693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc78a253-5771-4f4c-8bbc-a2fb3eb7ee38 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:36.416785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc78a253-5771-4f4c-8bbc-a2fb3eb7ee38 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:36.499522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-398f6e37-0df7-4445-b48e-c583d59eabbc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Getting quotas for project 6192b12536cf4040bfcaac0f1bbdc8bf. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:04:36.505328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-398f6e37-0df7-4445-b48e-c583d59eabbc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Getting quotas for user 27b29d136ead4a40b9c81787b96c567f and project 6192b12536cf4040bfcaac0f1bbdc8bf. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:04:36.523206 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-398f6e37-0df7-4445-b48e-c583d59eabbc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2334 microversion: 2.54 time: 0.359676 Feb 19 21:04:36.523836 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1582/3272] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Feb 19 21:04:36 2022] POST /compute/v2.1/os-keypairs => generated 2334 bytes in 361 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:04:36.529199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ebadca23-202d-4f41-8bb3-903cc0630c12 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:36.529964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ebadca23-202d-4f41-8bb3-903cc0630c12 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:36.537515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ebadca23-202d-4f41-8bb3-903cc0630c12 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:36.537897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ebadca23-202d-4f41-8bb3-903cc0630c12 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:36.538843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ebadca23-202d-4f41-8bb3-903cc0630c12 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:36.539283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ebadca23-202d-4f41-8bb3-903cc0630c12 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:36.991096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ebadca23-202d-4f41-8bb3-903cc0630c12 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:37.000623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bc78a253-5771-4f4c-8bbc-a2fb3eb7ee38 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:37.021918 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ebadca23-202d-4f41-8bb3-903cc0630c12 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1315 microversion: 2.1 time: 0.496985 Feb 19 21:04:37.023423 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bc78a253-5771-4f4c-8bbc-a2fb3eb7ee38 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1316 microversion: 2.1 time: 0.640330 Feb 19 21:04:37.024669 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1691/3273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:36 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:37.028653 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1583/3274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:36 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:37.035740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-700b69c1-1b8e-41ee-bfda-595ca089d928 req-3472a637-e8b1-40ac-91c3-7c6de71f6e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f813a2b-29b5-4a7d-9162-0e5b0971f8d8", "name": "network-vif-plugged", "status": "completed", "tag": "8691ea74-0542-4326-b0f9-09be241e16e5"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:37.037557 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:37.037557 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:37.039091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-230664380", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:37.040911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:37.053588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-700b69c1-1b8e-41ee-bfda-595ca089d928 req-3472a637-e8b1-40ac-91c3-7c6de71f6e51 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.055521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.056121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-700b69c1-1b8e-41ee-bfda-595ca089d928 req-3472a637-e8b1-40ac-91c3-7c6de71f6e51 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.059368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.060319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.061053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.083884 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-700b69c1-1b8e-41ee-bfda-595ca089d928 req-3472a637-e8b1-40ac-91c3-7c6de71f6e51 service nova] Creating event network-vif-plugged:8691ea74-0542-4326-b0f9-09be241e16e5 for instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 on nch1-master-1 Feb 19 21:04:37.096467 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-700b69c1-1b8e-41ee-bfda-595ca089d928 req-3472a637-e8b1-40ac-91c3-7c6de71f6e51 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066992 Feb 19 21:04:37.097405 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1692/3275] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:37.132192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-69a2036e-b649-4ab9-a83d-98094468f6ca tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:37.133188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-69a2036e-b649-4ab9-a83d-98094468f6ca tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:37.170518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69a2036e-b649-4ab9-a83d-98094468f6ca tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.171008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69a2036e-b649-4ab9-a83d-98094468f6ca tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.171819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69a2036e-b649-4ab9-a83d-98094468f6ca tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.172258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69a2036e-b649-4ab9-a83d-98094468f6ca tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.247713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:04:37.248316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:04:37.248782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:04:37.249211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:04:37.249625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:04:37.416550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:37.433114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.435225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.436993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.438024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.508617 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-246fa4d9-1bd6-4204-a77f-0be71d11c311 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "POST /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6/action" status: 202 len: 1139 microversion: 2.54 time: 0.469563 Feb 19 21:04:37.514277 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1584/3276] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Feb 19 21:04:37 2022] POST /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6/action => generated 1139 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Feb 19 21:04:37.550026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:37.553644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:37.569657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.569657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.569657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.569657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.881299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-69a2036e-b649-4ab9-a83d-98094468f6ca tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:37.899882 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-69a2036e-b649-4ab9-a83d-98094468f6ca tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1539 microversion: 2.1 time: 0.793828 Feb 19 21:04:37.917531 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1693/3277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:37 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1539 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:37.925975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2db33f5a-c929-458c-b7f8-05f7e588b178 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:37.927400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2db33f5a-c929-458c-b7f8-05f7e588b178 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:37.936687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2db33f5a-c929-458c-b7f8-05f7e588b178 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.937650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2db33f5a-c929-458c-b7f8-05f7e588b178 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:37.938764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2db33f5a-c929-458c-b7f8-05f7e588b178 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:37.939205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2db33f5a-c929-458c-b7f8-05f7e588b178 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.014066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:38.026802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:38.028340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:38.029554 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-210093bc-7e17-4f42-97a6-d7e9d81203d5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1724 microversion: 2.20 time: 0.513887 Feb 19 21:04:38.030141 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1585/3278] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:37 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1724 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:38.035149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d694f63c-5e40-45f0-8cad-c4715d22868e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:38.035822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d694f63c-5e40-45f0-8cad-c4715d22868e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:38.043749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d694f63c-5e40-45f0-8cad-c4715d22868e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.044561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d694f63c-5e40-45f0-8cad-c4715d22868e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.045568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d694f63c-5e40-45f0-8cad-c4715d22868e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.046334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d694f63c-5e40-45f0-8cad-c4715d22868e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.245598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2db33f5a-c929-458c-b7f8-05f7e588b178 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:38.253310 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2db33f5a-c929-458c-b7f8-05f7e588b178 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1325 microversion: 2.1 time: 0.334408 Feb 19 21:04:38.253914 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1694/3279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:37 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:38.263792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:38.263792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:38.271633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.273151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.276017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.280015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.421539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:38.432322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:38.434727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:38.435107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d694f63c-5e40-45f0-8cad-c4715d22868e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:38.437645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c48bc982-b3bd-41e4-8979-7fb88e0a6324 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.182528 Feb 19 21:04:38.454948 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d694f63c-5e40-45f0-8cad-c4715d22868e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1319 microversion: 2.1 time: 0.422207 Feb 19 21:04:38.456100 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1586/3280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:38 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:38.464240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cd2122b1-02a4-44ef-adb2-40d4f24bd1ba tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:38.464488 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1695/3281] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:38 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:38.465376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cd2122b1-02a4-44ef-adb2-40d4f24bd1ba tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:38.469439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd535cb9-1751-4172-9ab8-7924899f6b9f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:38.470056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fd535cb9-1751-4172-9ab8-7924899f6b9f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:38.474818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd2122b1-02a4-44ef-adb2-40d4f24bd1ba tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.475655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd2122b1-02a4-44ef-adb2-40d4f24bd1ba tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.476699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd2122b1-02a4-44ef-adb2-40d4f24bd1ba tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.477240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd2122b1-02a4-44ef-adb2-40d4f24bd1ba tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.499006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd535cb9-1751-4172-9ab8-7924899f6b9f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.499789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd535cb9-1751-4172-9ab8-7924899f6b9f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.505567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd535cb9-1751-4172-9ab8-7924899f6b9f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.506261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd535cb9-1751-4172-9ab8-7924899f6b9f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.729533 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cd2122b1-02a4-44ef-adb2-40d4f24bd1ba tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272115 Feb 19 21:04:38.730134 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1587/3282] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:04:38 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:38.742386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-01162d24-7e28-4f73-9dd6-01b66806b1dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:38.743338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-01162d24-7e28-4f73-9dd6-01b66806b1dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:38.755695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01162d24-7e28-4f73-9dd6-01b66806b1dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.756937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01162d24-7e28-4f73-9dd6-01b66806b1dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:38.757994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01162d24-7e28-4f73-9dd6-01b66806b1dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:38.758629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01162d24-7e28-4f73-9dd6-01b66806b1dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:39.357432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fd535cb9-1751-4172-9ab8-7924899f6b9f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:39.379919 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fd535cb9-1751-4172-9ab8-7924899f6b9f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1315 microversion: 2.1 time: 0.914113 Feb 19 21:04:39.394165 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1696/3283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:38 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:39.405753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-645525fe-4f93-46b5-90f5-79f32e693994 req-38d8eb9b-6a57-439a-b3a9-eae4601708d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb730c4e-37cc-47fd-a5c0-a4131d1990a9", "tag": "83b4b2cc-2908-4fac-942a-a2052608566d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:39.409271 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:39.409271 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:39.421844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-645525fe-4f93-46b5-90f5-79f32e693994 req-38d8eb9b-6a57-439a-b3a9-eae4601708d2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:39.422889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-645525fe-4f93-46b5-90f5-79f32e693994 req-38d8eb9b-6a57-439a-b3a9-eae4601708d2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:39.438996 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-645525fe-4f93-46b5-90f5-79f32e693994 req-38d8eb9b-6a57-439a-b3a9-eae4601708d2 service nova] Creating event network-changed:83b4b2cc-2908-4fac-942a-a2052608566d for instance cb730c4e-37cc-47fd-a5c0-a4131d1990a9 on nch1-master-1 Feb 19 21:04:39.451626 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-645525fe-4f93-46b5-90f5-79f32e693994 req-38d8eb9b-6a57-439a-b3a9-eae4601708d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052838 Feb 19 21:04:39.452545 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1697/3284] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:39.469935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:39.478415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:39.495362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:39.496114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:39.500727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:39.502548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:39.632827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-01162d24-7e28-4f73-9dd6-01b66806b1dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:39.646993 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-01162d24-7e28-4f73-9dd6-01b66806b1dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1316 microversion: 2.1 time: 0.908692 Feb 19 21:04:39.662674 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1588/3285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:38 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1316 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:39.669967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-86268ebe-c022-4e8d-a645-c9a7137b9b73 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:39.671078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-86268ebe-c022-4e8d-a645-c9a7137b9b73 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:39.686780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86268ebe-c022-4e8d-a645-c9a7137b9b73 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:39.687509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86268ebe-c022-4e8d-a645-c9a7137b9b73 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:39.690498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86268ebe-c022-4e8d-a645-c9a7137b9b73 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:39.692952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86268ebe-c022-4e8d-a645-c9a7137b9b73 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:40.205785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:40.227498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:40.233892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:40.235418 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c5b3e5d6-769f-4a88-8572-b0e5e0c9f993 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1724 microversion: 2.20 time: 0.781608 Feb 19 21:04:40.236795 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1698/3286] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:39 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1724 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:40.241514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:40.243009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:40.253187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:40.254704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:40.256032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:40.256965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:40.436948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:40.453570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:40.467246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:40.467246 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9cf794fe-365b-43ba-bbee-a9560d6e4abb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.224892 Feb 19 21:04:40.467246 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1699/3287] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:40 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:40.484744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e226aba7-7e48-4c45-9e16-2170685e89df tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:40.485386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e226aba7-7e48-4c45-9e16-2170685e89df tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:40.495672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e226aba7-7e48-4c45-9e16-2170685e89df tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:40.497000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e226aba7-7e48-4c45-9e16-2170685e89df tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:40.504971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e226aba7-7e48-4c45-9e16-2170685e89df tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:40.505392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e226aba7-7e48-4c45-9e16-2170685e89df tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:40.537350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-86268ebe-c022-4e8d-a645-c9a7137b9b73 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:40.553343 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-86268ebe-c022-4e8d-a645-c9a7137b9b73 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1325 microversion: 2.1 time: 0.889091 Feb 19 21:04:40.554239 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1589/3288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:39 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1325 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:40.570688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e5e291ad-0536-4be6-861a-82f8d1afccef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:40.573200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e5e291ad-0536-4be6-861a-82f8d1afccef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:40.603723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5e291ad-0536-4be6-861a-82f8d1afccef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:40.606106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5e291ad-0536-4be6-861a-82f8d1afccef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:40.606639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5e291ad-0536-4be6-861a-82f8d1afccef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:40.607087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e5e291ad-0536-4be6-861a-82f8d1afccef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:41.223465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e226aba7-7e48-4c45-9e16-2170685e89df tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:41.231655 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e226aba7-7e48-4c45-9e16-2170685e89df tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1319 microversion: 2.1 time: 0.766628 Feb 19 21:04:41.238482 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1700/3289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:40 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1319 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:41.251696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3c5e2b9-cb3d-4cb0-8d4f-ff3758788726 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:41.251696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e3c5e2b9-cb3d-4cb0-8d4f-ff3758788726 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:41.268114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3c5e2b9-cb3d-4cb0-8d4f-ff3758788726 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:41.268667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3c5e2b9-cb3d-4cb0-8d4f-ff3758788726 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:41.269487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3c5e2b9-cb3d-4cb0-8d4f-ff3758788726 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:41.269934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3c5e2b9-cb3d-4cb0-8d4f-ff3758788726 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:41.327530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e5e291ad-0536-4be6-861a-82f8d1afccef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:41.349077 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e5e291ad-0536-4be6-861a-82f8d1afccef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1315 microversion: 2.1 time: 0.787620 Feb 19 21:04:41.351207 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1590/3290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:40 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:41.360887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:41.361950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:41.375822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:41.376522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:41.377502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:41.377936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:41.758374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e3c5e2b9-cb3d-4cb0-8d4f-ff3758788726 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:41.779390 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e3c5e2b9-cb3d-4cb0-8d4f-ff3758788726 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1505 microversion: 2.1 time: 0.539779 Feb 19 21:04:41.780259 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1701/3291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:41 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:41.787832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-10a1970e-9ccc-4a09-9798-1fdc0fd01496 req-1c71207a-1a9a-4007-a548-ced4cd8cd709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa", "name": "network-vif-plugged", "status": "completed", "tag": "a2e98664-86fb-479c-833e-f1ba8f71db2c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:41.789950 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:41.789950 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:41.799396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-10a1970e-9ccc-4a09-9798-1fdc0fd01496 req-1c71207a-1a9a-4007-a548-ced4cd8cd709 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:41.800046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-10a1970e-9ccc-4a09-9798-1fdc0fd01496 req-1c71207a-1a9a-4007-a548-ced4cd8cd709 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:41.817718 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-10a1970e-9ccc-4a09-9798-1fdc0fd01496 req-1c71207a-1a9a-4007-a548-ced4cd8cd709 service nova] Creating event network-vif-plugged:a2e98664-86fb-479c-833e-f1ba8f71db2c for instance b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa on nch2-master-1 Feb 19 21:04:41.825401 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-10a1970e-9ccc-4a09-9798-1fdc0fd01496 req-1c71207a-1a9a-4007-a548-ced4cd8cd709 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043211 Feb 19 21:04:41.826945 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1702/3292] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:41.836569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:41.838024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:41.846672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:41.847419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:41.848680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:41.849689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:41.890847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:41.947505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:41.949641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:41.951636 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d61ef9b3-b444-4fe8-af59-e5b10ff78572 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1724 microversion: 2.20 time: 0.599118 Feb 19 21:04:41.952763 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1591/3293] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:41 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1724 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:41.959793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-92e1bc39-922b-4003-a296-5d9e1a205b55 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:41.964456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-92e1bc39-922b-4003-a296-5d9e1a205b55 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:41.984988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92e1bc39-922b-4003-a296-5d9e1a205b55 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:41.985845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92e1bc39-922b-4003-a296-5d9e1a205b55 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:41.987411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92e1bc39-922b-4003-a296-5d9e1a205b55 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:41.988117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92e1bc39-922b-4003-a296-5d9e1a205b55 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.148161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:42.167008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:42.169918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:42.172041 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2ba0bf77-69c1-4adf-bb41-209ef6b8f0bb tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.343384 Feb 19 21:04:42.175791 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1703/3294] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:41 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:42.188954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c180343-25da-4008-ac7c-9a5623d0fdd9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:42.189221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c180343-25da-4008-ac7c-9a5623d0fdd9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:42.204913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c180343-25da-4008-ac7c-9a5623d0fdd9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:42.206282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c180343-25da-4008-ac7c-9a5623d0fdd9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.207809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c180343-25da-4008-ac7c-9a5623d0fdd9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:42.208456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c180343-25da-4008-ac7c-9a5623d0fdd9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.262673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c180343-25da-4008-ac7c-9a5623d0fdd9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:04:42.361614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-92e1bc39-922b-4003-a296-5d9e1a205b55 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:42.369353 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-92e1bc39-922b-4003-a296-5d9e1a205b55 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1325 microversion: 2.1 time: 0.415129 Feb 19 21:04:42.369954 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1592/3295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:41 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1325 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:42.378755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11cd7e86-96b3-4d56-bb83-06b7c5748c2d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:42.386261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11cd7e86-96b3-4d56-bb83-06b7c5748c2d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:42.396194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11cd7e86-96b3-4d56-bb83-06b7c5748c2d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:42.396934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11cd7e86-96b3-4d56-bb83-06b7c5748c2d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.398137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11cd7e86-96b3-4d56-bb83-06b7c5748c2d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:42.398756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11cd7e86-96b3-4d56-bb83-06b7c5748c2d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.413482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c180343-25da-4008-ac7c-9a5623d0fdd9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 204 len: 0 microversion: 2.1 time: 0.235179 Feb 19 21:04:42.421332 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1704/3296] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:04:42 2022] DELETE /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:04:42.434805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6330fd94-5664-43ad-ab48-731914fdd6e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:42.435557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6330fd94-5664-43ad-ab48-731914fdd6e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:42.450416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6330fd94-5664-43ad-ab48-731914fdd6e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:42.453658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6330fd94-5664-43ad-ab48-731914fdd6e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.454741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6330fd94-5664-43ad-ab48-731914fdd6e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:42.455273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6330fd94-5664-43ad-ab48-731914fdd6e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.759103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11cd7e86-96b3-4d56-bb83-06b7c5748c2d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:42.772906 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11cd7e86-96b3-4d56-bb83-06b7c5748c2d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1319 microversion: 2.1 time: 0.397571 Feb 19 21:04:42.784363 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1593/3297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:42 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:42.784363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8ef1b637-9b9c-4778-bcca-e9e47a33a57f req-8b1886c4-24a4-4bb3-8360-2739a634f54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3addd2f6-24e1-4826-8f84-14355a67d407", "tag": "0f4a2e1e-4de3-4838-87c6-24936b87de02"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:42.784363 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:42.784363 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:04:42.794873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6330fd94-5664-43ad-ab48-731914fdd6e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:42.808173 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6330fd94-5664-43ad-ab48-731914fdd6e0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1315 microversion: 2.1 time: 0.385058 Feb 19 21:04:42.809587 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1705/3298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:42 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:42.810283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8ef1b637-9b9c-4778-bcca-e9e47a33a57f req-8b1886c4-24a4-4bb3-8360-2739a634f54b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:42.810746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8ef1b637-9b9c-4778-bcca-e9e47a33a57f req-8b1886c4-24a4-4bb3-8360-2739a634f54b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.818948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-35d72b97-cad3-4eb4-8937-3369e6a3a4c3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:42.822913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-35d72b97-cad3-4eb4-8937-3369e6a3a4c3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:42.830378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35d72b97-cad3-4eb4-8937-3369e6a3a4c3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:42.830856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35d72b97-cad3-4eb4-8937-3369e6a3a4c3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.831671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35d72b97-cad3-4eb4-8937-3369e6a3a4c3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:42.832090 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8ef1b637-9b9c-4778-bcca-e9e47a33a57f req-8b1886c4-24a4-4bb3-8360-2739a634f54b service nova] Creating event network-changed:0f4a2e1e-4de3-4838-87c6-24936b87de02 for instance 3addd2f6-24e1-4826-8f84-14355a67d407 on nch2-master-1 Feb 19 21:04:42.832209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35d72b97-cad3-4eb4-8937-3369e6a3a4c3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:42.838188 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8ef1b637-9b9c-4778-bcca-e9e47a33a57f req-8b1886c4-24a4-4bb3-8360-2739a634f54b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062493 Feb 19 21:04:42.839265 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1594/3299] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:42.987840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:42.989371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:43.001175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.003640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:43.006251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.007294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:43.052164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-35d72b97-cad3-4eb4-8937-3369e6a3a4c3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:43.062726 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-35d72b97-cad3-4eb4-8937-3369e6a3a4c3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1511 microversion: 2.1 time: 0.251482 Feb 19 21:04:43.063589 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1706/3300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:42 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1511 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:43.195569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:43.196203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:43.218920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.219829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:43.219965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:43.221095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.221716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:43.229859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:43.233160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:43.238711 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-82d59ca6-ec30-4878-baf7-ebbbab8311c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1724 microversion: 2.20 time: 0.254739 Feb 19 21:04:43.251872 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1595/3301] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:42 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:43.349435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:43.372508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:43.376840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:43.378403 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-529fa937-4692-4ff9-8a3d-410921f89c81 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.187442 Feb 19 21:04:43.379571 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1707/3302] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:43 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:43.419558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-33f450f4-ba64-45a7-843b-def7560348b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:43.422007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-33f450f4-ba64-45a7-843b-def7560348b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:43.448818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33f450f4-ba64-45a7-843b-def7560348b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.451488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33f450f4-ba64-45a7-843b-def7560348b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:43.458718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33f450f4-ba64-45a7-843b-def7560348b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.459567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33f450f4-ba64-45a7-843b-def7560348b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:43.795929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-33f450f4-ba64-45a7-843b-def7560348b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:43.806035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c295f027-711d-4fc8-98e7-5f9e4dba34b5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:43.807948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c295f027-711d-4fc8-98e7-5f9e4dba34b5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:43.818822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c295f027-711d-4fc8-98e7-5f9e4dba34b5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.819642 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-33f450f4-ba64-45a7-843b-def7560348b2 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1325 microversion: 2.1 time: 0.425082 Feb 19 21:04:43.820009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c295f027-711d-4fc8-98e7-5f9e4dba34b5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:43.820940 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1596/3303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:43 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1325 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:43.821522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c295f027-711d-4fc8-98e7-5f9e4dba34b5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.822226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c295f027-711d-4fc8-98e7-5f9e4dba34b5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:43.834982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5316ba4-9fd1-45c1-b9d8-68c52ba1853a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:43.835625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b5316ba4-9fd1-45c1-b9d8-68c52ba1853a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:43.854643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5316ba4-9fd1-45c1-b9d8-68c52ba1853a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.855666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5316ba4-9fd1-45c1-b9d8-68c52ba1853a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:43.857216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5316ba4-9fd1-45c1-b9d8-68c52ba1853a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:43.858322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5316ba4-9fd1-45c1-b9d8-68c52ba1853a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:44.166801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c295f027-711d-4fc8-98e7-5f9e4dba34b5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:44.184224 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c295f027-711d-4fc8-98e7-5f9e4dba34b5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1319 microversion: 2.1 time: 0.382846 Feb 19 21:04:44.207147 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1708/3304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:43 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:04:44.211961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ac8e6ac9-eaf5-42fa-9044-9fbd36d3a27b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:44.213899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ac8e6ac9-eaf5-42fa-9044-9fbd36d3a27b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:44.228836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac8e6ac9-eaf5-42fa-9044-9fbd36d3a27b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:44.229624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac8e6ac9-eaf5-42fa-9044-9fbd36d3a27b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:44.230639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac8e6ac9-eaf5-42fa-9044-9fbd36d3a27b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:44.232824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac8e6ac9-eaf5-42fa-9044-9fbd36d3a27b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:44.815844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b5316ba4-9fd1-45c1-b9d8-68c52ba1853a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:44.827004 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b5316ba4-9fd1-45c1-b9d8-68c52ba1853a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1315 microversion: 2.1 time: 0.996636 Feb 19 21:04:44.828427 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1597/3305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:43 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:04:44.841304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:44.842863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:44.857230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:44.858630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:44.860799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:44.861994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:45.204071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ac8e6ac9-eaf5-42fa-9044-9fbd36d3a27b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:45.214065 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ac8e6ac9-eaf5-42fa-9044-9fbd36d3a27b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1511 microversion: 2.1 time: 1.005830 Feb 19 21:04:45.214657 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1709/3306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:44 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1511 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:45.227929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:45.228615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:45.235680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:45.236131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:45.237059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:45.237402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:45.368862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:45.377585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:45.379105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:45.380311 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-de76ecd7-a80a-48a3-9204-ce6c69bea94b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.164666 Feb 19 21:04:45.380916 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1710/3307] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:45 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:45.386434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-cc4879ce-55e8-4bd2-9391-2a7f9b3c06fc req-37622697-4d23-474f-af31-d78dd9120cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8176c128-5636-4ef2-bb6e-0c2af96e882d", "name": "network-vif-plugged", "status": "completed", "tag": "355bbacc-6aa0-48ce-94d5-58853a8dbe09"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:45.387992 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:45.387992 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:45.395388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:45.396890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cc4879ce-55e8-4bd2-9391-2a7f9b3c06fc req-37622697-4d23-474f-af31-d78dd9120cc9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:45.397357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cc4879ce-55e8-4bd2-9391-2a7f9b3c06fc req-37622697-4d23-474f-af31-d78dd9120cc9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:45.406333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:45.407917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:45.409218 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e45b251d-16cf-4cd4-9910-882556815cb4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1724 microversion: 2.20 time: 0.579041 Feb 19 21:04:45.409997 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1598/3308] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:44 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1724 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:45.415874 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-cc4879ce-55e8-4bd2-9391-2a7f9b3c06fc req-37622697-4d23-474f-af31-d78dd9120cc9 service nova] Creating event network-vif-plugged:355bbacc-6aa0-48ce-94d5-58853a8dbe09 for instance 8176c128-5636-4ef2-bb6e-0c2af96e882d on nch1-master-1 Feb 19 21:04:45.416009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9d782647-2c7c-4629-8b82-c01cc84340b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:45.416009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9d782647-2c7c-4629-8b82-c01cc84340b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:45.421435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d782647-2c7c-4629-8b82-c01cc84340b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:45.421890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d782647-2c7c-4629-8b82-c01cc84340b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:45.423014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d782647-2c7c-4629-8b82-c01cc84340b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:45.423617 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-cc4879ce-55e8-4bd2-9391-2a7f9b3c06fc req-37622697-4d23-474f-af31-d78dd9120cc9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041403 Feb 19 21:04:45.423783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d782647-2c7c-4629-8b82-c01cc84340b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:45.424450 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1711/3309] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:45.432836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-23ed5f0c-d98e-4460-9398-2a177e5d2d68 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:45.434224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-23ed5f0c-d98e-4460-9398-2a177e5d2d68 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:45.442914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23ed5f0c-d98e-4460-9398-2a177e5d2d68 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:45.443377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23ed5f0c-d98e-4460-9398-2a177e5d2d68 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:45.444181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23ed5f0c-d98e-4460-9398-2a177e5d2d68 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:45.444650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23ed5f0c-d98e-4460-9398-2a177e5d2d68 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:45.946512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9d782647-2c7c-4629-8b82-c01cc84340b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:45.959637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-23ed5f0c-d98e-4460-9398-2a177e5d2d68 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:45.965793 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9d782647-2c7c-4629-8b82-c01cc84340b7 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1522 microversion: 2.1 time: 0.554317 Feb 19 21:04:45.972504 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-23ed5f0c-d98e-4460-9398-2a177e5d2d68 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1319 microversion: 2.1 time: 0.545742 Feb 19 21:04:45.974102 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1712/3311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:45 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:45.974327 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1599/3311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:45 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1522 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:45.983737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-90c696b1-78ed-4472-8ea8-51a73135e584 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:45.984413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-90c696b1-78ed-4472-8ea8-51a73135e584 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:45.997830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8dd9af9a-9439-4d57-96aa-4c301d458eff tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:45.998343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8dd9af9a-9439-4d57-96aa-4c301d458eff tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:45.999411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90c696b1-78ed-4472-8ea8-51a73135e584 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:45.999876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90c696b1-78ed-4472-8ea8-51a73135e584 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.002934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90c696b1-78ed-4472-8ea8-51a73135e584 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.005105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90c696b1-78ed-4472-8ea8-51a73135e584 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.005583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dd9af9a-9439-4d57-96aa-4c301d458eff tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.006246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dd9af9a-9439-4d57-96aa-4c301d458eff tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.007252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dd9af9a-9439-4d57-96aa-4c301d458eff tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.007880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dd9af9a-9439-4d57-96aa-4c301d458eff tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.047182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8dd9af9a-9439-4d57-96aa-4c301d458eff tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:04:46.264718 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8dd9af9a-9439-4d57-96aa-4c301d458eff tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 204 len: 0 microversion: 2.1 time: 0.269571 Feb 19 21:04:46.269963 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1713/3312] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:04:45 2022] DELETE /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:04:46.283562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7ae326cd-2abe-48c4-945c-562f4887e5e4 req-6c57f6d9-0ed7-4a8a-8090-efe8cb8d5cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f813a2b-29b5-4a7d-9162-0e5b0971f8d8", "name": "network-vif-deleted", "tag": "8691ea74-0542-4326-b0f9-09be241e16e5"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:46.288032 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:46.288032 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:46.308657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7ae326cd-2abe-48c4-945c-562f4887e5e4 req-6c57f6d9-0ed7-4a8a-8090-efe8cb8d5cf3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.309143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7ae326cd-2abe-48c4-945c-562f4887e5e4 req-6c57f6d9-0ed7-4a8a-8090-efe8cb8d5cf3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.350191 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7ae326cd-2abe-48c4-945c-562f4887e5e4 req-6c57f6d9-0ed7-4a8a-8090-efe8cb8d5cf3 service nova] Creating event network-vif-deleted:8691ea74-0542-4326-b0f9-09be241e16e5 for instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 on nch1-master-1 Feb 19 21:04:46.351757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-90c696b1-78ed-4472-8ea8-51a73135e584 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:46.359382 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7ae326cd-2abe-48c4-945c-562f4887e5e4 req-6c57f6d9-0ed7-4a8a-8090-efe8cb8d5cf3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085693 Feb 19 21:04:46.361221 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1714/3313] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:46.371842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:46.373460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:46.376162 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-90c696b1-78ed-4472-8ea8-51a73135e584 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1315 microversion: 2.1 time: 0.400350 Feb 19 21:04:46.378237 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1600/3314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:45 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:46.389245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3276474e-6707-4af1-938c-f460ffbda67c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:46.390204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3276474e-6707-4af1-938c-f460ffbda67c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:46.404107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.404685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.406079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.406835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.413623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3276474e-6707-4af1-938c-f460ffbda67c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.415940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3276474e-6707-4af1-938c-f460ffbda67c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.416908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3276474e-6707-4af1-938c-f460ffbda67c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.423749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3276474e-6707-4af1-938c-f460ffbda67c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.467935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.473572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.475419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lazy-loading 'fault' on Instance uuid 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:04:46.570851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:46.589511 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-511c5618-1acd-43d7-b59b-fc8f3bcc2330 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 200 len: 1306 microversion: 2.1 time: 0.226371 Feb 19 21:04:46.599799 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1715/3315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:46 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:46.606678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:46.607345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:46.621561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.622200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.623208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.624028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.676432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3276474e-6707-4af1-938c-f460ffbda67c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:46.688876 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3276474e-6707-4af1-938c-f460ffbda67c tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1528 microversion: 2.1 time: 0.308022 Feb 19 21:04:46.696983 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1601/3316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:46 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1528 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:46.706098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:46.708462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:46.741410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.741933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.742875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:46.743452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:46.745141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:46.756365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:46.758010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:46.759458 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6d0d8c0a-c15b-4b13-8311-3fa3e021f3be tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.157923 Feb 19 21:04:46.761951 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1716/3317] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:46 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:46.992912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:46.994225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f792a7a-75d1-4232-85db-904d52619937 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:46.994770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3f792a7a-75d1-4232-85db-904d52619937 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:47.002661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f792a7a-75d1-4232-85db-904d52619937 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.003440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f792a7a-75d1-4232-85db-904d52619937 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.004093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:47.004792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f792a7a-75d1-4232-85db-904d52619937 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.005463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f792a7a-75d1-4232-85db-904d52619937 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.005939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:47.007361 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6827ccdc-6d8d-4de4-b912-84d4fdca2e60 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1745 microversion: 2.20 time: 0.308613 Feb 19 21:04:47.020609 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1602/3318] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:46 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1745 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:47.210185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3f792a7a-75d1-4232-85db-904d52619937 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:47.231995 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f792a7a-75d1-4232-85db-904d52619937 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1319 microversion: 2.1 time: 0.240463 Feb 19 21:04:47.232844 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1717/3319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:46 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:47.407546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c076e461-3db0-49ce-ad88-91c5f55dad5a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:47.408080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c076e461-3db0-49ce-ad88-91c5f55dad5a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:47.416857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c076e461-3db0-49ce-ad88-91c5f55dad5a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.417319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c076e461-3db0-49ce-ad88-91c5f55dad5a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.418647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c076e461-3db0-49ce-ad88-91c5f55dad5a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.419324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c076e461-3db0-49ce-ad88-91c5f55dad5a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.440630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e93f5e3e-3568-4718-8b06-daa6ff7becb5 req-782d5372-39ab-4526-8c62-73b84dd0f7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb730c4e-37cc-47fd-a5c0-a4131d1990a9", "name": "network-vif-plugged", "status": "completed", "tag": "83b4b2cc-2908-4fac-942a-a2052608566d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:47.443212 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:47.443212 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:47.456305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e93f5e3e-3568-4718-8b06-daa6ff7becb5 req-782d5372-39ab-4526-8c62-73b84dd0f7eb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.456776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e93f5e3e-3568-4718-8b06-daa6ff7becb5 req-782d5372-39ab-4526-8c62-73b84dd0f7eb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.470948 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e93f5e3e-3568-4718-8b06-daa6ff7becb5 req-782d5372-39ab-4526-8c62-73b84dd0f7eb service nova] Creating event network-vif-plugged:83b4b2cc-2908-4fac-942a-a2052608566d for instance cb730c4e-37cc-47fd-a5c0-a4131d1990a9 on nch1-master-1 Feb 19 21:04:47.479940 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e93f5e3e-3568-4718-8b06-daa6ff7becb5 req-782d5372-39ab-4526-8c62-73b84dd0f7eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043282 Feb 19 21:04:47.485684 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1718/3320] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:47.608035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-30a7773b-bf7b-4a25-9853-387857bfb2a6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:47.608978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30a7773b-bf7b-4a25-9853-387857bfb2a6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:47.623224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30a7773b-bf7b-4a25-9853-387857bfb2a6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.623711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30a7773b-bf7b-4a25-9853-387857bfb2a6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.624574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30a7773b-bf7b-4a25-9853-387857bfb2a6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.625295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30a7773b-bf7b-4a25-9853-387857bfb2a6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.645609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c076e461-3db0-49ce-ad88-91c5f55dad5a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:47.653810 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c076e461-3db0-49ce-ad88-91c5f55dad5a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1501 microversion: 2.1 time: 0.251222 Feb 19 21:04:47.655086 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1603/3321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:47 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:47.669529 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-30a7773b-bf7b-4a25-9853-387857bfb2a6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. Feb 19 21:04:47.670251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-30a7773b-bf7b-4a25-9853-387857bfb2a6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:47.671125 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-30a7773b-bf7b-4a25-9853-387857bfb2a6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 404 len: 111 microversion: 2.1 time: 0.067864 Feb 19 21:04:47.671363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4e4dd5de-9889-4c6c-8b47-ed1b9a07405d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:47.673347 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1719/3322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:47 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:04:47.680195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4e4dd5de-9889-4c6c-8b47-ed1b9a07405d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:47.681009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-04c631dd-e148-4ce2-a6c5-0d6e5acadb19 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:47.682200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-04c631dd-e148-4ce2-a6c5-0d6e5acadb19 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:47.689553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04c631dd-e148-4ce2-a6c5-0d6e5acadb19 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.690127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04c631dd-e148-4ce2-a6c5-0d6e5acadb19 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.691791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04c631dd-e148-4ce2-a6c5-0d6e5acadb19 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.692381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04c631dd-e148-4ce2-a6c5-0d6e5acadb19 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.696750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e4dd5de-9889-4c6c-8b47-ed1b9a07405d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.697348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e4dd5de-9889-4c6c-8b47-ed1b9a07405d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.698819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e4dd5de-9889-4c6c-8b47-ed1b9a07405d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.699574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e4dd5de-9889-4c6c-8b47-ed1b9a07405d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.771524 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4e4dd5de-9889-4c6c-8b47-ed1b9a07405d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.103428 Feb 19 21:04:47.772557 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1604/3323] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:47 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:47.780980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-09e89a78-38f7-4488-abbf-1c73f640b030 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:47.782317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-09e89a78-38f7-4488-abbf-1c73f640b030 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:47.793344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09e89a78-38f7-4488-abbf-1c73f640b030 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.794705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09e89a78-38f7-4488-abbf-1c73f640b030 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.795957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09e89a78-38f7-4488-abbf-1c73f640b030 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.796592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09e89a78-38f7-4488-abbf-1c73f640b030 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.948771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-04c631dd-e148-4ce2-a6c5-0d6e5acadb19 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:47.961640 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-04c631dd-e148-4ce2-a6c5-0d6e5acadb19 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.284183 Feb 19 21:04:47.983462 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1720/3324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:47 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:04:47.988813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:47.989558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:47.997110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.997861 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:47.998897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:47.999557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.012214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-09e89a78-38f7-4488-abbf-1c73f640b030 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.027176 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-09e89a78-38f7-4488-abbf-1c73f640b030 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1528 microversion: 2.1 time: 0.252729 Feb 19 21:04:48.028248 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1605/3325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:47 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1528 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:48.033342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:48.034042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:48.040422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.041557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.042472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.043477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.105966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.126106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.128225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.132164 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f5ca91aa-cffd-4eb8-bae4-c79f53bb65bc tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.147521 Feb 19 21:04:48.135984 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1721/3326] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:47 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:48.184002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-13d528ce-de93-4091-b6b2-08db9b0dfe47 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:48.186454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-13d528ce-de93-4091-b6b2-08db9b0dfe47 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:48.190872 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-13d528ce-de93-4091-b6b2-08db9b0dfe47 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.013675 Feb 19 21:04:48.194645 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1722/3327] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:48 2022] POST /compute/v2.1/servers => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:04:48.204191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-18a790b6-d62f-463a-8a95-01148c56bad5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:48.204843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-18a790b6-d62f-463a-8a95-01148c56bad5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:48.228870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-18a790b6-d62f-463a-8a95-01148c56bad5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.230006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-18a790b6-d62f-463a-8a95-01148c56bad5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.231626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-18a790b6-d62f-463a-8a95-01148c56bad5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.232641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-18a790b6-d62f-463a-8a95-01148c56bad5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.374705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.385144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.387421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.389718 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e135a94a-624f-4540-a86d-183dc52f4fbd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1745 microversion: 2.20 time: 0.360086 Feb 19 21:04:48.407235 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1606/3328] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:48 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1745 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:48.420931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7dcd75a3-a70b-4c76-a5c5-0c15a11a4a5d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:48.422471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7dcd75a3-a70b-4c76-a5c5-0c15a11a4a5d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:48.433596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dcd75a3-a70b-4c76-a5c5-0c15a11a4a5d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.434421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dcd75a3-a70b-4c76-a5c5-0c15a11a4a5d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.435435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dcd75a3-a70b-4c76-a5c5-0c15a11a4a5d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.436069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dcd75a3-a70b-4c76-a5c5-0c15a11a4a5d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.559785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-18a790b6-d62f-463a-8a95-01148c56bad5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.569000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-18a790b6-d62f-463a-8a95-01148c56bad5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.373211 Feb 19 21:04:48.569577 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1723/3329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:48 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:48.593698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f4b12b40-3f1c-4363-bbc1-2bb0460aba3a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:48.594310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f4b12b40-3f1c-4363-bbc1-2bb0460aba3a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:48.608366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4b12b40-3f1c-4363-bbc1-2bb0460aba3a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.608983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4b12b40-3f1c-4363-bbc1-2bb0460aba3a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.609835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4b12b40-3f1c-4363-bbc1-2bb0460aba3a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.610337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4b12b40-3f1c-4363-bbc1-2bb0460aba3a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.823903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7dcd75a3-a70b-4c76-a5c5-0c15a11a4a5d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.838469 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7dcd75a3-a70b-4c76-a5c5-0c15a11a4a5d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1319 microversion: 2.1 time: 0.427248 Feb 19 21:04:48.839656 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1607/3330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:48 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:48.850545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae3e8b47-9080-4b17-b6f3-ab6fef9848fb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:48.858819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae3e8b47-9080-4b17-b6f3-ab6fef9848fb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:48.875882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae3e8b47-9080-4b17-b6f3-ab6fef9848fb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.877093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae3e8b47-9080-4b17-b6f3-ab6fef9848fb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.878239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae3e8b47-9080-4b17-b6f3-ab6fef9848fb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:48.878853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae3e8b47-9080-4b17-b6f3-ab6fef9848fb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:48.965977 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae3e8b47-9080-4b17-b6f3-ab6fef9848fb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.121900 Feb 19 21:04:48.967859 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1608/3331] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:48 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:48.984272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f4b12b40-3f1c-4363-bbc1-2bb0460aba3a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:48.993292 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f4b12b40-3f1c-4363-bbc1-2bb0460aba3a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.403214 Feb 19 21:04:49.001407 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1724/3332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:48 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:49.047943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-beb9333f-05dd-45da-a32e-7f6761f3f39a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:49.049724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-beb9333f-05dd-45da-a32e-7f6761f3f39a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:49.082161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-beb9333f-05dd-45da-a32e-7f6761f3f39a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.101038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-beb9333f-05dd-45da-a32e-7f6761f3f39a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:49.113142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-beb9333f-05dd-45da-a32e-7f6761f3f39a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.117685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-beb9333f-05dd-45da-a32e-7f6761f3f39a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:49.170007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:49.172019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:49.209558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.211113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:49.214041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.216781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:49.258063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-beb9333f-05dd-45da-a32e-7f6761f3f39a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b13848e363e44b9927525ca9ca6fe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d34faf6add7400690171f1d097d5f2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:49.269990 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-beb9333f-05dd-45da-a32e-7f6761f3f39a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 200 len: 1486 microversion: 2.1 time: 0.228272 Feb 19 21:04:49.283051 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1609/3333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:49 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 1486 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:49.288993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-91c7a625-8d89-4413-a43a-17105cc3aefb req-c80e09c6-b6b5-43fe-9612-7ed47efda6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa", "name": "network-vif-deleted", "tag": "a2e98664-86fb-479c-833e-f1ba8f71db2c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:49.292202 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:49.292202 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:04:49.303456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-91c7a625-8d89-4413-a43a-17105cc3aefb req-c80e09c6-b6b5-43fe-9612-7ed47efda6a8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.304359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-91c7a625-8d89-4413-a43a-17105cc3aefb req-c80e09c6-b6b5-43fe-9612-7ed47efda6a8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:49.321060 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-91c7a625-8d89-4413-a43a-17105cc3aefb req-c80e09c6-b6b5-43fe-9612-7ed47efda6a8 service nova] Creating event network-vif-deleted:a2e98664-86fb-479c-833e-f1ba8f71db2c for instance b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa on nch2-master-1 Feb 19 21:04:49.330444 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-91c7a625-8d89-4413-a43a-17105cc3aefb req-c80e09c6-b6b5-43fe-9612-7ed47efda6a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044805 Feb 19 21:04:49.331919 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1610/3334] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:49.390397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:49.423868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:49.424703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:49.442388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.442861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:49.463266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.463943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:49.474975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:49.492036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:49.498495 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d8c0ae5b-ad5f-4e1f-a1ed-a11f9d40fa44 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.334362 Feb 19 21:04:49.502220 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1725/3335] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:49 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:49.512760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-34d301ec-51f4-4661-96ad-eddfb5b13223 req-b9b2d702-65ca-45bc-92ad-0b34dfe59626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17524174-4cfd-409a-b6f4-15bde7d2c4d1", "name": "network-vif-plugged", "status": "completed", "tag": "2caf0c43-e8a7-47e8-a90c-390f3b45d82b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:49.515368 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:04:49.515368 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:04:49.536223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-34d301ec-51f4-4661-96ad-eddfb5b13223 req-b9b2d702-65ca-45bc-92ad-0b34dfe59626 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.541556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-34d301ec-51f4-4661-96ad-eddfb5b13223 req-b9b2d702-65ca-45bc-92ad-0b34dfe59626 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:49.577525 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-34d301ec-51f4-4661-96ad-eddfb5b13223 req-b9b2d702-65ca-45bc-92ad-0b34dfe59626 service nova] Creating event network-vif-plugged:2caf0c43-e8a7-47e8-a90c-390f3b45d82b for instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 on nch1-master-1 Feb 19 21:04:49.599972 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-34d301ec-51f4-4661-96ad-eddfb5b13223 req-b9b2d702-65ca-45bc-92ad-0b34dfe59626 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085693 Feb 19 21:04:49.601100 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1726/3336] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:49.858156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41639e70-49f8-4da0-abbb-bf5b448b94e6 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:49.859257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41639e70-49f8-4da0-abbb-bf5b448b94e6 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:49.890140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41639e70-49f8-4da0-abbb-bf5b448b94e6 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.891241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41639e70-49f8-4da0-abbb-bf5b448b94e6 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:49.892677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41639e70-49f8-4da0-abbb-bf5b448b94e6 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:49.893335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41639e70-49f8-4da0-abbb-bf5b448b94e6 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.272394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:50.285547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:50.288884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:50.293005 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-907a0690-0b3b-444d-9dba-1bbb6bb5b703 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.875370 Feb 19 21:04:50.294206 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1611/3337] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:49 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:50.303539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-41639e70-49f8-4da0-abbb-bf5b448b94e6 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:50.311956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4457f189-753e-49df-a547-810dfd3464ef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:50.314350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4457f189-753e-49df-a547-810dfd3464ef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:50.318210 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41639e70-49f8-4da0-abbb-bf5b448b94e6 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1507 microversion: 2.1 time: 0.466564 Feb 19 21:04:50.318723 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1727/3338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:49 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:04:50.330259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4457f189-753e-49df-a547-810dfd3464ef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.330806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4457f189-753e-49df-a547-810dfd3464ef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.332014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4457f189-753e-49df-a547-810dfd3464ef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.332868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4457f189-753e-49df-a547-810dfd3464ef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.359159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-582b8ef5-13ff-4e9f-9fa8-f67051dd7f37 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:50.360489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-582b8ef5-13ff-4e9f-9fa8-f67051dd7f37 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:50.385846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-582b8ef5-13ff-4e9f-9fa8-f67051dd7f37 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.386303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-582b8ef5-13ff-4e9f-9fa8-f67051dd7f37 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.387821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-582b8ef5-13ff-4e9f-9fa8-f67051dd7f37 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.388518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-582b8ef5-13ff-4e9f-9fa8-f67051dd7f37 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.411165 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-582b8ef5-13ff-4e9f-9fa8-f67051dd7f37 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Instance b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa could not be found. Feb 19 21:04:50.412077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-582b8ef5-13ff-4e9f-9fa8-f67051dd7f37 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Instance b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:50.413567 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-582b8ef5-13ff-4e9f-9fa8-f67051dd7f37 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa" status: 404 len: 111 microversion: 2.1 time: 0.093122 Feb 19 21:04:50.414738 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1728/3339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:50 2022] GET /compute/v2.1/servers/b1ac9c3b-8e6c-46e0-bf7c-86f41d4354aa => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:04:50.430569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-878cf695-1b45-4d4b-83f3-680c9d06b58f tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '.version_select at 0x7f646768f5e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:50.440311 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4457f189-753e-49df-a547-810dfd3464ef tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.130359 Feb 19 21:04:50.443291 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1612/3340] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:50 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:50.523109 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-878cf695-1b45-4d4b-83f3-680c9d06b58f tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Image not found. Feb 19 21:04:50.524430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-878cf695-1b45-4d4b-83f3-680c9d06b58f tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Image not found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:50.526016 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-878cf695-1b45-4d4b-83f3-680c9d06b58f tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/images/905dfdf3-2f3b-4636-8f3b-6c0226543df4" status: 404 len: 62 microversion: 2.1 time: 0.102920 Feb 19 21:04:50.530559 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1729/3341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:50 2022] DELETE /compute/v2.1/images/905dfdf3-2f3b-4636-8f3b-6c0226543df4 => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:04:50.530953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:50.532080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:50.548180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8ffcf8e8-e59f-4996-8a91-c9880f3935ee tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:50.559345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8ffcf8e8-e59f-4996-8a91-c9880f3935ee tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:50.565688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.566598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.568720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.570134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.591836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ffcf8e8-e59f-4996-8a91-c9880f3935ee tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.592469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ffcf8e8-e59f-4996-8a91-c9880f3935ee tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.593101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ffcf8e8-e59f-4996-8a91-c9880f3935ee tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.593545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ffcf8e8-e59f-4996-8a91-c9880f3935ee tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.666586 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-8ffcf8e8-e59f-4996-8a91-c9880f3935ee tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Instance 7b717b3c-e160-4a74-aff9-f1396031332d could not be found. Feb 19 21:04:50.667292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8ffcf8e8-e59f-4996-8a91-c9880f3935ee tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Instance 7b717b3c-e160-4a74-aff9-f1396031332d could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:50.668166 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8ffcf8e8-e59f-4996-8a91-c9880f3935ee tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 404 len: 111 microversion: 2.1 time: 0.135230 Feb 19 21:04:50.673196 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1730/3342] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:04:50 2022] DELETE /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:04:50.685146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e1213bfb-82ca-443c-b448-517e5ab9442b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:50.685772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e1213bfb-82ca-443c-b448-517e5ab9442b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 7b717b3c-e160-4a74-aff9-f1396031332d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:50.710653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1213bfb-82ca-443c-b448-517e5ab9442b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.711684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1213bfb-82ca-443c-b448-517e5ab9442b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.716168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1213bfb-82ca-443c-b448-517e5ab9442b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:50.717303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1213bfb-82ca-443c-b448-517e5ab9442b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:50.770131 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e1213bfb-82ca-443c-b448-517e5ab9442b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Instance 7b717b3c-e160-4a74-aff9-f1396031332d could not be found. Feb 19 21:04:50.771078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e1213bfb-82ca-443c-b448-517e5ab9442b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Instance 7b717b3c-e160-4a74-aff9-f1396031332d could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:50.772208 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e1213bfb-82ca-443c-b448-517e5ab9442b tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d" status: 404 len: 111 microversion: 2.1 time: 0.097973 Feb 19 21:04:50.779156 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1731/3343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:50 2022] GET /compute/v2.1/servers/7b717b3c-e160-4a74-aff9-f1396031332d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:04:50.793070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b0e29641-9d97-47dc-9ce1-afae467a786a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '.version_select at 0x7f6467a574c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:50.847212 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b0e29641-9d97-47dc-9ce1-afae467a786a tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-832389035" status: 202 len: 0 microversion: 2.1 time: 0.066724 Feb 19 21:04:50.851465 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1732/3344] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 21:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-832389035 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:04:50.930296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:50.951274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:50.962608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:50.962608 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e4ba3de5-e977-428e-84d9-729677ff98f9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.438258 Feb 19 21:04:50.962608 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1613/3345] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:50 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:04:51.244833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27b16286-2eff-49d6-bc41-b90bd00553dc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-558999902", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f9a0d149-5bcf-434f-90cb-ef3429b93f95", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:51.318074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:51.320393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:51.396575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:51.402041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:51.406893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:51.414151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:51.770640 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-27b16286-2eff-49d6-bc41-b90bd00553dc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Block Device f9a0d149-5bcf-434f-90cb-ef3429b93f95 is not bootable. Feb 19 21:04:51.771245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27b16286-2eff-49d6-bc41-b90bd00553dc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Block Device f9a0d149-5bcf-434f-90cb-ef3429b93f95 is not bootable. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:51.772265 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-27b16286-2eff-49d6-bc41-b90bd00553dc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.534696 Feb 19 21:04:51.773484 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1733/3346] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:51 2022] POST /compute/v2.1/servers => generated 110 bytes in 537 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:04:51.779608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e7d377e8-633a-43b5-a549-ed183033d687 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:51.782900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e7d377e8-633a-43b5-a549-ed183033d687 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:51.804073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7d377e8-633a-43b5-a549-ed183033d687 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:51.809445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7d377e8-633a-43b5-a549-ed183033d687 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:51.810578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7d377e8-633a-43b5-a549-ed183033d687 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:51.811038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7d377e8-633a-43b5-a549-ed183033d687 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:51.907914 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e7d377e8-633a-43b5-a549-ed183033d687 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.128275 Feb 19 21:04:51.913495 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1734/3347] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:51 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:51.924840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6b4e234c-fd5a-48b6-a25c-701b7c797ff8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:51.929610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6b4e234c-fd5a-48b6-a25c-701b7c797ff8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:51.960103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b4e234c-fd5a-48b6-a25c-701b7c797ff8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:51.961986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b4e234c-fd5a-48b6-a25c-701b7c797ff8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:51.965860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b4e234c-fd5a-48b6-a25c-701b7c797ff8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:51.968598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b4e234c-fd5a-48b6-a25c-701b7c797ff8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.035155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:52.065631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:52.076751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:52.078944 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-34de28db-69c7-4040-a486-0acc12314b9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.768038 Feb 19 21:04:52.092656 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1614/3348] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:51 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:52.109564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:52.110197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:52.146111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.147115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.148093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.152642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.334557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:52.345545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:52.349924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:52.357757 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d688f85d-e752-41b1-8b68-2ed39bc67d0a tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.262878 Feb 19 21:04:52.359359 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1615/3349] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:52 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:52.439541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f64e58f7-705f-4215-a170-817f3cacdbd1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '.version_select at 0x7f6467bbdca0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:52.479606 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f64e58f7-705f-4215-a170-817f3cacdbd1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Image not found. Feb 19 21:04:52.480580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f64e58f7-705f-4215-a170-817f3cacdbd1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Image not found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:52.481760 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f64e58f7-705f-4215-a170-817f3cacdbd1 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/images/67bdcfc3-3ed5-45d0-92b5-7c78efe8c1bf" status: 404 len: 62 microversion: 2.1 time: 0.049834 Feb 19 21:04:52.482898 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1616/3350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:52 2022] DELETE /compute/v2.1/images/67bdcfc3-3ed5-45d0-92b5-7c78efe8c1bf => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:04:52.494873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ef328c3-50d5-4f65-825e-8b5e31c63d92 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:52.495768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8ef328c3-50d5-4f65-825e-8b5e31c63d92 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:52.512957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ef328c3-50d5-4f65-825e-8b5e31c63d92 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.513788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ef328c3-50d5-4f65-825e-8b5e31c63d92 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.517932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ef328c3-50d5-4f65-825e-8b5e31c63d92 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.518807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ef328c3-50d5-4f65-825e-8b5e31c63d92 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.551996 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8ef328c3-50d5-4f65-825e-8b5e31c63d92 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Instance 92321eba-8b05-4954-9660-9e95356bb6b3 could not be found. Feb 19 21:04:52.553100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ef328c3-50d5-4f65-825e-8b5e31c63d92 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Instance 92321eba-8b05-4954-9660-9e95356bb6b3 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:52.554294 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ef328c3-50d5-4f65-825e-8b5e31c63d92 tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "DELETE /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 404 len: 111 microversion: 2.1 time: 0.067537 Feb 19 21:04:52.556207 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1617/3351] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:04:52 2022] DELETE /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:04:52.565098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f1b2c4bf-0d94-419f-b29d-e79f46c66b0e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:52.566108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f1b2c4bf-0d94-419f-b29d-e79f46c66b0e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] [instance: 92321eba-8b05-4954-9660-9e95356bb6b3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:52.574273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1b2c4bf-0d94-419f-b29d-e79f46c66b0e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.575083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1b2c4bf-0d94-419f-b29d-e79f46c66b0e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.576167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1b2c4bf-0d94-419f-b29d-e79f46c66b0e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.578069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f1b2c4bf-0d94-419f-b29d-e79f46c66b0e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.607684 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f1b2c4bf-0d94-419f-b29d-e79f46c66b0e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] HTTP exception thrown: Instance 92321eba-8b05-4954-9660-9e95356bb6b3 could not be found. Feb 19 21:04:52.610611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f1b2c4bf-0d94-419f-b29d-e79f46c66b0e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] Returning 404 to user: Instance 92321eba-8b05-4954-9660-9e95356bb6b3 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:52.613401 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f1b2c4bf-0d94-419f-b29d-e79f46c66b0e tempest-ImagesOneServerNegativeTestJSON-1568539689 tempest-ImagesOneServerNegativeTestJSON-1568539689-project] 10.222.0.30 "GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3" status: 404 len: 111 microversion: 2.1 time: 0.052969 Feb 19 21:04:52.620985 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1618/3352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:52 2022] GET /compute/v2.1/servers/92321eba-8b05-4954-9660-9e95356bb6b3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:04:52.633297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b4e234c-fd5a-48b6-a25c-701b7c797ff8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:52.643547 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6b4e234c-fd5a-48b6-a25c-701b7c797ff8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.728541 Feb 19 21:04:52.644457 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1735/3353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:51 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:52.682864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5613a898-8edf-4bb5-9562-7ad6d4f43b5a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:52.684018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5613a898-8edf-4bb5-9562-7ad6d4f43b5a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:52.722315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5613a898-8edf-4bb5-9562-7ad6d4f43b5a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.723219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5613a898-8edf-4bb5-9562-7ad6d4f43b5a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.724794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5613a898-8edf-4bb5-9562-7ad6d4f43b5a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.736784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5613a898-8edf-4bb5-9562-7ad6d4f43b5a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.923647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3d2d9b5e-2427-4d98-8e6b-88c7522f33f5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:52.924748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3d2d9b5e-2427-4d98-8e6b-88c7522f33f5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:52.958555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d2d9b5e-2427-4d98-8e6b-88c7522f33f5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.959268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d2d9b5e-2427-4d98-8e6b-88c7522f33f5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:52.962555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d2d9b5e-2427-4d98-8e6b-88c7522f33f5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:52.963247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3d2d9b5e-2427-4d98-8e6b-88c7522f33f5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:53.019283 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3d2d9b5e-2427-4d98-8e6b-88c7522f33f5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.104125 Feb 19 21:04:53.021180 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1736/3354] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:52 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:53.099564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:53.100219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:53.111857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:53.115687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:53.123210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:53.124700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:53.431349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5613a898-8edf-4bb5-9562-7ad6d4f43b5a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:53.451073 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5613a898-8edf-4bb5-9562-7ad6d4f43b5a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.777179 Feb 19 21:04:53.452313 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1619/3355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:52 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:53.457738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:53.458886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:53.478566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:53.479489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:53.481154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:53.482679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:53.711065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:53.730546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:53.732451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:53.738174 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-da6f9cd4-47af-45a1-99ff-ff36e06b0573 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.280186 Feb 19 21:04:53.744734 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1620/3356] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:53 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:54.035682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fbc5d46d-5dc1-4707-8366-a0133bdc974d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:54.037108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fbc5d46d-5dc1-4707-8366-a0133bdc974d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:54.074314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbc5d46d-5dc1-4707-8366-a0133bdc974d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:54.074757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbc5d46d-5dc1-4707-8366-a0133bdc974d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:54.075667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbc5d46d-5dc1-4707-8366-a0133bdc974d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:54.076125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbc5d46d-5dc1-4707-8366-a0133bdc974d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:54.196314 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fbc5d46d-5dc1-4707-8366-a0133bdc974d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.167257 Feb 19 21:04:54.202425 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1621/3357] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:54 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:54.620865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:54.642370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:54.644795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:54.646842 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4090efb9-13b8-40ba-b00c-62e37af3d507 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 1.551555 Feb 19 21:04:54.648637 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1737/3358] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:53 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:04:54.764762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:54.766742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:54.800021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:54.800822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:54.801821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:54.802637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:54.914380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aff44e88-1b57-4437-b440-5e4e21ec372a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "493c2856-8fb5-4b6f-bc89-58eb61177127", "device": "/dev/sdb"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:54.919158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aff44e88-1b57-4437-b440-5e4e21ec372a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:54.935328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:54.969379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aff44e88-1b57-4437-b440-5e4e21ec372a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:54.969610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:54.970261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aff44e88-1b57-4437-b440-5e4e21ec372a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:54.971591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aff44e88-1b57-4437-b440-5e4e21ec372a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:54.972420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aff44e88-1b57-4437-b440-5e4e21ec372a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:54.981813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:54.985636 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ca81fbf7-fea2-4479-9e33-5be0d930bb29 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.230558 Feb 19 21:04:54.986817 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1622/3359] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:54 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:55.215735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-622236a9-02a1-4d50-a6e8-c0ed735c92aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:55.222371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-622236a9-02a1-4d50-a6e8-c0ed735c92aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:55.242247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-622236a9-02a1-4d50-a6e8-c0ed735c92aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:55.243122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-622236a9-02a1-4d50-a6e8-c0ed735c92aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:55.249111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-622236a9-02a1-4d50-a6e8-c0ed735c92aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:55.250078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-622236a9-02a1-4d50-a6e8-c0ed735c92aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:55.387876 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-622236a9-02a1-4d50-a6e8-c0ed735c92aa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.181045 Feb 19 21:04:55.391056 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1623/3360] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:55 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:55.446592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19d587b2-abf5-439c-9d32-a73f43eb9d0d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1866313324", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f75529b9-2911-475e-b974-4af06053c17c", "destination_type": "local"}, {"source_type": "volume", "uuid": "2af565df-bf28-4e7b-b3c5-f62ffab1dd66", "destination_type": "invalid"}], "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:55.451188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19d587b2-abf5-439c-9d32-a73f43eb9d0d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:55.452814 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-19d587b2-abf5-439c-9d32-a73f43eb9d0d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010519 Feb 19 21:04:55.456176 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1624/3361] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:55 2022] POST /compute/v2.1/servers => generated 155 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:04:55.469519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d223d01d-3008-46cc-83ab-60417514eee8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:55.472114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d223d01d-3008-46cc-83ab-60417514eee8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:55.486300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d223d01d-3008-46cc-83ab-60417514eee8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:55.487499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d223d01d-3008-46cc-83ab-60417514eee8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:55.489367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d223d01d-3008-46cc-83ab-60417514eee8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:55.490286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d223d01d-3008-46cc-83ab-60417514eee8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:55.637927 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aff44e88-1b57-4437-b440-5e4e21ec372a tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "POST /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719441 Feb 19 21:04:55.644073 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1738/3362] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:04:54 2022] POST /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:04:55.695635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:55.696683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:55.704810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:55.705524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:55.706574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:55.707369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:56.372704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:56.393143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:56.398458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:56.401677 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-68370f6c-cf92-4443-8a50-a9543bc77c6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.728206 Feb 19 21:04:56.412561 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1739/3363] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:55 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:56.413706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:56.416602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:56.430140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:56.430632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:56.434187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:56.435490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:56.512936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d223d01d-3008-46cc-83ab-60417514eee8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:56.529371 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d223d01d-3008-46cc-83ab-60417514eee8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 1.065507 Feb 19 21:04:56.530816 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1625/3364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:55 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:56.553774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-883b2280-7282-4934-9ef1-ef1826b8d2e8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:56.555245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-883b2280-7282-4934-9ef1-ef1826b8d2e8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:56.566774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-883b2280-7282-4934-9ef1-ef1826b8d2e8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:56.568007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-883b2280-7282-4934-9ef1-ef1826b8d2e8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:56.569256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-883b2280-7282-4934-9ef1-ef1826b8d2e8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:56.570094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-883b2280-7282-4934-9ef1-ef1826b8d2e8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:56.656090 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-883b2280-7282-4934-9ef1-ef1826b8d2e8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.122890 Feb 19 21:04:56.659785 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1626/3365] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:56 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:56.665146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9285431-c0cb-4896-8c4e-ab6cec6a4fa3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:56.673367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9285431-c0cb-4896-8c4e-ab6cec6a4fa3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:56.689257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9285431-c0cb-4896-8c4e-ab6cec6a4fa3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:56.689816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9285431-c0cb-4896-8c4e-ab6cec6a4fa3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:56.690727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9285431-c0cb-4896-8c4e-ab6cec6a4fa3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:56.691251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9285431-c0cb-4896-8c4e-ab6cec6a4fa3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:56.704934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:56.719705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:56.721214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:56.722409 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8d0cb84b-d9ec-4c7f-888b-a4b7b74ea4b5 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.318560 Feb 19 21:04:56.760484 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1740/3366] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:56 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:57.111164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a9285431-c0cb-4896-8c4e-ab6cec6a4fa3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:57.120419 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9285431-c0cb-4896-8c4e-ab6cec6a4fa3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.461307 Feb 19 21:04:57.122625 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1627/3367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:56 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:57.328419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4ddb882b-144d-49cf-a600-1acb8fe47672 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1518360612", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:57.341259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4ddb882b-144d-49cf-a600-1acb8fe47672 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:57.343792 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4ddb882b-144d-49cf-a600-1acb8fe47672 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.038121 Feb 19 21:04:57.344815 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1741/3368] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:57 2022] POST /compute/v2.1/servers => generated 624 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:04:57.353703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-230ed215-3d11-4371-b3e1-1981b8569f77 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:57.354608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-230ed215-3d11-4371-b3e1-1981b8569f77 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:57.362216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-230ed215-3d11-4371-b3e1-1981b8569f77 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:57.362667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-230ed215-3d11-4371-b3e1-1981b8569f77 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:57.363618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-230ed215-3d11-4371-b3e1-1981b8569f77 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:57.364253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-230ed215-3d11-4371-b3e1-1981b8569f77 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:57.420360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:57.421250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:57.432646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:57.433444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:57.434420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:57.435021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:57.851208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-230ed215-3d11-4371-b3e1-1981b8569f77 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:57.870940 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-230ed215-3d11-4371-b3e1-1981b8569f77 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.520976 Feb 19 21:04:57.874389 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1628/3369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:57 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:57.880130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a30f3504-bc42-4cbd-9c9c-840c8d25aca8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:57.881111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a30f3504-bc42-4cbd-9c9c-840c8d25aca8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:57.889022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a30f3504-bc42-4cbd-9c9c-840c8d25aca8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:57.889979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a30f3504-bc42-4cbd-9c9c-840c8d25aca8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:57.891046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a30f3504-bc42-4cbd-9c9c-840c8d25aca8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:57.894223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:57.899007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a30f3504-bc42-4cbd-9c9c-840c8d25aca8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:57.911731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:57.917426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:57.919383 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aa41f4a6-7af6-4f37-86e0-69d98a847643 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.503037 Feb 19 21:04:57.924241 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1742/3370] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:57 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:04:57.936746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:57.941219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:57.954076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:57.954781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:57.959565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:57.959999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:57.987094 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a30f3504-bc42-4cbd-9c9c-840c8d25aca8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.110348 Feb 19 21:04:57.990503 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1629/3371] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:57 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:57.998316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-24338952-9610-4ff0-b61a-5c3cfbba0f65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:58.003619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-24338952-9610-4ff0-b61a-5c3cfbba0f65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:58.029062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24338952-9610-4ff0-b61a-5c3cfbba0f65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:58.030027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24338952-9610-4ff0-b61a-5c3cfbba0f65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:58.031057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24338952-9610-4ff0-b61a-5c3cfbba0f65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:58.031515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24338952-9610-4ff0-b61a-5c3cfbba0f65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:58.189354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:58.211804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:58.217634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:58.219189 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-886c9628-7d1e-4fa0-9a26-74c86b5f1afe tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.293709 Feb 19 21:04:58.228525 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1743/3372] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:57 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:58.516813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-24338952-9610-4ff0-b61a-5c3cfbba0f65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:58.526921 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-24338952-9610-4ff0-b61a-5c3cfbba0f65 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.532953 Feb 19 21:04:58.541870 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1630/3373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:57 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:58.620621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a94d3cd6-8ae9-4916-b88d-fa5020a8b785 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:58.622181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a94d3cd6-8ae9-4916-b88d-fa5020a8b785 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:04:58.623227 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a94d3cd6-8ae9-4916-b88d-fa5020a8b785 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006511 Feb 19 21:04:58.624282 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1744/3374] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:58 2022] POST /compute/v2.1/servers => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:04:58.632684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f6ddb32c-a06e-46f3-8efe-e1eaf2e72b88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:58.633607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f6ddb32c-a06e-46f3-8efe-e1eaf2e72b88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:58.644944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6ddb32c-a06e-46f3-8efe-e1eaf2e72b88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:58.645409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6ddb32c-a06e-46f3-8efe-e1eaf2e72b88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:58.646225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6ddb32c-a06e-46f3-8efe-e1eaf2e72b88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:58.646666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f6ddb32c-a06e-46f3-8efe-e1eaf2e72b88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:58.911754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6874f3c4-4a6a-49cc-99f9-2e21a1b87cca tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f6467ed1e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-136390502", "description": "tempest-description-1662985779"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:59.115678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f6ddb32c-a06e-46f3-8efe-e1eaf2e72b88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:59.136605 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f6ddb32c-a06e-46f3-8efe-e1eaf2e72b88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.507961 Feb 19 21:04:59.139504 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1631/3375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:58 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:59.151752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:59.161945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:59.183575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:59.184247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:59.186815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:59.193541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:59.375753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6874f3c4-4a6a-49cc-99f9-2e21a1b87cca tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.695188 Feb 19 21:04:59.376736 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1745/3376] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:04:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:04:59.387581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-556d76c5-05a8-45e9-bf6d-e9fbdfe75c2f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:59.388596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-556d76c5-05a8-45e9-bf6d-e9fbdfe75c2f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:59.398293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-556d76c5-05a8-45e9-bf6d-e9fbdfe75c2f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:59.398708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-556d76c5-05a8-45e9-bf6d-e9fbdfe75c2f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:59.399692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-556d76c5-05a8-45e9-bf6d-e9fbdfe75c2f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:59.400473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-556d76c5-05a8-45e9-bf6d-e9fbdfe75c2f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:59.490503 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-556d76c5-05a8-45e9-bf6d-e9fbdfe75c2f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.111830 Feb 19 21:04:59.496818 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1746/3377] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:04:59 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:04:59.508591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-17dad734-67b9-45bc-aca1-2411f40e5e25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:59.510228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17dad734-67b9-45bc-aca1-2411f40e5e25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:59.523456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17dad734-67b9-45bc-aca1-2411f40e5e25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:59.524746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17dad734-67b9-45bc-aca1-2411f40e5e25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:59.526143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17dad734-67b9-45bc-aca1-2411f40e5e25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:59.526971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17dad734-67b9-45bc-aca1-2411f40e5e25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:59.554169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:59.565122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:59.566815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:59.582241 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3b63f215-2006-41c5-86b8-46701b918a05 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.438309 Feb 19 21:04:59.582862 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1632/3378] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:59 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:59.587579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:04:59.588471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:04:59.602027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:59.605907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:59.607103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:04:59.607748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:04:59.720096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:59.739253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:59.740930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:59.742185 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-736f8a27-b905-4ac4-9b0f-a50244469c1b tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.158195 Feb 19 21:04:59.755720 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1633/3379] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:04:59 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:04:59.763285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3331c279-f113-4b97-b50b-a723cb4eb8cb tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f6467b41ee0>, body: {"security_group_rule": {"parent_group_id": "38dafb69-405e-4157-a6fb-5744fb266eb2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:59.842765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17dad734-67b9-45bc-aca1-2411f40e5e25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:04:59.852448 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-17dad734-67b9-45bc-aca1-2411f40e5e25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.353047 Feb 19 21:04:59.853254 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1747/3380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:04:59 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:04:59.984090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-24bf67ba-f40c-489b-b387-2d94a2e22816 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-877972197", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": -1, "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:04:59.999830 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-24bf67ba-f40c-489b-b387-2d94a2e22816 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Flavor -1 could not be found. Feb 19 21:05:00.000469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-24bf67ba-f40c-489b-b387-2d94a2e22816 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:00.001302 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-24bf67ba-f40c-489b-b387-2d94a2e22816 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.022626 Feb 19 21:05:00.002766 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1748/3381] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:04:59 2022] POST /compute/v2.1/servers => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Feb 19 21:05:00.014842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-221e50af-85a3-4c88-a378-b135ef2d49aa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:00.015781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-221e50af-85a3-4c88-a378-b135ef2d49aa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:00.024872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-221e50af-85a3-4c88-a378-b135ef2d49aa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:00.026101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-221e50af-85a3-4c88-a378-b135ef2d49aa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:00.027228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-221e50af-85a3-4c88-a378-b135ef2d49aa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:00.031143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-221e50af-85a3-4c88-a378-b135ef2d49aa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:00.161989 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3331c279-f113-4b97-b50b-a723cb4eb8cb tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.409326 Feb 19 21:05:00.162705 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1634/3382] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 21:04:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:00.187920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fa2eddce-73fb-4b99-a1c6-cc18e6e947b9 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f6467c0e700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-725164570", "description": "tempest-description-338988619"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:00.366621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-221e50af-85a3-4c88-a378-b135ef2d49aa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:00.379707 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-221e50af-85a3-4c88-a378-b135ef2d49aa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.370594 Feb 19 21:05:00.386437 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1749/3383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:00 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:00.411367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c6064acd-723d-425c-a177-ee5b4ff87a88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:00.412469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c6064acd-723d-425c-a177-ee5b4ff87a88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:00.424568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6064acd-723d-425c-a177-ee5b4ff87a88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:00.427825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6064acd-723d-425c-a177-ee5b4ff87a88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:00.429792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6064acd-723d-425c-a177-ee5b4ff87a88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:00.430532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6064acd-723d-425c-a177-ee5b4ff87a88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:00.620296 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fa2eddce-73fb-4b99-a1c6-cc18e6e947b9 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.448256 Feb 19 21:05:00.621405 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1635/3384] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:00 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:00.628493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-375c5340-3035-4266-8827-5edd29d23f28 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:00.631151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-375c5340-3035-4266-8827-5edd29d23f28 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:00.679570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-375c5340-3035-4266-8827-5edd29d23f28 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:00.680380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-375c5340-3035-4266-8827-5edd29d23f28 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:00.681950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-375c5340-3035-4266-8827-5edd29d23f28 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:00.682574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-375c5340-3035-4266-8827-5edd29d23f28 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:00.739824 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-375c5340-3035-4266-8827-5edd29d23f28 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.116234 Feb 19 21:05:00.740882 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1636/3385] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:00 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:05:00.765455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:00.766259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:00.788677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:00.789146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:00.789980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:00.795693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:00.874021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c6064acd-723d-425c-a177-ee5b4ff87a88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:00.885891 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c6064acd-723d-425c-a177-ee5b4ff87a88 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.480583 Feb 19 21:05:00.888169 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1750/3386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:00 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:00.907931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8df6850b-f9ef-4612-b988-550af6e0df6e tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f6467dd1790>, body: {"security_group_rule": {"parent_group_id": "ce6751d4-2776-41b3-ac9f-24049c6a45a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:01.218227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:01.230190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:01.232212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:01.237123 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1a5a76df-535c-466a-9a4d-bd00e404a8ae tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.494497 Feb 19 21:05:01.237953 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1637/3387] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:00 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:01.257121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:01.258454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:01.269163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:01.269989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:01.271035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:01.271688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:01.403410 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8df6850b-f9ef-4612-b988-550af6e0df6e tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.513650 Feb 19 21:05:01.411543 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1751/3388] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 21:05:00 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:01.417602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7dfc18dd-a741-4d1d-9860-913381bc296c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1392108701", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:01.418981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7dfc18dd-a741-4d1d-9860-913381bc296c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:01.425822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:01.435727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:01.438579 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7dfc18dd-a741-4d1d-9860-913381bc296c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.024567 Feb 19 21:05:01.439514 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1752/3389] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:01 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:05:01.445154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:01.446848 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7bdbb304-f2ec-40fc-bda2-79883bed557f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.193738 Feb 19 21:05:01.449177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7876bf9f-1fcb-4d56-bea4-e5d169a9aa33 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f646772b0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-486173757", "description": "tempest-description-1268110334"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:01.450648 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1638/3390] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:01 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:01.464656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-20bfc66d-0e9b-43e8-91fb-896ab627c05b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:01.465691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-20bfc66d-0e9b-43e8-91fb-896ab627c05b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:01.492172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20bfc66d-0e9b-43e8-91fb-896ab627c05b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:01.496744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20bfc66d-0e9b-43e8-91fb-896ab627c05b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:01.500483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20bfc66d-0e9b-43e8-91fb-896ab627c05b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:01.501030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20bfc66d-0e9b-43e8-91fb-896ab627c05b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:01.816553 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7876bf9f-1fcb-4d56-bea4-e5d169a9aa33 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.375706 Feb 19 21:05:01.817814 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1753/3391] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:01.832669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-67171f7a-ecf0-42e6-8e2e-aab81e4a1089 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:01.833643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-67171f7a-ecf0-42e6-8e2e-aab81e4a1089 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:01.834381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-20bfc66d-0e9b-43e8-91fb-896ab627c05b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:01.842615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67171f7a-ecf0-42e6-8e2e-aab81e4a1089 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:01.843128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67171f7a-ecf0-42e6-8e2e-aab81e4a1089 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:01.843979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67171f7a-ecf0-42e6-8e2e-aab81e4a1089 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:01.844447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67171f7a-ecf0-42e6-8e2e-aab81e4a1089 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:01.853340 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-20bfc66d-0e9b-43e8-91fb-896ab627c05b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.400141 Feb 19 21:05:01.854949 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1639/3392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:01 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:01.863848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9d5e14bc-9e63-4b16-ac06-31c13bd5ad54 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f6467c518b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-583666083", "description": "tempest-description-621630892"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:01.907632 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-67171f7a-ecf0-42e6-8e2e-aab81e4a1089 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 14 microversion: 2.1 time: 0.084776 Feb 19 21:05:01.910426 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1754/3393] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:01 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:05:01.923896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-15c842dd-0967-4e09-b4b4-4d5d859c6dbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:01.926971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-15c842dd-0967-4e09-b4b4-4d5d859c6dbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:01.950737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15c842dd-0967-4e09-b4b4-4d5d859c6dbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:01.952369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15c842dd-0967-4e09-b4b4-4d5d859c6dbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:01.954221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15c842dd-0967-4e09-b4b4-4d5d859c6dbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:01.954606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15c842dd-0967-4e09-b4b4-4d5d859c6dbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:02.281309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-15c842dd-0967-4e09-b4b4-4d5d859c6dbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:02.295693 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-15c842dd-0967-4e09-b4b4-4d5d859c6dbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.383421 Feb 19 21:05:02.299260 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1755/3394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:01 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:02.309299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:02.310042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:02.324115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:02.341943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:02.343927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:02.351574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:02.492001 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9d5e14bc-9e63-4b16-ac06-31c13bd5ad54 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.635130 Feb 19 21:05:02.493007 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1640/3395] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:01 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:02.498102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98afb295-dc9a-4215-b54d-92eb2b1a0084 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-676563793", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:02.505033 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-98afb295-dc9a-4215-b54d-92eb2b1a0084 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Feb 19 21:05:02.511262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98afb295-dc9a-4215-b54d-92eb2b1a0084 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:02.521979 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98afb295-dc9a-4215-b54d-92eb2b1a0084 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.027646 Feb 19 21:05:02.522999 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1641/3396] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:02 2022] POST /compute/v2.1/servers => generated 123 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:05:02.531605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:02.532232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:02.564936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:02.567950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:02.569372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:02.572924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:03.130416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:03.138954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:03.140538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:03.146231 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df68b6ff-8fee-4d14-9ca8-9a9dcc25651c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.845842 Feb 19 21:05:03.147401 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1756/3397] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:02 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:03.148818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:03.152836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e7a7da8f-86c2-402e-be02-155da59874be tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f646772bb80>, body: {"security_group_rule": {"parent_group_id": "6e123503-46bd-4af9-af3b-dbef806190d2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "cbf89274-941d-462b-a454-a417821622ed"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:03.168602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:03.170502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:03.171932 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-42b7b88b-bfd1-4bfc-86ea-7a8b6f8eeec9 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.647828 Feb 19 21:05:03.176975 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1642/3398] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:02 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:03.193301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a45e7d30-4db1-4275-afef-f39993fbdef9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:03.194262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a45e7d30-4db1-4275-afef-f39993fbdef9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:03.214691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a45e7d30-4db1-4275-afef-f39993fbdef9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:03.218456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a45e7d30-4db1-4275-afef-f39993fbdef9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:03.222205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a45e7d30-4db1-4275-afef-f39993fbdef9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:03.222935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a45e7d30-4db1-4275-afef-f39993fbdef9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:03.865272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a45e7d30-4db1-4275-afef-f39993fbdef9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:03.878408 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a45e7d30-4db1-4275-afef-f39993fbdef9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.698623 Feb 19 21:05:03.880188 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1643/3399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:03 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:03.892761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d1e7c7d3-9ac5-4f69-8abe-8b6fe988f440 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:03.894146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d1e7c7d3-9ac5-4f69-8abe-8b6fe988f440 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:03.911396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1e7c7d3-9ac5-4f69-8abe-8b6fe988f440 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:03.912244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1e7c7d3-9ac5-4f69-8abe-8b6fe988f440 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:03.913438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1e7c7d3-9ac5-4f69-8abe-8b6fe988f440 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:03.914152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1e7c7d3-9ac5-4f69-8abe-8b6fe988f440 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:03.956129 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e7a7da8f-86c2-402e-be02-155da59874be tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.807378 Feb 19 21:05:03.956776 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1757/3400] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 21:05:03 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:03.973263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a430f4de-c7f4-4523-8df9-2fb29e6fbae9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:03.973888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a430f4de-c7f4-4523-8df9-2fb29e6fbae9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:03.988179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a430f4de-c7f4-4523-8df9-2fb29e6fbae9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:03.988664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a430f4de-c7f4-4523-8df9-2fb29e6fbae9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:03.989466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a430f4de-c7f4-4523-8df9-2fb29e6fbae9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:03.989906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a430f4de-c7f4-4523-8df9-2fb29e6fbae9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:03.998714 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d1e7c7d3-9ac5-4f69-8abe-8b6fe988f440 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action" status: 200 len: 16385 microversion: 2.1 time: 0.116512 Feb 19 21:05:03.999657 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1644/3401] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:03 2022] POST /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d/action => generated 16385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:05:04.006286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0fd846e0-a6f2-43da-b1c5-5a48725273de tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f6467d05b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1463339888", "description": "tempest-description-827868771"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:04.296264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a430f4de-c7f4-4523-8df9-2fb29e6fbae9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:04.310244 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a430f4de-c7f4-4523-8df9-2fb29e6fbae9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.344581 Feb 19 21:05:04.312660 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1758/3402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:03 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:04.354179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-03ce2f95-dd3f-4530-b5df-fdf5998c266f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:04.355226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-03ce2f95-dd3f-4530-b5df-fdf5998c266f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:04.362758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03ce2f95-dd3f-4530-b5df-fdf5998c266f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:04.363666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03ce2f95-dd3f-4530-b5df-fdf5998c266f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:04.365116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03ce2f95-dd3f-4530-b5df-fdf5998c266f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:04.365877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03ce2f95-dd3f-4530-b5df-fdf5998c266f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:04.423308 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0fd846e0-a6f2-43da-b1c5-5a48725273de tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.422247 Feb 19 21:05:04.424313 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1645/3403] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:04.429149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:04.429881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:04.438302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:04.438770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:04.439791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:04.440490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:04.909950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-03ce2f95-dd3f-4530-b5df-fdf5998c266f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:04.921467 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-03ce2f95-dd3f-4530-b5df-fdf5998c266f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.586901 Feb 19 21:05:04.922361 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1759/3404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:04 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:04.935066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:04.938877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:04.942323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:04.952857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:04.957735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:04.958891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:04.959510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:04.962993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:04.969795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:04.971269 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dfeff638-f4c8-43fc-8fa5-f684c2193966 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.545839 Feb 19 21:05:04.975119 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1646/3405] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:04 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:04.988199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c83a6d24-04a5-4afb-8093-04e5c57ce31f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-842170306", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "key_name": "tempest-key-819504425", "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:05.129489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:05.138345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:05.139877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:05.143003 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-67766cab-3ec5-46ce-bedc-e165b0d5013f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.219459 Feb 19 21:05:05.147753 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1760/3406] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:04 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:05.157065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c9b2f538-f8fa-4044-b684-3ebd91ee4a25 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f646772b3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-738085144", "description": "tempest-description-1037238880"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:05.172837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-c83a6d24-04a5-4afb-8093-04e5c57ce31f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] validate_networks() for [('757b2f5d-0080-4f9a-891f-7b8f3d47ca02', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:05:05.597307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c9b2f538-f8fa-4044-b684-3ebd91ee4a25 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.447887 Feb 19 21:05:05.604988 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1761/3407] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:05.611339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6380f6e4-da71-49ce-ac66-5155e3acbb4c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:05.611967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6380f6e4-da71-49ce-ac66-5155e3acbb4c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:05.634647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6380f6e4-da71-49ce-ac66-5155e3acbb4c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:05.635095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6380f6e4-da71-49ce-ac66-5155e3acbb4c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:05.635908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6380f6e4-da71-49ce-ac66-5155e3acbb4c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:05.645779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6380f6e4-da71-49ce-ac66-5155e3acbb4c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:05.657724 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c83a6d24-04a5-4afb-8093-04e5c57ce31f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Invalid key_name provided. Feb 19 21:05:05.658662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c83a6d24-04a5-4afb-8093-04e5c57ce31f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid key_name provided. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:05.660025 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c83a6d24-04a5-4afb-8093-04e5c57ce31f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.683610 Feb 19 21:05:05.660982 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1647/3408] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:04 2022] POST /compute/v2.1/servers => generated 70 bytes in 685 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 19 21:05:05.674405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-14bfb149-3f81-488a-b143-ad69d96b3a52 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f6467b37820>, body: {"security_group_rule": {"parent_group_id": "1ac7b270-b490-41e1-99be-f0648be84ddc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e6665006-ef90-4dd8-a158-812b1c2a77e1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:05.955636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6380f6e4-da71-49ce-ac66-5155e3acbb4c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:05.967610 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6380f6e4-da71-49ce-ac66-5155e3acbb4c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.360738 Feb 19 21:05:05.969428 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1762/3409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:05 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:05.978024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-12b058b4-04cb-4652-ba3b-ad213220dbc2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:05.981154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-12b058b4-04cb-4652-ba3b-ad213220dbc2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:05.992564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12b058b4-04cb-4652-ba3b-ad213220dbc2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:05.996523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12b058b4-04cb-4652-ba3b-ad213220dbc2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:06.000038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12b058b4-04cb-4652-ba3b-ad213220dbc2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:06.005746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12b058b4-04cb-4652-ba3b-ad213220dbc2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:06.284897 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-14bfb149-3f81-488a-b143-ad69d96b3a52 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.622530 Feb 19 21:05:06.286131 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1648/3410] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 21:05:05 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:06.294954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-04671531-5f0a-4aa8-b3c6-bde5ad18ac31 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:06.296582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-04671531-5f0a-4aa8-b3c6-bde5ad18ac31 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:06.327422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04671531-5f0a-4aa8-b3c6-bde5ad18ac31 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:06.328258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04671531-5f0a-4aa8-b3c6-bde5ad18ac31 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:06.330068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04671531-5f0a-4aa8-b3c6-bde5ad18ac31 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:06.333168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04671531-5f0a-4aa8-b3c6-bde5ad18ac31 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:06.456855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-12b058b4-04cb-4652-ba3b-ad213220dbc2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:06.465790 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-12b058b4-04cb-4652-ba3b-ad213220dbc2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.494661 Feb 19 21:05:06.485179 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1763/3411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:05 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:06.502005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:06.503297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:06.525237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:06.526508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:06.527513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:06.528113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:06.701180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-04671531-5f0a-4aa8-b3c6-bde5ad18ac31 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:06.716466 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-04671531-5f0a-4aa8-b3c6-bde5ad18ac31 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.428817 Feb 19 21:05:06.717385 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1649/3412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:06 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:06.726918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:06.728889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:06.753630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:06.754830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:06.756774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:06.757388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:06.922600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:06.937056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:06.943349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:06.947686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:06.948639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:06.950549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:06.952652 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-40e8f854-6ba5-498e-8d15-1dc60d67f73f tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.231568 Feb 19 21:05:06.953001 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5eec3b8e-f807-4b27-8ca6-375a7a051d74 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.466084 Feb 19 21:05:06.953768 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1650/3413] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:06 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:06.966071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ef5c55f3-e15e-4508-aae9-36a3d413cbac tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6467bbde50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:06.967683 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1764/3414] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:06 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:06.972871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b8263b08-3e1e-4558-8559-cf0329d62899 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:06.973745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b8263b08-3e1e-4558-8559-cf0329d62899 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:06.996587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8263b08-3e1e-4558-8559-cf0329d62899 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:06.997761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8263b08-3e1e-4558-8559-cf0329d62899 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:07.001122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8263b08-3e1e-4558-8559-cf0329d62899 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:07.001802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8263b08-3e1e-4558-8559-cf0329d62899 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:07.337560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b8263b08-3e1e-4558-8559-cf0329d62899 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:07.345885 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b8263b08-3e1e-4558-8559-cf0329d62899 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.376761 Feb 19 21:05:07.346486 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1765/3415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:06 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:07.375980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0b4edaa4-1767-4220-81b5-8d58aae8a79f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:07.376860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0b4edaa4-1767-4220-81b5-8d58aae8a79f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:07.383166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b4edaa4-1767-4220-81b5-8d58aae8a79f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:07.383938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b4edaa4-1767-4220-81b5-8d58aae8a79f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:07.384934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b4edaa4-1767-4220-81b5-8d58aae8a79f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:07.385528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b4edaa4-1767-4220-81b5-8d58aae8a79f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:07.442863 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ef5c55f3-e15e-4508-aae9-36a3d413cbac tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e6665006-ef90-4dd8-a158-812b1c2a77e1" status: 202 len: 0 microversion: 2.1 time: 0.484724 Feb 19 21:05:07.443991 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1651/3416] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:06 2022] DELETE /compute/v2.1/os-security-groups/e6665006-ef90-4dd8-a158-812b1c2a77e1 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:07.449382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c56f098-86eb-455b-8d32-6cda8a4fdba0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1307522562", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:07.654450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-4c56f098-86eb-455b-8d32-6cda8a4fdba0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Neutron security group does_not_exist not found {{(pid=136095) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Feb 19 21:05:07.655052 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-4c56f098-86eb-455b-8d32-6cda8a4fdba0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Feb 19 21:05:07.655654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c56f098-86eb-455b-8d32-6cda8a4fdba0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:07.656566 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c56f098-86eb-455b-8d32-6cda8a4fdba0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.211565 Feb 19 21:05:07.657160 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1652/3417] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:07 2022] POST /compute/v2.1/servers => generated 106 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:05:07.668651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a17dbca-436b-4a31-bee2-067e05399a69 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6467c84550>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:07.761613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0b4edaa4-1767-4220-81b5-8d58aae8a79f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:07.783425 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0b4edaa4-1767-4220-81b5-8d58aae8a79f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.410044 Feb 19 21:05:07.795508 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1766/3418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:07 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:07.801648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7cadfdc-e4d2-4862-bab4-39f294654d25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:07.802328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d7cadfdc-e4d2-4862-bab4-39f294654d25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:07.810939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7cadfdc-e4d2-4862-bab4-39f294654d25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:07.811384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7cadfdc-e4d2-4862-bab4-39f294654d25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:07.812181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7cadfdc-e4d2-4862-bab4-39f294654d25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:07.812648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7cadfdc-e4d2-4862-bab4-39f294654d25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:07.833081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3a17dbca-436b-4a31-bee2-067e05399a69 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/1ac7b270-b490-41e1-99be-f0648be84ddc" status: 200 len: 247 microversion: 2.1 time: 0.170123 Feb 19 21:05:07.834359 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1653/3419] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:05:07 2022] GET /compute/v2.1/os-security-groups/1ac7b270-b490-41e1-99be-f0648be84ddc => generated 247 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:07.842178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9beb7d60-0cd4-4e12-8151-2bffbe9ecd67 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:07.846800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9beb7d60-0cd4-4e12-8151-2bffbe9ecd67 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:07.857884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9beb7d60-0cd4-4e12-8151-2bffbe9ecd67 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:07.858509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9beb7d60-0cd4-4e12-8151-2bffbe9ecd67 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:07.859475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9beb7d60-0cd4-4e12-8151-2bffbe9ecd67 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:07.860668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9beb7d60-0cd4-4e12-8151-2bffbe9ecd67 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:08.034063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9beb7d60-0cd4-4e12-8151-2bffbe9ecd67 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Locking {{(pid=136095) lock /opt/stack/nova/nova/compute/api.py:4624}} Feb 19 21:05:08.134707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d7cadfdc-e4d2-4862-bab4-39f294654d25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:08.139969 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9beb7d60-0cd4-4e12-8151-2bffbe9ecd67 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.303423 Feb 19 21:05:08.141353 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1654/3420] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:07 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:08.147086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d28b845d-9840-42c9-8cd2-7acb74c1b95c tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f6467b370d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-963552735", "description": "tempest-description-1692090353"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:08.161731 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d7cadfdc-e4d2-4862-bab4-39f294654d25 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.375371 Feb 19 21:05:08.163809 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1767/3421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:07 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:08.170371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:08.171442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:08.179846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:08.186352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:08.187752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:08.190150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:08.466740 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d28b845d-9840-42c9-8cd2-7acb74c1b95c tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.324096 Feb 19 21:05:08.469206 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1655/3422] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:08 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:08.475212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:08.477023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:08.490092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:08.490733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:08.492024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:08.492698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:08.609892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:08.613305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:08.624153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:08.626872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:08.627045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:08.628528 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e5357bb-7580-485a-b12c-396d17c5def5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1740 microversion: 2.20 time: 0.463379 Feb 19 21:05:08.643480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:08.643480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f31f4299-cec5-4eee-be79-06ded9f8b7d8 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1408 microversion: 2.54 time: 0.162103 Feb 19 21:05:08.643480 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1656/3423] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:08 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:08.643480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-59f47086-d724-439b-a0be-b3a2b1163193 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:08.643480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-59f47086-d724-439b-a0be-b3a2b1163193 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:08.651815 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1768/3424] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:08 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1740 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:08.659099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f356666-ffcc-4fc6-b266-e658bcabc1f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:08.659882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2f356666-ffcc-4fc6-b266-e658bcabc1f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:08.673671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59f47086-d724-439b-a0be-b3a2b1163193 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:08.673671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59f47086-d724-439b-a0be-b3a2b1163193 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:08.682698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59f47086-d724-439b-a0be-b3a2b1163193 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:08.684049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59f47086-d724-439b-a0be-b3a2b1163193 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:08.725708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f356666-ffcc-4fc6-b266-e658bcabc1f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:08.726465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f356666-ffcc-4fc6-b266-e658bcabc1f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:08.727518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f356666-ffcc-4fc6-b266-e658bcabc1f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:08.728703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f356666-ffcc-4fc6-b266-e658bcabc1f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:09.266305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-59f47086-d724-439b-a0be-b3a2b1163193 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:09.280871 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-59f47086-d724-439b-a0be-b3a2b1163193 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.644882 Feb 19 21:05:09.281987 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1657/3425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:08 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:09.286784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5f25bac7-f9d2-43bd-b428-3071c22d62a0 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f6467a84310>, body: {"security_group_rule": {"parent_group_id": "ca46aa15-bd97-4497-accb-1b3ef94e8c5c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:09.379994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f356666-ffcc-4fc6-b266-e658bcabc1f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:09.390481 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f356666-ffcc-4fc6-b266-e658bcabc1f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.736923 Feb 19 21:05:09.404550 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1769/3426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:08 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:09.412000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98b90bbc-3443-4dd4-9345-8fdf07c40513 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:09.418959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98b90bbc-3443-4dd4-9345-8fdf07c40513 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:09.436925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98b90bbc-3443-4dd4-9345-8fdf07c40513 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:09.490620 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-98b90bbc-3443-4dd4-9345-8fdf07c40513 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] HTTP exception thrown: Instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 is locked Feb 19 21:05:09.491560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98b90bbc-3443-4dd4-9345-8fdf07c40513 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Returning 409 to user: Instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 is locked {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:09.492619 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-98b90bbc-3443-4dd4-9345-8fdf07c40513 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 409 len: 107 microversion: 2.1 time: 0.086602 Feb 19 21:05:09.494503 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1770/3427] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:09 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 107 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:05:09.499355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-528052a7-6950-4771-aafb-947cb30ee728 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:09.500019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-528052a7-6950-4771-aafb-947cb30ee728 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: a6b0bad5-e9c7-4ac6-ad98-b920b9d0d362] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:09.507196 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-528052a7-6950-4771-aafb-947cb30ee728 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance a6b0bad5-e9c7-4ac6-ad98-b920b9d0d362 could not be found. Feb 19 21:05:09.508024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-528052a7-6950-4771-aafb-947cb30ee728 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance a6b0bad5-e9c7-4ac6-ad98-b920b9d0d362 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:09.509517 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-528052a7-6950-4771-aafb-947cb30ee728 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a6b0bad5-e9c7-4ac6-ad98-b920b9d0d362" status: 404 len: 111 microversion: 2.1 time: 0.013293 Feb 19 21:05:09.510630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1771/3428] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:05:09 2022] DELETE /compute/v2.1/servers/a6b0bad5-e9c7-4ac6-ad98-b920b9d0d362 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:09.516430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-542bec72-815d-434b-92ad-ce741c5e7be2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:09.517055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-542bec72-815d-434b-92ad-ce741c5e7be2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:09.529277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-542bec72-815d-434b-92ad-ce741c5e7be2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:09.529853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-542bec72-815d-434b-92ad-ce741c5e7be2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:09.530729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-542bec72-815d-434b-92ad-ce741c5e7be2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:09.531295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-542bec72-815d-434b-92ad-ce741c5e7be2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:09.612473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-542bec72-815d-434b-92ad-ce741c5e7be2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Unlocking {{(pid=136094) unlock /opt/stack/nova/nova/compute/api.py:4653}} Feb 19 21:05:09.638065 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5f25bac7-f9d2-43bd-b428-3071c22d62a0 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.346155 Feb 19 21:05:09.638065 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1658/3429] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 21:05:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:09.643536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7065b112-a1ea-49c9-ae69-79818e1ca052 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:09.644168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7065b112-a1ea-49c9-ae69-79818e1ca052 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:09.656150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7065b112-a1ea-49c9-ae69-79818e1ca052 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:09.659050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7065b112-a1ea-49c9-ae69-79818e1ca052 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:09.661478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7065b112-a1ea-49c9-ae69-79818e1ca052 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:09.661956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7065b112-a1ea-49c9-ae69-79818e1ca052 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:09.719286 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-542bec72-815d-434b-92ad-ce741c5e7be2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.206939 Feb 19 21:05:09.720219 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1772/3430] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:09 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:09.746704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a8ad225b-c441-43cd-9c25-05a4824b8c9f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Action: 'create', calling method: .version_select at 0x7f64678f5820>, body: {"security_group_rule": {"parent_group_id": "ca46aa15-bd97-4497-accb-1b3ef94e8c5c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:09.969409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7065b112-a1ea-49c9-ae69-79818e1ca052 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:09.978321 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7065b112-a1ea-49c9-ae69-79818e1ca052 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.339826 Feb 19 21:05:09.985216 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1659/3431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:09 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:09.991765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:09.992426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:10.012266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:10.013531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:10.020646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:10.021387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:10.159654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:10.173728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:10.177178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:10.179551 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9e3caeb1-4120-456e-95d8-b26d0c193667 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1414 microversion: 2.54 time: 0.193107 Feb 19 21:05:10.194929 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1660/3432] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:09 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1414 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:10.200622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:10.201600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:10.209461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:10.210297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:10.211399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:10.215470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:10.294984 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a8ad225b-c441-43cd-9c25-05a4824b8c9f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.573280 Feb 19 21:05:10.302855 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1773/3433] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Feb 19 21:05:09 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:10.308134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-47b6bba3-7d7b-4331-9606-934453e801e7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:10.320590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47b6bba3-7d7b-4331-9606-934453e801e7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:10.321429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47b6bba3-7d7b-4331-9606-934453e801e7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:10.362201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-47b6bba3-7d7b-4331-9606-934453e801e7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Going to try to stop instance {{(pid=136094) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:05:10.443461 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-47b6bba3-7d7b-4331-9606-934453e801e7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.138228 Feb 19 21:05:10.446302 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1774/3434] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:10 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:10.454372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b6132b8e-eee7-4027-bc76-b0dcf5095f02 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:10.463615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b6132b8e-eee7-4027-bc76-b0dcf5095f02 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:10.471174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6132b8e-eee7-4027-bc76-b0dcf5095f02 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:10.471806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6132b8e-eee7-4027-bc76-b0dcf5095f02 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:10.473084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6132b8e-eee7-4027-bc76-b0dcf5095f02 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:10.473679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6132b8e-eee7-4027-bc76-b0dcf5095f02 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:10.616841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:10.630913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:10.633167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:10.635359 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc68cd69-e91c-40ef-9606-e1d5a4041fe0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1722 microversion: 2.20 time: 0.439043 Feb 19 21:05:10.636585 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1661/3435] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:10 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1722 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:10.643185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d70d2519-073e-4e62-bd88-02f3775a2eeb tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6467b7b040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:10.823371 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d70d2519-073e-4e62-bd88-02f3775a2eeb tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/ca46aa15-bd97-4497-accb-1b3ef94e8c5c" status: 200 len: 664 microversion: 2.1 time: 0.185083 Feb 19 21:05:10.824019 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1662/3436] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:05:10 2022] GET /compute/v2.1/os-security-groups/ca46aa15-bd97-4497-accb-1b3ef94e8c5c => generated 664 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:10.828528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b82e0a53-d083-4a8f-a458-7af907a89195 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:10.829147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b82e0a53-d083-4a8f-a458-7af907a89195 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:10.841568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b82e0a53-d083-4a8f-a458-7af907a89195 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:10.842538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b82e0a53-d083-4a8f-a458-7af907a89195 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:10.843704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b82e0a53-d083-4a8f-a458-7af907a89195 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:10.844242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b82e0a53-d083-4a8f-a458-7af907a89195 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:10.878774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b6132b8e-eee7-4027-bc76-b0dcf5095f02 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:10.895808 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b6132b8e-eee7-4027-bc76-b0dcf5095f02 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.446858 Feb 19 21:05:10.897250 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1775/3437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:10 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:10.914018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46b3ebcf-9a45-461d-9f49-7db44efa7e47 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6467a2bee0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:11.290163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b82e0a53-d083-4a8f-a458-7af907a89195 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:11.298877 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b82e0a53-d083-4a8f-a458-7af907a89195 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.473504 Feb 19 21:05:11.300064 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1663/3438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:10 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:11.304887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce820087-437c-4662-8dde-83d00bfcb51e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:11.305588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ce820087-437c-4662-8dde-83d00bfcb51e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Failed to fetch instance by id 9223372036854775808 {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2871}} Feb 19 21:05:11.306310 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-ce820087-437c-4662-8dde-83d00bfcb51e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Feb 19 21:05:11.307219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce820087-437c-4662-8dde-83d00bfcb51e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:11.308513 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ce820087-437c-4662-8dde-83d00bfcb51e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.007009 Feb 19 21:05:11.313441 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1664/3439] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Feb 19 21:05:11 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:05:11.319471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:11.320400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:11.329869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:11.330707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:11.331553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:11.332183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:11.361902 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-46b3ebcf-9a45-461d-9f49-7db44efa7e47 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/62c56dca-c87c-44e4-ad7f-eb182d2046ec" status: 202 len: 0 microversion: 2.1 time: 0.456696 Feb 19 21:05:11.367794 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1776/3440] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Feb 19 21:05:10 2022] DELETE /compute/v2.1/os-security-group-rules/62c56dca-c87c-44e4-ad7f-eb182d2046ec => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:11.376615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-92678ead-df1e-4a81-a0d2-8bd66027f737 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:11.378277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-92678ead-df1e-4a81-a0d2-8bd66027f737 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:11.389179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92678ead-df1e-4a81-a0d2-8bd66027f737 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:11.390296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92678ead-df1e-4a81-a0d2-8bd66027f737 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:11.391477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92678ead-df1e-4a81-a0d2-8bd66027f737 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:11.392088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92678ead-df1e-4a81-a0d2-8bd66027f737 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:11.418486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:11.435683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:11.437315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:11.438850 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a0339148-7fda-44be-b255-8c5593335a55 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1414 microversion: 2.54 time: 0.124329 Feb 19 21:05:11.439698 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1665/3441] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:11 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:11.453882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1de6ea83-7c83-43c9-bf53-4751b08354c9 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6467a841f0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:11.771204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-92678ead-df1e-4a81-a0d2-8bd66027f737 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:11.781178 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-92678ead-df1e-4a81-a0d2-8bd66027f737 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.410980 Feb 19 21:05:11.782052 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1777/3442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:11 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:11.799713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:11.800611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:11.809912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:11.810640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:11.811445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:11.811881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:12.026515 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1de6ea83-7c83-43c9-bf53-4751b08354c9 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/ca46aa15-bd97-4497-accb-1b3ef94e8c5c" status: 202 len: 0 microversion: 2.1 time: 0.586009 Feb 19 21:05:12.027482 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1666/3443] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:11 2022] DELETE /compute/v2.1/os-security-groups/ca46aa15-bd97-4497-accb-1b3ef94e8c5c => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:12.035154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b6340c90-613e-4632-a7fa-4513ceb0ad06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:12.036287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b6340c90-613e-4632-a7fa-4513ceb0ad06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:12.044552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6340c90-613e-4632-a7fa-4513ceb0ad06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:12.045383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6340c90-613e-4632-a7fa-4513ceb0ad06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:12.046755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6340c90-613e-4632-a7fa-4513ceb0ad06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:12.047536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6340c90-613e-4632-a7fa-4513ceb0ad06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:12.230093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:12.245714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:12.248499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:12.250801 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9bbef40f-08fd-452a-a442-9cc2cf17a84b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1722 microversion: 2.20 time: 0.454803 Feb 19 21:05:12.263742 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1778/3444] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:11 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:12.270445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-61c07c3a-4e2f-4b60-ba34-95713069f31f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6467a9d040>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:12.327403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG neutronclient.v2_0.client [None req-61c07c3a-4e2f-4b60-ba34-95713069f31f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e6665006-ef90-4dd8-a158-812b1c2a77e1 does not exist", "detail": ""}} {{(pid=136094) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:05:12.328124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.security_group_api [None req-61c07c3a-4e2f-4b60-ba34-95713069f31f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Neutron security group e6665006-ef90-4dd8-a158-812b1c2a77e1 not found {{(pid=136094) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:05:12.328950 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-61c07c3a-4e2f-4b60-ba34-95713069f31f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] HTTP exception thrown: Security group e6665006-ef90-4dd8-a158-812b1c2a77e1 does not exist Feb 19 21:05:12.328950 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-1b4e14ee-0d82-4184-b46e-d02e6882b5b5'] Feb 19 21:05:12.329888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-61c07c3a-4e2f-4b60-ba34-95713069f31f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Returning 404 to user: Security group e6665006-ef90-4dd8-a158-812b1c2a77e1 does not exist Feb 19 21:05:12.329888 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-1b4e14ee-0d82-4184-b46e-d02e6882b5b5'] {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:12.331056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-61c07c3a-4e2f-4b60-ba34-95713069f31f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e6665006-ef90-4dd8-a158-812b1c2a77e1" status: 404 len: 194 microversion: 2.1 time: 0.065278 Feb 19 21:05:12.331872 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1779/3445] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:12 2022] DELETE /compute/v2.1/os-security-groups/e6665006-ef90-4dd8-a158-812b1c2a77e1 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:12.338436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-be830b0e-f533-4de3-8469-823f548c052d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:12.345818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-be830b0e-f533-4de3-8469-823f548c052d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:12.359445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be830b0e-f533-4de3-8469-823f548c052d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:12.360070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be830b0e-f533-4de3-8469-823f548c052d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:12.363090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be830b0e-f533-4de3-8469-823f548c052d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:12.363880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be830b0e-f533-4de3-8469-823f548c052d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:12.514626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b6340c90-613e-4632-a7fa-4513ceb0ad06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:12.530990 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b6340c90-613e-4632-a7fa-4513ceb0ad06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.501572 Feb 19 21:05:12.534889 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1667/3446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:12 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:12.567758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43d634b2-e9ab-4ac0-a2c5-d2e30bcdd0b2 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6467ac30d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:12.965059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-be830b0e-f533-4de3-8469-823f548c052d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:12.978728 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-be830b0e-f533-4de3-8469-823f548c052d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.642565 Feb 19 21:05:12.990160 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1780/3447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:12 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:12.996480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:12.997434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:13.003949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:13.004425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:13.005218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:13.005900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:13.421352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:13.430298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:13.436557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:13.437798 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e45434f1-673f-432b-8ba2-a7db9f095255 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1399 microversion: 2.54 time: 0.445408 Feb 19 21:05:13.438626 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1781/3448] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:12 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1399 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:13.452993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6ac296f3-0d3b-41c8-9579-03f9e0f0b8d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:13.455282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6ac296f3-0d3b-41c8-9579-03f9e0f0b8d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Failed to fetch instance by id -1 {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2871}} Feb 19 21:05:13.455895 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-6ac296f3-0d3b-41c8-9579-03f9e0f0b8d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance -1 could not be found. Feb 19 21:05:13.456576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6ac296f3-0d3b-41c8-9579-03f9e0f0b8d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance -1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:13.457692 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6ac296f3-0d3b-41c8-9579-03f9e0f0b8d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017993 Feb 19 21:05:13.459988 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1782/3449] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 21:05:13 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:05:13.465501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:13.471246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:13.482282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:13.483192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:13.484241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:13.484913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:13.567698 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-43d634b2-e9ab-4ac0-a2c5-d2e30bcdd0b2 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1ac7b270-b490-41e1-99be-f0648be84ddc" status: 202 len: 0 microversion: 2.1 time: 1.016592 Feb 19 21:05:13.568895 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1668/3450] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:12 2022] DELETE /compute/v2.1/os-security-groups/1ac7b270-b490-41e1-99be-f0648be84ddc => generated 0 bytes in 1019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:13.578888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d15183d-5173-486c-a52c-03f0a5a0e354 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '.version_select at 0x7f6467b41670>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:13.613823 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d15183d-5173-486c-a52c-03f0a5a0e354 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-230664380" status: 204 len: 0 microversion: 2.54 time: 0.043404 Feb 19 21:05:13.625926 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1669/3451] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Feb 19 21:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-230664380 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:05:13.636513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ddf807ba-847d-4421-ace4-b9f9f44fbdaa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:13.638200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ddf807ba-847d-4421-ace4-b9f9f44fbdaa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:13.646459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddf807ba-847d-4421-ace4-b9f9f44fbdaa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:13.646935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddf807ba-847d-4421-ace4-b9f9f44fbdaa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:13.648235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddf807ba-847d-4421-ace4-b9f9f44fbdaa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:13.649176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ddf807ba-847d-4421-ace4-b9f9f44fbdaa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:13.739538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:13.751601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:13.753355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:13.754868 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dc163b72-d37a-43fc-8985-185dcb929a9f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1722 microversion: 2.20 time: 0.293676 Feb 19 21:05:13.755453 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1783/3452] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:13 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:13.760431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b6d07ad0-b6d0-4bb0-b01e-e84406a8625f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6479086dc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:13.854892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ddf807ba-847d-4421-ace4-b9f9f44fbdaa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:13.866712 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ddf807ba-847d-4421-ace4-b9f9f44fbdaa tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.237369 Feb 19 21:05:13.878372 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1670/3453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:13 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:13.878372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2dfa0f96-571e-4e2f-9b60-cc01bd2c3235 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:13.878372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2dfa0f96-571e-4e2f-9b60-cc01bd2c3235 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:13.883491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dfa0f96-571e-4e2f-9b60-cc01bd2c3235 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:13.884276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dfa0f96-571e-4e2f-9b60-cc01bd2c3235 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:13.885225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dfa0f96-571e-4e2f-9b60-cc01bd2c3235 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:13.885739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dfa0f96-571e-4e2f-9b60-cc01bd2c3235 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:13.913372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2dfa0f96-571e-4e2f-9b60-cc01bd2c3235 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:05:14.002143 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2dfa0f96-571e-4e2f-9b60-cc01bd2c3235 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 204 len: 0 microversion: 2.54 time: 0.132155 Feb 19 21:05:14.005380 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1671/3454] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:05:13 2022] DELETE /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:05:14.009909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3ad863a3-21e7-49bd-aae4-207de9cfdbee tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:14.010618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3ad863a3-21e7-49bd-aae4-207de9cfdbee tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:14.019470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ad863a3-21e7-49bd-aae4-207de9cfdbee tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.019930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ad863a3-21e7-49bd-aae4-207de9cfdbee tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.021031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ad863a3-21e7-49bd-aae4-207de9cfdbee tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.022080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ad863a3-21e7-49bd-aae4-207de9cfdbee tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.027427 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b6d07ad0-b6d0-4bb0-b01e-e84406a8625f tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/cbf89274-941d-462b-a454-a417821622ed" status: 202 len: 0 microversion: 2.1 time: 0.270576 Feb 19 21:05:14.028622 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1784/3455] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:13 2022] DELETE /compute/v2.1/os-security-groups/cbf89274-941d-462b-a454-a417821622ed => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:14.034275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4eec5a87-b800-4f6d-997b-94f8d06a534e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:14.035221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4eec5a87-b800-4f6d-997b-94f8d06a534e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:14.050655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eec5a87-b800-4f6d-997b-94f8d06a534e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.051096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eec5a87-b800-4f6d-997b-94f8d06a534e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.052074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eec5a87-b800-4f6d-997b-94f8d06a534e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.064487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4eec5a87-b800-4f6d-997b-94f8d06a534e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.420784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3ad863a3-21e7-49bd-aae4-207de9cfdbee tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:14.454583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4eec5a87-b800-4f6d-997b-94f8d06a534e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:14.471233 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4eec5a87-b800-4f6d-997b-94f8d06a534e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.441373 Feb 19 21:05:14.471859 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1785/3456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:14 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:14.475142 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3ad863a3-21e7-49bd-aae4-207de9cfdbee tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.470127 Feb 19 21:05:14.484912 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1672/3457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:14 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:14.488220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4df363eb-130e-4be9-b73a-db03c56a66da tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6467fa68b0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:14.498718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:14.501859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:14.515199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.515659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.516494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.517219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.625739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:14.642216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:14.644763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:14.646295 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b7b20196-75a2-46e1-b303-62f9e54b7e61 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1405 microversion: 2.54 time: 0.173429 Feb 19 21:05:14.647397 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1786/3458] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:14 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:14.653121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7ca2b201-de62-4055-9bb8-4bf71459979d req-6b492529-672d-4319-a8e5-88e03806a09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17524174-4cfd-409a-b6f4-15bde7d2c4d1", "name": "network-vif-unplugged", "status": "completed", "tag": "2caf0c43-e8a7-47e8-a90c-390f3b45d82b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:14.657331 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:14.657331 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:05:14.669073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7ca2b201-de62-4055-9bb8-4bf71459979d req-6b492529-672d-4319-a8e5-88e03806a09f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.670092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7ca2b201-de62-4055-9bb8-4bf71459979d req-6b492529-672d-4319-a8e5-88e03806a09f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.685185 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7ca2b201-de62-4055-9bb8-4bf71459979d req-6b492529-672d-4319-a8e5-88e03806a09f service nova] Creating event network-vif-unplugged:2caf0c43-e8a7-47e8-a90c-390f3b45d82b for instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 on nch1-master-1 Feb 19 21:05:14.693924 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7ca2b201-de62-4055-9bb8-4bf71459979d req-6b492529-672d-4319-a8e5-88e03806a09f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045010 Feb 19 21:05:14.694562 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1787/3459] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:14.707358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6135ba72-4384-4d6b-bf9d-6c12b78a6e20 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:14.708241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6135ba72-4384-4d6b-bf9d-6c12b78a6e20 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 2f1c33dc-c3b3-43d4-9405-d6aa7b8733a8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:14.714622 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-6135ba72-4384-4d6b-bf9d-6c12b78a6e20 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 2f1c33dc-c3b3-43d4-9405-d6aa7b8733a8 could not be found. Feb 19 21:05:14.715228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6135ba72-4384-4d6b-bf9d-6c12b78a6e20 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 2f1c33dc-c3b3-43d4-9405-d6aa7b8733a8 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:14.716084 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6135ba72-4384-4d6b-bf9d-6c12b78a6e20 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/2f1c33dc-c3b3-43d4-9405-d6aa7b8733a8/action" status: 404 len: 111 microversion: 2.1 time: 0.013794 Feb 19 21:05:14.716727 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1788/3460] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:14 2022] POST /compute/v2.1/servers/2f1c33dc-c3b3-43d4-9405-d6aa7b8733a8/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:14.731767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b42386e8-7ee1-4dd8-9864-1a4f96e41827 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:14.733059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b42386e8-7ee1-4dd8-9864-1a4f96e41827 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:14.740977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b42386e8-7ee1-4dd8-9864-1a4f96e41827 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.741732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b42386e8-7ee1-4dd8-9864-1a4f96e41827 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.742849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b42386e8-7ee1-4dd8-9864-1a4f96e41827 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.743339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b42386e8-7ee1-4dd8-9864-1a4f96e41827 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.784759 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4df363eb-130e-4be9-b73a-db03c56a66da tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/6e123503-46bd-4af9-af3b-dbef806190d2" status: 202 len: 0 microversion: 2.1 time: 0.307862 Feb 19 21:05:14.786261 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1673/3461] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:14 2022] DELETE /compute/v2.1/os-security-groups/6e123503-46bd-4af9-af3b-dbef806190d2 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:14.792569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:14.793197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:14.799643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.800228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:14.801071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:14.801713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:15.095050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b42386e8-7ee1-4dd8-9864-1a4f96e41827 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:15.101595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:15.110690 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b42386e8-7ee1-4dd8-9864-1a4f96e41827 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.389438 Feb 19 21:05:15.111749 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1789/3462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:14 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:15.117910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c8d5729-853a-4fc9-acfd-89bde51e7bdc tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f64678f5af0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:15.130371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:15.132536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:15.139673 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-24971fb9-48a7-4bd4-9605-3e2896b65235 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1722 microversion: 2.20 time: 0.350522 Feb 19 21:05:15.140414 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1674/3463] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:14 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:15.153107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-474384b5-b96f-4959-9dc9-697e9a98841e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:15.153893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-474384b5-b96f-4959-9dc9-697e9a98841e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:15.208539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-474384b5-b96f-4959-9dc9-697e9a98841e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:15.211791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-474384b5-b96f-4959-9dc9-697e9a98841e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:15.219502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-474384b5-b96f-4959-9dc9-697e9a98841e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:15.226052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-474384b5-b96f-4959-9dc9-697e9a98841e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:15.531730 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c8d5729-853a-4fc9-acfd-89bde51e7bdc tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/ce6751d4-2776-41b3-ac9f-24049c6a45a9" status: 202 len: 0 microversion: 2.1 time: 0.418544 Feb 19 21:05:15.532886 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1790/3464] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:15 2022] DELETE /compute/v2.1/os-security-groups/ce6751d4-2776-41b3-ac9f-24049c6a45a9 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:15.537944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bee96395-7b75-4502-aaa9-db1eaa374b13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:15.538749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-474384b5-b96f-4959-9dc9-697e9a98841e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:15.538932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bee96395-7b75-4502-aaa9-db1eaa374b13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:15.548612 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-474384b5-b96f-4959-9dc9-697e9a98841e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.406852 Feb 19 21:05:15.554847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bee96395-7b75-4502-aaa9-db1eaa374b13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:15.557285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bee96395-7b75-4502-aaa9-db1eaa374b13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:15.558554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bee96395-7b75-4502-aaa9-db1eaa374b13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:15.559264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bee96395-7b75-4502-aaa9-db1eaa374b13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:15.561302 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1675/3465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:15 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:15.570049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2f1259cb-ebd9-414e-9269-c8916df3e9f0 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] Calling method '.version_select at 0x7f6467a840d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:15.947057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bee96395-7b75-4502-aaa9-db1eaa374b13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:15.957239 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bee96395-7b75-4502-aaa9-db1eaa374b13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.423022 Feb 19 21:05:15.957956 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1791/3466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:15 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:15.963800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c075ea8-0eea-4f07-9409-d780dc54a99a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:15.964819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3c075ea8-0eea-4f07-9409-d780dc54a99a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 9e0c4568-7e5b-4c03-b8bf-0574b10de65b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:15.971334 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-3c075ea8-0eea-4f07-9409-d780dc54a99a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 9e0c4568-7e5b-4c03-b8bf-0574b10de65b could not be found. Feb 19 21:05:15.971928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c075ea8-0eea-4f07-9409-d780dc54a99a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 9e0c4568-7e5b-4c03-b8bf-0574b10de65b could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:15.972986 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3c075ea8-0eea-4f07-9409-d780dc54a99a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/9e0c4568-7e5b-4c03-b8bf-0574b10de65b/action" status: 404 len: 111 microversion: 2.1 time: 0.013936 Feb 19 21:05:15.973570 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1792/3467] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:15 2022] POST /compute/v2.1/servers/9e0c4568-7e5b-4c03-b8bf-0574b10de65b/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:15.979812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:15.980109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:15.987904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:15.988586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:15.989922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:15.990533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:16.140586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:16.152689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:16.162144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27b29d136ead4a40b9c81787b96c567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6192b12536cf4040bfcaac0f1bbdc8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:16.163960 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d9f3ad0c-dfad-4f42-9ad4-225b65850ede tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 200 len: 1405 microversion: 2.54 time: 0.189175 Feb 19 21:05:16.164903 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1793/3468] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:15 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:16.170544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ac2df786-412b-43e1-8880-6ea5a6574242 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:16.171412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ac2df786-412b-43e1-8880-6ea5a6574242 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:16.177657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac2df786-412b-43e1-8880-6ea5a6574242 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:16.178416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac2df786-412b-43e1-8880-6ea5a6574242 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:16.179129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac2df786-412b-43e1-8880-6ea5a6574242 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:16.179565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac2df786-412b-43e1-8880-6ea5a6574242 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:16.251094 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2f1259cb-ebd9-414e-9269-c8916df3e9f0 tempest-SecurityGroupRulesTestJSON-1543476514 tempest-SecurityGroupRulesTestJSON-1543476514-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/38dafb69-405e-4157-a6fb-5744fb266eb2" status: 202 len: 0 microversion: 2.1 time: 0.688580 Feb 19 21:05:16.251694 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1676/3469] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:15 2022] DELETE /compute/v2.1/os-security-groups/38dafb69-405e-4157-a6fb-5744fb266eb2 => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:16.258355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:16.259027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:16.276986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:16.277550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:16.278590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:16.279078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:16.517573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ac2df786-412b-43e1-8880-6ea5a6574242 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:16.525999 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ac2df786-412b-43e1-8880-6ea5a6574242 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.359163 Feb 19 21:05:16.534176 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1794/3470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:16 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:16.546491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9960e918-6fb9-4073-a121-885f69854a58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:16.547122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9960e918-6fb9-4073-a121-885f69854a58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:16.553436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9960e918-6fb9-4073-a121-885f69854a58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:16.553893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9960e918-6fb9-4073-a121-885f69854a58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:16.554700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9960e918-6fb9-4073-a121-885f69854a58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:16.555175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9960e918-6fb9-4073-a121-885f69854a58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:16.564868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:16.584081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:16.587661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:16.591385 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7906e945-fc55-41e8-be45-5fc308aae055 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1665 microversion: 2.20 time: 0.336524 Feb 19 21:05:16.593768 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1677/3471] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:16 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1665 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:16.619042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a532a6c1-f178-432d-a59a-34f7457f6b36 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91b63972-f419-40a4-8d4f-37469baee526"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:16.620565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a532a6c1-f178-432d-a59a-34f7457f6b36 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:16.633064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a532a6c1-f178-432d-a59a-34f7457f6b36 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:16.644816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a532a6c1-f178-432d-a59a-34f7457f6b36 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:16.648787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a532a6c1-f178-432d-a59a-34f7457f6b36 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:16.651469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a532a6c1-f178-432d-a59a-34f7457f6b36 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:16.933020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9960e918-6fb9-4073-a121-885f69854a58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:16.944849 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9960e918-6fb9-4073-a121-885f69854a58 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.401975 Feb 19 21:05:16.953665 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1795/3472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:16 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:16.967527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68c96ad0-bdf4-4a0c-9ab1-7b881662fb22 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:16.968097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-68c96ad0-bdf4-4a0c-9ab1-7b881662fb22 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 8700fb1a-6f6a-43d0-8c63-b4d40906e281] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:16.988047 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-68c96ad0-bdf4-4a0c-9ab1-7b881662fb22 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 8700fb1a-6f6a-43d0-8c63-b4d40906e281 could not be found. Feb 19 21:05:16.989544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68c96ad0-bdf4-4a0c-9ab1-7b881662fb22 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 8700fb1a-6f6a-43d0-8c63-b4d40906e281 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:16.992304 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-68c96ad0-bdf4-4a0c-9ab1-7b881662fb22 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/8700fb1a-6f6a-43d0-8c63-b4d40906e281" status: 404 len: 111 microversion: 2.1 time: 0.029609 Feb 19 21:05:16.994570 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1796/3473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:16 2022] GET /compute/v2.1/servers/8700fb1a-6f6a-43d0-8c63-b4d40906e281 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:05:17.159283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3490566c-e970-43ec-ae63-767a0469cb75 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:17.161355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3490566c-e970-43ec-ae63-767a0469cb75 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:17.175219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3490566c-e970-43ec-ae63-767a0469cb75 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.176286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3490566c-e970-43ec-ae63-767a0469cb75 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.179857 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a532a6c1-f178-432d-a59a-34f7457f6b36 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.573382 Feb 19 21:05:17.181359 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1678/3474] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Feb 19 21:05:16 2022] POST /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments => generated 188 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 21:05:17.195099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3490566c-e970-43ec-ae63-767a0469cb75 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.197123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3490566c-e970-43ec-ae63-767a0469cb75 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.197773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8beeca5e-b5c8-4887-9b07-669014643970 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:17.198421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8beeca5e-b5c8-4887-9b07-669014643970 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:17.216406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8beeca5e-b5c8-4887-9b07-669014643970 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.219964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8beeca5e-b5c8-4887-9b07-669014643970 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.220576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8beeca5e-b5c8-4887-9b07-669014643970 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.221025 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8beeca5e-b5c8-4887-9b07-669014643970 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.650410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8beeca5e-b5c8-4887-9b07-669014643970 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:17.663055 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8beeca5e-b5c8-4887-9b07-669014643970 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.480160 Feb 19 21:05:17.665960 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1679/3475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:17 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:17.678286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3490566c-e970-43ec-ae63-767a0469cb75 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:17.687415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5b6356db-25da-4c89-b8b3-409f0ffd8109 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:17.688694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5b6356db-25da-4c89-b8b3-409f0ffd8109 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] [instance: 1e66619c-a7d4-4421-b279-81c4c41fa1b6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:17.690305 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3490566c-e970-43ec-ae63-767a0469cb75 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.691475 Feb 19 21:05:17.696406 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1797/3476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:16 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:17.715888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-30ff26b4-139f-4f83-948e-ff18fe14280c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:17.716703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b6356db-25da-4c89-b8b3-409f0ffd8109 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.717275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b6356db-25da-4c89-b8b3-409f0ffd8109 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.718196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b6356db-25da-4c89-b8b3-409f0ffd8109 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.725646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30ff26b4-139f-4f83-948e-ff18fe14280c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:17.726452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b6356db-25da-4c89-b8b3-409f0ffd8109 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.751161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30ff26b4-139f-4f83-948e-ff18fe14280c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.751917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30ff26b4-139f-4f83-948e-ff18fe14280c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.752750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30ff26b4-139f-4f83-948e-ff18fe14280c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.753367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30ff26b4-139f-4f83-948e-ff18fe14280c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.759397 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-5b6356db-25da-4c89-b8b3-409f0ffd8109 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] HTTP exception thrown: Instance 1e66619c-a7d4-4421-b279-81c4c41fa1b6 could not be found. Feb 19 21:05:17.760016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5b6356db-25da-4c89-b8b3-409f0ffd8109 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] Returning 404 to user: Instance 1e66619c-a7d4-4421-b279-81c4c41fa1b6 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:17.761097 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5b6356db-25da-4c89-b8b3-409f0ffd8109 tempest-ServerShowV254Test-1051627954 tempest-ServerShowV254Test-1051627954-project] 10.222.0.30 "GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6" status: 404 len: 111 microversion: 2.54 time: 0.077451 Feb 19 21:05:17.763702 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1680/3477] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:17 2022] GET /compute/v2.1/servers/1e66619c-a7d4-4421-b279-81c4c41fa1b6 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:05:17.782377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-918868ba-0e81-466a-acb4-0c6d1b6484dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:17.784638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-918868ba-0e81-466a-acb4-0c6d1b6484dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:17.813596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-918868ba-0e81-466a-acb4-0c6d1b6484dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.819981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-918868ba-0e81-466a-acb4-0c6d1b6484dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.820918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-918868ba-0e81-466a-acb4-0c6d1b6484dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.822099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-918868ba-0e81-466a-acb4-0c6d1b6484dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.926659 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-30ff26b4-139f-4f83-948e-ff18fe14280c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/action" status: 202 len: 0 microversion: 2.20 time: 0.231030 Feb 19 21:05:17.931663 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1798/3478] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 21:05:17 2022] POST /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:05:17.937321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:17.946328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:17.961105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.961955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:17.963008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:17.970893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:18.204519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-918868ba-0e81-466a-acb4-0c6d1b6484dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:18.213345 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-918868ba-0e81-466a-acb4-0c6d1b6484dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.448354 Feb 19 21:05:18.222437 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1681/3479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:17 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:18.290144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:18.314195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:18.317642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:18.327375 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5e3158eb-891e-41f2-aa9c-583a26fb6d46 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1751 microversion: 2.20 time: 0.393961 Feb 19 21:05:18.337902 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1799/3480] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:17 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1751 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:18.717085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2f74fb50-5b0b-45e7-84b8-11ee3168ce92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:18.717724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2f74fb50-5b0b-45e7-84b8-11ee3168ce92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:18.719573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-653cd218-2ff9-442e-a4d9-5a91dbdeb88e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-470681707", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:18.723928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-653cd218-2ff9-442e-a4d9-5a91dbdeb88e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:18.730768 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-653cd218-2ff9-442e-a4d9-5a91dbdeb88e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016399 Feb 19 21:05:18.736933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f74fb50-5b0b-45e7-84b8-11ee3168ce92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:18.737878 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1800/3481] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:05:18.742145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f74fb50-5b0b-45e7-84b8-11ee3168ce92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:18.745130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f74fb50-5b0b-45e7-84b8-11ee3168ce92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:18.747606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f74fb50-5b0b-45e7-84b8-11ee3168ce92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:18.753963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44437c51-1964-43b2-b1a8-8a2ce5eba077 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:18.759490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-44437c51-1964-43b2-b1a8-8a2ce5eba077 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:18.788123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44437c51-1964-43b2-b1a8-8a2ce5eba077 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:18.789127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44437c51-1964-43b2-b1a8-8a2ce5eba077 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:18.795701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44437c51-1964-43b2-b1a8-8a2ce5eba077 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:18.799001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44437c51-1964-43b2-b1a8-8a2ce5eba077 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:19.330356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2f74fb50-5b0b-45e7-84b8-11ee3168ce92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:19.338897 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2f74fb50-5b0b-45e7-84b8-11ee3168ce92 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.632666 Feb 19 21:05:19.349351 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1682/3482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:18 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:19.355767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44437c51-1964-43b2-b1a8-8a2ce5eba077 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:19.363135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:19.363767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:19.373434 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44437c51-1964-43b2-b1a8-8a2ce5eba077 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.634572 Feb 19 21:05:19.374031 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1801/3483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:18 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:19.383078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:19.383485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:19.384358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:19.384806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:19.413342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8fa93936-2ab9-4d15-80fd-8f4a75257614 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:19.413996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8fa93936-2ab9-4d15-80fd-8f4a75257614 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:19.429030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fa93936-2ab9-4d15-80fd-8f4a75257614 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:19.429528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fa93936-2ab9-4d15-80fd-8f4a75257614 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:19.430358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fa93936-2ab9-4d15-80fd-8f4a75257614 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:19.430892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fa93936-2ab9-4d15-80fd-8f4a75257614 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:19.782726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:19.792104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:19.798131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:19.801754 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-97d000f7-e3f3-4f5b-bf67-541b4a2504e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1751 microversion: 2.20 time: 0.442580 Feb 19 21:05:19.809069 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1683/3484] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:19 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1751 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:05:19.832050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8fa93936-2ab9-4d15-80fd-8f4a75257614 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:19.840369 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8fa93936-2ab9-4d15-80fd-8f4a75257614 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.451071 Feb 19 21:05:19.842687 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1802/3485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:19 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:20.171341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-15882f69-1fad-4f1c-981e-ca12e3c7e93c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-765742535", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:20.173256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-15882f69-1fad-4f1c-981e-ca12e3c7e93c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:20.174648 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-15882f69-1fad-4f1c-981e-ca12e3c7e93c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.006981 Feb 19 21:05:20.175391 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1684/3486] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:20 2022] POST /compute/v2.1/servers => generated 133 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:05:20.184409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cafde301-d84b-4659-a66a-471245a3740a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:20.185082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cafde301-d84b-4659-a66a-471245a3740a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:20.204069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cafde301-d84b-4659-a66a-471245a3740a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:20.204567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cafde301-d84b-4659-a66a-471245a3740a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:20.205464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cafde301-d84b-4659-a66a-471245a3740a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:20.205911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cafde301-d84b-4659-a66a-471245a3740a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:20.355689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2195af13-8625-427a-8e5c-062c6d7598a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:20.356575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2195af13-8625-427a-8e5c-062c6d7598a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:20.372622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2195af13-8625-427a-8e5c-062c6d7598a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:20.373088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2195af13-8625-427a-8e5c-062c6d7598a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:20.373910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2195af13-8625-427a-8e5c-062c6d7598a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:20.374356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2195af13-8625-427a-8e5c-062c6d7598a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:20.505456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cafde301-d84b-4659-a66a-471245a3740a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:20.515909 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cafde301-d84b-4659-a66a-471245a3740a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.335899 Feb 19 21:05:20.519844 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1803/3487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:20 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:20.549755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e6769c0-cb57-4ed1-ab53-1b87b73dab5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:20.550366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e6769c0-cb57-4ed1-ab53-1b87b73dab5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:20.569328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e6769c0-cb57-4ed1-ab53-1b87b73dab5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:20.570172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e6769c0-cb57-4ed1-ab53-1b87b73dab5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:20.571043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e6769c0-cb57-4ed1-ab53-1b87b73dab5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:20.571788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e6769c0-cb57-4ed1-ab53-1b87b73dab5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:20.827910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2195af13-8625-427a-8e5c-062c6d7598a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:20.841146 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2195af13-8625-427a-8e5c-062c6d7598a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.488263 Feb 19 21:05:20.844928 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1685/3488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:20 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:20.851887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:20.856807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:20.875880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:20.878149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:20.880183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:20.882122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:21.021867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e6769c0-cb57-4ed1-ab53-1b87b73dab5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:21.045228 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e6769c0-cb57-4ed1-ab53-1b87b73dab5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.505120 Feb 19 21:05:21.048857 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1804/3489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:20 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:21.073260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dbbc7d89-38c3-4943-b821-4b5f04d1c131 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:21.074153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dbbc7d89-38c3-4943-b821-4b5f04d1c131 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 577e68af-a60a-42cb-b16f-3ef44ab83032] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:21.097596 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-dbbc7d89-38c3-4943-b821-4b5f04d1c131 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 577e68af-a60a-42cb-b16f-3ef44ab83032 could not be found. Feb 19 21:05:21.098769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dbbc7d89-38c3-4943-b821-4b5f04d1c131 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 577e68af-a60a-42cb-b16f-3ef44ab83032 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:21.100219 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dbbc7d89-38c3-4943-b821-4b5f04d1c131 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/577e68af-a60a-42cb-b16f-3ef44ab83032/action" status: 404 len: 111 microversion: 2.1 time: 0.040231 Feb 19 21:05:21.103003 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1805/3490] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:21 2022] POST /compute/v2.1/servers/577e68af-a60a-42cb-b16f-3ef44ab83032/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:05:21.119782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f4498c22-b97a-4464-9d2a-139abfd78892 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:21.121351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f4498c22-b97a-4464-9d2a-139abfd78892 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:21.135396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4498c22-b97a-4464-9d2a-139abfd78892 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:21.136135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4498c22-b97a-4464-9d2a-139abfd78892 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:21.137508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4498c22-b97a-4464-9d2a-139abfd78892 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:21.138230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4498c22-b97a-4464-9d2a-139abfd78892 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:21.151964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:21.175068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:21.179721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:21.183380 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2635c98d-39d8-4dc5-8b87-734486fbdfc8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1751 microversion: 2.20 time: 0.336847 Feb 19 21:05:21.199191 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1686/3491] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:20 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1751 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:21.533397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f4498c22-b97a-4464-9d2a-139abfd78892 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:21.544655 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f4498c22-b97a-4464-9d2a-139abfd78892 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.435846 Feb 19 21:05:21.545756 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1806/3492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:21 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:21.565695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5918526d-dbb2-4941-a943-52b5142dd1bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:21.566783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5918526d-dbb2-4941-a943-52b5142dd1bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:21.612883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5918526d-dbb2-4941-a943-52b5142dd1bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:21.619600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5918526d-dbb2-4941-a943-52b5142dd1bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:21.623740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5918526d-dbb2-4941-a943-52b5142dd1bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:21.631983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5918526d-dbb2-4941-a943-52b5142dd1bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:21.860232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d527d8a1-df3f-4e75-92c5-541abf338c04 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:21.861148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d527d8a1-df3f-4e75-92c5-541abf338c04 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:21.869079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d527d8a1-df3f-4e75-92c5-541abf338c04 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:21.870102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d527d8a1-df3f-4e75-92c5-541abf338c04 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:21.871372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d527d8a1-df3f-4e75-92c5-541abf338c04 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:21.871975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d527d8a1-df3f-4e75-92c5-541abf338c04 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:21.905412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5918526d-dbb2-4941-a943-52b5142dd1bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:21.926008 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5918526d-dbb2-4941-a943-52b5142dd1bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.367026 Feb 19 21:05:21.928944 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1687/3493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:21 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:21.954195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9ce9bdfa-2598-4d6a-9a71-469d44c9aa45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:21.955654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9ce9bdfa-2598-4d6a-9a71-469d44c9aa45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:21.972073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ce9bdfa-2598-4d6a-9a71-469d44c9aa45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:21.973730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ce9bdfa-2598-4d6a-9a71-469d44c9aa45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:21.975799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ce9bdfa-2598-4d6a-9a71-469d44c9aa45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:21.976968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ce9bdfa-2598-4d6a-9a71-469d44c9aa45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:22.185981 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9ce9bdfa-2598-4d6a-9a71-469d44c9aa45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 202 len: 0 microversion: 2.1 time: 0.242095 Feb 19 21:05:22.190322 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1688/3494] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:21 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:05:22.210699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-14285c40-3b33-4bda-91fd-3ed6e44b236d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:22.216910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-14285c40-3b33-4bda-91fd-3ed6e44b236d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:22.243318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14285c40-3b33-4bda-91fd-3ed6e44b236d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:22.244879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14285c40-3b33-4bda-91fd-3ed6e44b236d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:22.246652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d527d8a1-df3f-4e75-92c5-541abf338c04 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:22.248148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14285c40-3b33-4bda-91fd-3ed6e44b236d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:22.250175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14285c40-3b33-4bda-91fd-3ed6e44b236d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:22.255346 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d527d8a1-df3f-4e75-92c5-541abf338c04 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1656 microversion: 2.1 time: 0.399113 Feb 19 21:05:22.263313 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1807/3495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:21 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1656 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:22.277796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:22.281361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:22.295787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:22.298788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:22.299884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:22.300698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:22.709437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-14285c40-3b33-4bda-91fd-3ed6e44b236d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:22.725685 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-14285c40-3b33-4bda-91fd-3ed6e44b236d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1511 microversion: 2.1 time: 0.532711 Feb 19 21:05:22.739043 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1689/3496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:22 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1511 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:22.751591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-05eee6b5-692d-4c8f-a1fc-62df57d40f74 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:22.763882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:22.775999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:22.778596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:22.779893 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-be6bb80e-937c-4726-b9ff-dd73390f828e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1753 microversion: 2.20 time: 0.515037 Feb 19 21:05:22.780966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05eee6b5-692d-4c8f-a1fc-62df57d40f74 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:22.781700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05eee6b5-692d-4c8f-a1fc-62df57d40f74 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:22.789117 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1808/3497] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:22 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1753 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:22.822626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-05eee6b5-692d-4c8f-a1fc-62df57d40f74 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Going to try to start instance {{(pid=136095) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 19 21:05:22.969356 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-05eee6b5-692d-4c8f-a1fc-62df57d40f74 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.227374 Feb 19 21:05:22.970195 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1690/3498] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:22 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:22.992803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7df94f40-faa7-4617-91ca-86a1f36fa2a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:22.994871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7df94f40-faa7-4617-91ca-86a1f36fa2a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:23.005101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7df94f40-faa7-4617-91ca-86a1f36fa2a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:23.006280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7df94f40-faa7-4617-91ca-86a1f36fa2a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:23.010279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7df94f40-faa7-4617-91ca-86a1f36fa2a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:23.011051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7df94f40-faa7-4617-91ca-86a1f36fa2a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:23.291670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e243abda-5394-4b23-a769-6cbb101f197f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: .version_select at 0x7f647909ddc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-242977100", "description": "tempest-description-1382514927"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:23.354635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7df94f40-faa7-4617-91ca-86a1f36fa2a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:23.371241 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7df94f40-faa7-4617-91ca-86a1f36fa2a8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1665 microversion: 2.1 time: 0.387090 Feb 19 21:05:23.374680 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1691/3499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:22 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1665 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:23.568116 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e243abda-5394-4b23-a769-6cbb101f197f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.777105 Feb 19 21:05:23.571271 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1809/3500] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:23.586564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c3cc95a-c12c-485e-bb23-19358bdc93e4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: .version_select at 0x7f6467b41940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-328080119", "description": "tempest-description-874442273"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:23.751910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7195256f-031d-4e2c-baf8-680aff83db5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:23.752550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7195256f-031d-4e2c-baf8-680aff83db5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:23.759917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7195256f-031d-4e2c-baf8-680aff83db5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:23.760732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7195256f-031d-4e2c-baf8-680aff83db5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:23.761890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7195256f-031d-4e2c-baf8-680aff83db5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:23.762495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7195256f-031d-4e2c-baf8-680aff83db5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:23.797584 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c3cc95a-c12c-485e-bb23-19358bdc93e4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.215906 Feb 19 21:05:23.809148 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1692/3501] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:23 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:23.809148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:23.809148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:23.817297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:23.818064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:23.819398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:23.820148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:24.167305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:24.186563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:24.189804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:24.193902 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ce7b2f0d-d4b4-4eed-b7fa-56d947471622 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.394648 Feb 19 21:05:24.194942 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1693/3502] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:23 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:24.224936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1299963426", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "a70cdeb1-fa61-4f53-afac-2e2ce6af3cb6"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:24.311762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] validate_networks() for [('a70cdeb1-fa61-4f53-afac-2e2ce6af3cb6', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:05:24.620187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7195256f-031d-4e2c-baf8-680aff83db5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:24.639507 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7195256f-031d-4e2c-baf8-680aff83db5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1491 microversion: 2.1 time: 0.896795 Feb 19 21:05:24.640852 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1810/3503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:23 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1491 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:24.646046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-06ee01dd-4d48-40c0-b42a-51e9e3102238 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:24.646792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-06ee01dd-4d48-40c0-b42a-51e9e3102238 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:24.656502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06ee01dd-4d48-40c0-b42a-51e9e3102238 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:24.657366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06ee01dd-4d48-40c0-b42a-51e9e3102238 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:24.658979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06ee01dd-4d48-40c0-b42a-51e9e3102238 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:24.659921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-06ee01dd-4d48-40c0-b42a-51e9e3102238 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:25.040502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-06ee01dd-4d48-40c0-b42a-51e9e3102238 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:25.056948 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-06ee01dd-4d48-40c0-b42a-51e9e3102238 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1665 microversion: 2.1 time: 0.414945 Feb 19 21:05:25.057811 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1811/3504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:24 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1665 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:25.064173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ebcdc92d-e61e-4f07-be49-36f6742569d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:25.065089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ebcdc92d-e61e-4f07-be49-36f6742569d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:25.073020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebcdc92d-e61e-4f07-be49-36f6742569d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:25.074256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebcdc92d-e61e-4f07-be49-36f6742569d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:25.076191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebcdc92d-e61e-4f07-be49-36f6742569d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:25.076832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ebcdc92d-e61e-4f07-be49-36f6742569d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:25.115590 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ebcdc92d-e61e-4f07-be49-36f6742569d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Cannot 'pause' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state paused Feb 19 21:05:25.116698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ebcdc92d-e61e-4f07-be49-36f6742569d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 409 to user: Cannot 'pause' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state paused {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:25.118184 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ebcdc92d-e61e-4f07-be49-36f6742569d6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 409 len: 143 microversion: 2.1 time: 0.058973 Feb 19 21:05:25.119151 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1812/3505] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:25 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 143 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:05:25.127645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5691a3ab-7ba3-4397-a96d-7a61e171ebc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:25.128696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5691a3ab-7ba3-4397-a96d-7a61e171ebc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:25.139648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5691a3ab-7ba3-4397-a96d-7a61e171ebc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:25.140452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5691a3ab-7ba3-4397-a96d-7a61e171ebc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:25.141419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5691a3ab-7ba3-4397-a96d-7a61e171ebc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:25.142025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5691a3ab-7ba3-4397-a96d-7a61e171ebc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:25.276839 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5691a3ab-7ba3-4397-a96d-7a61e171ebc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 202 len: 0 microversion: 2.1 time: 0.150249 Feb 19 21:05:25.281009 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1813/3506] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:25 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:05:25.295148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:25.297865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:25.312320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:25.313675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:25.315492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:25.316712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:25.890764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:05:25.891403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:05:25.892234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:05:25.896670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:05:25.897101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:05:25.918152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:25.918607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:25.921093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:25.921563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:25.971002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Getting quotas for project 3e16b1ae38144c3ba7d8cb99e46eea10. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:05:25.980951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Getting quotas for user 2ff7364263f04529910770039084fb7f and project 3e16b1ae38144c3ba7d8cb99e46eea10. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:05:26.014105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:05:26.019034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:05:26.118500 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-943f3221-9318-4b19-b989-6685d4d1bd8f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.912805 Feb 19 21:05:26.124776 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1694/3507] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:05:26.145904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-402ec8b3-33b9-4689-b3f2-465dd9a695bd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:26.147285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-402ec8b3-33b9-4689-b3f2-465dd9a695bd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:26.161908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-402ec8b3-33b9-4689-b3f2-465dd9a695bd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:26.163265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-402ec8b3-33b9-4689-b3f2-465dd9a695bd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:26.165801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-402ec8b3-33b9-4689-b3f2-465dd9a695bd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:26.166996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-402ec8b3-33b9-4689-b3f2-465dd9a695bd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:26.543138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:26.552611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:26.554675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:26.556896 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-72ae56ca-3462-4174-aae1-1bb0a5dbfb45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 1.273244 Feb 19 21:05:26.558084 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1814/3508] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:25 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:26.563215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c5b2993-42d8-4791-8ac4-b389a2ce4f15 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:26.564317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3c5b2993-42d8-4791-8ac4-b389a2ce4f15 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:26.573116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c5b2993-42d8-4791-8ac4-b389a2ce4f15 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:26.573572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c5b2993-42d8-4791-8ac4-b389a2ce4f15 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:26.574553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c5b2993-42d8-4791-8ac4-b389a2ce4f15 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:26.575168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c5b2993-42d8-4791-8ac4-b389a2ce4f15 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:26.722504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-402ec8b3-33b9-4689-b3f2-465dd9a695bd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:26.748372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-402ec8b3-33b9-4689-b3f2-465dd9a695bd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.622085 Feb 19 21:05:26.749279 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1695/3509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:26 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:26.757348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98c7d3b3-ce25-4e36-99a5-55ac71bbfbd8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:26.766373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-98c7d3b3-ce25-4e36-99a5-55ac71bbfbd8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:26.920974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98c7d3b3-ce25-4e36-99a5-55ac71bbfbd8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:26.957305 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98c7d3b3-ce25-4e36-99a5-55ac71bbfbd8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1216 microversion: 2.1 time: 0.206117 Feb 19 21:05:26.966292 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1696/3510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:26 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1216 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:27.001878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3c5b2993-42d8-4791-8ac4-b389a2ce4f15 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:27.011612 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3c5b2993-42d8-4791-8ac4-b389a2ce4f15 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.452029 Feb 19 21:05:27.015839 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1815/3511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:26 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:27.022125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-42211195-637b-4753-9f71-b3b3388cd6ff tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:27.022750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-42211195-637b-4753-9f71-b3b3388cd6ff tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:27.030993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42211195-637b-4753-9f71-b3b3388cd6ff tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:27.031712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42211195-637b-4753-9f71-b3b3388cd6ff tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:27.032785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42211195-637b-4753-9f71-b3b3388cd6ff tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:27.033426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42211195-637b-4753-9f71-b3b3388cd6ff tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:27.127443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-428259602", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "207d0904-2884-4a2a-ba57-e3dc23fe6321"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:27.256172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] validate_networks() for [('207d0904-2884-4a2a-ba57-e3dc23fe6321', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:05:27.715155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-42211195-637b-4753-9f71-b3b3388cd6ff tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:27.747876 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-42211195-637b-4753-9f71-b3b3388cd6ff tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.730808 Feb 19 21:05:27.753013 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1816/3512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:27 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:27.766745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b097ee2-2386-4c89-9209-f07450353f05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:27.771249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b097ee2-2386-4c89-9209-f07450353f05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:27.784301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b097ee2-2386-4c89-9209-f07450353f05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:27.784933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b097ee2-2386-4c89-9209-f07450353f05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:27.789365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b097ee2-2386-4c89-9209-f07450353f05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:27.791560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b097ee2-2386-4c89-9209-f07450353f05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:28.621756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4b097ee2-2386-4c89-9209-f07450353f05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:28.631215 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b097ee2-2386-4c89-9209-f07450353f05 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.875654 Feb 19 21:05:28.642648 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1817/3513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:27 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:28.647446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ec1116d9-f33e-4157-af3d-45747944a6d7 req-7fc1f473-5928-4ea1-b30b-1e214ae6e1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17524174-4cfd-409a-b6f4-15bde7d2c4d1", "tag": "2caf0c43-e8a7-47e8-a90c-390f3b45d82b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:28.649897 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:28.649897 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:05:28.668087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ec1116d9-f33e-4157-af3d-45747944a6d7 req-7fc1f473-5928-4ea1-b30b-1e214ae6e1f3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:28.668569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ec1116d9-f33e-4157-af3d-45747944a6d7 req-7fc1f473-5928-4ea1-b30b-1e214ae6e1f3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:28.694351 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ec1116d9-f33e-4157-af3d-45747944a6d7 req-7fc1f473-5928-4ea1-b30b-1e214ae6e1f3 service nova] Creating event network-changed:2caf0c43-e8a7-47e8-a90c-390f3b45d82b for instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 on nch2-master-1 Feb 19 21:05:28.706015 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ec1116d9-f33e-4157-af3d-45747944a6d7 req-7fc1f473-5928-4ea1-b30b-1e214ae6e1f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072945 Feb 19 21:05:28.707082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1818/3514] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:28.712351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:28.713049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:28.719894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:28.720588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:28.721711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:28.722331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:28.756999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:05:28.757516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:05:28.757902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:05:28.758320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:05:28.758803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:05:28.768206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:28.768713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:28.769707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:28.770162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:28.804786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Getting quotas for project 4d93cb84ab944db3aab11aab00da2f0d. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:05:28.812021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Getting quotas for user 282749d6d46245f4ad639dc22f789e1a and project 4d93cb84ab944db3aab11aab00da2f0d. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:05:28.829326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:05:28.832105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:05:28.896444 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aae7e93b-752a-4dfd-b1db-52da75406595 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.927709 Feb 19 21:05:28.898041 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1697/3515] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:05:28.904460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31c74f68-52d4-4bf8-a7d7-241eddd6c4f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:28.906174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-31c74f68-52d4-4bf8-a7d7-241eddd6c4f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:28.913264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c74f68-52d4-4bf8-a7d7-241eddd6c4f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:28.915421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c74f68-52d4-4bf8-a7d7-241eddd6c4f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:28.916749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c74f68-52d4-4bf8-a7d7-241eddd6c4f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:28.917465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31c74f68-52d4-4bf8-a7d7-241eddd6c4f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:28.949161 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-31c74f68-52d4-4bf8-a7d7-241eddd6c4f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. Feb 19 21:05:28.951772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31c74f68-52d4-4bf8-a7d7-241eddd6c4f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:28.953196 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-31c74f68-52d4-4bf8-a7d7-241eddd6c4f8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8/action" status: 404 len: 111 microversion: 2.1 time: 0.053926 Feb 19 21:05:28.953822 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1698/3516] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:28 2022] POST /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:28.961425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-515769ab-72d0-409c-922a-5d3bb2d418cf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:28.963005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-515769ab-72d0-409c-922a-5d3bb2d418cf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:28.971104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-515769ab-72d0-409c-922a-5d3bb2d418cf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:28.971855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-515769ab-72d0-409c-922a-5d3bb2d418cf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:28.973310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-515769ab-72d0-409c-922a-5d3bb2d418cf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:28.973984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-515769ab-72d0-409c-922a-5d3bb2d418cf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:29.913150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-515769ab-72d0-409c-922a-5d3bb2d418cf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:29.940393 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-515769ab-72d0-409c-922a-5d3bb2d418cf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1316 microversion: 2.1 time: 0.982339 Feb 19 21:05:29.948979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:29.957624 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1699/3517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:28 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1316 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:29.976808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-690c411b-9da0-4599-ada0-6ad5499d2b89 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:29.977444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:29.978034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-690c411b-9da0-4599-ada0-6ad5499d2b89 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:29.981133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:29.990840 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-859292b7-8487-4b38-ac78-29deeaf8f9ab tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 1.281067 Feb 19 21:05:29.991840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-690c411b-9da0-4599-ada0-6ad5499d2b89 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:29.992383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-690c411b-9da0-4599-ada0-6ad5499d2b89 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:29.994349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-690c411b-9da0-4599-ada0-6ad5499d2b89 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:29.995350 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1819/3518] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:28 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:30.000518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-690c411b-9da0-4599-ada0-6ad5499d2b89 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:30.009573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cca6785f-db33-4d98-aa70-2d558e186e51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:30.011072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cca6785f-db33-4d98-aa70-2d558e186e51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:30.048264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cca6785f-db33-4d98-aa70-2d558e186e51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:30.049053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cca6785f-db33-4d98-aa70-2d558e186e51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:30.054870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cca6785f-db33-4d98-aa70-2d558e186e51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:30.056193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cca6785f-db33-4d98-aa70-2d558e186e51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:30.130117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-690c411b-9da0-4599-ada0-6ad5499d2b89 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Unlocking {{(pid=136095) unlock /opt/stack/nova/nova/compute/api.py:4653}} Feb 19 21:05:30.250003 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-690c411b-9da0-4599-ada0-6ad5499d2b89 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.290779 Feb 19 21:05:30.251013 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1700/3519] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:29 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:30.267364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5f5d627d-8e39-44cb-aaed-602cabeca92a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:30.270152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5f5d627d-8e39-44cb-aaed-602cabeca92a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:30.280146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f5d627d-8e39-44cb-aaed-602cabeca92a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:30.280648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f5d627d-8e39-44cb-aaed-602cabeca92a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:30.281460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f5d627d-8e39-44cb-aaed-602cabeca92a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:30.282576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f5d627d-8e39-44cb-aaed-602cabeca92a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:30.326381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cca6785f-db33-4d98-aa70-2d558e186e51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:30.347273 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cca6785f-db33-4d98-aa70-2d558e186e51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1231 microversion: 2.1 time: 0.349247 Feb 19 21:05:30.348323 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1820/3520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:29 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1231 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:30.356553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-704ec5dd-39ca-4803-a354-6938d3c69aeb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:30.364916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-704ec5dd-39ca-4803-a354-6938d3c69aeb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:30.389618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-704ec5dd-39ca-4803-a354-6938d3c69aeb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:30.390938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-704ec5dd-39ca-4803-a354-6938d3c69aeb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:30.392090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-704ec5dd-39ca-4803-a354-6938d3c69aeb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:30.393055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-704ec5dd-39ca-4803-a354-6938d3c69aeb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:31.882766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5f5d627d-8e39-44cb-aaed-602cabeca92a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:31.898895 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5f5d627d-8e39-44cb-aaed-602cabeca92a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 1.644981 Feb 19 21:05:31.903788 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1701/3521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:30 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:31.914649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-53767843-e2d8-4277-b8a4-dca0dcf2aaac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:31.919567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-53767843-e2d8-4277-b8a4-dca0dcf2aaac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:31.937272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53767843-e2d8-4277-b8a4-dca0dcf2aaac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:31.938092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53767843-e2d8-4277-b8a4-dca0dcf2aaac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:31.941077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53767843-e2d8-4277-b8a4-dca0dcf2aaac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:31.945522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53767843-e2d8-4277-b8a4-dca0dcf2aaac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:32.139552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-704ec5dd-39ca-4803-a354-6938d3c69aeb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:32.176842 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-704ec5dd-39ca-4803-a354-6938d3c69aeb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 1.826709 Feb 19 21:05:32.183171 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1821/3522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:30 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:32.214686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:32.216847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:32.241858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:32.243659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:32.248585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:32.253420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:32.794633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53767843-e2d8-4277-b8a4-dca0dcf2aaac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:32.803730 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-53767843-e2d8-4277-b8a4-dca0dcf2aaac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1316 microversion: 2.1 time: 0.898364 Feb 19 21:05:32.806581 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1702/3523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:31 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:32.817796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1b9a6918-4924-4a3d-a4cd-8fd5300d5983 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:32.822201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1b9a6918-4924-4a3d-a4cd-8fd5300d5983 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:32.841660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b9a6918-4924-4a3d-a4cd-8fd5300d5983 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:32.844695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b9a6918-4924-4a3d-a4cd-8fd5300d5983 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:32.845821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b9a6918-4924-4a3d-a4cd-8fd5300d5983 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:32.847411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b9a6918-4924-4a3d-a4cd-8fd5300d5983 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:33.571660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1b9a6918-4924-4a3d-a4cd-8fd5300d5983 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:33.592426 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1b9a6918-4924-4a3d-a4cd-8fd5300d5983 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1285 microversion: 2.1 time: 0.781744 Feb 19 21:05:33.595938 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1703/3524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:32 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1285 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:33.599698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:33.612160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d3d510a8-b9f4-4e28-9137-ddae29b26667 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:33.612809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d3d510a8-b9f4-4e28-9137-ddae29b26667 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:33.614510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:33.616173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:33.622895 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-729094e2-ae55-4eff-80ef-d9ce29b10143 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 1.435643 Feb 19 21:05:33.624747 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1822/3525] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:32 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:33.634787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d510a8-b9f4-4e28-9137-ddae29b26667 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:33.635805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d510a8-b9f4-4e28-9137-ddae29b26667 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:33.636856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d510a8-b9f4-4e28-9137-ddae29b26667 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:33.637470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d510a8-b9f4-4e28-9137-ddae29b26667 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:33.639008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a813058f-297a-49d4-9cf7-29513735fe3d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:33.639761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a813058f-297a-49d4-9cf7-29513735fe3d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:33.670353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a813058f-297a-49d4-9cf7-29513735fe3d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:33.676902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a813058f-297a-49d4-9cf7-29513735fe3d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:33.681064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a813058f-297a-49d4-9cf7-29513735fe3d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:33.684522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a813058f-297a-49d4-9cf7-29513735fe3d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:34.185372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3d510a8-b9f4-4e28-9137-ddae29b26667 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:34.220189 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d3d510a8-b9f4-4e28-9137-ddae29b26667 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.618784 Feb 19 21:05:34.223400 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1704/3526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:33 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:34.265528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-535f3548-424e-4947-acbe-4de57daf9924 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:34.270001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-535f3548-424e-4947-acbe-4de57daf9924 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:34.286286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-535f3548-424e-4947-acbe-4de57daf9924 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:34.287766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-535f3548-424e-4947-acbe-4de57daf9924 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:34.288710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-535f3548-424e-4947-acbe-4de57daf9924 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:34.289154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-535f3548-424e-4947-acbe-4de57daf9924 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:34.315244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a813058f-297a-49d4-9cf7-29513735fe3d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:34.337351 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a813058f-297a-49d4-9cf7-29513735fe3d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.709486 Feb 19 21:05:34.339157 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1823/3527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:33 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:34.353388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-215c69de-6c6d-4963-8146-882e459b9ff1 req-9cbb71d8-787d-444f-8871-4bad6c7170ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed39c690-028c-40a9-9ed9-06b73776d4d6", "tag": "528c31a5-569d-4fef-a351-c1e8d8d8f70c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:34.358712 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:34.358712 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:05:34.380433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-215c69de-6c6d-4963-8146-882e459b9ff1 req-9cbb71d8-787d-444f-8871-4bad6c7170ff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:34.381191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-215c69de-6c6d-4963-8146-882e459b9ff1 req-9cbb71d8-787d-444f-8871-4bad6c7170ff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:34.408927 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-215c69de-6c6d-4963-8146-882e459b9ff1 req-9cbb71d8-787d-444f-8871-4bad6c7170ff service nova] Creating event network-changed:528c31a5-569d-4fef-a351-c1e8d8d8f70c for instance ed39c690-028c-40a9-9ed9-06b73776d4d6 on nch1-master-1 Feb 19 21:05:34.421954 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-215c69de-6c6d-4963-8146-882e459b9ff1 req-9cbb71d8-787d-444f-8871-4bad6c7170ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079526 Feb 19 21:05:34.426595 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1824/3528] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:34.443729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-647a2b84-9423-4eae-b75a-bd40ba966df3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:34.444780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-647a2b84-9423-4eae-b75a-bd40ba966df3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 01ac301b-54c0-4309-9bd2-39339987c725] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:34.458098 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-647a2b84-9423-4eae-b75a-bd40ba966df3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 01ac301b-54c0-4309-9bd2-39339987c725 could not be found. Feb 19 21:05:34.458958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-647a2b84-9423-4eae-b75a-bd40ba966df3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 01ac301b-54c0-4309-9bd2-39339987c725 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:34.459794 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-647a2b84-9423-4eae-b75a-bd40ba966df3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/01ac301b-54c0-4309-9bd2-39339987c725/action" status: 404 len: 111 microversion: 2.1 time: 0.031921 Feb 19 21:05:34.467619 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1825/3529] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:34 2022] POST /compute/v2.1/servers/01ac301b-54c0-4309-9bd2-39339987c725/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:34.479294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c97c080-35ff-46f5-b2be-e4acd777d7cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:34.481447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3c97c080-35ff-46f5-b2be-e4acd777d7cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:34.500588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c97c080-35ff-46f5-b2be-e4acd777d7cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:34.503145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c97c080-35ff-46f5-b2be-e4acd777d7cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:34.508638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c97c080-35ff-46f5-b2be-e4acd777d7cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:34.509922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c97c080-35ff-46f5-b2be-e4acd777d7cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:35.136341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-535f3548-424e-4947-acbe-4de57daf9924 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:35.154109 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-535f3548-424e-4947-acbe-4de57daf9924 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1316 microversion: 2.1 time: 0.912938 Feb 19 21:05:35.154719 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1705/3530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:34 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1316 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:35.159436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cd15133d-9203-48fc-8bcf-ec1bff114c6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:35.160053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cd15133d-9203-48fc-8bcf-ec1bff114c6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:35.183160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd15133d-9203-48fc-8bcf-ec1bff114c6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:35.184005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd15133d-9203-48fc-8bcf-ec1bff114c6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:35.185325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd15133d-9203-48fc-8bcf-ec1bff114c6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:35.185968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd15133d-9203-48fc-8bcf-ec1bff114c6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:35.244890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3c97c080-35ff-46f5-b2be-e4acd777d7cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:35.266642 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3c97c080-35ff-46f5-b2be-e4acd777d7cd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.793717 Feb 19 21:05:35.268061 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1826/3531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:34 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:35.286493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f5a550c-8797-4662-84b0-2880630dd88a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:35.287311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f5a550c-8797-4662-84b0-2880630dd88a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:35.305242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f5a550c-8797-4662-84b0-2880630dd88a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:35.307582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f5a550c-8797-4662-84b0-2880630dd88a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:35.309346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f5a550c-8797-4662-84b0-2880630dd88a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:35.311212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f5a550c-8797-4662-84b0-2880630dd88a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:35.787851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1f5a550c-8797-4662-84b0-2880630dd88a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:35.803416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cd15133d-9203-48fc-8bcf-ec1bff114c6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:35.815169 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f5a550c-8797-4662-84b0-2880630dd88a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.541850 Feb 19 21:05:35.828563 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cd15133d-9203-48fc-8bcf-ec1bff114c6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.672652 Feb 19 21:05:35.829169 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1706/3532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:35 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:35.832263 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1827/3533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:35 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:35.847191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:35.852318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1d9950e7-ed2e-410a-98e7-95f8c6e72f0b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:35.854169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:35.857119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1d9950e7-ed2e-410a-98e7-95f8c6e72f0b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:35.866950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:35.869359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d9950e7-ed2e-410a-98e7-95f8c6e72f0b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:35.870218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:35.871294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:35.871950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:35.872831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d9950e7-ed2e-410a-98e7-95f8c6e72f0b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:35.877492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d9950e7-ed2e-410a-98e7-95f8c6e72f0b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:35.878305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d9950e7-ed2e-410a-98e7-95f8c6e72f0b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:36.048893 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1d9950e7-ed2e-410a-98e7-95f8c6e72f0b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.205334 Feb 19 21:05:36.060411 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1707/3534] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:35 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:36.077653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7e931e9f-7693-4b90-b436-40dc49ff90c8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:36.079275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7e931e9f-7693-4b90-b436-40dc49ff90c8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:36.096737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e931e9f-7693-4b90-b436-40dc49ff90c8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:36.097215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e931e9f-7693-4b90-b436-40dc49ff90c8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:36.098095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e931e9f-7693-4b90-b436-40dc49ff90c8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:36.098554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e931e9f-7693-4b90-b436-40dc49ff90c8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:36.949307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:36.964130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:36.966543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:36.969234 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-08b7c3cd-e07f-49d6-add0-6cfb7a9e9ca7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 1.127159 Feb 19 21:05:36.980834 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1828/3535] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:35 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:36.985695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1160856c-96db-4763-b26d-e7eb1f1c5ba6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:36.986868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1160856c-96db-4763-b26d-e7eb1f1c5ba6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:36.996491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1160856c-96db-4763-b26d-e7eb1f1c5ba6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:36.997749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1160856c-96db-4763-b26d-e7eb1f1c5ba6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:36.999047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1160856c-96db-4763-b26d-e7eb1f1c5ba6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:36.999962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1160856c-96db-4763-b26d-e7eb1f1c5ba6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:37.239741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7e931e9f-7693-4b90-b436-40dc49ff90c8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:37.255037 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7e931e9f-7693-4b90-b436-40dc49ff90c8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 1.196394 Feb 19 21:05:37.275843 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1708/3536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:36 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:37.281094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71a366b1-646e-4adf-b1f0-0bdd9300e7bd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:37.281990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-71a366b1-646e-4adf-b1f0-0bdd9300e7bd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:37.300665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71a366b1-646e-4adf-b1f0-0bdd9300e7bd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:37.303771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71a366b1-646e-4adf-b1f0-0bdd9300e7bd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:37.308223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71a366b1-646e-4adf-b1f0-0bdd9300e7bd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:37.309697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71a366b1-646e-4adf-b1f0-0bdd9300e7bd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:37.806773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1160856c-96db-4763-b26d-e7eb1f1c5ba6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:37.826862 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1160856c-96db-4763-b26d-e7eb1f1c5ba6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1654 microversion: 2.1 time: 0.844143 Feb 19 21:05:37.827882 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1829/3537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:36 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1654 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:37.844317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3a1cac4d-aee2-4b08-9b9b-11333d9289e1 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:37.845387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3a1cac4d-aee2-4b08-9b9b-11333d9289e1 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:37.853915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a1cac4d-aee2-4b08-9b9b-11333d9289e1 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:37.854794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a1cac4d-aee2-4b08-9b9b-11333d9289e1 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:37.855866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a1cac4d-aee2-4b08-9b9b-11333d9289e1 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:37.856571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a1cac4d-aee2-4b08-9b9b-11333d9289e1 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.234999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-71a366b1-646e-4adf-b1f0-0bdd9300e7bd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:38.246827 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71a366b1-646e-4adf-b1f0-0bdd9300e7bd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1316 microversion: 2.1 time: 0.969188 Feb 19 21:05:38.261990 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1709/3538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:37 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1316 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:38.267184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0881d2cc-bc18-4234-99f4-ca0eb2ff511c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f75529b9-2911-475e-b974-4af06053c17c"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:38.270008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0881d2cc-bc18-4234-99f4-ca0eb2ff511c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:38.279588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0881d2cc-bc18-4234-99f4-ca0eb2ff511c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.280590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0881d2cc-bc18-4234-99f4-ca0eb2ff511c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.282268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0881d2cc-bc18-4234-99f4-ca0eb2ff511c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.283066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0881d2cc-bc18-4234-99f4-ca0eb2ff511c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.302984 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-0881d2cc-bc18-4234-99f4-ca0eb2ff511c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. Feb 19 21:05:38.303986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0881d2cc-bc18-4234-99f4-ca0eb2ff511c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:38.305280 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0881d2cc-bc18-4234-99f4-ca0eb2ff511c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8/action" status: 404 len: 111 microversion: 2.1 time: 0.041754 Feb 19 21:05:38.306345 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1710/3539] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:38 2022] POST /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:38.308841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3a1cac4d-aee2-4b08-9b9b-11333d9289e1 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:38.313221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0d7701bd-7d15-449d-b4af-e16a3ad3d0d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:38.314360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0d7701bd-7d15-449d-b4af-e16a3ad3d0d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:38.323567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d7701bd-7d15-449d-b4af-e16a3ad3d0d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.324508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d7701bd-7d15-449d-b4af-e16a3ad3d0d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.325666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d7701bd-7d15-449d-b4af-e16a3ad3d0d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.325791 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3a1cac4d-aee2-4b08-9b9b-11333d9289e1 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.495580 Feb 19 21:05:38.326713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d7701bd-7d15-449d-b4af-e16a3ad3d0d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.328306 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1830/3540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:37 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:38.335991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:38.337245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:38.355014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.355472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.360166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.360649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.433959 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0d7701bd-7d15-449d-b4af-e16a3ad3d0d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.125032 Feb 19 21:05:38.437119 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1711/3541] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:38 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:38.454854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-205ee38b-2776-4434-bf5e-13b078d53b2b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:38.457583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-205ee38b-2776-4434-bf5e-13b078d53b2b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:38.482792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-205ee38b-2776-4434-bf5e-13b078d53b2b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.485065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-205ee38b-2776-4434-bf5e-13b078d53b2b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.490846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-205ee38b-2776-4434-bf5e-13b078d53b2b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.491863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-205ee38b-2776-4434-bf5e-13b078d53b2b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.709088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:38.729991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:38.738439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:38.740744 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9fc0e001-8a05-4f4e-80fc-ae3b53f0fe77 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.411082 Feb 19 21:05:38.743736 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1831/3542] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:38 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:38.775015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b03efe8f-4604-4293-9c3c-ef03cb765aee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:38.781627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b03efe8f-4604-4293-9c3c-ef03cb765aee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:38.817118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b03efe8f-4604-4293-9c3c-ef03cb765aee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.819582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b03efe8f-4604-4293-9c3c-ef03cb765aee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:38.824586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b03efe8f-4604-4293-9c3c-ef03cb765aee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:38.829916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b03efe8f-4604-4293-9c3c-ef03cb765aee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:39.038488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-205ee38b-2776-4434-bf5e-13b078d53b2b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:39.055278 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-205ee38b-2776-4434-bf5e-13b078d53b2b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.612302 Feb 19 21:05:39.073752 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1712/3543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:38 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:39.081053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8fcffca2-c471-4ff4-991b-f6145336d991 req-8df03dca-72d5-4583-818b-cc6b0480f713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa7e1f5-314f-430a-92f8-b0f1b2e15f1c", "tag": "df7355b0-0bc1-43f9-9dc4-8218b7e68a43"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:39.089957 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:39.089957 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:05:39.115155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8fcffca2-c471-4ff4-991b-f6145336d991 req-8df03dca-72d5-4583-818b-cc6b0480f713 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:39.115819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8fcffca2-c471-4ff4-991b-f6145336d991 req-8df03dca-72d5-4583-818b-cc6b0480f713 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:39.162848 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8fcffca2-c471-4ff4-991b-f6145336d991 req-8df03dca-72d5-4583-818b-cc6b0480f713 service nova] Creating event network-changed:df7355b0-0bc1-43f9-9dc4-8218b7e68a43 for instance efa7e1f5-314f-430a-92f8-b0f1b2e15f1c on nch2-master-1 Feb 19 21:05:39.169907 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8fcffca2-c471-4ff4-991b-f6145336d991 req-8df03dca-72d5-4583-818b-cc6b0480f713 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094578 Feb 19 21:05:39.170990 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1713/3544] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:39.181035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4781d902-967a-476b-af3a-a1704b4a0903 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:39.181035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4781d902-967a-476b-af3a-a1704b4a0903 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:39.189574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4781d902-967a-476b-af3a-a1704b4a0903 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:39.190154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4781d902-967a-476b-af3a-a1704b4a0903 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:39.191074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4781d902-967a-476b-af3a-a1704b4a0903 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:39.191614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4781d902-967a-476b-af3a-a1704b4a0903 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:39.282953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b03efe8f-4604-4293-9c3c-ef03cb765aee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:39.294255 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b03efe8f-4604-4293-9c3c-ef03cb765aee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1661 microversion: 2.1 time: 0.526301 Feb 19 21:05:39.295103 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1832/3545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:38 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1661 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:39.301025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0ee07814-4af3-4e29-a617-2d919f6bd2ff tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:39.308692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0ee07814-4af3-4e29-a617-2d919f6bd2ff tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:39.324489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ee07814-4af3-4e29-a617-2d919f6bd2ff tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:39.325698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ee07814-4af3-4e29-a617-2d919f6bd2ff tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:39.326704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ee07814-4af3-4e29-a617-2d919f6bd2ff tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:39.328235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ee07814-4af3-4e29-a617-2d919f6bd2ff tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:39.863841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4781d902-967a-476b-af3a-a1704b4a0903 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:39.876988 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4781d902-967a-476b-af3a-a1704b4a0903 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.704064 Feb 19 21:05:39.888814 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1714/3546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:39 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:39.894658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a0c9b71e-4904-4e44-85f6-49624cdf9499 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:39.895514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a0c9b71e-4904-4e44-85f6-49624cdf9499 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:39.912375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0c9b71e-4904-4e44-85f6-49624cdf9499 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:39.912822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0c9b71e-4904-4e44-85f6-49624cdf9499 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:39.913649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0c9b71e-4904-4e44-85f6-49624cdf9499 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:39.914102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0c9b71e-4904-4e44-85f6-49624cdf9499 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:39.920726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0ee07814-4af3-4e29-a617-2d919f6bd2ff tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:39.938128 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0ee07814-4af3-4e29-a617-2d919f6bd2ff tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1316 microversion: 2.1 time: 0.638365 Feb 19 21:05:39.939020 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1833/3547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:39 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:39.949475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:39.950582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:39.959832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:39.969571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:39.970901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:39.971512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:40.223335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a0c9b71e-4904-4e44-85f6-49624cdf9499 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:40.234924 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a0c9b71e-4904-4e44-85f6-49624cdf9499 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.344790 Feb 19 21:05:40.236242 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1715/3548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:39 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:40.261695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-666fc306-9a3c-4f40-ad67-f5200c6c6bbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f75529b9-2911-475e-b974-4af06053c17c"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:40.263455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-666fc306-9a3c-4f40-ad67-f5200c6c6bbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 359a7682-a40d-4655-bd98-7180743146c5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:40.269804 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-666fc306-9a3c-4f40-ad67-f5200c6c6bbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 359a7682-a40d-4655-bd98-7180743146c5 could not be found. Feb 19 21:05:40.271596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-666fc306-9a3c-4f40-ad67-f5200c6c6bbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 359a7682-a40d-4655-bd98-7180743146c5 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:40.272742 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-666fc306-9a3c-4f40-ad67-f5200c6c6bbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/359a7682-a40d-4655-bd98-7180743146c5/action" status: 404 len: 111 microversion: 2.1 time: 0.035248 Feb 19 21:05:40.274654 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1716/3549] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:40 2022] POST /compute/v2.1/servers/359a7682-a40d-4655-bd98-7180743146c5/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:40.284458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-09fbd2e1-157e-4a10-9cd5-af749898923a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:40.285878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-09fbd2e1-157e-4a10-9cd5-af749898923a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:40.295737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09fbd2e1-157e-4a10-9cd5-af749898923a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:40.296684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09fbd2e1-157e-4a10-9cd5-af749898923a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:40.297952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09fbd2e1-157e-4a10-9cd5-af749898923a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:40.298800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09fbd2e1-157e-4a10-9cd5-af749898923a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:40.301677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:40.320081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:40.321674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:40.336604 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1ef52d2c-9856-4d5e-a404-2a95272c69cc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.394939 Feb 19 21:05:40.337671 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1834/3550] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:39 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:40.372795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-db770bcc-78be-46f9-8a76-297937a40912 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:40.373555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-db770bcc-78be-46f9-8a76-297937a40912 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:40.405128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db770bcc-78be-46f9-8a76-297937a40912 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:40.405521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db770bcc-78be-46f9-8a76-297937a40912 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:40.406359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db770bcc-78be-46f9-8a76-297937a40912 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:40.406813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db770bcc-78be-46f9-8a76-297937a40912 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:40.592400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-09fbd2e1-157e-4a10-9cd5-af749898923a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:40.601459 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-09fbd2e1-157e-4a10-9cd5-af749898923a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.322031 Feb 19 21:05:40.609042 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1717/3551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:40 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:40.638244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-314240b8-dd9f-4d2c-9d38-5cdd9d2f7c82 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:40.639243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-314240b8-dd9f-4d2c-9d38-5cdd9d2f7c82 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:40.648009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-314240b8-dd9f-4d2c-9d38-5cdd9d2f7c82 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:40.649528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-314240b8-dd9f-4d2c-9d38-5cdd9d2f7c82 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:40.650620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-314240b8-dd9f-4d2c-9d38-5cdd9d2f7c82 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:40.651453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-314240b8-dd9f-4d2c-9d38-5cdd9d2f7c82 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:40.882193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-db770bcc-78be-46f9-8a76-297937a40912 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:40.915670 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-db770bcc-78be-46f9-8a76-297937a40912 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.574290 Feb 19 21:05:40.918299 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1835/3552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:40 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:40.925140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b21892d7-eb96-4416-8768-f976f975ba8d req-1221f841-d313-40bd-9d16-3afd2d34014e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed39c690-028c-40a9-9ed9-06b73776d4d6", "name": "network-vif-plugged", "status": "completed", "tag": "528c31a5-569d-4fef-a351-c1e8d8d8f70c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:40.936807 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:40.936807 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:05:40.959372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b21892d7-eb96-4416-8768-f976f975ba8d req-1221f841-d313-40bd-9d16-3afd2d34014e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:40.962514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b21892d7-eb96-4416-8768-f976f975ba8d req-1221f841-d313-40bd-9d16-3afd2d34014e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:40.990072 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b21892d7-eb96-4416-8768-f976f975ba8d req-1221f841-d313-40bd-9d16-3afd2d34014e service nova] Creating event network-vif-plugged:528c31a5-569d-4fef-a351-c1e8d8d8f70c for instance ed39c690-028c-40a9-9ed9-06b73776d4d6 on nch1-master-1 Feb 19 21:05:41.001866 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b21892d7-eb96-4416-8768-f976f975ba8d req-1221f841-d313-40bd-9d16-3afd2d34014e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080400 Feb 19 21:05:41.003064 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1836/3553] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:41.011681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c4cd761c-e169-4a1c-a3e6-ed305e011e37 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:41.012431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c4cd761c-e169-4a1c-a3e6-ed305e011e37 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:41.020454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4cd761c-e169-4a1c-a3e6-ed305e011e37 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.021199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4cd761c-e169-4a1c-a3e6-ed305e011e37 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.022197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4cd761c-e169-4a1c-a3e6-ed305e011e37 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.022808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c4cd761c-e169-4a1c-a3e6-ed305e011e37 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.060657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-314240b8-dd9f-4d2c-9d38-5cdd9d2f7c82 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:41.070687 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-314240b8-dd9f-4d2c-9d38-5cdd9d2f7c82 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.437625 Feb 19 21:05:41.072460 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1718/3554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:40 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:41.084861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bfebffa5-ff86-42f3-b6e8-81ac8fbb9e25 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:41.085939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bfebffa5-ff86-42f3-b6e8-81ac8fbb9e25 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:41.094347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bfebffa5-ff86-42f3-b6e8-81ac8fbb9e25 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.095095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bfebffa5-ff86-42f3-b6e8-81ac8fbb9e25 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.096729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bfebffa5-ff86-42f3-b6e8-81ac8fbb9e25 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.097896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bfebffa5-ff86-42f3-b6e8-81ac8fbb9e25 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.459807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c4cd761c-e169-4a1c-a3e6-ed305e011e37 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:41.467953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bfebffa5-ff86-42f3-b6e8-81ac8fbb9e25 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:41.474168 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c4cd761c-e169-4a1c-a3e6-ed305e011e37 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.469192 Feb 19 21:05:41.475164 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1837/3555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:41 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:41.483537 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bfebffa5-ff86-42f3-b6e8-81ac8fbb9e25 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1316 microversion: 2.1 time: 0.402019 Feb 19 21:05:41.484457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d34ae49e-449b-4626-936b-2dd94e3e1194 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:41.485057 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1719/3556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:41 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:41.499750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d34ae49e-449b-4626-936b-2dd94e3e1194 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 13c0aaae-a8ed-4255-868e-495e581c6dcf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:41.503473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ee29fadc-9f35-4e08-8e9a-00d0913c4a8a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:41.504755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ee29fadc-9f35-4e08-8e9a-00d0913c4a8a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:41.512730 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-d34ae49e-449b-4626-936b-2dd94e3e1194 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 13c0aaae-a8ed-4255-868e-495e581c6dcf could not be found. Feb 19 21:05:41.513734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d34ae49e-449b-4626-936b-2dd94e3e1194 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 13c0aaae-a8ed-4255-868e-495e581c6dcf could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:41.515232 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d34ae49e-449b-4626-936b-2dd94e3e1194 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/13c0aaae-a8ed-4255-868e-495e581c6dcf/action" status: 404 len: 111 microversion: 2.1 time: 0.037953 Feb 19 21:05:41.517607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee29fadc-9f35-4e08-8e9a-00d0913c4a8a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.518505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee29fadc-9f35-4e08-8e9a-00d0913c4a8a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.520168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee29fadc-9f35-4e08-8e9a-00d0913c4a8a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.521276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee29fadc-9f35-4e08-8e9a-00d0913c4a8a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.521957 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1838/3557] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:41 2022] POST /compute/v2.1/servers/13c0aaae-a8ed-4255-868e-495e581c6dcf/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:41.530680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:41.531798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:41.544543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.545352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.547056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.548088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.769508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ee29fadc-9f35-4e08-8e9a-00d0913c4a8a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:41.777334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:41.779296 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ee29fadc-9f35-4e08-8e9a-00d0913c4a8a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.292435 Feb 19 21:05:41.779895 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1720/3558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:41 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:41.784651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6dcb2006-a34e-4e3c-837d-1f4e92bd3642 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:41.785082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6dcb2006-a34e-4e3c-837d-1f4e92bd3642 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:41.791812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6dcb2006-a34e-4e3c-837d-1f4e92bd3642 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.792269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6dcb2006-a34e-4e3c-837d-1f4e92bd3642 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.793112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6dcb2006-a34e-4e3c-837d-1f4e92bd3642 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.793553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6dcb2006-a34e-4e3c-837d-1f4e92bd3642 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.795017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:41.796965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:41.798209 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5e2ee5da-f9eb-4b03-8e42-a9c29648b74a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.274567 Feb 19 21:05:41.798780 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1839/3559] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:41 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:41.803542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a707287-891e-4088-85eb-ec439db5f939 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:41.804155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a707287-891e-4088-85eb-ec439db5f939 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:41.813492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a707287-891e-4088-85eb-ec439db5f939 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.814238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a707287-891e-4088-85eb-ec439db5f939 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:41.815051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a707287-891e-4088-85eb-ec439db5f939 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:41.815507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a707287-891e-4088-85eb-ec439db5f939 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.031406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6dcb2006-a34e-4e3c-837d-1f4e92bd3642 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:42.039399 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6dcb2006-a34e-4e3c-837d-1f4e92bd3642 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.258445 Feb 19 21:05:42.040123 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1721/3560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:41 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:42.056251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7e1c0fe7-33c5-45ca-9baf-8ca12b90e02b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:42.056903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7e1c0fe7-33c5-45ca-9baf-8ca12b90e02b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:42.062912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a707287-891e-4088-85eb-ec439db5f939 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:42.063159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e1c0fe7-33c5-45ca-9baf-8ca12b90e02b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.063894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e1c0fe7-33c5-45ca-9baf-8ca12b90e02b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.064535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e1c0fe7-33c5-45ca-9baf-8ca12b90e02b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.065017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e1c0fe7-33c5-45ca-9baf-8ca12b90e02b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.071899 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a707287-891e-4088-85eb-ec439db5f939 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.271203 Feb 19 21:05:42.073063 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1840/3561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:41 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:42.091585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0b15a583-59cf-41e7-9874-cdf0786d1289 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:42.092588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0b15a583-59cf-41e7-9874-cdf0786d1289 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:42.099231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b15a583-59cf-41e7-9874-cdf0786d1289 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.099763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b15a583-59cf-41e7-9874-cdf0786d1289 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.100626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b15a583-59cf-41e7-9874-cdf0786d1289 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.101308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b15a583-59cf-41e7-9874-cdf0786d1289 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.279007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7e1c0fe7-33c5-45ca-9baf-8ca12b90e02b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:42.289688 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7e1c0fe7-33c5-45ca-9baf-8ca12b90e02b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.237122 Feb 19 21:05:42.297780 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1722/3562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:42 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:42.310378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a59f5031-70e8-48c6-87ab-81376b9faab2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:42.311934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a59f5031-70e8-48c6-87ab-81376b9faab2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:42.315359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0b15a583-59cf-41e7-9874-cdf0786d1289 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:42.319804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a59f5031-70e8-48c6-87ab-81376b9faab2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.320678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a59f5031-70e8-48c6-87ab-81376b9faab2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.322346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a59f5031-70e8-48c6-87ab-81376b9faab2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.323141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a59f5031-70e8-48c6-87ab-81376b9faab2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.329505 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0b15a583-59cf-41e7-9874-cdf0786d1289 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.242641 Feb 19 21:05:42.331092 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1841/3563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:42 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:42.348186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b41598a5-51c2-488d-8f1c-3f991da73d40 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:42.348998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b41598a5-51c2-488d-8f1c-3f991da73d40 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:42.356646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b41598a5-51c2-488d-8f1c-3f991da73d40 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.357406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b41598a5-51c2-488d-8f1c-3f991da73d40 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.358427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b41598a5-51c2-488d-8f1c-3f991da73d40 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.359039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b41598a5-51c2-488d-8f1c-3f991da73d40 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.388730 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-b41598a5-51c2-488d-8f1c-3f991da73d40 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Cannot 'restore' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state active Feb 19 21:05:42.389611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b41598a5-51c2-488d-8f1c-3f991da73d40 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 409 to user: Cannot 'restore' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state active {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:42.390611 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b41598a5-51c2-488d-8f1c-3f991da73d40 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 409 len: 145 microversion: 2.1 time: 0.046566 Feb 19 21:05:42.395510 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1842/3564] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:42 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 145 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:05:42.401496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2ff0651b-f86a-4819-a9d8-8cc668a67afc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:42.402152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2ff0651b-f86a-4819-a9d8-8cc668a67afc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:42.409257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ff0651b-f86a-4819-a9d8-8cc668a67afc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.409705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ff0651b-f86a-4819-a9d8-8cc668a67afc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.410852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ff0651b-f86a-4819-a9d8-8cc668a67afc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.411452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ff0651b-f86a-4819-a9d8-8cc668a67afc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.577035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a59f5031-70e8-48c6-87ab-81376b9faab2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:42.588383 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a59f5031-70e8-48c6-87ab-81376b9faab2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.284686 Feb 19 21:05:42.590046 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1723/3565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:42 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:42.601536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4b496f02-eda3-447a-9e12-93ba6b77e298 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:42.605161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4b496f02-eda3-447a-9e12-93ba6b77e298 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:42.617746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b496f02-eda3-447a-9e12-93ba6b77e298 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.619274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b496f02-eda3-447a-9e12-93ba6b77e298 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.620386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b496f02-eda3-447a-9e12-93ba6b77e298 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.621495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b496f02-eda3-447a-9e12-93ba6b77e298 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.692567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2ff0651b-f86a-4819-a9d8-8cc668a67afc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:42.703722 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2ff0651b-f86a-4819-a9d8-8cc668a67afc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.306434 Feb 19 21:05:42.706038 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1843/3566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:42 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:42.718185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a503bc28-bf16-480f-b348-076c08b2a3b0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:42.719985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a503bc28-bf16-480f-b348-076c08b2a3b0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:42.731597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a503bc28-bf16-480f-b348-076c08b2a3b0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.733038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a503bc28-bf16-480f-b348-076c08b2a3b0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.734713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a503bc28-bf16-480f-b348-076c08b2a3b0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.735753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a503bc28-bf16-480f-b348-076c08b2a3b0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.877885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4b496f02-eda3-447a-9e12-93ba6b77e298 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:42.898045 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4b496f02-eda3-447a-9e12-93ba6b77e298 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1504 microversion: 2.1 time: 0.305713 Feb 19 21:05:42.912628 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1724/3567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:42 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:42.912628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61f3ea47-9af6-47ef-818f-a3568de5e822 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:42.912628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-61f3ea47-9af6-47ef-818f-a3568de5e822 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:42.919400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61f3ea47-9af6-47ef-818f-a3568de5e822 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.920086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61f3ea47-9af6-47ef-818f-a3568de5e822 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.921149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61f3ea47-9af6-47ef-818f-a3568de5e822 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:42.921447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61f3ea47-9af6-47ef-818f-a3568de5e822 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:42.971884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a503bc28-bf16-480f-b348-076c08b2a3b0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:42.990806 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a503bc28-bf16-480f-b348-076c08b2a3b0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.280296 Feb 19 21:05:42.991788 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1844/3568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:42 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:42.996383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-141da555-f36e-437f-b98c-8bd7ac4ee548 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:42.997100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-141da555-f36e-437f-b98c-8bd7ac4ee548 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:43.010752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-141da555-f36e-437f-b98c-8bd7ac4ee548 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.012624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-141da555-f36e-437f-b98c-8bd7ac4ee548 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:43.013775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-141da555-f36e-437f-b98c-8bd7ac4ee548 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.014235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-141da555-f36e-437f-b98c-8bd7ac4ee548 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:43.126948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-61f3ea47-9af6-47ef-818f-a3568de5e822 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:43.137619 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-61f3ea47-9af6-47ef-818f-a3568de5e822 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.235174 Feb 19 21:05:43.137619 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1725/3569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:42 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:43.143342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:43.144116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:43.151069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.151704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:43.152559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.153068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:43.220676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-141da555-f36e-437f-b98c-8bd7ac4ee548 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:43.236501 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-141da555-f36e-437f-b98c-8bd7ac4ee548 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.243350 Feb 19 21:05:43.238088 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1845/3570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:42 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:43.246510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f1de9023-ee3e-4275-b7d2-df3bb6abfba9 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-242977100"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:43.247680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f1de9023-ee3e-4275-b7d2-df3bb6abfba9 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:43.259104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1de9023-ee3e-4275-b7d2-df3bb6abfba9 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.260202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1de9023-ee3e-4275-b7d2-df3bb6abfba9 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:43.262318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1de9023-ee3e-4275-b7d2-df3bb6abfba9 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.263130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1de9023-ee3e-4275-b7d2-df3bb6abfba9 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:43.405813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:43.418376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:43.420706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:43.422243 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a8a87a73-57d7-43d8-82bc-04c19acfe88f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.283473 Feb 19 21:05:43.422920 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1726/3571] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:43 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:43.431332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5fe47214-7fe2-4704-abe0-b1c8afbe379c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:43.432364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5fe47214-7fe2-4704-abe0-b1c8afbe379c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 7aa56880-70f7-41e5-bde7-59c2d7f9a12a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:43.439850 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-5fe47214-7fe2-4704-abe0-b1c8afbe379c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 7aa56880-70f7-41e5-bde7-59c2d7f9a12a could not be found. Feb 19 21:05:43.440601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5fe47214-7fe2-4704-abe0-b1c8afbe379c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 7aa56880-70f7-41e5-bde7-59c2d7f9a12a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:43.441593 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5fe47214-7fe2-4704-abe0-b1c8afbe379c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/7aa56880-70f7-41e5-bde7-59c2d7f9a12a/action" status: 404 len: 111 microversion: 2.1 time: 0.017455 Feb 19 21:05:43.442273 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1727/3572] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:43 2022] POST /compute/v2.1/servers/7aa56880-70f7-41e5-bde7-59c2d7f9a12a/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:43.451574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-56b7775f-3204-46c6-880c-85a3186f2009 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:43.452380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-56b7775f-3204-46c6-880c-85a3186f2009 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:43.464465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56b7775f-3204-46c6-880c-85a3186f2009 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.465043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56b7775f-3204-46c6-880c-85a3186f2009 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:43.466680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56b7775f-3204-46c6-880c-85a3186f2009 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.467143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56b7775f-3204-46c6-880c-85a3186f2009 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:43.490066 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.network.security_group_api [None req-f1de9023-ee3e-4275-b7d2-df3bb6abfba9 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Adding security group f6bcb2ac-4094-4b86-9dd7-d20d9280f265 to port 528c31a5-569d-4fef-a351-c1e8d8d8f70c Feb 19 21:05:43.760540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-56b7775f-3204-46c6-880c-85a3186f2009 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:43.769905 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-56b7775f-3204-46c6-880c-85a3186f2009 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.321692 Feb 19 21:05:43.771366 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1728/3573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:43 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:43.794960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5fe5cb62-a416-473d-a1df-fdc6f4fce413 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:43.795861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5fe5cb62-a416-473d-a1df-fdc6f4fce413 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:43.803082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb62-a416-473d-a1df-fdc6f4fce413 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.803542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb62-a416-473d-a1df-fdc6f4fce413 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:43.804360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb62-a416-473d-a1df-fdc6f4fce413 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:43.804886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5fe5cb62-a416-473d-a1df-fdc6f4fce413 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:44.073920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5fe5cb62-a416-473d-a1df-fdc6f4fce413 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:44.084626 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5fe5cb62-a416-473d-a1df-fdc6f4fce413 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.293033 Feb 19 21:05:44.085893 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1729/3574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:43 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:44.103317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4ba91794-1d54-44d6-a8f0-4bdc04f00b72 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:44.103867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4ba91794-1d54-44d6-a8f0-4bdc04f00b72 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:44.105309 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f1de9023-ee3e-4275-b7d2-df3bb6abfba9 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6/action" status: 202 len: 0 microversion: 2.1 time: 0.866022 Feb 19 21:05:44.108740 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1846/3575] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:43 2022] POST /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6/action => generated 0 bytes in 870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:44.114345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ba91794-1d54-44d6-a8f0-4bdc04f00b72 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:44.114345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ba91794-1d54-44d6-a8f0-4bdc04f00b72 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:44.115142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ba91794-1d54-44d6-a8f0-4bdc04f00b72 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:44.115451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ba91794-1d54-44d6-a8f0-4bdc04f00b72 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:44.121558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2fa8ebdb-1977-4312-8249-955e05dae6dd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-328080119"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:44.122132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2fa8ebdb-1977-4312-8249-955e05dae6dd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:44.139023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fa8ebdb-1977-4312-8249-955e05dae6dd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:44.140900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fa8ebdb-1977-4312-8249-955e05dae6dd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:44.142553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fa8ebdb-1977-4312-8249-955e05dae6dd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:44.146513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fa8ebdb-1977-4312-8249-955e05dae6dd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:44.148641 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-4ba91794-1d54-44d6-a8f0-4bdc04f00b72 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Cannot 'resume' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state active Feb 19 21:05:44.154159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4ba91794-1d54-44d6-a8f0-4bdc04f00b72 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 409 to user: Cannot 'resume' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state active {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:44.154159 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4ba91794-1d54-44d6-a8f0-4bdc04f00b72 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 409 len: 144 microversion: 2.1 time: 0.054683 Feb 19 21:05:44.160310 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1730/3576] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:44 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 144 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:05:44.237570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-3d61c35c-e04c-41a4-8207-101b544042f7 req-4559c248-4617-45cf-b2b8-96758bb72255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed39c690-028c-40a9-9ed9-06b73776d4d6", "tag": "528c31a5-569d-4fef-a351-c1e8d8d8f70c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:44.239593 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:44.239593 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:05:44.251850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3d61c35c-e04c-41a4-8207-101b544042f7 req-4559c248-4617-45cf-b2b8-96758bb72255 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:44.252305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3d61c35c-e04c-41a4-8207-101b544042f7 req-4559c248-4617-45cf-b2b8-96758bb72255 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:44.267766 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3d61c35c-e04c-41a4-8207-101b544042f7 req-4559c248-4617-45cf-b2b8-96758bb72255 service nova] Creating event network-changed:528c31a5-569d-4fef-a351-c1e8d8d8f70c for instance ed39c690-028c-40a9-9ed9-06b73776d4d6 on nch1-master-1 Feb 19 21:05:44.276027 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-3d61c35c-e04c-41a4-8207-101b544042f7 req-4559c248-4617-45cf-b2b8-96758bb72255 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114048 Feb 19 21:05:44.277014 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1731/3577] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:44.283605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3e0a0a9e-94e6-4325-8fe9-9d8c9e7ef6dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:44.284346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3e0a0a9e-94e6-4325-8fe9-9d8c9e7ef6dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:44.293352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e0a0a9e-94e6-4325-8fe9-9d8c9e7ef6dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:44.294012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e0a0a9e-94e6-4325-8fe9-9d8c9e7ef6dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:44.296063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e0a0a9e-94e6-4325-8fe9-9d8c9e7ef6dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:44.296927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e0a0a9e-94e6-4325-8fe9-9d8c9e7ef6dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:44.661335 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.network.security_group_api [None req-2fa8ebdb-1977-4312-8249-955e05dae6dd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Adding security group e325cfc1-4a1b-4768-b92c-b58a77d5718a to port 528c31a5-569d-4fef-a351-c1e8d8d8f70c Feb 19 21:05:44.751603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3e0a0a9e-94e6-4325-8fe9-9d8c9e7ef6dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:44.764762 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3e0a0a9e-94e6-4325-8fe9-9d8c9e7ef6dd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.485440 Feb 19 21:05:44.780366 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1732/3578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:44 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:44.783616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bc82f097-0367-4f57-83d8-80b796f7a8cb tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:44.783616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc82f097-0367-4f57-83d8-80b796f7a8cb tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:44.790847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc82f097-0367-4f57-83d8-80b796f7a8cb tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:44.791301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc82f097-0367-4f57-83d8-80b796f7a8cb tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:44.792114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc82f097-0367-4f57-83d8-80b796f7a8cb tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:44.792576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc82f097-0367-4f57-83d8-80b796f7a8cb tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:45.682590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bc82f097-0367-4f57-83d8-80b796f7a8cb tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:45.691199 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc82f097-0367-4f57-83d8-80b796f7a8cb tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.924385 Feb 19 21:05:45.691801 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1733/3579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:44 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:45.703025 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:45.704163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:45.709931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:45.710389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:45.711192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:45.712345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:46.222504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:46.242023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:46.245366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:46.253337 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bb434da3-a973-4c7b-a895-7ad29698abee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.560377 Feb 19 21:05:46.253969 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1734/3580] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:45 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:46.268646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1967c19-6bd6-43fa-9c77-abc021d3f08e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:46.269525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1967c19-6bd6-43fa-9c77-abc021d3f08e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:46.269886 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2fa8ebdb-1977-4312-8249-955e05dae6dd tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6/action" status: 202 len: 0 microversion: 2.1 time: 2.156299 Feb 19 21:05:46.271478 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1847/3581] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:44 2022] POST /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6/action => generated 0 bytes in 2159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:46.280553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-45895a28-26e8-4f99-a02c-d8e69586f059 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:46.281352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-45895a28-26e8-4f99-a02c-d8e69586f059 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:46.296663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1967c19-6bd6-43fa-9c77-abc021d3f08e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:46.297195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1967c19-6bd6-43fa-9c77-abc021d3f08e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:46.298037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1967c19-6bd6-43fa-9c77-abc021d3f08e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:46.298479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1967c19-6bd6-43fa-9c77-abc021d3f08e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:46.299686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45895a28-26e8-4f99-a02c-d8e69586f059 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:46.300183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45895a28-26e8-4f99-a02c-d8e69586f059 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:46.301130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45895a28-26e8-4f99-a02c-d8e69586f059 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:46.301569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45895a28-26e8-4f99-a02c-d8e69586f059 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:46.596388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e1967c19-6bd6-43fa-9c77-abc021d3f08e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:46.613732 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1967c19-6bd6-43fa-9c77-abc021d3f08e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.355163 Feb 19 21:05:46.614234 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-45895a28-26e8-4f99-a02c-d8e69586f059 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.338756 Feb 19 21:05:46.624968 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1735/3582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:46 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:46.625479 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1848/3583] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 21:05:46 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6/os-security-groups => generated 1156 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:46.636766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ff353323-24c1-44f9-8b75-fd1ed40ca6d6 req-685ae7bb-1dd3-4b72-9f50-c877cb576ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed39c690-028c-40a9-9ed9-06b73776d4d6", "tag": "528c31a5-569d-4fef-a351-c1e8d8d8f70c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:46.637015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0898d8c3-11a2-4466-b090-6c785691af08 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: .version_select at 0x7f64790309d0>, body: {"security_group": {"name": " tempest-securitygroup -2050723677 ", "description": "tempest-description-465929773"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:46.637185 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:46.637185 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:05:46.642267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ff353323-24c1-44f9-8b75-fd1ed40ca6d6 req-685ae7bb-1dd3-4b72-9f50-c877cb576ff4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:46.642996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ff353323-24c1-44f9-8b75-fd1ed40ca6d6 req-685ae7bb-1dd3-4b72-9f50-c877cb576ff4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:46.674598 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ff353323-24c1-44f9-8b75-fd1ed40ca6d6 req-685ae7bb-1dd3-4b72-9f50-c877cb576ff4 service nova] Creating event network-changed:528c31a5-569d-4fef-a351-c1e8d8d8f70c for instance ed39c690-028c-40a9-9ed9-06b73776d4d6 on nch1-master-1 Feb 19 21:05:46.693123 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ff353323-24c1-44f9-8b75-fd1ed40ca6d6 req-685ae7bb-1dd3-4b72-9f50-c877cb576ff4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060914 Feb 19 21:05:46.694107 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1736/3584] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:46.708463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff98ac1e-f822-4fb2-a452-2476fdf5ca6a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:46.709207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff98ac1e-f822-4fb2-a452-2476fdf5ca6a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:46.728987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff98ac1e-f822-4fb2-a452-2476fdf5ca6a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:46.729973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff98ac1e-f822-4fb2-a452-2476fdf5ca6a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:46.731038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff98ac1e-f822-4fb2-a452-2476fdf5ca6a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:46.731561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff98ac1e-f822-4fb2-a452-2476fdf5ca6a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:47.027823 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0898d8c3-11a2-4466-b090-6c785691af08 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.398029 Feb 19 21:05:47.029235 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1849/3585] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:46 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:47.039040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-919762a7-f819-446c-a425-ce6b630c377a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "757b2f5d-0080-4f9a-891f-7b8f3d47ca02"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:47.040813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-919762a7-f819-446c-a425-ce6b630c377a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:47.042060 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-919762a7-f819-446c-a425-ce6b630c377a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.009178 Feb 19 21:05:47.042898 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1850/3586] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:47 2022] POST /compute/v2.1/servers => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:05:47.048860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b3560af3-ddf9-4dc0-8e5d-3019f94ec366 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f647907d3a0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:47.174437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ff98ac1e-f822-4fb2-a452-2476fdf5ca6a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:47.183357 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff98ac1e-f822-4fb2-a452-2476fdf5ca6a tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.479106 Feb 19 21:05:47.184580 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1737/3587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:46 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:47.186645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b3560af3-ddf9-4dc0-8e5d-3019f94ec366 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0" status: 200 len: 223 microversion: 2.1 time: 0.141303 Feb 19 21:05:47.187670 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1851/3588] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:05:47 2022] GET /compute/v2.1/os-security-groups/a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:47.190382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cc2bea09-b928-416e-b6f4-2c95475f526a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:47.191008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cc2bea09-b928-416e-b6f4-2c95475f526a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:47.198616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc2bea09-b928-416e-b6f4-2c95475f526a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:47.199345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc2bea09-b928-416e-b6f4-2c95475f526a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:47.200523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc2bea09-b928-416e-b6f4-2c95475f526a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:47.201311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc2bea09-b928-416e-b6f4-2c95475f526a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:47.208996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df857c5b-8067-4a7b-b87f-9300e00d5574 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f6479034820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:47.604466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cc2bea09-b928-416e-b6f4-2c95475f526a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:47.615075 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cc2bea09-b928-416e-b6f4-2c95475f526a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.429008 Feb 19 21:05:47.621343 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1738/3589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:47 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:47.628755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:47.630129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:47.641464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:47.642520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:47.644679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:47.645426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:47.803831 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df857c5b-8067-4a7b-b87f-9300e00d5574 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0" status: 202 len: 0 microversion: 2.1 time: 0.602777 Feb 19 21:05:47.804760 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1852/3590] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:47 2022] DELETE /compute/v2.1/os-security-groups/a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:05:47.811497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c8194f1f-1820-4079-8ea3-400929a6093c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:47.812362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c8194f1f-1820-4079-8ea3-400929a6093c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:47.832122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8194f1f-1820-4079-8ea3-400929a6093c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:47.832611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8194f1f-1820-4079-8ea3-400929a6093c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:47.833594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8194f1f-1820-4079-8ea3-400929a6093c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:47.834230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8194f1f-1820-4079-8ea3-400929a6093c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:48.051481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:48.078722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:48.080361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:48.081633 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc0e9a12-fd04-4733-b9cb-e670c1d06d13 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.458665 Feb 19 21:05:48.087834 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1739/3591] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:47 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:48.093911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cdff4b25-4512-47fb-8314-835407c86558 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f646749ddc0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:48.150425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-cdff4b25-4512-47fb-8314-835407c86558 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:05:48.151256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-cdff4b25-4512-47fb-8314-835407c86558 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:05:48.151970 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-cdff4b25-4512-47fb-8314-835407c86558 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 does not exist Feb 19 21:05:48.151970 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-45a25eb4-d577-43d9-9e4e-3c1f60e7af4a'] Feb 19 21:05:48.154210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cdff4b25-4512-47fb-8314-835407c86558 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 does not exist Feb 19 21:05:48.154210 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-45a25eb4-d577-43d9-9e4e-3c1f60e7af4a'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:48.155068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c8194f1f-1820-4079-8ea3-400929a6093c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:48.157146 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cdff4b25-4512-47fb-8314-835407c86558 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0" status: 404 len: 194 microversion: 2.1 time: 0.068144 Feb 19 21:05:48.163490 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c8194f1f-1820-4079-8ea3-400929a6093c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.356906 Feb 19 21:05:48.166188 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1853/3592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:47 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:48.171519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f3dc3a7-3396-46fb-ba99-dc5a93512dbc tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: .version_select at 0x7f64790d5430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-464676329", "description": "tempest-description-192136408"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:48.187946 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1740/3593] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:05:48 2022] GET /compute/v2.1/os-security-groups/a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:48.204290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-95ec0546-6510-4332-a494-922bc03adaf1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:48.205181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-95ec0546-6510-4332-a494-922bc03adaf1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 7770ff15-12ac-408e-aa65-7ff80cea596a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:48.213205 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-95ec0546-6510-4332-a494-922bc03adaf1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 7770ff15-12ac-408e-aa65-7ff80cea596a could not be found. Feb 19 21:05:48.214398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-95ec0546-6510-4332-a494-922bc03adaf1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 7770ff15-12ac-408e-aa65-7ff80cea596a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:48.216697 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-95ec0546-6510-4332-a494-922bc03adaf1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/7770ff15-12ac-408e-aa65-7ff80cea596a/action" status: 404 len: 111 microversion: 2.1 time: 0.026745 Feb 19 21:05:48.217585 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1741/3594] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:48 2022] POST /compute/v2.1/servers/7770ff15-12ac-408e-aa65-7ff80cea596a/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:48.226470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9362fdcd-211f-4fb4-965c-1335828cc529 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:48.228154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9362fdcd-211f-4fb4-965c-1335828cc529 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:48.236126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9362fdcd-211f-4fb4-965c-1335828cc529 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:48.236953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9362fdcd-211f-4fb4-965c-1335828cc529 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:48.237969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9362fdcd-211f-4fb4-965c-1335828cc529 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:48.238598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9362fdcd-211f-4fb4-965c-1335828cc529 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:48.434795 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f3dc3a7-3396-46fb-ba99-dc5a93512dbc tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.267036 Feb 19 21:05:48.435885 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1854/3595] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:48 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:48.449082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-29f4e85e-a428-4c31-9035-4625f6fb76c2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:48.449082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-29f4e85e-a428-4c31-9035-4625f6fb76c2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:48.458284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29f4e85e-a428-4c31-9035-4625f6fb76c2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:48.458284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29f4e85e-a428-4c31-9035-4625f6fb76c2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:48.459250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29f4e85e-a428-4c31-9035-4625f6fb76c2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:48.460741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29f4e85e-a428-4c31-9035-4625f6fb76c2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:48.505192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9362fdcd-211f-4fb4-965c-1335828cc529 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:48.520899 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9362fdcd-211f-4fb4-965c-1335828cc529 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.301153 Feb 19 21:05:48.536909 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1742/3596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:48 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:48.545755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5d32aeec-0965-470a-be13-95d64fc35f16 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: .version_select at 0x7f64674f5550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-199230584", "description": "tempest-description-630970160"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:48.724159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29f4e85e-a428-4c31-9035-4625f6fb76c2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:48.745124 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-29f4e85e-a428-4c31-9035-4625f6fb76c2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.308017 Feb 19 21:05:48.745722 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1855/3597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:48 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:48.772638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3077a6f5-b242-4d2e-a86f-6e5ecb6a59b6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:48.773533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3077a6f5-b242-4d2e-a86f-6e5ecb6a59b6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:48.784435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3077a6f5-b242-4d2e-a86f-6e5ecb6a59b6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:48.784893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3077a6f5-b242-4d2e-a86f-6e5ecb6a59b6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:48.785694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3077a6f5-b242-4d2e-a86f-6e5ecb6a59b6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:48.786335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3077a6f5-b242-4d2e-a86f-6e5ecb6a59b6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:49.050462 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5d32aeec-0965-470a-be13-95d64fc35f16 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.511975 Feb 19 21:05:49.051818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1743/3598] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:48 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:49.066357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f8392808-f11c-4381-9d4b-3013c9e6bc34 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: .version_select at 0x7f6467c6bca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1059499575", "description": "tempest-description-430498565"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:49.284511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3077a6f5-b242-4d2e-a86f-6e5ecb6a59b6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:49.293391 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3077a6f5-b242-4d2e-a86f-6e5ecb6a59b6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.532723 Feb 19 21:05:49.293982 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1856/3599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:48 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:49.310887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:49.312126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:49.324470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:49.325004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:49.325884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:49.326415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:49.569886 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f8392808-f11c-4381-9d4b-3013c9e6bc34 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.510336 Feb 19 21:05:49.571095 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1744/3600] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:49.576662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b230940-a2b5-40db-937d-9fd4cd03d964 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:49.577345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b230940-a2b5-40db-937d-9fd4cd03d964 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:49.586649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b230940-a2b5-40db-937d-9fd4cd03d964 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:49.587387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b230940-a2b5-40db-937d-9fd4cd03d964 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:49.588208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b230940-a2b5-40db-937d-9fd4cd03d964 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:49.588687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b230940-a2b5-40db-937d-9fd4cd03d964 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:49.622537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-6b230940-a2b5-40db-937d-9fd4cd03d964 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lazy-loading 'flavor' on Instance uuid 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:05:49.965894 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b230940-a2b5-40db-937d-9fd4cd03d964 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 202 len: 0 microversion: 2.1 time: 0.390365 Feb 19 21:05:49.980257 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1745/3601] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:05:49 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:49.988970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e648818-ccaa-4ab6-bf66-8f7f73a1474b tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:49.989879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e648818-ccaa-4ab6-bf66-8f7f73a1474b tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:50.003487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e648818-ccaa-4ab6-bf66-8f7f73a1474b tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:50.003942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e648818-ccaa-4ab6-bf66-8f7f73a1474b tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:50.005288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e648818-ccaa-4ab6-bf66-8f7f73a1474b tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:50.005533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e648818-ccaa-4ab6-bf66-8f7f73a1474b tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:50.102949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:50.117565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:50.119365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:50.120855 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d048ff3f-f740-4933-9556-fdeb5b4c6488 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.817201 Feb 19 21:05:50.136049 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1857/3602] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:49 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:50.141962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c7b380f5-0153-4db6-bfdb-fe3adf5fe242 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64790340d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:50.618470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8e648818-ccaa-4ab6-bf66-8f7f73a1474b tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:50.627353 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8e648818-ccaa-4ab6-bf66-8f7f73a1474b tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.643504 Feb 19 21:05:50.628292 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1746/3603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:49 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:50.634349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e084da48-760b-4af5-a255-e96536c8ad92 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:50.635356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e084da48-760b-4af5-a255-e96536c8ad92 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:50.641720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e084da48-760b-4af5-a255-e96536c8ad92 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:50.642451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e084da48-760b-4af5-a255-e96536c8ad92 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:50.643751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e084da48-760b-4af5-a255-e96536c8ad92 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:50.644387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e084da48-760b-4af5-a255-e96536c8ad92 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:50.957467 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c7b380f5-0153-4db6-bfdb-fe3adf5fe242 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.819731 Feb 19 21:05:50.965228 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1858/3604] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 21:05:50 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:50.971798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-26df31a1-013e-477c-b97e-abef61d07ab2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f6467bb9700>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:51.063969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e084da48-760b-4af5-a255-e96536c8ad92 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:51.073633 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e084da48-760b-4af5-a255-e96536c8ad92 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.443733 Feb 19 21:05:51.075675 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1747/3605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:50 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:51.142476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:51.143396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:51.150291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:51.150941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:51.151740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:51.152281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:51.628081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:51.640393 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-26df31a1-013e-477c-b97e-abef61d07ab2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/6a5c31e3-3389-4b33-9fff-76e0057302da" status: 202 len: 0 microversion: 2.1 time: 0.672055 Feb 19 21:05:51.641233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:51.641412 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1859/3606] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:50 2022] DELETE /compute/v2.1/os-security-groups/6a5c31e3-3389-4b33-9fff-76e0057302da => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:05:51.643216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:51.644848 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d6412815-c928-43ce-9a7a-e78e19d53816 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.506126 Feb 19 21:05:51.645586 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1748/3607] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:51 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:05:51.659125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7b3e2f38-c56f-4337-81e6-532715eacf95 req-0bc4026f-5e36-477b-bf21-09241d8b269e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa7e1f5-314f-430a-92f8-b0f1b2e15f1c", "name": "network-vif-plugged", "status": "completed", "tag": "df7355b0-0bc1-43f9-9dc4-8218b7e68a43"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:51.662130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13e79600-fc9f-4e08-a57d-8b0aa7e5f1ef tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674a4a60>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:51.666159 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:51.666159 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:05:51.677594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7b3e2f38-c56f-4337-81e6-532715eacf95 req-0bc4026f-5e36-477b-bf21-09241d8b269e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:51.678450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7b3e2f38-c56f-4337-81e6-532715eacf95 req-0bc4026f-5e36-477b-bf21-09241d8b269e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:51.692051 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7b3e2f38-c56f-4337-81e6-532715eacf95 req-0bc4026f-5e36-477b-bf21-09241d8b269e service nova] Creating event network-vif-plugged:df7355b0-0bc1-43f9-9dc4-8218b7e68a43 for instance efa7e1f5-314f-430a-92f8-b0f1b2e15f1c on nch2-master-1 Feb 19 21:05:51.700022 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7b3e2f38-c56f-4337-81e6-532715eacf95 req-0bc4026f-5e36-477b-bf21-09241d8b269e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057165 Feb 19 21:05:51.701824 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1860/3608] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:51.707702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f74d0c6-b3c8-48f7-a7ae-637d1c832cbd tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:51.708816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f74d0c6-b3c8-48f7-a7ae-637d1c832cbd tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:51.726101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f74d0c6-b3c8-48f7-a7ae-637d1c832cbd tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:51.726816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f74d0c6-b3c8-48f7-a7ae-637d1c832cbd tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:51.728253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f74d0c6-b3c8-48f7-a7ae-637d1c832cbd tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:51.728831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f74d0c6-b3c8-48f7-a7ae-637d1c832cbd tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:51.731480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-13e79600-fc9f-4e08-a57d-8b0aa7e5f1ef tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6a5c31e3-3389-4b33-9fff-76e0057302da does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:05:51.731753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-13e79600-fc9f-4e08-a57d-8b0aa7e5f1ef tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group 6a5c31e3-3389-4b33-9fff-76e0057302da not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:05:51.732286 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-13e79600-fc9f-4e08-a57d-8b0aa7e5f1ef tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group 6a5c31e3-3389-4b33-9fff-76e0057302da does not exist Feb 19 21:05:51.732286 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-7572912a-4ece-48e1-b360-3e6fdb6e05ae'] Feb 19 21:05:51.732909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13e79600-fc9f-4e08-a57d-8b0aa7e5f1ef tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group 6a5c31e3-3389-4b33-9fff-76e0057302da does not exist Feb 19 21:05:51.732909 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-7572912a-4ece-48e1-b360-3e6fdb6e05ae'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:51.733756 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13e79600-fc9f-4e08-a57d-8b0aa7e5f1ef tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/6a5c31e3-3389-4b33-9fff-76e0057302da" status: 404 len: 194 microversion: 2.1 time: 0.078866 Feb 19 21:05:51.737342 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1749/3609] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:05:51 2022] GET /compute/v2.1/os-security-groups/6a5c31e3-3389-4b33-9fff-76e0057302da => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:51.742717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ee902612-abf0-4c66-8463-acba1bfc6ebb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674f5af0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:52.133040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f74d0c6-b3c8-48f7-a7ae-637d1c832cbd tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:52.141200 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f74d0c6-b3c8-48f7-a7ae-637d1c832cbd tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.437649 Feb 19 21:05:52.141784 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1861/3610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:51 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:52.146239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8ab29daa-1b33-4e39-89be-38756e5da9ce tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:52.146856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8ab29daa-1b33-4e39-89be-38756e5da9ce tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:52.154592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ab29daa-1b33-4e39-89be-38756e5da9ce tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:52.155052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ab29daa-1b33-4e39-89be-38756e5da9ce tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:52.156056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ab29daa-1b33-4e39-89be-38756e5da9ce tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:52.156552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ab29daa-1b33-4e39-89be-38756e5da9ce tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:52.299578 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ee902612-abf0-4c66-8463-acba1bfc6ebb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/092e5c81-8e0e-43c1-b76f-170278dc21b4" status: 202 len: 0 microversion: 2.1 time: 0.560236 Feb 19 21:05:52.300175 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1750/3611] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:51 2022] DELETE /compute/v2.1/os-security-groups/092e5c81-8e0e-43c1-b76f-170278dc21b4 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:05:52.310041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bf078a86-b9c7-47c3-9dee-80ef43aa494d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674f5e50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:52.374171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-bf078a86-b9c7-47c3-9dee-80ef43aa494d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 092e5c81-8e0e-43c1-b76f-170278dc21b4 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:05:52.375088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-bf078a86-b9c7-47c3-9dee-80ef43aa494d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group 092e5c81-8e0e-43c1-b76f-170278dc21b4 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:05:52.380593 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-bf078a86-b9c7-47c3-9dee-80ef43aa494d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group 092e5c81-8e0e-43c1-b76f-170278dc21b4 does not exist Feb 19 21:05:52.380593 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-76422853-0442-464e-adef-c7d815c855fd'] Feb 19 21:05:52.381212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bf078a86-b9c7-47c3-9dee-80ef43aa494d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group 092e5c81-8e0e-43c1-b76f-170278dc21b4 does not exist Feb 19 21:05:52.381212 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-76422853-0442-464e-adef-c7d815c855fd'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:52.382456 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bf078a86-b9c7-47c3-9dee-80ef43aa494d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/092e5c81-8e0e-43c1-b76f-170278dc21b4" status: 404 len: 194 microversion: 2.1 time: 0.077930 Feb 19 21:05:52.386059 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1751/3612] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:05:52 2022] GET /compute/v2.1/os-security-groups/092e5c81-8e0e-43c1-b76f-170278dc21b4 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:05:52.394790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9d2a9218-79b5-4044-a89a-ff3cd29d2760 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674a4430>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:52.513497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8ab29daa-1b33-4e39-89be-38756e5da9ce tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:52.521965 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8ab29daa-1b33-4e39-89be-38756e5da9ce tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.379144 Feb 19 21:05:52.529801 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1862/3613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:52 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:52.664511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:52.665798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:52.674023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:52.674573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:52.675441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:52.675958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:52.884177 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9d2a9218-79b5-4044-a89a-ff3cd29d2760 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/43a4271b-abe4-4606-90de-e43d94450023" status: 202 len: 0 microversion: 2.1 time: 0.493171 Feb 19 21:05:52.885390 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1752/3614] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:05:52 2022] DELETE /compute/v2.1/os-security-groups/43a4271b-abe4-4606-90de-e43d94450023 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:05:52.895656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4d9bf13-4ef3-4970-9a8b-b6921e0739e6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674a4ca0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:52.948889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-c4d9bf13-4ef3-4970-9a8b-b6921e0739e6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 43a4271b-abe4-4606-90de-e43d94450023 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:05:52.950192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-c4d9bf13-4ef3-4970-9a8b-b6921e0739e6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group 43a4271b-abe4-4606-90de-e43d94450023 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:05:52.951011 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c4d9bf13-4ef3-4970-9a8b-b6921e0739e6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group 43a4271b-abe4-4606-90de-e43d94450023 does not exist Feb 19 21:05:52.951011 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-4984d64f-966c-46dd-b3b6-76f1018eebfd'] Feb 19 21:05:52.951816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4d9bf13-4ef3-4970-9a8b-b6921e0739e6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group 43a4271b-abe4-4606-90de-e43d94450023 does not exist Feb 19 21:05:52.951816 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-4984d64f-966c-46dd-b3b6-76f1018eebfd'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:52.953783 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c4d9bf13-4ef3-4970-9a8b-b6921e0739e6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/43a4271b-abe4-4606-90de-e43d94450023" status: 404 len: 194 microversion: 2.1 time: 0.064426 Feb 19 21:05:52.956006 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1753/3615] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:05:52 2022] GET /compute/v2.1/os-security-groups/43a4271b-abe4-4606-90de-e43d94450023 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:52.965937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-135b20f4-bf6e-44fe-bd29-52fceb0db01d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674f5ee0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:52.975999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:52.988089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:52.989963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:52.991319 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6fa08f93-368b-4b35-a2a6-3ede1c64250d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.330981 Feb 19 21:05:53.004938 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1863/3616] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:52 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:05:53.157453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b04a8e3c-3a24-4300-ae83-8c4ab05b9209 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:53.158207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b04a8e3c-3a24-4300-ae83-8c4ab05b9209 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:53.165190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b04a8e3c-3a24-4300-ae83-8c4ab05b9209 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:53.165783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b04a8e3c-3a24-4300-ae83-8c4ab05b9209 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:53.166720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b04a8e3c-3a24-4300-ae83-8c4ab05b9209 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:53.167243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b04a8e3c-3a24-4300-ae83-8c4ab05b9209 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:53.191877 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-135b20f4-bf6e-44fe-bd29-52fceb0db01d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.228898 Feb 19 21:05:53.201797 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1754/3617] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 21:05:52 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:53.207443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2ec2559e-f3d2-419c-b1cc-31d87afec477 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: .version_select at 0x7f64674f51f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-293704867", "description": "tempest-description-2075111780"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:53.379333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b04a8e3c-3a24-4300-ae83-8c4ab05b9209 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:53.389243 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b04a8e3c-3a24-4300-ae83-8c4ab05b9209 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1327 microversion: 2.1 time: 0.235331 Feb 19 21:05:53.390259 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1864/3618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:53 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1327 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:53.454446 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2ec2559e-f3d2-419c-b1cc-31d87afec477 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.250918 Feb 19 21:05:53.455588 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1755/3619] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:53 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:05:53.471508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5f7cfaa-2e39-485c-a13f-d573070679dc tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: .version_select at 0x7f64791415e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1565333646", "description": "tempest-description-2111263476"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:53.539764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cc424378-9c11-4495-8699-9fd520da2df7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:53.540879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cc424378-9c11-4495-8699-9fd520da2df7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:53.549141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc424378-9c11-4495-8699-9fd520da2df7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:53.549612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc424378-9c11-4495-8699-9fd520da2df7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:53.550398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc424378-9c11-4495-8699-9fd520da2df7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:53.551047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc424378-9c11-4495-8699-9fd520da2df7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:53.709996 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5f7cfaa-2e39-485c-a13f-d573070679dc tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.242521 Feb 19 21:05:53.711029 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1865/3620] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:05:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:53.778714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2091658726", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "a70cdeb1-fa61-4f53-afac-2e2ce6af3cb6"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:53.801278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cc424378-9c11-4495-8699-9fd520da2df7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:53.816157 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cc424378-9c11-4495-8699-9fd520da2df7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.280787 Feb 19 21:05:53.817370 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1756/3621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:53 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:53.849391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] validate_networks() for [('a70cdeb1-fa61-4f53-afac-2e2ce6af3cb6', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:05:54.013634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:54.014272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:54.021223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.021720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:54.022592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.023491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:54.582760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:54.591995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:54.593803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:54.595327 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-103532bd-8f8d-4764-9127-606dfd8603c0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.585910 Feb 19 21:05:54.596449 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1757/3622] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:54 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:05:54.600892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eeeecbed-43b4-44d1-bd4e-794787f77f51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:54.601697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eeeecbed-43b4-44d1-bd4e-794787f77f51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:54.611000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eeeecbed-43b4-44d1-bd4e-794787f77f51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.611739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eeeecbed-43b4-44d1-bd4e-794787f77f51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:54.612779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eeeecbed-43b4-44d1-bd4e-794787f77f51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.613405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eeeecbed-43b4-44d1-bd4e-794787f77f51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:54.640535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:05:54.641214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:05:54.641441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:05:54.642066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:05:54.642668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:05:54.663014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.663591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:54.665238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.666279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:54.689664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Getting quotas for project 3e16b1ae38144c3ba7d8cb99e46eea10. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:05:54.696126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Getting quotas for user 2ff7364263f04529910770039084fb7f and project 3e16b1ae38144c3ba7d8cb99e46eea10. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:05:54.709959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:05:54.712746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:05:54.771258 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-74145cc4-2cdc-48af-b5fb-1f0fe0defcac tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996613 Feb 19 21:05:54.778598 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1866/3623] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:05:54.784351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-48995b3b-f8be-4f9f-80c4-595bdc363644 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:54.785393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-48995b3b-f8be-4f9f-80c4-595bdc363644 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:54.859696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-48995b3b-f8be-4f9f-80c4-595bdc363644 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:54.860006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eeeecbed-43b4-44d1-bd4e-794787f77f51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:54.869437 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-48995b3b-f8be-4f9f-80c4-595bdc363644 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1216 microversion: 2.1 time: 0.087586 Feb 19 21:05:54.871750 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eeeecbed-43b4-44d1-bd4e-794787f77f51 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1527 microversion: 2.1 time: 0.271709 Feb 19 21:05:54.872862 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1758/3625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:54 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1527 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:54.877405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ea0eb862-f70e-4b96-ba01-339766c9cf76 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:54.878016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ea0eb862-f70e-4b96-ba01-339766c9cf76 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:54.882159 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1867/3625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:54 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:54.884758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea0eb862-f70e-4b96-ba01-339766c9cf76 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.885216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea0eb862-f70e-4b96-ba01-339766c9cf76 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:54.886159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea0eb862-f70e-4b96-ba01-339766c9cf76 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.886687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea0eb862-f70e-4b96-ba01-339766c9cf76 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:54.892127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0dfb8589-9d34-4be4-8189-723bd676c131 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:54.893226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0dfb8589-9d34-4be4-8189-723bd676c131 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:54.905007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dfb8589-9d34-4be4-8189-723bd676c131 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.906215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dfb8589-9d34-4be4-8189-723bd676c131 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:54.907861 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dfb8589-9d34-4be4-8189-723bd676c131 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:54.908943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dfb8589-9d34-4be4-8189-723bd676c131 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.480527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0dfb8589-9d34-4be4-8189-723bd676c131 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:55.491376 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0dfb8589-9d34-4be4-8189-723bd676c131 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1527 microversion: 2.1 time: 0.605778 Feb 19 21:05:55.491964 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1868/3626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:54 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1527 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:55.496811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ea0eb862-f70e-4b96-ba01-339766c9cf76 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:55.498608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9dbd4f9a-def6-408f-a140-b8149e77c5eb req-c13928ec-6054-4bcc-858e-a4bbdf7d950b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17524174-4cfd-409a-b6f4-15bde7d2c4d1", "name": "network-vif-plugged", "status": "completed", "tag": "2caf0c43-e8a7-47e8-a90c-390f3b45d82b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:55.500767 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:55.500767 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:05:55.508518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9dbd4f9a-def6-408f-a140-b8149e77c5eb req-c13928ec-6054-4bcc-858e-a4bbdf7d950b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.508894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9dbd4f9a-def6-408f-a140-b8149e77c5eb req-c13928ec-6054-4bcc-858e-a4bbdf7d950b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.511257 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ea0eb862-f70e-4b96-ba01-339766c9cf76 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.637013 Feb 19 21:05:55.511909 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1759/3627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:54 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:55.528426 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9dbd4f9a-def6-408f-a140-b8149e77c5eb req-c13928ec-6054-4bcc-858e-a4bbdf7d950b service nova] Creating event network-vif-plugged:2caf0c43-e8a7-47e8-a90c-390f3b45d82b for instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 on nch2-master-1 Feb 19 21:05:55.534202 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9dbd4f9a-def6-408f-a140-b8149e77c5eb req-c13928ec-6054-4bcc-858e-a4bbdf7d950b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040069 Feb 19 21:05:55.536137 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1869/3628] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:55.584313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9c1771bf-a591-4bbd-bfee-0867d49e57d7 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:55.584838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9c1771bf-a591-4bbd-bfee-0867d49e57d7 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:55.591346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c1771bf-a591-4bbd-bfee-0867d49e57d7 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.591878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c1771bf-a591-4bbd-bfee-0867d49e57d7 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.592799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c1771bf-a591-4bbd-bfee-0867d49e57d7 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.593545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c1771bf-a591-4bbd-bfee-0867d49e57d7 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.611062 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9c1771bf-a591-4bbd-bfee-0867d49e57d7 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] HTTP exception thrown: Instance efa7e1f5-314f-430a-92f8-b0f1b2e15f1c could not be found. Feb 19 21:05:55.611877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9c1771bf-a591-4bbd-bfee-0867d49e57d7 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Returning 404 to user: Instance efa7e1f5-314f-430a-92f8-b0f1b2e15f1c could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:55.613120 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9c1771bf-a591-4bbd-bfee-0867d49e57d7 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] 10.222.0.30 "DELETE /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 404 len: 111 microversion: 2.1 time: 0.099547 Feb 19 21:05:55.620818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1760/3629] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:05:55 2022] DELETE /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:55.622089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:55.622908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:55.628189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0272b17c-cacb-4808-9e9d-c7edc50b60d0 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:55.628860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0272b17c-cacb-4808-9e9d-c7edc50b60d0 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:55.631576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.633321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.635047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.635883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.637364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0272b17c-cacb-4808-9e9d-c7edc50b60d0 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.637878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0272b17c-cacb-4808-9e9d-c7edc50b60d0 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.638806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0272b17c-cacb-4808-9e9d-c7edc50b60d0 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.639242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0272b17c-cacb-4808-9e9d-c7edc50b60d0 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.902505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0272b17c-cacb-4808-9e9d-c7edc50b60d0 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:55.913598 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0272b17c-cacb-4808-9e9d-c7edc50b60d0 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1527 microversion: 2.1 time: 0.291535 Feb 19 21:05:55.927967 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1761/3630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:55 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:55.928265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:55.935803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8448ce1-3d9a-4ce8-a206-e14e473bacd1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:55.936795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e8448ce1-3d9a-4ce8-a206-e14e473bacd1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:55.942776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:55.946551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8448ce1-3d9a-4ce8-a206-e14e473bacd1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.947042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8448ce1-3d9a-4ce8-a206-e14e473bacd1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.947972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:55.948809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8448ce1-3d9a-4ce8-a206-e14e473bacd1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.949388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8448ce1-3d9a-4ce8-a206-e14e473bacd1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.950916 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c805509-4336-4e9e-8886-69478aeed74b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.334411 Feb 19 21:05:55.952553 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1870/3631] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:55 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:05:55.961632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e02566ee-7796-4a3f-a7d4-5e2061be25f8 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Action: 'update', calling method: >, body: {"server": {"name": "efa7e1f5-314f-430a-92f8-b0f1b2e15f1c_new"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:55.963176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e02566ee-7796-4a3f-a7d4-5e2061be25f8 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:55.970080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e02566ee-7796-4a3f-a7d4-5e2061be25f8 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.970527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e02566ee-7796-4a3f-a7d4-5e2061be25f8 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.971326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e02566ee-7796-4a3f-a7d4-5e2061be25f8 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:55.971760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e02566ee-7796-4a3f-a7d4-5e2061be25f8 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:55.989111 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e02566ee-7796-4a3f-a7d4-5e2061be25f8 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] HTTP exception thrown: Instance efa7e1f5-314f-430a-92f8-b0f1b2e15f1c could not be found. Feb 19 21:05:55.990367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e02566ee-7796-4a3f-a7d4-5e2061be25f8 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] Returning 404 to user: Instance efa7e1f5-314f-430a-92f8-b0f1b2e15f1c could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:05:55.991565 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e02566ee-7796-4a3f-a7d4-5e2061be25f8 tempest-ServersNegativeTestMultiTenantJSON-2002097392 tempest-ServersNegativeTestMultiTenantJSON-2002097392-project] 10.222.0.30 "PUT /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 404 len: 111 microversion: 2.1 time: 0.036739 Feb 19 21:05:55.993251 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1871/3632] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 21:05:55 2022] PUT /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:05:56.004571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-38cd1e0d-466b-4c30-abb3-cb2ccabc1ec7 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:56.005380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-38cd1e0d-466b-4c30-abb3-cb2ccabc1ec7 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:56.012546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38cd1e0d-466b-4c30-abb3-cb2ccabc1ec7 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:56.013254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38cd1e0d-466b-4c30-abb3-cb2ccabc1ec7 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:56.014447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38cd1e0d-466b-4c30-abb3-cb2ccabc1ec7 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:56.015141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38cd1e0d-466b-4c30-abb3-cb2ccabc1ec7 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:56.050830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-38cd1e0d-466b-4c30-abb3-cb2ccabc1ec7 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:05:56.071459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e8448ce1-3d9a-4ce8-a206-e14e473bacd1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:56.089974 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e8448ce1-3d9a-4ce8-a206-e14e473bacd1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1276 microversion: 2.1 time: 0.159581 Feb 19 21:05:56.091399 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1762/3633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:55 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:56.175431 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-38cd1e0d-466b-4c30-abb3-cb2ccabc1ec7 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "DELETE /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 204 len: 0 microversion: 2.1 time: 0.173814 Feb 19 21:05:56.177376 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1872/3634] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:05:55 2022] DELETE /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:05:56.185942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76d32e9f-9719-47fd-b585-a209aebd99ff tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:56.186665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-76d32e9f-9719-47fd-b585-a209aebd99ff tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:56.196631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d32e9f-9719-47fd-b585-a209aebd99ff tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:56.197714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d32e9f-9719-47fd-b585-a209aebd99ff tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:56.199191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d32e9f-9719-47fd-b585-a209aebd99ff tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:56.201020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76d32e9f-9719-47fd-b585-a209aebd99ff tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:56.460513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-76d32e9f-9719-47fd-b585-a209aebd99ff tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:56.468944 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-76d32e9f-9719-47fd-b585-a209aebd99ff tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1533 microversion: 2.1 time: 0.287589 Feb 19 21:05:56.470309 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1763/3635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:56 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1533 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:56.530225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a45231d9-f8c3-4a13-b46f-41f1fb22f164 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:56.531428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a45231d9-f8c3-4a13-b46f-41f1fb22f164 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:56.544056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a45231d9-f8c3-4a13-b46f-41f1fb22f164 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:56.544834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a45231d9-f8c3-4a13-b46f-41f1fb22f164 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:56.546118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a45231d9-f8c3-4a13-b46f-41f1fb22f164 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:56.546591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a45231d9-f8c3-4a13-b46f-41f1fb22f164 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:56.868691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a45231d9-f8c3-4a13-b46f-41f1fb22f164 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:56.876948 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a45231d9-f8c3-4a13-b46f-41f1fb22f164 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.350957 Feb 19 21:05:56.887076 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1873/3636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:56 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:56.972547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:56.974188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:56.986051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:56.986663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:56.988008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:56.989009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:57.114302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-654ffc93-aae7-4bb7-a0fc-cdc764bae1a1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:57.116606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-654ffc93-aae7-4bb7-a0fc-cdc764bae1a1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:57.129130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-654ffc93-aae7-4bb7-a0fc-cdc764bae1a1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:57.129971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-654ffc93-aae7-4bb7-a0fc-cdc764bae1a1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:57.130987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-654ffc93-aae7-4bb7-a0fc-cdc764bae1a1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:57.131648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-654ffc93-aae7-4bb7-a0fc-cdc764bae1a1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:57.440015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:57.448691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:57.452101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:57.453494 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eaf405fd-e268-48ca-8228-db4feff3da6f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.486910 Feb 19 21:05:57.454516 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1764/3637] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:56 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:57.488195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cc6c853c-c989-4847-9d88-ed59572d687f tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:57.489363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cc6c853c-c989-4847-9d88-ed59572d687f tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:57.500899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-654ffc93-aae7-4bb7-a0fc-cdc764bae1a1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:57.501202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc6c853c-c989-4847-9d88-ed59572d687f tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:57.503407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc6c853c-c989-4847-9d88-ed59572d687f tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:57.505116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc6c853c-c989-4847-9d88-ed59572d687f tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:57.505817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cc6c853c-c989-4847-9d88-ed59572d687f tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:57.509565 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-654ffc93-aae7-4bb7-a0fc-cdc764bae1a1 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1316 microversion: 2.1 time: 0.400196 Feb 19 21:05:57.509740 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1874/3638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:57 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:57.838762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cc6c853c-c989-4847-9d88-ed59572d687f tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:57.849001 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cc6c853c-c989-4847-9d88-ed59572d687f tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1533 microversion: 2.1 time: 0.365771 Feb 19 21:05:57.850313 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1765/3639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:57 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1533 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:05:57.896238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ae185c1-e29c-4c42-a037-ca0d6fa90cbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:57.897995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ae185c1-e29c-4c42-a037-ca0d6fa90cbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:57.907474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ae185c1-e29c-4c42-a037-ca0d6fa90cbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:57.908678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ae185c1-e29c-4c42-a037-ca0d6fa90cbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:57.910314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ae185c1-e29c-4c42-a037-ca0d6fa90cbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:57.911078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ae185c1-e29c-4c42-a037-ca0d6fa90cbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:58.345362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ae185c1-e29c-4c42-a037-ca0d6fa90cbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:58.357795 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ae185c1-e29c-4c42-a037-ca0d6fa90cbc tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.467018 Feb 19 21:05:58.369054 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1875/3640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:57 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:58.483584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:58.490961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:58.502547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:58.502987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:58.507990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:58.511488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:58.530428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f47803e3-98f5-4b14-ba9c-a19fb967f593 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:58.531394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f47803e3-98f5-4b14-ba9c-a19fb967f593 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:58.545918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f47803e3-98f5-4b14-ba9c-a19fb967f593 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:58.546430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f47803e3-98f5-4b14-ba9c-a19fb967f593 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:58.547245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f47803e3-98f5-4b14-ba9c-a19fb967f593 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:58.547732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f47803e3-98f5-4b14-ba9c-a19fb967f593 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:59.285374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:59.294700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:59.296856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:59.302217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f47803e3-98f5-4b14-ba9c-a19fb967f593 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:59.310654 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1696927-41c1-41fc-9a0c-1361d87b0bac tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1809 microversion: 2.20 time: 0.824687 Feb 19 21:05:59.327681 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f47803e3-98f5-4b14-ba9c-a19fb967f593 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1316 microversion: 2.1 time: 0.803106 Feb 19 21:05:59.328011 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1766/3641] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:05:58 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1809 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:05:59.332531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2b20fb1f-4b06-4df0-ae16-1c6adfb331e7 req-75ad68f2-92b9-4bd9-b3bc-453122867c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646454f0-96fd-4131-9267-ed8e438556e3", "tag": "29e2dde0-a838-4891-9d59-16f20a4969b9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:59.333234 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1876/3642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:58 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1316 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:59.340408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c7ea87d7-208e-4045-89ba-f0cf425c0171 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:59.342185 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:59.342185 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:05:59.347122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c7ea87d7-208e-4045-89ba-f0cf425c0171 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:59.351286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2b20fb1f-4b06-4df0-ae16-1c6adfb331e7 req-75ad68f2-92b9-4bd9-b3bc-453122867c64 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:59.352220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2b20fb1f-4b06-4df0-ae16-1c6adfb331e7 req-75ad68f2-92b9-4bd9-b3bc-453122867c64 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:59.354953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7ea87d7-208e-4045-89ba-f0cf425c0171 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:59.355614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7ea87d7-208e-4045-89ba-f0cf425c0171 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:59.356609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7ea87d7-208e-4045-89ba-f0cf425c0171 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:59.357497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7ea87d7-208e-4045-89ba-f0cf425c0171 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:59.371854 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2b20fb1f-4b06-4df0-ae16-1c6adfb331e7 req-75ad68f2-92b9-4bd9-b3bc-453122867c64 service nova] Creating event network-changed:29e2dde0-a838-4891-9d59-16f20a4969b9 for instance 646454f0-96fd-4131-9267-ed8e438556e3 on nch1-master-1 Feb 19 21:05:59.384704 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2b20fb1f-4b06-4df0-ae16-1c6adfb331e7 req-75ad68f2-92b9-4bd9-b3bc-453122867c64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055685 Feb 19 21:05:59.385985 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1767/3643] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:05:59.391351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-34c6f75f-d7d4-466d-9e97-c2b3805934fe tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:05:59.394008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-34c6f75f-d7d4-466d-9e97-c2b3805934fe tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:05:59.422955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34c6f75f-d7d4-466d-9e97-c2b3805934fe tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:59.423661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34c6f75f-d7d4-466d-9e97-c2b3805934fe tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:59.424632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34c6f75f-d7d4-466d-9e97-c2b3805934fe tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:59.426200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34c6f75f-d7d4-466d-9e97-c2b3805934fe tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:59.732417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c7ea87d7-208e-4045-89ba-f0cf425c0171 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282749d6d46245f4ad639dc22f789e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93cb84ab944db3aab11aab00da2f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:59.742462 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c7ea87d7-208e-4045-89ba-f0cf425c0171 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 200 len: 1533 microversion: 2.1 time: 0.407899 Feb 19 21:05:59.743759 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1877/3644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:59 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 1533 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:59.792849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-34c6f75f-d7d4-466d-9e97-c2b3805934fe tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:05:59.801590 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-34c6f75f-d7d4-466d-9e97-c2b3805934fe tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.414190 Feb 19 21:05:59.803087 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1768/3645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:05:59 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:05:59.906798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8856a1f5-31da-4ac8-ac50-c1ba384bcda7 req-cd136a0f-3d6f-4a14-b2a0-fe6a917e4ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa7e1f5-314f-430a-92f8-b0f1b2e15f1c", "name": "network-vif-deleted", "tag": "df7355b0-0bc1-43f9-9dc4-8218b7e68a43"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:05:59.909119 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:05:59.909119 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:05:59.924034 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8856a1f5-31da-4ac8-ac50-c1ba384bcda7 req-cd136a0f-3d6f-4a14-b2a0-fe6a917e4ca0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:05:59.925465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8856a1f5-31da-4ac8-ac50-c1ba384bcda7 req-cd136a0f-3d6f-4a14-b2a0-fe6a917e4ca0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:05:59.958812 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8856a1f5-31da-4ac8-ac50-c1ba384bcda7 req-cd136a0f-3d6f-4a14-b2a0-fe6a917e4ca0 service nova] Creating event network-vif-deleted:df7355b0-0bc1-43f9-9dc4-8218b7e68a43 for instance efa7e1f5-314f-430a-92f8-b0f1b2e15f1c on nch2-master-1 Feb 19 21:05:59.964883 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8856a1f5-31da-4ac8-ac50-c1ba384bcda7 req-cd136a0f-3d6f-4a14-b2a0-fe6a917e4ca0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061803 Feb 19 21:05:59.965850 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1878/3646] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:00.332145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:00.333179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:00.341179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:00.341958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:00.343010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:00.343451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:00.348155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-89a98a9d-59f6-431f-8122-3ec5372aad14 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:00.348995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-89a98a9d-59f6-431f-8122-3ec5372aad14 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:00.362699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89a98a9d-59f6-431f-8122-3ec5372aad14 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:00.372592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89a98a9d-59f6-431f-8122-3ec5372aad14 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:00.373611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89a98a9d-59f6-431f-8122-3ec5372aad14 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:00.374142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89a98a9d-59f6-431f-8122-3ec5372aad14 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:00.843200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:00.848071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-89a98a9d-59f6-431f-8122-3ec5372aad14 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:00.860773 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-89a98a9d-59f6-431f-8122-3ec5372aad14 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1316 microversion: 2.1 time: 0.517219 Feb 19 21:06:00.861365 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1879/3647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:00 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:00.863598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:00.866347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:00.867343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-73c41461-45f9-4698-90a4-494dd3403b83 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:00.868697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-73c41461-45f9-4698-90a4-494dd3403b83 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] [instance: efa7e1f5-314f-430a-92f8-b0f1b2e15f1c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:00.869076 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98b5eb57-0ef9-4f50-8617-b0e266a6dfbc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1796 microversion: 2.20 time: 0.541314 Feb 19 21:06:00.877402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73c41461-45f9-4698-90a4-494dd3403b83 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:00.878458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73c41461-45f9-4698-90a4-494dd3403b83 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:00.879521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73c41461-45f9-4698-90a4-494dd3403b83 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:00.880124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73c41461-45f9-4698-90a4-494dd3403b83 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:00.897006 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-73c41461-45f9-4698-90a4-494dd3403b83 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] HTTP exception thrown: Instance efa7e1f5-314f-430a-92f8-b0f1b2e15f1c could not be found. Feb 19 21:06:00.897875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-73c41461-45f9-4698-90a4-494dd3403b83 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] Returning 404 to user: Instance efa7e1f5-314f-430a-92f8-b0f1b2e15f1c could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:00.899434 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-73c41461-45f9-4698-90a4-494dd3403b83 tempest-ServersNegativeTestMultiTenantJSON-1007933490 tempest-ServersNegativeTestMultiTenantJSON-1007933490-project] 10.222.0.30 "GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c" status: 404 len: 111 microversion: 2.1 time: 0.036402 Feb 19 21:06:00.900179 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1880/3648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:00 2022] GET /compute/v2.1/servers/efa7e1f5-314f-430a-92f8-b0f1b2e15f1c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:00.906232 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1769/3649] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:06:00 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1796 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:06:00.921564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5789e6e3-762d-4d93-87ee-4afcb93bd542 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:00.924455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5789e6e3-762d-4d93-87ee-4afcb93bd542 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:00.939114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5789e6e3-762d-4d93-87ee-4afcb93bd542 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:00.939577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5789e6e3-762d-4d93-87ee-4afcb93bd542 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:00.940460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5789e6e3-762d-4d93-87ee-4afcb93bd542 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:00.940901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5789e6e3-762d-4d93-87ee-4afcb93bd542 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:01.259025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5789e6e3-762d-4d93-87ee-4afcb93bd542 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:01.271407 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5789e6e3-762d-4d93-87ee-4afcb93bd542 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.369944 Feb 19 21:06:01.272502 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1881/3650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:00 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:01.880232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d1f3813-954b-4a3a-995a-3fc644cd747f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:01.881548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2d1f3813-954b-4a3a-995a-3fc644cd747f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:01.890060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d1f3813-954b-4a3a-995a-3fc644cd747f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:01.890711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d1f3813-954b-4a3a-995a-3fc644cd747f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:01.891710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d1f3813-954b-4a3a-995a-3fc644cd747f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:01.892258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d1f3813-954b-4a3a-995a-3fc644cd747f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:02.190067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d1f3813-954b-4a3a-995a-3fc644cd747f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:02.200788 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2d1f3813-954b-4a3a-995a-3fc644cd747f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1316 microversion: 2.1 time: 0.325957 Feb 19 21:06:02.201830 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1770/3651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:01 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:02.291007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c69dff3-2864-4672-83a6-78374d315461 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:02.291636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7c69dff3-2864-4672-83a6-78374d315461 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:02.301223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c69dff3-2864-4672-83a6-78374d315461 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:02.301223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c69dff3-2864-4672-83a6-78374d315461 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:02.301430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c69dff3-2864-4672-83a6-78374d315461 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:02.301707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c69dff3-2864-4672-83a6-78374d315461 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:02.577007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7c69dff3-2864-4672-83a6-78374d315461 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:02.596826 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c69dff3-2864-4672-83a6-78374d315461 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.309536 Feb 19 21:06:02.597555 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1882/3652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:02 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:03.218913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7c3993ac-ceb5-4739-8884-ad303d43acbb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:03.218913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7c3993ac-ceb5-4739-8884-ad303d43acbb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:03.226894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c3993ac-ceb5-4739-8884-ad303d43acbb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:03.227849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c3993ac-ceb5-4739-8884-ad303d43acbb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:03.228797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c3993ac-ceb5-4739-8884-ad303d43acbb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:03.229282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c3993ac-ceb5-4739-8884-ad303d43acbb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:03.606373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7c3993ac-ceb5-4739-8884-ad303d43acbb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:03.617457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-872faec2-bc90-4225-9532-e3be5d33d72b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:03.618150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-872faec2-bc90-4225-9532-e3be5d33d72b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:03.628750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-872faec2-bc90-4225-9532-e3be5d33d72b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:03.629351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-872faec2-bc90-4225-9532-e3be5d33d72b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:03.630701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-872faec2-bc90-4225-9532-e3be5d33d72b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:03.631141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-872faec2-bc90-4225-9532-e3be5d33d72b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:03.646401 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7c3993ac-ceb5-4739-8884-ad303d43acbb tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1316 microversion: 2.1 time: 0.430912 Feb 19 21:06:03.656737 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1771/3653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:03 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:03.848507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-872faec2-bc90-4225-9532-e3be5d33d72b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:03.857791 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-872faec2-bc90-4225-9532-e3be5d33d72b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.245130 Feb 19 21:06:03.858994 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1883/3654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:03 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:04.551145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d19fc155-6634-464d-9793-903d2f1859a6 req-25f8b95d-089b-40fd-83af-d05caf86f11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646454f0-96fd-4131-9267-ed8e438556e3", "name": "network-vif-plugged", "status": "completed", "tag": "29e2dde0-a838-4891-9d59-16f20a4969b9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:04.552829 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:04.552829 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:04.564318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d19fc155-6634-464d-9793-903d2f1859a6 req-25f8b95d-089b-40fd-83af-d05caf86f11b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:04.565346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d19fc155-6634-464d-9793-903d2f1859a6 req-25f8b95d-089b-40fd-83af-d05caf86f11b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:04.580155 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d19fc155-6634-464d-9793-903d2f1859a6 req-25f8b95d-089b-40fd-83af-d05caf86f11b service nova] Creating event network-vif-plugged:29e2dde0-a838-4891-9d59-16f20a4969b9 for instance 646454f0-96fd-4131-9267-ed8e438556e3 on nch1-master-1 Feb 19 21:06:04.585417 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d19fc155-6634-464d-9793-903d2f1859a6 req-25f8b95d-089b-40fd-83af-d05caf86f11b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038731 Feb 19 21:06:04.586214 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1772/3655] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:04.665032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6cf88bed-05ad-44ac-a006-7e5b2e610146 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:04.666539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6cf88bed-05ad-44ac-a006-7e5b2e610146 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:04.675845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cf88bed-05ad-44ac-a006-7e5b2e610146 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:04.676310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cf88bed-05ad-44ac-a006-7e5b2e610146 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:04.677138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cf88bed-05ad-44ac-a006-7e5b2e610146 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:04.677580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cf88bed-05ad-44ac-a006-7e5b2e610146 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:04.888583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8111df6d-449d-4a90-81b2-817d503c8b84 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:04.889683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8111df6d-449d-4a90-81b2-817d503c8b84 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:04.901739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8111df6d-449d-4a90-81b2-817d503c8b84 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:04.903446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8111df6d-449d-4a90-81b2-817d503c8b84 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:04.908589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8111df6d-449d-4a90-81b2-817d503c8b84 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:04.910235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8111df6d-449d-4a90-81b2-817d503c8b84 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:04.972978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6cf88bed-05ad-44ac-a006-7e5b2e610146 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:04.982075 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6cf88bed-05ad-44ac-a006-7e5b2e610146 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1316 microversion: 2.1 time: 0.321509 Feb 19 21:06:04.993090 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1884/3656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:04 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:05.232417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8111df6d-449d-4a90-81b2-817d503c8b84 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:05.240012 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8111df6d-449d-4a90-81b2-817d503c8b84 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.361579 Feb 19 21:06:05.243515 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1773/3657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:04 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:05.999031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-47595f63-f7e6-4014-b3cc-dc46fa927085 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:06.000286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-47595f63-f7e6-4014-b3cc-dc46fa927085 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:06.008912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47595f63-f7e6-4014-b3cc-dc46fa927085 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:06.009547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47595f63-f7e6-4014-b3cc-dc46fa927085 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:06.010592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47595f63-f7e6-4014-b3cc-dc46fa927085 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:06.011253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47595f63-f7e6-4014-b3cc-dc46fa927085 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:06.262224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce29a62c-05b7-487e-be55-7a695fe176ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:06.263783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ce29a62c-05b7-487e-be55-7a695fe176ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:06.271901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce29a62c-05b7-487e-be55-7a695fe176ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:06.272973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce29a62c-05b7-487e-be55-7a695fe176ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:06.276586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce29a62c-05b7-487e-be55-7a695fe176ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:06.277411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce29a62c-05b7-487e-be55-7a695fe176ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:06.433844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-47595f63-f7e6-4014-b3cc-dc46fa927085 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:06.459421 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-47595f63-f7e6-4014-b3cc-dc46fa927085 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1316 microversion: 2.1 time: 0.463433 Feb 19 21:06:06.461884 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1885/3658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:05 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:06.612486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ce29a62c-05b7-487e-be55-7a695fe176ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:06.621150 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ce29a62c-05b7-487e-be55-7a695fe176ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.363270 Feb 19 21:06:06.622464 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1774/3659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:06 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:07.481813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e9556b6d-b4ff-4472-b37f-08b1a3fa4f68 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:07.483045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e9556b6d-b4ff-4472-b37f-08b1a3fa4f68 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:07.490362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9556b6d-b4ff-4472-b37f-08b1a3fa4f68 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:07.491303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9556b6d-b4ff-4472-b37f-08b1a3fa4f68 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:07.492276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9556b6d-b4ff-4472-b37f-08b1a3fa4f68 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:07.492929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9556b6d-b4ff-4472-b37f-08b1a3fa4f68 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:07.640191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-933b331e-b813-4046-9a40-3bd5abc3538d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:07.641770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-933b331e-b813-4046-9a40-3bd5abc3538d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:07.652220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-933b331e-b813-4046-9a40-3bd5abc3538d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:07.652896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-933b331e-b813-4046-9a40-3bd5abc3538d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:07.653885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-933b331e-b813-4046-9a40-3bd5abc3538d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:07.654502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-933b331e-b813-4046-9a40-3bd5abc3538d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:07.807943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e9556b6d-b4ff-4472-b37f-08b1a3fa4f68 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:07.830117 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e9556b6d-b4ff-4472-b37f-08b1a3fa4f68 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1504 microversion: 2.1 time: 0.352090 Feb 19 21:06:07.832199 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1886/3660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:07 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1504 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:07.852868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-931ba0c2-569f-4700-976f-241df7cde231 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-293704867"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:07.853874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-931ba0c2-569f-4700-976f-241df7cde231 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:07.863231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-931ba0c2-569f-4700-976f-241df7cde231 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:07.864466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-931ba0c2-569f-4700-976f-241df7cde231 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:07.867247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-931ba0c2-569f-4700-976f-241df7cde231 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:07.868561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-931ba0c2-569f-4700-976f-241df7cde231 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:08.126744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-933b331e-b813-4046-9a40-3bd5abc3538d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:08.137630 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-933b331e-b813-4046-9a40-3bd5abc3538d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.501525 Feb 19 21:06:08.150625 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1775/3661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:07 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:08.288208 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.network.security_group_api [None req-931ba0c2-569f-4700-976f-241df7cde231 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Adding security group eee05f67-78e3-474c-8d12-b46bf13bf3c8 to port 29e2dde0-a838-4891-9d59-16f20a4969b9 Feb 19 21:06:08.670866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f46aeeb-2d06-42d5-b445-eecfd11ce51d tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:08.671406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f46aeeb-2d06-42d5-b445-eecfd11ce51d tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:08.689555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f46aeeb-2d06-42d5-b445-eecfd11ce51d tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:08.690010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f46aeeb-2d06-42d5-b445-eecfd11ce51d tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:08.690816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f46aeeb-2d06-42d5-b445-eecfd11ce51d tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:08.691255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f46aeeb-2d06-42d5-b445-eecfd11ce51d tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:08.755875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f46aeeb-2d06-42d5-b445-eecfd11ce51d tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:06:08.931524 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8f46aeeb-2d06-42d5-b445-eecfd11ce51d tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 204 len: 0 microversion: 2.1 time: 0.259511 Feb 19 21:06:08.933971 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1776/3662] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:06:08 2022] DELETE /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:06:08.953194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57086be0-f79b-4d78-8365-3526d2e34ae4 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:08.956009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57086be0-f79b-4d78-8365-3526d2e34ae4 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:08.970181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57086be0-f79b-4d78-8365-3526d2e34ae4 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:08.971641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57086be0-f79b-4d78-8365-3526d2e34ae4 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:08.973714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57086be0-f79b-4d78-8365-3526d2e34ae4 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:08.974746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57086be0-f79b-4d78-8365-3526d2e34ae4 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:09.383453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-57086be0-f79b-4d78-8365-3526d2e34ae4 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:09.396492 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57086be0-f79b-4d78-8365-3526d2e34ae4 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1664 microversion: 2.1 time: 0.456464 Feb 19 21:06:09.418809 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1777/3663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:08 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1664 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:09.418809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ab1237d6-83cf-4a60-b4ed-e64279d17df6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:09.418809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ab1237d6-83cf-4a60-b4ed-e64279d17df6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:09.431899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab1237d6-83cf-4a60-b4ed-e64279d17df6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:09.443242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab1237d6-83cf-4a60-b4ed-e64279d17df6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:09.443242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab1237d6-83cf-4a60-b4ed-e64279d17df6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:09.443242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab1237d6-83cf-4a60-b4ed-e64279d17df6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:09.543667 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-931ba0c2-569f-4700-976f-241df7cde231 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3/action" status: 202 len: 0 microversion: 2.1 time: 1.696132 Feb 19 21:06:09.544939 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1887/3664] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:06:07 2022] POST /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3/action => generated 0 bytes in 1698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:09.554131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1158c82d-0b79-413f-b4af-3e65d8e03e04 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f647907dca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:10.248216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ab1237d6-83cf-4a60-b4ed-e64279d17df6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:10.255925 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ab1237d6-83cf-4a60-b4ed-e64279d17df6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.846634 Feb 19 21:06:10.264061 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1778/3665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:09 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:10.269241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5d921a44-79ec-4b06-84b2-73a7c850dc6f req-02f135c4-3e75-451f-ad5b-6c299f162687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646454f0-96fd-4131-9267-ed8e438556e3", "tag": "29e2dde0-a838-4891-9d59-16f20a4969b9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:10.274402 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:10.274402 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:10.280345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG neutronclient.v2_0.client [None req-1158c82d-0b79-413f-b4af-3e65d8e03e04 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group eee05f67-78e3-474c-8d12-b46bf13bf3c8 in use.", "detail": ""}} {{(pid=136094) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:06:10.281263 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-1158c82d-0b79-413f-b4af-3e65d8e03e04 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security Group eee05f67-78e3-474c-8d12-b46bf13bf3c8 in use. Feb 19 21:06:10.281263 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-a44f0fd9-7923-4bbf-87fb-1166bece53ae'] Feb 19 21:06:10.282112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1158c82d-0b79-413f-b4af-3e65d8e03e04 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 400 to user: Security Group eee05f67-78e3-474c-8d12-b46bf13bf3c8 in use. Feb 19 21:06:10.282112 ncdv-master-1 devstack@n-api.service[136094]: Neutron server returns request_ids: ['req-a44f0fd9-7923-4bbf-87fb-1166bece53ae'] {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:10.283229 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1158c82d-0b79-413f-b4af-3e65d8e03e04 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/eee05f67-78e3-474c-8d12-b46bf13bf3c8" status: 400 len: 185 microversion: 2.1 time: 0.733707 Feb 19 21:06:10.283949 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1888/3666] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:09 2022] DELETE /compute/v2.1/os-security-groups/eee05f67-78e3-474c-8d12-b46bf13bf3c8 => generated 185 bytes in 735 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 19 21:06:10.292567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5862c2b1-d325-4cb9-a60e-a6b93b66d039 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:10.292845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5d921a44-79ec-4b06-84b2-73a7c850dc6f req-02f135c4-3e75-451f-ad5b-6c299f162687 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:10.293078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5d921a44-79ec-4b06-84b2-73a7c850dc6f req-02f135c4-3e75-451f-ad5b-6c299f162687 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:10.295335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5862c2b1-d325-4cb9-a60e-a6b93b66d039 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:10.308933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5862c2b1-d325-4cb9-a60e-a6b93b66d039 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:10.311023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5862c2b1-d325-4cb9-a60e-a6b93b66d039 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:10.317259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5862c2b1-d325-4cb9-a60e-a6b93b66d039 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:10.318102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5862c2b1-d325-4cb9-a60e-a6b93b66d039 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:10.335774 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5d921a44-79ec-4b06-84b2-73a7c850dc6f req-02f135c4-3e75-451f-ad5b-6c299f162687 service nova] Creating event network-changed:29e2dde0-a838-4891-9d59-16f20a4969b9 for instance 646454f0-96fd-4131-9267-ed8e438556e3 on nch1-master-1 Feb 19 21:06:10.342905 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5d921a44-79ec-4b06-84b2-73a7c850dc6f req-02f135c4-3e75-451f-ad5b-6c299f162687 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077188 Feb 19 21:06:10.348096 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1779/3667] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:10.427117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-805ff3f3-5963-48a7-b9c4-5bceeab1d5c7 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:10.427757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-805ff3f3-5963-48a7-b9c4-5bceeab1d5c7 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:10.450865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-805ff3f3-5963-48a7-b9c4-5bceeab1d5c7 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:10.451323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-805ff3f3-5963-48a7-b9c4-5bceeab1d5c7 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:10.452154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-805ff3f3-5963-48a7-b9c4-5bceeab1d5c7 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:10.452701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-805ff3f3-5963-48a7-b9c4-5bceeab1d5c7 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:10.562019 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5862c2b1-d325-4cb9-a60e-a6b93b66d039 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3/action" status: 202 len: 0 microversion: 2.1 time: 0.271789 Feb 19 21:06:10.565937 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1889/3668] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:06:10 2022] POST /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:10.580460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b3caa7d0-da55-446f-9e51-d3de12bb5e38 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:10.581645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b3caa7d0-da55-446f-9e51-d3de12bb5e38 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:10.603250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3caa7d0-da55-446f-9e51-d3de12bb5e38 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:10.603897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3caa7d0-da55-446f-9e51-d3de12bb5e38 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:10.605494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3caa7d0-da55-446f-9e51-d3de12bb5e38 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:10.606289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3caa7d0-da55-446f-9e51-d3de12bb5e38 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:10.968460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-805ff3f3-5963-48a7-b9c4-5bceeab1d5c7 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:10.986105 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-805ff3f3-5963-48a7-b9c4-5bceeab1d5c7 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1664 microversion: 2.1 time: 0.562387 Feb 19 21:06:10.999467 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1780/3669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:10 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1664 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:11.162289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b3caa7d0-da55-446f-9e51-d3de12bb5e38 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:11.179901 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b3caa7d0-da55-446f-9e51-d3de12bb5e38 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1574 microversion: 2.1 time: 0.610032 Feb 19 21:06:11.180819 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1890/3670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:10 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1574 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:11.236643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e50f9abc-5987-4145-8460-b18ea6be745f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'create', calling method: .version_select at 0x7f6467a84160>, body: {"keypair": {"name": "tempest-keypair-1065561836"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:11.265688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e50f9abc-5987-4145-8460-b18ea6be745f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for project adecc012aca243138d03c189f5623f73. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:06:11.273381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e50f9abc-5987-4145-8460-b18ea6be745f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for user 7132cae4ebd549d491f5d0dcf83394ed and project adecc012aca243138d03c189f5623f73. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:06:11.281620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5c21bf29-77f5-4f19-84a3-49e4bdd5bd3d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:11.282530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5c21bf29-77f5-4f19-84a3-49e4bdd5bd3d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:11.295522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c21bf29-77f5-4f19-84a3-49e4bdd5bd3d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:11.298501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c21bf29-77f5-4f19-84a3-49e4bdd5bd3d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:11.299578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c21bf29-77f5-4f19-84a3-49e4bdd5bd3d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:11.304117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c21bf29-77f5-4f19-84a3-49e4bdd5bd3d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:11.762164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e50f9abc-5987-4145-8460-b18ea6be745f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for project adecc012aca243138d03c189f5623f73. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:06:11.769490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e50f9abc-5987-4145-8460-b18ea6be745f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for user 7132cae4ebd549d491f5d0dcf83394ed and project adecc012aca243138d03c189f5623f73. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:06:11.786458 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e50f9abc-5987-4145-8460-b18ea6be745f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.785286 Feb 19 21:06:11.787561 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1781/3671] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:06:10 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:12.006721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c1b54a35-35df-4790-82ab-ef0b215acebb tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:12.007737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c1b54a35-35df-4790-82ab-ef0b215acebb tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:12.016849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1b54a35-35df-4790-82ab-ef0b215acebb tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:12.017700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1b54a35-35df-4790-82ab-ef0b215acebb tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:12.018762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1b54a35-35df-4790-82ab-ef0b215acebb tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:12.019519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1b54a35-35df-4790-82ab-ef0b215acebb tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:12.027741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5c21bf29-77f5-4f19-84a3-49e4bdd5bd3d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:12.049184 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5c21bf29-77f5-4f19-84a3-49e4bdd5bd3d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1533 microversion: 2.1 time: 0.766568 Feb 19 21:06:12.049866 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1891/3672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:11 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1533 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:12.202324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-518433ff-8577-4bc5-9981-146716c1ca9e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:12.207327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-518433ff-8577-4bc5-9981-146716c1ca9e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:12.281762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-518433ff-8577-4bc5-9981-146716c1ca9e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:12.288270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-518433ff-8577-4bc5-9981-146716c1ca9e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:12.290437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-518433ff-8577-4bc5-9981-146716c1ca9e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:12.292783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-518433ff-8577-4bc5-9981-146716c1ca9e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:13.055155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c1b54a35-35df-4790-82ab-ef0b215acebb tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ce7bfa9c454b3389ec787812495827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e59ada015584cc6b980ae55cedc2103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:13.067224 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c1b54a35-35df-4790-82ab-ef0b215acebb tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 200 len: 1597 microversion: 2.1 time: 1.064255 Feb 19 21:06:13.068043 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1782/3673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:12 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 1597 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:13.083040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4540f09d-3e60-4cad-a969-c016934c6ceb req-8ba95834-cb6c-4b15-aab4-4599b1ee2bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3addd2f6-24e1-4826-8f84-14355a67d407", "name": "network-vif-deleted", "tag": "0f4a2e1e-4de3-4838-87c6-24936b87de02"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:13.099099 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:13.099099 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:13.116229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4540f09d-3e60-4cad-a969-c016934c6ceb req-8ba95834-cb6c-4b15-aab4-4599b1ee2bda service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:13.118929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4540f09d-3e60-4cad-a969-c016934c6ceb req-8ba95834-cb6c-4b15-aab4-4599b1ee2bda service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:13.138910 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4540f09d-3e60-4cad-a969-c016934c6ceb req-8ba95834-cb6c-4b15-aab4-4599b1ee2bda service nova] Creating event network-vif-deleted:0f4a2e1e-4de3-4838-87c6-24936b87de02 for instance 3addd2f6-24e1-4826-8f84-14355a67d407 on nch2-master-1 Feb 19 21:06:13.156910 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4540f09d-3e60-4cad-a969-c016934c6ceb req-8ba95834-cb6c-4b15-aab4-4599b1ee2bda service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082666 Feb 19 21:06:13.160248 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1783/3674] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:13.170292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0dc4fad2-533a-4869-82dc-c8dac9cec298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:13.175843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0dc4fad2-533a-4869-82dc-c8dac9cec298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:13.194690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0dc4fad2-533a-4869-82dc-c8dac9cec298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:13.196099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0dc4fad2-533a-4869-82dc-c8dac9cec298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:13.198879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0dc4fad2-533a-4869-82dc-c8dac9cec298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:13.205097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0dc4fad2-533a-4869-82dc-c8dac9cec298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:13.840420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-518433ff-8577-4bc5-9981-146716c1ca9e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:13.851932 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-518433ff-8577-4bc5-9981-146716c1ca9e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1574 microversion: 2.1 time: 1.657396 Feb 19 21:06:13.854552 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1892/3675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:12 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1574 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:14.042221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0dc4fad2-533a-4869-82dc-c8dac9cec298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:14.053280 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0dc4fad2-533a-4869-82dc-c8dac9cec298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.891456 Feb 19 21:06:14.053896 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1784/3676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:13 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:14.086657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d6671abf-beb3-4da8-94a3-ede8ee40b537 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:14.087847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d6671abf-beb3-4da8-94a3-ede8ee40b537 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] [instance: 3addd2f6-24e1-4826-8f84-14355a67d407] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:14.095458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6671abf-beb3-4da8-94a3-ede8ee40b537 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:14.097808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6671abf-beb3-4da8-94a3-ede8ee40b537 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:14.098999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6671abf-beb3-4da8-94a3-ede8ee40b537 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:14.102498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6671abf-beb3-4da8-94a3-ede8ee40b537 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:14.128123 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-d6671abf-beb3-4da8-94a3-ede8ee40b537 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] HTTP exception thrown: Instance 3addd2f6-24e1-4826-8f84-14355a67d407 could not be found. Feb 19 21:06:14.135438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d6671abf-beb3-4da8-94a3-ede8ee40b537 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Returning 404 to user: Instance 3addd2f6-24e1-4826-8f84-14355a67d407 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:14.136866 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d6671abf-beb3-4da8-94a3-ede8ee40b537 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407" status: 404 len: 111 microversion: 2.1 time: 0.055759 Feb 19 21:06:14.138003 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1893/3677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:14 2022] GET /compute/v2.1/servers/3addd2f6-24e1-4826-8f84-14355a67d407 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:06:14.155490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a780d14-d9fe-4ab7-9a3a-798139ae0f57 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] Calling method '.version_select at 0x7f64674b4790>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:14.193519 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1a780d14-d9fe-4ab7-9a3a-798139ae0f57 tempest-ServersTestFqdnHostnames-945175054 tempest-ServersTestFqdnHostnames-945175054-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194059251" status: 202 len: 0 microversion: 2.1 time: 0.049692 Feb 19 21:06:14.194929 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1785/3678] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 21:06:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194059251 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:14.471646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-514093632", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "813ad1c1-0059-4a59-91cb-1222ec1b44c2"}], "security_groups": [{"name": "tempest-securitygroup--996462487"}], "key_name": "tempest-keypair-1065561836", "user_data": "}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:14.839901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] validate_networks() for [('813ad1c1-0059-4a59-91cb-1222ec1b44c2', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:06:14.871646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-429a4326-9d0c-4624-b0e0-39feb90315f2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:14.872302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-429a4326-9d0c-4624-b0e0-39feb90315f2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:14.882119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-429a4326-9d0c-4624-b0e0-39feb90315f2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:14.886711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-429a4326-9d0c-4624-b0e0-39feb90315f2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:14.888320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-429a4326-9d0c-4624-b0e0-39feb90315f2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:14.888962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-429a4326-9d0c-4624-b0e0-39feb90315f2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:15.769871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-429a4326-9d0c-4624-b0e0-39feb90315f2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:15.783344 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-429a4326-9d0c-4624-b0e0-39feb90315f2 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1579 microversion: 2.1 time: 0.912842 Feb 19 21:06:15.784135 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1786/3679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:14 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1579 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:15.797002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6c320338-9ff1-492a-b48c-3121afa3209e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:15.797878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6c320338-9ff1-492a-b48c-3121afa3209e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:15.804608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c320338-9ff1-492a-b48c-3121afa3209e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:15.805884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c320338-9ff1-492a-b48c-3121afa3209e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:15.806870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c320338-9ff1-492a-b48c-3121afa3209e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:15.807466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c320338-9ff1-492a-b48c-3121afa3209e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:16.274548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:06:16.275575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:06:16.276246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:06:16.276900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:06:16.277474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:06:16.296389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:16.298202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:16.300144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:16.300949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:16.341321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for project adecc012aca243138d03c189f5623f73. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:06:16.352061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for user 7132cae4ebd549d491f5d0dcf83394ed and project adecc012aca243138d03c189f5623f73. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:06:16.355289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6c320338-9ff1-492a-b48c-3121afa3209e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:16.373397 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6c320338-9ff1-492a-b48c-3121afa3209e tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.578594 Feb 19 21:06:16.374178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:06:16.380354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:06:16.388137 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1787/3680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:15 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:16.579448 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a8b44fc-2b17-4f05-b43d-556cd51f4559 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.102813 Feb 19 21:06:16.586939 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1894/3681] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:06:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:06:16.608534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4dc11e7d-3bf0-4020-91a1-d9a043863bbd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:16.610607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d66ec2c1-2af6-4ce1-bb85-80fdb1332977 req-c0830e39-33cb-42f6-a8dd-8f9d54f8651c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63482c29-4a39-4eaa-9bf1-de6107d9b0f0", "name": "network-vif-plugged", "status": "completed", "tag": "a943b989-5a95-44a3-9a78-35384327a397"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:16.612624 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:16.612624 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:16.614742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4dc11e7d-3bf0-4020-91a1-d9a043863bbd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:16.641206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d66ec2c1-2af6-4ce1-bb85-80fdb1332977 req-c0830e39-33cb-42f6-a8dd-8f9d54f8651c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:16.643750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d66ec2c1-2af6-4ce1-bb85-80fdb1332977 req-c0830e39-33cb-42f6-a8dd-8f9d54f8651c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:16.708314 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d66ec2c1-2af6-4ce1-bb85-80fdb1332977 req-c0830e39-33cb-42f6-a8dd-8f9d54f8651c service nova] Creating event network-vif-plugged:a943b989-5a95-44a3-9a78-35384327a397 for instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 on nch1-master-1 Feb 19 21:06:16.734625 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d66ec2c1-2af6-4ce1-bb85-80fdb1332977 req-c0830e39-33cb-42f6-a8dd-8f9d54f8651c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337035 Feb 19 21:06:16.747673 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1788/3682] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:16.804585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-994e8558-a67e-4a8c-b58a-a50546e50fa4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:16.806661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-994e8558-a67e-4a8c-b58a-a50546e50fa4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:16.846194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-994e8558-a67e-4a8c-b58a-a50546e50fa4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:16.849361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-994e8558-a67e-4a8c-b58a-a50546e50fa4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:16.853105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-994e8558-a67e-4a8c-b58a-a50546e50fa4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:16.868231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-994e8558-a67e-4a8c-b58a-a50546e50fa4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:17.328939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4dc11e7d-3bf0-4020-91a1-d9a043863bbd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:17.338345 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4dc11e7d-3bf0-4020-91a1-d9a043863bbd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1237 microversion: 2.1 time: 0.749303 Feb 19 21:06:17.343841 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1895/3683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:16 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1237 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:17.393772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-017b82ed-4042-43ee-a67f-b6201be4a563 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:17.394394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-017b82ed-4042-43ee-a67f-b6201be4a563 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:17.455365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-017b82ed-4042-43ee-a67f-b6201be4a563 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:17.456060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-017b82ed-4042-43ee-a67f-b6201be4a563 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:17.457405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-017b82ed-4042-43ee-a67f-b6201be4a563 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:17.458199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-017b82ed-4042-43ee-a67f-b6201be4a563 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:17.628975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-994e8558-a67e-4a8c-b58a-a50546e50fa4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:17.637523 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-994e8558-a67e-4a8c-b58a-a50546e50fa4 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1572 microversion: 2.1 time: 0.837879 Feb 19 21:06:17.642463 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1789/3684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:16 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1572 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:17.663886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7a5df805-220d-43b4-811d-5e14c6ce857f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1565333646"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:17.665437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7a5df805-220d-43b4-811d-5e14c6ce857f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:17.683921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a5df805-220d-43b4-811d-5e14c6ce857f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:17.685984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a5df805-220d-43b4-811d-5e14c6ce857f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:17.687339 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a5df805-220d-43b4-811d-5e14c6ce857f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:17.689844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a5df805-220d-43b4-811d-5e14c6ce857f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:18.143533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-017b82ed-4042-43ee-a67f-b6201be4a563 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:18.162929 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-017b82ed-4042-43ee-a67f-b6201be4a563 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.773085 Feb 19 21:06:18.164714 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1896/3685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:17 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:18.322908 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.network.security_group_api [None req-7a5df805-220d-43b4-811d-5e14c6ce857f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Adding security group d1dd8625-f661-4158-81f9-48a14f9cabe7 to port 29e2dde0-a838-4891-9d59-16f20a4969b9 Feb 19 21:06:18.363628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-024f0323-2ca8-48c6-af3a-c7c7bfa84abc tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:18.364247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-024f0323-2ca8-48c6-af3a-c7c7bfa84abc tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:18.375940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-024f0323-2ca8-48c6-af3a-c7c7bfa84abc tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:18.376420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-024f0323-2ca8-48c6-af3a-c7c7bfa84abc tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:18.377226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-024f0323-2ca8-48c6-af3a-c7c7bfa84abc tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:18.377663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-024f0323-2ca8-48c6-af3a-c7c7bfa84abc tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:18.828384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-024f0323-2ca8-48c6-af3a-c7c7bfa84abc tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:18.840972 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-024f0323-2ca8-48c6-af3a-c7c7bfa84abc tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1289 microversion: 2.1 time: 0.481093 Feb 19 21:06:18.843632 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1897/3686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:18 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1289 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:19.191446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7ed8e2af-72bd-440e-931d-66e59991fb09 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:19.193118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7ed8e2af-72bd-440e-931d-66e59991fb09 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:19.219177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ed8e2af-72bd-440e-931d-66e59991fb09 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:19.219965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ed8e2af-72bd-440e-931d-66e59991fb09 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:19.221322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ed8e2af-72bd-440e-931d-66e59991fb09 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:19.222074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ed8e2af-72bd-440e-931d-66e59991fb09 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:19.617866 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7a5df805-220d-43b4-811d-5e14c6ce857f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3/action" status: 202 len: 0 microversion: 2.1 time: 1.957933 Feb 19 21:06:19.622541 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1790/3687] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:06:17 2022] POST /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3/action => generated 0 bytes in 1961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:06:19.635059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-54f7f471-edfd-4e17-9f37-bbf09677c03c tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674de310>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:20.370403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7ed8e2af-72bd-440e-931d-66e59991fb09 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:20.415978 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7ed8e2af-72bd-440e-931d-66e59991fb09 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 1.225106 Feb 19 21:06:20.418151 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1898/3688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:19 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:20.458599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-830873a5-5bdf-4840-b9ec-6a5a4057ad84 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:20.460713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-830873a5-5bdf-4840-b9ec-6a5a4057ad84 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:20.479406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-830873a5-5bdf-4840-b9ec-6a5a4057ad84 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:20.480487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-830873a5-5bdf-4840-b9ec-6a5a4057ad84 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:20.481766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-830873a5-5bdf-4840-b9ec-6a5a4057ad84 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:20.482440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-830873a5-5bdf-4840-b9ec-6a5a4057ad84 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:20.694714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-830873a5-5bdf-4840-b9ec-6a5a4057ad84 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:20.707275 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-830873a5-5bdf-4840-b9ec-6a5a4057ad84 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1295 microversion: 2.1 time: 0.287323 Feb 19 21:06:20.707891 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1899/3689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:20 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1295 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:20.743418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f8403f8d-e85b-4931-a034-aa5dcefb6bea req-f657b736-4b9e-4815-87aa-85089661bc96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646454f0-96fd-4131-9267-ed8e438556e3", "tag": "29e2dde0-a838-4891-9d59-16f20a4969b9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:20.745283 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:20.745283 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:06:20.766568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f8403f8d-e85b-4931-a034-aa5dcefb6bea req-f657b736-4b9e-4815-87aa-85089661bc96 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:20.771323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f8403f8d-e85b-4931-a034-aa5dcefb6bea req-f657b736-4b9e-4815-87aa-85089661bc96 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:20.813021 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f8403f8d-e85b-4931-a034-aa5dcefb6bea req-f657b736-4b9e-4815-87aa-85089661bc96 service nova] Creating event network-changed:29e2dde0-a838-4891-9d59-16f20a4969b9 for instance 646454f0-96fd-4131-9267-ed8e438556e3 on nch1-master-1 Feb 19 21:06:20.831881 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f8403f8d-e85b-4931-a034-aa5dcefb6bea req-f657b736-4b9e-4815-87aa-85089661bc96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122688 Feb 19 21:06:20.832941 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1900/3690] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:21.046628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-54f7f471-edfd-4e17-9f37-bbf09677c03c tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d1dd8625-f661-4158-81f9-48a14f9cabe7 in use.", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:06:21.047532 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-54f7f471-edfd-4e17-9f37-bbf09677c03c tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security Group d1dd8625-f661-4158-81f9-48a14f9cabe7 in use. Feb 19 21:06:21.047532 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-f0694cf8-d7eb-478d-891d-e206a704097c'] Feb 19 21:06:21.048393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-54f7f471-edfd-4e17-9f37-bbf09677c03c tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 400 to user: Security Group d1dd8625-f661-4158-81f9-48a14f9cabe7 in use. Feb 19 21:06:21.048393 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-f0694cf8-d7eb-478d-891d-e206a704097c'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:21.049704 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-54f7f471-edfd-4e17-9f37-bbf09677c03c tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d1dd8625-f661-4158-81f9-48a14f9cabe7" status: 400 len: 185 microversion: 2.1 time: 1.423806 Feb 19 21:06:21.051670 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1791/3691] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:19 2022] DELETE /compute/v2.1/os-security-groups/d1dd8625-f661-4158-81f9-48a14f9cabe7 => generated 185 bytes in 1429 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:06:21.061906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bd938eed-8681-423b-96b3-4012fda69e94 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:21.062573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bd938eed-8681-423b-96b3-4012fda69e94 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:21.074256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd938eed-8681-423b-96b3-4012fda69e94 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:21.074991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd938eed-8681-423b-96b3-4012fda69e94 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:21.076212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd938eed-8681-423b-96b3-4012fda69e94 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:21.078098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd938eed-8681-423b-96b3-4012fda69e94 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:21.126352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bd938eed-8681-423b-96b3-4012fda69e94 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:06:21.308120 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bd938eed-8681-423b-96b3-4012fda69e94 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 204 len: 0 microversion: 2.1 time: 0.251682 Feb 19 21:06:21.309211 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1901/3692] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:06:21 2022] DELETE /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:06:21.365351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cfbb89a5-6f00-4409-a57a-534af83a0e5e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:21.365351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cfbb89a5-6f00-4409-a57a-534af83a0e5e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:21.365351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfbb89a5-6f00-4409-a57a-534af83a0e5e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:21.365351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfbb89a5-6f00-4409-a57a-534af83a0e5e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:21.365351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfbb89a5-6f00-4409-a57a-534af83a0e5e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:21.365351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfbb89a5-6f00-4409-a57a-534af83a0e5e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:21.435694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f2bf115e-cd63-4579-b54e-9fc4ecbe8cbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:21.437750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f2bf115e-cd63-4579-b54e-9fc4ecbe8cbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:21.448613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2bf115e-cd63-4579-b54e-9fc4ecbe8cbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:21.451409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2bf115e-cd63-4579-b54e-9fc4ecbe8cbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:21.457335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2bf115e-cd63-4579-b54e-9fc4ecbe8cbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:21.458601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2bf115e-cd63-4579-b54e-9fc4ecbe8cbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:22.590835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cfbb89a5-6f00-4409-a57a-534af83a0e5e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:22.600466 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cfbb89a5-6f00-4409-a57a-534af83a0e5e tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1647 microversion: 2.1 time: 1.281756 Feb 19 21:06:22.608097 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1792/3693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:21 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1647 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:22.625362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f90b994-322a-4177-a681-464c6b9a2048 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:22.626328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f90b994-322a-4177-a681-464c6b9a2048 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:22.640230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f90b994-322a-4177-a681-464c6b9a2048 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:22.645436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f90b994-322a-4177-a681-464c6b9a2048 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:22.646641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f90b994-322a-4177-a681-464c6b9a2048 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:22.647927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f90b994-322a-4177-a681-464c6b9a2048 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:22.855454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f2bf115e-cd63-4579-b54e-9fc4ecbe8cbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:22.875162 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f2bf115e-cd63-4579-b54e-9fc4ecbe8cbd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 1.443597 Feb 19 21:06:22.889927 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1902/3694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:21 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:23.628884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a22c81ba-9a82-4969-9aeb-0b7e31218d76 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:23.630169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a22c81ba-9a82-4969-9aeb-0b7e31218d76 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:23.643285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a22c81ba-9a82-4969-9aeb-0b7e31218d76 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:23.647619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a22c81ba-9a82-4969-9aeb-0b7e31218d76 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:23.653202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a22c81ba-9a82-4969-9aeb-0b7e31218d76 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:23.653932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a22c81ba-9a82-4969-9aeb-0b7e31218d76 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:24.050889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f90b994-322a-4177-a681-464c6b9a2048 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:24.062851 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f90b994-322a-4177-a681-464c6b9a2048 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1362 microversion: 2.1 time: 1.453013 Feb 19 21:06:24.072021 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1793/3695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:22 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1362 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:24.093129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7dec3421-c5db-4614-885e-eeb92a484d06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:24.094367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7dec3421-c5db-4614-885e-eeb92a484d06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:24.113253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dec3421-c5db-4614-885e-eeb92a484d06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:24.115461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dec3421-c5db-4614-885e-eeb92a484d06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:24.118287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dec3421-c5db-4614-885e-eeb92a484d06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:24.119208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7dec3421-c5db-4614-885e-eeb92a484d06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:24.387680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a22c81ba-9a82-4969-9aeb-0b7e31218d76 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:24.396287 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a22c81ba-9a82-4969-9aeb-0b7e31218d76 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1647 microversion: 2.1 time: 0.771918 Feb 19 21:06:24.402408 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1903/3696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:23 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1647 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:24.487862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1e45c24c-959c-40ee-893a-97c2acca85ef req-21bf3fba-d86d-42a0-a884-7d338c999c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc97c9dc-bc47-4884-b42e-fa373a918258", "tag": "60b74908-1902-4216-8619-32cd92b10359"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:24.491485 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:24.491485 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:06:24.529179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1e45c24c-959c-40ee-893a-97c2acca85ef req-21bf3fba-d86d-42a0-a884-7d338c999c73 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:24.532470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1e45c24c-959c-40ee-893a-97c2acca85ef req-21bf3fba-d86d-42a0-a884-7d338c999c73 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:24.620691 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1e45c24c-959c-40ee-893a-97c2acca85ef req-21bf3fba-d86d-42a0-a884-7d338c999c73 service nova] Creating event network-changed:60b74908-1902-4216-8619-32cd92b10359 for instance cc97c9dc-bc47-4884-b42e-fa373a918258 on nch2-master-1 Feb 19 21:06:24.633746 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1e45c24c-959c-40ee-893a-97c2acca85ef req-21bf3fba-d86d-42a0-a884-7d338c999c73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156477 Feb 19 21:06:24.641395 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1904/3697] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:06:25.011225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7dec3421-c5db-4614-885e-eeb92a484d06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:25.028144 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7dec3421-c5db-4614-885e-eeb92a484d06 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.950038 Feb 19 21:06:25.030697 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1794/3698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:24 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:25.091395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a70d9f47-d898-49d5-ba52-3df7b03be892 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:25.103405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a70d9f47-d898-49d5-ba52-3df7b03be892 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:25.128996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a70d9f47-d898-49d5-ba52-3df7b03be892 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:25.130113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a70d9f47-d898-49d5-ba52-3df7b03be892 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:25.131932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a70d9f47-d898-49d5-ba52-3df7b03be892 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:25.132976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a70d9f47-d898-49d5-ba52-3df7b03be892 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:25.414707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f04bbc02-1dc1-4a20-88b4-7ac07f714ae7 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:25.415409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f04bbc02-1dc1-4a20-88b4-7ac07f714ae7 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:25.430688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f04bbc02-1dc1-4a20-88b4-7ac07f714ae7 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:25.431144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f04bbc02-1dc1-4a20-88b4-7ac07f714ae7 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:25.432445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f04bbc02-1dc1-4a20-88b4-7ac07f714ae7 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:25.433093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f04bbc02-1dc1-4a20-88b4-7ac07f714ae7 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:25.759247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a70d9f47-d898-49d5-ba52-3df7b03be892 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:25.774142 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a70d9f47-d898-49d5-ba52-3df7b03be892 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1362 microversion: 2.1 time: 0.684535 Feb 19 21:06:25.779583 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1905/3699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:25 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1362 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:26.051019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2cd40d66-69f3-46a8-8563-079e058e393d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:26.052017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2cd40d66-69f3-46a8-8563-079e058e393d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:26.075495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2cd40d66-69f3-46a8-8563-079e058e393d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:26.076321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2cd40d66-69f3-46a8-8563-079e058e393d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:26.079632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2cd40d66-69f3-46a8-8563-079e058e393d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:26.085102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2cd40d66-69f3-46a8-8563-079e058e393d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:26.277394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f04bbc02-1dc1-4a20-88b4-7ac07f714ae7 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:26.315422 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f04bbc02-1dc1-4a20-88b4-7ac07f714ae7 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 200 len: 1647 microversion: 2.1 time: 0.904301 Feb 19 21:06:26.342262 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1795/3700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:25 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 1647 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:26.361177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-858c8c16-faf9-4d63-8ac8-d3a5103629da req-6571cbc5-ba55-4afe-bfde-a0f7a8149a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646454f0-96fd-4131-9267-ed8e438556e3", "name": "network-vif-deleted", "tag": "29e2dde0-a838-4891-9d59-16f20a4969b9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:26.402748 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:26.402748 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:26.464089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-858c8c16-faf9-4d63-8ac8-d3a5103629da req-6571cbc5-ba55-4afe-bfde-a0f7a8149a1c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:26.465024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-858c8c16-faf9-4d63-8ac8-d3a5103629da req-6571cbc5-ba55-4afe-bfde-a0f7a8149a1c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:26.568262 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-858c8c16-faf9-4d63-8ac8-d3a5103629da req-6571cbc5-ba55-4afe-bfde-a0f7a8149a1c service nova] Creating event network-vif-deleted:29e2dde0-a838-4891-9d59-16f20a4969b9 for instance 646454f0-96fd-4131-9267-ed8e438556e3 on nch1-master-1 Feb 19 21:06:26.601002 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-858c8c16-faf9-4d63-8ac8-d3a5103629da req-6571cbc5-ba55-4afe-bfde-a0f7a8149a1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255633 Feb 19 21:06:26.605441 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1796/3701] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:26.750307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2cd40d66-69f3-46a8-8563-079e058e393d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:26.765402 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2cd40d66-69f3-46a8-8563-079e058e393d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.720743 Feb 19 21:06:26.766418 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1906/3702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:26 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:26.798829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-401b06d5-b4f5-4f00-85c5-0074ec63352a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:26.799599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-401b06d5-b4f5-4f00-85c5-0074ec63352a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:26.808360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-401b06d5-b4f5-4f00-85c5-0074ec63352a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:26.809119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-401b06d5-b4f5-4f00-85c5-0074ec63352a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:26.811239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-401b06d5-b4f5-4f00-85c5-0074ec63352a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:26.812085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-401b06d5-b4f5-4f00-85c5-0074ec63352a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:27.205995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-401b06d5-b4f5-4f00-85c5-0074ec63352a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:27.222252 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-401b06d5-b4f5-4f00-85c5-0074ec63352a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1362 microversion: 2.1 time: 0.427565 Feb 19 21:06:27.228875 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1797/3703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:26 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:27.359537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d4b8c27c-3dad-4c84-a01a-2722276eddcf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:27.362378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d4b8c27c-3dad-4c84-a01a-2722276eddcf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:27.390474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4b8c27c-3dad-4c84-a01a-2722276eddcf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:27.391727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4b8c27c-3dad-4c84-a01a-2722276eddcf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:27.395734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4b8c27c-3dad-4c84-a01a-2722276eddcf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:27.397744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4b8c27c-3dad-4c84-a01a-2722276eddcf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:27.436240 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-d4b8c27c-3dad-4c84-a01a-2722276eddcf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Instance 646454f0-96fd-4131-9267-ed8e438556e3 could not be found. Feb 19 21:06:27.442435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d4b8c27c-3dad-4c84-a01a-2722276eddcf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Instance 646454f0-96fd-4131-9267-ed8e438556e3 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:27.448534 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d4b8c27c-3dad-4c84-a01a-2722276eddcf tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 404 len: 111 microversion: 2.1 time: 0.093463 Feb 19 21:06:27.454896 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1907/3704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:27 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:27.461374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-746aa582-902f-44e4-9e92-9c6957287d9a tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674589d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:27.796256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2689b674-dc1d-406d-a5e0-4ee17803ca5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:27.798888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2689b674-dc1d-406d-a5e0-4ee17803ca5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:27.807694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2689b674-dc1d-406d-a5e0-4ee17803ca5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:27.808487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2689b674-dc1d-406d-a5e0-4ee17803ca5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:27.809467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2689b674-dc1d-406d-a5e0-4ee17803ca5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:27.810067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2689b674-dc1d-406d-a5e0-4ee17803ca5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:28.577678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2689b674-dc1d-406d-a5e0-4ee17803ca5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:28.593271 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2689b674-dc1d-406d-a5e0-4ee17803ca5b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.803127 Feb 19 21:06:28.594697 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1908/3705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:27 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:28.600346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e538bad-f846-4acb-a999-17d5f7a46c41 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:28.601950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e538bad-f846-4acb-a999-17d5f7a46c41 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:28.609225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e538bad-f846-4acb-a999-17d5f7a46c41 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:28.611040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e538bad-f846-4acb-a999-17d5f7a46c41 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:28.612139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e538bad-f846-4acb-a999-17d5f7a46c41 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:28.613709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e538bad-f846-4acb-a999-17d5f7a46c41 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:28.670318 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-746aa582-902f-44e4-9e92-9c6957287d9a tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/eee05f67-78e3-474c-8d12-b46bf13bf3c8" status: 202 len: 0 microversion: 2.1 time: 1.215808 Feb 19 21:06:28.670906 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1798/3706] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:27 2022] DELETE /compute/v2.1/os-security-groups/eee05f67-78e3-474c-8d12-b46bf13bf3c8 => generated 0 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:28.678627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-478824aa-4c59-42ed-a62e-4c91f9404e41 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f6467458ca0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:29.138633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e538bad-f846-4acb-a999-17d5f7a46c41 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:29.157322 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e538bad-f846-4acb-a999-17d5f7a46c41 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1362 microversion: 2.1 time: 0.560994 Feb 19 21:06:29.161805 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1909/3707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:28 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1362 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:29.422363 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-478824aa-4c59-42ed-a62e-4c91f9404e41 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d1dd8625-f661-4158-81f9-48a14f9cabe7" status: 202 len: 0 microversion: 2.1 time: 0.746814 Feb 19 21:06:29.423109 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1799/3708] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:28 2022] DELETE /compute/v2.1/os-security-groups/d1dd8625-f661-4158-81f9-48a14f9cabe7 => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:06:29.444894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-71c502f7-88f2-47f1-b72f-5b691dad6f2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'create', calling method: .version_select at 0x7f6479086310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-457483926", "description": "tempest-description-1733135237"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:29.612318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4a27be30-96ab-4a2c-9f68-f370c6ead365 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:29.613440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4a27be30-96ab-4a2c-9f68-f370c6ead365 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:29.626047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a27be30-96ab-4a2c-9f68-f370c6ead365 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:29.626882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a27be30-96ab-4a2c-9f68-f370c6ead365 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:29.627927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a27be30-96ab-4a2c-9f68-f370c6ead365 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:29.628521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a27be30-96ab-4a2c-9f68-f370c6ead365 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:30.076908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4a27be30-96ab-4a2c-9f68-f370c6ead365 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:30.079904 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-71c502f7-88f2-47f1-b72f-5b691dad6f2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.643391 Feb 19 21:06:30.080790 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1910/3709] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Feb 19 21:06:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:30.095197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ee277c17-fd06-4126-b412-c1b30997d57d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Action: 'update', calling method: .version_select at 0x7f6467ed11f0>, body: {"security_group": {"name": "tempest-sg-hth-649662405", "description": "tempest-description-hth-1826117947"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:30.119734 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4a27be30-96ab-4a2c-9f68-f370c6ead365 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.511309 Feb 19 21:06:30.132320 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1800/3710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:29 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:30.178108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-921aa17f-ef68-4526-8f95-0aa1a28d78a8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:30.178739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-921aa17f-ef68-4526-8f95-0aa1a28d78a8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:30.186354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-921aa17f-ef68-4526-8f95-0aa1a28d78a8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:30.187155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-921aa17f-ef68-4526-8f95-0aa1a28d78a8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:30.188731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-921aa17f-ef68-4526-8f95-0aa1a28d78a8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:30.189174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-921aa17f-ef68-4526-8f95-0aa1a28d78a8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:30.924121 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ee277c17-fd06-4126-b412-c1b30997d57d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/0d163311-40f9-43c3-99f8-d4a9ee331aa2" status: 200 len: 217 microversion: 2.1 time: 0.831431 Feb 19 21:06:30.927254 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1911/3711] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Feb 19 21:06:30 2022] PUT /compute/v2.1/os-security-groups/0d163311-40f9-43c3-99f8-d4a9ee331aa2 => generated 217 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:30.936769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-921aa17f-ef68-4526-8f95-0aa1a28d78a8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:30.940606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-35069a62-92c0-4203-9c66-7a198199de47 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f6478ffa9d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:30.948819 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-921aa17f-ef68-4526-8f95-0aa1a28d78a8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1362 microversion: 2.1 time: 0.773221 Feb 19 21:06:30.950506 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1801/3712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:30 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1362 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:31.139152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-08db083e-f45f-4bb3-8958-fdaf70eabe1a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:31.142950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08db083e-f45f-4bb3-8958-fdaf70eabe1a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:31.158377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08db083e-f45f-4bb3-8958-fdaf70eabe1a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:31.159231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08db083e-f45f-4bb3-8958-fdaf70eabe1a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:31.160796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08db083e-f45f-4bb3-8958-fdaf70eabe1a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:31.161441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08db083e-f45f-4bb3-8958-fdaf70eabe1a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:31.235500 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-35069a62-92c0-4203-9c66-7a198199de47 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/0d163311-40f9-43c3-99f8-d4a9ee331aa2" status: 200 len: 217 microversion: 2.1 time: 0.301832 Feb 19 21:06:31.255316 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1912/3713] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:06:30 2022] GET /compute/v2.1/os-security-groups/0d163311-40f9-43c3-99f8-d4a9ee331aa2 => generated 217 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:06:31.279398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-26250c60-4bbc-4a0d-bd7a-df262c4f6536 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f6478ffa160>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:31.813967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-08db083e-f45f-4bb3-8958-fdaf70eabe1a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:31.860931 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-08db083e-f45f-4bb3-8958-fdaf70eabe1a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.726572 Feb 19 21:06:31.863498 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1802/3714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:31 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:31.975478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c26d5d3e-9764-4a0e-8b68-ca138edd582b tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:31.977788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c26d5d3e-9764-4a0e-8b68-ca138edd582b tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:31.994596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c26d5d3e-9764-4a0e-8b68-ca138edd582b tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:31.998059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c26d5d3e-9764-4a0e-8b68-ca138edd582b tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:32.005919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c26d5d3e-9764-4a0e-8b68-ca138edd582b tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:32.006839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c26d5d3e-9764-4a0e-8b68-ca138edd582b tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:32.154994 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-26250c60-4bbc-4a0d-bd7a-df262c4f6536 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/0d163311-40f9-43c3-99f8-d4a9ee331aa2" status: 202 len: 0 microversion: 2.1 time: 0.897605 Feb 19 21:06:32.159385 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1913/3715] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:31 2022] DELETE /compute/v2.1/os-security-groups/0d163311-40f9-43c3-99f8-d4a9ee331aa2 => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:32.165377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96a24ad7-1dca-4f9a-bf93-ebbc792f33ab tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:32.166092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-96a24ad7-1dca-4f9a-bf93-ebbc792f33ab tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:32.187775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96a24ad7-1dca-4f9a-bf93-ebbc792f33ab tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:32.190186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96a24ad7-1dca-4f9a-bf93-ebbc792f33ab tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:32.193323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96a24ad7-1dca-4f9a-bf93-ebbc792f33ab tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:32.193964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96a24ad7-1dca-4f9a-bf93-ebbc792f33ab tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:32.232619 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-96a24ad7-1dca-4f9a-bf93-ebbc792f33ab tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Instance 646454f0-96fd-4131-9267-ed8e438556e3 could not be found. Feb 19 21:06:32.237833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96a24ad7-1dca-4f9a-bf93-ebbc792f33ab tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Instance 646454f0-96fd-4131-9267-ed8e438556e3 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:32.238905 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96a24ad7-1dca-4f9a-bf93-ebbc792f33ab tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 404 len: 111 microversion: 2.1 time: 0.078556 Feb 19 21:06:32.239663 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1914/3716] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:06:32 2022] DELETE /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:32.251291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-62342f4f-bbb3-47f1-8139-5f795f31ebec tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:32.256221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-62342f4f-bbb3-47f1-8139-5f795f31ebec tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: 646454f0-96fd-4131-9267-ed8e438556e3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:32.270839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62342f4f-bbb3-47f1-8139-5f795f31ebec tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:32.273272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62342f4f-bbb3-47f1-8139-5f795f31ebec tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:32.273767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62342f4f-bbb3-47f1-8139-5f795f31ebec tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:32.276926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62342f4f-bbb3-47f1-8139-5f795f31ebec tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:32.321120 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-62342f4f-bbb3-47f1-8139-5f795f31ebec tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Instance 646454f0-96fd-4131-9267-ed8e438556e3 could not be found. Feb 19 21:06:32.322910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-62342f4f-bbb3-47f1-8139-5f795f31ebec tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Instance 646454f0-96fd-4131-9267-ed8e438556e3 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:32.324016 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-62342f4f-bbb3-47f1-8139-5f795f31ebec tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3" status: 404 len: 111 microversion: 2.1 time: 0.078805 Feb 19 21:06:32.332991 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1915/3717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:32 2022] GET /compute/v2.1/servers/646454f0-96fd-4131-9267-ed8e438556e3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:06:32.553417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-107604411", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "be9178cb-fadc-423e-95e2-979af3a2f95e"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:32.600576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c26d5d3e-9764-4a0e-8b68-ca138edd582b tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:32.619533 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c26d5d3e-9764-4a0e-8b68-ca138edd582b tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1362 microversion: 2.1 time: 0.656295 Feb 19 21:06:32.625370 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1803/3718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:31 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1362 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:32.636022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c7533e8c-574c-454d-8007-040c2129b32d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674b3af0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:32.694443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] validate_networks() for [('be9178cb-fadc-423e-95e2-979af3a2f95e', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:06:33.133348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-c7533e8c-574c-454d-8007-040c2129b32d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1dd8625-f661-4158-81f9-48a14f9cabe7 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:06:33.134318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-c7533e8c-574c-454d-8007-040c2129b32d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group d1dd8625-f661-4158-81f9-48a14f9cabe7 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:06:33.134863 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c7533e8c-574c-454d-8007-040c2129b32d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group d1dd8625-f661-4158-81f9-48a14f9cabe7 does not exist Feb 19 21:06:33.134863 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-21be13d2-d0e2-4ee3-9e9d-fb144bac3d6d'] Feb 19 21:06:33.135467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c7533e8c-574c-454d-8007-040c2129b32d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group d1dd8625-f661-4158-81f9-48a14f9cabe7 does not exist Feb 19 21:06:33.135467 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-21be13d2-d0e2-4ee3-9e9d-fb144bac3d6d'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:33.136435 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c7533e8c-574c-454d-8007-040c2129b32d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d1dd8625-f661-4158-81f9-48a14f9cabe7" status: 404 len: 194 microversion: 2.1 time: 0.509562 Feb 19 21:06:33.137541 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1804/3719] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:32 2022] DELETE /compute/v2.1/os-security-groups/d1dd8625-f661-4158-81f9-48a14f9cabe7 => generated 194 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:33.144048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b43007e4-6ba3-4dcd-aa57-9a6829661312 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:33.144974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b43007e4-6ba3-4dcd-aa57-9a6829661312 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:33.154306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b43007e4-6ba3-4dcd-aa57-9a6829661312 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:33.155038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b43007e4-6ba3-4dcd-aa57-9a6829661312 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:33.156103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b43007e4-6ba3-4dcd-aa57-9a6829661312 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:33.156596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b43007e4-6ba3-4dcd-aa57-9a6829661312 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:33.509915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b43007e4-6ba3-4dcd-aa57-9a6829661312 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:33.528576 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b43007e4-6ba3-4dcd-aa57-9a6829661312 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.388739 Feb 19 21:06:33.529401 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1805/3720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:33 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:33.534046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f4127498-ceb3-4cb0-b0b0-d3b69c67d658 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674de040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:33.606000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-f4127498-ceb3-4cb0-b0b0-d3b69c67d658 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eee05f67-78e3-474c-8d12-b46bf13bf3c8 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:06:33.607653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-f4127498-ceb3-4cb0-b0b0-d3b69c67d658 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group eee05f67-78e3-474c-8d12-b46bf13bf3c8 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:06:33.608407 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f4127498-ceb3-4cb0-b0b0-d3b69c67d658 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group eee05f67-78e3-474c-8d12-b46bf13bf3c8 does not exist Feb 19 21:06:33.608407 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-e7394cfb-776c-492f-8bef-4efec0208f45'] Feb 19 21:06:33.609324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f4127498-ceb3-4cb0-b0b0-d3b69c67d658 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group eee05f67-78e3-474c-8d12-b46bf13bf3c8 does not exist Feb 19 21:06:33.609324 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-e7394cfb-776c-492f-8bef-4efec0208f45'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:33.610558 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f4127498-ceb3-4cb0-b0b0-d3b69c67d658 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/eee05f67-78e3-474c-8d12-b46bf13bf3c8" status: 404 len: 194 microversion: 2.1 time: 0.080088 Feb 19 21:06:33.614686 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1806/3721] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:33 2022] DELETE /compute/v2.1/os-security-groups/eee05f67-78e3-474c-8d12-b46bf13bf3c8 => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:33.620405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45b5c9a8-d007-4296-8dae-43f9a0426400 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674be820>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:33.689690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-45b5c9a8-d007-4296-8dae-43f9a0426400 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 43a4271b-abe4-4606-90de-e43d94450023 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:06:33.693349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-45b5c9a8-d007-4296-8dae-43f9a0426400 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group 43a4271b-abe4-4606-90de-e43d94450023 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:06:33.696703 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-45b5c9a8-d007-4296-8dae-43f9a0426400 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group 43a4271b-abe4-4606-90de-e43d94450023 does not exist Feb 19 21:06:33.696703 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-ebbde59e-ebdb-47ec-ace8-63097bbcbc73'] Feb 19 21:06:33.699333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45b5c9a8-d007-4296-8dae-43f9a0426400 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group 43a4271b-abe4-4606-90de-e43d94450023 does not exist Feb 19 21:06:33.699333 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-ebbde59e-ebdb-47ec-ace8-63097bbcbc73'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:33.702525 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45b5c9a8-d007-4296-8dae-43f9a0426400 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/43a4271b-abe4-4606-90de-e43d94450023" status: 404 len: 194 microversion: 2.1 time: 0.084608 Feb 19 21:06:33.704812 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1807/3722] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:33 2022] DELETE /compute/v2.1/os-security-groups/43a4271b-abe4-4606-90de-e43d94450023 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:33.714804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bc014123-c6f1-44d7-8496-6727a9799807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:33.716177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc014123-c6f1-44d7-8496-6727a9799807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:33.724703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc014123-c6f1-44d7-8496-6727a9799807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:33.726031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc014123-c6f1-44d7-8496-6727a9799807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:33.727552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc014123-c6f1-44d7-8496-6727a9799807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:33.728636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc014123-c6f1-44d7-8496-6727a9799807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:33.959577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:06:33.960143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:06:33.960409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:06:33.961865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:06:33.962435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:06:33.987114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:33.987830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:33.988849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:33.989485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:33.993741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bc014123-c6f1-44d7-8496-6727a9799807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:34.004711 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc014123-c6f1-44d7-8496-6727a9799807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1362 microversion: 2.1 time: 0.298450 Feb 19 21:06:34.011104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:06:34.015765 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1808/3723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:33 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:34.017501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for user 20246495a35b4762be5b2ad98f537377 and project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:06:34.021110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-beeb32da-53af-4e98-8475-4946700325b8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64674491f0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:34.033550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:06:34.036301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:06:34.050060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-beeb32da-53af-4e98-8475-4946700325b8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 092e5c81-8e0e-43c1-b76f-170278dc21b4 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:06:34.050663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-beeb32da-53af-4e98-8475-4946700325b8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group 092e5c81-8e0e-43c1-b76f-170278dc21b4 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:06:34.051471 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-beeb32da-53af-4e98-8475-4946700325b8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group 092e5c81-8e0e-43c1-b76f-170278dc21b4 does not exist Feb 19 21:06:34.051471 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-e8b3da21-cef5-4515-abea-47fb036d5384'] Feb 19 21:06:34.052546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-beeb32da-53af-4e98-8475-4946700325b8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group 092e5c81-8e0e-43c1-b76f-170278dc21b4 does not exist Feb 19 21:06:34.052546 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-e8b3da21-cef5-4515-abea-47fb036d5384'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:34.055227 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-beeb32da-53af-4e98-8475-4946700325b8 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/092e5c81-8e0e-43c1-b76f-170278dc21b4" status: 404 len: 194 microversion: 2.1 time: 0.037366 Feb 19 21:06:34.055826 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1809/3724] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:34 2022] DELETE /compute/v2.1/os-security-groups/092e5c81-8e0e-43c1-b76f-170278dc21b4 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:34.065947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7659ac24-ca9f-4c37-8112-75fa028a8f6d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f6467b37820>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:34.097327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-7659ac24-ca9f-4c37-8112-75fa028a8f6d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6a5c31e3-3389-4b33-9fff-76e0057302da does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:06:34.101158 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-34e12b15-73e9-414c-9aae-afaaee21d179 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.766167 Feb 19 21:06:34.102819 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1916/3725] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:06:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:06:34.115498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-7659ac24-ca9f-4c37-8112-75fa028a8f6d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group 6a5c31e3-3389-4b33-9fff-76e0057302da not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:06:34.116195 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-7659ac24-ca9f-4c37-8112-75fa028a8f6d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group 6a5c31e3-3389-4b33-9fff-76e0057302da does not exist Feb 19 21:06:34.116195 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-822bd544-bbf7-4b54-a7ee-984e58713d68'] Feb 19 21:06:34.119476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7659ac24-ca9f-4c37-8112-75fa028a8f6d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group 6a5c31e3-3389-4b33-9fff-76e0057302da does not exist Feb 19 21:06:34.119476 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-822bd544-bbf7-4b54-a7ee-984e58713d68'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:34.120456 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7659ac24-ca9f-4c37-8112-75fa028a8f6d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/6a5c31e3-3389-4b33-9fff-76e0057302da" status: 404 len: 194 microversion: 2.1 time: 0.060146 Feb 19 21:06:34.122138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c99e116a-d60a-476e-943c-8dfc8d10a042 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:34.123829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c99e116a-d60a-476e-943c-8dfc8d10a042 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:34.125938 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1810/3726] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:34 2022] DELETE /compute/v2.1/os-security-groups/6a5c31e3-3389-4b33-9fff-76e0057302da => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:06:34.141439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-db6eed90-03d9-4ccf-942f-ed7a738ca846 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f646744f820>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:34.250686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c99e116a-d60a-476e-943c-8dfc8d10a042 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:34.262958 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c99e116a-d60a-476e-943c-8dfc8d10a042 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1214 microversion: 2.1 time: 0.147165 Feb 19 21:06:34.263835 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1917/3727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:34 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:34.266429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG neutronclient.v2_0.client [None req-db6eed90-03d9-4ccf-942f-ed7a738ca846 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 does not exist", "detail": ""}} {{(pid=136095) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 19 21:06:34.267577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.security_group_api [None req-db6eed90-03d9-4ccf-942f-ed7a738ca846 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Neutron security group a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 not found {{(pid=136095) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 19 21:06:34.268397 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-db6eed90-03d9-4ccf-942f-ed7a738ca846 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Security group a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 does not exist Feb 19 21:06:34.268397 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-65f353e3-d903-46eb-856f-c824b474189f'] Feb 19 21:06:34.269557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-db6eed90-03d9-4ccf-942f-ed7a738ca846 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Security group a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 does not exist Feb 19 21:06:34.269557 ncdv-master-1 devstack@n-api.service[136095]: Neutron server returns request_ids: ['req-65f353e3-d903-46eb-856f-c824b474189f'] {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:34.270826 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-db6eed90-03d9-4ccf-942f-ed7a738ca846 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0" status: 404 len: 194 microversion: 2.1 time: 0.140711 Feb 19 21:06:34.271652 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1811/3728] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:34 2022] DELETE /compute/v2.1/os-security-groups/a5b9cfe0-78ea-4b61-b692-2b0c2c46aaa0 => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:34.283014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-329fb6f9-5041-4cca-8e68-b9bebef71b2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:34.283937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-329fb6f9-5041-4cca-8e68-b9bebef71b2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:34.294475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-329fb6f9-5041-4cca-8e68-b9bebef71b2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:34.295352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-329fb6f9-5041-4cca-8e68-b9bebef71b2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:34.297127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-329fb6f9-5041-4cca-8e68-b9bebef71b2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:34.297820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-329fb6f9-5041-4cca-8e68-b9bebef71b2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:34.359770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-329fb6f9-5041-4cca-8e68-b9bebef71b2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:06:34.550420 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-329fb6f9-5041-4cca-8e68-b9bebef71b2d tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 204 len: 0 microversion: 2.1 time: 0.271991 Feb 19 21:06:34.551101 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1918/3729] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:06:34 2022] DELETE /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:06:34.561116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa5c91f3-c206-4dd5-b0d9-fdd481d2407b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:34.562184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aa5c91f3-c206-4dd5-b0d9-fdd481d2407b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:34.566110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e32a0188-ffa7-4a7b-ba1d-8a4526f3c6c5 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:34.567128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e32a0188-ffa7-4a7b-ba1d-8a4526f3c6c5 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:34.586998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e32a0188-ffa7-4a7b-ba1d-8a4526f3c6c5 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:34.587934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e32a0188-ffa7-4a7b-ba1d-8a4526f3c6c5 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:34.588995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e32a0188-ffa7-4a7b-ba1d-8a4526f3c6c5 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:34.589695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e32a0188-ffa7-4a7b-ba1d-8a4526f3c6c5 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:34.596770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa5c91f3-c206-4dd5-b0d9-fdd481d2407b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:34.597766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa5c91f3-c206-4dd5-b0d9-fdd481d2407b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:34.599235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa5c91f3-c206-4dd5-b0d9-fdd481d2407b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:34.602491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa5c91f3-c206-4dd5-b0d9-fdd481d2407b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:34.931964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e32a0188-ffa7-4a7b-ba1d-8a4526f3c6c5 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:34.939036 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e32a0188-ffa7-4a7b-ba1d-8a4526f3c6c5 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1646 microversion: 2.1 time: 0.382370 Feb 19 21:06:34.940632 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1919/3730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:34 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1646 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:34.955755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa5c91f3-c206-4dd5-b0d9-fdd481d2407b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:34.963376 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa5c91f3-c206-4dd5-b0d9-fdd481d2407b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1528 microversion: 2.1 time: 0.410951 Feb 19 21:06:34.963971 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1812/3731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:34 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1528 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:35.023927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cde9f0d7-eaa8-460d-9c42-8ccd66c06a78 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:35.024878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cde9f0d7-eaa8-460d-9c42-8ccd66c06a78 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:35.032395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cde9f0d7-eaa8-460d-9c42-8ccd66c06a78 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:35.032923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cde9f0d7-eaa8-460d-9c42-8ccd66c06a78 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:35.034214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cde9f0d7-eaa8-460d-9c42-8ccd66c06a78 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:35.034804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cde9f0d7-eaa8-460d-9c42-8ccd66c06a78 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:35.290380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6e3f50c4-12ad-49db-9d8a-89a155afbf27 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:35.291832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6e3f50c4-12ad-49db-9d8a-89a155afbf27 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:35.311105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e3f50c4-12ad-49db-9d8a-89a155afbf27 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:35.312062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e3f50c4-12ad-49db-9d8a-89a155afbf27 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:35.313146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e3f50c4-12ad-49db-9d8a-89a155afbf27 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:35.313598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e3f50c4-12ad-49db-9d8a-89a155afbf27 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:35.360522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cde9f0d7-eaa8-460d-9c42-8ccd66c06a78 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:35.380686 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cde9f0d7-eaa8-460d-9c42-8ccd66c06a78 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1362 microversion: 2.1 time: 0.361221 Feb 19 21:06:35.386502 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1920/3732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:35 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:35.397228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b612a61-6a84-4cc3-9fff-47bbcdf83cf0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:35.398733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9b612a61-6a84-4cc3-9fff-47bbcdf83cf0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:35.408448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b612a61-6a84-4cc3-9fff-47bbcdf83cf0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:35.409192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b612a61-6a84-4cc3-9fff-47bbcdf83cf0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:35.410150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b612a61-6a84-4cc3-9fff-47bbcdf83cf0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:35.411237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b612a61-6a84-4cc3-9fff-47bbcdf83cf0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:35.456760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6e3f50c4-12ad-49db-9d8a-89a155afbf27 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:35.465799 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6e3f50c4-12ad-49db-9d8a-89a155afbf27 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1266 microversion: 2.1 time: 0.186948 Feb 19 21:06:35.476490 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1813/3733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:35 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:35.522888 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b612a61-6a84-4cc3-9fff-47bbcdf83cf0 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.133942 Feb 19 21:06:35.529813 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1921/3734] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:06:35 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:35.534461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-568f91d3-9c8d-4cba-8f8e-6d4c0321243d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:35.535347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-568f91d3-9c8d-4cba-8f8e-6d4c0321243d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:35.549781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-568f91d3-9c8d-4cba-8f8e-6d4c0321243d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:35.551107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-568f91d3-9c8d-4cba-8f8e-6d4c0321243d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:35.568776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-568f91d3-9c8d-4cba-8f8e-6d4c0321243d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:35.569259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-568f91d3-9c8d-4cba-8f8e-6d4c0321243d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:35.685966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-14582222-9d38-415c-94db-d8490a07f437 req-91e82b8c-d84c-4633-b01d-8cb1a0cdd537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc97c9dc-bc47-4884-b42e-fa373a918258", "name": "network-vif-plugged", "status": "completed", "tag": "60b74908-1902-4216-8619-32cd92b10359"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:35.694690 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:35.694690 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:06:35.719367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-14582222-9d38-415c-94db-d8490a07f437 req-91e82b8c-d84c-4633-b01d-8cb1a0cdd537 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:35.720208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-14582222-9d38-415c-94db-d8490a07f437 req-91e82b8c-d84c-4633-b01d-8cb1a0cdd537 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:35.759391 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-14582222-9d38-415c-94db-d8490a07f437 req-91e82b8c-d84c-4633-b01d-8cb1a0cdd537 service nova] Creating event network-vif-plugged:60b74908-1902-4216-8619-32cd92b10359 for instance cc97c9dc-bc47-4884-b42e-fa373a918258 on nch2-master-1 Feb 19 21:06:35.771183 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-14582222-9d38-415c-94db-d8490a07f437 req-91e82b8c-d84c-4633-b01d-8cb1a0cdd537 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094760 Feb 19 21:06:35.773540 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1922/3735] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:35.990097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1633349f-c60e-40c0-acae-1c128cce2eb6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:35.996614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1633349f-c60e-40c0-acae-1c128cce2eb6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:36.009966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1633349f-c60e-40c0-acae-1c128cce2eb6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:36.010921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1633349f-c60e-40c0-acae-1c128cce2eb6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:36.013581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1633349f-c60e-40c0-acae-1c128cce2eb6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:36.014646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1633349f-c60e-40c0-acae-1c128cce2eb6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:36.278630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-568f91d3-9c8d-4cba-8f8e-6d4c0321243d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:36.288300 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-568f91d3-9c8d-4cba-8f8e-6d4c0321243d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1671 microversion: 2.1 time: 0.758205 Feb 19 21:06:36.289492 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1814/3736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:35 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1671 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:36.303719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8937656f-0da5-43dc-ad37-7187238d0140 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:36.304505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8937656f-0da5-43dc-ad37-7187238d0140 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:36.312777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8937656f-0da5-43dc-ad37-7187238d0140 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:36.313009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8937656f-0da5-43dc-ad37-7187238d0140 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:36.314067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8937656f-0da5-43dc-ad37-7187238d0140 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:36.314946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8937656f-0da5-43dc-ad37-7187238d0140 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:36.880581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1633349f-c60e-40c0-acae-1c128cce2eb6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:36.893662 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1633349f-c60e-40c0-acae-1c128cce2eb6 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1646 microversion: 2.1 time: 0.937958 Feb 19 21:06:36.894496 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1923/3737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:35 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1646 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:36.916837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1fb54f6c-b635-4bf0-b441-8463b04efde8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:36.917726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1fb54f6c-b635-4bf0-b441-8463b04efde8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:36.925889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fb54f6c-b635-4bf0-b441-8463b04efde8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:36.926669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fb54f6c-b635-4bf0-b441-8463b04efde8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:36.927630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fb54f6c-b635-4bf0-b441-8463b04efde8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:36.928265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fb54f6c-b635-4bf0-b441-8463b04efde8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:36.940840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8937656f-0da5-43dc-ad37-7187238d0140 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:36.955480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8937656f-0da5-43dc-ad37-7187238d0140 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1510 microversion: 2.1 time: 0.664089 Feb 19 21:06:36.956125 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1815/3738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:36 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1510 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:36.961572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-88cdbd38-3ac7-439c-8839-f826c9a790d1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:36.964882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-88cdbd38-3ac7-439c-8839-f826c9a790d1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:36.997588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88cdbd38-3ac7-439c-8839-f826c9a790d1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:36.998493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88cdbd38-3ac7-439c-8839-f826c9a790d1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:37.001475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88cdbd38-3ac7-439c-8839-f826c9a790d1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:37.002624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88cdbd38-3ac7-439c-8839-f826c9a790d1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:37.230028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-88cdbd38-3ac7-439c-8839-f826c9a790d1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:37.246311 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-88cdbd38-3ac7-439c-8839-f826c9a790d1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1272 microversion: 2.1 time: 0.288231 Feb 19 21:06:37.246923 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1816/3739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:36 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:37.318533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a973b54d-39d9-449a-a424-e2c24c2d1bf2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:37.319214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a973b54d-39d9-449a-a424-e2c24c2d1bf2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:37.327430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a973b54d-39d9-449a-a424-e2c24c2d1bf2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:37.328202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a973b54d-39d9-449a-a424-e2c24c2d1bf2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:37.333590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a973b54d-39d9-449a-a424-e2c24c2d1bf2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:37.334310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a973b54d-39d9-449a-a424-e2c24c2d1bf2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:37.465335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1fb54f6c-b635-4bf0-b441-8463b04efde8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:37.474740 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1fb54f6c-b635-4bf0-b441-8463b04efde8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1362 microversion: 2.1 time: 0.573228 Feb 19 21:06:37.476062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1924/3740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:36 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:37.783350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a973b54d-39d9-449a-a424-e2c24c2d1bf2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:37.802742 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a973b54d-39d9-449a-a424-e2c24c2d1bf2 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1676 microversion: 2.1 time: 0.488280 Feb 19 21:06:37.803669 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1817/3741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:37 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1676 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:37.916992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f2dca485-9609-4d62-9db5-fa206f32d03f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:37.919042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f2dca485-9609-4d62-9db5-fa206f32d03f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:37.932375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2dca485-9609-4d62-9db5-fa206f32d03f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:37.932838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2dca485-9609-4d62-9db5-fa206f32d03f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:37.933712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2dca485-9609-4d62-9db5-fa206f32d03f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:37.936469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2dca485-9609-4d62-9db5-fa206f32d03f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:37.987814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c6d680e0-f72f-4aa5-a8ed-1f3266ded861 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:37.989416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c6d680e0-f72f-4aa5-a8ed-1f3266ded861 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:38.006546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d680e0-f72f-4aa5-a8ed-1f3266ded861 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:38.007166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d680e0-f72f-4aa5-a8ed-1f3266ded861 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:38.008578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d680e0-f72f-4aa5-a8ed-1f3266ded861 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:38.009029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d680e0-f72f-4aa5-a8ed-1f3266ded861 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:38.076604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f2dca485-9609-4d62-9db5-fa206f32d03f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff7364263f04529910770039084fb7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e16b1ae38144c3ba7d8cb99e46eea10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:38.087840 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f2dca485-9609-4d62-9db5-fa206f32d03f tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 200 len: 1468 microversion: 2.1 time: 0.176444 Feb 19 21:06:38.089885 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1925/3742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:37 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 1468 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:38.102473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6cf5963f-238a-46e4-8670-d6a53e8f7a5f req-2f58a80e-e3d0-421d-a439-e7a348bf9f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed39c690-028c-40a9-9ed9-06b73776d4d6", "name": "network-vif-deleted", "tag": "528c31a5-569d-4fef-a351-c1e8d8d8f70c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:38.104428 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:38.104428 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:06:38.115323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6cf5963f-238a-46e4-8670-d6a53e8f7a5f req-2f58a80e-e3d0-421d-a439-e7a348bf9f1d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:38.116119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6cf5963f-238a-46e4-8670-d6a53e8f7a5f req-2f58a80e-e3d0-421d-a439-e7a348bf9f1d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:38.146193 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6cf5963f-238a-46e4-8670-d6a53e8f7a5f req-2f58a80e-e3d0-421d-a439-e7a348bf9f1d service nova] Creating event network-vif-deleted:528c31a5-569d-4fef-a351-c1e8d8d8f70c for instance ed39c690-028c-40a9-9ed9-06b73776d4d6 on nch1-master-1 Feb 19 21:06:38.152563 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6cf5963f-238a-46e4-8670-d6a53e8f7a5f req-2f58a80e-e3d0-421d-a439-e7a348bf9f1d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061007 Feb 19 21:06:38.153361 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1926/3743] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:38.265205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2143048-1d5e-4e21-bfbd-518e05d44eaa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:38.265993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b2143048-1d5e-4e21-bfbd-518e05d44eaa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:38.288829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2143048-1d5e-4e21-bfbd-518e05d44eaa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:38.292046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2143048-1d5e-4e21-bfbd-518e05d44eaa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:38.296192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2143048-1d5e-4e21-bfbd-518e05d44eaa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:38.296852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2143048-1d5e-4e21-bfbd-518e05d44eaa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:38.719939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c6d680e0-f72f-4aa5-a8ed-1f3266ded861 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:38.748959 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c6d680e0-f72f-4aa5-a8ed-1f3266ded861 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1510 microversion: 2.1 time: 0.768123 Feb 19 21:06:38.758866 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1818/3744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:37 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1510 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:38.781386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:38.782155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:38.807206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:38.809987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:38.818069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:38.820163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:38.971062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b2143048-1d5e-4e21-bfbd-518e05d44eaa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:38.987266 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2143048-1d5e-4e21-bfbd-518e05d44eaa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1314 microversion: 2.1 time: 0.726039 Feb 19 21:06:38.991768 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1927/3745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:38 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:38.996582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b34d866-74a0-481f-bb7e-df51e6e713d0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:38.997203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b34d866-74a0-481f-bb7e-df51e6e713d0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:39.027169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b34d866-74a0-481f-bb7e-df51e6e713d0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:39.027720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b34d866-74a0-481f-bb7e-df51e6e713d0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:39.028596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b34d866-74a0-481f-bb7e-df51e6e713d0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:39.029262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b34d866-74a0-481f-bb7e-df51e6e713d0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:39.058398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lazy-loading 'services' on Instance uuid cb730c4e-37cc-47fd-a5c0-a4131d1990a9 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:06:39.362483 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b273be1f-56f0-4a7a-b274-d8d26ee4a1de tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9/os-volume_attachments/493c2856-8fb5-4b6f-bc89-58eb61177127" status: 202 len: 0 microversion: 2.1 time: 0.600512 Feb 19 21:06:39.372459 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1819/3746] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:06:38 2022] DELETE /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9/os-volume_attachments/493c2856-8fb5-4b6f-bc89-58eb61177127 => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:39.408546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2030b52d-49ee-4c6e-abb5-c8cd5c71b463 req-0a9ddcde-d01a-4299-b3f8-2f6366099bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63482c29-4a39-4eaa-9bf1-de6107d9b0f0", "name": "network-vif-unplugged", "status": "completed", "tag": "a943b989-5a95-44a3-9a78-35384327a397"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:39.411716 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:39.411716 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:39.442816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2030b52d-49ee-4c6e-abb5-c8cd5c71b463 req-0a9ddcde-d01a-4299-b3f8-2f6366099bdc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:39.450866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2030b52d-49ee-4c6e-abb5-c8cd5c71b463 req-0a9ddcde-d01a-4299-b3f8-2f6366099bdc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:39.507179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.compute.server_external_events [req-2030b52d-49ee-4c6e-abb5-c8cd5c71b463 req-0a9ddcde-d01a-4299-b3f8-2f6366099bdc service nova] Unable to find a host for instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0. Dropping event network-vif-unplugged {{(pid=136095) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 19 21:06:39.510567 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2030b52d-49ee-4c6e-abb5-c8cd5c71b463 req-0a9ddcde-d01a-4299-b3f8-2f6366099bdc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.135198 Feb 19 21:06:39.511707 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1820/3747] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 138 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 19 21:06:39.525350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-318ba262-094e-4e53-acdf-4db329d90e7f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:39.526879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-318ba262-094e-4e53-acdf-4db329d90e7f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:39.537818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-318ba262-094e-4e53-acdf-4db329d90e7f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:39.539530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-318ba262-094e-4e53-acdf-4db329d90e7f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:39.541323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-318ba262-094e-4e53-acdf-4db329d90e7f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:39.542418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-318ba262-094e-4e53-acdf-4db329d90e7f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:39.936356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4b34d866-74a0-481f-bb7e-df51e6e713d0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:39.946728 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b34d866-74a0-481f-bb7e-df51e6e713d0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1548 microversion: 2.1 time: 0.953700 Feb 19 21:06:39.948291 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1928/3748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:38 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1548 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:39.964975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8d27c931-324d-4e4b-8b86-f7ad1c1c8405 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:39.966787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8d27c931-324d-4e4b-8b86-f7ad1c1c8405 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] [instance: ed39c690-028c-40a9-9ed9-06b73776d4d6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:39.974678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d27c931-324d-4e4b-8b86-f7ad1c1c8405 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:39.975733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d27c931-324d-4e4b-8b86-f7ad1c1c8405 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:39.975894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d27c931-324d-4e4b-8b86-f7ad1c1c8405 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:39.976395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d27c931-324d-4e4b-8b86-f7ad1c1c8405 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:39.991732 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-8d27c931-324d-4e4b-8b86-f7ad1c1c8405 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] HTTP exception thrown: Instance ed39c690-028c-40a9-9ed9-06b73776d4d6 could not be found. Feb 19 21:06:39.994394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8d27c931-324d-4e4b-8b86-f7ad1c1c8405 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Returning 404 to user: Instance ed39c690-028c-40a9-9ed9-06b73776d4d6 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:39.995516 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8d27c931-324d-4e4b-8b86-f7ad1c1c8405 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6" status: 404 len: 111 microversion: 2.1 time: 0.046050 Feb 19 21:06:39.996401 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1929/3749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:39 2022] GET /compute/v2.1/servers/ed39c690-028c-40a9-9ed9-06b73776d4d6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:40.005339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e5f4f3b-9d0c-4884-8132-3a88f16d74c0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:40.006378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e5f4f3b-9d0c-4884-8132-3a88f16d74c0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:40.017924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e5f4f3b-9d0c-4884-8132-3a88f16d74c0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:40.019501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e5f4f3b-9d0c-4884-8132-3a88f16d74c0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:40.020921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e5f4f3b-9d0c-4884-8132-3a88f16d74c0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:40.021870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e5f4f3b-9d0c-4884-8132-3a88f16d74c0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:40.086176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-318ba262-094e-4e53-acdf-4db329d90e7f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:40.096318 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-318ba262-094e-4e53-acdf-4db329d90e7f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1676 microversion: 2.1 time: 0.577473 Feb 19 21:06:40.097633 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1821/3750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:39 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1676 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:40.105654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5e8ad9ee-7538-49d8-b796-bcb9b12dacc9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:40.106615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5e8ad9ee-7538-49d8-b796-bcb9b12dacc9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:40.120209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e8ad9ee-7538-49d8-b796-bcb9b12dacc9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:40.121454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e8ad9ee-7538-49d8-b796-bcb9b12dacc9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:40.122970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e8ad9ee-7538-49d8-b796-bcb9b12dacc9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:40.123967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e8ad9ee-7538-49d8-b796-bcb9b12dacc9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:40.444871 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5e8ad9ee-7538-49d8-b796-bcb9b12dacc9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.345725 Feb 19 21:06:40.446354 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1822/3751] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:06:40 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/os-interface => generated 284 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:40.472524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a0e95285-c18d-4855-a07d-fac143eecc02 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:40.473386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a0e95285-c18d-4855-a07d-fac143eecc02 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:40.507634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0e95285-c18d-4855-a07d-fac143eecc02 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:40.511531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0e95285-c18d-4855-a07d-fac143eecc02 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:40.514670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0e95285-c18d-4855-a07d-fac143eecc02 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:40.516899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0e95285-c18d-4855-a07d-fac143eecc02 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:41.022426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e5f4f3b-9d0c-4884-8132-3a88f16d74c0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:41.043440 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e5f4f3b-9d0c-4884-8132-3a88f16d74c0 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1453 microversion: 2.1 time: 1.042419 Feb 19 21:06:41.044885 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1930/3752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:39 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1453 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:41.063940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-63f4df3b-7bc1-4f47-8385-d2e844972331 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f6479020c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:41.465665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a0e95285-c18d-4855-a07d-fac143eecc02 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:41.476531 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a0e95285-c18d-4855-a07d-fac143eecc02 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1314 microversion: 2.1 time: 1.028269 Feb 19 21:06:41.478819 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1823/3753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:40 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1314 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:41.484224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bd89106d-77ad-4a8c-a0b6-97be00dba4a8 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:41.485248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bd89106d-77ad-4a8c-a0b6-97be00dba4a8 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:41.498903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd89106d-77ad-4a8c-a0b6-97be00dba4a8 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:41.499826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd89106d-77ad-4a8c-a0b6-97be00dba4a8 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:41.500971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd89106d-77ad-4a8c-a0b6-97be00dba4a8 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:41.501587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd89106d-77ad-4a8c-a0b6-97be00dba4a8 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:41.540833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bd89106d-77ad-4a8c-a0b6-97be00dba4a8 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:06:41.702984 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bd89106d-77ad-4a8c-a0b6-97be00dba4a8 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 204 len: 0 microversion: 2.1 time: 0.221194 Feb 19 21:06:41.704891 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1824/3754] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:06:41 2022] DELETE /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:06:41.712908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-cbb2b010-5d40-492c-9585-4863e37a59f3 req-4d10ce60-662a-4950-a625-c1c93767c861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ca5e86-5e05-49e1-a775-7d5553410ecb", "tag": "38e30f6a-a9e0-47fd-87cc-5f95e86df571"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:41.715378 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:41.715378 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:41.724691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cbb2b010-5d40-492c-9585-4863e37a59f3 req-4d10ce60-662a-4950-a625-c1c93767c861 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:41.725598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cbb2b010-5d40-492c-9585-4863e37a59f3 req-4d10ce60-662a-4950-a625-c1c93767c861 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:41.758187 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-cbb2b010-5d40-492c-9585-4863e37a59f3 req-4d10ce60-662a-4950-a625-c1c93767c861 service nova] Creating event network-changed:38e30f6a-a9e0-47fd-87cc-5f95e86df571 for instance 76ca5e86-5e05-49e1-a775-7d5553410ecb on nch1-master-1 Feb 19 21:06:41.767140 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-cbb2b010-5d40-492c-9585-4863e37a59f3 req-4d10ce60-662a-4950-a625-c1c93767c861 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058856 Feb 19 21:06:41.768292 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1825/3755] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:41.776897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0c949cdb-0744-4b7e-aaa0-dfd3e3906720 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:41.780555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0c949cdb-0744-4b7e-aaa0-dfd3e3906720 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:41.795451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c949cdb-0744-4b7e-aaa0-dfd3e3906720 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:41.796701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c949cdb-0744-4b7e-aaa0-dfd3e3906720 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:41.798289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c949cdb-0744-4b7e-aaa0-dfd3e3906720 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:41.799299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c949cdb-0744-4b7e-aaa0-dfd3e3906720 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:42.061443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-63f4df3b-7bc1-4f47-8385-d2e844972331 tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e325cfc1-4a1b-4768-b92c-b58a77d5718a" status: 202 len: 0 microversion: 2.1 time: 1.012829 Feb 19 21:06:42.066401 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1931/3756] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:41 2022] DELETE /compute/v2.1/os-security-groups/e325cfc1-4a1b-4768-b92c-b58a77d5718a => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:42.073121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-23074ca4-3bf1-4b8a-964b-6b04ab2eacd5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:42.076518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-23074ca4-3bf1-4b8a-964b-6b04ab2eacd5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:42.097102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23074ca4-3bf1-4b8a-964b-6b04ab2eacd5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:42.099590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23074ca4-3bf1-4b8a-964b-6b04ab2eacd5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:42.100758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23074ca4-3bf1-4b8a-964b-6b04ab2eacd5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:42.102238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23074ca4-3bf1-4b8a-964b-6b04ab2eacd5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:42.527039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0c949cdb-0744-4b7e-aaa0-dfd3e3906720 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:42.560079 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0c949cdb-0744-4b7e-aaa0-dfd3e3906720 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1453 microversion: 2.1 time: 0.790091 Feb 19 21:06:42.578080 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1826/3757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:41 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1453 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:42.582027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-23074ca4-3bf1-4b8a-964b-6b04ab2eacd5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:42.597149 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-23074ca4-3bf1-4b8a-964b-6b04ab2eacd5 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1676 microversion: 2.1 time: 0.529214 Feb 19 21:06:42.612185 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1932/3758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:42 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1676 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:42.618251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6af4b4ca-3084-4aac-a6ad-f1512d010be5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:42.628301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6af4b4ca-3084-4aac-a6ad-f1512d010be5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:42.634412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ccb9aff1-879c-4bdf-8762-52c794f6fbfe tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] Calling method '.version_select at 0x7f64790340d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:42.653508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6af4b4ca-3084-4aac-a6ad-f1512d010be5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:42.654092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6af4b4ca-3084-4aac-a6ad-f1512d010be5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:42.655980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6af4b4ca-3084-4aac-a6ad-f1512d010be5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:42.656748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6af4b4ca-3084-4aac-a6ad-f1512d010be5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:43.794307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6af4b4ca-3084-4aac-a6ad-f1512d010be5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:43.832716 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6af4b4ca-3084-4aac-a6ad-f1512d010be5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 200 len: 1513 microversion: 2.1 time: 1.238949 Feb 19 21:06:43.837912 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1827/3759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:42 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 1513 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:43.852178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2213a60c-99bd-4a49-b1f1-032878289afb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:43.855427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2213a60c-99bd-4a49-b1f1-032878289afb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:43.863185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2213a60c-99bd-4a49-b1f1-032878289afb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:43.864016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2213a60c-99bd-4a49-b1f1-032878289afb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:43.874331 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2213a60c-99bd-4a49-b1f1-032878289afb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:43.875098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2213a60c-99bd-4a49-b1f1-032878289afb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:43.941212 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2213a60c-99bd-4a49-b1f1-032878289afb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/ips" status: 200 len: 106 microversion: 2.1 time: 0.092659 Feb 19 21:06:43.941927 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1828/3760] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:06:43 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/ips => generated 106 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:44.036087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-336efbee-ca0e-43c0-aa0f-d4217b28d28e req-ff88706e-76ae-40c6-8d00-d0a826156d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc97c9dc-bc47-4884-b42e-fa373a918258", "tag": "60b74908-1902-4216-8619-32cd92b10359"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:44.037941 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:44.037941 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:44.049492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-336efbee-ca0e-43c0-aa0f-d4217b28d28e req-ff88706e-76ae-40c6-8d00-d0a826156d64 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:44.050938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-336efbee-ca0e-43c0-aa0f-d4217b28d28e req-ff88706e-76ae-40c6-8d00-d0a826156d64 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:44.067907 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-336efbee-ca0e-43c0-aa0f-d4217b28d28e req-ff88706e-76ae-40c6-8d00-d0a826156d64 service nova] Creating event network-changed:60b74908-1902-4216-8619-32cd92b10359 for instance cc97c9dc-bc47-4884-b42e-fa373a918258 on nch2-master-1 Feb 19 21:06:44.077330 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-336efbee-ca0e-43c0-aa0f-d4217b28d28e req-ff88706e-76ae-40c6-8d00-d0a826156d64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131570 Feb 19 21:06:44.078433 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1829/3761] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:44.099201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9195282d-b11e-4354-8e9d-ad8b3a3af698 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:44.101480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9195282d-b11e-4354-8e9d-ad8b3a3af698 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:44.111772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9195282d-b11e-4354-8e9d-ad8b3a3af698 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:44.116998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9195282d-b11e-4354-8e9d-ad8b3a3af698 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:44.118144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9195282d-b11e-4354-8e9d-ad8b3a3af698 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:44.118703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9195282d-b11e-4354-8e9d-ad8b3a3af698 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:44.285712 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ccb9aff1-879c-4bdf-8762-52c794f6fbfe tempest-SecurityGroupsTestJSON-1534547659 tempest-SecurityGroupsTestJSON-1534547659-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/f6bcb2ac-4094-4b86-9dd7-d20d9280f265" status: 202 len: 0 microversion: 2.1 time: 1.669303 Feb 19 21:06:44.285712 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1933/3762] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:06:42 2022] DELETE /compute/v2.1/os-security-groups/f6bcb2ac-4094-4b86-9dd7-d20d9280f265 => generated 0 bytes in 1672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:44.299482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:44.299482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:44.307164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:44.307622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:44.308454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:44.309026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:44.349830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lazy-loading 'flavor' on Instance uuid 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:06:44.372078 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Cannot 'shelve' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state shelved_offloaded Feb 19 21:06:44.372731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 409 to user: Cannot 'shelve' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state shelved_offloaded {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:44.373657 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4580bf67-1d5c-45ef-970e-d8cb6e0ebc3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 409 len: 155 microversion: 2.1 time: 0.083091 Feb 19 21:06:44.377569 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1934/3763] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:06:44 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 155 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:06:44.381249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3b1d0bdb-0f16-457a-8650-2293c196a6ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:44.382414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3b1d0bdb-0f16-457a-8650-2293c196a6ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:44.428817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b1d0bdb-0f16-457a-8650-2293c196a6ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:44.430978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b1d0bdb-0f16-457a-8650-2293c196a6ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:44.431900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b1d0bdb-0f16-457a-8650-2293c196a6ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:44.432410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b1d0bdb-0f16-457a-8650-2293c196a6ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:45.181011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9195282d-b11e-4354-8e9d-ad8b3a3af698 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:45.189942 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9195282d-b11e-4354-8e9d-ad8b3a3af698 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1314 microversion: 2.1 time: 1.109510 Feb 19 21:06:45.202281 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1830/3764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:44 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1314 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:45.209088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2cb1549b-e240-4f7a-abe4-931ac0793ea8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:45.209808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2cb1549b-e240-4f7a-abe4-931ac0793ea8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:45.220518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cb1549b-e240-4f7a-abe4-931ac0793ea8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:45.221120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cb1549b-e240-4f7a-abe4-931ac0793ea8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:45.222247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cb1549b-e240-4f7a-abe4-931ac0793ea8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:45.222799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cb1549b-e240-4f7a-abe4-931ac0793ea8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:45.245596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3b1d0bdb-0f16-457a-8650-2293c196a6ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:45.254865 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3b1d0bdb-0f16-457a-8650-2293c196a6ca tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.878953 Feb 19 21:06:45.258208 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1935/3765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:44 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:45.280751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-47ac6669-c514-49e7-aad8-cd2b639a060d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:45.281515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-47ac6669-c514-49e7-aad8-cd2b639a060d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: cb730c4e-37cc-47fd-a5c0-a4131d1990a9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:45.287895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47ac6669-c514-49e7-aad8-cd2b639a060d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:45.288627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47ac6669-c514-49e7-aad8-cd2b639a060d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:45.289713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47ac6669-c514-49e7-aad8-cd2b639a060d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:45.290144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-47ac6669-c514-49e7-aad8-cd2b639a060d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:45.307661 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-47ac6669-c514-49e7-aad8-cd2b639a060d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] HTTP exception thrown: Instance cb730c4e-37cc-47fd-a5c0-a4131d1990a9 could not be found. Feb 19 21:06:45.308277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-47ac6669-c514-49e7-aad8-cd2b639a060d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Returning 404 to user: Instance cb730c4e-37cc-47fd-a5c0-a4131d1990a9 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:45.310115 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-47ac6669-c514-49e7-aad8-cd2b639a060d tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9" status: 404 len: 111 microversion: 2.1 time: 0.048490 Feb 19 21:06:45.310707 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1936/3766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:45 2022] GET /compute/v2.1/servers/cb730c4e-37cc-47fd-a5c0-a4131d1990a9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:45.546064 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2cb1549b-e240-4f7a-abe4-931ac0793ea8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 202 len: 0 microversion: 2.1 time: 0.342394 Feb 19 21:06:45.551606 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1831/3767] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:06:45 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:06:45.559959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f5976e52-f002-4f46-86e7-3da2fa948abf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:45.560862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f5976e52-f002-4f46-86e7-3da2fa948abf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:45.591653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5976e52-f002-4f46-86e7-3da2fa948abf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:45.592600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5976e52-f002-4f46-86e7-3da2fa948abf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:45.593389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5976e52-f002-4f46-86e7-3da2fa948abf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:45.593944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f5976e52-f002-4f46-86e7-3da2fa948abf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:46.149950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2d0dbb42-c8bc-4fb3-a457-050683c13462 req-38048483-dc21-41de-8b4d-386b1f6aec46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb730c4e-37cc-47fd-a5c0-a4131d1990a9", "name": "network-vif-deleted", "tag": "83b4b2cc-2908-4fac-942a-a2052608566d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:46.155571 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:46.155571 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:46.195961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f5976e52-f002-4f46-86e7-3da2fa948abf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:46.205362 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f5976e52-f002-4f46-86e7-3da2fa948abf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1461 microversion: 2.1 time: 0.649226 Feb 19 21:06:46.216017 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1937/3768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:45 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1461 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:46.216017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-339e1aed-d7aa-4343-8065-3e44c8b6ccf1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:46.216017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-339e1aed-d7aa-4343-8065-3e44c8b6ccf1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:46.218867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2d0dbb42-c8bc-4fb3-a457-050683c13462 req-38048483-dc21-41de-8b4d-386b1f6aec46 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:46.219543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2d0dbb42-c8bc-4fb3-a457-050683c13462 req-38048483-dc21-41de-8b4d-386b1f6aec46 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:46.225259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-339e1aed-d7aa-4343-8065-3e44c8b6ccf1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:46.225773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-339e1aed-d7aa-4343-8065-3e44c8b6ccf1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:46.227243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-339e1aed-d7aa-4343-8065-3e44c8b6ccf1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:46.227680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-339e1aed-d7aa-4343-8065-3e44c8b6ccf1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:46.242287 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2d0dbb42-c8bc-4fb3-a457-050683c13462 req-38048483-dc21-41de-8b4d-386b1f6aec46 service nova] Creating event network-vif-deleted:83b4b2cc-2908-4fac-942a-a2052608566d for instance cb730c4e-37cc-47fd-a5c0-a4131d1990a9 on nch1-master-1 Feb 19 21:06:46.252125 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2d0dbb42-c8bc-4fb3-a457-050683c13462 req-38048483-dc21-41de-8b4d-386b1f6aec46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113320 Feb 19 21:06:46.252795 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1832/3769] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:46.546212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-339e1aed-d7aa-4343-8065-3e44c8b6ccf1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:46.567612 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-339e1aed-d7aa-4343-8065-3e44c8b6ccf1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1314 microversion: 2.1 time: 0.357908 Feb 19 21:06:46.568730 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1938/3770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:46 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:47.031408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f390e061-cfcb-486f-8ae2-a85f1da9419c req-e12c17c6-5a90-4aef-bd2a-3e7b3fe7d708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ca5e86-5e05-49e1-a775-7d5553410ecb", "name": "network-vif-plugged", "status": "completed", "tag": "38e30f6a-a9e0-47fd-87cc-5f95e86df571"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:47.033774 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:47.033774 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:47.052622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f390e061-cfcb-486f-8ae2-a85f1da9419c req-e12c17c6-5a90-4aef-bd2a-3e7b3fe7d708 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:47.053411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f390e061-cfcb-486f-8ae2-a85f1da9419c req-e12c17c6-5a90-4aef-bd2a-3e7b3fe7d708 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:47.071538 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f390e061-cfcb-486f-8ae2-a85f1da9419c req-e12c17c6-5a90-4aef-bd2a-3e7b3fe7d708 service nova] Creating event network-vif-plugged:38e30f6a-a9e0-47fd-87cc-5f95e86df571 for instance 76ca5e86-5e05-49e1-a775-7d5553410ecb on nch1-master-1 Feb 19 21:06:47.090553 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f390e061-cfcb-486f-8ae2-a85f1da9419c req-e12c17c6-5a90-4aef-bd2a-3e7b3fe7d708 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061796 Feb 19 21:06:47.091491 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1833/3771] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:47.223382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44fd2d20-fe09-466b-9e69-2fcd0583ec5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:47.224126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-44fd2d20-fe09-466b-9e69-2fcd0583ec5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:47.238303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44fd2d20-fe09-466b-9e69-2fcd0583ec5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:47.238819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44fd2d20-fe09-466b-9e69-2fcd0583ec5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:47.239761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44fd2d20-fe09-466b-9e69-2fcd0583ec5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:47.240304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44fd2d20-fe09-466b-9e69-2fcd0583ec5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:47.587228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4277436e-dc8b-4cd1-ae69-7e4015d00663 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:47.588281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4277436e-dc8b-4cd1-ae69-7e4015d00663 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:47.604279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4277436e-dc8b-4cd1-ae69-7e4015d00663 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:47.605679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4277436e-dc8b-4cd1-ae69-7e4015d00663 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:47.606657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4277436e-dc8b-4cd1-ae69-7e4015d00663 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:47.609227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4277436e-dc8b-4cd1-ae69-7e4015d00663 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:47.686269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44fd2d20-fe09-466b-9e69-2fcd0583ec5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:47.706202 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44fd2d20-fe09-466b-9e69-2fcd0583ec5c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 0.486634 Feb 19 21:06:47.718664 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1939/3772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:47 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:47.895361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4277436e-dc8b-4cd1-ae69-7e4015d00663 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:47.910183 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4277436e-dc8b-4cd1-ae69-7e4015d00663 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1314 microversion: 2.1 time: 0.328479 Feb 19 21:06:47.918319 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1834/3773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:47 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:48.725589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8d7649cf-7e3e-46d6-858f-12c279c8b67d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:48.726930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8d7649cf-7e3e-46d6-858f-12c279c8b67d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:48.742861 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d7649cf-7e3e-46d6-858f-12c279c8b67d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:48.743883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d7649cf-7e3e-46d6-858f-12c279c8b67d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:48.745385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d7649cf-7e3e-46d6-858f-12c279c8b67d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:48.745998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d7649cf-7e3e-46d6-858f-12c279c8b67d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:48.934000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8d7649cf-7e3e-46d6-858f-12c279c8b67d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:48.942493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-26f6eed1-4271-4519-87b8-2ffec2320d03 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:48.945301 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8d7649cf-7e3e-46d6-858f-12c279c8b67d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 0.223504 Feb 19 21:06:48.945535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-26f6eed1-4271-4519-87b8-2ffec2320d03 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:48.946637 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1940/3774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:48 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:48.967623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26f6eed1-4271-4519-87b8-2ffec2320d03 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:48.968544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26f6eed1-4271-4519-87b8-2ffec2320d03 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:48.969733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26f6eed1-4271-4519-87b8-2ffec2320d03 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:48.971015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26f6eed1-4271-4519-87b8-2ffec2320d03 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:49.180651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-26f6eed1-4271-4519-87b8-2ffec2320d03 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:49.191005 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-26f6eed1-4271-4519-87b8-2ffec2320d03 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1501 microversion: 2.1 time: 0.262316 Feb 19 21:06:49.191608 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1835/3775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:48 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:49.207687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f14c6517-714e-487f-94bf-7a4efaf5edb7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:49.208181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f14c6517-714e-487f-94bf-7a4efaf5edb7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:49.214887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f14c6517-714e-487f-94bf-7a4efaf5edb7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:49.215341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f14c6517-714e-487f-94bf-7a4efaf5edb7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:49.216127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f14c6517-714e-487f-94bf-7a4efaf5edb7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:49.220908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f14c6517-714e-487f-94bf-7a4efaf5edb7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:49.287722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f14c6517-714e-487f-94bf-7a4efaf5edb7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:06:49.514541 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f14c6517-714e-487f-94bf-7a4efaf5edb7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 204 len: 0 microversion: 2.1 time: 0.310120 Feb 19 21:06:49.515175 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1941/3776] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:06:49 2022] DELETE /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:06:49.525093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-710175a7-7f23-48db-ab57-00a2532c576e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:49.526024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-710175a7-7f23-48db-ab57-00a2532c576e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:49.535891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-710175a7-7f23-48db-ab57-00a2532c576e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:49.536697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-710175a7-7f23-48db-ab57-00a2532c576e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:49.537669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-710175a7-7f23-48db-ab57-00a2532c576e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:49.538283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-710175a7-7f23-48db-ab57-00a2532c576e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:49.963005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a9e14450-ef02-4f21-ad5b-a991cc4186b4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:49.964527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a9e14450-ef02-4f21-ad5b-a991cc4186b4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:49.987354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9e14450-ef02-4f21-ad5b-a991cc4186b4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:49.987826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9e14450-ef02-4f21-ad5b-a991cc4186b4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:49.993789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9e14450-ef02-4f21-ad5b-a991cc4186b4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:49.994261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9e14450-ef02-4f21-ad5b-a991cc4186b4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:50.102822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-710175a7-7f23-48db-ab57-00a2532c576e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:50.115006 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-710175a7-7f23-48db-ab57-00a2532c576e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1507 microversion: 2.1 time: 0.594351 Feb 19 21:06:50.116369 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1836/3777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:49 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:50.639775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2140533913", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "a7720066-6763-4cf2-8422-94736652addc"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:50.843696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] validate_networks() for [('a7720066-6763-4cf2-8422-94736652addc', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:06:52.093633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a9e14450-ef02-4f21-ad5b-a991cc4186b4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:52.114771 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a9e14450-ef02-4f21-ad5b-a991cc4186b4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 2.153114 Feb 19 21:06:52.117245 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1942/3778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:49 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:52.133582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b0467b02-e145-4ff3-af89-f11046a691ea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:52.134200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b0467b02-e145-4ff3-af89-f11046a691ea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:52.151157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0467b02-e145-4ff3-af89-f11046a691ea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:52.152199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0467b02-e145-4ff3-af89-f11046a691ea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:52.153648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0467b02-e145-4ff3-af89-f11046a691ea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:52.154406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0467b02-e145-4ff3-af89-f11046a691ea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:52.954515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b0467b02-e145-4ff3-af89-f11046a691ea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:52.966307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b0467b02-e145-4ff3-af89-f11046a691ea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1507 microversion: 2.1 time: 0.846512 Feb 19 21:06:52.969684 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1943/3779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:52 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1507 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:53.040779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:06:53.041364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:06:53.041696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:06:53.042107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:06:53.043034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:06:53.069399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:53.074790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:53.076022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:53.086474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:53.138346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d147f4d2-9559-4215-845f-677bc74b14de tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:53.139154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d147f4d2-9559-4215-845f-677bc74b14de tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:53.154175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d147f4d2-9559-4215-845f-677bc74b14de tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:53.154647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d147f4d2-9559-4215-845f-677bc74b14de tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:53.155486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d147f4d2-9559-4215-845f-677bc74b14de tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:53.155931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d147f4d2-9559-4215-845f-677bc74b14de tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:53.165032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Getting quotas for project ba9b396737a34280bdc448a2b0df5a7e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:06:53.178040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Getting quotas for user 0edf621841d44514b6082172d15af2a7 and project ba9b396737a34280bdc448a2b0df5a7e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:06:53.236460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:06:53.248263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:06:53.390956 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b657838a-2264-459c-9a4a-7d5646a53681 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.759246 Feb 19 21:06:53.391695 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1837/3780] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:06:53.425172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-28764d07-2662-4df4-96a6-bea8dba15181 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:53.426468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-28764d07-2662-4df4-96a6-bea8dba15181 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:54.270327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-28764d07-2662-4df4-96a6-bea8dba15181 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:54.295381 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-28764d07-2662-4df4-96a6-bea8dba15181 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1219 microversion: 2.1 time: 0.893860 Feb 19 21:06:54.308274 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1838/3781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:53 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1219 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:54.344250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-36288174-4fbe-48bd-ba64-be81dfddc873 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:54.353327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-36288174-4fbe-48bd-ba64-be81dfddc873 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:54.386875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36288174-4fbe-48bd-ba64-be81dfddc873 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:54.387711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36288174-4fbe-48bd-ba64-be81dfddc873 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:54.400802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36288174-4fbe-48bd-ba64-be81dfddc873 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:54.401860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36288174-4fbe-48bd-ba64-be81dfddc873 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:54.779636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d147f4d2-9559-4215-845f-677bc74b14de tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:54.791660 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d147f4d2-9559-4215-845f-677bc74b14de tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 1.659403 Feb 19 21:06:54.805525 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1944/3782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:53 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:55.340454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9ac5a6eb-e186-4981-8bd9-13001b29b829 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:55.342975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9ac5a6eb-e186-4981-8bd9-13001b29b829 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:55.431617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ac5a6eb-e186-4981-8bd9-13001b29b829 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:55.438196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ac5a6eb-e186-4981-8bd9-13001b29b829 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:55.444473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ac5a6eb-e186-4981-8bd9-13001b29b829 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:55.455980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ac5a6eb-e186-4981-8bd9-13001b29b829 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:55.548907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-36288174-4fbe-48bd-ba64-be81dfddc873 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:55.561696 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-36288174-4fbe-48bd-ba64-be81dfddc873 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 200 len: 1507 microversion: 2.1 time: 1.251368 Feb 19 21:06:55.562292 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1839/3783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:54 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 1507 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:55.587457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-cb1dd8e3-8772-4826-9fd2-8ea921baa6d3 req-11370df4-4cff-4cbd-aefb-7a0b8427a7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ca5e86-5e05-49e1-a775-7d5553410ecb", "name": "network-vif-deleted", "tag": "38e30f6a-a9e0-47fd-87cc-5f95e86df571"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:55.600071 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:06:55.600071 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:06:55.629867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cb1dd8e3-8772-4826-9fd2-8ea921baa6d3 req-11370df4-4cff-4cbd-aefb-7a0b8427a7b6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:55.630336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cb1dd8e3-8772-4826-9fd2-8ea921baa6d3 req-11370df4-4cff-4cbd-aefb-7a0b8427a7b6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:55.669401 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-cb1dd8e3-8772-4826-9fd2-8ea921baa6d3 req-11370df4-4cff-4cbd-aefb-7a0b8427a7b6 service nova] Creating event network-vif-deleted:38e30f6a-a9e0-47fd-87cc-5f95e86df571 for instance 76ca5e86-5e05-49e1-a775-7d5553410ecb on nch1-master-1 Feb 19 21:06:55.706054 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-cb1dd8e3-8772-4826-9fd2-8ea921baa6d3 req-11370df4-4cff-4cbd-aefb-7a0b8427a7b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142504 Feb 19 21:06:55.706688 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1840/3784] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:06:55.793934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9ac5a6eb-e186-4981-8bd9-13001b29b829 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:55.801971 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9ac5a6eb-e186-4981-8bd9-13001b29b829 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1279 microversion: 2.1 time: 0.475557 Feb 19 21:06:55.810070 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1945/3785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:55 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1279 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:06:55.837201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d993146d-a044-4080-89a4-1c839604f298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:55.838192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d993146d-a044-4080-89a4-1c839604f298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:55.853165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d993146d-a044-4080-89a4-1c839604f298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:55.853914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d993146d-a044-4080-89a4-1c839604f298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:55.854914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d993146d-a044-4080-89a4-1c839604f298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:55.855518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d993146d-a044-4080-89a4-1c839604f298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:56.415506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d993146d-a044-4080-89a4-1c839604f298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:56.424459 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d993146d-a044-4080-89a4-1c839604f298 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 0.591151 Feb 19 21:06:56.433058 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1841/3786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:55 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:56.580203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-35c72f93-b12c-4521-83e8-a975de9e7636 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:56.581002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-35c72f93-b12c-4521-83e8-a975de9e7636 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:56.594448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35c72f93-b12c-4521-83e8-a975de9e7636 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:56.598669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35c72f93-b12c-4521-83e8-a975de9e7636 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:56.599807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35c72f93-b12c-4521-83e8-a975de9e7636 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:56.602260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35c72f93-b12c-4521-83e8-a975de9e7636 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:56.637953 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-35c72f93-b12c-4521-83e8-a975de9e7636 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 76ca5e86-5e05-49e1-a775-7d5553410ecb could not be found. Feb 19 21:06:56.638714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-35c72f93-b12c-4521-83e8-a975de9e7636 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 76ca5e86-5e05-49e1-a775-7d5553410ecb could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:06:56.639608 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-35c72f93-b12c-4521-83e8-a975de9e7636 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 404 len: 111 microversion: 2.1 time: 0.064230 Feb 19 21:06:56.640161 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1946/3787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:56 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:06:56.827558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-42ec9e6e-5df0-4364-b2fd-ca5fc10a1640 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:56.828446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-42ec9e6e-5df0-4364-b2fd-ca5fc10a1640 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:56.842615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42ec9e6e-5df0-4364-b2fd-ca5fc10a1640 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:56.843841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42ec9e6e-5df0-4364-b2fd-ca5fc10a1640 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:56.846866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42ec9e6e-5df0-4364-b2fd-ca5fc10a1640 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:56.848318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42ec9e6e-5df0-4364-b2fd-ca5fc10a1640 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:56.979078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1262276522", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "be9178cb-fadc-423e-95e2-979af3a2f95e"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:06:57.122923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-42ec9e6e-5df0-4364-b2fd-ca5fc10a1640 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:57.129743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] validate_networks() for [('be9178cb-fadc-423e-95e2-979af3a2f95e', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:06:57.154296 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-42ec9e6e-5df0-4364-b2fd-ca5fc10a1640 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1277 microversion: 2.1 time: 0.330901 Feb 19 21:06:57.172083 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1842/3788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:56 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1277 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:57.451304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-de492fb8-cef6-4035-a93e-b7dcb0160540 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:57.451979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-de492fb8-cef6-4035-a93e-b7dcb0160540 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:57.469117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de492fb8-cef6-4035-a93e-b7dcb0160540 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:57.470497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de492fb8-cef6-4035-a93e-b7dcb0160540 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:57.471376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de492fb8-cef6-4035-a93e-b7dcb0160540 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:57.477638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de492fb8-cef6-4035-a93e-b7dcb0160540 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:59.858164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-de492fb8-cef6-4035-a93e-b7dcb0160540 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:06:59.871851 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-de492fb8-cef6-4035-a93e-b7dcb0160540 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 2.424496 Feb 19 21:06:59.877275 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1843/3789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:57 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 2430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:06:59.898704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-602fc52f-2530-4d5f-8a71-e5875741836e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:06:59.899804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-602fc52f-2530-4d5f-8a71-e5875741836e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:06:59.922766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-602fc52f-2530-4d5f-8a71-e5875741836e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:59.923997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-602fc52f-2530-4d5f-8a71-e5875741836e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:06:59.926231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-602fc52f-2530-4d5f-8a71-e5875741836e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:06:59.928236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-602fc52f-2530-4d5f-8a71-e5875741836e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:00.779243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:07:00.781208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:07:00.784234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:07:00.785304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:07:00.786256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:07:00.827121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:00.827995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:00.829116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:00.829821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:00.830189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-602fc52f-2530-4d5f-8a71-e5875741836e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:00.842255 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-602fc52f-2530-4d5f-8a71-e5875741836e tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1319 microversion: 2.1 time: 0.962987 Feb 19 21:07:00.843758 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1844/3790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:06:59 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1319 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:00.871228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:00.886103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for user 20246495a35b4762be5b2ad98f537377 and project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:00.903307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d11e7566-6337-465e-8e4f-9d040fdc8dca tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:00.904073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d11e7566-6337-465e-8e4f-9d040fdc8dca tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:00.915748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d11e7566-6337-465e-8e4f-9d040fdc8dca tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:00.921009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d11e7566-6337-465e-8e4f-9d040fdc8dca tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:00.924001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d11e7566-6337-465e-8e4f-9d040fdc8dca tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:00.925423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d11e7566-6337-465e-8e4f-9d040fdc8dca tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:00.943661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:07:00.950619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:07:01.127169 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a75ac9a3-9168-49b8-95dc-3fe67d76628e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.152520 Feb 19 21:07:01.135962 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1947/3791] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:07:01.151049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c0b85757-2cb4-4538-8f6a-557d0ebd6408 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:01.157276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c0b85757-2cb4-4538-8f6a-557d0ebd6408 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:01.462481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c0b85757-2cb4-4538-8f6a-557d0ebd6408 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:01.471113 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c0b85757-2cb4-4538-8f6a-557d0ebd6408 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1215 microversion: 2.1 time: 0.331665 Feb 19 21:07:01.475022 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1948/3792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:01 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:01.860437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7df021ff-7488-4c97-b608-184f93814078 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:01.861832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7df021ff-7488-4c97-b608-184f93814078 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:01.877437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7df021ff-7488-4c97-b608-184f93814078 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:01.888290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7df021ff-7488-4c97-b608-184f93814078 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:01.889657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7df021ff-7488-4c97-b608-184f93814078 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:01.893927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7df021ff-7488-4c97-b608-184f93814078 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:02.101391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d11e7566-6337-465e-8e4f-9d040fdc8dca tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:02.111216 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d11e7566-6337-465e-8e4f-9d040fdc8dca tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 1.211569 Feb 19 21:07:02.121480 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1845/3793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:00 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:02.492251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2225bfd0-3ed6-4cf5-9631-0133be4bc0cc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:02.501027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2225bfd0-3ed6-4cf5-9631-0133be4bc0cc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:02.509712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2225bfd0-3ed6-4cf5-9631-0133be4bc0cc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:02.510718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2225bfd0-3ed6-4cf5-9631-0133be4bc0cc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:02.511730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2225bfd0-3ed6-4cf5-9631-0133be4bc0cc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:02.512508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2225bfd0-3ed6-4cf5-9631-0133be4bc0cc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:02.654430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2225bfd0-3ed6-4cf5-9631-0133be4bc0cc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:02.662777 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2225bfd0-3ed6-4cf5-9631-0133be4bc0cc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1219 microversion: 2.1 time: 0.175396 Feb 19 21:07:02.666639 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1846/3794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:02 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1219 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:02.893103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7df021ff-7488-4c97-b608-184f93814078 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:02.903726 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7df021ff-7488-4c97-b608-184f93814078 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1319 microversion: 2.1 time: 1.046862 Feb 19 21:07:02.904346 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1949/3795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:01 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1319 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:03.131067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1745fda5-70bd-4859-b6e4-ecc772d054b1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:03.131670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1745fda5-70bd-4859-b6e4-ecc772d054b1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:03.151035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1745fda5-70bd-4859-b6e4-ecc772d054b1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:03.152006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1745fda5-70bd-4859-b6e4-ecc772d054b1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:03.152356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1745fda5-70bd-4859-b6e4-ecc772d054b1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:03.152873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1745fda5-70bd-4859-b6e4-ecc772d054b1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:03.456842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-917b16fa-4ee4-4b16-bfbe-f9159b7524c8 req-72eb5ef1-cc7e-4392-b1b4-c259f49d1700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5340f4f1-b817-484c-a352-a4452e9a3b5d", "tag": "4c79265f-54cf-4b0b-a603-70533b9a21e1"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:03.458583 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:03.458583 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:07:03.478646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-917b16fa-4ee4-4b16-bfbe-f9159b7524c8 req-72eb5ef1-cc7e-4392-b1b4-c259f49d1700 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:03.479324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-917b16fa-4ee4-4b16-bfbe-f9159b7524c8 req-72eb5ef1-cc7e-4392-b1b4-c259f49d1700 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:03.499658 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-917b16fa-4ee4-4b16-bfbe-f9159b7524c8 req-72eb5ef1-cc7e-4392-b1b4-c259f49d1700 service nova] Creating event network-changed:4c79265f-54cf-4b0b-a603-70533b9a21e1 for instance 5340f4f1-b817-484c-a352-a4452e9a3b5d on nch1-master-1 Feb 19 21:07:03.521792 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-917b16fa-4ee4-4b16-bfbe-f9159b7524c8 req-72eb5ef1-cc7e-4392-b1b4-c259f49d1700 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068032 Feb 19 21:07:03.524250 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1950/3796] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:07:03.551179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1745fda5-70bd-4859-b6e4-ecc772d054b1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:03.565036 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1745fda5-70bd-4859-b6e4-ecc772d054b1 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 0.439773 Feb 19 21:07:03.576067 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1847/3797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:03 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:03.685110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-33075f52-d76b-4c2d-841d-4fb806a3971f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:03.685999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-33075f52-d76b-4c2d-841d-4fb806a3971f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:03.697327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33075f52-d76b-4c2d-841d-4fb806a3971f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:03.699849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33075f52-d76b-4c2d-841d-4fb806a3971f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:03.704367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33075f52-d76b-4c2d-841d-4fb806a3971f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:03.704367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33075f52-d76b-4c2d-841d-4fb806a3971f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:03.923683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b0869fdc-3b29-4efc-8a8f-e35ae9b16c76 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:03.924505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b0869fdc-3b29-4efc-8a8f-e35ae9b16c76 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:03.942936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0869fdc-3b29-4efc-8a8f-e35ae9b16c76 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:03.945266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0869fdc-3b29-4efc-8a8f-e35ae9b16c76 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:03.954848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0869fdc-3b29-4efc-8a8f-e35ae9b16c76 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:03.956437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0869fdc-3b29-4efc-8a8f-e35ae9b16c76 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:04.018299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-33075f52-d76b-4c2d-841d-4fb806a3971f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:04.038072 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-33075f52-d76b-4c2d-841d-4fb806a3971f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1275 microversion: 2.1 time: 0.358437 Feb 19 21:07:04.039627 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1951/3798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:03 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1275 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:04.459111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b0869fdc-3b29-4efc-8a8f-e35ae9b16c76 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:04.470902 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b0869fdc-3b29-4efc-8a8f-e35ae9b16c76 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1319 microversion: 2.1 time: 0.553233 Feb 19 21:07:04.479171 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1848/3799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:03 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:04.618501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-99cb3aec-a6a8-4158-aa23-d54fb56e0d79 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:04.620303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-99cb3aec-a6a8-4158-aa23-d54fb56e0d79 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:04.638143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99cb3aec-a6a8-4158-aa23-d54fb56e0d79 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:04.639893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99cb3aec-a6a8-4158-aa23-d54fb56e0d79 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:04.641582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99cb3aec-a6a8-4158-aa23-d54fb56e0d79 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:04.642385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99cb3aec-a6a8-4158-aa23-d54fb56e0d79 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:05.056878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-80d972ca-3c6f-4875-9db1-3a0e4c1a367d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:05.058024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-80d972ca-3c6f-4875-9db1-3a0e4c1a367d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:05.067115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80d972ca-3c6f-4875-9db1-3a0e4c1a367d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:05.068123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80d972ca-3c6f-4875-9db1-3a0e4c1a367d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:05.070863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80d972ca-3c6f-4875-9db1-3a0e4c1a367d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:05.071759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80d972ca-3c6f-4875-9db1-3a0e4c1a367d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:05.425590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-80d972ca-3c6f-4875-9db1-3a0e4c1a367d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:05.447049 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-80d972ca-3c6f-4875-9db1-3a0e4c1a367d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1273 microversion: 2.1 time: 0.395291 Feb 19 21:07:05.448673 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1849/3800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:05 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1273 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:05.490212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c537708c-b7f7-4ae3-a4d7-ab90e821b62f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:05.492855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c537708c-b7f7-4ae3-a4d7-ab90e821b62f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:05.501794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c537708c-b7f7-4ae3-a4d7-ab90e821b62f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:05.502757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c537708c-b7f7-4ae3-a4d7-ab90e821b62f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:05.503788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c537708c-b7f7-4ae3-a4d7-ab90e821b62f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:05.505138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c537708c-b7f7-4ae3-a4d7-ab90e821b62f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:05.664931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-99cb3aec-a6a8-4158-aa23-d54fb56e0d79 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:05.679099 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-99cb3aec-a6a8-4158-aa23-d54fb56e0d79 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 1.098377 Feb 19 21:07:05.688879 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1952/3801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:04 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:06.067689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c537708c-b7f7-4ae3-a4d7-ab90e821b62f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:06.077330 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c537708c-b7f7-4ae3-a4d7-ab90e821b62f tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1319 microversion: 2.1 time: 0.592692 Feb 19 21:07:06.085879 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1850/3802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:05 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:06.473898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e6b91306-7fa5-47e7-8af8-51f12998700b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:06.477612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e6b91306-7fa5-47e7-8af8-51f12998700b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:06.517398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6b91306-7fa5-47e7-8af8-51f12998700b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:06.517890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6b91306-7fa5-47e7-8af8-51f12998700b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:06.527646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6b91306-7fa5-47e7-8af8-51f12998700b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:06.528096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6b91306-7fa5-47e7-8af8-51f12998700b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:06.698926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1d3f07c1-df5e-491e-91d4-eef91a0f28b3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:06.700170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1d3f07c1-df5e-491e-91d4-eef91a0f28b3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:06.716770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d3f07c1-df5e-491e-91d4-eef91a0f28b3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:06.717604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d3f07c1-df5e-491e-91d4-eef91a0f28b3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:06.720795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d3f07c1-df5e-491e-91d4-eef91a0f28b3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:06.729912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d3f07c1-df5e-491e-91d4-eef91a0f28b3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:07.687512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e6b91306-7fa5-47e7-8af8-51f12998700b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:07.701730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1d3f07c1-df5e-491e-91d4-eef91a0f28b3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:07.705719 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e6b91306-7fa5-47e7-8af8-51f12998700b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1315 microversion: 2.1 time: 1.242601 Feb 19 21:07:07.706324 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1953/3803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:06 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1315 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:07.715516 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1d3f07c1-df5e-491e-91d4-eef91a0f28b3 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 1.022937 Feb 19 21:07:07.717640 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1851/3804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:06 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:07.753101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e5e5d1f6-2a11-448c-97a3-767ba710dda5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:07.754862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e5e5d1f6-2a11-448c-97a3-767ba710dda5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:07.765195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-1004e528-d339-46f5-9fd1-75812ab3a7e9 req-d101c81f-84b8-44ae-87be-0f13d72c3ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63482c29-4a39-4eaa-9bf1-de6107d9b0f0", "name": "network-vif-plugged", "status": "completed", "tag": "a943b989-5a95-44a3-9a78-35384327a397"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:07.767546 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:07.767546 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:07:07.796244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1004e528-d339-46f5-9fd1-75812ab3a7e9 req-d101c81f-84b8-44ae-87be-0f13d72c3ac4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:07.797525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5e5d1f6-2a11-448c-97a3-767ba710dda5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:07.803307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5e5d1f6-2a11-448c-97a3-767ba710dda5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:07.803668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1004e528-d339-46f5-9fd1-75812ab3a7e9 req-d101c81f-84b8-44ae-87be-0f13d72c3ac4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:07.807993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5e5d1f6-2a11-448c-97a3-767ba710dda5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:07.808523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5e5d1f6-2a11-448c-97a3-767ba710dda5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:07.833044 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-1004e528-d339-46f5-9fd1-75812ab3a7e9 req-d101c81f-84b8-44ae-87be-0f13d72c3ac4 service nova] Creating event network-vif-plugged:a943b989-5a95-44a3-9a78-35384327a397 for instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 on nch1-master-1 Feb 19 21:07:07.844084 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-1004e528-d339-46f5-9fd1-75812ab3a7e9 req-d101c81f-84b8-44ae-87be-0f13d72c3ac4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083698 Feb 19 21:07:07.845504 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1852/3805] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:07:08.213792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e5e5d1f6-2a11-448c-97a3-767ba710dda5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:08.222999 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e5e5d1f6-2a11-448c-97a3-767ba710dda5 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1319 microversion: 2.1 time: 0.495830 Feb 19 21:07:08.223613 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1954/3806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:07 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:08.726426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-29007505-5418-4f8a-ad85-cdd9e6e2bb42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:08.728150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-29007505-5418-4f8a-ad85-cdd9e6e2bb42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:08.735279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a0efa7b4-caec-44a4-8361-6567366a444c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:08.736262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a0efa7b4-caec-44a4-8361-6567366a444c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:08.756911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0efa7b4-caec-44a4-8361-6567366a444c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:08.758903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29007505-5418-4f8a-ad85-cdd9e6e2bb42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:08.759481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29007505-5418-4f8a-ad85-cdd9e6e2bb42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:08.759782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0efa7b4-caec-44a4-8361-6567366a444c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:08.761547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29007505-5418-4f8a-ad85-cdd9e6e2bb42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:08.762115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29007505-5418-4f8a-ad85-cdd9e6e2bb42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:08.763949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0efa7b4-caec-44a4-8361-6567366a444c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:08.765801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0efa7b4-caec-44a4-8361-6567366a444c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:09.505010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a0efa7b4-caec-44a4-8361-6567366a444c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:09.514679 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a0efa7b4-caec-44a4-8361-6567366a444c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 0.784118 Feb 19 21:07:09.525588 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1955/3807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:08 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:09.530646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-775f523c-7076-41c6-a7db-5e2f5cfea09d req-8a9da795-606b-4151-9898-2c5a5072978b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1a6553-3c84-44a4-a3f7-159e22f8c9e2", "tag": "b110cc61-dab2-4486-a7cd-eb8a5572b017"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:09.532659 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:09.532659 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:07:09.549786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-775f523c-7076-41c6-a7db-5e2f5cfea09d req-8a9da795-606b-4151-9898-2c5a5072978b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:09.550992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-775f523c-7076-41c6-a7db-5e2f5cfea09d req-8a9da795-606b-4151-9898-2c5a5072978b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:09.579654 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-775f523c-7076-41c6-a7db-5e2f5cfea09d req-8a9da795-606b-4151-9898-2c5a5072978b service nova] Creating event network-changed:b110cc61-dab2-4486-a7cd-eb8a5572b017 for instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 on nch1-master-1 Feb 19 21:07:09.598168 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-775f523c-7076-41c6-a7db-5e2f5cfea09d req-8a9da795-606b-4151-9898-2c5a5072978b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070946 Feb 19 21:07:09.598793 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1956/3808] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:09.599008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-29007505-5418-4f8a-ad85-cdd9e6e2bb42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:09.606284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d677a180-1325-4a71-a07d-4a4d37f4af50 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:09.607287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d677a180-1325-4a71-a07d-4a4d37f4af50 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:09.619043 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-29007505-5418-4f8a-ad85-cdd9e6e2bb42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1315 microversion: 2.1 time: 0.898397 Feb 19 21:07:09.630568 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1853/3809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:08 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1315 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:09.634208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d677a180-1325-4a71-a07d-4a4d37f4af50 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:09.634677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d677a180-1325-4a71-a07d-4a4d37f4af50 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:09.635495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d677a180-1325-4a71-a07d-4a4d37f4af50 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:09.635942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d677a180-1325-4a71-a07d-4a4d37f4af50 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:10.391520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d677a180-1325-4a71-a07d-4a4d37f4af50 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:10.407866 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d677a180-1325-4a71-a07d-4a4d37f4af50 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1319 microversion: 2.1 time: 0.807312 Feb 19 21:07:10.410346 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1957/3810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:09 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1319 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:10.552451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d5dde3c0-f094-4692-99bd-7f34f4380d49 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:10.553266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d5dde3c0-f094-4692-99bd-7f34f4380d49 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:10.571813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5dde3c0-f094-4692-99bd-7f34f4380d49 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:10.572279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5dde3c0-f094-4692-99bd-7f34f4380d49 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:10.573111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5dde3c0-f094-4692-99bd-7f34f4380d49 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:10.573557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d5dde3c0-f094-4692-99bd-7f34f4380d49 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:10.649900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-77ba8b47-db1a-471b-8bd6-662e8995d781 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:10.650899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-77ba8b47-db1a-471b-8bd6-662e8995d781 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:10.662931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77ba8b47-db1a-471b-8bd6-662e8995d781 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:10.665794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77ba8b47-db1a-471b-8bd6-662e8995d781 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:10.666798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77ba8b47-db1a-471b-8bd6-662e8995d781 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:10.669804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-77ba8b47-db1a-471b-8bd6-662e8995d781 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:11.529468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d5dde3c0-f094-4692-99bd-7f34f4380d49 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:11.544370 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d5dde3c0-f094-4692-99bd-7f34f4380d49 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1519 microversion: 2.1 time: 0.997421 Feb 19 21:07:11.546691 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1854/3811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:10 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1519 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:11.572202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-525cb3cc-20a4-4f7a-ad98-a4e615c91947 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:11.574782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-525cb3cc-20a4-4f7a-ad98-a4e615c91947 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:11.589195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-525cb3cc-20a4-4f7a-ad98-a4e615c91947 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:11.589880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-525cb3cc-20a4-4f7a-ad98-a4e615c91947 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:11.590887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-525cb3cc-20a4-4f7a-ad98-a4e615c91947 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:11.591352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-525cb3cc-20a4-4f7a-ad98-a4e615c91947 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:11.652590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-77ba8b47-db1a-471b-8bd6-662e8995d781 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:11.662811 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-77ba8b47-db1a-471b-8bd6-662e8995d781 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1315 microversion: 2.1 time: 1.019176 Feb 19 21:07:11.673230 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1958/3812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:10 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1315 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:11.985437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-525cb3cc-20a4-4f7a-ad98-a4e615c91947 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:11.992918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-10248ea2-f9b9-479c-bd19-f1ca744bb95e req-9c5ce3ce-9b66-4b04-8dc6-a6ca2d79a33f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5340f4f1-b817-484c-a352-a4452e9a3b5d", "name": "network-vif-plugged", "status": "completed", "tag": "4c79265f-54cf-4b0b-a603-70533b9a21e1"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:11.996874 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:11.996874 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:07:12.006143 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-525cb3cc-20a4-4f7a-ad98-a4e615c91947 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1319 microversion: 2.1 time: 0.438940 Feb 19 21:07:12.007811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-10248ea2-f9b9-479c-bd19-f1ca744bb95e req-9c5ce3ce-9b66-4b04-8dc6-a6ca2d79a33f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:12.008974 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1855/3813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:11 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:12.018122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-10248ea2-f9b9-479c-bd19-f1ca744bb95e req-9c5ce3ce-9b66-4b04-8dc6-a6ca2d79a33f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:12.301368 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-10248ea2-f9b9-479c-bd19-f1ca744bb95e req-9c5ce3ce-9b66-4b04-8dc6-a6ca2d79a33f service nova] Creating event network-vif-plugged:4c79265f-54cf-4b0b-a603-70533b9a21e1 for instance 5340f4f1-b817-484c-a352-a4452e9a3b5d on nch1-master-1 Feb 19 21:07:12.307266 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-10248ea2-f9b9-479c-bd19-f1ca744bb95e req-9c5ce3ce-9b66-4b04-8dc6-a6ca2d79a33f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319140 Feb 19 21:07:12.307886 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1959/3814] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:07:12.577960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9a03778-e94a-46c2-9e54-03ac32e305ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:12.582543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9a03778-e94a-46c2-9e54-03ac32e305ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:12.592766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9a03778-e94a-46c2-9e54-03ac32e305ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:12.593834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9a03778-e94a-46c2-9e54-03ac32e305ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:12.594992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9a03778-e94a-46c2-9e54-03ac32e305ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:12.595689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9a03778-e94a-46c2-9e54-03ac32e305ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:12.685132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-333a2091-4409-4948-b825-ae3e90b81b4f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:12.691361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-333a2091-4409-4948-b825-ae3e90b81b4f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:12.716123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-333a2091-4409-4948-b825-ae3e90b81b4f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:12.717893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-333a2091-4409-4948-b825-ae3e90b81b4f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:12.718558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-333a2091-4409-4948-b825-ae3e90b81b4f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:12.719128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-333a2091-4409-4948-b825-ae3e90b81b4f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:13.000740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a9a03778-e94a-46c2-9e54-03ac32e305ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:13.010292 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9a03778-e94a-46c2-9e54-03ac32e305ae tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.442082 Feb 19 21:07:13.011105 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1856/3815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:12 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:13.028031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2e721e7-28c0-4620-8dc6-38a8a9899944 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:13.028875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c2e721e7-28c0-4620-8dc6-38a8a9899944 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:13.036994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2e721e7-28c0-4620-8dc6-38a8a9899944 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:13.038924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2e721e7-28c0-4620-8dc6-38a8a9899944 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:13.040199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2e721e7-28c0-4620-8dc6-38a8a9899944 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:13.040987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2e721e7-28c0-4620-8dc6-38a8a9899944 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:13.138421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-333a2091-4409-4948-b825-ae3e90b81b4f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:13.168085 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-333a2091-4409-4948-b825-ae3e90b81b4f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1315 microversion: 2.1 time: 0.490518 Feb 19 21:07:13.168953 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1960/3816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:12 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:13.197989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a49390b7-2e73-4315-a8b9-10edd39195d7 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:13.203742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a49390b7-2e73-4315-a8b9-10edd39195d7 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:13.234264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a49390b7-2e73-4315-a8b9-10edd39195d7 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:13.237966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a49390b7-2e73-4315-a8b9-10edd39195d7 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:13.239201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a49390b7-2e73-4315-a8b9-10edd39195d7 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:13.239734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a49390b7-2e73-4315-a8b9-10edd39195d7 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:13.358264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c2e721e7-28c0-4620-8dc6-38a8a9899944 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:13.373116 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c2e721e7-28c0-4620-8dc6-38a8a9899944 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.349108 Feb 19 21:07:13.374441 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1857/3817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:13 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:13.424494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa419300-fb25-46e9-83ac-f8c2099f2e4a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:13.427082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aa419300-fb25-46e9-83ac-f8c2099f2e4a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:13.443197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa419300-fb25-46e9-83ac-f8c2099f2e4a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:13.444182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa419300-fb25-46e9-83ac-f8c2099f2e4a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:13.446364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa419300-fb25-46e9-83ac-f8c2099f2e4a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:13.447115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa419300-fb25-46e9-83ac-f8c2099f2e4a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:13.595885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a49390b7-2e73-4315-a8b9-10edd39195d7 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:13.615137 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a49390b7-2e73-4315-a8b9-10edd39195d7 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1319 microversion: 2.1 time: 0.443276 Feb 19 21:07:13.618399 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1961/3818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:13 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1319 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:13.705789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa419300-fb25-46e9-83ac-f8c2099f2e4a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:13.719441 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa419300-fb25-46e9-83ac-f8c2099f2e4a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.307116 Feb 19 21:07:13.721462 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1858/3819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:13 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:13.737264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2009e574-713c-4185-ace6-392605991308 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:13.745220 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-2009e574-713c-4185-ace6-392605991308 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 49ae90de-a4a9-46c9-83c3-02a49bfe5ffb has no mapping to a cell. Feb 19 21:07:13.745932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2009e574-713c-4185-ace6-392605991308 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 49ae90de-a4a9-46c9-83c3-02a49bfe5ffb has no mapping to a cell. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:13.746967 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2009e574-713c-4185-ace6-392605991308 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/49ae90de-a4a9-46c9-83c3-02a49bfe5ffb/action" status: 404 len: 117 microversion: 2.1 time: 0.014042 Feb 19 21:07:13.747652 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1962/3820] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:13 2022] POST /compute/v2.1/servers/49ae90de-a4a9-46c9-83c3-02a49bfe5ffb/action => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:07:13.757139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6595946b-70fb-41b0-8e12-7117a98b9cd2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:13.757926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6595946b-70fb-41b0-8e12-7117a98b9cd2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:13.765607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6595946b-70fb-41b0-8e12-7117a98b9cd2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:13.766170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6595946b-70fb-41b0-8e12-7117a98b9cd2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:13.767087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6595946b-70fb-41b0-8e12-7117a98b9cd2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:13.767602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6595946b-70fb-41b0-8e12-7117a98b9cd2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:13.961629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6595946b-70fb-41b0-8e12-7117a98b9cd2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:13.970166 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6595946b-70fb-41b0-8e12-7117a98b9cd2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.217382 Feb 19 21:07:13.971305 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1859/3821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:13 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:13.990130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-659744e4-3d23-4890-886b-a4a28f485096 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:13.991920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-659744e4-3d23-4890-886b-a4a28f485096 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:13.999117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-659744e4-3d23-4890-886b-a4a28f485096 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:13.999828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-659744e4-3d23-4890-886b-a4a28f485096 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:14.000990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-659744e4-3d23-4890-886b-a4a28f485096 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:14.001735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-659744e4-3d23-4890-886b-a4a28f485096 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:14.210847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c8b99207-65b1-45db-a1da-5918f9c13ecc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:14.228975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c8b99207-65b1-45db-a1da-5918f9c13ecc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:14.248322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8b99207-65b1-45db-a1da-5918f9c13ecc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:14.258886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8b99207-65b1-45db-a1da-5918f9c13ecc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:14.261756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8b99207-65b1-45db-a1da-5918f9c13ecc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:14.267115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8b99207-65b1-45db-a1da-5918f9c13ecc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:14.403759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-659744e4-3d23-4890-886b-a4a28f485096 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:14.422847 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-659744e4-3d23-4890-886b-a4a28f485096 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.437818 Feb 19 21:07:14.438050 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1963/3822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:13 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:14.446785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f859081a-8e50-467d-a4b4-b4b8e096c446 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:14.449351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f859081a-8e50-467d-a4b4-b4b8e096c446 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 00dfb04d-718e-4a2b-9eb3-c79409442258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:14.457134 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-f859081a-8e50-467d-a4b4-b4b8e096c446 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 00dfb04d-718e-4a2b-9eb3-c79409442258 could not be found. Feb 19 21:07:14.459663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f859081a-8e50-467d-a4b4-b4b8e096c446 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 00dfb04d-718e-4a2b-9eb3-c79409442258 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:14.461161 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f859081a-8e50-467d-a4b4-b4b8e096c446 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/00dfb04d-718e-4a2b-9eb3-c79409442258/action" status: 404 len: 111 microversion: 2.1 time: 0.019438 Feb 19 21:07:14.466896 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1964/3823] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:14 2022] POST /compute/v2.1/servers/00dfb04d-718e-4a2b-9eb3-c79409442258/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:07:14.472971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7a6bd38-c2db-4881-84b0-f9fc0661972d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:14.473897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d7a6bd38-c2db-4881-84b0-f9fc0661972d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:14.482649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7a6bd38-c2db-4881-84b0-f9fc0661972d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:14.483464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7a6bd38-c2db-4881-84b0-f9fc0661972d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:14.484724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7a6bd38-c2db-4881-84b0-f9fc0661972d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:14.485360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7a6bd38-c2db-4881-84b0-f9fc0661972d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:14.624428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c8b99207-65b1-45db-a1da-5918f9c13ecc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:14.633787 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c8b99207-65b1-45db-a1da-5918f9c13ecc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1315 microversion: 2.1 time: 0.442482 Feb 19 21:07:14.637070 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1860/3824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:14 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:14.643653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-81c1147e-493d-458f-a808-b09068a0b8bc tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:14.644295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-81c1147e-493d-458f-a808-b09068a0b8bc tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:14.662516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81c1147e-493d-458f-a808-b09068a0b8bc tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:14.663006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81c1147e-493d-458f-a808-b09068a0b8bc tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:14.664467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81c1147e-493d-458f-a808-b09068a0b8bc tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:14.664940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81c1147e-493d-458f-a808-b09068a0b8bc tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:14.778054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d7a6bd38-c2db-4881-84b0-f9fc0661972d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:14.790070 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d7a6bd38-c2db-4881-84b0-f9fc0661972d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.321237 Feb 19 21:07:14.794644 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1965/3825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:14 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:14.810962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b3b2670f-aff1-4afb-9f97-0d190236e09d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:14.811929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b3b2670f-aff1-4afb-9f97-0d190236e09d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:14.820242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3b2670f-aff1-4afb-9f97-0d190236e09d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:14.820761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3b2670f-aff1-4afb-9f97-0d190236e09d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:14.821627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3b2670f-aff1-4afb-9f97-0d190236e09d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:14.822323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3b2670f-aff1-4afb-9f97-0d190236e09d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:15.025497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-81c1147e-493d-458f-a808-b09068a0b8bc tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:15.036696 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-81c1147e-493d-458f-a808-b09068a0b8bc tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1507 microversion: 2.1 time: 0.398398 Feb 19 21:07:15.037932 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1861/3826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:14 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:15.058425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-94de098a-f464-45bb-80dc-1097dee6b003 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c4659bd-63a9-4ccf-8885-d4725562e8a0", "device": "/dev/sdb"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:15.060288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-94de098a-f464-45bb-80dc-1097dee6b003 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:15.085073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94de098a-f464-45bb-80dc-1097dee6b003 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:15.086062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94de098a-f464-45bb-80dc-1097dee6b003 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:15.086902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94de098a-f464-45bb-80dc-1097dee6b003 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:15.087357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94de098a-f464-45bb-80dc-1097dee6b003 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:15.199950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b3b2670f-aff1-4afb-9f97-0d190236e09d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:15.215524 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b3b2670f-aff1-4afb-9f97-0d190236e09d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.408711 Feb 19 21:07:15.225022 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1966/3827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:14 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:15.245527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-35468d63-95e8-4404-9679-d662a77c3389 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:15.246252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-35468d63-95e8-4404-9679-d662a77c3389 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:15.259056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35468d63-95e8-4404-9679-d662a77c3389 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:15.259933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35468d63-95e8-4404-9679-d662a77c3389 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:15.261418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35468d63-95e8-4404-9679-d662a77c3389 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:15.263940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35468d63-95e8-4404-9679-d662a77c3389 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:15.380174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-35468d63-95e8-4404-9679-d662a77c3389 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lazy-loading 'flavor' on Instance uuid 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:07:15.571597 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-35468d63-95e8-4404-9679-d662a77c3389 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 202 len: 0 microversion: 2.1 time: 0.332822 Feb 19 21:07:15.575069 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1967/3828] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:15 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:07:15.589597 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-94de098a-f464-45bb-80dc-1097dee6b003 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "POST /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535495 Feb 19 21:07:15.597993 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1862/3829] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:07:15 2022] POST /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:07:15.630495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec2fe7e9-c5d1-4295-8fa0-4cae55586896 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:15.635315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ec2fe7e9-c5d1-4295-8fa0-4cae55586896 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:15.652755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec2fe7e9-c5d1-4295-8fa0-4cae55586896 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:15.653229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec2fe7e9-c5d1-4295-8fa0-4cae55586896 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:15.657563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec2fe7e9-c5d1-4295-8fa0-4cae55586896 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:15.658102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec2fe7e9-c5d1-4295-8fa0-4cae55586896 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:15.666706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-846cde63-87f1-4cfe-ac80-c30a7429e9fa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:15.672436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-846cde63-87f1-4cfe-ac80-c30a7429e9fa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:15.724864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846cde63-87f1-4cfe-ac80-c30a7429e9fa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:15.725463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846cde63-87f1-4cfe-ac80-c30a7429e9fa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:15.735922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846cde63-87f1-4cfe-ac80-c30a7429e9fa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:15.743737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846cde63-87f1-4cfe-ac80-c30a7429e9fa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:16.983112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec2fe7e9-c5d1-4295-8fa0-4cae55586896 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:17.000979 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec2fe7e9-c5d1-4295-8fa0-4cae55586896 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1514 microversion: 2.1 time: 1.402429 Feb 19 21:07:17.003400 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1968/3830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:15 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1514 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:17.045989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-846cde63-87f1-4cfe-ac80-c30a7429e9fa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:17.055499 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-846cde63-87f1-4cfe-ac80-c30a7429e9fa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1315 microversion: 2.1 time: 1.406750 Feb 19 21:07:17.070554 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1863/3831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:15 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1315 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:17.490610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2dffb60f-b2fa-447d-826c-c9539f2cda67 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:17.492409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2dffb60f-b2fa-447d-826c-c9539f2cda67 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:17.517816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2dffb60f-b2fa-447d-826c-c9539f2cda67 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:17.518270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2dffb60f-b2fa-447d-826c-c9539f2cda67 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:17.530044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2dffb60f-b2fa-447d-826c-c9539f2cda67 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:17.532532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2dffb60f-b2fa-447d-826c-c9539f2cda67 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:17.609801 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2dffb60f-b2fa-447d-826c-c9539f2cda67 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments/91b63972-f419-40a4-8d4f-37469baee526" status: 200 len: 194 microversion: 2.20 time: 0.126199 Feb 19 21:07:17.618568 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1969/3832] 10.222.0.30 () {60 vars in 1453 bytes} [Sat Feb 19 21:07:17 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments/91b63972-f419-40a4-8d4f-37469baee526 => generated 194 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:07:17.775153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-184a18f0-f3f6-47b6-b8b2-f982b516e105 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:17.775740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-184a18f0-f3f6-47b6-b8b2-f982b516e105 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:17.792256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-184a18f0-f3f6-47b6-b8b2-f982b516e105 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:17.794586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-184a18f0-f3f6-47b6-b8b2-f982b516e105 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:17.798118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-184a18f0-f3f6-47b6-b8b2-f982b516e105 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:17.798619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-184a18f0-f3f6-47b6-b8b2-f982b516e105 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:18.034130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-49c5278e-609b-41bb-84cd-5f14c229aacd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:18.037167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-49c5278e-609b-41bb-84cd-5f14c229aacd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:18.072872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49c5278e-609b-41bb-84cd-5f14c229aacd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:18.075381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49c5278e-609b-41bb-84cd-5f14c229aacd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:18.079621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49c5278e-609b-41bb-84cd-5f14c229aacd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:18.080545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49c5278e-609b-41bb-84cd-5f14c229aacd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:18.191824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-184a18f0-f3f6-47b6-b8b2-f982b516e105 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lazy-loading 'services' on Instance uuid 17524174-4cfd-409a-b6f4-15bde7d2c4d1 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:07:18.378729 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-184a18f0-f3f6-47b6-b8b2-f982b516e105 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments/91b63972-f419-40a4-8d4f-37469baee526" status: 202 len: 0 microversion: 2.20 time: 0.607918 Feb 19 21:07:18.381033 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1864/3833] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Feb 19 21:07:17 2022] DELETE /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments/91b63972-f419-40a4-8d4f-37469baee526 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:07:18.412777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-054ee907-e0e0-4ef0-9b52-8edee0a03c32 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:18.414983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-054ee907-e0e0-4ef0-9b52-8edee0a03c32 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:18.429410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-054ee907-e0e0-4ef0-9b52-8edee0a03c32 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:18.430644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-054ee907-e0e0-4ef0-9b52-8edee0a03c32 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:18.431694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-054ee907-e0e0-4ef0-9b52-8edee0a03c32 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:18.433302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-054ee907-e0e0-4ef0-9b52-8edee0a03c32 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:18.806986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-49c5278e-609b-41bb-84cd-5f14c229aacd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:18.815138 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-49c5278e-609b-41bb-84cd-5f14c229aacd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1497 microversion: 2.1 time: 0.787700 Feb 19 21:07:18.820261 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1970/3834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:18 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1497 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:18.843102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e435589c-7184-43c7-ab1b-62debdf2b75f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:18.844095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e435589c-7184-43c7-ab1b-62debdf2b75f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:18.864318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e435589c-7184-43c7-ab1b-62debdf2b75f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:18.865368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e435589c-7184-43c7-ab1b-62debdf2b75f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:18.868435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e435589c-7184-43c7-ab1b-62debdf2b75f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:18.870050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e435589c-7184-43c7-ab1b-62debdf2b75f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:18.911317 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e435589c-7184-43c7-ab1b-62debdf2b75f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087539 Feb 19 21:07:18.916063 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1971/3835] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Feb 19 21:07:18 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:07:18.923529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:18.924371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:18.931451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:18.932158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:18.935806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:18.936526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:18.969566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lazy-loading 'flavor' on Instance uuid 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:07:18.986440 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Cannot 'suspend' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state suspended Feb 19 21:07:18.987426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 409 to user: Cannot 'suspend' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state suspended {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:18.988694 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0204363f-ba0e-4028-bebc-8d683899af64 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 409 len: 148 microversion: 2.1 time: 0.071067 Feb 19 21:07:18.989924 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1972/3836] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:18 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 148 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:07:19.009970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f8e39cc6-5a8e-4a93-8f37-e119aea5457c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:19.009970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f8e39cc6-5a8e-4a93-8f37-e119aea5457c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:19.020968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8e39cc6-5a8e-4a93-8f37-e119aea5457c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:19.021350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8e39cc6-5a8e-4a93-8f37-e119aea5457c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:19.023043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8e39cc6-5a8e-4a93-8f37-e119aea5457c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:19.023519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8e39cc6-5a8e-4a93-8f37-e119aea5457c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:19.181812 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f8e39cc6-5a8e-4a93-8f37-e119aea5457c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 202 len: 0 microversion: 2.1 time: 0.185914 Feb 19 21:07:19.183232 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1973/3837] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:18 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:07:19.198264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-65d95215-57b6-422e-af9c-c2854ea02099 req-f5bde690-a064-4eb4-afc0-69e231d69478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1a6553-3c84-44a4-a3f7-159e22f8c9e2", "name": "network-vif-plugged", "status": "completed", "tag": "b110cc61-dab2-4486-a7cd-eb8a5572b017"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:19.201362 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:19.201362 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:07:19.220522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-65d95215-57b6-422e-af9c-c2854ea02099 req-f5bde690-a064-4eb4-afc0-69e231d69478 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:19.223172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-65d95215-57b6-422e-af9c-c2854ea02099 req-f5bde690-a064-4eb4-afc0-69e231d69478 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:19.287753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-65d95215-57b6-422e-af9c-c2854ea02099 req-f5bde690-a064-4eb4-afc0-69e231d69478 service nova] Creating event network-vif-plugged:b110cc61-dab2-4486-a7cd-eb8a5572b017 for instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 on nch1-master-1 Feb 19 21:07:19.318483 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-65d95215-57b6-422e-af9c-c2854ea02099 req-f5bde690-a064-4eb4-afc0-69e231d69478 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132579 Feb 19 21:07:19.326067 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1974/3838] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:19.369109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-054ee907-e0e0-4ef0-9b52-8edee0a03c32 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:19.388907 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-054ee907-e0e0-4ef0-9b52-8edee0a03c32 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1315 microversion: 2.1 time: 1.001422 Feb 19 21:07:19.389777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-50c7b1fe-81be-4e86-80a8-379319e4f244 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:19.391172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-50c7b1fe-81be-4e86-80a8-379319e4f244 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:19.398647 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1865/3839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:18 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1315 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:19.412151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50c7b1fe-81be-4e86-80a8-379319e4f244 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:19.412885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50c7b1fe-81be-4e86-80a8-379319e4f244 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:19.416847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50c7b1fe-81be-4e86-80a8-379319e4f244 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:19.419163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50c7b1fe-81be-4e86-80a8-379319e4f244 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:19.925591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-68b2819e-174f-4a2b-93b8-d8954a467705 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:19.926581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-68b2819e-174f-4a2b-93b8-d8954a467705 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:19.940312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-68b2819e-174f-4a2b-93b8-d8954a467705 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:19.943277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-68b2819e-174f-4a2b-93b8-d8954a467705 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:19.944993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-68b2819e-174f-4a2b-93b8-d8954a467705 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:19.949506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-68b2819e-174f-4a2b-93b8-d8954a467705 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:20.037729 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-68b2819e-174f-4a2b-93b8-d8954a467705 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.118363 Feb 19 21:07:20.043513 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1866/3840] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Feb 19 21:07:19 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:20.174659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c6d1cb8f-504d-4986-ae5a-6b13643fc7ef tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:20.175270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c6d1cb8f-504d-4986-ae5a-6b13643fc7ef tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:20.182875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d1cb8f-504d-4986-ae5a-6b13643fc7ef tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:20.183651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d1cb8f-504d-4986-ae5a-6b13643fc7ef tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:20.184688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d1cb8f-504d-4986-ae5a-6b13643fc7ef tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:20.185356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6d1cb8f-504d-4986-ae5a-6b13643fc7ef tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:20.239815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c6d1cb8f-504d-4986-ae5a-6b13643fc7ef tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:07:20.362963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-50c7b1fe-81be-4e86-80a8-379319e4f244 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:20.383684 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-50c7b1fe-81be-4e86-80a8-379319e4f244 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1503 microversion: 2.1 time: 1.034439 Feb 19 21:07:20.390345 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1975/3841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:19 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1503 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:20.405732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84744d38-f0b6-4c6a-990a-5fb9720c40ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:20.408366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-84744d38-f0b6-4c6a-990a-5fb9720c40ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:20.435221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84744d38-f0b6-4c6a-990a-5fb9720c40ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:20.443851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84744d38-f0b6-4c6a-990a-5fb9720c40ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:20.448757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84744d38-f0b6-4c6a-990a-5fb9720c40ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:20.449519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84744d38-f0b6-4c6a-990a-5fb9720c40ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:20.493251 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c6d1cb8f-504d-4986-ae5a-6b13643fc7ef tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 204 len: 0 microversion: 2.20 time: 0.320283 Feb 19 21:07:20.493960 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1867/3842] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:07:20 2022] DELETE /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 19 21:07:20.517273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:20.518254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:20.526535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:20.526998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:20.527810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:20.528463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:21.180089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84744d38-f0b6-4c6a-990a-5fb9720c40ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:21.194214 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84744d38-f0b6-4c6a-990a-5fb9720c40ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1315 microversion: 2.1 time: 0.792250 Feb 19 21:07:21.204003 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1976/3843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:20 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:21.415650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7e8dbc6-6d1d-4e6e-b172-7d0838e0fafb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:21.416524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d7e8dbc6-6d1d-4e6e-b172-7d0838e0fafb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:21.430682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7e8dbc6-6d1d-4e6e-b172-7d0838e0fafb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:21.431340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7e8dbc6-6d1d-4e6e-b172-7d0838e0fafb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:21.432699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7e8dbc6-6d1d-4e6e-b172-7d0838e0fafb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:21.433592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7e8dbc6-6d1d-4e6e-b172-7d0838e0fafb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:21.717977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:21.743545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:21.745903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:21.747145 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-918ca34d-c784-4030-8e4e-4cb2f2b7dd93 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1724 microversion: 2.20 time: 1.240488 Feb 19 21:07:21.748042 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1868/3844] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:20 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1724 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:22.038965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d7e8dbc6-6d1d-4e6e-b172-7d0838e0fafb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:22.050884 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d7e8dbc6-6d1d-4e6e-b172-7d0838e0fafb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1503 microversion: 2.1 time: 0.640646 Feb 19 21:07:22.061356 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1977/3845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:21 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1503 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:22.214479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ee0256d-146a-4a85-a2e3-f678afae3da7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:22.215250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8ee0256d-146a-4a85-a2e3-f678afae3da7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:22.244524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ee0256d-146a-4a85-a2e3-f678afae3da7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:22.244524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ee0256d-146a-4a85-a2e3-f678afae3da7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:22.246721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ee0256d-146a-4a85-a2e3-f678afae3da7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:22.248166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ee0256d-146a-4a85-a2e3-f678afae3da7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:22.599909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8ee0256d-146a-4a85-a2e3-f678afae3da7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:22.607668 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ee0256d-146a-4a85-a2e3-f678afae3da7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1501 microversion: 2.1 time: 0.399898 Feb 19 21:07:22.608784 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1869/3846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:22 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1501 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:22.766619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:22.767274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:22.786388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:22.786935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:22.787778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:22.791632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:23.070244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-843be3b7-e841-4a65-8c8d-763dcf6607bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:23.071296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-843be3b7-e841-4a65-8c8d-763dcf6607bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:23.083533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-843be3b7-e841-4a65-8c8d-763dcf6607bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:23.084274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-843be3b7-e841-4a65-8c8d-763dcf6607bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:23.086284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-843be3b7-e841-4a65-8c8d-763dcf6607bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:23.089420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-843be3b7-e841-4a65-8c8d-763dcf6607bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:23.292393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:23.305086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:23.306680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:23.307898 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e4fafca5-935d-40ef-bcbe-3900d43dd2a9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1724 microversion: 2.20 time: 0.545262 Feb 19 21:07:23.308487 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1978/3847] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:22 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1724 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:23.519998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-843be3b7-e841-4a65-8c8d-763dcf6607bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:23.597727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-843be3b7-e841-4a65-8c8d-763dcf6607bf tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.522170 Feb 19 21:07:23.614656 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1870/3848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:23 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:23.619141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7046a18f-2a16-4ae9-9ad6-ddd597e254f5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:23.619953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7046a18f-2a16-4ae9-9ad6-ddd597e254f5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:23.632624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7046a18f-2a16-4ae9-9ad6-ddd597e254f5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:23.635670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7046a18f-2a16-4ae9-9ad6-ddd597e254f5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:23.636711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7046a18f-2a16-4ae9-9ad6-ddd597e254f5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:23.644488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7046a18f-2a16-4ae9-9ad6-ddd597e254f5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:24.222142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7046a18f-2a16-4ae9-9ad6-ddd597e254f5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:24.245191 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7046a18f-2a16-4ae9-9ad6-ddd597e254f5 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.624868 Feb 19 21:07:24.267094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c891e2b5-972c-4080-a078-8b3e3d7cab3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:24.267641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c891e2b5-972c-4080-a078-8b3e3d7cab3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 0680d4f5-dc06-485e-b8f9-bc6b22b10c25] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:24.276033 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1979/3849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:23 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:24.290710 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c891e2b5-972c-4080-a078-8b3e3d7cab3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 0680d4f5-dc06-485e-b8f9-bc6b22b10c25 could not be found. Feb 19 21:07:24.292104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c891e2b5-972c-4080-a078-8b3e3d7cab3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 0680d4f5-dc06-485e-b8f9-bc6b22b10c25 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:24.293023 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c891e2b5-972c-4080-a078-8b3e3d7cab3b tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/0680d4f5-dc06-485e-b8f9-bc6b22b10c25/action" status: 404 len: 111 microversion: 2.1 time: 0.030670 Feb 19 21:07:24.297140 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1871/3850] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:24 2022] POST /compute/v2.1/servers/0680d4f5-dc06-485e-b8f9-bc6b22b10c25/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:07:24.304599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9489eaa6-5edd-49f5-9ba6-b8287b8f89bb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:24.305436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9489eaa6-5edd-49f5-9ba6-b8287b8f89bb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:24.312306 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9489eaa6-5edd-49f5-9ba6-b8287b8f89bb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:24.313041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9489eaa6-5edd-49f5-9ba6-b8287b8f89bb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:24.314019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9489eaa6-5edd-49f5-9ba6-b8287b8f89bb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:24.314627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9489eaa6-5edd-49f5-9ba6-b8287b8f89bb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:24.328539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:24.329838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:24.353248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:24.377953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:24.384171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:24.384684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:24.645991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:24.659259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:24.661161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:24.662607 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c510cd5a-868e-4514-8706-ccbcf92ec2ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1656 microversion: 2.20 time: 0.339553 Feb 19 21:07:24.664682 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1872/3851] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:24 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1656 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:07:24.677083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-900a5242-3875-419d-a2ac-80688e323041 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc1352cb-02fb-4212-ba31-55df6ddc6132"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:24.679535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-900a5242-3875-419d-a2ac-80688e323041 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:24.690189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-900a5242-3875-419d-a2ac-80688e323041 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:24.690882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-900a5242-3875-419d-a2ac-80688e323041 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:24.692290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-900a5242-3875-419d-a2ac-80688e323041 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:24.697816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-900a5242-3875-419d-a2ac-80688e323041 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:24.894319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9489eaa6-5edd-49f5-9ba6-b8287b8f89bb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:24.914621 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9489eaa6-5edd-49f5-9ba6-b8287b8f89bb tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.615672 Feb 19 21:07:24.916214 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1980/3852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:24 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:24.958470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-559c0f1d-205a-4d73-989d-4a20196477e7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:24.967896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-559c0f1d-205a-4d73-989d-4a20196477e7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:24.987135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-559c0f1d-205a-4d73-989d-4a20196477e7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:24.987904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-559c0f1d-205a-4d73-989d-4a20196477e7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:24.989166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-559c0f1d-205a-4d73-989d-4a20196477e7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:24.989808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-559c0f1d-205a-4d73-989d-4a20196477e7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:25.162307 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-900a5242-3875-419d-a2ac-80688e323041 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496098 Feb 19 21:07:25.185044 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1873/3853] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:07:24 2022] POST /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2/os-volume_attachments => generated 194 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:25.214597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-180271eb-53ba-4d79-80c8-076d257fd64a req-0d539671-d19f-4055-aadb-52d2acd24c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17524174-4cfd-409a-b6f4-15bde7d2c4d1", "name": "network-vif-deleted", "tag": "2caf0c43-e8a7-47e8-a90c-390f3b45d82b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:25.225304 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:25.225304 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:07:25.259870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-180271eb-53ba-4d79-80c8-076d257fd64a req-0d539671-d19f-4055-aadb-52d2acd24c22 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:25.266392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-180271eb-53ba-4d79-80c8-076d257fd64a req-0d539671-d19f-4055-aadb-52d2acd24c22 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:25.313138 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-180271eb-53ba-4d79-80c8-076d257fd64a req-0d539671-d19f-4055-aadb-52d2acd24c22 service nova] Creating event network-vif-deleted:2caf0c43-e8a7-47e8-a90c-390f3b45d82b for instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 on nch2-master-1 Feb 19 21:07:25.328221 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-180271eb-53ba-4d79-80c8-076d257fd64a req-0d539671-d19f-4055-aadb-52d2acd24c22 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145977 Feb 19 21:07:25.331631 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1874/3854] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:25.485780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-559c0f1d-205a-4d73-989d-4a20196477e7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:25.495243 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-559c0f1d-205a-4d73-989d-4a20196477e7 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.545635 Feb 19 21:07:25.508428 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1981/3855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:24 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:25.517075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b9069e7f-d271-4eb8-ae82-edc8d48a6488 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:25.517711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b9069e7f-d271-4eb8-ae82-edc8d48a6488 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:25.534440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9069e7f-d271-4eb8-ae82-edc8d48a6488 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:25.535171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9069e7f-d271-4eb8-ae82-edc8d48a6488 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:25.536419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9069e7f-d271-4eb8-ae82-edc8d48a6488 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:25.537032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9069e7f-d271-4eb8-ae82-edc8d48a6488 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:25.593521 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-b9069e7f-d271-4eb8-ae82-edc8d48a6488 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Cannot 'unpause' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state active Feb 19 21:07:25.594697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b9069e7f-d271-4eb8-ae82-edc8d48a6488 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 409 to user: Cannot 'unpause' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state active {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:25.595917 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b9069e7f-d271-4eb8-ae82-edc8d48a6488 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 409 len: 145 microversion: 2.1 time: 0.083601 Feb 19 21:07:25.597206 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1875/3856] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:25 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 21:07:25.605757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3913857d-9e8f-4aaa-960c-b34d8bc44cf4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:25.606883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3913857d-9e8f-4aaa-960c-b34d8bc44cf4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:25.613935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3913857d-9e8f-4aaa-960c-b34d8bc44cf4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:25.614773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3913857d-9e8f-4aaa-960c-b34d8bc44cf4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:25.615811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3913857d-9e8f-4aaa-960c-b34d8bc44cf4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:25.617268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3913857d-9e8f-4aaa-960c-b34d8bc44cf4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:25.693437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:25.694302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:25.709342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:25.711717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:25.713945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:25.716501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:25.826270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:25.827885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:25.829910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lazy-loading 'fault' on Instance uuid 17524174-4cfd-409a-b6f4-15bde7d2c4d1 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:07:26.043522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:26.099662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:26.101395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:26.102714 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6d321bb2-05da-474e-84b5-33404ef61272 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 200 len: 1371 microversion: 2.20 time: 0.413612 Feb 19 21:07:26.113152 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1876/3857] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:25 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 1371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:26.169278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3913857d-9e8f-4aaa-960c-b34d8bc44cf4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:26.191202 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3913857d-9e8f-4aaa-960c-b34d8bc44cf4 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.587804 Feb 19 21:07:26.191935 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1982/3858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:25 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:26.210433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0b3364b0-98a0-4929-a30c-24a8ac28c217 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:26.211409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0b3364b0-98a0-4929-a30c-24a8ac28c217 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:26.227902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b3364b0-98a0-4929-a30c-24a8ac28c217 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:26.229918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b3364b0-98a0-4929-a30c-24a8ac28c217 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:26.231588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b3364b0-98a0-4929-a30c-24a8ac28c217 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:26.233458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b3364b0-98a0-4929-a30c-24a8ac28c217 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:26.872777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0b3364b0-98a0-4929-a30c-24a8ac28c217 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:26.885766 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0b3364b0-98a0-4929-a30c-24a8ac28c217 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.679642 Feb 19 21:07:26.899086 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1877/3859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:26 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:26.906685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3751e62d-678f-46f7-8321-c847dcd2eccd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:26.907727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3751e62d-678f-46f7-8321-c847dcd2eccd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 12c4300c-a6ed-4f2b-8c61-24cb2e48dc9a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:26.921502 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-3751e62d-678f-46f7-8321-c847dcd2eccd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 12c4300c-a6ed-4f2b-8c61-24cb2e48dc9a could not be found. Feb 19 21:07:26.922906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3751e62d-678f-46f7-8321-c847dcd2eccd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 12c4300c-a6ed-4f2b-8c61-24cb2e48dc9a could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:26.924414 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3751e62d-678f-46f7-8321-c847dcd2eccd tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/12c4300c-a6ed-4f2b-8c61-24cb2e48dc9a/action" status: 404 len: 111 microversion: 2.1 time: 0.025057 Feb 19 21:07:26.925991 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1983/3860] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:26 2022] POST /compute/v2.1/servers/12c4300c-a6ed-4f2b-8c61-24cb2e48dc9a/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:07:26.937323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-96cb00f2-071b-4b3b-a628-041a33771a99 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:26.938240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-96cb00f2-071b-4b3b-a628-041a33771a99 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:26.946610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-96cb00f2-071b-4b3b-a628-041a33771a99 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:26.947350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-96cb00f2-071b-4b3b-a628-041a33771a99 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:26.948173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-96cb00f2-071b-4b3b-a628-041a33771a99 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:26.948978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-96cb00f2-071b-4b3b-a628-041a33771a99 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:27.134991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a0ec43c4-6947-474e-8725-ade82ba6b1a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:27.137236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a0ec43c4-6947-474e-8725-ade82ba6b1a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:27.145437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0ec43c4-6947-474e-8725-ade82ba6b1a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:27.149178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0ec43c4-6947-474e-8725-ade82ba6b1a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:27.150323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0ec43c4-6947-474e-8725-ade82ba6b1a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:27.150995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0ec43c4-6947-474e-8725-ade82ba6b1a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:27.182683 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a0ec43c4-6947-474e-8725-ade82ba6b1a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] HTTP exception thrown: Instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 could not be found. Feb 19 21:07:27.183507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a0ec43c4-6947-474e-8725-ade82ba6b1a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Returning 404 to user: Instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:27.184578 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a0ec43c4-6947-474e-8725-ade82ba6b1a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 404 len: 111 microversion: 2.20 time: 0.055089 Feb 19 21:07:27.185149 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1984/3861] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:27 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:07:27.193665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-651cf8ce-4853-4da1-be29-e90443e967e9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '.version_select at 0x7f64678965e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:27.227479 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-651cf8ce-4853-4da1-be29-e90443e967e9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-340226193" status: 204 len: 0 microversion: 2.20 time: 0.037407 Feb 19 21:07:27.241795 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1985/3862] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Feb 19 21:07:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-340226193 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 19 21:07:27.920578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-96cb00f2-071b-4b3b-a628-041a33771a99 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:27.936912 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-96cb00f2-071b-4b3b-a628-041a33771a99 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 1.002115 Feb 19 21:07:27.937957 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1878/3863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:26 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:27.958171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bc78bc5e-099c-42c4-8558-a4935c11af6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:27.959504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bc78bc5e-099c-42c4-8558-a4935c11af6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:27.973699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc78bc5e-099c-42c4-8558-a4935c11af6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:27.974169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc78bc5e-099c-42c4-8558-a4935c11af6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:27.974984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc78bc5e-099c-42c4-8558-a4935c11af6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:27.977923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc78bc5e-099c-42c4-8558-a4935c11af6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:28.268666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bc78bc5e-099c-42c4-8558-a4935c11af6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:28.291614 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bc78bc5e-099c-42c4-8558-a4935c11af6d tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.336434 Feb 19 21:07:28.292237 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1986/3864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:27 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:28.309865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43f75163-05a3-4160-a08a-f80b5b066f45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:28.310495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-43f75163-05a3-4160-a08a-f80b5b066f45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:28.324733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43f75163-05a3-4160-a08a-f80b5b066f45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:28.332074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43f75163-05a3-4160-a08a-f80b5b066f45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:28.333890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43f75163-05a3-4160-a08a-f80b5b066f45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:28.334965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43f75163-05a3-4160-a08a-f80b5b066f45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:28.399532 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-43f75163-05a3-4160-a08a-f80b5b066f45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Cannot 'unshelve' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state active Feb 19 21:07:28.400604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43f75163-05a3-4160-a08a-f80b5b066f45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 409 to user: Cannot 'unshelve' instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 while it is in vm_state active {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:28.402203 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-43f75163-05a3-4160-a08a-f80b5b066f45 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action" status: 409 len: 146 microversion: 2.1 time: 0.096507 Feb 19 21:07:28.404432 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1879/3865] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:28 2022] POST /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0/action => generated 146 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 19 21:07:28.427863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c9583da1-f109-496a-96b3-07a93e73056f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:28.429722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c9583da1-f109-496a-96b3-07a93e73056f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:28.460991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9583da1-f109-496a-96b3-07a93e73056f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:28.462916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9583da1-f109-496a-96b3-07a93e73056f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:28.465062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9583da1-f109-496a-96b3-07a93e73056f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:28.466852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9583da1-f109-496a-96b3-07a93e73056f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:28.743625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c9583da1-f109-496a-96b3-07a93e73056f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:28.755030 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c9583da1-f109-496a-96b3-07a93e73056f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.342534 Feb 19 21:07:28.756442 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1987/3866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:28 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:28.774139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-70d9c6f8-51a0-46a2-9509-87fd9b1a2921 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:28.775259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-70d9c6f8-51a0-46a2-9509-87fd9b1a2921 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:28.785995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70d9c6f8-51a0-46a2-9509-87fd9b1a2921 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:28.786853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70d9c6f8-51a0-46a2-9509-87fd9b1a2921 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:28.788004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70d9c6f8-51a0-46a2-9509-87fd9b1a2921 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:28.789023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70d9c6f8-51a0-46a2-9509-87fd9b1a2921 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:29.046407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-70d9c6f8-51a0-46a2-9509-87fd9b1a2921 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:29.073553 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-70d9c6f8-51a0-46a2-9509-87fd9b1a2921 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.303960 Feb 19 21:07:29.077561 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1880/3867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:28 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:29.106695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6580dfa1-a349-41ba-acf0-1d66ad712ab2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1798863457_updated"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:29.108124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6580dfa1-a349-41ba-acf0-1d66ad712ab2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 17efe0a0-51c3-4c01-9553-16a528b67e32] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:29.129081 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-6580dfa1-a349-41ba-acf0-1d66ad712ab2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 17efe0a0-51c3-4c01-9553-16a528b67e32 could not be found. Feb 19 21:07:29.129817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6580dfa1-a349-41ba-acf0-1d66ad712ab2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 17efe0a0-51c3-4c01-9553-16a528b67e32 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:29.130786 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6580dfa1-a349-41ba-acf0-1d66ad712ab2 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "PUT /compute/v2.1/servers/17efe0a0-51c3-4c01-9553-16a528b67e32" status: 404 len: 111 microversion: 2.1 time: 0.029438 Feb 19 21:07:29.131534 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1988/3868] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 21:07:29 2022] PUT /compute/v2.1/servers/17efe0a0-51c3-4c01-9553-16a528b67e32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:07:29.145222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b948f5d1-9bf4-4ac7-90c9-d168b5ca0f69 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:29.146250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b948f5d1-9bf4-4ac7-90c9-d168b5ca0f69 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:29.163749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b948f5d1-9bf4-4ac7-90c9-d168b5ca0f69 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:29.164620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b948f5d1-9bf4-4ac7-90c9-d168b5ca0f69 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:29.165515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b948f5d1-9bf4-4ac7-90c9-d168b5ca0f69 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:29.165962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b948f5d1-9bf4-4ac7-90c9-d168b5ca0f69 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:29.424073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-942a5681-2d0c-45ec-af11-5ade1553c4b9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'create', calling method: .version_select at 0x7f6478fc1ca0>, body: {"keypair": {"name": "tempest-keypair-1425274070"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:29.431523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b948f5d1-9bf4-4ac7-90c9-d168b5ca0f69 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:29.447015 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b948f5d1-9bf4-4ac7-90c9-d168b5ca0f69 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.309887 Feb 19 21:07:29.450719 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1881/3869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:29 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:29.469318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-942a5681-2d0c-45ec-af11-5ade1553c4b9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:29.473801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dbc37865-b208-464b-b8a3-ed26271490c6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:29.474793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dbc37865-b208-464b-b8a3-ed26271490c6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:29.476030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-942a5681-2d0c-45ec-af11-5ade1553c4b9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for user a388edbf88ba4749b3abb2a42b750757 and project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:29.484397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbc37865-b208-464b-b8a3-ed26271490c6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:29.487227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbc37865-b208-464b-b8a3-ed26271490c6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:29.494131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbc37865-b208-464b-b8a3-ed26271490c6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:29.494929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbc37865-b208-464b-b8a3-ed26271490c6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:29.713784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-942a5681-2d0c-45ec-af11-5ade1553c4b9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:29.723588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-942a5681-2d0c-45ec-af11-5ade1553c4b9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for user a388edbf88ba4749b3abb2a42b750757 and project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:29.769055 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-942a5681-2d0c-45ec-af11-5ade1553c4b9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.348848 Feb 19 21:07:29.785129 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1989/3870] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Feb 19 21:07:29 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 350 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:07:29.814057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dbc37865-b208-464b-b8a3-ed26271490c6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:29.826308 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dbc37865-b208-464b-b8a3-ed26271490c6 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.356369 Feb 19 21:07:29.827310 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1882/3871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:29 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:29.845716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1b30ff2d-115d-4ddf-b58a-0ab1436ece85 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:29.846963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1b30ff2d-115d-4ddf-b58a-0ab1436ece85 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:29.848067 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1b30ff2d-115d-4ddf-b58a-0ab1436ece85 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "PUT /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 400 len: 619 microversion: 2.1 time: 0.006702 Feb 19 21:07:29.848744 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1990/3872] 10.222.0.30 () {60 vars in 1256 bytes} [Sat Feb 19 21:07:29 2022] PUT /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:07:29.870952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ccdf04a5-3cd2-4d28-991b-9890d439ff3f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:29.874495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ccdf04a5-3cd2-4d28-991b-9890d439ff3f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:29.899043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccdf04a5-3cd2-4d28-991b-9890d439ff3f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:29.899840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccdf04a5-3cd2-4d28-991b-9890d439ff3f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:29.901566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccdf04a5-3cd2-4d28-991b-9890d439ff3f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:29.902981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b89f6700-fbee-42d1-94e5-d205994c26b1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:29.903464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b89f6700-fbee-42d1-94e5-d205994c26b1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:29.907834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccdf04a5-3cd2-4d28-991b-9890d439ff3f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:29.915676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b89f6700-fbee-42d1-94e5-d205994c26b1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:29.917112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b89f6700-fbee-42d1-94e5-d205994c26b1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:29.920408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b89f6700-fbee-42d1-94e5-d205994c26b1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:29.921107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b89f6700-fbee-42d1-94e5-d205994c26b1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:29.974901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b89f6700-fbee-42d1-94e5-d205994c26b1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:07:30.135453 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b89f6700-fbee-42d1-94e5-d205994c26b1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 204 len: 0 microversion: 2.1 time: 0.236274 Feb 19 21:07:30.136844 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1991/3873] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:07:29 2022] DELETE /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:07:30.148048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d6130038-0912-4cf6-883a-8b9224f1b3f1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:30.148997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d6130038-0912-4cf6-883a-8b9224f1b3f1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:30.159699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6130038-0912-4cf6-883a-8b9224f1b3f1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:30.160433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6130038-0912-4cf6-883a-8b9224f1b3f1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:30.161369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6130038-0912-4cf6-883a-8b9224f1b3f1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:30.162122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6130038-0912-4cf6-883a-8b9224f1b3f1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:30.403744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ccdf04a5-3cd2-4d28-991b-9890d439ff3f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:30.412397 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ccdf04a5-3cd2-4d28-991b-9890d439ff3f tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.557934 Feb 19 21:07:30.413067 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1883/3874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:29 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:30.431313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aad3bcc6-b9e4-4315-a0f6-4324a6270e59 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:30.432064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aad3bcc6-b9e4-4315-a0f6-4324a6270e59 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:30.440674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aad3bcc6-b9e4-4315-a0f6-4324a6270e59 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:30.441169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aad3bcc6-b9e4-4315-a0f6-4324a6270e59 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:30.442300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aad3bcc6-b9e4-4315-a0f6-4324a6270e59 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:30.442751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aad3bcc6-b9e4-4315-a0f6-4324a6270e59 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:30.645579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6130038-0912-4cf6-883a-8b9224f1b3f1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:30.660296 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d6130038-0912-4cf6-883a-8b9224f1b3f1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1553 microversion: 2.1 time: 0.516137 Feb 19 21:07:30.661112 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1992/3875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:30 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1553 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:30.766150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aad3bcc6-b9e4-4315-a0f6-4324a6270e59 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:30.783188 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aad3bcc6-b9e4-4315-a0f6-4324a6270e59 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.356642 Feb 19 21:07:30.784054 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1884/3876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:30 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:30.806955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-67e133f4-0972-46a1-8b70-b9564b2a191c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:30.809435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-67e133f4-0972-46a1-8b70-b9564b2a191c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:30.810274 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-67e133f4-0972-46a1-8b70-b9564b2a191c tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "PUT /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 400 len: 108 microversion: 2.1 time: 0.008435 Feb 19 21:07:30.811176 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1993/3877] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 21:07:30 2022] PUT /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:07:30.819682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7e4f1f1b-9633-4dab-a1e0-92a4f9fb141a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:30.820423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7e4f1f1b-9633-4dab-a1e0-92a4f9fb141a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:30.827500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e4f1f1b-9633-4dab-a1e0-92a4f9fb141a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:30.828058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e4f1f1b-9633-4dab-a1e0-92a4f9fb141a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:30.829225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e4f1f1b-9633-4dab-a1e0-92a4f9fb141a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:30.829706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e4f1f1b-9633-4dab-a1e0-92a4f9fb141a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:31.265659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7e4f1f1b-9633-4dab-a1e0-92a4f9fb141a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:31.275345 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7e4f1f1b-9633-4dab-a1e0-92a4f9fb141a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1506 microversion: 2.1 time: 0.459734 Feb 19 21:07:31.276684 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1885/3878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:30 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:31.682583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c55c79d-3a5e-4f14-8a51-7234b0d180fb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:31.684873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7c55c79d-3a5e-4f14-8a51-7234b0d180fb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:31.713652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c55c79d-3a5e-4f14-8a51-7234b0d180fb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:31.714441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c55c79d-3a5e-4f14-8a51-7234b0d180fb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:31.716092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c55c79d-3a5e-4f14-8a51-7234b0d180fb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:31.716634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c55c79d-3a5e-4f14-8a51-7234b0d180fb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:32.172532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-587006215", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0af9030-e395-43f9-8a34-dbc361fa9146"}], "security_groups": [{"name": "tempest-securitygroup--2120550201"}], "key_name": "tempest-keypair-1425274070", "user_data": "}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:32.179859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7c55c79d-3a5e-4f14-8a51-7234b0d180fb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:32.189631 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c55c79d-3a5e-4f14-8a51-7234b0d180fb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1553 microversion: 2.1 time: 0.515214 Feb 19 21:07:32.190488 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1994/3879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:31 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1553 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:32.537338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] validate_networks() for [('b0af9030-e395-43f9-8a34-dbc361fa9146', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:07:33.207312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4c1023c8-8125-418b-b4e1-572fac4a4a67 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:33.207938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4c1023c8-8125-418b-b4e1-572fac4a4a67 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:33.215705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4c1023c8-8125-418b-b4e1-572fac4a4a67 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:33.216168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4c1023c8-8125-418b-b4e1-572fac4a4a67 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:33.217007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4c1023c8-8125-418b-b4e1-572fac4a4a67 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:33.217452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4c1023c8-8125-418b-b4e1-572fac4a4a67 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:33.921815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4c1023c8-8125-418b-b4e1-572fac4a4a67 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:33.930638 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4c1023c8-8125-418b-b4e1-572fac4a4a67 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1553 microversion: 2.1 time: 0.726984 Feb 19 21:07:33.931471 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1995/3880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:33 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1553 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:33.936223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8fb22596-e2a2-4f32-b008-72ddbe5c5898 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:33.936959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8fb22596-e2a2-4f32-b008-72ddbe5c5898 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:33.943936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fb22596-e2a2-4f32-b008-72ddbe5c5898 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:33.944652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fb22596-e2a2-4f32-b008-72ddbe5c5898 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:33.945940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fb22596-e2a2-4f32-b008-72ddbe5c5898 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:33.946546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8fb22596-e2a2-4f32-b008-72ddbe5c5898 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:33.965301 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-8fb22596-e2a2-4f32-b008-72ddbe5c5898 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. Feb 19 21:07:33.966718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8fb22596-e2a2-4f32-b008-72ddbe5c5898 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:33.967974 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8fb22596-e2a2-4f32-b008-72ddbe5c5898 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 404 len: 111 microversion: 2.1 time: 0.035326 Feb 19 21:07:33.972777 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1996/3881] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:07:33 2022] DELETE /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:07:33.980401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-de134833-19dd-48c3-b3de-e53e780e336a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:33.981347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-de134833-19dd-48c3-b3de-e53e780e336a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:33.988748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de134833-19dd-48c3-b3de-e53e780e336a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:33.989563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de134833-19dd-48c3-b3de-e53e780e336a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:33.990605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de134833-19dd-48c3-b3de-e53e780e336a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.006084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de134833-19dd-48c3-b3de-e53e780e336a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:34.035043 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-de134833-19dd-48c3-b3de-e53e780e336a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. Feb 19 21:07:34.036043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-de134833-19dd-48c3-b3de-e53e780e336a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:34.038526 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-de134833-19dd-48c3-b3de-e53e780e336a tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8" status: 404 len: 111 microversion: 2.1 time: 0.062936 Feb 19 21:07:34.039610 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1997/3882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:33 2022] GET /compute/v2.1/servers/3f813a2b-29b5-4a7d-9162-0e5b0971f8d8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:07:34.057973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fc13dec1-97c8-455d-b733-b76f85278d94 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:34.059015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fc13dec1-97c8-455d-b733-b76f85278d94 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:34.072055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc13dec1-97c8-455d-b733-b76f85278d94 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.072572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc13dec1-97c8-455d-b733-b76f85278d94 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:34.078276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc13dec1-97c8-455d-b733-b76f85278d94 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.079146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc13dec1-97c8-455d-b733-b76f85278d94 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:34.135517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fc13dec1-97c8-455d-b733-b76f85278d94 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:07:34.255083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:07:34.257370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:07:34.258757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:07:34.259822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:07:34.260666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:07:34.291534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.292447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:34.293803 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fc13dec1-97c8-455d-b733-b76f85278d94 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "DELETE /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 204 len: 0 microversion: 2.1 time: 0.247930 Feb 19 21:07:34.296740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.297156 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1998/3883] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:07:34 2022] DELETE /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:07:34.297773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:34.316065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7fcc9e56-bba7-4423-817a-5cd1f96cd196 req-a1b64c9f-dfe4-4192-b6fd-60350e715ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1a6553-3c84-44a4-a3f7-159e22f8c9e2", "name": "network-vif-deleted", "tag": "b110cc61-dab2-4486-a7cd-eb8a5572b017"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:34.320873 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:34.320873 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:07:34.342074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:34.343585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7fcc9e56-bba7-4423-817a-5cd1f96cd196 req-a1b64c9f-dfe4-4192-b6fd-60350e715ea6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.344707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7fcc9e56-bba7-4423-817a-5cd1f96cd196 req-a1b64c9f-dfe4-4192-b6fd-60350e715ea6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:34.350246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Getting quotas for user a388edbf88ba4749b3abb2a42b750757 and project 61ad9ca9c0944ba68443aaa71a10eb19. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:34.358506 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7fcc9e56-bba7-4423-817a-5cd1f96cd196 req-a1b64c9f-dfe4-4192-b6fd-60350e715ea6 service nova] Creating event network-vif-deleted:b110cc61-dab2-4486-a7cd-eb8a5572b017 for instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 on nch1-master-1 Feb 19 21:07:34.364494 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7fcc9e56-bba7-4423-817a-5cd1f96cd196 req-a1b64c9f-dfe4-4192-b6fd-60350e715ea6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065361 Feb 19 21:07:34.365160 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 1999/3884] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:34.373530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a2c53db8-2ad0-41f3-98ef-fcaefe850fe8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:34.374644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a2c53db8-2ad0-41f3-98ef-fcaefe850fe8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:34.379343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:07:34.382998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:07:34.384557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2c53db8-2ad0-41f3-98ef-fcaefe850fe8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.385062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2c53db8-2ad0-41f3-98ef-fcaefe850fe8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:34.386105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2c53db8-2ad0-41f3-98ef-fcaefe850fe8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.386864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2c53db8-2ad0-41f3-98ef-fcaefe850fe8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:34.477303 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-43ed6144-1749-45e8-9df6-328893742ce6 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.308741 Feb 19 21:07:34.478459 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1886/3885] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 21:07:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 2311 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 19 21:07:34.500473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-18e4284e-3996-4e5d-97b9-1221e2d271a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:34.502901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-18e4284e-3996-4e5d-97b9-1221e2d271a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:34.628533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-18e4284e-3996-4e5d-97b9-1221e2d271a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:34.644171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-18e4284e-3996-4e5d-97b9-1221e2d271a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:34.651462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-18e4284e-3996-4e5d-97b9-1221e2d271a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:34.653677 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-18e4284e-3996-4e5d-97b9-1221e2d271a4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1281 microversion: 2.20 time: 0.165398 Feb 19 21:07:34.654502 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1887/3886] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:34 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:34.711100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a2c53db8-2ad0-41f3-98ef-fcaefe850fe8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:34.721977 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a2c53db8-2ad0-41f3-98ef-fcaefe850fe8 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.354875 Feb 19 21:07:34.722856 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2000/3887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:34 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:34.949585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:34.950217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:34.961947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.962449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:34.966337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:34.973474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:35.086744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:35.087269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:35.087884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lazy-loading 'fault' on Instance uuid dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:07:35.172308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:35.188438 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b7e52618-bcc3-4888-ad7f-97cc28070c6e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 200 len: 1351 microversion: 2.1 time: 0.243276 Feb 19 21:07:35.190705 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1888/3888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:34 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 1351 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:35.673580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:35.674586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:35.718636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:35.719102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:35.720023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:35.721971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:35.747172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-64fa662d-894c-432e-9bf1-1518b0826bc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:35.748603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-64fa662d-894c-432e-9bf1-1518b0826bc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:35.763942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64fa662d-894c-432e-9bf1-1518b0826bc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:35.764427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64fa662d-894c-432e-9bf1-1518b0826bc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:35.769707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64fa662d-894c-432e-9bf1-1518b0826bc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:35.771844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64fa662d-894c-432e-9bf1-1518b0826bc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:35.966012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:35.981325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:35.983343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:35.986372 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c0aadcb2-4ac2-4302-a808-d6e864bc4629 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1333 microversion: 2.20 time: 0.316471 Feb 19 21:07:35.993159 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2001/3889] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:35 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1333 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:36.207183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eae2c30c-ce33-48da-927b-badd3db9cc87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:36.208114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eae2c30c-ce33-48da-927b-badd3db9cc87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:36.218179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eae2c30c-ce33-48da-927b-badd3db9cc87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:36.218636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eae2c30c-ce33-48da-927b-badd3db9cc87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:36.219440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eae2c30c-ce33-48da-927b-badd3db9cc87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:36.225097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eae2c30c-ce33-48da-927b-badd3db9cc87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:36.297372 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-eae2c30c-ce33-48da-927b-badd3db9cc87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 could not be found. Feb 19 21:07:36.300180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eae2c30c-ce33-48da-927b-badd3db9cc87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:36.303473 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eae2c30c-ce33-48da-927b-badd3db9cc87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 404 len: 111 microversion: 2.1 time: 0.100175 Feb 19 21:07:36.311986 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2002/3890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:36 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:07:36.317125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64fa662d-894c-432e-9bf1-1518b0826bc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:36.328501 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-64fa662d-894c-432e-9bf1-1518b0826bc9 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.592403 Feb 19 21:07:36.329124 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1889/3891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:35 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:36.503755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4de5b7f6-0792-493e-b04c-e5419622b164 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:36.504779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4de5b7f6-0792-493e-b04c-e5419622b164 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:36.526234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4de5b7f6-0792-493e-b04c-e5419622b164 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:36.528965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4de5b7f6-0792-493e-b04c-e5419622b164 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:36.531673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4de5b7f6-0792-493e-b04c-e5419622b164 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:36.532494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4de5b7f6-0792-493e-b04c-e5419622b164 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:36.569107 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-4de5b7f6-0792-493e-b04c-e5419622b164 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 could not be found. Feb 19 21:07:36.571757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4de5b7f6-0792-493e-b04c-e5419622b164 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:36.574307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4de5b7f6-0792-493e-b04c-e5419622b164 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074654 Feb 19 21:07:36.577097 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2003/3892] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:07:36 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:07:36.915261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-215762577", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "be9178cb-fadc-423e-95e2-979af3a2f95e"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:37.017205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:37.017844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:37.032515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:37.035165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:37.035922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:37.037807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] validate_networks() for [('be9178cb-fadc-423e-95e2-979af3a2f95e', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:07:37.038984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:37.227554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:37.275095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:37.292885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:37.294852 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-888bde7b-1dbb-4a39-87af-8f9fd5e8d022 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1339 microversion: 2.20 time: 0.283724 Feb 19 21:07:37.297187 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2004/3893] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:37 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1339 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:37.347760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1b04572a-15cc-42d1-b6ea-585cd7c3a916 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:37.349283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1b04572a-15cc-42d1-b6ea-585cd7c3a916 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:37.364776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b04572a-15cc-42d1-b6ea-585cd7c3a916 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:37.366889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b04572a-15cc-42d1-b6ea-585cd7c3a916 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:37.377634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b04572a-15cc-42d1-b6ea-585cd7c3a916 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:37.379196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b04572a-15cc-42d1-b6ea-585cd7c3a916 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:38.048316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1b04572a-15cc-42d1-b6ea-585cd7c3a916 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36bd5d716db4dba866a1bcd880accb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee065d1c70940cd8caadd525737c593', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:38.064084 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1b04572a-15cc-42d1-b6ea-585cd7c3a916 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 200 len: 1512 microversion: 2.1 time: 0.721400 Feb 19 21:07:38.078089 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2005/3894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:37 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 1512 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:38.087379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:07:38.088578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:07:38.089256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:07:38.089870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:07:38.090458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:07:38.091488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a312dcdb-4d8d-42e8-a717-e3b797280d07 req-aaef6bac-98c2-4432-b19d-0f361f104fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63482c29-4a39-4eaa-9bf1-de6107d9b0f0", "name": "network-vif-deleted", "tag": "a943b989-5a95-44a3-9a78-35384327a397"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:38.095473 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:38.095473 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:07:38.110667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a312dcdb-4d8d-42e8-a717-e3b797280d07 req-aaef6bac-98c2-4432-b19d-0f361f104fb6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:38.111396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a312dcdb-4d8d-42e8-a717-e3b797280d07 req-aaef6bac-98c2-4432-b19d-0f361f104fb6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:38.112043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:38.112620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:38.113469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:38.113915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:38.125907 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a312dcdb-4d8d-42e8-a717-e3b797280d07 req-aaef6bac-98c2-4432-b19d-0f361f104fb6 service nova] Creating event network-vif-deleted:a943b989-5a95-44a3-9a78-35384327a397 for instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 on nch1-master-1 Feb 19 21:07:38.134645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a312dcdb-4d8d-42e8-a717-e3b797280d07 req-aaef6bac-98c2-4432-b19d-0f361f104fb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054675 Feb 19 21:07:38.135498 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2006/3895] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:38.164129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:38.172035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for user 20246495a35b4762be5b2ad98f537377 and project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:38.211822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:07:38.216282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:07:38.327642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:38.331465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:38.358443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:38.363901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:38.365863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:38.369300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:38.394840 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1cc7750-62e7-4a4c-92cf-a9dab3b5d2ac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501016 Feb 19 21:07:38.404809 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1890/3896] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:07:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:07:38.429706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ea9764b2-a4bc-499f-af6c-2865e4f13b18 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:38.430849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ea9764b2-a4bc-499f-af6c-2865e4f13b18 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:38.721347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:38.730983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:38.747427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:38.748763 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dcf8edad-c718-406d-8712-af5586ff59f0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1339 microversion: 2.20 time: 0.434386 Feb 19 21:07:38.749260 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2007/3897] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:38 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1339 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:38.890992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ea9764b2-a4bc-499f-af6c-2865e4f13b18 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:38.908311 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ea9764b2-a4bc-499f-af6c-2865e4f13b18 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a" status: 200 len: 1214 microversion: 2.1 time: 0.496841 Feb 19 21:07:38.909037 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1891/3898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:38 2022] GET /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a => generated 1214 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:38.933650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0fe8ce48-097c-446f-a165-ebc23b7107a4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:38.934167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0fe8ce48-097c-446f-a165-ebc23b7107a4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:38.995141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0fe8ce48-097c-446f-a165-ebc23b7107a4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:07:39.085749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2b0f9d0-765f-4bd6-b486-5cd77841c706 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:39.086765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c2b0f9d0-765f-4bd6-b486-5cd77841c706 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] [instance: 63482c29-4a39-4eaa-9bf1-de6107d9b0f0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:39.112837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2b0f9d0-765f-4bd6-b486-5cd77841c706 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:39.113500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2b0f9d0-765f-4bd6-b486-5cd77841c706 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:39.114088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2b0f9d0-765f-4bd6-b486-5cd77841c706 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:39.114520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2b0f9d0-765f-4bd6-b486-5cd77841c706 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:39.154181 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c2b0f9d0-765f-4bd6-b486-5cd77841c706 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] HTTP exception thrown: Instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 could not be found. Feb 19 21:07:39.165558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2b0f9d0-765f-4bd6-b486-5cd77841c706 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] Returning 404 to user: Instance 63482c29-4a39-4eaa-9bf1-de6107d9b0f0 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:39.167787 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c2b0f9d0-765f-4bd6-b486-5cd77841c706 tempest-ServersNegativeTestJSON-36785744 tempest-ServersNegativeTestJSON-36785744-project] 10.222.0.30 "GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0" status: 404 len: 111 microversion: 2.1 time: 0.087297 Feb 19 21:07:39.169149 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1892/3899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:39 2022] GET /compute/v2.1/servers/63482c29-4a39-4eaa-9bf1-de6107d9b0f0 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:07:39.777399 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.scheduler.client.report [None req-0fe8ce48-097c-446f-a165-ebc23b7107a4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Deleted allocations for instance 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a Feb 19 21:07:39.778662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:39.779308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:39.804855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:39.805719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:39.807215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:39.807973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:39.838796 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0fe8ce48-097c-446f-a165-ebc23b7107a4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a" status: 204 len: 0 microversion: 2.1 time: 0.908819 Feb 19 21:07:39.841489 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2008/3900] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:07:38 2022] DELETE /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a => generated 0 bytes in 914 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:07:39.858621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6dee6830-840b-4124-8035-5fe5b91d24fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:39.859623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6dee6830-840b-4124-8035-5fe5b91d24fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:39.873977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dee6830-840b-4124-8035-5fe5b91d24fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:39.875571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dee6830-840b-4124-8035-5fe5b91d24fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:39.876625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dee6830-840b-4124-8035-5fe5b91d24fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:39.877650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dee6830-840b-4124-8035-5fe5b91d24fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:39.902674 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-6dee6830-840b-4124-8035-5fe5b91d24fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a could not be found. Feb 19 21:07:39.903571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6dee6830-840b-4124-8035-5fe5b91d24fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:07:39.904675 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6dee6830-840b-4124-8035-5fe5b91d24fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a" status: 404 len: 111 microversion: 2.1 time: 0.056969 Feb 19 21:07:39.928286 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2009/3901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:39 2022] GET /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:07:40.012559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1520238003", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "be9178cb-fadc-423e-95e2-979af3a2f95e"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:40.112980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] validate_networks() for [('be9178cb-fadc-423e-95e2-979af3a2f95e', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:07:40.682612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:40.693024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:40.695050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:40.705292 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fa0fe42d-d8e1-47e4-8aab-751bda05baad tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1407 microversion: 2.20 time: 0.938012 Feb 19 21:07:40.706332 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1893/3902] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:39 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1407 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:40.876705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dff1122b-ac81-4b7b-b3f9-58e273e1e7fc tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Action: 'create', calling method: .version_select at 0x7f64673cdaf0>, body: {"keypair": {"name": "tempest-keypair-1865563910"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:40.893717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-dff1122b-ac81-4b7b-b3f9-58e273e1e7fc tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Getting quotas for project f260ed47c5994487a4cc293c33dae3ea. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:40.900187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-dff1122b-ac81-4b7b-b3f9-58e273e1e7fc tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Getting quotas for user 2ee3e5caf3e44b21b66cf9ad197e5999 and project f260ed47c5994487a4cc293c33dae3ea. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:41.046033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:07:41.046555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:07:41.046940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:07:41.047354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:07:41.047778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:07:41.057975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:41.058432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:41.059252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:41.059691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:41.062732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-dff1122b-ac81-4b7b-b3f9-58e273e1e7fc tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Getting quotas for project f260ed47c5994487a4cc293c33dae3ea. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:41.068062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-dff1122b-ac81-4b7b-b3f9-58e273e1e7fc tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Getting quotas for user 2ee3e5caf3e44b21b66cf9ad197e5999 and project f260ed47c5994487a4cc293c33dae3ea. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:41.083624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:41.085549 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dff1122b-ac81-4b7b-b3f9-58e273e1e7fc tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.32 time: 0.212268 Feb 19 21:07:41.086571 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1894/3903] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Feb 19 21:07:40 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 215 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:07:41.095907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for user 20246495a35b4762be5b2ad98f537377 and project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:41.111119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:07:41.114792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:07:41.167786 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ba6ef78e-3735-4f7f-a561-ac73d37c06ca tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166626 Feb 19 21:07:41.173049 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2010/3904] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:07:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:07:41.179365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f6e4f4c0-09c5-4c40-872c-c7f3b059226c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:41.180168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f6e4f4c0-09c5-4c40-872c-c7f3b059226c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:41.265599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f6e4f4c0-09c5-4c40-872c-c7f3b059226c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:41.295981 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f6e4f4c0-09c5-4c40-872c-c7f3b059226c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1215 microversion: 2.1 time: 0.108149 Feb 19 21:07:41.305769 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1895/3905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:41 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:41.736909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:41.737542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:41.759933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:41.761953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:41.763222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:41.765143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:42.252202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-fda20db8-7fa6-498b-bfb3-0e760e6a537e req-77fa4fab-b6f1-475c-93bd-1fa06a51beb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9598d4a9-3a39-4e96-b6ea-d437e2050247", "tag": "705d433e-42c6-442d-adce-cb0486512277"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:42.257051 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:42.257051 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:07:42.263719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fda20db8-7fa6-498b-bfb3-0e760e6a537e req-77fa4fab-b6f1-475c-93bd-1fa06a51beb0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:42.264170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-fda20db8-7fa6-498b-bfb3-0e760e6a537e req-77fa4fab-b6f1-475c-93bd-1fa06a51beb0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:42.297813 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-fda20db8-7fa6-498b-bfb3-0e760e6a537e req-77fa4fab-b6f1-475c-93bd-1fa06a51beb0 service nova] Creating event network-changed:705d433e-42c6-442d-adce-cb0486512277 for instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 on nch2-master-1 Feb 19 21:07:42.314578 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-fda20db8-7fa6-498b-bfb3-0e760e6a537e req-77fa4fab-b6f1-475c-93bd-1fa06a51beb0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069920 Feb 19 21:07:42.316893 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1896/3906] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:42.333739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-02996cdb-f39d-4000-9d22-0652e48c00a9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:42.335205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-02996cdb-f39d-4000-9d22-0652e48c00a9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:42.346464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02996cdb-f39d-4000-9d22-0652e48c00a9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:42.347003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02996cdb-f39d-4000-9d22-0652e48c00a9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:42.348048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02996cdb-f39d-4000-9d22-0652e48c00a9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:42.348716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02996cdb-f39d-4000-9d22-0652e48c00a9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:42.471340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-02996cdb-f39d-4000-9d22-0652e48c00a9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:42.485545 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-02996cdb-f39d-4000-9d22-0652e48c00a9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1267 microversion: 2.1 time: 0.166833 Feb 19 21:07:42.487583 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1897/3907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:42 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:42.621649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:42.641106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:42.643671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:42.647818 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d772fbb3-f298-4800-b4be-2903bb75a5ca tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1407 microversion: 2.20 time: 0.918751 Feb 19 21:07:42.650270 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2011/3908] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:41 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1407 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:43.506900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b993dadd-df28-4783-91f3-1097ed850fdf tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:43.508139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b993dadd-df28-4783-91f3-1097ed850fdf tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:43.528650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b993dadd-df28-4783-91f3-1097ed850fdf tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:43.529394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b993dadd-df28-4783-91f3-1097ed850fdf tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:43.530403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b993dadd-df28-4783-91f3-1097ed850fdf tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:43.531022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b993dadd-df28-4783-91f3-1097ed850fdf tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:43.667871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:43.668755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:43.677299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:43.678302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:43.679610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:43.680614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:43.707904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b993dadd-df28-4783-91f3-1097ed850fdf tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:43.724188 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b993dadd-df28-4783-91f3-1097ed850fdf tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1273 microversion: 2.1 time: 0.221886 Feb 19 21:07:43.727071 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1898/3909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:43 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:44.203937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:44.221711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:44.223265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:44.224575 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e2806628-5a4f-49cb-a0f0-b9c6fdb34e02 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1407 microversion: 2.20 time: 0.562404 Feb 19 21:07:44.225336 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2012/3910] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:43 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:07:44.747284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a683683a-91ac-4288-aa18-4879bbd2b35e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:44.747948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a683683a-91ac-4288-aa18-4879bbd2b35e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:44.770526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a683683a-91ac-4288-aa18-4879bbd2b35e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:44.770874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a683683a-91ac-4288-aa18-4879bbd2b35e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:44.773868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a683683a-91ac-4288-aa18-4879bbd2b35e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:44.774288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a683683a-91ac-4288-aa18-4879bbd2b35e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:45.243726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:45.245398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:45.255601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:45.256059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:45.256958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:45.257573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:45.376361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a683683a-91ac-4288-aa18-4879bbd2b35e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:45.384763 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a683683a-91ac-4288-aa18-4879bbd2b35e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1315 microversion: 2.1 time: 0.645172 Feb 19 21:07:45.385542 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1899/3911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:44 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:45.854401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:45.863495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:45.865353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:45.867517 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-62c154dd-64e8-4915-add7-9c08b70afd6e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1407 microversion: 2.20 time: 0.628125 Feb 19 21:07:45.869101 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2013/3912] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:45 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:46.026083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1946600725", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "412258df-58b8-4ea9-9432-b16f8bdfc8b8"}, {"port": "5896be69-08fa-4335-b439-1a196dfa8691", "tag": "port-1"}, {"port": "d2e2e0f9-6f33-4853-808c-07962b81a563", "tag": "port-2"}, {"uuid": "dab979e5-8b5d-487e-9e1b-dac0a9f9ee06", "tag": "net-1"}, {"uuid": "dab979e5-8b5d-487e-9e1b-dac0a9f9ee06"}, {"uuid": "5c55b6fb-c182-40ec-8324-04db14622512", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5c55b6fb-c182-40ec-8324-04db14622512", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3ff6b310-d818-4d76-b66a-68ab83434270", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "56aed238-dfe7-4409-a1cc-1d5aee658c06", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fd491209-be3e-4e2f-b5ae-a327e5f6dc9b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--91144015"}], "key_name": "tempest-keypair-1865563910", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:46.221218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] validate_networks() for [('412258df-58b8-4ea9-9432-b16f8bdfc8b8', None, None, None, None, None), (None, None, '5896be69-08fa-4335-b439-1a196dfa8691', None, None, None), (None, None, 'd2e2e0f9-6f33-4853-808c-07962b81a563', None, None, None), ('dab979e5-8b5d-487e-9e1b-dac0a9f9ee06', None, None, None, None, None), ('dab979e5-8b5d-487e-9e1b-dac0a9f9ee06', None, None, None, None, None), ('5c55b6fb-c182-40ec-8324-04db14622512', '10.2.2.100', None, None, None, None), ('5c55b6fb-c182-40ec-8324-04db14622512', '10.2.2.200', None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:07:46.402126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:46.402742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:46.409327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:46.409777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:46.410680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:46.411118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:46.828942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:46.847516 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1315 microversion: 2.1 time: 0.448842 Feb 19 21:07:46.858678 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2014/3913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:46 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:46.860605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:46.862088 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5316a062-54e3-42bf-a15c-23308db7cc2f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001851 Feb 19 21:07:46.862644 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2015/3914] 10.222.0.30 () {56 vars in 885 bytes} [Sat Feb 19 21:07:46 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Feb 19 21:07:46.888992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:46.889755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:46.897345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:46.898082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:46.899718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:46.904713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:47.403553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:47.426454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:47.432430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:47.435748 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83828127-3be4-4a26-889b-44ab4c5bf5d9 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1407 microversion: 2.20 time: 0.550842 Feb 19 21:07:47.452942 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2016/3915] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:46 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1407 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:07:47.481252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-77da4805-c68b-4d66-9c5d-306970342298 req-e22608c1-f6cf-40e7-b00d-c883d90ea34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e830f7e-f576-4d1a-8d33-16ac817471c9", "tag": "ffa51f04-9cbf-40b5-bed7-f5a71282e883"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:47.486867 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:47.486867 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:07:47.503961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-77da4805-c68b-4d66-9c5d-306970342298 req-e22608c1-f6cf-40e7-b00d-c883d90ea34f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:47.504611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-77da4805-c68b-4d66-9c5d-306970342298 req-e22608c1-f6cf-40e7-b00d-c883d90ea34f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:47.520378 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-77da4805-c68b-4d66-9c5d-306970342298 req-e22608c1-f6cf-40e7-b00d-c883d90ea34f service nova] Creating event network-changed:ffa51f04-9cbf-40b5-bed7-f5a71282e883 for instance 1e830f7e-f576-4d1a-8d33-16ac817471c9 on nch1-master-1 Feb 19 21:07:47.527762 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-77da4805-c68b-4d66-9c5d-306970342298 req-e22608c1-f6cf-40e7-b00d-c883d90ea34f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060734 Feb 19 21:07:47.528408 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2017/3916] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:47.869459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d046deaa-786d-4556-9b8a-ee5c9eaeb201 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:47.870513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d046deaa-786d-4556-9b8a-ee5c9eaeb201 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:47.879790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d046deaa-786d-4556-9b8a-ee5c9eaeb201 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:47.880257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d046deaa-786d-4556-9b8a-ee5c9eaeb201 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:47.881837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d046deaa-786d-4556-9b8a-ee5c9eaeb201 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:47.882489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d046deaa-786d-4556-9b8a-ee5c9eaeb201 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:48.430069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d046deaa-786d-4556-9b8a-ee5c9eaeb201 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:48.441474 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d046deaa-786d-4556-9b8a-ee5c9eaeb201 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1315 microversion: 2.1 time: 0.579775 Feb 19 21:07:48.455241 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2018/3917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:47 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:07:48.476066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:48.481484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:48.493919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:48.494378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:48.498013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:48.498456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:49.494323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:49.503803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:49.507852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:49.511881 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b66b76bf-ce16-4fae-bc2f-fef10f38cedb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1407 microversion: 2.20 time: 1.041044 Feb 19 21:07:49.523747 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2019/3918] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:48 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1407 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:49.530598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c91291d-4df2-4478-b927-c69d05b149f4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:49.531561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c91291d-4df2-4478-b927-c69d05b149f4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:49.541946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c91291d-4df2-4478-b927-c69d05b149f4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:49.542965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c91291d-4df2-4478-b927-c69d05b149f4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:49.545058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c91291d-4df2-4478-b927-c69d05b149f4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:49.545787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c91291d-4df2-4478-b927-c69d05b149f4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:50.008013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8c91291d-4df2-4478-b927-c69d05b149f4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:50.032427 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c91291d-4df2-4478-b927-c69d05b149f4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.506606 Feb 19 21:07:50.033939 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2020/3919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:49 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:50.046962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c916395b-8115-471e-a582-73ba8a81b532 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:50.048952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c916395b-8115-471e-a582-73ba8a81b532 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:50.092592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c916395b-8115-471e-a582-73ba8a81b532 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:50.094007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c916395b-8115-471e-a582-73ba8a81b532 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:50.096897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c916395b-8115-471e-a582-73ba8a81b532 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:50.098079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c916395b-8115-471e-a582-73ba8a81b532 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:50.469082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c916395b-8115-471e-a582-73ba8a81b532 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:50.482373 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c916395b-8115-471e-a582-73ba8a81b532 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1315 microversion: 2.1 time: 0.446181 Feb 19 21:07:50.492847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2021/3920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:50 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:50.492847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-22866801-2dd1-412a-bb85-23967ccd41d9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:50.492847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-22866801-2dd1-412a-bb85-23967ccd41d9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:50.503739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22866801-2dd1-412a-bb85-23967ccd41d9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:50.512551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22866801-2dd1-412a-bb85-23967ccd41d9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:50.513906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22866801-2dd1-412a-bb85-23967ccd41d9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:50.514699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22866801-2dd1-412a-bb85-23967ccd41d9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:50.861993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-22866801-2dd1-412a-bb85-23967ccd41d9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:50.871614 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-22866801-2dd1-412a-bb85-23967ccd41d9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.385426 Feb 19 21:07:50.872226 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2022/3921] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:50 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:50.878860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:50.885031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:50.891621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:50.892089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:50.893036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:50.893694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:51.223067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:51.234879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:51.236511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:51.238696 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6ad4186b-9be7-4010-a0bb-0f80296cc930 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1407 microversion: 2.20 time: 0.363460 Feb 19 21:07:51.239849 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2023/3922] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:50 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:51.245137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c883013c-e0f0-4193-9866-bffd34c47b90 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:51.246502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c883013c-e0f0-4193-9866-bffd34c47b90 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:51.257732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c883013c-e0f0-4193-9866-bffd34c47b90 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:51.258335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c883013c-e0f0-4193-9866-bffd34c47b90 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:51.261935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c883013c-e0f0-4193-9866-bffd34c47b90 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:51.263079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c883013c-e0f0-4193-9866-bffd34c47b90 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:51.513231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:07:51.515745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:07:51.516884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:07:51.517550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:07:51.518208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:07:51.532315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:51.534260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:51.535510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:51.536597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:51.563422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Getting quotas for project f260ed47c5994487a4cc293c33dae3ea. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:51.571306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Getting quotas for user 2ee3e5caf3e44b21b66cf9ad197e5999 and project f260ed47c5994487a4cc293c33dae3ea. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:51.599459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c883013c-e0f0-4193-9866-bffd34c47b90 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:51.620292 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c883013c-e0f0-4193-9866-bffd34c47b90 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.379046 Feb 19 21:07:51.634091 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2024/3923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:51 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:51.645948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-90c0b6d7-4529-4169-8e31-b61a0f5ca703 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:51.646577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-90c0b6d7-4529-4169-8e31-b61a0f5ca703 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:51.662266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90c0b6d7-4529-4169-8e31-b61a0f5ca703 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:51.665976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90c0b6d7-4529-4169-8e31-b61a0f5ca703 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:51.666925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90c0b6d7-4529-4169-8e31-b61a0f5ca703 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:51.667376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-90c0b6d7-4529-4169-8e31-b61a0f5ca703 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:51.885734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-90c0b6d7-4529-4169-8e31-b61a0f5ca703 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:51.888512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:07:51.892006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3ff6b310-d818-4d76-b66a-68ab83434270',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='56aed238-dfe7-4409-a1cc-1d5aee658c06',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd491209-be3e-4e2f-b5ae-a327e5f6dc9b',volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:07:51.914496 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-90c0b6d7-4529-4169-8e31-b61a0f5ca703 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1315 microversion: 2.1 time: 0.276947 Feb 19 21:07:51.916263 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2025/3924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:51 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:51.923274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5f68d49-2c08-483b-95a5-d68536e48cb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:51.925145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d5f68d49-2c08-483b-95a5-d68536e48cb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:51.937104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5f68d49-2c08-483b-95a5-d68536e48cb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:51.937900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5f68d49-2c08-483b-95a5-d68536e48cb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:51.938771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5f68d49-2c08-483b-95a5-d68536e48cb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:51.939430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5f68d49-2c08-483b-95a5-d68536e48cb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:52.208098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d5f68d49-2c08-483b-95a5-d68536e48cb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:52.226362 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5f68d49-2c08-483b-95a5-d68536e48cb6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.305746 Feb 19 21:07:52.227727 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2026/3925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:51 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:52.249366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-acf32b6b-7eb1-4fa9-ad94-13bc7c99c009 req-0eeea78f-d00c-43cb-a3a4-ca635c612276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9598d4a9-3a39-4e96-b6ea-d437e2050247", "name": "network-vif-plugged", "status": "completed", "tag": "705d433e-42c6-442d-adce-cb0486512277"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:52.264731 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:52.264731 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:07:52.283290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-acf32b6b-7eb1-4fa9-ad94-13bc7c99c009 req-0eeea78f-d00c-43cb-a3a4-ca635c612276 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:52.283932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-acf32b6b-7eb1-4fa9-ad94-13bc7c99c009 req-0eeea78f-d00c-43cb-a3a4-ca635c612276 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:52.300178 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-acf32b6b-7eb1-4fa9-ad94-13bc7c99c009 req-0eeea78f-d00c-43cb-a3a4-ca635c612276 service nova] Creating event network-vif-plugged:705d433e-42c6-442d-adce-cb0486512277 for instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 on nch2-master-1 Feb 19 21:07:52.307517 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-acf32b6b-7eb1-4fa9-ad94-13bc7c99c009 req-0eeea78f-d00c-43cb-a3a4-ca635c612276 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077655 Feb 19 21:07:52.309096 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2027/3926] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:52.317385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:52.319918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:52.329336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:52.330611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:52.331884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:52.332668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:52.484041 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-18347fee-0e1b-4c75-ae4a-46f35501a741 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 6.461210 Feb 19 21:07:52.490436 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1900/3927] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Feb 19 21:07:46 2022] POST /compute/v2.1/servers => generated 404 bytes in 6469 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 21:07:52.497118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-411390362", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "10d49579-ce64-4d24-a5f5-a01170b84f25"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:52.569610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] validate_networks() for [('10d49579-ce64-4d24-a5f5-a01170b84f25', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:07:52.635752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:52.645958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:52.648741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:52.649922 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5d6097a5-618f-430f-8e22-91aaff05cb85 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1407 microversion: 2.20 time: 0.339164 Feb 19 21:07:52.650502 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2028/3928] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:52 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:52.655657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-99c36a02-849e-4442-9e54-1811fe75c253 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:52.656419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-99c36a02-849e-4442-9e54-1811fe75c253 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:52.743503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-99c36a02-849e-4442-9e54-1811fe75c253 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:52.752868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-99c36a02-849e-4442-9e54-1811fe75c253 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:52.755756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-99c36a02-849e-4442-9e54-1811fe75c253 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:52.758382 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-99c36a02-849e-4442-9e54-1811fe75c253 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1286 microversion: 2.32 time: 0.106689 Feb 19 21:07:52.759584 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2029/3929] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:52 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:52.937164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-395b5f85-049f-4491-8f51-822d15aa92da tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:52.937977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-395b5f85-049f-4491-8f51-822d15aa92da tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:52.949857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-395b5f85-049f-4491-8f51-822d15aa92da tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:52.950756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-395b5f85-049f-4491-8f51-822d15aa92da tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:52.951618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-395b5f85-049f-4491-8f51-822d15aa92da tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:52.952150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-395b5f85-049f-4491-8f51-822d15aa92da tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:53.385285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-395b5f85-049f-4491-8f51-822d15aa92da tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:53.394866 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-395b5f85-049f-4491-8f51-822d15aa92da tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1315 microversion: 2.1 time: 0.462723 Feb 19 21:07:53.395873 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2030/3930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:52 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:53.495564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:07:53.496415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:07:53.497137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:07:53.498132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:07:53.499748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:07:53.513742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:53.514215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:53.515839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:53.516470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:53.545482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:07:53.552916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for user fad7207822c04fc289709200d7e2bd2d and project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:07:53.589768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:07:53.595317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:07:53.659389 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c48946d2-5868-4208-94fe-fe587a99fdb1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167719 Feb 19 21:07:53.660402 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1901/3931] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:07:53.673733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:53.674361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:53.690089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:53.696375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:53.697495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:53.698036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a439481f-4c71-45c9-ae96-87d8dd460cb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:53.699930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:53.700665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a439481f-4c71-45c9-ae96-87d8dd460cb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:53.888105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a439481f-4c71-45c9-ae96-87d8dd460cb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:53.903623 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a439481f-4c71-45c9-ae96-87d8dd460cb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1214 microversion: 2.1 time: 0.221467 Feb 19 21:07:53.904226 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1902/3932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:53 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:53.917567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:53.918694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:53.928992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:53.929572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:53.931377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:53.931935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:54.070791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:54.083512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:54.087743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:54.089184 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b26cfa6b-fd79-44c2-9e8a-a36143696285 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1576 microversion: 2.32 time: 0.183129 Feb 19 21:07:54.090016 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1903/3933] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:53 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:54.104557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:54.112205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:54.113791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:54.115383 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-57954fc4-cd34-4702-9b2c-b8cbd69f0a2f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1407 microversion: 2.20 time: 0.447990 Feb 19 21:07:54.117331 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2031/3934] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:53 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:54.417023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5b522376-a4ce-4029-96bd-85efced0bf72 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:54.418774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5b522376-a4ce-4029-96bd-85efced0bf72 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:54.427737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b522376-a4ce-4029-96bd-85efced0bf72 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:54.428924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b522376-a4ce-4029-96bd-85efced0bf72 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:54.432426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b522376-a4ce-4029-96bd-85efced0bf72 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:54.433130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b522376-a4ce-4029-96bd-85efced0bf72 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:54.763116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5b522376-a4ce-4029-96bd-85efced0bf72 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:54.771664 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5b522376-a4ce-4029-96bd-85efced0bf72 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1315 microversion: 2.1 time: 0.360832 Feb 19 21:07:54.773338 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1904/3935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:54 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:54.922106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bf5dd5d9-8580-48c8-90d4-2eeb4da53a98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:54.922740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bf5dd5d9-8580-48c8-90d4-2eeb4da53a98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:54.933909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf5dd5d9-8580-48c8-90d4-2eeb4da53a98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:54.934373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf5dd5d9-8580-48c8-90d4-2eeb4da53a98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:54.935192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf5dd5d9-8580-48c8-90d4-2eeb4da53a98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:54.936835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf5dd5d9-8580-48c8-90d4-2eeb4da53a98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:55.112175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bf5dd5d9-8580-48c8-90d4-2eeb4da53a98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:55.116305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:55.118852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:55.139134 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bf5dd5d9-8580-48c8-90d4-2eeb4da53a98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1266 microversion: 2.1 time: 0.218252 Feb 19 21:07:55.142505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:55.142915 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2032/3936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:54 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:55.144679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:55.148475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:55.148933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:55.163518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:55.166130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:55.190877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:55.201396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:55.205703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:55.212871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:55.411717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:55.427355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:55.437688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:55.438905 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ed5805d9-504f-4a65-8a97-934aefcc41c5 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1594 microversion: 2.32 time: 0.331272 Feb 19 21:07:55.439491 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1905/3937] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:55 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1594 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:55.471156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-626c5f08-1e97-41b0-bf0e-a8e0019c96fa req-ccae9a79-d444-4ab0-8143-b489fa733996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e830f7e-f576-4d1a-8d33-16ac817471c9", "name": "network-vif-plugged", "status": "completed", "tag": "ffa51f04-9cbf-40b5-bed7-f5a71282e883"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:55.472821 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:55.472821 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:07:55.506607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-626c5f08-1e97-41b0-bf0e-a8e0019c96fa req-ccae9a79-d444-4ab0-8143-b489fa733996 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:55.508830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-626c5f08-1e97-41b0-bf0e-a8e0019c96fa req-ccae9a79-d444-4ab0-8143-b489fa733996 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:55.539286 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-626c5f08-1e97-41b0-bf0e-a8e0019c96fa req-ccae9a79-d444-4ab0-8143-b489fa733996 service nova] Creating event network-vif-plugged:ffa51f04-9cbf-40b5-bed7-f5a71282e883 for instance 1e830f7e-f576-4d1a-8d33-16ac817471c9 on nch1-master-1 Feb 19 21:07:55.550494 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-626c5f08-1e97-41b0-bf0e-a8e0019c96fa req-ccae9a79-d444-4ab0-8143-b489fa733996 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082823 Feb 19 21:07:55.559473 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1906/3938] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:55.711404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:55.724555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:55.727937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:55.732271 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8697d104-20d8-4b01-8b74-288d9cdca114 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1598 microversion: 2.20 time: 0.583324 Feb 19 21:07:55.746251 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2033/3939] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:55 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1598 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:55.755467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2fd6428b-c411-4233-aeb3-57d28ef0ef4f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:55.756242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2fd6428b-c411-4233-aeb3-57d28ef0ef4f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:55.782568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fd6428b-c411-4233-aeb3-57d28ef0ef4f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:55.789976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-847ee53f-b463-4949-84bc-d8447892b075 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:55.790478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fd6428b-c411-4233-aeb3-57d28ef0ef4f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:55.791220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-847ee53f-b463-4949-84bc-d8447892b075 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:55.791864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fd6428b-c411-4233-aeb3-57d28ef0ef4f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:55.797273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fd6428b-c411-4233-aeb3-57d28ef0ef4f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:55.799255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-847ee53f-b463-4949-84bc-d8447892b075 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:55.799987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-847ee53f-b463-4949-84bc-d8447892b075 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:55.801042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-847ee53f-b463-4949-84bc-d8447892b075 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:55.801685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-847ee53f-b463-4949-84bc-d8447892b075 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:56.528866 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2fd6428b-c411-4233-aeb3-57d28ef0ef4f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.777833 Feb 19 21:07:56.529920 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1907/3940] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Feb 19 21:07:55 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/os-interface => generated 284 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:07:56.541971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-63ed3504-a79d-4c1f-a2a4-5f729da77421 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:56.542776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-63ed3504-a79d-4c1f-a2a4-5f729da77421 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:56.560677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63ed3504-a79d-4c1f-a2a4-5f729da77421 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:56.561382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63ed3504-a79d-4c1f-a2a4-5f729da77421 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:56.563034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63ed3504-a79d-4c1f-a2a4-5f729da77421 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:56.563663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-63ed3504-a79d-4c1f-a2a4-5f729da77421 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:56.746812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-847ee53f-b463-4949-84bc-d8447892b075 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:56.766207 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-847ee53f-b463-4949-84bc-d8447892b075 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1315 microversion: 2.1 time: 0.978630 Feb 19 21:07:56.767396 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2034/3941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:55 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1315 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:56.783845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:56.785699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:56.804096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:56.808229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:56.811569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:56.815719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:57.816702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-63ed3504-a79d-4c1f-a2a4-5f729da77421 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:57.826630 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-63ed3504-a79d-4c1f-a2a4-5f729da77421 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1314 microversion: 2.1 time: 1.289158 Feb 19 21:07:57.827244 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1908/3942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:56 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1314 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:57.858702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-548f09ca-897c-47c4-9c64-47811e888262 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:57.859431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-548f09ca-897c-47c4-9c64-47811e888262 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:57.870945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548f09ca-897c-47c4-9c64-47811e888262 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:57.871408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548f09ca-897c-47c4-9c64-47811e888262 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:57.872209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548f09ca-897c-47c4-9c64-47811e888262 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:57.882418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548f09ca-897c-47c4-9c64-47811e888262 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:57.925623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:57.936288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:57.942614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:57.947699 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d109a071-41dc-4f2f-a8d8-c76dd7e32bec tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1660 microversion: 2.32 time: 1.177298 Feb 19 21:07:57.957148 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2035/3943] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:56 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1660 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:07:58.444641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-548f09ca-897c-47c4-9c64-47811e888262 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:58.463408 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-548f09ca-897c-47c4-9c64-47811e888262 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1502 microversion: 2.1 time: 0.633666 Feb 19 21:07:58.467110 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1909/3944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:57 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1502 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:58.486508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54549d9d-584a-4480-8e33-1c3af0904a85 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:58.487083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54549d9d-584a-4480-8e33-1c3af0904a85 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:58.503492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54549d9d-584a-4480-8e33-1c3af0904a85 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:58.507321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54549d9d-584a-4480-8e33-1c3af0904a85 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:58.508365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54549d9d-584a-4480-8e33-1c3af0904a85 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:58.511053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54549d9d-584a-4480-8e33-1c3af0904a85 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:58.728206 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54549d9d-584a-4480-8e33-1c3af0904a85 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9/action" status: 202 len: 0 microversion: 2.1 time: 0.242397 Feb 19 21:07:58.743939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61bafaa4-765d-4de0-a4c2-92d873361a34 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:58.745270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-61bafaa4-765d-4de0-a4c2-92d873361a34 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:58.754453 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2036/3945] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:07:58 2022] POST /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:07:58.764021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61bafaa4-765d-4de0-a4c2-92d873361a34 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:58.764715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61bafaa4-765d-4de0-a4c2-92d873361a34 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:58.765700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61bafaa4-765d-4de0-a4c2-92d873361a34 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:58.766304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61bafaa4-765d-4de0-a4c2-92d873361a34 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:58.846855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0059f0fa-7e21-4379-b47a-db298328cb8b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:58.847617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0059f0fa-7e21-4379-b47a-db298328cb8b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:58.856439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0059f0fa-7e21-4379-b47a-db298328cb8b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:58.857246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0059f0fa-7e21-4379-b47a-db298328cb8b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:58.858269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0059f0fa-7e21-4379-b47a-db298328cb8b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:58.858900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0059f0fa-7e21-4379-b47a-db298328cb8b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:59.608543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0059f0fa-7e21-4379-b47a-db298328cb8b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:59.635191 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0059f0fa-7e21-4379-b47a-db298328cb8b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1314 microversion: 2.1 time: 0.792908 Feb 19 21:07:59.647429 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2037/3946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:58 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:07:59.655408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c15199f9-1c4b-45bb-bb8e-65200e25b698 req-2ccee99c-a081-4e17-a6cf-93d70608d608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73383da-8ceb-4cc4-86b1-1cbfd2fad4de", "tag": "38bd6a80-55ef-4392-bd03-a78c89dcbf7e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:07:59.657317 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:07:59.657317 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:07:59.666552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c15199f9-1c4b-45bb-bb8e-65200e25b698 req-2ccee99c-a081-4e17-a6cf-93d70608d608 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:59.667271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c15199f9-1c4b-45bb-bb8e-65200e25b698 req-2ccee99c-a081-4e17-a6cf-93d70608d608 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:59.680077 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c15199f9-1c4b-45bb-bb8e-65200e25b698 req-2ccee99c-a081-4e17-a6cf-93d70608d608 service nova] Creating event network-changed:38bd6a80-55ef-4392-bd03-a78c89dcbf7e for instance c73383da-8ceb-4cc4-86b1-1cbfd2fad4de on nch2-master-1 Feb 19 21:07:59.685714 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c15199f9-1c4b-45bb-bb8e-65200e25b698 req-2ccee99c-a081-4e17-a6cf-93d70608d608 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036940 Feb 19 21:07:59.686822 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2038/3947] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:07:59.692790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:07:59.694056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:07:59.694190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-61bafaa4-765d-4de0-a4c2-92d873361a34 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:07:59.701962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:59.702662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:59.704672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:07:59.705388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:07:59.711170 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-61bafaa4-765d-4de0-a4c2-92d873361a34 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1507 microversion: 2.1 time: 0.974695 Feb 19 21:07:59.713491 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1910/3948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:07:58 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1507 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:00.143201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-531313dc-6b93-4ce3-aaa8-62be913e900b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:00.143762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-531313dc-6b93-4ce3-aaa8-62be913e900b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:00.153335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:00.163406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-531313dc-6b93-4ce3-aaa8-62be913e900b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:00.166454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:00.167289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-531313dc-6b93-4ce3-aaa8-62be913e900b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:00.168373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-531313dc-6b93-4ce3-aaa8-62be913e900b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:00.169858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-531313dc-6b93-4ce3-aaa8-62be913e900b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:00.170038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:00.179306 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cf297847-7949-455f-9738-680896f19736 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1705 microversion: 2.32 time: 0.491009 Feb 19 21:08:00.195631 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2039/3949] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:07:59 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1705 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:00.201785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6463a629-a73c-4a28-8d5a-a9f9a21842e7 req-b4295e45-2738-4f33-9c59-fa3485e94159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9598d4a9-3a39-4e96-b6ea-d437e2050247", "tag": "705d433e-42c6-442d-adce-cb0486512277"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:00.208734 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:00.208734 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:08:00.233183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6463a629-a73c-4a28-8d5a-a9f9a21842e7 req-b4295e45-2738-4f33-9c59-fa3485e94159 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:00.233968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6463a629-a73c-4a28-8d5a-a9f9a21842e7 req-b4295e45-2738-4f33-9c59-fa3485e94159 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:00.252372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-531313dc-6b93-4ce3-aaa8-62be913e900b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/ips" status: 200 len: 111 microversion: 2.20 time: 0.115747 Feb 19 21:08:00.257420 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1911/3950] 10.222.0.30 () {60 vars in 1288 bytes} [Sat Feb 19 21:08:00 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/ips => generated 111 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 21:08:00.261683 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6463a629-a73c-4a28-8d5a-a9f9a21842e7 req-b4295e45-2738-4f33-9c59-fa3485e94159 service nova] Creating event network-changed:705d433e-42c6-442d-adce-cb0486512277 for instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 on nch2-master-1 Feb 19 21:08:00.272897 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6463a629-a73c-4a28-8d5a-a9f9a21842e7 req-b4295e45-2738-4f33-9c59-fa3485e94159 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071056 Feb 19 21:08:00.273932 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2040/3951] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:00.651664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dc52a41e-3e71-4756-a78e-911a651155de tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:00.652604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dc52a41e-3e71-4756-a78e-911a651155de tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:00.665993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc52a41e-3e71-4756-a78e-911a651155de tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:00.666452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc52a41e-3e71-4756-a78e-911a651155de tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:00.667262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc52a41e-3e71-4756-a78e-911a651155de tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:00.667726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc52a41e-3e71-4756-a78e-911a651155de tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:00.731409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-841143bd-c52a-42c3-a426-0adf86753427 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:00.733811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-841143bd-c52a-42c3-a426-0adf86753427 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:00.755346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-841143bd-c52a-42c3-a426-0adf86753427 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:00.758059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-841143bd-c52a-42c3-a426-0adf86753427 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:00.758954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-841143bd-c52a-42c3-a426-0adf86753427 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:00.759406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-841143bd-c52a-42c3-a426-0adf86753427 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:01.330748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dc52a41e-3e71-4756-a78e-911a651155de tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:01.343993 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dc52a41e-3e71-4756-a78e-911a651155de tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1314 microversion: 2.1 time: 0.695729 Feb 19 21:08:01.345111 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1912/3952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:00 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:01.352586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:01.353770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:01.363504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:01.364295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:01.366220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:01.366963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:01.528915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-841143bd-c52a-42c3-a426-0adf86753427 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:01.536888 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-841143bd-c52a-42c3-a426-0adf86753427 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1487 microversion: 2.1 time: 0.810063 Feb 19 21:08:01.537858 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2041/3953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:00 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1487 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:01.557154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3e0f4561-f999-4a99-a22d-c9c4ae10bd8a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:01.557669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3e0f4561-f999-4a99-a22d-c9c4ae10bd8a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:01.575229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e0f4561-f999-4a99-a22d-c9c4ae10bd8a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:01.576580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e0f4561-f999-4a99-a22d-c9c4ae10bd8a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:01.577941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e0f4561-f999-4a99-a22d-c9c4ae10bd8a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:01.578654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3e0f4561-f999-4a99-a22d-c9c4ae10bd8a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:01.627073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3e0f4561-f999-4a99-a22d-c9c4ae10bd8a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:08:01.799015 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3e0f4561-f999-4a99-a22d-c9c4ae10bd8a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 204 len: 0 microversion: 2.1 time: 0.245355 Feb 19 21:08:01.799930 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2042/3954] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:08:01 2022] DELETE /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:08:01.809625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3fbe2831-b3b8-4e67-996f-11227b02040d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:01.810347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3fbe2831-b3b8-4e67-996f-11227b02040d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:01.818054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fbe2831-b3b8-4e67-996f-11227b02040d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:01.818502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fbe2831-b3b8-4e67-996f-11227b02040d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:01.820166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fbe2831-b3b8-4e67-996f-11227b02040d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:01.820422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fbe2831-b3b8-4e67-996f-11227b02040d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:01.831424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:01.843096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:01.858346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:01.859544 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2dbad2be-a3eb-447e-a637-c7931ed8062c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1693 microversion: 2.32 time: 0.512958 Feb 19 21:08:01.872991 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1913/3955] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:01 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1693 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:02.304242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3fbe2831-b3b8-4e67-996f-11227b02040d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:02.317333 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3fbe2831-b3b8-4e67-996f-11227b02040d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1493 microversion: 2.1 time: 0.512543 Feb 19 21:08:02.318891 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2043/3956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:01 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1493 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:02.370430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-294a1e3d-b7f7-4c08-8315-b15175269aa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:02.371048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-294a1e3d-b7f7-4c08-8315-b15175269aa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:02.380142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-294a1e3d-b7f7-4c08-8315-b15175269aa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:02.380142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-294a1e3d-b7f7-4c08-8315-b15175269aa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:02.380142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-294a1e3d-b7f7-4c08-8315-b15175269aa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:02.380142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-294a1e3d-b7f7-4c08-8315-b15175269aa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:02.759616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-294a1e3d-b7f7-4c08-8315-b15175269aa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:02.770854 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-294a1e3d-b7f7-4c08-8315-b15175269aa3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1314 microversion: 2.1 time: 0.403777 Feb 19 21:08:02.782439 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1914/3957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:02 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:02.879637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:02.880597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:02.891743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:02.893674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:02.894843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:02.895955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:03.301834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:03.313108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:03.314647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:03.316083 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c71c82a-0e6e-480c-8b59-263585b52b37 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1738 microversion: 2.32 time: 0.440554 Feb 19 21:08:03.321037 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2044/3958] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:02 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1738 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:03.336095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-72d4605f-6273-4ed3-91d3-dc6e0c774056 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:03.337223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-72d4605f-6273-4ed3-91d3-dc6e0c774056 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:03.345880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72d4605f-6273-4ed3-91d3-dc6e0c774056 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:03.346328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72d4605f-6273-4ed3-91d3-dc6e0c774056 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:03.347132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72d4605f-6273-4ed3-91d3-dc6e0c774056 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:03.347566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72d4605f-6273-4ed3-91d3-dc6e0c774056 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:03.650113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-72d4605f-6273-4ed3-91d3-dc6e0c774056 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:03.663728 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-72d4605f-6273-4ed3-91d3-dc6e0c774056 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1493 microversion: 2.1 time: 0.330114 Feb 19 21:08:03.677867 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1915/3959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:03 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1493 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:03.789946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-012b21ab-3989-4cfc-bbe5-7c28c7c5a653 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:03.791477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-012b21ab-3989-4cfc-bbe5-7c28c7c5a653 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:03.804024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-012b21ab-3989-4cfc-bbe5-7c28c7c5a653 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:03.804795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-012b21ab-3989-4cfc-bbe5-7c28c7c5a653 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:03.805867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-012b21ab-3989-4cfc-bbe5-7c28c7c5a653 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:03.808999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-012b21ab-3989-4cfc-bbe5-7c28c7c5a653 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:04.181230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-64c0fc30-dd90-427e-a968-a5218f42890a req-bd23e463-53d6-420f-9dad-0dfd73cf19ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e830f7e-f576-4d1a-8d33-16ac817471c9", "name": "network-vif-deleted", "tag": "ffa51f04-9cbf-40b5-bed7-f5a71282e883"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:04.183067 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:04.183067 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:04.186128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-012b21ab-3989-4cfc-bbe5-7c28c7c5a653 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:04.196629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-64c0fc30-dd90-427e-a968-a5218f42890a req-bd23e463-53d6-420f-9dad-0dfd73cf19ea service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:04.197064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-64c0fc30-dd90-427e-a968-a5218f42890a req-bd23e463-53d6-420f-9dad-0dfd73cf19ea service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:04.203671 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-012b21ab-3989-4cfc-bbe5-7c28c7c5a653 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1314 microversion: 2.1 time: 0.417170 Feb 19 21:08:04.221939 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2045/3960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:03 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:04.225817 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-64c0fc30-dd90-427e-a968-a5218f42890a req-bd23e463-53d6-420f-9dad-0dfd73cf19ea service nova] Creating event network-vif-deleted:ffa51f04-9cbf-40b5-bed7-f5a71282e883 for instance 1e830f7e-f576-4d1a-8d33-16ac817471c9 on nch1-master-1 Feb 19 21:08:04.236063 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-64c0fc30-dd90-427e-a968-a5218f42890a req-bd23e463-53d6-420f-9dad-0dfd73cf19ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056873 Feb 19 21:08:04.241715 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1916/3961] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:04.340365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:04.341136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:04.351718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:04.352180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:04.354696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:04.355150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:04.685138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:04.686286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:04.687429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:04.696849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:04.697505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:04.698881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:04.699532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:04.709662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:04.711704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:04.713413 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-52ccc10a-1fd8-4c96-b680-e6369060d0e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1783 microversion: 2.32 time: 0.377877 Feb 19 21:08:04.734312 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2046/3962] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:04 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1783 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:04.744719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:04.745496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:04.746735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lazy-loading 'fault' on Instance uuid 1e830f7e-f576-4d1a-8d33-16ac817471c9 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:08:04.852866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:04.863043 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bcf4a8da-4430-4ad0-87d5-1a2a805a9b3b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 200 len: 1305 microversion: 2.1 time: 0.182880 Feb 19 21:08:04.864103 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1917/3963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:04 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 1305 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:05.219773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87db2674-70ca-4e1c-bbe2-81782c88befb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:05.221704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-87db2674-70ca-4e1c-bbe2-81782c88befb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:05.233435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87db2674-70ca-4e1c-bbe2-81782c88befb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:05.235456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87db2674-70ca-4e1c-bbe2-81782c88befb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:05.237498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87db2674-70ca-4e1c-bbe2-81782c88befb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:05.242388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87db2674-70ca-4e1c-bbe2-81782c88befb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:05.736415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-87db2674-70ca-4e1c-bbe2-81782c88befb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:05.746554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:05.747168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:05.748215 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-87db2674-70ca-4e1c-bbe2-81782c88befb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1314 microversion: 2.1 time: 0.531869 Feb 19 21:08:05.760181 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2047/3964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:05 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:05.769860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:05.771371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:05.773918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:05.777483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:05.883662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-12f403e4-eced-4f0c-b6b7-c7a4e4b99672 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:05.884684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-12f403e4-eced-4f0c-b6b7-c7a4e4b99672 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:05.911481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12f403e4-eced-4f0c-b6b7-c7a4e4b99672 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:05.911944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12f403e4-eced-4f0c-b6b7-c7a4e4b99672 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:05.919669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12f403e4-eced-4f0c-b6b7-c7a4e4b99672 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:05.920128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12f403e4-eced-4f0c-b6b7-c7a4e4b99672 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:05.973323 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-12f403e4-eced-4f0c-b6b7-c7a4e4b99672 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 1e830f7e-f576-4d1a-8d33-16ac817471c9 could not be found. Feb 19 21:08:05.974222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-12f403e4-eced-4f0c-b6b7-c7a4e4b99672 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 1e830f7e-f576-4d1a-8d33-16ac817471c9 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:08:05.975598 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-12f403e4-eced-4f0c-b6b7-c7a4e4b99672 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 404 len: 111 microversion: 2.1 time: 0.097854 Feb 19 21:08:05.988367 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2048/3965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:05 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:08:06.002201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-931c7816-1ffa-42ae-82c0-1cbb109bac81 req-5fdb023c-cc92-430a-afc5-1d260fef952c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73383da-8ceb-4cc4-86b1-1cbfd2fad4de", "name": "network-vif-plugged", "status": "completed", "tag": "38bd6a80-55ef-4392-bd03-a78c89dcbf7e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:06.006797 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:06.006797 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:08:06.018877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-931c7816-1ffa-42ae-82c0-1cbb109bac81 req-5fdb023c-cc92-430a-afc5-1d260fef952c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:06.021096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-931c7816-1ffa-42ae-82c0-1cbb109bac81 req-5fdb023c-cc92-430a-afc5-1d260fef952c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:06.066988 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-931c7816-1ffa-42ae-82c0-1cbb109bac81 req-5fdb023c-cc92-430a-afc5-1d260fef952c service nova] Creating event network-vif-plugged:38bd6a80-55ef-4392-bd03-a78c89dcbf7e for instance c73383da-8ceb-4cc4-86b1-1cbfd2fad4de on nch2-master-1 Feb 19 21:08:06.074536 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-931c7816-1ffa-42ae-82c0-1cbb109bac81 req-5fdb023c-cc92-430a-afc5-1d260fef952c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096582 Feb 19 21:08:06.075492 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2049/3966] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:06.158145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-521287598", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "be9178cb-fadc-423e-95e2-979af3a2f95e"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:06.258905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] validate_networks() for [('be9178cb-fadc-423e-95e2-979af3a2f95e', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:08:07.246488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:07.256760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:07.259256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:07.260710 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8116e243-75dc-4239-95d7-953689989922 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1828 microversion: 2.32 time: 1.521814 Feb 19 21:08:07.261487 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1918/3967] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:05 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1828 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:07.266272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-7cb030c2-ce9b-48e7-b1f9-c5505e65adfb req-f97d4a0a-6b32-4754-a24b-f22c4ff6f691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "tag": "953183ea-8af2-4363-894d-4fc5565d335c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:07.268173 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:07.268173 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:07.276138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7cb030c2-ce9b-48e7-b1f9-c5505e65adfb req-f97d4a0a-6b32-4754-a24b-f22c4ff6f691 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:07.276899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7cb030c2-ce9b-48e7-b1f9-c5505e65adfb req-f97d4a0a-6b32-4754-a24b-f22c4ff6f691 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:07.288562 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-7cb030c2-ce9b-48e7-b1f9-c5505e65adfb req-f97d4a0a-6b32-4754-a24b-f22c4ff6f691 service nova] Creating event network-changed:953183ea-8af2-4363-894d-4fc5565d335c for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:07.294455 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-7cb030c2-ce9b-48e7-b1f9-c5505e65adfb req-f97d4a0a-6b32-4754-a24b-f22c4ff6f691 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031357 Feb 19 21:08:07.295584 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1919/3968] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:07.303017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-85b7f0c2-4a6c-4308-b9f5-9a54e1bafabe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:07.304762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-85b7f0c2-4a6c-4308-b9f5-9a54e1bafabe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:07.311994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85b7f0c2-4a6c-4308-b9f5-9a54e1bafabe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:07.312703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85b7f0c2-4a6c-4308-b9f5-9a54e1bafabe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:07.313690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85b7f0c2-4a6c-4308-b9f5-9a54e1bafabe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:07.314318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85b7f0c2-4a6c-4308-b9f5-9a54e1bafabe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:07.696160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:08:07.697529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:08:07.698412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:08:07.699845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:08:07.700611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:08:07.713389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-85b7f0c2-4a6c-4308-b9f5-9a54e1bafabe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:07.719780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:07.720239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:07.732235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:07.732865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:07.736686 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-85b7f0c2-4a6c-4308-b9f5-9a54e1bafabe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1314 microversion: 2.1 time: 0.427746 Feb 19 21:08:07.737730 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1920/3969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:07 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:07.757301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:08:07.764651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for user 20246495a35b4762be5b2ad98f537377 and project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:08:07.782629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:08:07.784969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:08:07.847762 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c21ba60-e82f-4c57-812b-5d26447dee31 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694580 Feb 19 21:08:07.855956 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2050/3970] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:08:07.861992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cbd7d10b-ff3f-451c-b403-454bc8afde99 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:07.862885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cbd7d10b-ff3f-451c-b403-454bc8afde99 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:07.947222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cbd7d10b-ff3f-451c-b403-454bc8afde99 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:07.956048 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cbd7d10b-ff3f-451c-b403-454bc8afde99 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1214 microversion: 2.1 time: 0.097734 Feb 19 21:08:07.957070 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1921/3971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:07 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:08.281252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:08.281884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:08.296517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:08.297359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:08.298386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:08.298999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:08.641521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:08.655857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:08.664793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:08.668419 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d50146fc-d607-4e95-8499-796f782fb193 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1849 microversion: 2.32 time: 0.391675 Feb 19 21:08:08.669093 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2051/3972] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:08 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1849 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:08.755311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8a46d45b-fa40-432d-9b33-b93f89743d47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:08.756974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8a46d45b-fa40-432d-9b33-b93f89743d47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:08.774433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a46d45b-fa40-432d-9b33-b93f89743d47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:08.776247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a46d45b-fa40-432d-9b33-b93f89743d47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:08.780083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a46d45b-fa40-432d-9b33-b93f89743d47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:08.782047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a46d45b-fa40-432d-9b33-b93f89743d47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:08.976293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-16e209a9-24e4-4d8f-a35b-fa8610f91d20 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:08.977111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-16e209a9-24e4-4d8f-a35b-fa8610f91d20 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:08.986748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16e209a9-24e4-4d8f-a35b-fa8610f91d20 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:08.989980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16e209a9-24e4-4d8f-a35b-fa8610f91d20 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:08.992487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16e209a9-24e4-4d8f-a35b-fa8610f91d20 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:08.994860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16e209a9-24e4-4d8f-a35b-fa8610f91d20 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:09.162057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-16e209a9-24e4-4d8f-a35b-fa8610f91d20 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:09.166316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8a46d45b-fa40-432d-9b33-b93f89743d47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:09.175547 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8a46d45b-fa40-432d-9b33-b93f89743d47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1501 microversion: 2.1 time: 0.424401 Feb 19 21:08:09.191051 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-16e209a9-24e4-4d8f-a35b-fa8610f91d20 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1274 microversion: 2.1 time: 0.220134 Feb 19 21:08:09.192963 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2052/3973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:08 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:09.201437 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1922/3974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:08 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1501 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:09.212803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1bec4dca-d642-4e69-987c-b6dbf9cc2b08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:09.215402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1bec4dca-d642-4e69-987c-b6dbf9cc2b08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:09.229451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bec4dca-d642-4e69-987c-b6dbf9cc2b08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:09.229913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bec4dca-d642-4e69-987c-b6dbf9cc2b08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:09.232725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bec4dca-d642-4e69-987c-b6dbf9cc2b08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:09.233174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1bec4dca-d642-4e69-987c-b6dbf9cc2b08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:09.355757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d1aa9f64-f2cd-4859-a276-5a22d4af0280 req-38fe6aca-819d-40ad-aecd-6ea04b32859e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "tag": "5896be69-08fa-4335-b439-1a196dfa8691"}, {"name": "network-changed", "server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "tag": "d2e2e0f9-6f33-4853-808c-07962b81a563"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:09.357798 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:09.357798 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:09.372662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d1aa9f64-f2cd-4859-a276-5a22d4af0280 req-38fe6aca-819d-40ad-aecd-6ea04b32859e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:09.373509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d1aa9f64-f2cd-4859-a276-5a22d4af0280 req-38fe6aca-819d-40ad-aecd-6ea04b32859e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:09.389381 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d1aa9f64-f2cd-4859-a276-5a22d4af0280 req-38fe6aca-819d-40ad-aecd-6ea04b32859e service nova] Creating event network-changed:5896be69-08fa-4335-b439-1a196dfa8691 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:09.390394 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d1aa9f64-f2cd-4859-a276-5a22d4af0280 req-38fe6aca-819d-40ad-aecd-6ea04b32859e service nova] Creating event network-changed:d2e2e0f9-6f33-4853-808c-07962b81a563 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:09.395901 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d1aa9f64-f2cd-4859-a276-5a22d4af0280 req-38fe6aca-819d-40ad-aecd-6ea04b32859e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043765 Feb 19 21:08:09.397580 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1923/3975] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:08:09.604734 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.network.security_group_api [None req-1bec4dca-d642-4e69-987c-b6dbf9cc2b08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Removing security group 4fcdcfde-963e-4121-a4e5-55e015651b0b from port 38bd6a80-55ef-4392-bd03-a78c89dcbf7e Feb 19 21:08:09.690988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:09.691640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:09.699453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:09.700154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:09.701138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:09.701741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:10.439276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:10.452079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:10.455006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:10.456711 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ceb41759-bc6f-432c-953f-b192b0f320c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.770011 Feb 19 21:08:10.459240 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1924/3976] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:09 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:08:10.463269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c941e895-5d88-4acb-9212-98e645fa2f0f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:10.464208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c941e895-5d88-4acb-9212-98e645fa2f0f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:10.474303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c941e895-5d88-4acb-9212-98e645fa2f0f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:10.475947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c941e895-5d88-4acb-9212-98e645fa2f0f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:10.477326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c941e895-5d88-4acb-9212-98e645fa2f0f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:10.478016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c941e895-5d88-4acb-9212-98e645fa2f0f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:10.821025 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1bec4dca-d642-4e69-987c-b6dbf9cc2b08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de/action" status: 202 len: 0 microversion: 2.1 time: 1.626198 Feb 19 21:08:10.822244 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2053/3977] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:08:09 2022] POST /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de/action => generated 0 bytes in 1629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:08:10.830352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e2fb7e90-6185-4e62-a731-8dfceb1e3f63 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:10.833010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e2fb7e90-6185-4e62-a731-8dfceb1e3f63 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:10.846185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2fb7e90-6185-4e62-a731-8dfceb1e3f63 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:10.856418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2fb7e90-6185-4e62-a731-8dfceb1e3f63 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:10.868951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2fb7e90-6185-4e62-a731-8dfceb1e3f63 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:10.876484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2fb7e90-6185-4e62-a731-8dfceb1e3f63 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:11.645159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c941e895-5d88-4acb-9212-98e645fa2f0f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:11.651015 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c941e895-5d88-4acb-9212-98e645fa2f0f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1314 microversion: 2.1 time: 1.192349 Feb 19 21:08:11.651733 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1925/3978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:10 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1314 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:11.656608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ace92b5c-5868-4875-ba0f-e8b978be2863 req-aa94fa43-788d-450a-afd5-91d36347bebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f620150-4262-4d39-9937-e1f00ea04a88", "tag": "d8970ddf-bb4f-4a41-8cb2-0ed56b52ff6e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:11.658277 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:11.658277 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:11.665936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ace92b5c-5868-4875-ba0f-e8b978be2863 req-aa94fa43-788d-450a-afd5-91d36347bebc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:11.666139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e2fb7e90-6185-4e62-a731-8dfceb1e3f63 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:11.666573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ace92b5c-5868-4875-ba0f-e8b978be2863 req-aa94fa43-788d-450a-afd5-91d36347bebc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:11.673964 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e2fb7e90-6185-4e62-a731-8dfceb1e3f63 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1459 microversion: 2.1 time: 0.847402 Feb 19 21:08:11.674660 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2054/3979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:10 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1459 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:11.680203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:11.681216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:11.687970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:11.688627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:11.689490 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ace92b5c-5868-4875-ba0f-e8b978be2863 req-aa94fa43-788d-450a-afd5-91d36347bebc service nova] Creating event network-changed:d8970ddf-bb4f-4a41-8cb2-0ed56b52ff6e for instance 6f620150-4262-4d39-9937-e1f00ea04a88 on nch1-master-1 Feb 19 21:08:11.689788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:11.690302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:11.697330 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ace92b5c-5868-4875-ba0f-e8b978be2863 req-aa94fa43-788d-450a-afd5-91d36347bebc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044265 Feb 19 21:08:11.697977 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1926/3980] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:11.710770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-44ee075d-624e-48ed-ae98-8b9aaeac6cda req-adfa4db7-35a1-41d3-a229-fbe40567622c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73383da-8ceb-4cc4-86b1-1cbfd2fad4de", "tag": "38bd6a80-55ef-4392-bd03-a78c89dcbf7e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:11.712641 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:11.712641 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:11.722779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-44ee075d-624e-48ed-ae98-8b9aaeac6cda req-adfa4db7-35a1-41d3-a229-fbe40567622c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:11.723508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-44ee075d-624e-48ed-ae98-8b9aaeac6cda req-adfa4db7-35a1-41d3-a229-fbe40567622c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:11.750734 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-44ee075d-624e-48ed-ae98-8b9aaeac6cda req-adfa4db7-35a1-41d3-a229-fbe40567622c service nova] Creating event network-changed:38bd6a80-55ef-4392-bd03-a78c89dcbf7e for instance c73383da-8ceb-4cc4-86b1-1cbfd2fad4de on nch2-master-1 Feb 19 21:08:11.759191 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-44ee075d-624e-48ed-ae98-8b9aaeac6cda req-adfa4db7-35a1-41d3-a229-fbe40567622c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053363 Feb 19 21:08:11.760115 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1927/3981] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:11.774916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-93200d77-d778-4e16-9086-8aff1a9ae1d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:11.776168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-93200d77-d778-4e16-9086-8aff1a9ae1d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:11.784190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93200d77-d778-4e16-9086-8aff1a9ae1d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:11.784676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93200d77-d778-4e16-9086-8aff1a9ae1d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:11.786132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93200d77-d778-4e16-9086-8aff1a9ae1d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:11.786631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93200d77-d778-4e16-9086-8aff1a9ae1d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:12.471292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-93200d77-d778-4e16-9086-8aff1a9ae1d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:12.481507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:12.486636 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-93200d77-d778-4e16-9086-8aff1a9ae1d7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.724388 Feb 19 21:08:12.506905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:12.506905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:12.506905 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c32e11d0-422a-4f95-ba9b-4ad60af103e6 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.820239 Feb 19 21:08:12.507348 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1928/3982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:11 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:12.508781 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2055/3983] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:11 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:12.509619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-18b127bf-b3e6-43fc-8efe-a871e685a326 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:12.510241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-18b127bf-b3e6-43fc-8efe-a871e685a326 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:12.525842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18b127bf-b3e6-43fc-8efe-a871e685a326 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:12.526322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18b127bf-b3e6-43fc-8efe-a871e685a326 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:12.527242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18b127bf-b3e6-43fc-8efe-a871e685a326 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:12.527698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18b127bf-b3e6-43fc-8efe-a871e685a326 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:12.670948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd975aee-f45b-42ed-9414-cd0749e1ec3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:12.671998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cd975aee-f45b-42ed-9414-cd0749e1ec3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:12.679611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd975aee-f45b-42ed-9414-cd0749e1ec3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:12.680163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd975aee-f45b-42ed-9414-cd0749e1ec3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:12.681078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd975aee-f45b-42ed-9414-cd0749e1ec3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:12.681797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd975aee-f45b-42ed-9414-cd0749e1ec3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:13.020380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-18b127bf-b3e6-43fc-8efe-a871e685a326 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:13.032255 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-18b127bf-b3e6-43fc-8efe-a871e685a326 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.526756 Feb 19 21:08:13.033381 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1929/3984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:12 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:13.051118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dea09a35-b202-4eb7-be24-7beb00b808f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:13.051723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dea09a35-b202-4eb7-be24-7beb00b808f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:13.057728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dea09a35-b202-4eb7-be24-7beb00b808f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:13.058183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dea09a35-b202-4eb7-be24-7beb00b808f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:13.058978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dea09a35-b202-4eb7-be24-7beb00b808f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:13.059414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dea09a35-b202-4eb7-be24-7beb00b808f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:13.192856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cd975aee-f45b-42ed-9414-cd0749e1ec3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:13.202243 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd975aee-f45b-42ed-9414-cd0749e1ec3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1314 microversion: 2.1 time: 0.536634 Feb 19 21:08:13.202845 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2056/3985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:12 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:13.426409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dea09a35-b202-4eb7-be24-7beb00b808f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:13.455548 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dea09a35-b202-4eb7-be24-7beb00b808f8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.403436 Feb 19 21:08:13.456677 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1930/3986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:13 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:13.496523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f4d157c4-6db7-4037-a7c5-09e29503ac54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:13.497376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f4d157c4-6db7-4037-a7c5-09e29503ac54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:13.507587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4d157c4-6db7-4037-a7c5-09e29503ac54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:13.508031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4d157c4-6db7-4037-a7c5-09e29503ac54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:13.509421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4d157c4-6db7-4037-a7c5-09e29503ac54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:13.509808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4d157c4-6db7-4037-a7c5-09e29503ac54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:13.518757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:13.519395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:13.526747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:13.527030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:13.527835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:13.528418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:14.030941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:14.044677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:14.045108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f4d157c4-6db7-4037-a7c5-09e29503ac54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:14.061242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:14.063121 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a41cb4e9-6e07-4e65-9a47-4b0aa3c4c481 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.551842 Feb 19 21:08:14.065431 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1931/3987] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:13 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:14.073657 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f4d157c4-6db7-4037-a7c5-09e29503ac54 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.581518 Feb 19 21:08:14.081092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f68ac63e-8cc6-432d-8e51-9ce9849ec6a1 req-a7d2f051-d6ae-4247-b510-b7a1bccf5a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "tag": "70eb9392-ffac-4852-9582-a01fcfe48d7c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:14.083595 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2057/3988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:13 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:14.095540 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:14.095540 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:14.105284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f68ac63e-8cc6-432d-8e51-9ce9849ec6a1 req-a7d2f051-d6ae-4247-b510-b7a1bccf5a54 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:14.107599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f68ac63e-8cc6-432d-8e51-9ce9849ec6a1 req-a7d2f051-d6ae-4247-b510-b7a1bccf5a54 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:14.129924 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f68ac63e-8cc6-432d-8e51-9ce9849ec6a1 req-a7d2f051-d6ae-4247-b510-b7a1bccf5a54 service nova] Creating event network-changed:70eb9392-ffac-4852-9582-a01fcfe48d7c for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:14.136426 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f68ac63e-8cc6-432d-8e51-9ce9849ec6a1 req-a7d2f051-d6ae-4247-b510-b7a1bccf5a54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066589 Feb 19 21:08:14.137578 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1932/3989] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:14.221933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e97aadc-b675-4f3f-8b01-23306f9fec4a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:14.223427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5e97aadc-b675-4f3f-8b01-23306f9fec4a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:14.239275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e97aadc-b675-4f3f-8b01-23306f9fec4a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:14.240535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e97aadc-b675-4f3f-8b01-23306f9fec4a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:14.241382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e97aadc-b675-4f3f-8b01-23306f9fec4a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:14.241832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e97aadc-b675-4f3f-8b01-23306f9fec4a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:14.272431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1288662199", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "10d49579-ce64-4d24-a5f5-a01170b84f25"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:14.330857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] validate_networks() for [('10d49579-ce64-4d24-a5f5-a01170b84f25', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:08:15.060029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e97aadc-b675-4f3f-8b01-23306f9fec4a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:15.072098 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5e97aadc-b675-4f3f-8b01-23306f9fec4a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1314 microversion: 2.1 time: 0.856236 Feb 19 21:08:15.072804 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2058/3990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:14 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:15.089590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:15.092807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:15.101801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:15.102775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:15.103953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:15.105244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:15.621614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:15.632978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:15.636933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:15.638874 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-10191191-9ea0-4b23-a62e-3eb65d60a7e2 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.554559 Feb 19 21:08:15.639781 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2059/3991] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:15 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:15.649669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6768d674-2239-42f2-9cff-52dea663902f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15fd35a7-de5b-44ee-af9e-26318f1c9422"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:15.651916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6768d674-2239-42f2-9cff-52dea663902f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:15.664668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:08:15.665224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6768d674-2239-42f2-9cff-52dea663902f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:15.665370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:08:15.665488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6768d674-2239-42f2-9cff-52dea663902f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:15.665596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:08:15.665999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:08:15.666343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6768d674-2239-42f2-9cff-52dea663902f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:15.666451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:08:15.666790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6768d674-2239-42f2-9cff-52dea663902f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:15.678837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:15.679290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:15.680256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:15.680754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:15.709012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:08:15.714986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Getting quotas for user fad7207822c04fc289709200d7e2bd2d and project e4e370ef28034ffbbbee9d2cfd826084. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:08:15.732851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:08:15.735943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:08:15.786011 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c2e42077-18b1-48a1-ac99-4b5c3c9e03d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.518127 Feb 19 21:08:15.787930 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1933/3992] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:08:15.806100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b88236c-0060-433c-9dc6-fc2918f6917e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:15.807755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b88236c-0060-433c-9dc6-fc2918f6917e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:15.889716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9b88236c-0060-433c-9dc6-fc2918f6917e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:15.901219 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b88236c-0060-433c-9dc6-fc2918f6917e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1215 microversion: 2.1 time: 0.099322 Feb 19 21:08:15.901705 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1934/3993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:15 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:16.044383 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6768d674-2239-42f2-9cff-52dea663902f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403098 Feb 19 21:08:16.045239 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2060/3994] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:08:15 2022] POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:16.089862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0399589c-9d58-4f31-997a-bc0b93d5f25d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:16.097396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0399589c-9d58-4f31-997a-bc0b93d5f25d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:16.108032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0399589c-9d58-4f31-997a-bc0b93d5f25d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:16.108788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0399589c-9d58-4f31-997a-bc0b93d5f25d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:16.111591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0399589c-9d58-4f31-997a-bc0b93d5f25d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:16.112884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0399589c-9d58-4f31-997a-bc0b93d5f25d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:16.175296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d3420d63-8337-40cb-8837-bc1e85c25cea req-92a756a6-44f9-44d0-9bf3-0e88f47520c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "tag": "9ed98a2b-9925-480d-95be-fe4ae1e28f6e"}, {"name": "network-changed", "server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "tag": "e67957f6-071e-404a-a727-94c417e4d265"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:16.179175 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:16.179175 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:08:16.189583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d3420d63-8337-40cb-8837-bc1e85c25cea req-92a756a6-44f9-44d0-9bf3-0e88f47520c8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:16.190335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d3420d63-8337-40cb-8837-bc1e85c25cea req-92a756a6-44f9-44d0-9bf3-0e88f47520c8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:16.216298 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d3420d63-8337-40cb-8837-bc1e85c25cea req-92a756a6-44f9-44d0-9bf3-0e88f47520c8 service nova] Creating event network-changed:9ed98a2b-9925-480d-95be-fe4ae1e28f6e for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:16.216858 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d3420d63-8337-40cb-8837-bc1e85c25cea req-92a756a6-44f9-44d0-9bf3-0e88f47520c8 service nova] Creating event network-changed:e67957f6-071e-404a-a727-94c417e4d265 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:16.232825 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d3420d63-8337-40cb-8837-bc1e85c25cea req-92a756a6-44f9-44d0-9bf3-0e88f47520c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063208 Feb 19 21:08:16.233805 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2061/3995] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:16.615008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0399589c-9d58-4f31-997a-bc0b93d5f25d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:16.625904 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0399589c-9d58-4f31-997a-bc0b93d5f25d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1314 microversion: 2.1 time: 0.539887 Feb 19 21:08:16.627169 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1935/3996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:16 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:16.661906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:16.663676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:16.672497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:16.673466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:16.674533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:16.675245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:16.929491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a75bab5c-5561-470c-b728-c469cb34de97 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:16.930120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a75bab5c-5561-470c-b728-c469cb34de97 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:16.954124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a75bab5c-5561-470c-b728-c469cb34de97 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:16.954595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a75bab5c-5561-470c-b728-c469cb34de97 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:16.955434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a75bab5c-5561-470c-b728-c469cb34de97 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:16.955884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a75bab5c-5561-470c-b728-c469cb34de97 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:17.149214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a75bab5c-5561-470c-b728-c469cb34de97 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:17.155299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:17.160529 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a75bab5c-5561-470c-b728-c469cb34de97 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1211 microversion: 2.1 time: 0.242473 Feb 19 21:08:17.161118 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1936/3997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:16 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1211 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:17.174469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:17.177150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:17.178403 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c3af7505-83bf-4344-878a-85adbce585a1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.523982 Feb 19 21:08:17.178988 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2062/3998] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:16 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:17.266575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-43321a7f-e737-4770-ace9-72bb5ac5e1cf req-88adbb04-8497-4a71-8ad2-452b66304d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f620150-4262-4d39-9937-e1f00ea04a88", "name": "network-vif-plugged", "status": "completed", "tag": "d8970ddf-bb4f-4a41-8cb2-0ed56b52ff6e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:17.268548 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:17.268548 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:17.287199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-43321a7f-e737-4770-ace9-72bb5ac5e1cf req-88adbb04-8497-4a71-8ad2-452b66304d40 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:17.288562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-43321a7f-e737-4770-ace9-72bb5ac5e1cf req-88adbb04-8497-4a71-8ad2-452b66304d40 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:17.311877 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-43321a7f-e737-4770-ace9-72bb5ac5e1cf req-88adbb04-8497-4a71-8ad2-452b66304d40 service nova] Creating event network-vif-plugged:d8970ddf-bb4f-4a41-8cb2-0ed56b52ff6e for instance 6f620150-4262-4d39-9937-e1f00ea04a88 on nch1-master-1 Feb 19 21:08:17.330973 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-43321a7f-e737-4770-ace9-72bb5ac5e1cf req-88adbb04-8497-4a71-8ad2-452b66304d40 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064297 Feb 19 21:08:17.332205 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1937/3999] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:17.646021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-30c7f30b-dc51-43a4-a404-dc02ad24568a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:17.648512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-30c7f30b-dc51-43a4-a404-dc02ad24568a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:17.659799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30c7f30b-dc51-43a4-a404-dc02ad24568a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:17.660246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30c7f30b-dc51-43a4-a404-dc02ad24568a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:17.661074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30c7f30b-dc51-43a4-a404-dc02ad24568a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:17.661511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-30c7f30b-dc51-43a4-a404-dc02ad24568a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:17.924299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-30c7f30b-dc51-43a4-a404-dc02ad24568a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:17.934680 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-30c7f30b-dc51-43a4-a404-dc02ad24568a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1314 microversion: 2.1 time: 0.292905 Feb 19 21:08:17.936037 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2063/4000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:17 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:18.178101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a321e32-92a3-4c07-9bd6-f098615322cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:18.179496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1a321e32-92a3-4c07-9bd6-f098615322cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:18.192543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a321e32-92a3-4c07-9bd6-f098615322cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:18.192543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a321e32-92a3-4c07-9bd6-f098615322cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:18.194322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a321e32-92a3-4c07-9bd6-f098615322cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:18.194790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a321e32-92a3-4c07-9bd6-f098615322cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:18.199003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:18.202103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:18.212477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:18.213465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:18.215298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:18.216007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:18.356456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1a321e32-92a3-4c07-9bd6-f098615322cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:18.367164 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1a321e32-92a3-4c07-9bd6-f098615322cf tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1273 microversion: 2.1 time: 0.193117 Feb 19 21:08:18.368466 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1938/4001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:18 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:18.387721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a94afefa-9cae-4930-b55d-418d2f85ac11 req-e5a51409-ea15-452a-b49b-09bdc2895d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "tag": "95e9c0f7-4a48-40c7-a205-d0efe0ce4387"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:18.389592 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:18.389592 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:18.398254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a94afefa-9cae-4930-b55d-418d2f85ac11 req-e5a51409-ea15-452a-b49b-09bdc2895d3a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:18.398981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a94afefa-9cae-4930-b55d-418d2f85ac11 req-e5a51409-ea15-452a-b49b-09bdc2895d3a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:18.411782 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a94afefa-9cae-4930-b55d-418d2f85ac11 req-e5a51409-ea15-452a-b49b-09bdc2895d3a service nova] Creating event network-changed:95e9c0f7-4a48-40c7-a205-d0efe0ce4387 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:18.420683 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a94afefa-9cae-4930-b55d-418d2f85ac11 req-e5a51409-ea15-452a-b49b-09bdc2895d3a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048154 Feb 19 21:08:18.421837 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1939/4002] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:18.671039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:18.684820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:18.688120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:18.689692 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cc1a8781-adff-415d-a002-bd10a8b26001 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.495457 Feb 19 21:08:18.691969 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2064/4003] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:18 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:18.957108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0cc1de42-3b73-44fc-b063-d5b3901eafb0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:18.958246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0cc1de42-3b73-44fc-b063-d5b3901eafb0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:18.975669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cc1de42-3b73-44fc-b063-d5b3901eafb0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:18.976131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cc1de42-3b73-44fc-b063-d5b3901eafb0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:18.980719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cc1de42-3b73-44fc-b063-d5b3901eafb0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:18.981368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cc1de42-3b73-44fc-b063-d5b3901eafb0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:19.388590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f36d1bfa-7ab2-4af8-a01a-5584b1fd8abe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:19.389783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f36d1bfa-7ab2-4af8-a01a-5584b1fd8abe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:19.409540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f36d1bfa-7ab2-4af8-a01a-5584b1fd8abe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:19.411099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f36d1bfa-7ab2-4af8-a01a-5584b1fd8abe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:19.411938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f36d1bfa-7ab2-4af8-a01a-5584b1fd8abe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:19.412460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f36d1bfa-7ab2-4af8-a01a-5584b1fd8abe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:19.430865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0cc1de42-3b73-44fc-b063-d5b3901eafb0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:19.445060 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0cc1de42-3b73-44fc-b063-d5b3901eafb0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1501 microversion: 2.1 time: 0.491250 Feb 19 21:08:19.447729 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1940/4004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:18 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1501 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:19.464932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-14da2625-ab08-4281-b841-1f40c8c23090 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:19.465775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-14da2625-ab08-4281-b841-1f40c8c23090 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:19.483769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14da2625-ab08-4281-b841-1f40c8c23090 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:19.496619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14da2625-ab08-4281-b841-1f40c8c23090 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:19.498996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14da2625-ab08-4281-b841-1f40c8c23090 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:19.501020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-14da2625-ab08-4281-b841-1f40c8c23090 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:19.568780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-14da2625-ab08-4281-b841-1f40c8c23090 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lazy-loading 'flavor' on Instance uuid 6f620150-4262-4d39-9937-e1f00ea04a88 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:08:20.013963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f36d1bfa-7ab2-4af8-a01a-5584b1fd8abe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:20.031928 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f36d1bfa-7ab2-4af8-a01a-5584b1fd8abe tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1315 microversion: 2.1 time: 0.649115 Feb 19 21:08:20.044045 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2065/4005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:19 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:20.050467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9df7fbab-b44d-4b65-afa5-44fb4636d61a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:20.055358 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-14da2625-ab08-4281-b841-1f40c8c23090 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88/action" status: 202 len: 0 microversion: 2.1 time: 0.595824 Feb 19 21:08:20.056290 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1941/4006] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:08:19 2022] POST /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:08:20.067179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:20.069416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9df7fbab-b44d-4b65-afa5-44fb4636d61a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:20.070068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9df7fbab-b44d-4b65-afa5-44fb4636d61a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:20.073629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:20.086962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:20.089175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:20.091277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:20.091945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:20.141552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9df7fbab-b44d-4b65-afa5-44fb4636d61a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Going to try to stop instance {{(pid=136094) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:08:20.221178 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9df7fbab-b44d-4b65-afa5-44fb4636d61a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/action" status: 202 len: 0 microversion: 2.1 time: 0.174827 Feb 19 21:08:20.224560 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2066/4007] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:08:20 2022] POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:08:20.232799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-cba46183-8faf-4a52-b2b0-31a6dababfc8 req-75c47f93-96eb-4635-a979-08341376fcb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee0c1d6-4d26-4bb6-bf2b-83054efe676c", "tag": "761a57e3-c4a5-4caf-8b79-ab7836b14ef0"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:20.235046 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:20.235046 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:08:20.268488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cba46183-8faf-4a52-b2b0-31a6dababfc8 req-75c47f93-96eb-4635-a979-08341376fcb7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:20.269405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cba46183-8faf-4a52-b2b0-31a6dababfc8 req-75c47f93-96eb-4635-a979-08341376fcb7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:20.286937 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-cba46183-8faf-4a52-b2b0-31a6dababfc8 req-75c47f93-96eb-4635-a979-08341376fcb7 service nova] Creating event network-changed:761a57e3-c4a5-4caf-8b79-ab7836b14ef0 for instance 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c on nch1-master-1 Feb 19 21:08:20.294855 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-cba46183-8faf-4a52-b2b0-31a6dababfc8 req-75c47f93-96eb-4635-a979-08341376fcb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067969 Feb 19 21:08:20.296029 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2067/4008] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:20.302874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-19c624d2-be79-4ec8-b8f7-990e129416f3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:20.303681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-19c624d2-be79-4ec8-b8f7-990e129416f3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:20.311660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19c624d2-be79-4ec8-b8f7-990e129416f3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:20.312635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19c624d2-be79-4ec8-b8f7-990e129416f3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:20.315239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19c624d2-be79-4ec8-b8f7-990e129416f3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:20.316087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19c624d2-be79-4ec8-b8f7-990e129416f3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:20.993323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-19c624d2-be79-4ec8-b8f7-990e129416f3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:21.005270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:21.015920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:21.017469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:21.018717 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-19c624d2-be79-4ec8-b8f7-990e129416f3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.704841 Feb 19 21:08:21.019134 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2068/4009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:20 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:21.024077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-099bd2a7-49d6-4518-b2ff-d5bd8fee724e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:21.025348 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa3675cf-f3c6-4cbb-a42f-67ebbff6de1c tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.967546 Feb 19 21:08:21.026212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-099bd2a7-49d6-4518-b2ff-d5bd8fee724e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:21.027551 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1942/4010] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:20 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:21.046798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-099bd2a7-49d6-4518-b2ff-d5bd8fee724e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:21.047378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-099bd2a7-49d6-4518-b2ff-d5bd8fee724e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:21.048256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-099bd2a7-49d6-4518-b2ff-d5bd8fee724e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:21.048950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-099bd2a7-49d6-4518-b2ff-d5bd8fee724e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:21.050838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a4256c2-385e-49d6-8539-c7f795cab4ac tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:21.051687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3a4256c2-385e-49d6-8539-c7f795cab4ac tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:21.067115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a4256c2-385e-49d6-8539-c7f795cab4ac tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:21.067836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a4256c2-385e-49d6-8539-c7f795cab4ac tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:21.070877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a4256c2-385e-49d6-8539-c7f795cab4ac tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:21.071751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a4256c2-385e-49d6-8539-c7f795cab4ac tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:21.435748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-099bd2a7-49d6-4518-b2ff-d5bd8fee724e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:21.450523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3a4256c2-385e-49d6-8539-c7f795cab4ac tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:21.457387 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-099bd2a7-49d6-4518-b2ff-d5bd8fee724e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.436881 Feb 19 21:08:21.458017 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2069/4011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:21 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:21.462547 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3a4256c2-385e-49d6-8539-c7f795cab4ac tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1315 microversion: 2.1 time: 0.416457 Feb 19 21:08:21.463376 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1943/4012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:21 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:22.034780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a2ab6ba-b05e-4e86-b600-7e95d8624223 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:22.035426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a2ab6ba-b05e-4e86-b600-7e95d8624223 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:22.044109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a2ab6ba-b05e-4e86-b600-7e95d8624223 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:22.044597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a2ab6ba-b05e-4e86-b600-7e95d8624223 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:22.045392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a2ab6ba-b05e-4e86-b600-7e95d8624223 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:22.045826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a2ab6ba-b05e-4e86-b600-7e95d8624223 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:22.049009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:22.050393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:22.059005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:22.059744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:22.061187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:22.062245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:22.450256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1a2ab6ba-b05e-4e86-b600-7e95d8624223 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:22.459212 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1a2ab6ba-b05e-4e86-b600-7e95d8624223 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.428033 Feb 19 21:08:22.459820 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2070/4013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:22 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:22.475534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f6b736b7-a892-4d5a-acf9-747c53be4f3e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:22.476195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f6b736b7-a892-4d5a-acf9-747c53be4f3e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:22.482421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6b736b7-a892-4d5a-acf9-747c53be4f3e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:22.482875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6b736b7-a892-4d5a-acf9-747c53be4f3e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:22.483699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6b736b7-a892-4d5a-acf9-747c53be4f3e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:22.484141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6b736b7-a892-4d5a-acf9-747c53be4f3e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:22.510930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:22.520081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:22.521838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:22.523062 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cda7fc70-9092-4bed-bd2c-1c859d6b3936 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.480018 Feb 19 21:08:22.523646 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1944/4014] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:22 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:22.528774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-26efc7d4-459b-47e6-bc28-492a139f2c3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:22.529392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-26efc7d4-459b-47e6-bc28-492a139f2c3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:22.535807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26efc7d4-459b-47e6-bc28-492a139f2c3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:22.536260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26efc7d4-459b-47e6-bc28-492a139f2c3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:22.537673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26efc7d4-459b-47e6-bc28-492a139f2c3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:22.538173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26efc7d4-459b-47e6-bc28-492a139f2c3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:22.802420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f6b736b7-a892-4d5a-acf9-747c53be4f3e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:22.811200 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f6b736b7-a892-4d5a-acf9-747c53be4f3e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.339935 Feb 19 21:08:22.812440 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2071/4015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:22 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:22.836910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-26efc7d4-459b-47e6-bc28-492a139f2c3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:22.848732 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-26efc7d4-459b-47e6-bc28-492a139f2c3b tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1315 microversion: 2.1 time: 0.320702 Feb 19 21:08:22.850849 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1945/4016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:22 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:23.477071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d5377fa7-2e46-42ee-81f8-3e7a767369e2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:23.477833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d5377fa7-2e46-42ee-81f8-3e7a767369e2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:23.485056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5377fa7-2e46-42ee-81f8-3e7a767369e2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:23.485509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5377fa7-2e46-42ee-81f8-3e7a767369e2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:23.486292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5377fa7-2e46-42ee-81f8-3e7a767369e2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:23.486725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d5377fa7-2e46-42ee-81f8-3e7a767369e2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:23.543008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:23.543833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:23.550779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:23.551235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:23.552225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:23.553278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:23.668442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d5377fa7-2e46-42ee-81f8-3e7a767369e2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:23.676143 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d5377fa7-2e46-42ee-81f8-3e7a767369e2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.203734 Feb 19 21:08:23.676762 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2072/4017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:23 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:23.790792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:23.800634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:23.802210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:23.803965 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f0cd4c5b-ccef-42de-928d-dc3b231f48ed tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.265206 Feb 19 21:08:23.804567 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1946/4018] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:23 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:23.829748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a0bdd32f-9eca-44ca-b9c0-3f03ec2331c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:23.830357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a0bdd32f-9eca-44ca-b9c0-3f03ec2331c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:23.836571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0bdd32f-9eca-44ca-b9c0-3f03ec2331c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:23.837028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0bdd32f-9eca-44ca-b9c0-3f03ec2331c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:23.837828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0bdd32f-9eca-44ca-b9c0-3f03ec2331c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:23.838270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0bdd32f-9eca-44ca-b9c0-3f03ec2331c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:23.866759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b0ef0791-77e3-487f-a221-0284235fe8c8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:23.867648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b0ef0791-77e3-487f-a221-0284235fe8c8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:23.874316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0ef0791-77e3-487f-a221-0284235fe8c8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:23.874684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0ef0791-77e3-487f-a221-0284235fe8c8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:23.875487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0ef0791-77e3-487f-a221-0284235fe8c8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:23.876104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b0ef0791-77e3-487f-a221-0284235fe8c8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:24.048839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a0bdd32f-9eca-44ca-b9c0-3f03ec2331c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:24.057931 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a0bdd32f-9eca-44ca-b9c0-3f03ec2331c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.231936 Feb 19 21:08:24.058484 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2073/4019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:23 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:24.079381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b0ef0791-77e3-487f-a221-0284235fe8c8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:24.093691 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b0ef0791-77e3-487f-a221-0284235fe8c8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1315 microversion: 2.1 time: 0.231066 Feb 19 21:08:24.094295 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1947/4020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:23 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:24.693295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f95d9b0-4103-4d13-8d88-c2aea3bb0715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:24.693915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9f95d9b0-4103-4d13-8d88-c2aea3bb0715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:24.701489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f95d9b0-4103-4d13-8d88-c2aea3bb0715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:24.702049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f95d9b0-4103-4d13-8d88-c2aea3bb0715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:24.703005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f95d9b0-4103-4d13-8d88-c2aea3bb0715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:24.703478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f95d9b0-4103-4d13-8d88-c2aea3bb0715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:24.823289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:24.824029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:24.831206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:24.831774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:24.832690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:24.833171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:24.843740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9f95d9b0-4103-4d13-8d88-c2aea3bb0715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:24.853127 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f95d9b0-4103-4d13-8d88-c2aea3bb0715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.163785 Feb 19 21:08:24.853729 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2074/4021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:24 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:25.044098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:25.055350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:25.057024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:25.058276 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cd6da51a-d18e-4db0-b0d5-043b5d0be35e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.238797 Feb 19 21:08:25.058925 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1948/4022] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:24 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:08:25.074965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7fd85c49-33fc-4ee6-b8d6-9dfeeb3148e3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:25.075821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7fd85c49-33fc-4ee6-b8d6-9dfeeb3148e3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:25.082349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fd85c49-33fc-4ee6-b8d6-9dfeeb3148e3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:25.082890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fd85c49-33fc-4ee6-b8d6-9dfeeb3148e3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:25.083756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fd85c49-33fc-4ee6-b8d6-9dfeeb3148e3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:25.084812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fd85c49-33fc-4ee6-b8d6-9dfeeb3148e3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:25.113146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-35ed5ca7-6460-41b3-b5c6-273296238cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:25.114090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-35ed5ca7-6460-41b3-b5c6-273296238cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:25.120303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35ed5ca7-6460-41b3-b5c6-273296238cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:25.120797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35ed5ca7-6460-41b3-b5c6-273296238cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:25.121669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35ed5ca7-6460-41b3-b5c6-273296238cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:25.122565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-35ed5ca7-6460-41b3-b5c6-273296238cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:25.295222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7fd85c49-33fc-4ee6-b8d6-9dfeeb3148e3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:25.303485 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7fd85c49-33fc-4ee6-b8d6-9dfeeb3148e3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.232286 Feb 19 21:08:25.304092 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2075/4023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:25 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:25.316697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-35ed5ca7-6460-41b3-b5c6-273296238cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:25.324922 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-35ed5ca7-6460-41b3-b5c6-273296238cc8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1315 microversion: 2.1 time: 0.215466 Feb 19 21:08:25.325517 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1949/4024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:25 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:25.878645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-11084682-2f7e-4a45-9915-25c744ebf167 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:25.879636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-11084682-2f7e-4a45-9915-25c744ebf167 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:25.888677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11084682-2f7e-4a45-9915-25c744ebf167 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:25.889147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11084682-2f7e-4a45-9915-25c744ebf167 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:25.889971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11084682-2f7e-4a45-9915-25c744ebf167 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:25.890415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11084682-2f7e-4a45-9915-25c744ebf167 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:26.058524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11084682-2f7e-4a45-9915-25c744ebf167 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:26.066852 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-11084682-2f7e-4a45-9915-25c744ebf167 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.193544 Feb 19 21:08:26.067446 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2076/4025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:25 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:26.077538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:26.078153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:26.085214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:26.085635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:26.086429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:26.086865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:26.300640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:26.311155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:26.312713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:26.314082 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b051ba89-23fa-4f5e-a757-5938ea9bbd89 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.240339 Feb 19 21:08:26.314745 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1950/4026] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:26 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:26.325732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-231a6f4f-cf34-4c2b-b034-40957b96d67f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:26.325732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-231a6f4f-cf34-4c2b-b034-40957b96d67f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:26.328098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-231a6f4f-cf34-4c2b-b034-40957b96d67f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:26.328596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-231a6f4f-cf34-4c2b-b034-40957b96d67f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:26.329421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-231a6f4f-cf34-4c2b-b034-40957b96d67f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:26.329863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-231a6f4f-cf34-4c2b-b034-40957b96d67f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:26.342737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58321635-0648-4ff7-afa9-aee80fd1e255 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:26.344169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-58321635-0648-4ff7-afa9-aee80fd1e255 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:26.350848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58321635-0648-4ff7-afa9-aee80fd1e255 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:26.351303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58321635-0648-4ff7-afa9-aee80fd1e255 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:26.352092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58321635-0648-4ff7-afa9-aee80fd1e255 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:26.352600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58321635-0648-4ff7-afa9-aee80fd1e255 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:26.534763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-231a6f4f-cf34-4c2b-b034-40957b96d67f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:26.543586 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-231a6f4f-cf34-4c2b-b034-40957b96d67f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.226063 Feb 19 21:08:26.544179 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2077/4027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:26 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:26.560820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-58321635-0648-4ff7-afa9-aee80fd1e255 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:26.567013 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-58321635-0648-4ff7-afa9-aee80fd1e255 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1315 microversion: 2.1 time: 0.228281 Feb 19 21:08:26.567603 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1951/4028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:26 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:27.083169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9810546f-4d31-4468-b8a7-414c7ebfabac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:27.085314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9810546f-4d31-4468-b8a7-414c7ebfabac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:27.095715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9810546f-4d31-4468-b8a7-414c7ebfabac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:27.096303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9810546f-4d31-4468-b8a7-414c7ebfabac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:27.097228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9810546f-4d31-4468-b8a7-414c7ebfabac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:27.097744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9810546f-4d31-4468-b8a7-414c7ebfabac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:27.175973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-29fc2046-7b35-4cb0-ac8e-d448edbb331c req-b7ee1e79-6301-4f81-a50a-941562608e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee0c1d6-4d26-4bb6-bf2b-83054efe676c", "name": "network-vif-plugged", "status": "completed", "tag": "761a57e3-c4a5-4caf-8b79-ab7836b14ef0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:27.178468 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:27.178468 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:27.187050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-29fc2046-7b35-4cb0-ac8e-d448edbb331c req-b7ee1e79-6301-4f81-a50a-941562608e41 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:27.187865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-29fc2046-7b35-4cb0-ac8e-d448edbb331c req-b7ee1e79-6301-4f81-a50a-941562608e41 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:27.202920 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-29fc2046-7b35-4cb0-ac8e-d448edbb331c req-b7ee1e79-6301-4f81-a50a-941562608e41 service nova] Creating event network-vif-plugged:761a57e3-c4a5-4caf-8b79-ab7836b14ef0 for instance 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c on nch1-master-1 Feb 19 21:08:27.208481 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-29fc2046-7b35-4cb0-ac8e-d448edbb331c req-b7ee1e79-6301-4f81-a50a-941562608e41 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036115 Feb 19 21:08:27.210209 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1952/4029] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:27.266755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9810546f-4d31-4468-b8a7-414c7ebfabac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:27.275246 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9810546f-4d31-4468-b8a7-414c7ebfabac tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.195867 Feb 19 21:08:27.275845 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2078/4030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:27 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:27.333676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:27.335004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:27.341411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:27.341877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:27.342691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:27.343141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:27.559877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:27.561502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84e3c8eb-e428-44e5-865f-a366b483c117 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:27.562117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-84e3c8eb-e428-44e5-865f-a366b483c117 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:27.569489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84e3c8eb-e428-44e5-865f-a366b483c117 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:27.569942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84e3c8eb-e428-44e5-865f-a366b483c117 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:27.570727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:27.570911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84e3c8eb-e428-44e5-865f-a366b483c117 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:27.571535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84e3c8eb-e428-44e5-865f-a366b483c117 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:27.572564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:27.573834 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d3d56485-5e1c-4dcf-b6d8-8d613cf6b106 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.244287 Feb 19 21:08:27.574493 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1953/4031] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:27 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:27.582805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fd8934e1-961a-4dbf-b25f-c214f44a43bd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:27.583421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fd8934e1-961a-4dbf-b25f-c214f44a43bd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:27.590676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd8934e1-961a-4dbf-b25f-c214f44a43bd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:27.591064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd8934e1-961a-4dbf-b25f-c214f44a43bd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:27.591904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd8934e1-961a-4dbf-b25f-c214f44a43bd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:27.592369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd8934e1-961a-4dbf-b25f-c214f44a43bd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:27.801099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fd8934e1-961a-4dbf-b25f-c214f44a43bd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:27.812293 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fd8934e1-961a-4dbf-b25f-c214f44a43bd tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1315 microversion: 2.1 time: 0.233012 Feb 19 21:08:27.818984 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1954/4032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:27 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:27.819533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84e3c8eb-e428-44e5-865f-a366b483c117 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:27.828788 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84e3c8eb-e428-44e5-865f-a366b483c117 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.271041 Feb 19 21:08:27.829775 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2079/4033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:27 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:28.293324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-af015179-802e-479f-9aff-825df9de8080 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:28.293886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-af015179-802e-479f-9aff-825df9de8080 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:28.303538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af015179-802e-479f-9aff-825df9de8080 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:28.303998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af015179-802e-479f-9aff-825df9de8080 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:28.304836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af015179-802e-479f-9aff-825df9de8080 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:28.305282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af015179-802e-479f-9aff-825df9de8080 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:28.457071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-af015179-802e-479f-9aff-825df9de8080 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:28.464683 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-af015179-802e-479f-9aff-825df9de8080 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.175125 Feb 19 21:08:28.465276 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1955/4034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:28 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:28.595139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:28.595682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:28.603331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:28.603791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:28.604626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:28.605075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:28.804411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:28.814095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:28.816101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:28.817281 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f30828f-5db3-490f-ac4f-45e5441a71cf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.225975 Feb 19 21:08:28.817917 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2080/4035] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:28 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:28.829498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-23cc5bcf-c29e-415d-bf15-22c238dd3f8a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:28.830114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-23cc5bcf-c29e-415d-bf15-22c238dd3f8a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:28.836767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23cc5bcf-c29e-415d-bf15-22c238dd3f8a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:28.837226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23cc5bcf-c29e-415d-bf15-22c238dd3f8a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:28.838030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23cc5bcf-c29e-415d-bf15-22c238dd3f8a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:28.838484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23cc5bcf-c29e-415d-bf15-22c238dd3f8a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:28.847261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-be3adae5-37df-478d-9a2c-2b97d1e03c49 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:28.847806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-be3adae5-37df-478d-9a2c-2b97d1e03c49 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:28.854672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be3adae5-37df-478d-9a2c-2b97d1e03c49 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:28.855272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be3adae5-37df-478d-9a2c-2b97d1e03c49 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:28.856273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be3adae5-37df-478d-9a2c-2b97d1e03c49 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:28.856934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be3adae5-37df-478d-9a2c-2b97d1e03c49 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:29.052190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-23cc5bcf-c29e-415d-bf15-22c238dd3f8a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:29.060241 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-23cc5bcf-c29e-415d-bf15-22c238dd3f8a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1502 microversion: 2.1 time: 0.234305 Feb 19 21:08:29.061467 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1956/4036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:28 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:29.072140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-be3adae5-37df-478d-9a2c-2b97d1e03c49 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:29.081920 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-be3adae5-37df-478d-9a2c-2b97d1e03c49 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.238735 Feb 19 21:08:29.082442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-023b4481-2e34-4ed0-96c4-850cf204aac8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:29.082774 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2081/4037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:28 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:29.083666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-023b4481-2e34-4ed0-96c4-850cf204aac8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:29.090594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-023b4481-2e34-4ed0-96c4-850cf204aac8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:29.092652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-023b4481-2e34-4ed0-96c4-850cf204aac8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:29.094100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-023b4481-2e34-4ed0-96c4-850cf204aac8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:29.094574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-023b4481-2e34-4ed0-96c4-850cf204aac8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:29.171543 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-023b4481-2e34-4ed0-96c4-850cf204aac8 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c/action" status: 202 len: 0 microversion: 2.1 time: 0.092261 Feb 19 21:08:29.172233 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1957/4038] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:08:29 2022] POST /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:08:29.180374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b46ccfb-b532-4c97-870a-4413b21f0545 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:29.181302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7b46ccfb-b532-4c97-870a-4413b21f0545 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:29.189047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b46ccfb-b532-4c97-870a-4413b21f0545 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:29.189674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b46ccfb-b532-4c97-870a-4413b21f0545 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:29.190724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b46ccfb-b532-4c97-870a-4413b21f0545 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:29.191722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b46ccfb-b532-4c97-870a-4413b21f0545 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:29.416626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7b46ccfb-b532-4c97-870a-4413b21f0545 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:29.430978 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b46ccfb-b532-4c97-870a-4413b21f0545 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1507 microversion: 2.1 time: 0.254358 Feb 19 21:08:29.437170 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2082/4039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:29 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:29.482453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f12946b9-d311-4139-aeba-408af3802f4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:29.483997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f12946b9-d311-4139-aeba-408af3802f4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:29.493057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f12946b9-d311-4139-aeba-408af3802f4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:29.493512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f12946b9-d311-4139-aeba-408af3802f4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:29.494468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f12946b9-d311-4139-aeba-408af3802f4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:29.495193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f12946b9-d311-4139-aeba-408af3802f4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:29.644924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f12946b9-d311-4139-aeba-408af3802f4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:29.652816 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f12946b9-d311-4139-aeba-408af3802f4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.174874 Feb 19 21:08:29.653420 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1958/4040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:29 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:29.837101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:29.837719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:29.844879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:29.845335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:29.847151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:29.847151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.054411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:30.063932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:30.066604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:30.067979 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6b23414b-855c-4db4-b262-7a719e4af6cd tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.235560 Feb 19 21:08:30.069629 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2083/4041] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:29 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:30.099272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b53025da-414d-4173-82ae-6245fffe4bc5 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:30.100184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b53025da-414d-4173-82ae-6245fffe4bc5 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:30.106418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b53025da-414d-4173-82ae-6245fffe4bc5 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.106855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b53025da-414d-4173-82ae-6245fffe4bc5 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.107821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b53025da-414d-4173-82ae-6245fffe4bc5 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.108519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b53025da-414d-4173-82ae-6245fffe4bc5 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.284768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b53025da-414d-4173-82ae-6245fffe4bc5 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:30.294193 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b53025da-414d-4173-82ae-6245fffe4bc5 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.198618 Feb 19 21:08:30.294912 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1959/4042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:30 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:30.451132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3692f09a-dbd0-4fab-a94d-2d3c22133fdc tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:30.451957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3692f09a-dbd0-4fab-a94d-2d3c22133fdc tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:30.458170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3692f09a-dbd0-4fab-a94d-2d3c22133fdc tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.458634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3692f09a-dbd0-4fab-a94d-2d3c22133fdc tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.459435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3692f09a-dbd0-4fab-a94d-2d3c22133fdc tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.460077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3692f09a-dbd0-4fab-a94d-2d3c22133fdc tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.613776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3692f09a-dbd0-4fab-a94d-2d3c22133fdc tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:30.622547 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3692f09a-dbd0-4fab-a94d-2d3c22133fdc tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1487 microversion: 2.1 time: 0.176478 Feb 19 21:08:30.624408 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2084/4043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:30 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1487 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:30.638990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-86b64f16-321a-4aa3-a0ba-91e66a23f3a7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:30.639531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-86b64f16-321a-4aa3-a0ba-91e66a23f3a7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:30.646034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86b64f16-321a-4aa3-a0ba-91e66a23f3a7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.646551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86b64f16-321a-4aa3-a0ba-91e66a23f3a7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.647351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86b64f16-321a-4aa3-a0ba-91e66a23f3a7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.647797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86b64f16-321a-4aa3-a0ba-91e66a23f3a7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.669929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-79e165fe-80f3-4175-95b1-123cbd8b2d93 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:30.670545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-79e165fe-80f3-4175-95b1-123cbd8b2d93 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:30.671795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-86b64f16-321a-4aa3-a0ba-91e66a23f3a7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lazy-loading 'flavor' on Instance uuid 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:08:30.677113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79e165fe-80f3-4175-95b1-123cbd8b2d93 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.677625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79e165fe-80f3-4175-95b1-123cbd8b2d93 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.678931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79e165fe-80f3-4175-95b1-123cbd8b2d93 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.679369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-79e165fe-80f3-4175-95b1-123cbd8b2d93 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.828829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-79e165fe-80f3-4175-95b1-123cbd8b2d93 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:30.837383 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-79e165fe-80f3-4175-95b1-123cbd8b2d93 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.170953 Feb 19 21:08:30.842140 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2085/4044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:30 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:30.936283 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-86b64f16-321a-4aa3-a0ba-91e66a23f3a7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c/action" status: 202 len: 0 microversion: 2.1 time: 0.300526 Feb 19 21:08:30.936729 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1960/4045] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:08:30 2022] POST /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:08:30.945813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ee21a13d-99a7-4c57-a2e5-8fc8ac3f62bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:30.946464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ee21a13d-99a7-4c57-a2e5-8fc8ac3f62bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:30.954050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee21a13d-99a7-4c57-a2e5-8fc8ac3f62bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.954453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee21a13d-99a7-4c57-a2e5-8fc8ac3f62bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:30.955446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee21a13d-99a7-4c57-a2e5-8fc8ac3f62bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:30.955858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee21a13d-99a7-4c57-a2e5-8fc8ac3f62bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:31.097267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:31.098505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:31.100102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ee21a13d-99a7-4c57-a2e5-8fc8ac3f62bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:31.105668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:31.106124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:31.107298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:31.108037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:31.114713 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ee21a13d-99a7-4c57-a2e5-8fc8ac3f62bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1493 microversion: 2.1 time: 0.173610 Feb 19 21:08:31.117022 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2086/4046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:30 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1493 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:31.313820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d4b88ecb-1514-4fd5-ad61-9825c02c4c8c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:31.315142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d4b88ecb-1514-4fd5-ad61-9825c02c4c8c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:31.322144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4b88ecb-1514-4fd5-ad61-9825c02c4c8c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:31.322921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4b88ecb-1514-4fd5-ad61-9825c02c4c8c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:31.323724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4b88ecb-1514-4fd5-ad61-9825c02c4c8c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:31.324164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4b88ecb-1514-4fd5-ad61-9825c02c4c8c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:31.341808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:31.351866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:31.353434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:31.354632 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6a2f35ae-4a09-43cc-8c03-cfb7456b2b88 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.262865 Feb 19 21:08:31.355208 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1961/4047] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:31 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:08:31.485512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d4b88ecb-1514-4fd5-ad61-9825c02c4c8c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:31.494655 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d4b88ecb-1514-4fd5-ad61-9825c02c4c8c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.186341 Feb 19 21:08:31.495468 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2087/4048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:31 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:31.854794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e7487da0-9d76-4af7-9579-7f57788ce1aa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:31.856001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e7487da0-9d76-4af7-9579-7f57788ce1aa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:31.863582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7487da0-9d76-4af7-9579-7f57788ce1aa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:31.864293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7487da0-9d76-4af7-9579-7f57788ce1aa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:31.868979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7487da0-9d76-4af7-9579-7f57788ce1aa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:31.869792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7487da0-9d76-4af7-9579-7f57788ce1aa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:32.087506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e7487da0-9d76-4af7-9579-7f57788ce1aa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:32.098721 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e7487da0-9d76-4af7-9579-7f57788ce1aa tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.247429 Feb 19 21:08:32.100254 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1962/4049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:31 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:32.138543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-94c5c9e7-1184-414a-b665-a6453a47e9b4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:32.139166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-94c5c9e7-1184-414a-b665-a6453a47e9b4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:32.153303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94c5c9e7-1184-414a-b665-a6453a47e9b4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:32.154689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94c5c9e7-1184-414a-b665-a6453a47e9b4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:32.156134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94c5c9e7-1184-414a-b665-a6453a47e9b4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:32.157166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94c5c9e7-1184-414a-b665-a6453a47e9b4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:32.361222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-94c5c9e7-1184-414a-b665-a6453a47e9b4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:32.374596 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-94c5c9e7-1184-414a-b665-a6453a47e9b4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1514 microversion: 2.1 time: 0.242681 Feb 19 21:08:32.375152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:32.375343 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2088/4050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:32 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:32.376375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:32.386889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:32.389221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:32.390084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:32.390540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:32.513186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6c24d332-d067-4490-a124-225fe8658fa7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:32.514275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6c24d332-d067-4490-a124-225fe8658fa7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:32.528793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c24d332-d067-4490-a124-225fe8658fa7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:32.530980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c24d332-d067-4490-a124-225fe8658fa7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:32.533136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c24d332-d067-4490-a124-225fe8658fa7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:32.534539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6c24d332-d067-4490-a124-225fe8658fa7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:32.739370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:32.752727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:32.754440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:32.756211 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3d0d24c5-7d99-438d-8d56-bb911d55b540 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.385274 Feb 19 21:08:32.756850 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1963/4051] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:32 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:08:32.837440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6c24d332-d067-4490-a124-225fe8658fa7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:32.850872 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6c24d332-d067-4490-a124-225fe8658fa7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.341617 Feb 19 21:08:32.851930 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2089/4052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:32 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:33.117635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-667a1c98-72d9-4130-9d0b-213e3bba70e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:33.118383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-667a1c98-72d9-4130-9d0b-213e3bba70e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:33.124477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667a1c98-72d9-4130-9d0b-213e3bba70e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:33.124945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667a1c98-72d9-4130-9d0b-213e3bba70e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:33.125770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667a1c98-72d9-4130-9d0b-213e3bba70e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:33.126204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667a1c98-72d9-4130-9d0b-213e3bba70e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:33.286180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-667a1c98-72d9-4130-9d0b-213e3bba70e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:33.295274 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-667a1c98-72d9-4130-9d0b-213e3bba70e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.182616 Feb 19 21:08:33.295879 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1964/4053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:33 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:33.393113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-08139a8c-4220-4353-82a3-9efad8262180 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:33.394009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-08139a8c-4220-4353-82a3-9efad8262180 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:33.402427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08139a8c-4220-4353-82a3-9efad8262180 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:33.402891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08139a8c-4220-4353-82a3-9efad8262180 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:33.403674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08139a8c-4220-4353-82a3-9efad8262180 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:33.404104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08139a8c-4220-4353-82a3-9efad8262180 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:33.563719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-08139a8c-4220-4353-82a3-9efad8262180 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:33.573228 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-08139a8c-4220-4353-82a3-9efad8262180 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1514 microversion: 2.1 time: 0.183992 Feb 19 21:08:33.574024 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2090/4054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:33 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:33.775320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:33.775943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:33.782515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:33.782978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:33.783999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:33.784647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:33.868990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4ef96b11-1241-408b-bfae-e7f5d6304dad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:33.869757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4ef96b11-1241-408b-bfae-e7f5d6304dad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:33.877282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ef96b11-1241-408b-bfae-e7f5d6304dad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:33.877976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ef96b11-1241-408b-bfae-e7f5d6304dad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:33.879005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ef96b11-1241-408b-bfae-e7f5d6304dad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:33.879451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4ef96b11-1241-408b-bfae-e7f5d6304dad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:34.545947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:34.555871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:34.557435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:34.558656 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b4cbe5de-7668-44f1-82ad-bd6a1df148c7 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.787376 Feb 19 21:08:34.559231 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1965/4055] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:33 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:34.572742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cee641af-f88c-4701-8fa3-863f971daf06 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:34.573374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cee641af-f88c-4701-8fa3-863f971daf06 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:34.591947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cee641af-f88c-4701-8fa3-863f971daf06 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:34.592448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cee641af-f88c-4701-8fa3-863f971daf06 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:34.593267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cee641af-f88c-4701-8fa3-863f971daf06 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:34.593718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cee641af-f88c-4701-8fa3-863f971daf06 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:34.658549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4ef96b11-1241-408b-bfae-e7f5d6304dad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:34.677168 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4ef96b11-1241-408b-bfae-e7f5d6304dad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1722 microversion: 2.1 time: 0.812371 Feb 19 21:08:34.678369 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2091/4056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:33 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1722 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:34.683412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-301c6751-4bb5-459b-a912-dd588fa006eb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:34.684368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-301c6751-4bb5-459b-a912-dd588fa006eb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:34.695749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-301c6751-4bb5-459b-a912-dd588fa006eb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:34.696932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-301c6751-4bb5-459b-a912-dd588fa006eb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:34.700138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-301c6751-4bb5-459b-a912-dd588fa006eb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:34.700919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-301c6751-4bb5-459b-a912-dd588fa006eb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:34.838332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cee641af-f88c-4701-8fa3-863f971daf06 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:34.846226 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cee641af-f88c-4701-8fa3-863f971daf06 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.285932 Feb 19 21:08:34.846803 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1966/4057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:34 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:34.932727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-301c6751-4bb5-459b-a912-dd588fa006eb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:34.947746 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-301c6751-4bb5-459b-a912-dd588fa006eb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.268109 Feb 19 21:08:34.948768 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2092/4058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:34 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:35.415100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-174f83c4-5acb-40ec-925f-c45a6a3c8c7f req-f84c05e1-7cf4-4550-8169-e111467a8e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-plugged", "status": "completed", "tag": "9ed98a2b-9925-480d-95be-fe4ae1e28f6e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:35.417118 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:35.417118 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:35.437014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-174f83c4-5acb-40ec-925f-c45a6a3c8c7f req-f84c05e1-7cf4-4550-8169-e111467a8e96 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:35.438059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-174f83c4-5acb-40ec-925f-c45a6a3c8c7f req-f84c05e1-7cf4-4550-8169-e111467a8e96 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:35.461100 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-174f83c4-5acb-40ec-925f-c45a6a3c8c7f req-f84c05e1-7cf4-4550-8169-e111467a8e96 service nova] Creating event network-vif-plugged:9ed98a2b-9925-480d-95be-fe4ae1e28f6e for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:35.469779 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-174f83c4-5acb-40ec-925f-c45a6a3c8c7f req-f84c05e1-7cf4-4550-8169-e111467a8e96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058457 Feb 19 21:08:35.471250 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1967/4059] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:35.579035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:35.580014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:35.594407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:35.595252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:35.597684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:35.599438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:35.698777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4a00060e-3182-4f20-951e-c3a271f595eb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:35.700133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4a00060e-3182-4f20-951e-c3a271f595eb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:35.710015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a00060e-3182-4f20-951e-c3a271f595eb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:35.713698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a00060e-3182-4f20-951e-c3a271f595eb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:35.716110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a00060e-3182-4f20-951e-c3a271f595eb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:35.718859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a00060e-3182-4f20-951e-c3a271f595eb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:35.955513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:35.966869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:35.969404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:35.971025 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83b3d798-c733-4c40-ac02-c7de01610939 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.396060 Feb 19 21:08:36.006283 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2093/4060] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:35 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:36.015459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1c2c37b3-f1fb-47a4-be9f-91d12524c069 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:36.019614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1c2c37b3-f1fb-47a4-be9f-91d12524c069 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:36.031766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c2c37b3-f1fb-47a4-be9f-91d12524c069 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:36.034976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c2c37b3-f1fb-47a4-be9f-91d12524c069 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:36.038242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c2c37b3-f1fb-47a4-be9f-91d12524c069 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:36.039056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1c2c37b3-f1fb-47a4-be9f-91d12524c069 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:36.069969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4a00060e-3182-4f20-951e-c3a271f595eb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:36.097175 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4a00060e-3182-4f20-951e-c3a271f595eb tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1699 microversion: 2.1 time: 0.404491 Feb 19 21:08:36.101119 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1968/4061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:35 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1699 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:36.125453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-715d6352-d8d1-4a09-b60e-253185b1cbea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:36.126204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-715d6352-d8d1-4a09-b60e-253185b1cbea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:36.141093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-715d6352-d8d1-4a09-b60e-253185b1cbea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:36.143065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-715d6352-d8d1-4a09-b60e-253185b1cbea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:36.145105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-715d6352-d8d1-4a09-b60e-253185b1cbea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:36.148028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-715d6352-d8d1-4a09-b60e-253185b1cbea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:36.456004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1c2c37b3-f1fb-47a4-be9f-91d12524c069 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:36.470867 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1c2c37b3-f1fb-47a4-be9f-91d12524c069 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.462850 Feb 19 21:08:36.481112 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2094/4062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:36 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:36.481112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7f52afb8-3450-44fd-98b9-ae7c0ac9ac4f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:36.486687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f52afb8-3450-44fd-98b9-ae7c0ac9ac4f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:36.487145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f52afb8-3450-44fd-98b9-ae7c0ac9ac4f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:36.528477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-715d6352-d8d1-4a09-b60e-253185b1cbea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:36.540491 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-715d6352-d8d1-4a09-b60e-253185b1cbea tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.434220 Feb 19 21:08:36.544421 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1969/4063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:36 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:36.564546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7f52afb8-3450-44fd-98b9-ae7c0ac9ac4f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Going to try to start instance {{(pid=136094) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 19 21:08:36.648492 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7f52afb8-3450-44fd-98b9-ae7c0ac9ac4f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/action" status: 202 len: 0 microversion: 2.1 time: 0.175144 Feb 19 21:08:36.649471 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2095/4064] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:08:36 2022] POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:08:36.659444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1d7827ad-a1f8-4477-b614-c4c55f67f412 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:36.660162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1d7827ad-a1f8-4477-b614-c4c55f67f412 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:36.668029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d7827ad-a1f8-4477-b614-c4c55f67f412 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:36.668825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d7827ad-a1f8-4477-b614-c4c55f67f412 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:36.669964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d7827ad-a1f8-4477-b614-c4c55f67f412 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:36.670699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d7827ad-a1f8-4477-b614-c4c55f67f412 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:36.991243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:36.991868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:36.998853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:36.999315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:37.000439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:37.001054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:37.008743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1d7827ad-a1f8-4477-b614-c4c55f67f412 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:37.021452 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1d7827ad-a1f8-4477-b614-c4c55f67f412 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1708 microversion: 2.1 time: 0.365952 Feb 19 21:08:37.043751 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1970/4065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:36 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1708 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:37.489370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c90a69c2-36f2-4ffb-b739-d65052a7583e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:37.490806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c90a69c2-36f2-4ffb-b739-d65052a7583e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:37.512220 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c90a69c2-36f2-4ffb-b739-d65052a7583e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:37.513083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c90a69c2-36f2-4ffb-b739-d65052a7583e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:37.514106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c90a69c2-36f2-4ffb-b739-d65052a7583e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:37.514758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c90a69c2-36f2-4ffb-b739-d65052a7583e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:37.750960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:37.763433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:37.764992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:37.766172 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1cb4fab1-3dcd-4e3d-895f-1953345c84c3 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.779803 Feb 19 21:08:37.766749 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2096/4066] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:36 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:37.805624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-940227d8-02b4-40d3-b4f7-51493ef951c7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:37.806512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-940227d8-02b4-40d3-b4f7-51493ef951c7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:37.821115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-940227d8-02b4-40d3-b4f7-51493ef951c7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:37.824549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-940227d8-02b4-40d3-b4f7-51493ef951c7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:37.826621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-940227d8-02b4-40d3-b4f7-51493ef951c7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:37.830054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-940227d8-02b4-40d3-b4f7-51493ef951c7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:38.102403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c90a69c2-36f2-4ffb-b739-d65052a7583e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:38.114282 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c90a69c2-36f2-4ffb-b739-d65052a7583e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.629078 Feb 19 21:08:38.126278 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1971/4067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:37 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:38.135758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-35691344-11ae-4ffc-bad8-e5100f434649 req-97cf0232-7ce8-4f70-80bb-25e82bcc7377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-plugged", "status": "completed", "tag": "70eb9392-ffac-4852-9582-a01fcfe48d7c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:38.137904 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:38.137904 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:38.158224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-35691344-11ae-4ffc-bad8-e5100f434649 req-97cf0232-7ce8-4f70-80bb-25e82bcc7377 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:38.159015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-35691344-11ae-4ffc-bad8-e5100f434649 req-97cf0232-7ce8-4f70-80bb-25e82bcc7377 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:38.180366 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-35691344-11ae-4ffc-bad8-e5100f434649 req-97cf0232-7ce8-4f70-80bb-25e82bcc7377 service nova] Creating event network-vif-plugged:70eb9392-ffac-4852-9582-a01fcfe48d7c for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:38.199455 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-35691344-11ae-4ffc-bad8-e5100f434649 req-97cf0232-7ce8-4f70-80bb-25e82bcc7377 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071247 Feb 19 21:08:38.200412 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1972/4068] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:38.211750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f365d2d5-45b0-42da-9215-7cc08aacb429 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:38.212792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f365d2d5-45b0-42da-9215-7cc08aacb429 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:38.233264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f365d2d5-45b0-42da-9215-7cc08aacb429 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:38.234037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f365d2d5-45b0-42da-9215-7cc08aacb429 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:38.235107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f365d2d5-45b0-42da-9215-7cc08aacb429 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:38.235745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f365d2d5-45b0-42da-9215-7cc08aacb429 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:38.467837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-940227d8-02b4-40d3-b4f7-51493ef951c7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:38.496721 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-940227d8-02b4-40d3-b4f7-51493ef951c7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.711581 Feb 19 21:08:38.499765 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2097/4069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:37 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:38.619263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f365d2d5-45b0-42da-9215-7cc08aacb429 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:38.631878 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f365d2d5-45b0-42da-9215-7cc08aacb429 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1708 microversion: 2.1 time: 0.429833 Feb 19 21:08:38.632992 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1973/4070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:38 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1708 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:38.799086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:38.801233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:38.827424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:38.828409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:38.829461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:38.830146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:39.138443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2af813d7-4c21-45c0-8fbe-4d7751d03f2e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:39.139053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2af813d7-4c21-45c0-8fbe-4d7751d03f2e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:39.160402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2af813d7-4c21-45c0-8fbe-4d7751d03f2e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:39.170486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2af813d7-4c21-45c0-8fbe-4d7751d03f2e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:39.171631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2af813d7-4c21-45c0-8fbe-4d7751d03f2e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:39.172115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2af813d7-4c21-45c0-8fbe-4d7751d03f2e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:39.399771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:39.414724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:39.417548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:39.424345 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-63f717a8-812e-4762-8bac-81e9e410fca1 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.641988 Feb 19 21:08:39.431834 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2098/4071] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:38 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:08:39.519257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e9387f12-7809-43b6-8fe3-e384f5d7ca08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:39.520004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e9387f12-7809-43b6-8fe3-e384f5d7ca08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:39.553672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9387f12-7809-43b6-8fe3-e384f5d7ca08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:39.553672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9387f12-7809-43b6-8fe3-e384f5d7ca08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:39.553672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9387f12-7809-43b6-8fe3-e384f5d7ca08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:39.553672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9387f12-7809-43b6-8fe3-e384f5d7ca08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:39.759849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2af813d7-4c21-45c0-8fbe-4d7751d03f2e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:39.778507 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2af813d7-4c21-45c0-8fbe-4d7751d03f2e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.646598 Feb 19 21:08:39.784487 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1974/4072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:39 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:39.795276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7265deb5-ed77-48df-bb66-a7be66298618 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:39.803776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7265deb5-ed77-48df-bb66-a7be66298618 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:39.817907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7265deb5-ed77-48df-bb66-a7be66298618 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:39.819556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7265deb5-ed77-48df-bb66-a7be66298618 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:39.821776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7265deb5-ed77-48df-bb66-a7be66298618 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:39.824023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7265deb5-ed77-48df-bb66-a7be66298618 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:39.880078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e9387f12-7809-43b6-8fe3-e384f5d7ca08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:39.890012 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e9387f12-7809-43b6-8fe3-e384f5d7ca08 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.377861 Feb 19 21:08:39.893445 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2099/4073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:39 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:40.056709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7265deb5-ed77-48df-bb66-a7be66298618 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:40.070619 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7265deb5-ed77-48df-bb66-a7be66298618 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1712 microversion: 2.1 time: 0.285012 Feb 19 21:08:40.071926 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1975/4074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:39 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1712 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:40.231565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a23a36c9-aad8-477b-b8f8-ae51d16c726f req-1560e16b-efb1-4e7a-8842-ebd09e6f2d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-plugged", "status": "completed", "tag": "953183ea-8af2-4363-894d-4fc5565d335c"}, {"server_uuid": "6ee0c1d6-4d26-4bb6-bf2b-83054efe676c", "name": "network-vif-plugged", "status": "completed", "tag": "761a57e3-c4a5-4caf-8b79-ab7836b14ef0"}, {"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-plugged", "status": "completed", "tag": "d2e2e0f9-6f33-4853-808c-07962b81a563"}, {"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-plugged", "status": "completed", "tag": "95e9c0f7-4a48-40c7-a205-d0efe0ce4387"}, {"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-plugged", "status": "completed", "tag": "e67957f6-071e-404a-a727-94c417e4d265"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:40.237718 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:40.237718 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:08:40.247005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a23a36c9-aad8-477b-b8f8-ae51d16c726f req-1560e16b-efb1-4e7a-8842-ebd09e6f2d26 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:40.248134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a23a36c9-aad8-477b-b8f8-ae51d16c726f req-1560e16b-efb1-4e7a-8842-ebd09e6f2d26 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:40.269714 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a23a36c9-aad8-477b-b8f8-ae51d16c726f req-1560e16b-efb1-4e7a-8842-ebd09e6f2d26 service nova] Creating event network-vif-plugged:953183ea-8af2-4363-894d-4fc5565d335c for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:40.270545 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a23a36c9-aad8-477b-b8f8-ae51d16c726f req-1560e16b-efb1-4e7a-8842-ebd09e6f2d26 service nova] Creating event network-vif-plugged:761a57e3-c4a5-4caf-8b79-ab7836b14ef0 for instance 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c on nch1-master-1 Feb 19 21:08:40.271440 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a23a36c9-aad8-477b-b8f8-ae51d16c726f req-1560e16b-efb1-4e7a-8842-ebd09e6f2d26 service nova] Creating event network-vif-plugged:d2e2e0f9-6f33-4853-808c-07962b81a563 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:40.272738 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a23a36c9-aad8-477b-b8f8-ae51d16c726f req-1560e16b-efb1-4e7a-8842-ebd09e6f2d26 service nova] Creating event network-vif-plugged:95e9c0f7-4a48-40c7-a205-d0efe0ce4387 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:40.273412 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a23a36c9-aad8-477b-b8f8-ae51d16c726f req-1560e16b-efb1-4e7a-8842-ebd09e6f2d26 service nova] Creating event network-vif-plugged:e67957f6-071e-404a-a727-94c417e4d265 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:40.282068 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a23a36c9-aad8-477b-b8f8-ae51d16c726f req-1560e16b-efb1-4e7a-8842-ebd09e6f2d26 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.054397 Feb 19 21:08:40.282925 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2100/4075] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:40.454960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:40.455689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:40.473769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:40.474823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:40.490916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:40.491831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:40.809967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-986d0fb2-3c69-4c5c-b887-c41f6fd3a82c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:40.810685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-986d0fb2-3c69-4c5c-b887-c41f6fd3a82c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:40.824777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-986d0fb2-3c69-4c5c-b887-c41f6fd3a82c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:40.825280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-986d0fb2-3c69-4c5c-b887-c41f6fd3a82c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:40.826115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-986d0fb2-3c69-4c5c-b887-c41f6fd3a82c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:40.826562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-986d0fb2-3c69-4c5c-b887-c41f6fd3a82c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:40.836770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:40.847511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:40.850004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:40.851637 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9dd409b3-e87d-4f37-94a6-a70b39411afb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.402171 Feb 19 21:08:40.852869 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1976/4076] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:40 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:40.917588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2e53ca44-a6a4-4c13-aff2-bdec3a263222 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:40.918794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2e53ca44-a6a4-4c13-aff2-bdec3a263222 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:40.944709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e53ca44-a6a4-4c13-aff2-bdec3a263222 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:40.948521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e53ca44-a6a4-4c13-aff2-bdec3a263222 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:40.951560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e53ca44-a6a4-4c13-aff2-bdec3a263222 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:40.953708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e53ca44-a6a4-4c13-aff2-bdec3a263222 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:41.006253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-986d0fb2-3c69-4c5c-b887-c41f6fd3a82c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:41.015742 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-986d0fb2-3c69-4c5c-b887-c41f6fd3a82c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.209916 Feb 19 21:08:41.016355 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2101/4077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:40 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:41.195539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2e53ca44-a6a4-4c13-aff2-bdec3a263222 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:41.204923 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2e53ca44-a6a4-4c13-aff2-bdec3a263222 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.291591 Feb 19 21:08:41.206074 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1977/4078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:40 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:41.874357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:41.875017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:41.889244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:41.889244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:41.890069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:41.890069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:42.034409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-850adcf8-39c9-4bc8-8617-b8032674f8ef tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:42.035078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-850adcf8-39c9-4bc8-8617-b8032674f8ef tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:42.058062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-850adcf8-39c9-4bc8-8617-b8032674f8ef tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:42.059216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-850adcf8-39c9-4bc8-8617-b8032674f8ef tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:42.061697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-850adcf8-39c9-4bc8-8617-b8032674f8ef tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:42.065823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-850adcf8-39c9-4bc8-8617-b8032674f8ef tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:42.290255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:42.314207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:42.315924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:42.321736 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1871181a-28ab-4724-bfa1-b442862e717e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.450974 Feb 19 21:08:42.329889 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2102/4079] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:41 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:42.339468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d6312e62-ab3f-4073-987a-e6dcc41a0efb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:42.343862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d6312e62-ab3f-4073-987a-e6dcc41a0efb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:42.363179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6312e62-ab3f-4073-987a-e6dcc41a0efb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:42.365306 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6312e62-ab3f-4073-987a-e6dcc41a0efb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:42.368818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6312e62-ab3f-4073-987a-e6dcc41a0efb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:42.369274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6312e62-ab3f-4073-987a-e6dcc41a0efb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:42.508175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-850adcf8-39c9-4bc8-8617-b8032674f8ef tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:42.525077 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-850adcf8-39c9-4bc8-8617-b8032674f8ef tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.490768 Feb 19 21:08:42.526270 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1978/4080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:42 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:42.532075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-46561875-57a1-4319-8abf-012db824a750 req-57aef294-4d8c-4181-83a2-94831e23a775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-plugged", "status": "completed", "tag": "5896be69-08fa-4335-b439-1a196dfa8691"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:42.535885 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:42.535885 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:42.545966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-46561875-57a1-4319-8abf-012db824a750 req-57aef294-4d8c-4181-83a2-94831e23a775 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:42.547365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-46561875-57a1-4319-8abf-012db824a750 req-57aef294-4d8c-4181-83a2-94831e23a775 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:42.570620 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-46561875-57a1-4319-8abf-012db824a750 req-57aef294-4d8c-4181-83a2-94831e23a775 service nova] Creating event network-vif-plugged:5896be69-08fa-4335-b439-1a196dfa8691 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:42.581592 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-46561875-57a1-4319-8abf-012db824a750 req-57aef294-4d8c-4181-83a2-94831e23a775 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053509 Feb 19 21:08:42.582244 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1979/4081] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:42.646020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6312e62-ab3f-4073-987a-e6dcc41a0efb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:42.657987 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d6312e62-ab3f-4073-987a-e6dcc41a0efb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.325346 Feb 19 21:08:42.669821 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2103/4082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:42 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:43.350579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:43.352523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:43.361109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:43.361880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:43.362934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:43.363597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:43.543747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0cac58c8-b933-4453-9610-121d2e83ace1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:43.544404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0cac58c8-b933-4453-9610-121d2e83ace1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:43.562608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cac58c8-b933-4453-9610-121d2e83ace1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:43.564881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cac58c8-b933-4453-9610-121d2e83ace1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:43.568529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cac58c8-b933-4453-9610-121d2e83ace1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:43.569005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cac58c8-b933-4453-9610-121d2e83ace1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:43.747593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:43.765119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:43.768924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:43.772208 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-40cafaf9-01ce-4f8b-a4f3-4d269ab98db4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1870 microversion: 2.32 time: 0.426079 Feb 19 21:08:43.773290 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1980/4083] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:43 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1870 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:43.784552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4e2a975f-6435-407f-8e15-ce5592131613 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:43.789577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4e2a975f-6435-407f-8e15-ce5592131613 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:43.808438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e2a975f-6435-407f-8e15-ce5592131613 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:43.813000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e2a975f-6435-407f-8e15-ce5592131613 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:43.824966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e2a975f-6435-407f-8e15-ce5592131613 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:43.825534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e2a975f-6435-407f-8e15-ce5592131613 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:43.958851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0cac58c8-b933-4453-9610-121d2e83ace1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:43.971269 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0cac58c8-b933-4453-9610-121d2e83ace1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.431715 Feb 19 21:08:43.972227 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2104/4084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:43 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:44.074819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4e2a975f-6435-407f-8e15-ce5592131613 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:44.085132 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4e2a975f-6435-407f-8e15-ce5592131613 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.310248 Feb 19 21:08:44.087115 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1981/4085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:43 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:44.791720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:44.792533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:44.803534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:44.803988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:44.807904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:44.808914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:44.989490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-78f2446c-ad85-40e0-bea0-8f19c9153c37 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:44.990830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-78f2446c-ad85-40e0-bea0-8f19c9153c37 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:44.999841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78f2446c-ad85-40e0-bea0-8f19c9153c37 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:45.000400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78f2446c-ad85-40e0-bea0-8f19c9153c37 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:45.001463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78f2446c-ad85-40e0-bea0-8f19c9153c37 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:45.002165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78f2446c-ad85-40e0-bea0-8f19c9153c37 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:45.132272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:45.148311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:45.152853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:45.156379 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-37ed0ebe-e55d-4007-91dd-99c91386c83e tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2822 microversion: 2.32 time: 0.367514 Feb 19 21:08:45.157933 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2105/4086] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:44 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2822 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:08:45.178850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83a109f1-0f7a-475e-8553-c2cc0bbb06e6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:45.179991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83a109f1-0f7a-475e-8553-c2cc0bbb06e6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:45.188113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83a109f1-0f7a-475e-8553-c2cc0bbb06e6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:45.188979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83a109f1-0f7a-475e-8553-c2cc0bbb06e6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:45.190175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83a109f1-0f7a-475e-8553-c2cc0bbb06e6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:45.191825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83a109f1-0f7a-475e-8553-c2cc0bbb06e6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:45.282118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-78f2446c-ad85-40e0-bea0-8f19c9153c37 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:45.293013 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-78f2446c-ad85-40e0-bea0-8f19c9153c37 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.306461 Feb 19 21:08:45.304530 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1982/4087] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:44 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:45.311945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-45abd37e-3b48-468e-b243-e626b29fd884 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:45.315340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-45abd37e-3b48-468e-b243-e626b29fd884 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:45.345526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45abd37e-3b48-468e-b243-e626b29fd884 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:45.345972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45abd37e-3b48-468e-b243-e626b29fd884 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:45.346784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45abd37e-3b48-468e-b243-e626b29fd884 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:45.347222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-45abd37e-3b48-468e-b243-e626b29fd884 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:45.550816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83a109f1-0f7a-475e-8553-c2cc0bbb06e6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:45.570500 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83a109f1-0f7a-475e-8553-c2cc0bbb06e6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.408510 Feb 19 21:08:45.571555 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2106/4088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:45 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:45.646243 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-45abd37e-3b48-468e-b243-e626b29fd884 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.347642 Feb 19 21:08:45.647012 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1983/4089] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Feb 19 21:08:45 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b/os-interface => generated 1831 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:46.317807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4c341dd-e94d-4e80-9727-0b8e42156d57 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:46.318547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e4c341dd-e94d-4e80-9727-0b8e42156d57 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:46.339193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4c341dd-e94d-4e80-9727-0b8e42156d57 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:46.339644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4c341dd-e94d-4e80-9727-0b8e42156d57 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:46.341605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4c341dd-e94d-4e80-9727-0b8e42156d57 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:46.343124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4c341dd-e94d-4e80-9727-0b8e42156d57 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:46.595878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2e370500-30a9-4f96-ae97-95d824992fc3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:46.596512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2e370500-30a9-4f96-ae97-95d824992fc3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:46.640972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e370500-30a9-4f96-ae97-95d824992fc3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:46.641434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e370500-30a9-4f96-ae97-95d824992fc3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:46.652294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e370500-30a9-4f96-ae97-95d824992fc3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:46.652968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e370500-30a9-4f96-ae97-95d824992fc3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:46.657022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e4c341dd-e94d-4e80-9727-0b8e42156d57 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:46.678303 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e4c341dd-e94d-4e80-9727-0b8e42156d57 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.363653 Feb 19 21:08:46.679327 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2107/4090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:46 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:46.973238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2e370500-30a9-4f96-ae97-95d824992fc3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:46.983603 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2e370500-30a9-4f96-ae97-95d824992fc3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.396081 Feb 19 21:08:46.984900 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1984/4091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:46 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:47.618123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:47.618750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:47.638846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:47.649196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-20a100b8-884b-4b91-8a7c-e8ac023794c6 req-a807a144-e9bf-4617-9b67-0a4f394644df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "tag": "953183ea-8af2-4363-894d-4fc5565d335c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:47.651194 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:47.651194 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:08:47.653982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:47.658724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:47.659196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:47.675818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-20a100b8-884b-4b91-8a7c-e8ac023794c6 req-a807a144-e9bf-4617-9b67-0a4f394644df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:47.675818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-20a100b8-884b-4b91-8a7c-e8ac023794c6 req-a807a144-e9bf-4617-9b67-0a4f394644df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:47.759287 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-20a100b8-884b-4b91-8a7c-e8ac023794c6 req-a807a144-e9bf-4617-9b67-0a4f394644df service nova] Creating event network-changed:953183ea-8af2-4363-894d-4fc5565d335c for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:08:47.809722 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-20a100b8-884b-4b91-8a7c-e8ac023794c6 req-a807a144-e9bf-4617-9b67-0a4f394644df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158253 Feb 19 21:08:47.814407 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1985/4092] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:47.829460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1c2c3fa8-7eef-4588-8e29-30aa080af0e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:47.831104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1c2c3fa8-7eef-4588-8e29-30aa080af0e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:47.846272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c2c3fa8-7eef-4588-8e29-30aa080af0e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:47.848781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c2c3fa8-7eef-4588-8e29-30aa080af0e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:47.855729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c2c3fa8-7eef-4588-8e29-30aa080af0e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:47.861184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c2c3fa8-7eef-4588-8e29-30aa080af0e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:48.341817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:48.371155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:48.373887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1c2c3fa8-7eef-4588-8e29-30aa080af0e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:48.382350 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1c2c3fa8-7eef-4588-8e29-30aa080af0e1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.562699 Feb 19 21:08:48.384889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:48.386126 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1986/4093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:47 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:48.390917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-39977b91-97bd-40af-95b3-48394b0eb1c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:48.397315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-39977b91-97bd-40af-95b3-48394b0eb1c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:48.405346 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7cf94ee-ab9d-466a-b1f8-bb24ecd5828d tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2822 microversion: 2.32 time: 0.793870 Feb 19 21:08:48.407899 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2108/4094] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:08:47 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2822 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:08:48.422704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39977b91-97bd-40af-95b3-48394b0eb1c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:48.423638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39977b91-97bd-40af-95b3-48394b0eb1c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:48.424699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39977b91-97bd-40af-95b3-48394b0eb1c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:48.425349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39977b91-97bd-40af-95b3-48394b0eb1c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:48.441036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-62eafb95-9fac-4c0d-bd9a-5a753d94d109 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:48.442484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-62eafb95-9fac-4c0d-bd9a-5a753d94d109 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:48.459610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62eafb95-9fac-4c0d-bd9a-5a753d94d109 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:48.460199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62eafb95-9fac-4c0d-bd9a-5a753d94d109 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:48.461190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62eafb95-9fac-4c0d-bd9a-5a753d94d109 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:48.461709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-62eafb95-9fac-4c0d-bd9a-5a753d94d109 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:48.753065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-39977b91-97bd-40af-95b3-48394b0eb1c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:48.762254 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-39977b91-97bd-40af-95b3-48394b0eb1c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1509 microversion: 2.1 time: 0.374798 Feb 19 21:08:48.773762 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1987/4095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:48 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1509 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:48.831897 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-62eafb95-9fac-4c0d-bd9a-5a753d94d109 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.394186 Feb 19 21:08:48.834582 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2109/4096] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Feb 19 21:08:48 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b/os-interface => generated 1831 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:08:49.407499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a1c1b23f-76ba-40a7-9845-8b1f070c5550 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:49.408120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a1c1b23f-76ba-40a7-9845-8b1f070c5550 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:49.418235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1c1b23f-76ba-40a7-9845-8b1f070c5550 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:49.418973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1c1b23f-76ba-40a7-9845-8b1f070c5550 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:49.419975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1c1b23f-76ba-40a7-9845-8b1f070c5550 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:49.420631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1c1b23f-76ba-40a7-9845-8b1f070c5550 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:49.773582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a1c1b23f-76ba-40a7-9845-8b1f070c5550 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:49.781841 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a1c1b23f-76ba-40a7-9845-8b1f070c5550 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1507 microversion: 2.1 time: 0.378545 Feb 19 21:08:49.782338 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1988/4097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:49 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:49.794559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cf57f8c0-28cb-494b-ada6-304f49597bb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:49.794559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cf57f8c0-28cb-494b-ada6-304f49597bb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:49.799884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf57f8c0-28cb-494b-ada6-304f49597bb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:49.800358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf57f8c0-28cb-494b-ada6-304f49597bb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:49.801150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf57f8c0-28cb-494b-ada6-304f49597bb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:49.801910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cf57f8c0-28cb-494b-ada6-304f49597bb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:50.078194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cf57f8c0-28cb-494b-ada6-304f49597bb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:50.089292 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cf57f8c0-28cb-494b-ada6-304f49597bb9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1506 microversion: 2.1 time: 0.300922 Feb 19 21:08:50.090470 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2110/4098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:49 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:50.798977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-225e1194-7bc9-48ed-8462-6ae16a094ec8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:50.799758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-225e1194-7bc9-48ed-8462-6ae16a094ec8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:50.808539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-225e1194-7bc9-48ed-8462-6ae16a094ec8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:50.809100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-225e1194-7bc9-48ed-8462-6ae16a094ec8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:50.810013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-225e1194-7bc9-48ed-8462-6ae16a094ec8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:50.810512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-225e1194-7bc9-48ed-8462-6ae16a094ec8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:51.018237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-225e1194-7bc9-48ed-8462-6ae16a094ec8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:51.026109 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-225e1194-7bc9-48ed-8462-6ae16a094ec8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1528 microversion: 2.1 time: 0.230937 Feb 19 21:08:51.029578 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1989/4099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:50 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1528 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:51.119888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-803d295f-9661-40bb-8c3f-3c73c2424cb3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:51.120709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-803d295f-9661-40bb-8c3f-3c73c2424cb3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:51.133027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-803d295f-9661-40bb-8c3f-3c73c2424cb3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:51.133733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-803d295f-9661-40bb-8c3f-3c73c2424cb3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:51.135157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-803d295f-9661-40bb-8c3f-3c73c2424cb3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:51.135839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-803d295f-9661-40bb-8c3f-3c73c2424cb3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:51.303995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-803d295f-9661-40bb-8c3f-3c73c2424cb3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:51.312648 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-803d295f-9661-40bb-8c3f-3c73c2424cb3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1506 microversion: 2.1 time: 0.199994 Feb 19 21:08:51.313519 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2111/4100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:51 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:52.044676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dcdf51ad-013b-415f-95cf-4082b70ee141 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:52.045513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dcdf51ad-013b-415f-95cf-4082b70ee141 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:52.052973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcdf51ad-013b-415f-95cf-4082b70ee141 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:52.053946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcdf51ad-013b-415f-95cf-4082b70ee141 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:52.055064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcdf51ad-013b-415f-95cf-4082b70ee141 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:52.055692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcdf51ad-013b-415f-95cf-4082b70ee141 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:52.226464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dcdf51ad-013b-415f-95cf-4082b70ee141 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:52.237181 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dcdf51ad-013b-415f-95cf-4082b70ee141 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1528 microversion: 2.1 time: 0.196728 Feb 19 21:08:52.247262 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1990/4101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:52 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1528 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:52.332785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-221e1297-dd58-483a-b652-eacc80ae39c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:52.339219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-221e1297-dd58-483a-b652-eacc80ae39c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:52.356683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-221e1297-dd58-483a-b652-eacc80ae39c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:52.357776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-221e1297-dd58-483a-b652-eacc80ae39c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:52.360907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-221e1297-dd58-483a-b652-eacc80ae39c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:52.363068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-221e1297-dd58-483a-b652-eacc80ae39c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:52.614027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-221e1297-dd58-483a-b652-eacc80ae39c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:52.624864 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-221e1297-dd58-483a-b652-eacc80ae39c1 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1506 microversion: 2.1 time: 0.298187 Feb 19 21:08:52.635640 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2112/4102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:52 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:53.254440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-73960862-eb45-4b56-9634-aef0c1579249 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:53.255099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-73960862-eb45-4b56-9634-aef0c1579249 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:53.271416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73960862-eb45-4b56-9634-aef0c1579249 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:53.271882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73960862-eb45-4b56-9634-aef0c1579249 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:53.272870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73960862-eb45-4b56-9634-aef0c1579249 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:53.273317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73960862-eb45-4b56-9634-aef0c1579249 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:53.511179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-73960862-eb45-4b56-9634-aef0c1579249 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:53.521873 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-73960862-eb45-4b56-9634-aef0c1579249 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.270563 Feb 19 21:08:53.523080 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1991/4103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:53 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:53.548421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8fb37498-2c2e-4264-8fbc-8c011ece438d req-60023c07-1aef-40a5-a9dc-771051a11dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee0c1d6-4d26-4bb6-bf2b-83054efe676c", "name": "network-vif-unplugged", "status": "completed", "tag": "761a57e3-c4a5-4caf-8b79-ab7836b14ef0"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:53.552291 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:53.552291 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:08:53.564775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8fb37498-2c2e-4264-8fbc-8c011ece438d req-60023c07-1aef-40a5-a9dc-771051a11dd5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:53.565961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8fb37498-2c2e-4264-8fbc-8c011ece438d req-60023c07-1aef-40a5-a9dc-771051a11dd5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:53.582001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.compute.server_external_events [req-8fb37498-2c2e-4264-8fbc-8c011ece438d req-60023c07-1aef-40a5-a9dc-771051a11dd5 service nova] Unable to find a host for instance 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c. Dropping event network-vif-unplugged {{(pid=136094) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 19 21:08:53.584586 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8fb37498-2c2e-4264-8fbc-8c011ece438d req-60023c07-1aef-40a5-a9dc-771051a11dd5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043272 Feb 19 21:08:53.585967 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2113/4104] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 19 21:08:53.661135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9d593b4e-e914-47fc-aea2-a6eaa5b98ecb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:53.665107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9d593b4e-e914-47fc-aea2-a6eaa5b98ecb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:53.678611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d593b4e-e914-47fc-aea2-a6eaa5b98ecb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:53.679938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d593b4e-e914-47fc-aea2-a6eaa5b98ecb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:53.683343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d593b4e-e914-47fc-aea2-a6eaa5b98ecb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:53.684122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d593b4e-e914-47fc-aea2-a6eaa5b98ecb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:53.961427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9d593b4e-e914-47fc-aea2-a6eaa5b98ecb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:54.001129 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9d593b4e-e914-47fc-aea2-a6eaa5b98ecb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 200 len: 1449 microversion: 2.1 time: 0.361837 Feb 19 21:08:54.008182 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1992/4105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:53 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 1449 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:54.047077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9a7a777f-a2e6-4821-94b4-56c6eb9620c6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:54.050726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9a7a777f-a2e6-4821-94b4-56c6eb9620c6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:54.080636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a7a777f-a2e6-4821-94b4-56c6eb9620c6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:54.087776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a7a777f-a2e6-4821-94b4-56c6eb9620c6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:54.091293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a7a777f-a2e6-4821-94b4-56c6eb9620c6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:54.092821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9a7a777f-a2e6-4821-94b4-56c6eb9620c6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:54.313876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9a7a777f-a2e6-4821-94b4-56c6eb9620c6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:54.324945 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9a7a777f-a2e6-4821-94b4-56c6eb9620c6 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.304837 Feb 19 21:08:54.325865 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2114/4106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:54 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:54.353147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae7ee0bf-fa65-4333-98e5-42bc342459ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:54.353807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae7ee0bf-fa65-4333-98e5-42bc342459ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:54.391219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae7ee0bf-fa65-4333-98e5-42bc342459ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:54.394574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae7ee0bf-fa65-4333-98e5-42bc342459ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:54.397415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae7ee0bf-fa65-4333-98e5-42bc342459ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:54.398503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae7ee0bf-fa65-4333-98e5-42bc342459ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:54.539894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b5606e06-e009-4bbd-8e8d-85ac73d307df tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:54.540548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b5606e06-e009-4bbd-8e8d-85ac73d307df tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:54.552584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5606e06-e009-4bbd-8e8d-85ac73d307df tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:54.555568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5606e06-e009-4bbd-8e8d-85ac73d307df tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:54.557210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5606e06-e009-4bbd-8e8d-85ac73d307df tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:54.557926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5606e06-e009-4bbd-8e8d-85ac73d307df tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:54.752607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae7ee0bf-fa65-4333-98e5-42bc342459ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:54.781766 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae7ee0bf-fa65-4333-98e5-42bc342459ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.432456 Feb 19 21:08:54.783964 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1993/4107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:54 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:54.818789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0252bf05-e524-4512-aa6c-6d68827714fa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:54.821239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0252bf05-e524-4512-aa6c-6d68827714fa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:54.844375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0252bf05-e524-4512-aa6c-6d68827714fa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:54.845086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0252bf05-e524-4512-aa6c-6d68827714fa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:54.846995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0252bf05-e524-4512-aa6c-6d68827714fa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:54.848917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0252bf05-e524-4512-aa6c-6d68827714fa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:54.856276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b5606e06-e009-4bbd-8e8d-85ac73d307df tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:54.864393 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b5606e06-e009-4bbd-8e8d-85ac73d307df tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.329078 Feb 19 21:08:54.865531 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2115/4108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:54 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:55.085607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0252bf05-e524-4512-aa6c-6d68827714fa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:55.098731 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0252bf05-e524-4512-aa6c-6d68827714fa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.296040 Feb 19 21:08:55.119521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-092324d1-a6b9-4de5-ba9c-1b189e48716e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:55.120468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-092324d1-a6b9-4de5-ba9c-1b189e48716e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:55.126800 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1994/4109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:54 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:55.128941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-092324d1-a6b9-4de5-ba9c-1b189e48716e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:55.129661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-092324d1-a6b9-4de5-ba9c-1b189e48716e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:55.131036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-092324d1-a6b9-4de5-ba9c-1b189e48716e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:55.131703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-092324d1-a6b9-4de5-ba9c-1b189e48716e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:55.406430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-092324d1-a6b9-4de5-ba9c-1b189e48716e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:55.421156 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-092324d1-a6b9-4de5-ba9c-1b189e48716e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.305246 Feb 19 21:08:55.422126 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2116/4110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:55 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:55.441694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5c3f00d-987c-436e-aaf0-233523bd61e9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:55.461047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5c3f00d-987c-436e-aaf0-233523bd61e9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:55.461936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b5c3f00d-987c-436e-aaf0-233523bd61e9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:55.518585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b5c3f00d-987c-436e-aaf0-233523bd61e9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Going to try to stop instance {{(pid=136095) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:08:55.610985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5eaf5eff-d2b1-44fa-9b35-dc11350f11f8 req-ffe2b198-ca78-4c0f-a95c-e9d124b05117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f620150-4262-4d39-9937-e1f00ea04a88", "name": "network-vif-plugged", "status": "completed", "tag": "d8970ddf-bb4f-4a41-8cb2-0ed56b52ff6e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:08:55.613028 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:08:55.613028 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:08:55.627974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5eaf5eff-d2b1-44fa-9b35-dc11350f11f8 req-ffe2b198-ca78-4c0f-a95c-e9d124b05117 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:55.641829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5eaf5eff-d2b1-44fa-9b35-dc11350f11f8 req-ffe2b198-ca78-4c0f-a95c-e9d124b05117 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:55.645421 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b5c3f00d-987c-436e-aaf0-233523bd61e9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.210151 Feb 19 21:08:55.647142 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1995/4111] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:08:55 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:08:55.663809 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5eaf5eff-d2b1-44fa-9b35-dc11350f11f8 req-ffe2b198-ca78-4c0f-a95c-e9d124b05117 service nova] Creating event network-vif-plugged:d8970ddf-bb4f-4a41-8cb2-0ed56b52ff6e for instance 6f620150-4262-4d39-9937-e1f00ea04a88 on nch1-master-1 Feb 19 21:08:55.669769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9640f0bd-3140-4e83-9716-bb83c0241dfa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:55.672011 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5eaf5eff-d2b1-44fa-9b35-dc11350f11f8 req-ffe2b198-ca78-4c0f-a95c-e9d124b05117 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066138 Feb 19 21:08:55.674438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9640f0bd-3140-4e83-9716-bb83c0241dfa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:55.675069 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2117/4112] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:08:55.687165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9640f0bd-3140-4e83-9716-bb83c0241dfa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:55.687739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9640f0bd-3140-4e83-9716-bb83c0241dfa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:55.688997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9640f0bd-3140-4e83-9716-bb83c0241dfa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:55.689523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9640f0bd-3140-4e83-9716-bb83c0241dfa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:55.892532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6b09a296-37f2-4f50-a577-c40e17150c5e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:55.893625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6b09a296-37f2-4f50-a577-c40e17150c5e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:55.906360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b09a296-37f2-4f50-a577-c40e17150c5e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:55.907795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b09a296-37f2-4f50-a577-c40e17150c5e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:55.909546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b09a296-37f2-4f50-a577-c40e17150c5e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:55.910731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b09a296-37f2-4f50-a577-c40e17150c5e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:56.016146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9640f0bd-3140-4e83-9716-bb83c0241dfa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:56.027950 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9640f0bd-3140-4e83-9716-bb83c0241dfa tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.376634 Feb 19 21:08:56.037656 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1996/4113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:55 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:56.167649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b09a296-37f2-4f50-a577-c40e17150c5e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:56.201018 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6b09a296-37f2-4f50-a577-c40e17150c5e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.316961 Feb 19 21:08:56.212003 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2118/4114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:55 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:57.060145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa4ec37c-7ad6-4b25-9210-aa84a7089e44 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:57.066887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aa4ec37c-7ad6-4b25-9210-aa84a7089e44 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:57.090306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa4ec37c-7ad6-4b25-9210-aa84a7089e44 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:57.090839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa4ec37c-7ad6-4b25-9210-aa84a7089e44 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:57.091876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa4ec37c-7ad6-4b25-9210-aa84a7089e44 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:57.096357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa4ec37c-7ad6-4b25-9210-aa84a7089e44 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:57.220053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-32308190-240d-4ee0-ab41-dddd2af96715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:57.220890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-32308190-240d-4ee0-ab41-dddd2af96715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:57.244692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32308190-240d-4ee0-ab41-dddd2af96715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:57.245097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32308190-240d-4ee0-ab41-dddd2af96715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:57.247099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32308190-240d-4ee0-ab41-dddd2af96715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:57.248458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32308190-240d-4ee0-ab41-dddd2af96715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:57.454593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa4ec37c-7ad6-4b25-9210-aa84a7089e44 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:57.472216 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa4ec37c-7ad6-4b25-9210-aa84a7089e44 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.420098 Feb 19 21:08:57.476383 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1997/4115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:57 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:57.654560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-32308190-240d-4ee0-ab41-dddd2af96715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:57.692556 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-32308190-240d-4ee0-ab41-dddd2af96715 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.476179 Feb 19 21:08:57.703047 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2119/4116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:57 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:58.502919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7a8486f5-e580-49aa-941b-1fa620a932d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:58.504185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7a8486f5-e580-49aa-941b-1fa620a932d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:58.512317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a8486f5-e580-49aa-941b-1fa620a932d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:58.513174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a8486f5-e580-49aa-941b-1fa620a932d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:58.514248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a8486f5-e580-49aa-941b-1fa620a932d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:58.515050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a8486f5-e580-49aa-941b-1fa620a932d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:58.714701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a1b45f82-ffd3-4ec7-b527-2fa58a73c3bb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:58.716015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a1b45f82-ffd3-4ec7-b527-2fa58a73c3bb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:58.734400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1b45f82-ffd3-4ec7-b527-2fa58a73c3bb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:58.735100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1b45f82-ffd3-4ec7-b527-2fa58a73c3bb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:58.736075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1b45f82-ffd3-4ec7-b527-2fa58a73c3bb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:58.736776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a1b45f82-ffd3-4ec7-b527-2fa58a73c3bb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:58.767486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7a8486f5-e580-49aa-941b-1fa620a932d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:58.778603 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7a8486f5-e580-49aa-941b-1fa620a932d4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.284533 Feb 19 21:08:58.779691 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1998/4117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:58 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:08:58.785048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:58.785684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:58.793620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:58.794748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:58.795869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:58.796561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:58.963050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lazy-loading 'services' on Instance uuid 5340f4f1-b817-484c-a352-a4452e9a3b5d {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:08:59.089300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a1b45f82-ffd3-4ec7-b527-2fa58a73c3bb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:08:59.093962 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e48dae99-f40a-4d11-82ad-2c36a0e7a383 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d/os-volume_attachments/3c4659bd-63a9-4ccf-8885-d4725562e8a0" status: 202 len: 0 microversion: 2.1 time: 0.312593 Feb 19 21:08:59.095022 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 1999/4118] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:08:58 2022] DELETE /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d/os-volume_attachments/3c4659bd-63a9-4ccf-8885-d4725562e8a0 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:08:59.099836 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a1b45f82-ffd3-4ec7-b527-2fa58a73c3bb tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.392387 Feb 19 21:08:59.100636 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2120/4119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:58 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:08:59.797328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b3a8cfb-047b-4a6c-86eb-6df43a049093 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:08:59.798161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b3a8cfb-047b-4a6c-86eb-6df43a049093 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:08:59.809938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b3a8cfb-047b-4a6c-86eb-6df43a049093 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:59.811258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b3a8cfb-047b-4a6c-86eb-6df43a049093 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:08:59.812085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b3a8cfb-047b-4a6c-86eb-6df43a049093 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:08:59.812562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b3a8cfb-047b-4a6c-86eb-6df43a049093 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:00.119087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d0ac5813-7dce-401d-84e6-2fcd9f8c459f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:00.120453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d0ac5813-7dce-401d-84e6-2fcd9f8c459f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:00.133760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0ac5813-7dce-401d-84e6-2fcd9f8c459f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:00.139828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0ac5813-7dce-401d-84e6-2fcd9f8c459f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:00.140768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0ac5813-7dce-401d-84e6-2fcd9f8c459f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:00.141199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0ac5813-7dce-401d-84e6-2fcd9f8c459f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:00.151372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4b3a8cfb-047b-4a6c-86eb-6df43a049093 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:00.163525 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b3a8cfb-047b-4a6c-86eb-6df43a049093 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.369881 Feb 19 21:09:00.169361 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2121/4120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:08:59 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:00.279042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4812daf8-0678-495d-99f4-0d23f59ab063 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:00.280317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4812daf8-0678-495d-99f4-0d23f59ab063 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:00.289375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4812daf8-0678-495d-99f4-0d23f59ab063 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:00.289953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4812daf8-0678-495d-99f4-0d23f59ab063 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:00.291029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4812daf8-0678-495d-99f4-0d23f59ab063 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:00.291562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4812daf8-0678-495d-99f4-0d23f59ab063 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:00.329208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4812daf8-0678-495d-99f4-0d23f59ab063 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:09:00.449688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d0ac5813-7dce-401d-84e6-2fcd9f8c459f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:00.463980 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d0ac5813-7dce-401d-84e6-2fcd9f8c459f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.350066 Feb 19 21:09:00.480454 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2000/4121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:00 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:00.528413 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4812daf8-0678-495d-99f4-0d23f59ab063 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 204 len: 0 microversion: 2.1 time: 0.252769 Feb 19 21:09:00.529645 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2122/4122] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:09:00 2022] DELETE /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:09:00.538549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c51af8e3-d2c0-450d-972d-2067c6735b87 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:00.539295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c51af8e3-d2c0-450d-972d-2067c6735b87 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:00.547131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c51af8e3-d2c0-450d-972d-2067c6735b87 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:00.547769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c51af8e3-d2c0-450d-972d-2067c6735b87 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:00.548940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c51af8e3-d2c0-450d-972d-2067c6735b87 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:00.549606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c51af8e3-d2c0-450d-972d-2067c6735b87 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:01.181869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c51af8e3-d2c0-450d-972d-2067c6735b87 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:01.182916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8250030b-f04d-4dbb-9d09-45e8fa440dfb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:01.183543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8250030b-f04d-4dbb-9d09-45e8fa440dfb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:01.198232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8250030b-f04d-4dbb-9d09-45e8fa440dfb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:01.198726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8250030b-f04d-4dbb-9d09-45e8fa440dfb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:01.199186 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c51af8e3-d2c0-450d-972d-2067c6735b87 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1513 microversion: 2.1 time: 0.663955 Feb 19 21:09:01.200713 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2001/4123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:00 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1513 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:01.216089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8250030b-f04d-4dbb-9d09-45e8fa440dfb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:01.216089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8250030b-f04d-4dbb-9d09-45e8fa440dfb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:01.485421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8250030b-f04d-4dbb-9d09-45e8fa440dfb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:01.487815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-efda4798-6645-42bc-b85a-1942bbdf9093 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:01.488461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-efda4798-6645-42bc-b85a-1942bbdf9093 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:01.494695 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8250030b-f04d-4dbb-9d09-45e8fa440dfb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.316565 Feb 19 21:09:01.497102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efda4798-6645-42bc-b85a-1942bbdf9093 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:01.497788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efda4798-6645-42bc-b85a-1942bbdf9093 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:01.502141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efda4798-6645-42bc-b85a-1942bbdf9093 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:01.502797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efda4798-6645-42bc-b85a-1942bbdf9093 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:01.512981 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2123/4124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:01 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:01.771723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-efda4798-6645-42bc-b85a-1942bbdf9093 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:01.783236 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-efda4798-6645-42bc-b85a-1942bbdf9093 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.298692 Feb 19 21:09:01.794054 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2002/4125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:01 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:02.232476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f711b610-6a6b-40b7-a188-6491fcd7bb2c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:02.234191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f711b610-6a6b-40b7-a188-6491fcd7bb2c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:02.249981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f711b610-6a6b-40b7-a188-6491fcd7bb2c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:02.250447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f711b610-6a6b-40b7-a188-6491fcd7bb2c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:02.251266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f711b610-6a6b-40b7-a188-6491fcd7bb2c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:02.251712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f711b610-6a6b-40b7-a188-6491fcd7bb2c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:02.516376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7a22fda2-905f-4562-aeb0-e0bcd884b32f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:02.517328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7a22fda2-905f-4562-aeb0-e0bcd884b32f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:02.545614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a22fda2-905f-4562-aeb0-e0bcd884b32f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:02.546222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a22fda2-905f-4562-aeb0-e0bcd884b32f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:02.547097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a22fda2-905f-4562-aeb0-e0bcd884b32f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:02.547564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a22fda2-905f-4562-aeb0-e0bcd884b32f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:02.650453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f711b610-6a6b-40b7-a188-6491fcd7bb2c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:02.678599 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f711b610-6a6b-40b7-a188-6491fcd7bb2c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1513 microversion: 2.1 time: 0.451589 Feb 19 21:09:02.694022 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2124/4126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:02 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1513 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:02.810599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0eef154-821a-4134-b3d3-c4614932ce56 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:02.818005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0eef154-821a-4134-b3d3-c4614932ce56 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:02.862556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0eef154-821a-4134-b3d3-c4614932ce56 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:02.863996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0eef154-821a-4134-b3d3-c4614932ce56 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:02.869299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0eef154-821a-4134-b3d3-c4614932ce56 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:02.875562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0eef154-821a-4134-b3d3-c4614932ce56 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:03.102729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7a22fda2-905f-4562-aeb0-e0bcd884b32f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:03.119359 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7a22fda2-905f-4562-aeb0-e0bcd884b32f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.609356 Feb 19 21:09:03.123144 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2003/4127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:02 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:03.323254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b66ccd80-5ed1-4401-abbf-a55bba5974e8 req-c6a26013-96ca-4eb4-8326-203649904c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5340f4f1-b817-484c-a352-a4452e9a3b5d", "name": "network-vif-deleted", "tag": "4c79265f-54cf-4b0b-a603-70533b9a21e1"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:03.324988 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:03.324988 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:09:03.327455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e0eef154-821a-4134-b3d3-c4614932ce56 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:03.344360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b66ccd80-5ed1-4401-abbf-a55bba5974e8 req-c6a26013-96ca-4eb4-8326-203649904c2b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:03.344808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b66ccd80-5ed1-4401-abbf-a55bba5974e8 req-c6a26013-96ca-4eb4-8326-203649904c2b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:03.345000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0eef154-821a-4134-b3d3-c4614932ce56 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.542368 Feb 19 21:09:03.346091 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2125/4128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:02 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:03.380041 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b66ccd80-5ed1-4401-abbf-a55bba5974e8 req-c6a26013-96ca-4eb4-8326-203649904c2b service nova] Creating event network-vif-deleted:4c79265f-54cf-4b0b-a603-70533b9a21e1 for instance 5340f4f1-b817-484c-a352-a4452e9a3b5d on nch1-master-1 Feb 19 21:09:03.388954 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b66ccd80-5ed1-4401-abbf-a55bba5974e8 req-c6a26013-96ca-4eb4-8326-203649904c2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072201 Feb 19 21:09:03.395172 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2004/4129] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:09:03.703400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:03.704622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:03.714858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:03.715727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:03.716826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:03.717272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:03.767876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:03.769072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:03.769924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lazy-loading 'fault' on Instance uuid 5340f4f1-b817-484c-a352-a4452e9a3b5d {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:09:03.826181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edf621841d44514b6082172d15af2a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9b396737a34280bdc448a2b0df5a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:03.838571 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab3ec21c-9e6a-4a1a-8635-35ebcfa00477 tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 200 len: 1309 microversion: 2.1 time: 0.139486 Feb 19 21:09:03.839174 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2126/4130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:03 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 1309 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:04.144355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0991a138-fff2-4e24-a5a6-3e3bfbbe639a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:04.145055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0991a138-fff2-4e24-a5a6-3e3bfbbe639a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:04.157408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0991a138-fff2-4e24-a5a6-3e3bfbbe639a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:04.160549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0991a138-fff2-4e24-a5a6-3e3bfbbe639a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:04.161674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0991a138-fff2-4e24-a5a6-3e3bfbbe639a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:04.162335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0991a138-fff2-4e24-a5a6-3e3bfbbe639a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:04.364370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bba92d4a-145b-45d0-89df-ba194413f660 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:04.365533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bba92d4a-145b-45d0-89df-ba194413f660 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:04.379867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bba92d4a-145b-45d0-89df-ba194413f660 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:04.405224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bba92d4a-145b-45d0-89df-ba194413f660 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:04.406344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bba92d4a-145b-45d0-89df-ba194413f660 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:04.406965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bba92d4a-145b-45d0-89df-ba194413f660 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:04.490761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0991a138-fff2-4e24-a5a6-3e3bfbbe639a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:04.511241 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0991a138-fff2-4e24-a5a6-3e3bfbbe639a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.371550 Feb 19 21:09:04.512191 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2005/4131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:04 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:04.683428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bba92d4a-145b-45d0-89df-ba194413f660 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:04.697645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bba92d4a-145b-45d0-89df-ba194413f660 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.337731 Feb 19 21:09:04.698866 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2127/4132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:04 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:04.864515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d10f4b9-7ffa-4e29-a020-28429e43f17c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:04.866648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d10f4b9-7ffa-4e29-a020-28429e43f17c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] [instance: 5340f4f1-b817-484c-a352-a4452e9a3b5d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:04.881597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d10f4b9-7ffa-4e29-a020-28429e43f17c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:04.882137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d10f4b9-7ffa-4e29-a020-28429e43f17c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:04.883106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d10f4b9-7ffa-4e29-a020-28429e43f17c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:04.883638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d10f4b9-7ffa-4e29-a020-28429e43f17c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:04.911413 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8d10f4b9-7ffa-4e29-a020-28429e43f17c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] HTTP exception thrown: Instance 5340f4f1-b817-484c-a352-a4452e9a3b5d could not be found. Feb 19 21:09:04.914285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d10f4b9-7ffa-4e29-a020-28429e43f17c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] Returning 404 to user: Instance 5340f4f1-b817-484c-a352-a4452e9a3b5d could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:09:04.917224 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d10f4b9-7ffa-4e29-a020-28429e43f17c tempest-VolumesSnapshotTestJSON-2140298196 tempest-VolumesSnapshotTestJSON-2140298196-project] 10.222.0.30 "GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d" status: 404 len: 111 microversion: 2.1 time: 0.063917 Feb 19 21:09:04.920521 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2006/4133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:04 2022] GET /compute/v2.1/servers/5340f4f1-b817-484c-a352-a4452e9a3b5d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:05.535469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-48a0b993-1c1d-4d78-b251-ffa38c7fb835 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:05.537599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-48a0b993-1c1d-4d78-b251-ffa38c7fb835 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:05.549920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48a0b993-1c1d-4d78-b251-ffa38c7fb835 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:05.550558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48a0b993-1c1d-4d78-b251-ffa38c7fb835 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:05.552115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48a0b993-1c1d-4d78-b251-ffa38c7fb835 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:05.553433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48a0b993-1c1d-4d78-b251-ffa38c7fb835 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:05.726806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4e9f3fdd-93b0-4af6-bc5b-6dbd650bff42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:05.729714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4e9f3fdd-93b0-4af6-bc5b-6dbd650bff42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:05.759641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e9f3fdd-93b0-4af6-bc5b-6dbd650bff42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:05.760602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e9f3fdd-93b0-4af6-bc5b-6dbd650bff42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:05.761846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e9f3fdd-93b0-4af6-bc5b-6dbd650bff42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:05.762358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e9f3fdd-93b0-4af6-bc5b-6dbd650bff42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:05.912264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-48a0b993-1c1d-4d78-b251-ffa38c7fb835 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:05.922117 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-48a0b993-1c1d-4d78-b251-ffa38c7fb835 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1679 microversion: 2.1 time: 0.396771 Feb 19 21:09:05.922724 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2128/4134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:05 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1679 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:06.038988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4e9f3fdd-93b0-4af6-bc5b-6dbd650bff42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:06.051472 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4e9f3fdd-93b0-4af6-bc5b-6dbd650bff42 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.331558 Feb 19 21:09:06.052743 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2007/4135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:05 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:06.939950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5d4c121d-7d46-42f3-b101-4779ecc99e47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:06.940661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5d4c121d-7d46-42f3-b101-4779ecc99e47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:06.949140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d4c121d-7d46-42f3-b101-4779ecc99e47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:06.949267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d4c121d-7d46-42f3-b101-4779ecc99e47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:06.950039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d4c121d-7d46-42f3-b101-4779ecc99e47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:06.950476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d4c121d-7d46-42f3-b101-4779ecc99e47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:07.070167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4029060-e089-4e4e-be95-3cb22ee0c2f2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:07.070937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c4029060-e089-4e4e-be95-3cb22ee0c2f2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:07.081352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4029060-e089-4e4e-be95-3cb22ee0c2f2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:07.082194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4029060-e089-4e4e-be95-3cb22ee0c2f2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:07.084169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4029060-e089-4e4e-be95-3cb22ee0c2f2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:07.085044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4029060-e089-4e4e-be95-3cb22ee0c2f2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:07.207758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5d4c121d-7d46-42f3-b101-4779ecc99e47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:07.222482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5d4c121d-7d46-42f3-b101-4779ecc99e47 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1656 microversion: 2.1 time: 0.286602 Feb 19 21:09:07.223066 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2129/4136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:06 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1656 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:07.242006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a8335a92-623d-4787-aea1-1125b78d0b99 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:07.248957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8335a92-623d-4787-aea1-1125b78d0b99 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:07.249765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8335a92-623d-4787-aea1-1125b78d0b99 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:07.290695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a8335a92-623d-4787-aea1-1125b78d0b99 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Going to try to start instance {{(pid=136094) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 19 21:09:07.303538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4029060-e089-4e4e-be95-3cb22ee0c2f2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:07.321605 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c4029060-e089-4e4e-be95-3cb22ee0c2f2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.255735 Feb 19 21:09:07.322203 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2008/4137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:07 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:07.387736 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a8335a92-623d-4787-aea1-1125b78d0b99 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.149608 Feb 19 21:09:07.389049 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2130/4138] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:09:07 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:09:07.399961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce4ac3de-0bf3-40a4-9d4c-bc4fd69453a3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:07.400963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ce4ac3de-0bf3-40a4-9d4c-bc4fd69453a3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:07.409384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce4ac3de-0bf3-40a4-9d4c-bc4fd69453a3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:07.410203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce4ac3de-0bf3-40a4-9d4c-bc4fd69453a3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:07.411817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce4ac3de-0bf3-40a4-9d4c-bc4fd69453a3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:07.413014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce4ac3de-0bf3-40a4-9d4c-bc4fd69453a3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:07.653775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ce4ac3de-0bf3-40a4-9d4c-bc4fd69453a3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:07.664376 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ce4ac3de-0bf3-40a4-9d4c-bc4fd69453a3 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1665 microversion: 2.1 time: 0.270947 Feb 19 21:09:07.666092 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2009/4139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:07 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1665 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:08.339845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-692cecce-4c9f-4659-8220-330b44fd4ce1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:08.340693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-692cecce-4c9f-4659-8220-330b44fd4ce1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:08.350312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-692cecce-4c9f-4659-8220-330b44fd4ce1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:08.350771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-692cecce-4c9f-4659-8220-330b44fd4ce1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:08.351644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-692cecce-4c9f-4659-8220-330b44fd4ce1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:08.352185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-692cecce-4c9f-4659-8220-330b44fd4ce1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:08.593322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-692cecce-4c9f-4659-8220-330b44fd4ce1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:08.603620 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-692cecce-4c9f-4659-8220-330b44fd4ce1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1523 microversion: 2.1 time: 0.268617 Feb 19 21:09:08.604859 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2131/4140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:08 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:08.686241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0cb53464-32a6-4b05-bc67-adca7165f7b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:08.695498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0cb53464-32a6-4b05-bc67-adca7165f7b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:08.702338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cb53464-32a6-4b05-bc67-adca7165f7b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:08.711804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cb53464-32a6-4b05-bc67-adca7165f7b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:08.712949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cb53464-32a6-4b05-bc67-adca7165f7b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:08.713584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cb53464-32a6-4b05-bc67-adca7165f7b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:09.092547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0cb53464-32a6-4b05-bc67-adca7165f7b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:09.113069 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0cb53464-32a6-4b05-bc67-adca7165f7b7 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1665 microversion: 2.1 time: 0.433820 Feb 19 21:09:09.113948 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2010/4141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:08 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1665 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:09.622141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ae2ea3d3-9f27-4fec-94c7-0ac6d9bf1bb8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:09.622752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae2ea3d3-9f27-4fec-94c7-0ac6d9bf1bb8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:09.630699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae2ea3d3-9f27-4fec-94c7-0ac6d9bf1bb8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:09.631174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae2ea3d3-9f27-4fec-94c7-0ac6d9bf1bb8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:09.632174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae2ea3d3-9f27-4fec-94c7-0ac6d9bf1bb8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:09.632780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae2ea3d3-9f27-4fec-94c7-0ac6d9bf1bb8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:09.849669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ae2ea3d3-9f27-4fec-94c7-0ac6d9bf1bb8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:09.861995 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ae2ea3d3-9f27-4fec-94c7-0ac6d9bf1bb8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1505 microversion: 2.1 time: 0.243728 Feb 19 21:09:09.863303 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2132/4142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:09 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:10.132017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d6ba43f-4d81-418e-bab6-ecea58205c64 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:10.132725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d6ba43f-4d81-418e-bab6-ecea58205c64 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:10.139914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6ba43f-4d81-418e-bab6-ecea58205c64 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.140450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6ba43f-4d81-418e-bab6-ecea58205c64 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:10.141254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6ba43f-4d81-418e-bab6-ecea58205c64 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.141753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d6ba43f-4d81-418e-bab6-ecea58205c64 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:10.348283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8d6ba43f-4d81-418e-bab6-ecea58205c64 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:10.358652 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d6ba43f-4d81-418e-bab6-ecea58205c64 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.230999 Feb 19 21:09:10.375527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f22464d4-2429-42c4-b2e1-4a2a12b22732 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:10.376141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f22464d4-2429-42c4-b2e1-4a2a12b22732 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:10.378724 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2011/4143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:10 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:10.382245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f22464d4-2429-42c4-b2e1-4a2a12b22732 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.382916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f22464d4-2429-42c4-b2e1-4a2a12b22732 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:10.383774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f22464d4-2429-42c4-b2e1-4a2a12b22732 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.384365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f22464d4-2429-42c4-b2e1-4a2a12b22732 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:10.560240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f22464d4-2429-42c4-b2e1-4a2a12b22732 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:10.574171 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f22464d4-2429-42c4-b2e1-4a2a12b22732 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.202124 Feb 19 21:09:10.575205 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2133/4144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:10 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:10.598144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-00639a79-7361-49f9-8db0-eda296bdc404 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:10.599734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-00639a79-7361-49f9-8db0-eda296bdc404 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:10.608132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00639a79-7361-49f9-8db0-eda296bdc404 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.608621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00639a79-7361-49f9-8db0-eda296bdc404 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:10.616081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00639a79-7361-49f9-8db0-eda296bdc404 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.616572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00639a79-7361-49f9-8db0-eda296bdc404 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:10.830519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-00639a79-7361-49f9-8db0-eda296bdc404 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:10.838598 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-00639a79-7361-49f9-8db0-eda296bdc404 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.246527 Feb 19 21:09:10.839807 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2012/4145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:10 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:10.855291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4e924293-7f70-4156-93f5-397ee5773990 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:10.855862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4e924293-7f70-4156-93f5-397ee5773990 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:10.866453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e924293-7f70-4156-93f5-397ee5773990 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.867484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e924293-7f70-4156-93f5-397ee5773990 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:10.869022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e924293-7f70-4156-93f5-397ee5773990 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.869849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e924293-7f70-4156-93f5-397ee5773990 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:10.881187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a49e4c40-4323-40de-93af-a732736174a1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:10.882125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a49e4c40-4323-40de-93af-a732736174a1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:10.891916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a49e4c40-4323-40de-93af-a732736174a1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.892659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a49e4c40-4323-40de-93af-a732736174a1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:10.893675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a49e4c40-4323-40de-93af-a732736174a1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:10.894421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a49e4c40-4323-40de-93af-a732736174a1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:11.190619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a49e4c40-4323-40de-93af-a732736174a1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:11.200850 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a49e4c40-4323-40de-93af-a732736174a1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1505 microversion: 2.1 time: 0.323777 Feb 19 21:09:11.201461 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2013/4146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:10 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:11.202602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4e924293-7f70-4156-93f5-397ee5773990 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:11.215764 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4e924293-7f70-4156-93f5-397ee5773990 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.364311 Feb 19 21:09:11.216546 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2134/4147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:10 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:11.232090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-069dbd59-fbcc-48b8-bbce-77b868ca7830 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:11.233324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-069dbd59-fbcc-48b8-bbce-77b868ca7830 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:11.245337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-069dbd59-fbcc-48b8-bbce-77b868ca7830 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:11.246303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-069dbd59-fbcc-48b8-bbce-77b868ca7830 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:11.247423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-069dbd59-fbcc-48b8-bbce-77b868ca7830 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:11.248094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-069dbd59-fbcc-48b8-bbce-77b868ca7830 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:11.395999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f5526543-0ec7-4f88-b365-f1dc2658115c req-e63dd85b-b8f5-403c-8132-4dfb01244cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f620150-4262-4d39-9937-e1f00ea04a88", "name": "network-vif-unplugged", "status": "completed", "tag": "d8970ddf-bb4f-4a41-8cb2-0ed56b52ff6e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:11.401604 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:11.401604 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:09:11.421666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f5526543-0ec7-4f88-b365-f1dc2658115c req-e63dd85b-b8f5-403c-8132-4dfb01244cec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:11.424040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f5526543-0ec7-4f88-b365-f1dc2658115c req-e63dd85b-b8f5-403c-8132-4dfb01244cec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:11.431223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-069dbd59-fbcc-48b8-bbce-77b868ca7830 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:11.441915 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-069dbd59-fbcc-48b8-bbce-77b868ca7830 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.213902 Feb 19 21:09:11.444003 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2014/4148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:11 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:11.462221 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f5526543-0ec7-4f88-b365-f1dc2658115c req-e63dd85b-b8f5-403c-8132-4dfb01244cec service nova] Creating event network-vif-unplugged:d8970ddf-bb4f-4a41-8cb2-0ed56b52ff6e for instance 6f620150-4262-4d39-9937-e1f00ea04a88 on nch1-master-1 Feb 19 21:09:11.475478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e6d4d595-3850-4af3-b6ae-d6ddd07f41a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:11.476243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e6d4d595-3850-4af3-b6ae-d6ddd07f41a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:11.478293 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f5526543-0ec7-4f88-b365-f1dc2658115c req-e63dd85b-b8f5-403c-8132-4dfb01244cec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101456 Feb 19 21:09:11.481064 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2135/4149] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:11.485125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d4d595-3850-4af3-b6ae-d6ddd07f41a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:11.487116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d4d595-3850-4af3-b6ae-d6ddd07f41a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:11.488033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d4d595-3850-4af3-b6ae-d6ddd07f41a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:11.488781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d4d595-3850-4af3-b6ae-d6ddd07f41a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:11.518889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-e6d4d595-3850-4af3-b6ae-d6ddd07f41a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lazy-loading 'flavor' on Instance uuid 17a82db1-c267-4dcd-97c5-10fac191c0a2 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:09:11.617811 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e6d4d595-3850-4af3-b6ae-d6ddd07f41a4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.146895 Feb 19 21:09:11.618818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2015/4150] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:09:11 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:09:11.627233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-903d5695-0a3a-45e8-a7c3-e2fa877d9960 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:11.628143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-903d5695-0a3a-45e8-a7c3-e2fa877d9960 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:11.635240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-903d5695-0a3a-45e8-a7c3-e2fa877d9960 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:11.635806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-903d5695-0a3a-45e8-a7c3-e2fa877d9960 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:11.637119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-903d5695-0a3a-45e8-a7c3-e2fa877d9960 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:11.637506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-903d5695-0a3a-45e8-a7c3-e2fa877d9960 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:11.854065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-903d5695-0a3a-45e8-a7c3-e2fa877d9960 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:11.865484 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-903d5695-0a3a-45e8-a7c3-e2fa877d9960 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1677 microversion: 2.1 time: 0.239658 Feb 19 21:09:11.865484 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2136/4151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:11 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1677 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:12.221544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-91fdc312-f378-4961-9d0b-9bc8e761e55b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:12.222309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-91fdc312-f378-4961-9d0b-9bc8e761e55b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:12.229680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91fdc312-f378-4961-9d0b-9bc8e761e55b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:12.230137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91fdc312-f378-4961-9d0b-9bc8e761e55b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:12.230941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91fdc312-f378-4961-9d0b-9bc8e761e55b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:12.231574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91fdc312-f378-4961-9d0b-9bc8e761e55b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:12.391478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91fdc312-f378-4961-9d0b-9bc8e761e55b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:12.400596 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-91fdc312-f378-4961-9d0b-9bc8e761e55b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 200 len: 1448 microversion: 2.1 time: 0.185196 Feb 19 21:09:12.401305 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2016/4152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:12 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 1448 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:12.417533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:12.418036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:12.424176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:12.424609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:12.425421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:12.425860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:12.456739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:09:12.463999 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.compute.api [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Working on deleting snapshot 24656f49-f849-46db-bce0-9e279c8641ce from shelved instance... Feb 19 21:09:12.882039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fa855c08-ac5c-4bbb-bd42-15ca6eacdd2d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:12.883003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fa855c08-ac5c-4bbb-bd42-15ca6eacdd2d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:12.889847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa855c08-ac5c-4bbb-bd42-15ca6eacdd2d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:12.890598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa855c08-ac5c-4bbb-bd42-15ca6eacdd2d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:12.893092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa855c08-ac5c-4bbb-bd42-15ca6eacdd2d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:12.894283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa855c08-ac5c-4bbb-bd42-15ca6eacdd2d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:13.137463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fa855c08-ac5c-4bbb-bd42-15ca6eacdd2d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:13.149672 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fa855c08-ac5c-4bbb-bd42-15ca6eacdd2d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1660 microversion: 2.1 time: 0.271997 Feb 19 21:09:13.150789 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2017/4153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:12 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1660 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:13.169087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3e2ee349-0605-43ad-8b16-ac6cc0043a13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:13.169661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3e2ee349-0605-43ad-8b16-ac6cc0043a13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:13.179913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e2ee349-0605-43ad-8b16-ac6cc0043a13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:13.181839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e2ee349-0605-43ad-8b16-ac6cc0043a13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:13.183659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e2ee349-0605-43ad-8b16-ac6cc0043a13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:13.184686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e2ee349-0605-43ad-8b16-ac6cc0043a13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:13.326784 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3e2ee349-0605-43ad-8b16-ac6cc0043a13 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.162093 Feb 19 21:09:13.329048 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2018/4154] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:09:13 2022] POST /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:09:13.329841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Doing local delete in cell 661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) {{(pid=136094) _delete /opt/stack/nova/nova/compute/api.py:2439}} Feb 19 21:09:13.330762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:13.331229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:13.339129 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.compute.api [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Feb 19 21:09:13.345009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] deallocate_for_instance() {{(pid=136094) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1790}} Feb 19 21:09:13.354931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aee86a34-3bda-4ef9-920e-be01a609b37a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:13.358597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aee86a34-3bda-4ef9-920e-be01a609b37a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:13.410089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aee86a34-3bda-4ef9-920e-be01a609b37a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:13.410089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aee86a34-3bda-4ef9-920e-be01a609b37a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:13.410089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aee86a34-3bda-4ef9-920e-be01a609b37a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:13.410089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aee86a34-3bda-4ef9-920e-be01a609b37a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:13.852007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aee86a34-3bda-4ef9-920e-be01a609b37a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:13.866179 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aee86a34-3bda-4ef9-920e-be01a609b37a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1666 microversion: 2.1 time: 0.524564 Feb 19 21:09:13.866730 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2019/4155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:13 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1666 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:14.369826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Updating instance_info_cache with network_info: [] {{(pid=136094) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 21:09:14.380194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5b9c08fc-22d6-4b8d-947a-e821181c686d req-202f2769-ab9e-4302-a474-ae8e33016774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f620150-4262-4d39-9937-e1f00ea04a88", "name": "network-vif-deleted", "tag": "d8970ddf-bb4f-4a41-8cb2-0ed56b52ff6e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:14.381755 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:14.381755 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:09:14.392961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5b9c08fc-22d6-4b8d-947a-e821181c686d req-202f2769-ab9e-4302-a474-ae8e33016774 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:14.393588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5b9c08fc-22d6-4b8d-947a-e821181c686d req-202f2769-ab9e-4302-a474-ae8e33016774 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:14.428140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.compute.server_external_events [req-5b9c08fc-22d6-4b8d-947a-e821181c686d req-202f2769-ab9e-4302-a474-ae8e33016774 service nova] Unable to find a host for instance 6f620150-4262-4d39-9937-e1f00ea04a88. Dropping event network-vif-deleted {{(pid=136095) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 19 21:09:14.435780 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5b9c08fc-22d6-4b8d-947a-e821181c686d req-202f2769-ab9e-4302-a474-ae8e33016774 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.059191 Feb 19 21:09:14.436887 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2020/4156] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 19 21:09:14.636258 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-69cf907c-554a-4a9c-b576-85bc6c846f7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 204 len: 0 microversion: 2.1 time: 2.221264 Feb 19 21:09:14.637410 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2137/4157] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:09:12 2022] DELETE /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 0 bytes in 2224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:09:14.645350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19c8a139-bb73-4d8d-947b-b1c80b0b2514 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:14.647240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-19c8a139-bb73-4d8d-947b-b1c80b0b2514 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:14.659335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19c8a139-bb73-4d8d-947b-b1c80b0b2514 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:14.659791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19c8a139-bb73-4d8d-947b-b1c80b0b2514 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:14.660898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19c8a139-bb73-4d8d-947b-b1c80b0b2514 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:14.664967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-19c8a139-bb73-4d8d-947b-b1c80b0b2514 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:14.686879 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-19c8a139-bb73-4d8d-947b-b1c80b0b2514 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 6f620150-4262-4d39-9937-e1f00ea04a88 could not be found. Feb 19 21:09:14.688098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-19c8a139-bb73-4d8d-947b-b1c80b0b2514 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 6f620150-4262-4d39-9937-e1f00ea04a88 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:09:14.689810 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-19c8a139-bb73-4d8d-947b-b1c80b0b2514 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 404 len: 111 microversion: 2.1 time: 0.047855 Feb 19 21:09:14.690779 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2021/4158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:14 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:14.861696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2004607724", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "be9178cb-fadc-423e-95e2-979af3a2f95e"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:14.887085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-199c0c38-b3a7-49a7-b699-8cb802df337a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:14.887396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-199c0c38-b3a7-49a7-b699-8cb802df337a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:14.894737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-199c0c38-b3a7-49a7-b699-8cb802df337a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:14.895121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-199c0c38-b3a7-49a7-b699-8cb802df337a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:14.896576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-199c0c38-b3a7-49a7-b699-8cb802df337a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:14.897019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-199c0c38-b3a7-49a7-b699-8cb802df337a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:14.943493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] validate_networks() for [('be9178cb-fadc-423e-95e2-979af3a2f95e', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:09:15.329803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-199c0c38-b3a7-49a7-b699-8cb802df337a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:15.339981 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-199c0c38-b3a7-49a7-b699-8cb802df337a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1666 microversion: 2.1 time: 0.458189 Feb 19 21:09:15.340704 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2022/4159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:14 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1666 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:16.022305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:09:16.023337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:09:16.023597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:09:16.024103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:09:16.024763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:09:16.040352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:16.041015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:16.042177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:16.042841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:16.083610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:09:16.094286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for user 20246495a35b4762be5b2ad98f537377 and project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:09:16.128862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:09:16.133352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:09:16.199180 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-417174b9-20c3-49f8-989a-984711675642 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341668 Feb 19 21:09:16.199848 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2138/4160] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:09:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:09:16.210832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5e1c8af4-2836-4f90-bfac-300768482290 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:16.211450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5e1c8af4-2836-4f90-bfac-300768482290 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:16.338347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5e1c8af4-2836-4f90-bfac-300768482290 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:16.348602 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5e1c8af4-2836-4f90-bfac-300768482290 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1215 microversion: 2.1 time: 0.142398 Feb 19 21:09:16.350515 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2023/4161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:16 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:16.363502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-78c736a3-a476-4d1c-b636-27093ff2d319 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:16.364365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-78c736a3-a476-4d1c-b636-27093ff2d319 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:16.373559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78c736a3-a476-4d1c-b636-27093ff2d319 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:16.374389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78c736a3-a476-4d1c-b636-27093ff2d319 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:16.375036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78c736a3-a476-4d1c-b636-27093ff2d319 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:16.375654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78c736a3-a476-4d1c-b636-27093ff2d319 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:16.578206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-78c736a3-a476-4d1c-b636-27093ff2d319 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:16.587986 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-78c736a3-a476-4d1c-b636-27093ff2d319 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.228273 Feb 19 21:09:16.589248 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2139/4162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:16 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:16.606296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4574319-1422-45ba-82c4-e4e6fa369721 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:16.607219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e4574319-1422-45ba-82c4-e4e6fa369721 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:16.615335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4574319-1422-45ba-82c4-e4e6fa369721 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:16.615794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4574319-1422-45ba-82c4-e4e6fa369721 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:16.616882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4574319-1422-45ba-82c4-e4e6fa369721 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:16.617704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4574319-1422-45ba-82c4-e4e6fa369721 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:16.809814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e4574319-1422-45ba-82c4-e4e6fa369721 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:16.822174 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e4574319-1422-45ba-82c4-e4e6fa369721 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1669 microversion: 2.1 time: 0.219777 Feb 19 21:09:16.823835 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2024/4163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:16 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1669 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:16.842595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:16.843155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:16.849959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:16.850587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:16.851421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:16.851859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:16.881305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:09:16.888619 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.compute.api [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Working on deleting snapshot bca6d1f6-a877-43e4-a9f9-5c1f07dce8eb from shelved instance... Feb 19 21:09:17.384562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f3bdcdc0-3fec-45bb-b35d-622b1edbde14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:17.392644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f3bdcdc0-3fec-45bb-b35d-622b1edbde14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:17.437427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3bdcdc0-3fec-45bb-b35d-622b1edbde14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:17.438331 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3bdcdc0-3fec-45bb-b35d-622b1edbde14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:17.442182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3bdcdc0-3fec-45bb-b35d-622b1edbde14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:17.442182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3bdcdc0-3fec-45bb-b35d-622b1edbde14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:17.577132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f3bdcdc0-3fec-45bb-b35d-622b1edbde14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:17.600213 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f3bdcdc0-3fec-45bb-b35d-622b1edbde14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1267 microversion: 2.1 time: 0.230698 Feb 19 21:09:17.601611 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2025/4164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:17 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:17.730178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Doing local delete in cell 661a85a5-95ec-46b3-ad66-d3bc04fb7064(cell1) {{(pid=136094) _delete /opt/stack/nova/nova/compute/api.py:2439}} Feb 19 21:09:17.731020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:17.731505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:17.736964 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.compute.api [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Feb 19 21:09:17.743505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] deallocate_for_instance() {{(pid=136094) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1790}} Feb 19 21:09:18.060122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-12e5300c-95f6-4fb5-9115-0a88edc29231 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:18.060791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-12e5300c-95f6-4fb5-9115-0a88edc29231 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:18.069258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12e5300c-95f6-4fb5-9115-0a88edc29231 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:18.070024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12e5300c-95f6-4fb5-9115-0a88edc29231 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:18.071028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12e5300c-95f6-4fb5-9115-0a88edc29231 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:18.071660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12e5300c-95f6-4fb5-9115-0a88edc29231 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:18.108461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-12e5300c-95f6-4fb5-9115-0a88edc29231 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lazy-loading 'flavor' on Instance uuid 9598d4a9-3a39-4e96-b6ea-d437e2050247 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:09:18.491810 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-12e5300c-95f6-4fb5-9115-0a88edc29231 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/action" status: 202 len: 0 microversion: 2.20 time: 0.888182 Feb 19 21:09:18.493436 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2026/4165] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 21:09:17 2022] POST /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/action => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:09:18.506276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:18.508557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:18.516420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:18.517374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:18.518630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:18.519283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:19.118805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Updating instance_info_cache with network_info: [] {{(pid=136094) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 19 21:09:19.149329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:19.171702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:19.181286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:19.188662 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e241dbcd-318f-4722-9256-a9f81918f1cb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.688495 Feb 19 21:09:19.189764 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2027/4166] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:18 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:19.196618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-87b060e0-e44d-4787-8e6a-42630e168827 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:19.197246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-87b060e0-e44d-4787-8e6a-42630e168827 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:19.221632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87b060e0-e44d-4787-8e6a-42630e168827 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:19.225128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87b060e0-e44d-4787-8e6a-42630e168827 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:19.226334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87b060e0-e44d-4787-8e6a-42630e168827 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:19.226981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87b060e0-e44d-4787-8e6a-42630e168827 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:19.425672 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a2ee2207-f7c7-429b-92c9-d51d2a07e64f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 204 len: 0 microversion: 2.1 time: 2.585184 Feb 19 21:09:19.428290 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2140/4167] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:09:16 2022] DELETE /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 0 bytes in 2591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:09:19.445550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-026a95b0-480e-44f8-8db5-b34831998d9f req-b7ecca51-96cf-4cc1-b5a4-f695e16e9f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee0c1d6-4d26-4bb6-bf2b-83054efe676c", "name": "network-vif-deleted", "tag": "761a57e3-c4a5-4caf-8b79-ab7836b14ef0"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:19.451147 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:19.451147 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:09:19.473682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-026a95b0-480e-44f8-8db5-b34831998d9f req-b7ecca51-96cf-4cc1-b5a4-f695e16e9f91 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:19.475080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-026a95b0-480e-44f8-8db5-b34831998d9f req-b7ecca51-96cf-4cc1-b5a4-f695e16e9f91 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:19.518000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.compute.server_external_events [req-026a95b0-480e-44f8-8db5-b34831998d9f req-b7ecca51-96cf-4cc1-b5a4-f695e16e9f91 service nova] Unable to find a host for instance 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c. Dropping event network-vif-deleted {{(pid=136094) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 19 21:09:19.522313 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-026a95b0-480e-44f8-8db5-b34831998d9f req-b7ecca51-96cf-4cc1-b5a4-f695e16e9f91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.087574 Feb 19 21:09:19.523056 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2141/4168] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 19 21:09:19.528528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0806f82d-3422-4f3c-9119-152a67013bda tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:19.532261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0806f82d-3422-4f3c-9119-152a67013bda tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:19.551562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0806f82d-3422-4f3c-9119-152a67013bda tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:19.553943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0806f82d-3422-4f3c-9119-152a67013bda tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:19.557948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0806f82d-3422-4f3c-9119-152a67013bda tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:19.558533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0806f82d-3422-4f3c-9119-152a67013bda tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:19.579158 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0806f82d-3422-4f3c-9119-152a67013bda tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] HTTP exception thrown: Instance 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c could not be found. Feb 19 21:09:19.579823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0806f82d-3422-4f3c-9119-152a67013bda tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Returning 404 to user: Instance 6ee0c1d6-4d26-4bb6-bf2b-83054efe676c could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:09:19.580809 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0806f82d-3422-4f3c-9119-152a67013bda tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c" status: 404 len: 111 microversion: 2.1 time: 0.056715 Feb 19 21:09:19.582340 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2142/4169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:19 2022] GET /compute/v2.1/servers/6ee0c1d6-4d26-4bb6-bf2b-83054efe676c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:19.595443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-132d7c50-3a0f-45e1-bc76-2057e041cd98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:19.595961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-132d7c50-3a0f-45e1-bc76-2057e041cd98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:19.632286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-132d7c50-3a0f-45e1-bc76-2057e041cd98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:19.634691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-87b060e0-e44d-4787-8e6a-42630e168827 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:19.636345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-132d7c50-3a0f-45e1-bc76-2057e041cd98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:19.639573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-132d7c50-3a0f-45e1-bc76-2057e041cd98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:19.640028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-132d7c50-3a0f-45e1-bc76-2057e041cd98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:19.647910 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-87b060e0-e44d-4787-8e6a-42630e168827 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.456587 Feb 19 21:09:19.651757 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2028/4170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:19 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:19.688666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-132d7c50-3a0f-45e1-bc76-2057e041cd98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:09:19.850511 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-132d7c50-3a0f-45e1-bc76-2057e041cd98 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 204 len: 0 microversion: 2.1 time: 0.262617 Feb 19 21:09:19.852389 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2143/4171] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:09:19 2022] DELETE /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:09:19.861535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-00ceefac-1f45-4e35-b8ef-8d2e9b5cc60c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:19.863400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-00ceefac-1f45-4e35-b8ef-8d2e9b5cc60c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:19.873290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00ceefac-1f45-4e35-b8ef-8d2e9b5cc60c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:19.874254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00ceefac-1f45-4e35-b8ef-8d2e9b5cc60c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:19.875354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00ceefac-1f45-4e35-b8ef-8d2e9b5cc60c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:19.876019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-00ceefac-1f45-4e35-b8ef-8d2e9b5cc60c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:20.187417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-00ceefac-1f45-4e35-b8ef-8d2e9b5cc60c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:20.207261 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-00ceefac-1f45-4e35-b8ef-8d2e9b5cc60c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1465 microversion: 2.1 time: 0.349639 Feb 19 21:09:20.210405 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2029/4172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:19 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1465 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:20.211984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:20.212965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:20.225849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:20.226625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:20.227513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:20.227902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:20.526982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:20.540425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:20.543316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:20.545279 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84f98975-a598-4a53-83af-7de071953465 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.338541 Feb 19 21:09:20.552380 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2144/4173] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:20 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:20.669820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3571c1e9-cf37-42c7-bd42-a17667c7a5c5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:20.670599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3571c1e9-cf37-42c7-bd42-a17667c7a5c5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:20.678894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3571c1e9-cf37-42c7-bd42-a17667c7a5c5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:20.679498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3571c1e9-cf37-42c7-bd42-a17667c7a5c5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:20.680858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3571c1e9-cf37-42c7-bd42-a17667c7a5c5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:20.681552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3571c1e9-cf37-42c7-bd42-a17667c7a5c5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:21.050795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3571c1e9-cf37-42c7-bd42-a17667c7a5c5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:21.066002 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3571c1e9-cf37-42c7-bd42-a17667c7a5c5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.400469 Feb 19 21:09:21.068126 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2030/4174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:20 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:21.227668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c1a835c-2599-4eb5-a4de-ea6522faa170 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:21.229185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7c1a835c-2599-4eb5-a4de-ea6522faa170 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:21.237047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c1a835c-2599-4eb5-a4de-ea6522faa170 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:21.238019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c1a835c-2599-4eb5-a4de-ea6522faa170 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:21.239759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c1a835c-2599-4eb5-a4de-ea6522faa170 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:21.240830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c1a835c-2599-4eb5-a4de-ea6522faa170 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:21.409674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7c1a835c-2599-4eb5-a4de-ea6522faa170 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:21.419066 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c1a835c-2599-4eb5-a4de-ea6522faa170 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1465 microversion: 2.1 time: 0.195498 Feb 19 21:09:21.420575 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2145/4175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:21 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1465 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:21.568045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:21.568974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:21.578711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:21.579575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:21.581160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:21.581949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:21.623647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-bf800b98-dc24-4d1b-b4b4-340de369b8c1 req-68a2c75d-1e1f-48c9-af56-b2456e43b43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366afc42-f8b8-4a45-99b9-f9203f39d3a5", "tag": "d0ef6ba9-dfd0-44f2-98db-eb48c1299a8e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:21.625223 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:21.625223 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:09:21.634437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bf800b98-dc24-4d1b-b4b4-340de369b8c1 req-68a2c75d-1e1f-48c9-af56-b2456e43b43b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:21.634882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bf800b98-dc24-4d1b-b4b4-340de369b8c1 req-68a2c75d-1e1f-48c9-af56-b2456e43b43b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:21.650181 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-bf800b98-dc24-4d1b-b4b4-340de369b8c1 req-68a2c75d-1e1f-48c9-af56-b2456e43b43b service nova] Creating event network-changed:d0ef6ba9-dfd0-44f2-98db-eb48c1299a8e for instance 366afc42-f8b8-4a45-99b9-f9203f39d3a5 on nch2-master-1 Feb 19 21:09:21.655811 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-bf800b98-dc24-4d1b-b4b4-340de369b8c1 req-68a2c75d-1e1f-48c9-af56-b2456e43b43b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036124 Feb 19 21:09:21.658161 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2146/4176] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:21.815789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:21.826261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:21.829852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:21.831972 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c4764ca1-1af4-4188-9fc2-8a96ea4eaebd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.270505 Feb 19 21:09:21.833120 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2031/4177] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:21 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:09:22.085737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-78a0e729-859f-4b4a-afee-911fdbad2155 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:22.086454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-78a0e729-859f-4b4a-afee-911fdbad2155 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:22.093976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78a0e729-859f-4b4a-afee-911fdbad2155 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:22.094876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78a0e729-859f-4b4a-afee-911fdbad2155 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:22.096106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78a0e729-859f-4b4a-afee-911fdbad2155 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:22.097025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78a0e729-859f-4b4a-afee-911fdbad2155 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:22.439763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bdd3707d-22dd-4842-b4e2-46383e07ce6a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:22.441154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bdd3707d-22dd-4842-b4e2-46383e07ce6a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:22.452485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdd3707d-22dd-4842-b4e2-46383e07ce6a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:22.455694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdd3707d-22dd-4842-b4e2-46383e07ce6a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:22.456937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdd3707d-22dd-4842-b4e2-46383e07ce6a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:22.458190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdd3707d-22dd-4842-b4e2-46383e07ce6a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:22.533088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-78a0e729-859f-4b4a-afee-911fdbad2155 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:22.542873 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-78a0e729-859f-4b4a-afee-911fdbad2155 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.462590 Feb 19 21:09:22.553543 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2147/4178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:22 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:22.637569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bdd3707d-22dd-4842-b4e2-46383e07ce6a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:22.653967 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bdd3707d-22dd-4842-b4e2-46383e07ce6a tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 200 len: 1465 microversion: 2.1 time: 0.220136 Feb 19 21:09:22.654532 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2032/4179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:22 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 1465 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:22.712039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-50d30d04-c878-4f1c-b009-fd2feeba5586 req-b2f31855-7fe4-4511-bc93-d62d523124ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73383da-8ceb-4cc4-86b1-1cbfd2fad4de", "name": "network-vif-deleted", "tag": "38bd6a80-55ef-4392-bd03-a78c89dcbf7e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:22.717214 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:22.717214 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:09:22.727715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-50d30d04-c878-4f1c-b009-fd2feeba5586 req-b2f31855-7fe4-4511-bc93-d62d523124ae service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:22.728279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-50d30d04-c878-4f1c-b009-fd2feeba5586 req-b2f31855-7fe4-4511-bc93-d62d523124ae service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:22.750596 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-50d30d04-c878-4f1c-b009-fd2feeba5586 req-b2f31855-7fe4-4511-bc93-d62d523124ae service nova] Creating event network-vif-deleted:38bd6a80-55ef-4392-bd03-a78c89dcbf7e for instance c73383da-8ceb-4cc4-86b1-1cbfd2fad4de on nch2-master-1 Feb 19 21:09:22.768860 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-50d30d04-c878-4f1c-b009-fd2feeba5586 req-b2f31855-7fe4-4511-bc93-d62d523124ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070285 Feb 19 21:09:22.773049 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2148/4180] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:22.850942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:22.852914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:22.861291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:22.861849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:22.862833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:22.863569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:23.121869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:23.132959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:23.134732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:23.137082 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-061fd45b-7c70-4766-9f37-bb0e9b480b1b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.289845 Feb 19 21:09:23.146696 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2033/4181] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:22 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:23.563342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a04d920f-9a14-4a7d-92e9-49f9bbb74328 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:23.564267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a04d920f-9a14-4a7d-92e9-49f9bbb74328 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:23.574417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a04d920f-9a14-4a7d-92e9-49f9bbb74328 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:23.575168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a04d920f-9a14-4a7d-92e9-49f9bbb74328 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:23.576585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a04d920f-9a14-4a7d-92e9-49f9bbb74328 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:23.577466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a04d920f-9a14-4a7d-92e9-49f9bbb74328 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:23.686354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-88a6be01-32eb-4ead-a418-795a51cb8692 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:23.687287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-88a6be01-32eb-4ead-a418-795a51cb8692 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: c73383da-8ceb-4cc4-86b1-1cbfd2fad4de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:23.706040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88a6be01-32eb-4ead-a418-795a51cb8692 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:23.711741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88a6be01-32eb-4ead-a418-795a51cb8692 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:23.712888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88a6be01-32eb-4ead-a418-795a51cb8692 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:23.716966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88a6be01-32eb-4ead-a418-795a51cb8692 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:23.745514 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-88a6be01-32eb-4ead-a418-795a51cb8692 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] HTTP exception thrown: Instance c73383da-8ceb-4cc4-86b1-1cbfd2fad4de could not be found. Feb 19 21:09:23.746956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-88a6be01-32eb-4ead-a418-795a51cb8692 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Returning 404 to user: Instance c73383da-8ceb-4cc4-86b1-1cbfd2fad4de could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:09:23.748734 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-88a6be01-32eb-4ead-a418-795a51cb8692 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de" status: 404 len: 111 microversion: 2.1 time: 0.070296 Feb 19 21:09:23.752555 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2034/4182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:23 2022] GET /compute/v2.1/servers/c73383da-8ceb-4cc4-86b1-1cbfd2fad4de => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:23.765338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-edf7a2a4-f34a-4f3f-b1d8-d6346382e4df tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:23.766543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-edf7a2a4-f34a-4f3f-b1d8-d6346382e4df tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:23.778542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edf7a2a4-f34a-4f3f-b1d8-d6346382e4df tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:23.779435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edf7a2a4-f34a-4f3f-b1d8-d6346382e4df tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:23.780825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edf7a2a4-f34a-4f3f-b1d8-d6346382e4df tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:23.781584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edf7a2a4-f34a-4f3f-b1d8-d6346382e4df tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:23.849155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-edf7a2a4-f34a-4f3f-b1d8-d6346382e4df tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:09:24.059424 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-edf7a2a4-f34a-4f3f-b1d8-d6346382e4df tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 204 len: 0 microversion: 2.1 time: 0.300137 Feb 19 21:09:24.060931 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2035/4183] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:09:23 2022] DELETE /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:09:24.093150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0e1b5380-824e-42cb-9a5e-a7135f544455 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:24.099238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0e1b5380-824e-42cb-9a5e-a7135f544455 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:24.113073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e1b5380-824e-42cb-9a5e-a7135f544455 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:24.113578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e1b5380-824e-42cb-9a5e-a7135f544455 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:24.114943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e1b5380-824e-42cb-9a5e-a7135f544455 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:24.117295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e1b5380-824e-42cb-9a5e-a7135f544455 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:24.209253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a04d920f-9a14-4a7d-92e9-49f9bbb74328 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:24.230000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a04d920f-9a14-4a7d-92e9-49f9bbb74328 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.672060 Feb 19 21:09:24.230862 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2149/4184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:23 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:24.240672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:24.240672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:24.250388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:24.251288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:24.253948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:24.254597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:24.425813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0e1b5380-824e-42cb-9a5e-a7135f544455 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:24.445295 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0e1b5380-824e-42cb-9a5e-a7135f544455 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1507 microversion: 2.1 time: 0.376180 Feb 19 21:09:24.451440 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2036/4185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:24 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:24.528294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:24.546457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:24.552509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:24.558351 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ef68479-8dac-4f30-ad0f-abcb20d8f453 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.325782 Feb 19 21:09:24.560523 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2150/4186] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:24 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:25.251115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-457e43a5-572d-47c7-804a-4469a22b064e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:25.251740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-457e43a5-572d-47c7-804a-4469a22b064e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:25.259565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-457e43a5-572d-47c7-804a-4469a22b064e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:25.259968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-457e43a5-572d-47c7-804a-4469a22b064e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:25.260975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-457e43a5-572d-47c7-804a-4469a22b064e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:25.261418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-457e43a5-572d-47c7-804a-4469a22b064e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:25.447516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-457e43a5-572d-47c7-804a-4469a22b064e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:25.466058 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-457e43a5-572d-47c7-804a-4469a22b064e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.218879 Feb 19 21:09:25.475738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f962445-8961-4415-a723-30b362f8af8f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:25.475738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3f962445-8961-4415-a723-30b362f8af8f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:25.477228 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2037/4187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:25 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:25.482631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f962445-8961-4415-a723-30b362f8af8f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:25.483090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f962445-8961-4415-a723-30b362f8af8f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:25.483885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f962445-8961-4415-a723-30b362f8af8f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:25.484413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f962445-8961-4415-a723-30b362f8af8f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:25.591828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:25.593120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:25.609446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:25.610612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:25.612370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:25.613351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:25.881713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3f962445-8961-4415-a723-30b362f8af8f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:25.896399 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f962445-8961-4415-a723-30b362f8af8f tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1507 microversion: 2.1 time: 0.431909 Feb 19 21:09:25.897521 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2151/4188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:25 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:26.129297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:26.144596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:26.149052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:26.150521 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c2301b8-9f07-4e21-804b-102e082da2c4 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.565066 Feb 19 21:09:26.169427 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2038/4189] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:25 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:26.350482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5bdea49e-43e1-495a-a396-bc410e24fc82 req-b2acb52b-022b-4239-9b46-c6d0464edbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8176c128-5636-4ef2-bb6e-0c2af96e882d", "name": "network-vif-deleted", "tag": "355bbacc-6aa0-48ce-94d5-58853a8dbe09"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:26.354264 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:26.354264 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:09:26.369805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5bdea49e-43e1-495a-a396-bc410e24fc82 req-b2acb52b-022b-4239-9b46-c6d0464edbe9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:26.374629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5bdea49e-43e1-495a-a396-bc410e24fc82 req-b2acb52b-022b-4239-9b46-c6d0464edbe9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:26.390119 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5bdea49e-43e1-495a-a396-bc410e24fc82 req-b2acb52b-022b-4239-9b46-c6d0464edbe9 service nova] Creating event network-vif-deleted:355bbacc-6aa0-48ce-94d5-58853a8dbe09 for instance 8176c128-5636-4ef2-bb6e-0c2af96e882d on nch1-master-1 Feb 19 21:09:26.397155 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5bdea49e-43e1-495a-a396-bc410e24fc82 req-b2acb52b-022b-4239-9b46-c6d0464edbe9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054887 Feb 19 21:09:26.397981 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2152/4190] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:26.485873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-164b2dcd-f565-4423-b095-62b320a1335e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:26.486499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-164b2dcd-f565-4423-b095-62b320a1335e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:26.500288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-164b2dcd-f565-4423-b095-62b320a1335e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:26.501804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-164b2dcd-f565-4423-b095-62b320a1335e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:26.503740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-164b2dcd-f565-4423-b095-62b320a1335e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:26.504592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-164b2dcd-f565-4423-b095-62b320a1335e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:26.715469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-164b2dcd-f565-4423-b095-62b320a1335e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:26.724611 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-164b2dcd-f565-4423-b095-62b320a1335e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.244151 Feb 19 21:09:26.736542 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2039/4191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:26 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:26.920274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:26.922977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:26.934118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:26.935679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:26.937271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:26.938222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:27.090220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:27.098937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:27.100795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lazy-loading 'fault' on Instance uuid 8176c128-5636-4ef2-bb6e-0c2af96e882d {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:09:27.183682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:27.186242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:27.194612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:27.194842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:27.195690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:27.196604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:27.197277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:27.209575 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-938a4c02-91cc-4a41-9fe8-fdfd19cced3e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 200 len: 1305 microversion: 2.1 time: 0.299013 Feb 19 21:09:27.210690 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2153/4192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:26 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 1305 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:27.374471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:27.384880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:27.387404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:27.389155 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c71197f-39aa-46df-b64c-4c4f8c1ee5bf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.222846 Feb 19 21:09:27.390499 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2040/4193] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:27 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:09:27.757193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4bc95897-2487-42bd-ab52-c7bb4edaa667 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:27.757802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4bc95897-2487-42bd-ab52-c7bb4edaa667 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:27.763727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4bc95897-2487-42bd-ab52-c7bb4edaa667 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:27.764174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4bc95897-2487-42bd-ab52-c7bb4edaa667 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:27.765002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4bc95897-2487-42bd-ab52-c7bb4edaa667 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:27.765440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4bc95897-2487-42bd-ab52-c7bb4edaa667 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:27.917078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4bc95897-2487-42bd-ab52-c7bb4edaa667 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:27.925438 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4bc95897-2487-42bd-ab52-c7bb4edaa667 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.171977 Feb 19 21:09:27.926823 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2154/4194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:27 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:28.230117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e7df2612-59ad-4ff4-9ce9-a8450b8c8fae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:28.231148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e7df2612-59ad-4ff4-9ce9-a8450b8c8fae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 8176c128-5636-4ef2-bb6e-0c2af96e882d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:28.242617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7df2612-59ad-4ff4-9ce9-a8450b8c8fae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.243303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7df2612-59ad-4ff4-9ce9-a8450b8c8fae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:28.244676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7df2612-59ad-4ff4-9ce9-a8450b8c8fae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.245427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7df2612-59ad-4ff4-9ce9-a8450b8c8fae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:28.269863 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-e7df2612-59ad-4ff4-9ce9-a8450b8c8fae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] HTTP exception thrown: Instance 8176c128-5636-4ef2-bb6e-0c2af96e882d could not be found. Feb 19 21:09:28.271189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e7df2612-59ad-4ff4-9ce9-a8450b8c8fae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Returning 404 to user: Instance 8176c128-5636-4ef2-bb6e-0c2af96e882d could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:09:28.272706 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e7df2612-59ad-4ff4-9ce9-a8450b8c8fae tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d" status: 404 len: 111 microversion: 2.1 time: 0.048641 Feb 19 21:09:28.273647 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2041/4195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:28 2022] GET /compute/v2.1/servers/8176c128-5636-4ef2-bb6e-0c2af96e882d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:28.283438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d1709866-9527-4710-86cd-c7a733cac28c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:28.283953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d1709866-9527-4710-86cd-c7a733cac28c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:28.291048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1709866-9527-4710-86cd-c7a733cac28c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.291501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1709866-9527-4710-86cd-c7a733cac28c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:28.292356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1709866-9527-4710-86cd-c7a733cac28c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.292788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1709866-9527-4710-86cd-c7a733cac28c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:28.344135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d1709866-9527-4710-86cd-c7a733cac28c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:09:28.410304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:28.411513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:28.425238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.426535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:28.429862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.432490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:28.489900 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d1709866-9527-4710-86cd-c7a733cac28c tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 204 len: 0 microversion: 2.1 time: 0.209706 Feb 19 21:09:28.491221 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2155/4196] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:09:28 2022] DELETE /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:09:28.500348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e92a8539-1170-48a3-8332-43f9ff0c8bce tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:28.501389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e92a8539-1170-48a3-8332-43f9ff0c8bce tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:28.507579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e92a8539-1170-48a3-8332-43f9ff0c8bce tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.508037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e92a8539-1170-48a3-8332-43f9ff0c8bce tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:28.509111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e92a8539-1170-48a3-8332-43f9ff0c8bce tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.509556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e92a8539-1170-48a3-8332-43f9ff0c8bce tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:28.760176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:28.771246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:28.772913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:28.774157 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dc2355ce-673e-4e63-9df1-5d94a17067d7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.368419 Feb 19 21:09:28.787448 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2042/4197] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:28 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:09:28.792906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e92a8539-1170-48a3-8332-43f9ff0c8bce tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:28.805434 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e92a8539-1170-48a3-8332-43f9ff0c8bce tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1495 microversion: 2.1 time: 0.309883 Feb 19 21:09:28.806238 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2156/4198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:28 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1495 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:28.943197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71969a80-433d-45f5-8637-a8875cba05cd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:28.943826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-71969a80-433d-45f5-8637-a8875cba05cd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:28.954254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71969a80-433d-45f5-8637-a8875cba05cd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.954915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71969a80-433d-45f5-8637-a8875cba05cd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:28.956190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71969a80-433d-45f5-8637-a8875cba05cd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:28.956939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71969a80-433d-45f5-8637-a8875cba05cd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:29.146921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-71969a80-433d-45f5-8637-a8875cba05cd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:29.167057 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71969a80-433d-45f5-8637-a8875cba05cd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.226917 Feb 19 21:09:29.170853 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2043/4199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:28 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:29.670944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9aaa6a0e-60a3-4e04-84c4-bc4471f9324d req-c6baa17c-3d78-4406-8ff4-d4f0ce3b1808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e428fbc5-f80a-4990-810a-97c7cbf53246", "name": "network-vif-deleted", "tag": "c58eb122-6243-45f8-9077-813f02b7493e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:29.672704 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:29.672704 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:09:29.682190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9aaa6a0e-60a3-4e04-84c4-bc4471f9324d req-c6baa17c-3d78-4406-8ff4-d4f0ce3b1808 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:29.682782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9aaa6a0e-60a3-4e04-84c4-bc4471f9324d req-c6baa17c-3d78-4406-8ff4-d4f0ce3b1808 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:29.724380 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9aaa6a0e-60a3-4e04-84c4-bc4471f9324d req-c6baa17c-3d78-4406-8ff4-d4f0ce3b1808 service nova] Creating event network-vif-deleted:c58eb122-6243-45f8-9077-813f02b7493e for instance e428fbc5-f80a-4990-810a-97c7cbf53246 on nch2-master-1 Feb 19 21:09:29.731016 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9aaa6a0e-60a3-4e04-84c4-bc4471f9324d req-c6baa17c-3d78-4406-8ff4-d4f0ce3b1808 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064349 Feb 19 21:09:29.732062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2157/4200] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:29.794458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:29.795772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:29.806113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:29.806579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:29.807479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:29.811940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:29.828122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:29.829184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:29.846721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:29.850481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:29.854015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:29.859149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:29.974684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:29.975287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:29.976842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lazy-loading 'fault' on Instance uuid e428fbc5-f80a-4990-810a-97c7cbf53246 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:09:30.085385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:30.107640 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-498998cc-8706-441a-8799-e76ede2dc6bb tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 200 len: 1305 microversion: 2.1 time: 0.283668 Feb 19 21:09:30.109093 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2158/4201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:29 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 1305 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:30.194404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:30.204533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:30.206708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:30.208897 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1f8750c0-46ba-4607-a4d2-51ea1bac92a8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.418588 Feb 19 21:09:30.210015 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2044/4202] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:29 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:30.219340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9bc9d707-3547-4755-98e2-8b67d4b3b311 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:30.221305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9bc9d707-3547-4755-98e2-8b67d4b3b311 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:30.226902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d3cb368f-d516-487c-ba32-e08beaf52ceb req-79545b13-5403-41ee-8485-05cb53855980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366afc42-f8b8-4a45-99b9-f9203f39d3a5", "name": "network-vif-plugged", "status": "completed", "tag": "d0ef6ba9-dfd0-44f2-98db-eb48c1299a8e"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:30.232898 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:30.232898 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:09:30.236430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bc9d707-3547-4755-98e2-8b67d4b3b311 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:30.237237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bc9d707-3547-4755-98e2-8b67d4b3b311 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:30.239121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bc9d707-3547-4755-98e2-8b67d4b3b311 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:30.239846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bc9d707-3547-4755-98e2-8b67d4b3b311 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:30.244316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d3cb368f-d516-487c-ba32-e08beaf52ceb req-79545b13-5403-41ee-8485-05cb53855980 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:30.245158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d3cb368f-d516-487c-ba32-e08beaf52ceb req-79545b13-5403-41ee-8485-05cb53855980 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:30.259713 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d3cb368f-d516-487c-ba32-e08beaf52ceb req-79545b13-5403-41ee-8485-05cb53855980 service nova] Creating event network-vif-plugged:d0ef6ba9-dfd0-44f2-98db-eb48c1299a8e for instance 366afc42-f8b8-4a45-99b9-f9203f39d3a5 on nch2-master-1 Feb 19 21:09:30.266109 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d3cb368f-d516-487c-ba32-e08beaf52ceb req-79545b13-5403-41ee-8485-05cb53855980 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054463 Feb 19 21:09:30.267331 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2045/4203] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:30.527004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9bc9d707-3547-4755-98e2-8b67d4b3b311 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:30.546997 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9bc9d707-3547-4755-98e2-8b67d4b3b311 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.352262 Feb 19 21:09:30.547975 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2159/4204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:30 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:31.131303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40aab2de-5e91-434b-a952-9ef94934a5ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:31.133396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-40aab2de-5e91-434b-a952-9ef94934a5ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: e428fbc5-f80a-4990-810a-97c7cbf53246] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:31.143794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40aab2de-5e91-434b-a952-9ef94934a5ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.144743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40aab2de-5e91-434b-a952-9ef94934a5ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.147263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40aab2de-5e91-434b-a952-9ef94934a5ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.148300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40aab2de-5e91-434b-a952-9ef94934a5ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.172901 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-40aab2de-5e91-434b-a952-9ef94934a5ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] HTTP exception thrown: Instance e428fbc5-f80a-4990-810a-97c7cbf53246 could not be found. Feb 19 21:09:31.173756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40aab2de-5e91-434b-a952-9ef94934a5ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Returning 404 to user: Instance e428fbc5-f80a-4990-810a-97c7cbf53246 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:09:31.174976 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-40aab2de-5e91-434b-a952-9ef94934a5ee tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246" status: 404 len: 111 microversion: 2.1 time: 0.051427 Feb 19 21:09:31.176000 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2046/4205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:31 2022] GET /compute/v2.1/servers/e428fbc5-f80a-4990-810a-97c7cbf53246 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:31.185480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-19d7fe06-af40-43c2-8e5c-3729f37a06c4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:31.186083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-19d7fe06-af40-43c2-8e5c-3729f37a06c4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:31.195046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19d7fe06-af40-43c2-8e5c-3729f37a06c4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.195510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19d7fe06-af40-43c2-8e5c-3729f37a06c4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.196313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19d7fe06-af40-43c2-8e5c-3729f37a06c4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.196789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-19d7fe06-af40-43c2-8e5c-3729f37a06c4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.228524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:31.229459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:31.235699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.236442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.237442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.238055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.244905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-19d7fe06-af40-43c2-8e5c-3729f37a06c4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:09:31.383498 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-19d7fe06-af40-43c2-8e5c-3729f37a06c4 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 204 len: 0 microversion: 2.1 time: 0.201358 Feb 19 21:09:31.385618 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2160/4206] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:09:31 2022] DELETE /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:09:31.396792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5bde6544-19c3-49c5-9e9e-042d94082602 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:31.398551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5bde6544-19c3-49c5-9e9e-042d94082602 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:31.408247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bde6544-19c3-49c5-9e9e-042d94082602 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.410718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bde6544-19c3-49c5-9e9e-042d94082602 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.412721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bde6544-19c3-49c5-9e9e-042d94082602 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.413562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bde6544-19c3-49c5-9e9e-042d94082602 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.581753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:31.593803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:31.597665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:31.603822 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-955f7881-d7d0-4caa-938f-3be4a86df60f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.376337 Feb 19 21:09:31.616625 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2047/4207] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:31 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:09:31.622574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-56f4c5d5-82cd-4b40-b4b7-74176baabe7c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:31.623498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-56f4c5d5-82cd-4b40-b4b7-74176baabe7c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:31.635160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56f4c5d5-82cd-4b40-b4b7-74176baabe7c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.636003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56f4c5d5-82cd-4b40-b4b7-74176baabe7c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.637527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56f4c5d5-82cd-4b40-b4b7-74176baabe7c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:31.639050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56f4c5d5-82cd-4b40-b4b7-74176baabe7c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:31.675709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5bde6544-19c3-49c5-9e9e-042d94082602 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:31.685404 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5bde6544-19c3-49c5-9e9e-042d94082602 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1675 microversion: 2.1 time: 0.295364 Feb 19 21:09:31.690842 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2161/4208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:31 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1675 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:31.837639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-56f4c5d5-82cd-4b40-b4b7-74176baabe7c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:31.852091 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-56f4c5d5-82cd-4b40-b4b7-74176baabe7c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1315 microversion: 2.1 time: 0.233560 Feb 19 21:09:31.862403 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2048/4209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:31 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:32.625340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:32.625994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:32.635091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:32.635726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:32.636910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:32.637758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:32.710155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e0ace0dc-1a58-41c3-9bdc-0119cb458f4d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:32.710895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e0ace0dc-1a58-41c3-9bdc-0119cb458f4d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:32.720374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0ace0dc-1a58-41c3-9bdc-0119cb458f4d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:32.721185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0ace0dc-1a58-41c3-9bdc-0119cb458f4d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:32.722268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0ace0dc-1a58-41c3-9bdc-0119cb458f4d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:32.722928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0ace0dc-1a58-41c3-9bdc-0119cb458f4d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:33.021447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:33.078892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:33.090357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:33.096798 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-80f7894c-d261-412f-bbe2-02a8240b3af2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.470508 Feb 19 21:09:33.097500 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2162/4210] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:32 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:33.121359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3b411bff-77b6-4fb5-a4c3-0540354a18e8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:33.121968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3b411bff-77b6-4fb5-a4c3-0540354a18e8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:33.151155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b411bff-77b6-4fb5-a4c3-0540354a18e8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:33.151444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b411bff-77b6-4fb5-a4c3-0540354a18e8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:33.152494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b411bff-77b6-4fb5-a4c3-0540354a18e8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:33.152934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b411bff-77b6-4fb5-a4c3-0540354a18e8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:33.171250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e0ace0dc-1a58-41c3-9bdc-0119cb458f4d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:33.180897 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e0ace0dc-1a58-41c3-9bdc-0119cb458f4d tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1675 microversion: 2.1 time: 0.477070 Feb 19 21:09:33.182144 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2049/4211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:32 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1675 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:33.332693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3b411bff-77b6-4fb5-a4c3-0540354a18e8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:33.342200 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3b411bff-77b6-4fb5-a4c3-0540354a18e8 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1501 microversion: 2.1 time: 0.224499 Feb 19 21:09:33.343266 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2163/4212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:33 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:33.361868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71f0864a-7bc6-486e-8a31-cd50962f614e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:33.368535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71f0864a-7bc6-486e-8a31-cd50962f614e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:33.369151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71f0864a-7bc6-486e-8a31-cd50962f614e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:33.406033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-71f0864a-7bc6-486e-8a31-cd50962f614e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Going to try to stop instance {{(pid=136095) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:09:33.470578 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71f0864a-7bc6-486e-8a31-cd50962f614e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5/action" status: 202 len: 0 microversion: 2.1 time: 0.111902 Feb 19 21:09:33.471210 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2050/4213] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:09:33 2022] POST /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:09:33.480496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8e60d0c0-7bad-4d7b-9a1c-8dc45e495e0c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:33.481464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8e60d0c0-7bad-4d7b-9a1c-8dc45e495e0c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:33.490955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e60d0c0-7bad-4d7b-9a1c-8dc45e495e0c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:33.491783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e60d0c0-7bad-4d7b-9a1c-8dc45e495e0c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:33.493561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e60d0c0-7bad-4d7b-9a1c-8dc45e495e0c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:33.494278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e60d0c0-7bad-4d7b-9a1c-8dc45e495e0c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:33.731528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8e60d0c0-7bad-4d7b-9a1c-8dc45e495e0c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:33.745176 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8e60d0c0-7bad-4d7b-9a1c-8dc45e495e0c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.268682 Feb 19 21:09:33.747134 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2164/4214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:33 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:34.133729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:34.136302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:34.154484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:34.154980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:34.155971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:34.156744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:34.204751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-81a2a1bc-ea13-4705-b3e5-3dec2f1ab815 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:34.204751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-81a2a1bc-ea13-4705-b3e5-3dec2f1ab815 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:34.230184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81a2a1bc-ea13-4705-b3e5-3dec2f1ab815 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:34.238885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81a2a1bc-ea13-4705-b3e5-3dec2f1ab815 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:34.244699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81a2a1bc-ea13-4705-b3e5-3dec2f1ab815 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:34.249048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-81a2a1bc-ea13-4705-b3e5-3dec2f1ab815 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:34.391383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-81a2a1bc-ea13-4705-b3e5-3dec2f1ab815 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:34.402979 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-81a2a1bc-ea13-4705-b3e5-3dec2f1ab815 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1607 microversion: 2.1 time: 0.203615 Feb 19 21:09:34.414133 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2165/4215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:34 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1607 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:34.536849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:34.570826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:34.579506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:34.588479 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-593279a0-6f32-492e-861e-0be66a743a45 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.461437 Feb 19 21:09:34.599160 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2051/4216] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:34 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:34.765697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9243a9e1-d022-48a2-b559-ae8b96d8dc3a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:34.767183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9243a9e1-d022-48a2-b559-ae8b96d8dc3a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:34.777178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9243a9e1-d022-48a2-b559-ae8b96d8dc3a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:34.777871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9243a9e1-d022-48a2-b559-ae8b96d8dc3a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:34.782246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9243a9e1-d022-48a2-b559-ae8b96d8dc3a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:34.784677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9243a9e1-d022-48a2-b559-ae8b96d8dc3a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:34.795264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e49ebe08-450c-4296-9070-cc096c845199 req-5e5e9ad2-05da-4e9f-adc6-ed7cbe371435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a82db1-c267-4dcd-97c5-10fac191c0a2", "name": "network-vif-deleted", "tag": "3af9d550-dac7-42d8-be63-467504951ed9"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:34.797976 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:34.797976 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:09:34.807550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e49ebe08-450c-4296-9070-cc096c845199 req-5e5e9ad2-05da-4e9f-adc6-ed7cbe371435 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:34.808732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e49ebe08-450c-4296-9070-cc096c845199 req-5e5e9ad2-05da-4e9f-adc6-ed7cbe371435 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:34.831453 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e49ebe08-450c-4296-9070-cc096c845199 req-5e5e9ad2-05da-4e9f-adc6-ed7cbe371435 service nova] Creating event network-vif-deleted:3af9d550-dac7-42d8-be63-467504951ed9 for instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 on nch2-master-1 Feb 19 21:09:34.843147 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e49ebe08-450c-4296-9070-cc096c845199 req-5e5e9ad2-05da-4e9f-adc6-ed7cbe371435 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051302 Feb 19 21:09:34.844268 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2052/4217] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:35.044456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9243a9e1-d022-48a2-b559-ae8b96d8dc3a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:35.055581 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9243a9e1-d022-48a2-b559-ae8b96d8dc3a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.294976 Feb 19 21:09:35.056578 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2166/4218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:34 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:35.425340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:35.428693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:35.437010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:35.437721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:35.438845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:35.439458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:35.489880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:35.490659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:35.491224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lazy-loading 'fault' on Instance uuid 17a82db1-c267-4dcd-97c5-10fac191c0a2 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:09:35.550666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad7207822c04fc289709200d7e2bd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e370ef28034ffbbbee9d2cfd826084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:35.560188 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-751523a4-2ac9-42dc-9513-199a6f150d8e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 200 len: 1329 microversion: 2.1 time: 0.141254 Feb 19 21:09:35.561195 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2053/4219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:35 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 1329 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:35.616060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:35.617093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:35.625019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:35.625923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:35.627217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:35.627633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:35.849808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:35.875923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:35.881731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:35.882799 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d6c0e1b8-40b0-408c-bdb4-00ddb0ae9db8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1743 microversion: 2.20 time: 0.277674 Feb 19 21:09:35.883372 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2167/4220] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:35 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1743 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:36.076918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0a4794db-8eb2-46c5-8a90-45db9082ce77 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:36.076918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0a4794db-8eb2-46c5-8a90-45db9082ce77 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:36.082379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a4794db-8eb2-46c5-8a90-45db9082ce77 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:36.083490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a4794db-8eb2-46c5-8a90-45db9082ce77 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:36.084758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a4794db-8eb2-46c5-8a90-45db9082ce77 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:36.085172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a4794db-8eb2-46c5-8a90-45db9082ce77 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:36.336588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0a4794db-8eb2-46c5-8a90-45db9082ce77 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:36.349022 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0a4794db-8eb2-46c5-8a90-45db9082ce77 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.276007 Feb 19 21:09:36.349685 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2054/4221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:36 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:36.579696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5273bd71-4fd3-4a0d-b37a-63b8b0f0cc9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:36.580483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5273bd71-4fd3-4a0d-b37a-63b8b0f0cc9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] [instance: 17a82db1-c267-4dcd-97c5-10fac191c0a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:36.592537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5273bd71-4fd3-4a0d-b37a-63b8b0f0cc9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:36.595212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5273bd71-4fd3-4a0d-b37a-63b8b0f0cc9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:36.600861 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5273bd71-4fd3-4a0d-b37a-63b8b0f0cc9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:36.601333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5273bd71-4fd3-4a0d-b37a-63b8b0f0cc9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:36.638302 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-5273bd71-4fd3-4a0d-b37a-63b8b0f0cc9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] HTTP exception thrown: Instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 could not be found. Feb 19 21:09:36.638925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5273bd71-4fd3-4a0d-b37a-63b8b0f0cc9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Returning 404 to user: Instance 17a82db1-c267-4dcd-97c5-10fac191c0a2 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:09:36.639785 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5273bd71-4fd3-4a0d-b37a-63b8b0f0cc9e tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2" status: 404 len: 111 microversion: 2.1 time: 0.063738 Feb 19 21:09:36.640609 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2168/4222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:36 2022] GET /compute/v2.1/servers/17a82db1-c267-4dcd-97c5-10fac191c0a2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:09:36.650079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-094b6c50-9415-4dfd-84cd-c948978a91c9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] Calling method '.version_select at 0x7f64747d3ee0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:36.676357 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-094b6c50-9415-4dfd-84cd-c948978a91c9 tempest-ServerActionsTestJSON-1623506475 tempest-ServerActionsTestJSON-1623506475-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970095653" status: 202 len: 0 microversion: 2.1 time: 0.030759 Feb 19 21:09:36.678095 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2055/4223] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:09:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970095653 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:09:36.902054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:36.902757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:36.910734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:36.912003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:36.913174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:36.913721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:37.168592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:37.181438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:37.183895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:37.185571 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d0680472-edfa-4bec-a333-f941f3aad401 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1743 microversion: 2.20 time: 0.288012 Feb 19 21:09:37.186348 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2169/4224] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:36 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1743 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:37.370455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa1601f8-168d-4316-a466-e2fd70cc1c91 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:37.371247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aa1601f8-168d-4316-a466-e2fd70cc1c91 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:37.379046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa1601f8-168d-4316-a466-e2fd70cc1c91 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:37.380044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa1601f8-168d-4316-a466-e2fd70cc1c91 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:37.381023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa1601f8-168d-4316-a466-e2fd70cc1c91 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:37.381477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa1601f8-168d-4316-a466-e2fd70cc1c91 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:37.594780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa1601f8-168d-4316-a466-e2fd70cc1c91 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:37.606273 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa1601f8-168d-4316-a466-e2fd70cc1c91 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.240985 Feb 19 21:09:37.607162 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2056/4225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:37 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:38.144005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-40d933e8-ba3a-4f84-a434-a0a678f5c87a req-7331d867-3221-40ee-84da-b3a0db0a802d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9598d4a9-3a39-4e96-b6ea-d437e2050247", "name": "network-vif-plugged", "status": "completed", "tag": "705d433e-42c6-442d-adce-cb0486512277"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:38.147323 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:09:38.147323 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:09:38.157114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-40d933e8-ba3a-4f84-a434-a0a678f5c87a req-7331d867-3221-40ee-84da-b3a0db0a802d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:38.157696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-40d933e8-ba3a-4f84-a434-a0a678f5c87a req-7331d867-3221-40ee-84da-b3a0db0a802d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:38.175467 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-40d933e8-ba3a-4f84-a434-a0a678f5c87a req-7331d867-3221-40ee-84da-b3a0db0a802d service nova] Creating event network-vif-plugged:705d433e-42c6-442d-adce-cb0486512277 for instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 on nch2-master-1 Feb 19 21:09:38.183037 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-40d933e8-ba3a-4f84-a434-a0a678f5c87a req-7331d867-3221-40ee-84da-b3a0db0a802d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043721 Feb 19 21:09:38.184487 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2170/4226] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:38.207461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:38.210102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:38.219785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:38.221231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:38.225173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:38.226580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:38.460186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:38.476758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:38.478670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:38.482952 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ac46559-9ed7-45d6-a557-8d16b4ac94fd tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1743 microversion: 2.20 time: 0.281361 Feb 19 21:09:38.486275 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2057/4227] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:38 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1743 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:38.630991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ef5daaef-a048-4157-8c30-e8cfc963d849 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:38.631901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ef5daaef-a048-4157-8c30-e8cfc963d849 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:38.638939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef5daaef-a048-4157-8c30-e8cfc963d849 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:38.639700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef5daaef-a048-4157-8c30-e8cfc963d849 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:38.640876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef5daaef-a048-4157-8c30-e8cfc963d849 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:38.641542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef5daaef-a048-4157-8c30-e8cfc963d849 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:38.874171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ef5daaef-a048-4157-8c30-e8cfc963d849 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:38.895920 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ef5daaef-a048-4157-8c30-e8cfc963d849 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.262187 Feb 19 21:09:38.897516 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2171/4228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:38 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:39.507650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:39.508886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:39.517709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:39.518435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:39.519651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:39.520968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:39.729106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:39.741209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:39.743459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:39.750096 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2944851a-b29d-49c6-aeb3-0cf282786946 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1743 microversion: 2.20 time: 0.246257 Feb 19 21:09:39.752895 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2058/4229] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:39 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:39.917336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ead792e2-a110-4c20-94ad-bb65e34b5778 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:39.918263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ead792e2-a110-4c20-94ad-bb65e34b5778 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:39.930320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ead792e2-a110-4c20-94ad-bb65e34b5778 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:39.931672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ead792e2-a110-4c20-94ad-bb65e34b5778 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:39.933860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ead792e2-a110-4c20-94ad-bb65e34b5778 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:39.934928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ead792e2-a110-4c20-94ad-bb65e34b5778 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:40.274010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ead792e2-a110-4c20-94ad-bb65e34b5778 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:40.286714 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ead792e2-a110-4c20-94ad-bb65e34b5778 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.375426 Feb 19 21:09:40.289274 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2172/4230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:39 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:40.779276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:40.781005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:40.792264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:40.793037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:40.795568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:40.796717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:41.231488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:41.258529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:41.261509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:41.263227 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d999ea54-c0c7-4173-8960-1fe0daffeeaa tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1743 microversion: 2.20 time: 0.488873 Feb 19 21:09:41.264239 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2059/4231] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:40 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1743 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:41.308610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7541afc5-8844-447b-8115-3bb3163e03a7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:41.310820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7541afc5-8844-447b-8115-3bb3163e03a7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:41.321885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7541afc5-8844-447b-8115-3bb3163e03a7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:41.323250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7541afc5-8844-447b-8115-3bb3163e03a7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:41.324675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7541afc5-8844-447b-8115-3bb3163e03a7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:41.325285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7541afc5-8844-447b-8115-3bb3163e03a7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:41.593874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7541afc5-8844-447b-8115-3bb3163e03a7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:41.608869 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7541afc5-8844-447b-8115-3bb3163e03a7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.306570 Feb 19 21:09:41.609714 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2173/4232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:41 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:42.285439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:42.289956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:42.303112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:42.304016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:42.305147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:42.305750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:42.626732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c1d176cb-fce6-410a-972c-c74cea01c674 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:42.627354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c1d176cb-fce6-410a-972c-c74cea01c674 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:42.641440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1d176cb-fce6-410a-972c-c74cea01c674 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:42.641922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1d176cb-fce6-410a-972c-c74cea01c674 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:42.642777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1d176cb-fce6-410a-972c-c74cea01c674 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:42.643296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1d176cb-fce6-410a-972c-c74cea01c674 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:42.717218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:42.729065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:42.730606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:42.732784 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c6088ed-0b0b-47fd-9ef8-c52bf73ce903 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.453106 Feb 19 21:09:42.740798 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2060/4233] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:42 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:42.923653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c1d176cb-fce6-410a-972c-c74cea01c674 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:42.935753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c1d176cb-fce6-410a-972c-c74cea01c674 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.312811 Feb 19 21:09:42.948157 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2174/4234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:42 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:43.752620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:43.753736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:43.773354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:43.773814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:43.775083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:43.786582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:43.963564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-97747cec-11b8-4201-ad24-d2142829a0a2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:43.965492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-97747cec-11b8-4201-ad24-d2142829a0a2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:43.977692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97747cec-11b8-4201-ad24-d2142829a0a2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:43.985104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97747cec-11b8-4201-ad24-d2142829a0a2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:43.986929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97747cec-11b8-4201-ad24-d2142829a0a2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:43.990298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97747cec-11b8-4201-ad24-d2142829a0a2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:44.206410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:44.221939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:44.233357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:44.234374 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-39132b4b-548d-42a7-a961-47d3b419c1d8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.485974 Feb 19 21:09:44.237180 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2061/4235] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:43 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:44.338754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-97747cec-11b8-4201-ad24-d2142829a0a2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:44.355584 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-97747cec-11b8-4201-ad24-d2142829a0a2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.395772 Feb 19 21:09:44.356373 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2175/4236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:43 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:45.262940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:45.264921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:45.292237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:45.296297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:45.297570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:45.298269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:45.384029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e11918c6-934b-4a4b-af42-add3a5e7ea79 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:45.384681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e11918c6-934b-4a4b-af42-add3a5e7ea79 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:45.426264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e11918c6-934b-4a4b-af42-add3a5e7ea79 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:45.432450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e11918c6-934b-4a4b-af42-add3a5e7ea79 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:45.439566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e11918c6-934b-4a4b-af42-add3a5e7ea79 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:45.440041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e11918c6-934b-4a4b-af42-add3a5e7ea79 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:45.639524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:45.655108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:45.661592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:45.668051 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-adcfe7ab-af98-4648-b2b7-4778d8b9ea64 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.413953 Feb 19 21:09:45.702657 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2062/4237] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:45 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:45.832244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e11918c6-934b-4a4b-af42-add3a5e7ea79 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:45.842082 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e11918c6-934b-4a4b-af42-add3a5e7ea79 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.463614 Feb 19 21:09:45.842708 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2176/4238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:45 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:46.430621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-986a2d21-f8d9-4511-b62b-23ec8e83345e tempest-ComputeTenantNetworksTest-859553962 tempest-ComputeTenantNetworksTest-859553962-project] Calling method '.version_select at 0x7f6467dbea60>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:46.721084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:46.722641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:46.731530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:46.732668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:46.733695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:46.734310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:47.177966 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-986a2d21-f8d9-4511-b62b-23ec8e83345e tempest-ComputeTenantNetworksTest-859553962 tempest-ComputeTenantNetworksTest-859553962-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 307 microversion: 2.1 time: 0.920578 Feb 19 21:09:47.178791 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2063/4239] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 21:09:46 2022] GET /compute/v2.1/os-tenant-networks => generated 307 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:47.188313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fa1bbb18-cd01-4d87-993c-12be755a68bc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:47.189424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fa1bbb18-cd01-4d87-993c-12be755a68bc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:47.201259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa1bbb18-cd01-4d87-993c-12be755a68bc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:47.202355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa1bbb18-cd01-4d87-993c-12be755a68bc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:47.203542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa1bbb18-cd01-4d87-993c-12be755a68bc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:47.205480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa1bbb18-cd01-4d87-993c-12be755a68bc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:47.325257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:47.338598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:47.342369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:47.344737 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-617d9c0c-46f1-4001-b15e-a3d09fd58bd1 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.627006 Feb 19 21:09:47.346235 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2177/4240] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:46 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:09:47.352949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-90bed3bb-0ef1-4e9e-88b2-e7b87a3ffc9b tempest-ComputeTenantNetworksTest-859553962 tempest-ComputeTenantNetworksTest-859553962-project] Calling method '.version_select at 0x7f6467cd6d30>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:47.509958 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-90bed3bb-0ef1-4e9e-88b2-e7b87a3ffc9b tempest-ComputeTenantNetworksTest-859553962 tempest-ComputeTenantNetworksTest-859553962-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks/cd48e7aa-b719-4431-b65e-f9710a0bb85d" status: 200 len: 138 microversion: 2.1 time: 0.162404 Feb 19 21:09:47.514443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fa1bbb18-cd01-4d87-993c-12be755a68bc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:47.515182 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2178/4241] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:09:47 2022] GET /compute/v2.1/os-tenant-networks/cd48e7aa-b719-4431-b65e-f9710a0bb85d => generated 138 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:09:47.528136 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fa1bbb18-cd01-4d87-993c-12be755a68bc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.347923 Feb 19 21:09:47.528779 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2064/4242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:47 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:47.534703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:47.537009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:47.560688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:47.561578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:47.568311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:47.573499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:47.736662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lazy-loading 'services' on Instance uuid cc97c9dc-bc47-4884-b42e-fa373a918258 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:09:47.867716 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c6468c3-1a0e-477f-a1ed-2a6ebdf573e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/os-volume_attachments/15fd35a7-de5b-44ee-af9e-26318f1c9422" status: 202 len: 0 microversion: 2.1 time: 0.351004 Feb 19 21:09:47.869331 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2179/4243] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:09:47 2022] DELETE /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/os-volume_attachments/15fd35a7-de5b-44ee-af9e-26318f1c9422 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:09:48.383420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:48.384533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:48.404455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:48.407086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:48.408267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:48.411372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:48.548970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-22b71100-b617-4b59-8622-994949f07a3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:48.552150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-22b71100-b617-4b59-8622-994949f07a3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:48.573926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22b71100-b617-4b59-8622-994949f07a3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:48.575140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22b71100-b617-4b59-8622-994949f07a3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:48.576206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22b71100-b617-4b59-8622-994949f07a3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:48.577444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22b71100-b617-4b59-8622-994949f07a3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:48.747649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:48.759124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:48.761003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:48.763396 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-af700005-6f9e-4d54-a7de-5903e4c8680a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.389023 Feb 19 21:09:48.778313 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2065/4244] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:48 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:48.919282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-22b71100-b617-4b59-8622-994949f07a3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:48.939312 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-22b71100-b617-4b59-8622-994949f07a3c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.396998 Feb 19 21:09:48.940673 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2180/4245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:48 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:49.271775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ac8b33af-2ebb-4089-a580-44804059037f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:09:49.286993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac8b33af-2ebb-4089-a580-44804059037f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:49.287333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac8b33af-2ebb-4089-a580-44804059037f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:49.325143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ac8b33af-2ebb-4089-a580-44804059037f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Going to try to stop instance {{(pid=136095) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:09:49.451184 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ac8b33af-2ebb-4089-a580-44804059037f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/action" status: 202 len: 0 microversion: 2.1 time: 0.183545 Feb 19 21:09:49.453026 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2066/4246] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:09:49 2022] POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:09:49.462784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-42d56922-9511-4e94-b126-57bea5a365ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:49.463351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-42d56922-9511-4e94-b126-57bea5a365ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:49.470688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42d56922-9511-4e94-b126-57bea5a365ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:49.471311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42d56922-9511-4e94-b126-57bea5a365ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:49.472595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42d56922-9511-4e94-b126-57bea5a365ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:49.475412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42d56922-9511-4e94-b126-57bea5a365ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:49.789387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:49.790128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:49.811784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:49.812248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:49.813100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:49.813570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:49.833339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-42d56922-9511-4e94-b126-57bea5a365ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:49.859727 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-42d56922-9511-4e94-b126-57bea5a365ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1676 microversion: 2.1 time: 0.399281 Feb 19 21:09:49.868542 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2181/4247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:49 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1676 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:49.963889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-496d139d-358c-4b0b-9167-fde798ad8b70 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:49.965642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-496d139d-358c-4b0b-9167-fde798ad8b70 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:49.974369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-496d139d-358c-4b0b-9167-fde798ad8b70 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:49.975110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-496d139d-358c-4b0b-9167-fde798ad8b70 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:49.977343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-496d139d-358c-4b0b-9167-fde798ad8b70 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:49.978768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-496d139d-358c-4b0b-9167-fde798ad8b70 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:50.288282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:50.307871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:50.311337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:50.316260 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-04e7f871-5c28-4052-b1ec-c21fb45b922e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.531265 Feb 19 21:09:50.320690 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2067/4248] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:49 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:50.382205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-496d139d-358c-4b0b-9167-fde798ad8b70 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:50.400272 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-496d139d-358c-4b0b-9167-fde798ad8b70 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.446305 Feb 19 21:09:50.401454 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2182/4249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:49 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:50.883205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-52cba1c4-2121-4442-87aa-e5734c305d21 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:50.885668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-52cba1c4-2121-4442-87aa-e5734c305d21 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:50.903534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52cba1c4-2121-4442-87aa-e5734c305d21 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:50.905147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52cba1c4-2121-4442-87aa-e5734c305d21 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:50.906475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52cba1c4-2121-4442-87aa-e5734c305d21 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:50.908546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52cba1c4-2121-4442-87aa-e5734c305d21 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:51.147681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-52cba1c4-2121-4442-87aa-e5734c305d21 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:51.158952 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-52cba1c4-2121-4442-87aa-e5734c305d21 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1676 microversion: 2.1 time: 0.281089 Feb 19 21:09:51.160306 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2068/4250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:50 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1676 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:51.345930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:51.346869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:51.358295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:51.359003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:51.360006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:51.361085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:51.424994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3db9006e-9af2-42ad-b911-34da61c86b39 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:51.429298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3db9006e-9af2-42ad-b911-34da61c86b39 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:51.461406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3db9006e-9af2-42ad-b911-34da61c86b39 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:51.461881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3db9006e-9af2-42ad-b911-34da61c86b39 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:51.463304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3db9006e-9af2-42ad-b911-34da61c86b39 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:51.467656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3db9006e-9af2-42ad-b911-34da61c86b39 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:51.678720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:51.711509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:51.714340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:51.718006 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a49ff3cd-0519-4213-9fea-f64776cd56e0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.377968 Feb 19 21:09:51.718681 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2183/4251] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:51 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:09:51.876426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3db9006e-9af2-42ad-b911-34da61c86b39 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:51.886324 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3db9006e-9af2-42ad-b911-34da61c86b39 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.470154 Feb 19 21:09:51.900010 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2069/4252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:51 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:52.182050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7fe1a99c-f66e-43db-b819-1a90a0f08405 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:52.183522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7fe1a99c-f66e-43db-b819-1a90a0f08405 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:52.203366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fe1a99c-f66e-43db-b819-1a90a0f08405 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:52.203980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fe1a99c-f66e-43db-b819-1a90a0f08405 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:52.204938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fe1a99c-f66e-43db-b819-1a90a0f08405 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:52.205536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fe1a99c-f66e-43db-b819-1a90a0f08405 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:52.574760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7fe1a99c-f66e-43db-b819-1a90a0f08405 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:52.588918 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7fe1a99c-f66e-43db-b819-1a90a0f08405 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1676 microversion: 2.1 time: 0.414211 Feb 19 21:09:52.601343 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2184/4253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:52 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1676 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:52.742395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:52.743031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:52.762698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:52.763447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:52.765545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:52.770501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:52.908104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a248c46e-6e8f-47f1-9542-23066a6393dd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:52.909049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a248c46e-6e8f-47f1-9542-23066a6393dd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:52.923726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a248c46e-6e8f-47f1-9542-23066a6393dd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:52.924580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a248c46e-6e8f-47f1-9542-23066a6393dd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:52.925593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a248c46e-6e8f-47f1-9542-23066a6393dd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:52.927837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a248c46e-6e8f-47f1-9542-23066a6393dd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:53.131593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:53.162451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:53.168547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:53.173628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-505455d0-71c5-4af1-b06d-52c0605ad483 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.440009 Feb 19 21:09:53.180383 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2070/4254] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:52 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:53.359685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a248c46e-6e8f-47f1-9542-23066a6393dd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:53.394875 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a248c46e-6e8f-47f1-9542-23066a6393dd tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.492875 Feb 19 21:09:53.411169 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2185/4255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:52 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:53.612874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-65224652-cb62-4916-ba8e-e04a0dcde601 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:53.614908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-65224652-cb62-4916-ba8e-e04a0dcde601 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:53.634536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65224652-cb62-4916-ba8e-e04a0dcde601 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:53.635616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65224652-cb62-4916-ba8e-e04a0dcde601 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:53.636854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65224652-cb62-4916-ba8e-e04a0dcde601 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:53.638641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65224652-cb62-4916-ba8e-e04a0dcde601 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:53.966230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-65224652-cb62-4916-ba8e-e04a0dcde601 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:53.990373 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-65224652-cb62-4916-ba8e-e04a0dcde601 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1676 microversion: 2.1 time: 0.379391 Feb 19 21:09:53.992946 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2071/4256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:53 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1676 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:54.194555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:54.195454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:54.212590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:54.215084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:54.219710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:54.220289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:54.418240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-93bba38e-68f2-4f29-8a7e-81ea6d5d7252 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:54.420228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-93bba38e-68f2-4f29-8a7e-81ea6d5d7252 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:54.431117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93bba38e-68f2-4f29-8a7e-81ea6d5d7252 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:54.432739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93bba38e-68f2-4f29-8a7e-81ea6d5d7252 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:54.436408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93bba38e-68f2-4f29-8a7e-81ea6d5d7252 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:54.437960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93bba38e-68f2-4f29-8a7e-81ea6d5d7252 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:54.627765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:54.641337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:54.644106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:54.648658 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f4e3270c-55e3-4b87-ad2e-2c7b2a035aa2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.456119 Feb 19 21:09:54.655557 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2186/4257] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:54 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:09:54.753546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-93bba38e-68f2-4f29-8a7e-81ea6d5d7252 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:54.765764 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-93bba38e-68f2-4f29-8a7e-81ea6d5d7252 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.355078 Feb 19 21:09:54.776231 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2072/4258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:54 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:55.014610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5e8dfc2b-a9b1-4b71-a83c-befde9c02712 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:55.015491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5e8dfc2b-a9b1-4b71-a83c-befde9c02712 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:55.036465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e8dfc2b-a9b1-4b71-a83c-befde9c02712 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:55.037468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e8dfc2b-a9b1-4b71-a83c-befde9c02712 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:55.045226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e8dfc2b-a9b1-4b71-a83c-befde9c02712 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:55.045889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5e8dfc2b-a9b1-4b71-a83c-befde9c02712 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:55.328288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5e8dfc2b-a9b1-4b71-a83c-befde9c02712 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:55.342571 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5e8dfc2b-a9b1-4b71-a83c-befde9c02712 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1676 microversion: 2.1 time: 0.331747 Feb 19 21:09:55.345207 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2187/4259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:55 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1676 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:55.671847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:55.672565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:55.691249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:55.691718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:55.693255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:55.699430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:55.784376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b36d0f68-bc6d-43ea-9463-9354c195a6e5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:55.791812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b36d0f68-bc6d-43ea-9463-9354c195a6e5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:55.815284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b36d0f68-bc6d-43ea-9463-9354c195a6e5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:55.816296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b36d0f68-bc6d-43ea-9463-9354c195a6e5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:55.820011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b36d0f68-bc6d-43ea-9463-9354c195a6e5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:55.820516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b36d0f68-bc6d-43ea-9463-9354c195a6e5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:56.133012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:56.152921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:56.159682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:56.165786 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5b7a623a-c932-4358-ab91-3ab041253915 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.498611 Feb 19 21:09:56.167741 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2073/4260] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:55 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:56.204204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b36d0f68-bc6d-43ea-9463-9354c195a6e5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:56.215639 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b36d0f68-bc6d-43ea-9463-9354c195a6e5 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.436499 Feb 19 21:09:56.218059 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2188/4261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:55 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:56.363854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-895228fa-8d93-4741-ab4f-24d491c80b0d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:56.364761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-895228fa-8d93-4741-ab4f-24d491c80b0d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:56.373993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-895228fa-8d93-4741-ab4f-24d491c80b0d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:56.379440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-895228fa-8d93-4741-ab4f-24d491c80b0d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:56.382801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-895228fa-8d93-4741-ab4f-24d491c80b0d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:56.384861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-895228fa-8d93-4741-ab4f-24d491c80b0d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:56.743702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-895228fa-8d93-4741-ab4f-24d491c80b0d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:56.756199 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-895228fa-8d93-4741-ab4f-24d491c80b0d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1676 microversion: 2.1 time: 0.397108 Feb 19 21:09:56.758579 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2074/4262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:56 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1676 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:57.187365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:57.188057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:57.204829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:57.211533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:57.212428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:57.212876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:57.235688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-70beffce-b664-4e89-98c6-6cc8fbc86e1c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:57.236676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-70beffce-b664-4e89-98c6-6cc8fbc86e1c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:57.253898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70beffce-b664-4e89-98c6-6cc8fbc86e1c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:57.254693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70beffce-b664-4e89-98c6-6cc8fbc86e1c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:57.255746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70beffce-b664-4e89-98c6-6cc8fbc86e1c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:57.256578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70beffce-b664-4e89-98c6-6cc8fbc86e1c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:57.726175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:57.773896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:57.775771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:57.777242 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-85383ce6-465a-4cbe-9582-8f21434a717e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.594750 Feb 19 21:09:57.789431 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2189/4263] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:57 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:57.797359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a35c07f1-e8be-44b2-b441-a004c53719c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:57.810039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a35c07f1-e8be-44b2-b441-a004c53719c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:57.825153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a35c07f1-e8be-44b2-b441-a004c53719c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:57.828613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a35c07f1-e8be-44b2-b441-a004c53719c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:57.830131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a35c07f1-e8be-44b2-b441-a004c53719c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:57.830865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a35c07f1-e8be-44b2-b441-a004c53719c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:57.997072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-70beffce-b664-4e89-98c6-6cc8fbc86e1c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:58.007780 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-70beffce-b664-4e89-98c6-6cc8fbc86e1c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.776073 Feb 19 21:09:58.009481 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2075/4264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:57 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:58.157998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a35c07f1-e8be-44b2-b441-a004c53719c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:58.170145 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a35c07f1-e8be-44b2-b441-a004c53719c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1676 microversion: 2.1 time: 0.379595 Feb 19 21:09:58.171605 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2190/4265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:57 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1676 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:09:58.800089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:58.800764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:58.808776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:58.809081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:58.810110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:58.812030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:59.032808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9fe78744-8493-4ef3-b46f-2106ad267397 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:59.033725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9fe78744-8493-4ef3-b46f-2106ad267397 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:59.062721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fe78744-8493-4ef3-b46f-2106ad267397 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:59.064383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fe78744-8493-4ef3-b46f-2106ad267397 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:59.065604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fe78744-8493-4ef3-b46f-2106ad267397 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:59.067500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fe78744-8493-4ef3-b46f-2106ad267397 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:59.111065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:59.138234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:59.138234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:59.138234 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11065bfa-0e8d-4819-9d5e-e172bfd15f12 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.339271 Feb 19 21:09:59.156017 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2076/4266] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:09:58 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:09:59.239335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c543a379-f36f-43d5-9c14-4ab7cd52d4ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:09:59.240183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c543a379-f36f-43d5-9c14-4ab7cd52d4ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:09:59.269195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c543a379-f36f-43d5-9c14-4ab7cd52d4ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:59.269789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c543a379-f36f-43d5-9c14-4ab7cd52d4ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:59.270608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c543a379-f36f-43d5-9c14-4ab7cd52d4ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:09:59.271136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c543a379-f36f-43d5-9c14-4ab7cd52d4ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:09:59.490639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9fe78744-8493-4ef3-b46f-2106ad267397 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:59.501088 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9fe78744-8493-4ef3-b46f-2106ad267397 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.472093 Feb 19 21:09:59.514522 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2191/4267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:59 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:09:59.628668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c543a379-f36f-43d5-9c14-4ab7cd52d4ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:09:59.644749 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c543a379-f36f-43d5-9c14-4ab7cd52d4ad tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1676 microversion: 2.1 time: 0.412428 Feb 19 21:09:59.647539 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2077/4268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:09:59 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1676 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:00.179007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:00.179753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:00.187657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:00.189932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:00.193061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:00.194380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:00.498573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:00.518868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6283ffa0-0286-46bb-8723-a12d890fe175 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:00.519483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6283ffa0-0286-46bb-8723-a12d890fe175 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:00.533508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6283ffa0-0286-46bb-8723-a12d890fe175 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:00.534854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:00.536450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6283ffa0-0286-46bb-8723-a12d890fe175 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:00.537372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6283ffa0-0286-46bb-8723-a12d890fe175 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:00.537820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6283ffa0-0286-46bb-8723-a12d890fe175 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:00.539392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:00.540663 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e80ef218-f1b1-4b09-833c-3c8e69492b32 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.366292 Feb 19 21:10:00.556573 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2192/4269] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:00 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:00.671649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41a4c62f-69c9-4f8b-95b8-08374e5c656a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:00.672429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41a4c62f-69c9-4f8b-95b8-08374e5c656a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:00.682008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41a4c62f-69c9-4f8b-95b8-08374e5c656a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:00.686240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41a4c62f-69c9-4f8b-95b8-08374e5c656a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:00.690382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41a4c62f-69c9-4f8b-95b8-08374e5c656a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:00.691088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41a4c62f-69c9-4f8b-95b8-08374e5c656a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:00.787775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6283ffa0-0286-46bb-8723-a12d890fe175 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:00.797029 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6283ffa0-0286-46bb-8723-a12d890fe175 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.281821 Feb 19 21:10:00.810325 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2078/4270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:00 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:10:00.935365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-41a4c62f-69c9-4f8b-95b8-08374e5c656a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:00.944695 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41a4c62f-69c9-4f8b-95b8-08374e5c656a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1653 microversion: 2.1 time: 0.275263 Feb 19 21:10:00.944695 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2193/4271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:00 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1653 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:10:00.966007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-813514ec-1a1c-47af-9a0d-e78348744ebe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:00.970324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-813514ec-1a1c-47af-9a0d-e78348744ebe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:00.970786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-813514ec-1a1c-47af-9a0d-e78348744ebe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:00.997644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-813514ec-1a1c-47af-9a0d-e78348744ebe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Going to try to start instance {{(pid=136095) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 19 21:10:01.050649 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-813514ec-1a1c-47af-9a0d-e78348744ebe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/action" status: 202 len: 0 microversion: 2.1 time: 0.092155 Feb 19 21:10:01.052024 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2079/4272] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:10:00 2022] POST /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:10:01.064591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-517ca04f-fc13-4510-9991-4cac38898122 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:01.065938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-517ca04f-fc13-4510-9991-4cac38898122 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:01.079202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517ca04f-fc13-4510-9991-4cac38898122 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:01.080411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517ca04f-fc13-4510-9991-4cac38898122 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:01.082998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517ca04f-fc13-4510-9991-4cac38898122 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:01.084384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517ca04f-fc13-4510-9991-4cac38898122 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:01.279413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-517ca04f-fc13-4510-9991-4cac38898122 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:01.289933 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-517ca04f-fc13-4510-9991-4cac38898122 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1662 microversion: 2.1 time: 0.230712 Feb 19 21:10:01.290539 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2194/4273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:01 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1662 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:01.560994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:01.572165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:01.592233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:01.594584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:01.595895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:01.597525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:01.816229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2adb074f-fdc3-4f35-9464-27dd6ce1a63b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:01.817473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2adb074f-fdc3-4f35-9464-27dd6ce1a63b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:01.833009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2adb074f-fdc3-4f35-9464-27dd6ce1a63b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:01.835051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2adb074f-fdc3-4f35-9464-27dd6ce1a63b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:01.836118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2adb074f-fdc3-4f35-9464-27dd6ce1a63b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:01.838563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2adb074f-fdc3-4f35-9464-27dd6ce1a63b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:01.910408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:01.929881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:01.932295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:01.933741 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b8f022dd-a612-42ea-9787-edea14351ea8 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1738 microversion: 2.20 time: 0.377884 Feb 19 21:10:01.935001 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2080/4274] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:01 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1738 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:02.307799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2adb074f-fdc3-4f35-9464-27dd6ce1a63b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:02.312471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c424acc-c341-45cf-9e84-c7516b9413e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:02.313778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c424acc-c341-45cf-9e84-c7516b9413e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:02.317995 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2adb074f-fdc3-4f35-9464-27dd6ce1a63b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.505796 Feb 19 21:10:02.318594 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2195/4275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:01 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:02.327024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c424acc-c341-45cf-9e84-c7516b9413e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:02.327607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c424acc-c341-45cf-9e84-c7516b9413e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:02.329212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c424acc-c341-45cf-9e84-c7516b9413e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:02.330287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c424acc-c341-45cf-9e84-c7516b9413e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:02.668045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c424acc-c341-45cf-9e84-c7516b9413e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:02.679599 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c424acc-c341-45cf-9e84-c7516b9413e0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1662 microversion: 2.1 time: 0.374895 Feb 19 21:10:02.689572 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2081/4276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:02 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1662 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:10:02.982090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:02.982764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:03.000245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:03.001031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:03.002153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:03.005070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:03.210500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:03.220464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:03.222380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:03.224659 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-399040c2-6fc5-498b-8b1b-6d937dc0001d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1720 microversion: 2.20 time: 0.272137 Feb 19 21:10:03.225437 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2196/4277] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:02 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1720 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:03.343973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5203019e-074e-4905-a516-4061a4e3095c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:03.344908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5203019e-074e-4905-a516-4061a4e3095c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:03.357876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5203019e-074e-4905-a516-4061a4e3095c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:03.358359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5203019e-074e-4905-a516-4061a4e3095c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:03.359148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5203019e-074e-4905-a516-4061a4e3095c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:03.359838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5203019e-074e-4905-a516-4061a4e3095c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:03.546140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5203019e-074e-4905-a516-4061a4e3095c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:03.554499 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5203019e-074e-4905-a516-4061a4e3095c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1511 microversion: 2.1 time: 0.215737 Feb 19 21:10:03.555107 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2082/4278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:03 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:03.708686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d90970c3-33d1-475e-8e0d-f557bceb568d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:03.709578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d90970c3-33d1-475e-8e0d-f557bceb568d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:03.718633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d90970c3-33d1-475e-8e0d-f557bceb568d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:03.719084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d90970c3-33d1-475e-8e0d-f557bceb568d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:03.719881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d90970c3-33d1-475e-8e0d-f557bceb568d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:03.720313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d90970c3-33d1-475e-8e0d-f557bceb568d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:03.897219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d90970c3-33d1-475e-8e0d-f557bceb568d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:03.908044 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d90970c3-33d1-475e-8e0d-f557bceb568d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1666 microversion: 2.1 time: 0.214816 Feb 19 21:10:03.920359 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2197/4279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:03 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1666 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:04.156084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ecfdef3d-79f7-420b-b773-72f61140a14f req-62c925c1-55b6-4b6c-9508-41b62949a610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9598d4a9-3a39-4e96-b6ea-d437e2050247", "name": "network-vif-unplugged", "status": "completed", "tag": "705d433e-42c6-442d-adce-cb0486512277"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:04.157923 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:04.157923 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:04.168389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ecfdef3d-79f7-420b-b773-72f61140a14f req-62c925c1-55b6-4b6c-9508-41b62949a610 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:04.169484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ecfdef3d-79f7-420b-b773-72f61140a14f req-62c925c1-55b6-4b6c-9508-41b62949a610 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:04.188250 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ecfdef3d-79f7-420b-b773-72f61140a14f req-62c925c1-55b6-4b6c-9508-41b62949a610 service nova] Creating event network-vif-unplugged:705d433e-42c6-442d-adce-cb0486512277 for instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 on nch2-master-1 Feb 19 21:10:04.211805 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ecfdef3d-79f7-420b-b773-72f61140a14f req-62c925c1-55b6-4b6c-9508-41b62949a610 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059031 Feb 19 21:10:04.213887 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2083/4280] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:04.247307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:04.248567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:04.256673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:04.257402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:04.258657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:04.259380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:04.450833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:04.461152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:04.463999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:04.465164 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e2b333ac-7daf-4c9b-af0b-6816fe4d12fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1720 microversion: 2.20 time: 0.225579 Feb 19 21:10:04.466086 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2198/4281] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:04 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:10:04.575907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0613dfca-73ae-48c9-a1a9-0fc15f8a8b98 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:04.576985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0613dfca-73ae-48c9-a1a9-0fc15f8a8b98 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:04.595368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0613dfca-73ae-48c9-a1a9-0fc15f8a8b98 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:04.596611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0613dfca-73ae-48c9-a1a9-0fc15f8a8b98 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:04.598769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0613dfca-73ae-48c9-a1a9-0fc15f8a8b98 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:04.599874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0613dfca-73ae-48c9-a1a9-0fc15f8a8b98 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:04.810269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0613dfca-73ae-48c9-a1a9-0fc15f8a8b98 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:04.822111 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0613dfca-73ae-48c9-a1a9-0fc15f8a8b98 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1488 microversion: 2.1 time: 0.253039 Feb 19 21:10:04.837570 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2084/4282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:04 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1488 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:04.842868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c3872632-e6f0-440a-aadb-4d8b895b2af2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:04.843459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c3872632-e6f0-440a-aadb-4d8b895b2af2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:04.849873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3872632-e6f0-440a-aadb-4d8b895b2af2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:04.850330 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3872632-e6f0-440a-aadb-4d8b895b2af2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:04.851159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3872632-e6f0-440a-aadb-4d8b895b2af2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:04.851596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3872632-e6f0-440a-aadb-4d8b895b2af2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:04.877396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c3872632-e6f0-440a-aadb-4d8b895b2af2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:10:04.966276 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c3872632-e6f0-440a-aadb-4d8b895b2af2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 204 len: 0 microversion: 2.1 time: 0.126939 Feb 19 21:10:04.966945 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2199/4283] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:10:04 2022] DELETE /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:10:04.975802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d3ed0e8b-ec9a-45ab-a924-60990c8d86c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:04.976474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d3ed0e8b-ec9a-45ab-a924-60990c8d86c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:04.987674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3ed0e8b-ec9a-45ab-a924-60990c8d86c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:04.988135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3ed0e8b-ec9a-45ab-a924-60990c8d86c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:04.989137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3ed0e8b-ec9a-45ab-a924-60990c8d86c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:04.989751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3ed0e8b-ec9a-45ab-a924-60990c8d86c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:05.235580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3ed0e8b-ec9a-45ab-a924-60990c8d86c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:05.248059 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d3ed0e8b-ec9a-45ab-a924-60990c8d86c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1494 microversion: 2.1 time: 0.276285 Feb 19 21:10:05.252951 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2085/4284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:04 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1494 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:05.487455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:05.487760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:05.497410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:05.497994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:05.499104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:05.499692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:05.700203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:05.713223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:05.715477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:05.717118 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd6a75dd-f4fe-4953-a48b-657e94e74a73 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1663 microversion: 2.20 time: 0.235419 Feb 19 21:10:05.718007 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2200/4285] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:05 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1663 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:05.743269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0a26bb9a-2bea-44a8-8676-156c68639832 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3be2f43d-88e4-40bc-a3e5-285a7855b8e5"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:05.744719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0a26bb9a-2bea-44a8-8676-156c68639832 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:05.755089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a26bb9a-2bea-44a8-8676-156c68639832 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:05.755089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a26bb9a-2bea-44a8-8676-156c68639832 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:05.755089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a26bb9a-2bea-44a8-8676-156c68639832 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:05.755089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0a26bb9a-2bea-44a8-8676-156c68639832 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:06.159823 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0a26bb9a-2bea-44a8-8676-156c68639832 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.421341 Feb 19 21:10:06.161212 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2086/4286] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Feb 19 21:10:05 2022] POST /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/os-volume_attachments => generated 188 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:10:06.269359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84832129-e65d-4f04-870f-8053546b4ff0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:06.272299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-84832129-e65d-4f04-870f-8053546b4ff0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:06.284125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84832129-e65d-4f04-870f-8053546b4ff0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:06.284908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84832129-e65d-4f04-870f-8053546b4ff0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:06.286487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84832129-e65d-4f04-870f-8053546b4ff0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:06.287733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84832129-e65d-4f04-870f-8053546b4ff0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:06.377449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3ffa9bbf-fa53-48f3-ae81-49cc5ed965f5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:06.378162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3ffa9bbf-fa53-48f3-ae81-49cc5ed965f5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:06.393874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ffa9bbf-fa53-48f3-ae81-49cc5ed965f5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:06.394838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ffa9bbf-fa53-48f3-ae81-49cc5ed965f5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:06.396349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ffa9bbf-fa53-48f3-ae81-49cc5ed965f5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:06.397003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ffa9bbf-fa53-48f3-ae81-49cc5ed965f5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:06.606456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84832129-e65d-4f04-870f-8053546b4ff0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:06.617156 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84832129-e65d-4f04-870f-8053546b4ff0 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1494 microversion: 2.1 time: 0.352528 Feb 19 21:10:06.618060 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2201/4287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:06 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1494 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:06.834201 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3ffa9bbf-fa53-48f3-ae81-49cc5ed965f5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/os-volume_attachments/3be2f43d-88e4-40bc-a3e5-285a7855b8e5" status: 202 len: 0 microversion: 2.20 time: 0.461838 Feb 19 21:10:06.836548 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2087/4288] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Feb 19 21:10:06 2022] DELETE /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/os-volume_attachments/3be2f43d-88e4-40bc-a3e5-285a7855b8e5 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:10:06.911345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dbeb5fcc-0c04-4c0c-8ef3-e3b097dc33fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:06.912128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dbeb5fcc-0c04-4c0c-8ef3-e3b097dc33fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:06.919646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbeb5fcc-0c04-4c0c-8ef3-e3b097dc33fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:06.920471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbeb5fcc-0c04-4c0c-8ef3-e3b097dc33fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:06.921978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbeb5fcc-0c04-4c0c-8ef3-e3b097dc33fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:06.922578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbeb5fcc-0c04-4c0c-8ef3-e3b097dc33fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:07.055998 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dbeb5fcc-0c04-4c0c-8ef3-e3b097dc33fc tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "POST /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/action" status: 202 len: 0 microversion: 2.20 time: 0.149185 Feb 19 21:10:07.057359 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2202/4289] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 21:10:06 2022] POST /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:10:07.065102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:07.065645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:07.086459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:07.087308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:07.090313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:07.092474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:07.235630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4d5fa40a-5c08-41a1-b90c-d57520c39a56 req-2c10990a-9539-4d56-9e6e-61d766e1f045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366afc42-f8b8-4a45-99b9-f9203f39d3a5", "name": "network-vif-deleted", "tag": "d0ef6ba9-dfd0-44f2-98db-eb48c1299a8e"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:07.238226 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:07.238226 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:10:07.247169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4d5fa40a-5c08-41a1-b90c-d57520c39a56 req-2c10990a-9539-4d56-9e6e-61d766e1f045 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:07.247967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4d5fa40a-5c08-41a1-b90c-d57520c39a56 req-2c10990a-9539-4d56-9e6e-61d766e1f045 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:07.264874 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4d5fa40a-5c08-41a1-b90c-d57520c39a56 req-2c10990a-9539-4d56-9e6e-61d766e1f045 service nova] Creating event network-vif-deleted:d0ef6ba9-dfd0-44f2-98db-eb48c1299a8e for instance 366afc42-f8b8-4a45-99b9-f9203f39d3a5 on nch2-master-1 Feb 19 21:10:07.272874 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4d5fa40a-5c08-41a1-b90c-d57520c39a56 req-2c10990a-9539-4d56-9e6e-61d766e1f045 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042596 Feb 19 21:10:07.274318 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2203/4290] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:10:07.381255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:07.392819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:07.395881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:07.398811 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0c11051a-15dd-4ce6-9561-8883cec7d0a3 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1671 microversion: 2.20 time: 0.337631 Feb 19 21:10:07.400101 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2088/4291] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:07 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1671 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:07.634935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:07.635635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:07.651176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:07.651724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:07.652574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:07.653007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:07.722375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:07.724114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:07.726613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lazy-loading 'fault' on Instance uuid 366afc42-f8b8-4a45-99b9-f9203f39d3a5 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:10:07.832990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:07.872185 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-40703299-4f8a-4de7-b945-f9282f3b0ce9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 200 len: 1305 microversion: 2.1 time: 0.241093 Feb 19 21:10:07.876964 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2204/4292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:07 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 1305 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:08.419601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:08.420947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:08.430792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:08.431657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:08.432617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:08.433289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:08.649229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:08.669481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:08.676955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:08.678534 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fd98e65c-2b9c-41a7-bc04-cbc0ff3e759d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1671 microversion: 2.20 time: 0.264151 Feb 19 21:10:08.680517 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2089/4293] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:08 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1671 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:08.896736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6ef2fc80-f2d1-4626-b562-2a41b62c8b4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:08.897521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6ef2fc80-f2d1-4626-b562-2a41b62c8b4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:08.905000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ef2fc80-f2d1-4626-b562-2a41b62c8b4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:08.905805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ef2fc80-f2d1-4626-b562-2a41b62c8b4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:08.906973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ef2fc80-f2d1-4626-b562-2a41b62c8b4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:08.907828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ef2fc80-f2d1-4626-b562-2a41b62c8b4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:08.923609 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-6ef2fc80-f2d1-4626-b562-2a41b62c8b4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 366afc42-f8b8-4a45-99b9-f9203f39d3a5 could not be found. Feb 19 21:10:08.924552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6ef2fc80-f2d1-4626-b562-2a41b62c8b4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 366afc42-f8b8-4a45-99b9-f9203f39d3a5 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:08.925571 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6ef2fc80-f2d1-4626-b562-2a41b62c8b4c tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 404 len: 111 microversion: 2.1 time: 0.032965 Feb 19 21:10:08.938636 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2205/4294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:08 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:09.084190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1233008442", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "be9178cb-fadc-423e-95e2-979af3a2f95e"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:09.199525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] validate_networks() for [('be9178cb-fadc-423e-95e2-979af3a2f95e', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:10:09.701351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:09.702309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:09.718133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:09.718733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:09.719649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:09.720203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:09.937123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:10:09.938180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:10:09.938826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:10:09.939436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:10:09.940053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:10:09.956153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:09.958009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:09.959353 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:09.960061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:09.984157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:10:09.991962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Getting quotas for user 20246495a35b4762be5b2ad98f537377 and project e5f81dcc5d52473ab53817e20df04cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:10:10.008872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:10:10.012019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:10:10.066200 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3e3f6d87-a1ad-4bea-b6e5-41fe81a67b14 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987380 Feb 19 21:10:10.070528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:10.075633 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2090/4295] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:10:10.084428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2e626e50-1e0e-48a3-8c1a-d8e5995570e4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:10.085592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2e626e50-1e0e-48a3-8c1a-d8e5995570e4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:10.096126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:10.098937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:10.108044 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a859e190-e907-4444-a12a-83522125d687 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.411412 Feb 19 21:10:10.109169 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2206/4296] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:09 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:10.234842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2e626e50-1e0e-48a3-8c1a-d8e5995570e4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:10.246847 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2e626e50-1e0e-48a3-8c1a-d8e5995570e4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1215 microversion: 2.1 time: 0.169169 Feb 19 21:10:10.247846 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2091/4297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:10 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:11.128738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:11.130380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:11.157034 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:11.158343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:11.159516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:11.160217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:11.266977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4e3d3cf9-3ff3-4de8-9329-619665150689 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:11.267494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4e3d3cf9-3ff3-4de8-9329-619665150689 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:11.293523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e3d3cf9-3ff3-4de8-9329-619665150689 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:11.294339 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e3d3cf9-3ff3-4de8-9329-619665150689 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:11.296564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e3d3cf9-3ff3-4de8-9329-619665150689 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:11.297510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e3d3cf9-3ff3-4de8-9329-619665150689 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:11.981656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4e3d3cf9-3ff3-4de8-9329-619665150689 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:11.993880 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4e3d3cf9-3ff3-4de8-9329-619665150689 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1267 microversion: 2.1 time: 0.730201 Feb 19 21:10:11.995868 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2092/4298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:11 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1267 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:10:12.513511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:12.529966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:12.532132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:12.533828 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bf5acc4c-d030-4ca3-a508-014759102058 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 1.409887 Feb 19 21:10:12.560621 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2207/4299] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:11 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:10:12.930468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-42d30eac-95ca-4675-bed2-3e299e5e35d3 req-194932cf-d7ec-4502-9dca-67397fa071b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9598d4a9-3a39-4e96-b6ea-d437e2050247", "tag": "705d433e-42c6-442d-adce-cb0486512277"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:12.938735 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:12.938735 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:12.964942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-42d30eac-95ca-4675-bed2-3e299e5e35d3 req-194932cf-d7ec-4502-9dca-67397fa071b5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:12.965877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-42d30eac-95ca-4675-bed2-3e299e5e35d3 req-194932cf-d7ec-4502-9dca-67397fa071b5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:12.997849 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-42d30eac-95ca-4675-bed2-3e299e5e35d3 req-194932cf-d7ec-4502-9dca-67397fa071b5 service nova] Creating event network-changed:705d433e-42c6-442d-adce-cb0486512277 for instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 on nch1-master-1 Feb 19 21:10:13.013770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c73b00ab-9d07-4b7b-a8d0-a4765a3d1fd3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:13.014669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c73b00ab-9d07-4b7b-a8d0-a4765a3d1fd3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:13.015018 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-42d30eac-95ca-4675-bed2-3e299e5e35d3 req-194932cf-d7ec-4502-9dca-67397fa071b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112227 Feb 19 21:10:13.016253 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2093/4300] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:13.031734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c73b00ab-9d07-4b7b-a8d0-a4765a3d1fd3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:13.032393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c73b00ab-9d07-4b7b-a8d0-a4765a3d1fd3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:13.033459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c73b00ab-9d07-4b7b-a8d0-a4765a3d1fd3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:13.034549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c73b00ab-9d07-4b7b-a8d0-a4765a3d1fd3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:13.262346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c73b00ab-9d07-4b7b-a8d0-a4765a3d1fd3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:13.296196 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c73b00ab-9d07-4b7b-a8d0-a4765a3d1fd3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1273 microversion: 2.1 time: 0.285351 Feb 19 21:10:13.299975 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2208/4301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:13 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:10:13.554035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:13.554752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:13.578256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:13.578965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:13.584421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:13.585756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:14.233991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:14.268409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:14.283806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:14.292951 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-496b0f47-e26c-4695-9ac2-de176669ad42 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.736182 Feb 19 21:10:14.299886 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2094/4302] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:13 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:14.321407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-233c7980-085d-4a5e-ac15-63dc17f0b6f7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:14.322432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-233c7980-085d-4a5e-ac15-63dc17f0b6f7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:14.337467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-233c7980-085d-4a5e-ac15-63dc17f0b6f7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:14.337936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-233c7980-085d-4a5e-ac15-63dc17f0b6f7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:14.338759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-233c7980-085d-4a5e-ac15-63dc17f0b6f7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:14.339249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-233c7980-085d-4a5e-ac15-63dc17f0b6f7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:15.319882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-233c7980-085d-4a5e-ac15-63dc17f0b6f7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:15.328590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:15.334302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:15.342705 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-233c7980-085d-4a5e-ac15-63dc17f0b6f7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1315 microversion: 2.1 time: 1.025334 Feb 19 21:10:15.354243 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2209/4303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:14 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1315 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:15.354482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:15.354482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:15.355364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:15.356874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:16.372582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8dea3ccf-8da7-4aaf-9013-dd8d9d6bd0d7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:16.374853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8dea3ccf-8da7-4aaf-9013-dd8d9d6bd0d7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:16.385074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dea3ccf-8da7-4aaf-9013-dd8d9d6bd0d7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:16.386134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dea3ccf-8da7-4aaf-9013-dd8d9d6bd0d7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:16.400483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dea3ccf-8da7-4aaf-9013-dd8d9d6bd0d7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:16.401893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dea3ccf-8da7-4aaf-9013-dd8d9d6bd0d7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:16.432510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:16.481769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:16.486853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:16.488122 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4549bf5b-1b36-4d29-95fe-ab09b1589051 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 1.163904 Feb 19 21:10:16.498020 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2095/4304] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:15 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:10:17.423578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8dea3ccf-8da7-4aaf-9013-dd8d9d6bd0d7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:17.449589 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8dea3ccf-8da7-4aaf-9013-dd8d9d6bd0d7 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1315 microversion: 2.1 time: 1.090287 Feb 19 21:10:17.453879 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2210/4305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:16 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1315 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:17.518384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:17.519064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:17.539811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:17.540228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:17.544657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:17.545127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:18.471899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e9c8634-ea91-4561-bf26-aa9b9ebf8fba tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:18.473150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e9c8634-ea91-4561-bf26-aa9b9ebf8fba tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:18.497348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e9c8634-ea91-4561-bf26-aa9b9ebf8fba tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:18.498833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e9c8634-ea91-4561-bf26-aa9b9ebf8fba tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:18.500221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e9c8634-ea91-4561-bf26-aa9b9ebf8fba tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:18.502968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e9c8634-ea91-4561-bf26-aa9b9ebf8fba tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:19.353123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:19.369505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:19.376195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:19.398755 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e3eba72-5894-4ae6-b783-3e495a6249a0 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 1.863486 Feb 19 21:10:19.426122 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2096/4306] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:17 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:19.444935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8f0a1ca0-0777-40c4-9c18-c6628bbb55ac req-fa8c3480-d4ac-4b3e-8586-3836333a4a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdd5414-93bf-4975-9a3a-3ed8f1ce47de", "tag": "80f6391f-5119-41fe-99ce-51986ff3e516"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:19.455095 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:19.455095 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:19.479369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8f0a1ca0-0777-40c4-9c18-c6628bbb55ac req-fa8c3480-d4ac-4b3e-8586-3836333a4a77 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:19.482771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8f0a1ca0-0777-40c4-9c18-c6628bbb55ac req-fa8c3480-d4ac-4b3e-8586-3836333a4a77 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:19.516969 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8f0a1ca0-0777-40c4-9c18-c6628bbb55ac req-fa8c3480-d4ac-4b3e-8586-3836333a4a77 service nova] Creating event network-changed:80f6391f-5119-41fe-99ce-51986ff3e516 for instance 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de on nch2-master-1 Feb 19 21:10:19.533900 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8f0a1ca0-0777-40c4-9c18-c6628bbb55ac req-fa8c3480-d4ac-4b3e-8586-3836333a4a77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101400 Feb 19 21:10:19.535018 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2097/4307] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:19.921820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e9c8634-ea91-4561-bf26-aa9b9ebf8fba tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:19.939011 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e9c8634-ea91-4561-bf26-aa9b9ebf8fba tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1315 microversion: 2.1 time: 1.471776 Feb 19 21:10:19.949315 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2211/4308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:18 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1315 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:10:20.445987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:20.446740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:20.468684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:20.477649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:20.479622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:20.480123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:20.959344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-af505b42-8229-42ae-ba06-11d992f567ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:20.959963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-af505b42-8229-42ae-ba06-11d992f567ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:20.983260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af505b42-8229-42ae-ba06-11d992f567ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:20.983654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af505b42-8229-42ae-ba06-11d992f567ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:20.984491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af505b42-8229-42ae-ba06-11d992f567ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:20.984863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af505b42-8229-42ae-ba06-11d992f567ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:21.056744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:21.077658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:21.085708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:21.102716 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b4292cbb-e194-4a1c-a2ae-484a0464b00d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.662776 Feb 19 21:10:21.104595 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2098/4309] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:20 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:22.099568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-af505b42-8229-42ae-ba06-11d992f567ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:22.123364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:22.124797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:22.160226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:22.160715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:22.161716 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-af505b42-8229-42ae-ba06-11d992f567ec tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1315 microversion: 2.1 time: 1.201869 Feb 19 21:10:22.162602 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2212/4310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:20 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1315 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:10:22.169407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:22.170319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:22.893929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:22.906764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:22.912108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:22.913398 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3dbe00c9-5871-4150-ad54-9f777524eceb tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.793923 Feb 19 21:10:22.917174 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2099/4311] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:22 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:10:23.180176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7baa59a7-afc7-44b2-9b01-ef5a75ed28c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:23.184911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7baa59a7-afc7-44b2-9b01-ef5a75ed28c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:23.199548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7baa59a7-afc7-44b2-9b01-ef5a75ed28c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:23.202265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7baa59a7-afc7-44b2-9b01-ef5a75ed28c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:23.203599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7baa59a7-afc7-44b2-9b01-ef5a75ed28c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:23.205391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7baa59a7-afc7-44b2-9b01-ef5a75ed28c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:23.688427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7baa59a7-afc7-44b2-9b01-ef5a75ed28c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:23.703789 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7baa59a7-afc7-44b2-9b01-ef5a75ed28c2 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1315 microversion: 2.1 time: 0.528154 Feb 19 21:10:23.711301 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2213/4312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:23 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:23.946584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:23.947369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:23.964322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:23.969142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:23.970227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:23.970733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:24.404748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:24.416709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:24.430921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:24.440688 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-43526c91-3e4b-480e-a0c3-b34666443246 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.496526 Feb 19 21:10:24.446474 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2100/4313] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:23 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:24.729441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9173b24b-812a-489c-af48-2601c3700799 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:24.730736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9173b24b-812a-489c-af48-2601c3700799 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:24.746958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9173b24b-812a-489c-af48-2601c3700799 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:24.758013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9173b24b-812a-489c-af48-2601c3700799 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:24.766318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9173b24b-812a-489c-af48-2601c3700799 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:24.769559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9173b24b-812a-489c-af48-2601c3700799 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:25.468790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:25.470077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:25.518221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:25.524388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:25.531708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:25.533798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:27.692882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9173b24b-812a-489c-af48-2601c3700799 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:27.705111 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9173b24b-812a-489c-af48-2601c3700799 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1315 microversion: 2.1 time: 2.979410 Feb 19 21:10:27.710847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2214/4314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:24 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1315 bytes in 2986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:28.577195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:28.611386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:28.618446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:28.624799 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a74a7b92-720f-4889-9fa4-2c8f24a65e0a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 3.158859 Feb 19 21:10:28.627543 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2101/4315] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:25 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 3167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:28.740804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5da97048-f2e3-4dd9-adbf-522499928b48 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:28.741604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5da97048-f2e3-4dd9-adbf-522499928b48 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:28.764266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5da97048-f2e3-4dd9-adbf-522499928b48 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:28.768228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5da97048-f2e3-4dd9-adbf-522499928b48 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:28.772613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5da97048-f2e3-4dd9-adbf-522499928b48 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:28.775806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5da97048-f2e3-4dd9-adbf-522499928b48 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:29.315899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5f4748d3-51d3-47c9-becc-64f7f8d8aaa1 req-4717e1be-4edc-4714-a303-7da93b5fe919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdd5414-93bf-4975-9a3a-3ed8f1ce47de", "name": "network-vif-plugged", "status": "completed", "tag": "80f6391f-5119-41fe-99ce-51986ff3e516"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:29.318551 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:29.318551 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:29.359845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5f4748d3-51d3-47c9-becc-64f7f8d8aaa1 req-4717e1be-4edc-4714-a303-7da93b5fe919 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:29.360813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5da97048-f2e3-4dd9-adbf-522499928b48 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:29.363766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5f4748d3-51d3-47c9-becc-64f7f8d8aaa1 req-4717e1be-4edc-4714-a303-7da93b5fe919 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:29.370233 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5da97048-f2e3-4dd9-adbf-522499928b48 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1315 microversion: 2.1 time: 0.634624 Feb 19 21:10:29.371822 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2215/4316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:28 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:29.412514 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5f4748d3-51d3-47c9-becc-64f7f8d8aaa1 req-4717e1be-4edc-4714-a303-7da93b5fe919 service nova] Creating event network-vif-plugged:80f6391f-5119-41fe-99ce-51986ff3e516 for instance 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de on nch2-master-1 Feb 19 21:10:29.431657 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5f4748d3-51d3-47c9-becc-64f7f8d8aaa1 req-4717e1be-4edc-4714-a303-7da93b5fe919 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120217 Feb 19 21:10:29.436643 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2102/4317] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:29.646355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:29.647294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:29.663332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:29.663789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:29.670886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:29.671932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:30.124256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:30.138786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:30.156541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:30.159532 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-25e6f695-896e-4d05-81ae-c4d6a0ab4fd2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.518157 Feb 19 21:10:30.171839 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2216/4318] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:29 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:30.389068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-492d87ff-592c-454d-9575-e1a85e8b8ff4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:30.390796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-492d87ff-592c-454d-9575-e1a85e8b8ff4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:30.415755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-492d87ff-592c-454d-9575-e1a85e8b8ff4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:30.419905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-492d87ff-592c-454d-9575-e1a85e8b8ff4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:30.421159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-492d87ff-592c-454d-9575-e1a85e8b8ff4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:30.421844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-492d87ff-592c-454d-9575-e1a85e8b8ff4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:30.791329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-492d87ff-592c-454d-9575-e1a85e8b8ff4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:30.811588 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-492d87ff-592c-454d-9575-e1a85e8b8ff4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1315 microversion: 2.1 time: 0.426559 Feb 19 21:10:30.823380 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2103/4319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:30 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:31.179694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:31.181541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:31.200762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:31.201639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:31.202637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:31.203241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:31.524966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:31.550252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:31.565429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:31.568239 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-29eb4cc7-7597-4ca0-8908-8784d4f89e0f tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.392011 Feb 19 21:10:31.580635 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2217/4320] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:31 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:31.831679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4119d87c-01ea-420c-98b3-eb5e4bf71fea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:31.833912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4119d87c-01ea-420c-98b3-eb5e4bf71fea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:31.845957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4119d87c-01ea-420c-98b3-eb5e4bf71fea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:31.848627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4119d87c-01ea-420c-98b3-eb5e4bf71fea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:31.849519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4119d87c-01ea-420c-98b3-eb5e4bf71fea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:31.851908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4119d87c-01ea-420c-98b3-eb5e4bf71fea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:32.296180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4119d87c-01ea-420c-98b3-eb5e4bf71fea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:32.309030 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4119d87c-01ea-420c-98b3-eb5e4bf71fea tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1315 microversion: 2.1 time: 0.483399 Feb 19 21:10:32.309774 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2104/4321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:31 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:32.587229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:32.587994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:32.595126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:32.595892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:32.596969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:32.597802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:32.832869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:32.845113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:32.847069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:32.848862 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2b996f54-2aaf-438a-803b-61ad5fc5414b tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.265250 Feb 19 21:10:32.863611 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2218/4322] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:32 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:33.334127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a5213254-1690-4184-b372-00e9b454cdd9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:33.334725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a5213254-1690-4184-b372-00e9b454cdd9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:33.344648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5213254-1690-4184-b372-00e9b454cdd9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:33.345104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5213254-1690-4184-b372-00e9b454cdd9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:33.345911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5213254-1690-4184-b372-00e9b454cdd9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:33.346348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5213254-1690-4184-b372-00e9b454cdd9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:33.645443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a5213254-1690-4184-b372-00e9b454cdd9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:33.654933 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a5213254-1690-4184-b372-00e9b454cdd9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1502 microversion: 2.1 time: 0.325086 Feb 19 21:10:33.670703 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2105/4323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:33 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1502 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:33.678562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d8db4929-bf2e-45ec-a28b-8e871b970a7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:33.680309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8db4929-bf2e-45ec-a28b-8e871b970a7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:33.696824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8db4929-bf2e-45ec-a28b-8e871b970a7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:33.697523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8db4929-bf2e-45ec-a28b-8e871b970a7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:33.698507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8db4929-bf2e-45ec-a28b-8e871b970a7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:33.704980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8db4929-bf2e-45ec-a28b-8e871b970a7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:33.761156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-d8db4929-bf2e-45ec-a28b-8e871b970a7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lazy-loading 'flavor' on Instance uuid 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:10:33.870914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:33.871978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:33.879726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:33.881262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:33.882983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:33.883595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:33.901696 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d8db4929-bf2e-45ec-a28b-8e871b970a7d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "POST /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de/action" status: 202 len: 0 microversion: 2.1 time: 0.232512 Feb 19 21:10:33.903048 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2219/4324] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:10:33 2022] POST /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:10:33.919018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-80117cc0-9d1a-4a4a-99fa-e783015aadc9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:33.920009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-80117cc0-9d1a-4a4a-99fa-e783015aadc9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:33.933999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80117cc0-9d1a-4a4a-99fa-e783015aadc9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:33.940582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80117cc0-9d1a-4a4a-99fa-e783015aadc9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:33.941467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80117cc0-9d1a-4a4a-99fa-e783015aadc9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:33.941905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-80117cc0-9d1a-4a4a-99fa-e783015aadc9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:34.326207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:34.341628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:34.343232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:34.344507 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7953cf7c-1d2c-4925-8a11-ac99c182af8c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.478541 Feb 19 21:10:34.345307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-80117cc0-9d1a-4a4a-99fa-e783015aadc9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:34.356152 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2106/4325] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:33 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:34.356488 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-80117cc0-9d1a-4a4a-99fa-e783015aadc9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1510 microversion: 2.1 time: 0.449331 Feb 19 21:10:34.368403 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2220/4326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:33 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1510 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:35.383251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9c4ebdb7-9044-494a-a83e-8cdb659adee4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:35.383980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:35.384803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:35.385529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9c4ebdb7-9044-494a-a83e-8cdb659adee4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:35.393404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c4ebdb7-9044-494a-a83e-8cdb659adee4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:35.394830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c4ebdb7-9044-494a-a83e-8cdb659adee4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:35.395982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c4ebdb7-9044-494a-a83e-8cdb659adee4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:35.396729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c4ebdb7-9044-494a-a83e-8cdb659adee4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:35.397423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:35.397896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:35.399194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:35.402329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:35.965275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9c4ebdb7-9044-494a-a83e-8cdb659adee4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:35.981727 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9c4ebdb7-9044-494a-a83e-8cdb659adee4 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1493 microversion: 2.1 time: 0.602589 Feb 19 21:10:36.002055 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2221/4327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:35 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1493 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:36.012289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-daa3f3fc-8990-4d2d-9492-e3629c590321 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:36.012845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:36.013160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-daa3f3fc-8990-4d2d-9492-e3629c590321 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:36.025842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:36.027942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:36.031519 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-79fc3656-982c-4c33-a229-3b0abe21b7e7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.653826 Feb 19 21:10:36.033654 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2107/4328] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:35 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:36.034692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-daa3f3fc-8990-4d2d-9492-e3629c590321 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:36.041028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-daa3f3fc-8990-4d2d-9492-e3629c590321 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:36.041991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-daa3f3fc-8990-4d2d-9492-e3629c590321 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:36.042441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-daa3f3fc-8990-4d2d-9492-e3629c590321 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:36.116168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-daa3f3fc-8990-4d2d-9492-e3629c590321 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:10:36.299470 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-daa3f3fc-8990-4d2d-9492-e3629c590321 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 204 len: 0 microversion: 2.1 time: 0.296024 Feb 19 21:10:36.301076 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2222/4329] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:10:36 2022] DELETE /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:10:36.310648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-97091f80-10e9-40db-a091-7a24c031d633 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:36.311439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-97091f80-10e9-40db-a091-7a24c031d633 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:36.311950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2197e5ab-6df7-4b28-ad19-75721c2a08ab tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-795529258", "availability_zone": "foo_zone"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:36.319318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97091f80-10e9-40db-a091-7a24c031d633 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:36.319866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97091f80-10e9-40db-a091-7a24c031d633 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:36.320807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97091f80-10e9-40db-a091-7a24c031d633 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:36.321347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97091f80-10e9-40db-a091-7a24c031d633 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:36.341338 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:36.341338 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:36.366690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.aggregate [None req-2197e5ab-6df7-4b28-ad19-75721c2a08ab tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Generated uuid 02afffc5-5024-4867-89ef-20c332d14697 for aggregate {{(pid=136095) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 19 21:10:36.417235 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2197e5ab-6df7-4b28-ad19-75721c2a08ab tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.376109 Feb 19 21:10:36.431266 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2108/4330] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Feb 19 21:10:36 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:10:36.436099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f5acfc9-1ce3-49bb-9811-1811fb71b841 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:36.437405 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:36.437405 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:36.471099 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8f5acfc9-1ce3-49bb-9811-1811fb71b841 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.038595 Feb 19 21:10:36.473910 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2109/4331] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 21:10:36 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:36.487857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-925de3e5-4b49-4c6c-b71f-801acc8f4b64 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:36.489846 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:36.489846 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:36.492128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-925de3e5-4b49-4c6c-b71f-801acc8f4b64 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:36.492978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-925de3e5-4b49-4c6c-b71f-801acc8f4b64 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:36.494226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-925de3e5-4b49-4c6c-b71f-801acc8f4b64 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:36.494934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-925de3e5-4b49-4c6c-b71f-801acc8f4b64 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:36.539080 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-925de3e5-4b49-4c6c-b71f-801acc8f4b64 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056331 Feb 19 21:10:36.543389 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2110/4332] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Feb 19 21:10:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:36.550138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2950294a-0f12-41f4-ae22-68d1443a5526 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:36.552126 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:36.552126 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:36.559744 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2950294a-0f12-41f4-ae22-68d1443a5526 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013415 Feb 19 21:10:36.560844 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2111/4333] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Feb 19 21:10:36 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:10:36.572210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-964569ef-b18e-48b1-b5d5-c7d523a377e3 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:36.573665 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:36.573665 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:36.586636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-97091f80-10e9-40db-a091-7a24c031d633 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:36.595225 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-97091f80-10e9-40db-a091-7a24c031d633 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1499 microversion: 2.1 time: 0.289452 Feb 19 21:10:36.596538 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2223/4334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:36 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1499 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:36.604945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-964569ef-b18e-48b1-b5d5-c7d523a377e3 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:36.605868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-964569ef-b18e-48b1-b5d5-c7d523a377e3 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:36.855769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1381848215", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:36.922192 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-964569ef-b18e-48b1-b5d5-c7d523a377e3 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.353971 Feb 19 21:10:36.929110 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2112/4335] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 21:10:36 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:36.929459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:10:36.937636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-de84fc89-8b9f-496f-9dcb-e28975685b33 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:36.938401 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:36.938401 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:36.948412 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-de84fc89-8b9f-496f-9dcb-e28975685b33 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.014843 Feb 19 21:10:36.949021 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2113/4336] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:10:36 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:36.960393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-935954f8-1929-4685-92a8-05c23b367519 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-318284993", "availability_zone": "foo_zone"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:37.056241 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:37.056241 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:37.184562 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-935954f8-1929-4685-92a8-05c23b367519 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.228654 Feb 19 21:10:37.188360 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2114/4337] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Feb 19 21:10:36 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:37.195485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:37.196522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:37.209638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:37.210442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:37.211478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:37.212292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:37.439799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:10:37.441401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:10:37.442096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:10:37.442946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:10:37.443577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:10:37.453830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:37.454499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:37.455242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:37.455687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:37.477690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Getting quotas for project 463a97fa588d4fc2bb01401ca0fcb8aa. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:10:37.483147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:37.492928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Getting quotas for user 52c7a837477849768d5a90636fddf7b4 and project 463a97fa588d4fc2bb01401ca0fcb8aa. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:10:37.494466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:37.496417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:37.498033 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-25e75566-f5c2-48e9-9bb2-7a65e9f6726a tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1733 microversion: 2.20 time: 0.308422 Feb 19 21:10:37.498753 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2115/4338] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:37 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1733 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:37.510948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:10:37.514264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:10:37.515236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8b215d43-739e-4e4a-89e6-a2dda220894d tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:37.521388 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:37.521388 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:37.552162 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8b215d43-739e-4e4a-89e6-a2dda220894d tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.040927 Feb 19 21:10:37.553419 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2116/4339] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 21:10:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:37.564131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0faab141-9203-4839-a621-414f3eae8624 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:37.565048 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:37.565048 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:37.575561 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0faab141-9203-4839-a621-414f3eae8624 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.016020 Feb 19 21:10:37.576163 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2117/4340] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:10:37 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:37.585232 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-358a1f2d-d938-4bfb-a95a-cd9720fcb10f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735723 Feb 19 21:10:37.587591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5e1d4362-924c-4450-ad3d-c0bf7c519d20 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:37.588856 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:37.588856 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:37.592478 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2224/4341] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:10:37.597437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c5493f94-8679-4ac0-a10d-4dd3194f94e8 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:37.598788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c5493f94-8679-4ac0-a10d-4dd3194f94e8 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:37.611647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e1d4362-924c-4450-ad3d-c0bf7c519d20 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:37.612105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5e1d4362-924c-4450-ad3d-c0bf7c519d20 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:37.740617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c5493f94-8679-4ac0-a10d-4dd3194f94e8 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:37.771270 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c5493f94-8679-4ac0-a10d-4dd3194f94e8 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1214 microversion: 2.1 time: 0.175642 Feb 19 21:10:37.773837 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2225/4342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:37 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:37.783461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3fe92b51-48e2-4b8a-a1d8-f8203368e87f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:37.786238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3fe92b51-48e2-4b8a-a1d8-f8203368e87f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:37.810792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe92b51-48e2-4b8a-a1d8-f8203368e87f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:37.812654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe92b51-48e2-4b8a-a1d8-f8203368e87f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:37.813808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe92b51-48e2-4b8a-a1d8-f8203368e87f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:37.814857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3fe92b51-48e2-4b8a-a1d8-f8203368e87f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:37.848773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5e1d4362-924c-4450-ad3d-c0bf7c519d20 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.264688 Feb 19 21:10:37.861195 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2118/4343] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Feb 19 21:10:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:10:37.884628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b5e1ca67-f619-44ed-a8c5-cfa84621e452 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:37.893310 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:37.893310 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:37.943720 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b5e1ca67-f619-44ed-a8c5-cfa84621e452 tempest-TestAggregatesBasicOps-574073414 tempest-TestAggregatesBasicOps-574073414-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.081133 Feb 19 21:10:37.944615 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2119/4344] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Feb 19 21:10:37 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 19 21:10:37.954942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-eb1c8751-3f31-4563-a827-f58089203f37 req-9e3f2fb2-37d4-43f2-8ce8-3ae89c7cefa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9598d4a9-3a39-4e96-b6ea-d437e2050247", "name": "network-vif-plugged", "status": "completed", "tag": "705d433e-42c6-442d-adce-cb0486512277"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:37.956553 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:37.956553 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:37.965773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-eb1c8751-3f31-4563-a827-f58089203f37 req-9e3f2fb2-37d4-43f2-8ce8-3ae89c7cefa4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:37.966580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-eb1c8751-3f31-4563-a827-f58089203f37 req-9e3f2fb2-37d4-43f2-8ce8-3ae89c7cefa4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:37.985043 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-eb1c8751-3f31-4563-a827-f58089203f37 req-9e3f2fb2-37d4-43f2-8ce8-3ae89c7cefa4 service nova] Creating event network-vif-plugged:705d433e-42c6-442d-adce-cb0486512277 for instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 on nch1-master-1 Feb 19 21:10:37.992120 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-eb1c8751-3f31-4563-a827-f58089203f37 req-9e3f2fb2-37d4-43f2-8ce8-3ae89c7cefa4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041087 Feb 19 21:10:37.993054 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2120/4345] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:38.517849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:38.518653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:38.536024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:38.536209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:38.539953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:38.540517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:39.172452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3fe92b51-48e2-4b8a-a1d8-f8203368e87f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20246495a35b4762be5b2ad98f537377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f81dcc5d52473ab53817e20df04cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:39.180273 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3fe92b51-48e2-4b8a-a1d8-f8203368e87f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 200 len: 1499 microversion: 2.1 time: 1.404309 Feb 19 21:10:39.183882 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2226/4346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:37 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 1499 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:39.199912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-78f443ab-a4be-417a-b07d-339e422d93c4 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:39.212649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-78f443ab-a4be-417a-b07d-339e422d93c4 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:39.219023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78f443ab-a4be-417a-b07d-339e422d93c4 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:39.219646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78f443ab-a4be-417a-b07d-339e422d93c4 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:39.220591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78f443ab-a4be-417a-b07d-339e422d93c4 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:39.221167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78f443ab-a4be-417a-b07d-339e422d93c4 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:39.326141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-78f443ab-a4be-417a-b07d-339e422d93c4 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:39.342370 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-78f443ab-a4be-417a-b07d-339e422d93c4 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1210 microversion: 2.1 time: 0.146140 Feb 19 21:10:39.343218 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2227/4347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:39 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1210 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:39.356592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:39.367199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:39.368778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:39.370028 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-79a15715-ab57-4b03-a417-44c6ca9a88c5 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.857286 Feb 19 21:10:39.370579 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2121/4348] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:38 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:10:39.414250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-fde38f90-2fb0-4f6a-8d10-58748d318c84 req-f845a936-fc35-473f-bdfc-0e934f4967fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdd5414-93bf-4975-9a3a-3ed8f1ce47de", "name": "network-vif-deleted", "tag": "80f6391f-5119-41fe-99ce-51986ff3e516"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:39.418552 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:39.418552 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:10:39.431479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fde38f90-2fb0-4f6a-8d10-58748d318c84 req-f845a936-fc35-473f-bdfc-0e934f4967fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:39.433748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fde38f90-2fb0-4f6a-8d10-58748d318c84 req-f845a936-fc35-473f-bdfc-0e934f4967fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:39.454786 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-fde38f90-2fb0-4f6a-8d10-58748d318c84 req-f845a936-fc35-473f-bdfc-0e934f4967fe service nova] Creating event network-vif-deleted:80f6391f-5119-41fe-99ce-51986ff3e516 for instance 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de on nch2-master-1 Feb 19 21:10:39.463662 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-fde38f90-2fb0-4f6a-8d10-58748d318c84 req-f845a936-fc35-473f-bdfc-0e934f4967fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053742 Feb 19 21:10:39.465056 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2228/4349] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:40.202105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d59b5362-4d33-463c-aa1a-ae13c9e82d7e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.203620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d59b5362-4d33-463c-aa1a-ae13c9e82d7e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.212903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d59b5362-4d33-463c-aa1a-ae13c9e82d7e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.214414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d59b5362-4d33-463c-aa1a-ae13c9e82d7e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.222268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d59b5362-4d33-463c-aa1a-ae13c9e82d7e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.226461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d59b5362-4d33-463c-aa1a-ae13c9e82d7e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.263320 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-d59b5362-4d33-463c-aa1a-ae13c9e82d7e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de could not be found. Feb 19 21:10:40.265813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d59b5362-4d33-463c-aa1a-ae13c9e82d7e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:40.268857 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d59b5362-4d33-463c-aa1a-ae13c9e82d7e tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 404 len: 111 microversion: 2.1 time: 0.070288 Feb 19 21:10:40.276071 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2122/4350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:40 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:40.281209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00f78ff1-4c8c-41eb-9028-9f9dcc4f36fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.281803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-00f78ff1-4c8c-41eb-9028-9f9dcc4f36fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.292221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00f78ff1-4c8c-41eb-9028-9f9dcc4f36fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.292709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00f78ff1-4c8c-41eb-9028-9f9dcc4f36fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.293502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00f78ff1-4c8c-41eb-9028-9f9dcc4f36fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.293940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00f78ff1-4c8c-41eb-9028-9f9dcc4f36fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.353756 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-00f78ff1-4c8c-41eb-9028-9f9dcc4f36fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de could not be found. Feb 19 21:10:40.354371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00f78ff1-4c8c-41eb-9028-9f9dcc4f36fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:40.355222 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-00f78ff1-4c8c-41eb-9028-9f9dcc4f36fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 404 len: 111 microversion: 2.1 time: 0.078201 Feb 19 21:10:40.360513 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2229/4351] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:10:40 2022] DELETE /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:40.365447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6dcb8229-b91c-4e78-9af7-7fcdfa63ed23 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.366088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6dcb8229-b91c-4e78-9af7-7fcdfa63ed23 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.373999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0d510f2a-6700-47db-9d79-06763208288f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.374527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0d510f2a-6700-47db-9d79-06763208288f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.381767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dcb8229-b91c-4e78-9af7-7fcdfa63ed23 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.382207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dcb8229-b91c-4e78-9af7-7fcdfa63ed23 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.383023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dcb8229-b91c-4e78-9af7-7fcdfa63ed23 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.383462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6dcb8229-b91c-4e78-9af7-7fcdfa63ed23 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.390058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d510f2a-6700-47db-9d79-06763208288f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.391201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d510f2a-6700-47db-9d79-06763208288f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.393247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d510f2a-6700-47db-9d79-06763208288f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.393960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d510f2a-6700-47db-9d79-06763208288f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.428465 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-6dcb8229-b91c-4e78-9af7-7fcdfa63ed23 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de could not be found. Feb 19 21:10:40.429074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6dcb8229-b91c-4e78-9af7-7fcdfa63ed23 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 9cdd5414-93bf-4975-9a3a-3ed8f1ce47de could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:40.429921 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6dcb8229-b91c-4e78-9af7-7fcdfa63ed23 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de" status: 404 len: 111 microversion: 2.1 time: 0.068404 Feb 19 21:10:40.430495 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2230/4352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:40 2022] GET /compute/v2.1/servers/9cdd5414-93bf-4975-9a3a-3ed8f1ce47de => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:40.449022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.449642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.466940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.467399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.468227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.468686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.505963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0d510f2a-6700-47db-9d79-06763208288f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:40.520811 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0d510f2a-6700-47db-9d79-06763208288f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1272 microversion: 2.1 time: 0.159062 Feb 19 21:10:40.523986 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2123/4353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:40 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:40.540437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40a7beb7-4d64-4390-af5e-2644298774d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.541330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-40a7beb7-4d64-4390-af5e-2644298774d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.551925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40a7beb7-4d64-4390-af5e-2644298774d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.553037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40a7beb7-4d64-4390-af5e-2644298774d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.554443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40a7beb7-4d64-4390-af5e-2644298774d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.555612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40a7beb7-4d64-4390-af5e-2644298774d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.596925 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-40a7beb7-4d64-4390-af5e-2644298774d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 366afc42-f8b8-4a45-99b9-f9203f39d3a5 could not be found. Feb 19 21:10:40.598907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40a7beb7-4d64-4390-af5e-2644298774d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 366afc42-f8b8-4a45-99b9-f9203f39d3a5 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:40.599992 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-40a7beb7-4d64-4390-af5e-2644298774d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 404 len: 111 microversion: 2.1 time: 0.063704 Feb 19 21:10:40.600852 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2124/4354] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:10:40 2022] DELETE /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:40.612464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-705c8fd9-d829-4a02-a7e3-524e847b9084 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.614301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-705c8fd9-d829-4a02-a7e3-524e847b9084 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 366afc42-f8b8-4a45-99b9-f9203f39d3a5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.623619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-705c8fd9-d829-4a02-a7e3-524e847b9084 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.624539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-705c8fd9-d829-4a02-a7e3-524e847b9084 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.625885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-705c8fd9-d829-4a02-a7e3-524e847b9084 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.626615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-705c8fd9-d829-4a02-a7e3-524e847b9084 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.651233 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-705c8fd9-d829-4a02-a7e3-524e847b9084 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 366afc42-f8b8-4a45-99b9-f9203f39d3a5 could not be found. Feb 19 21:10:40.652167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-705c8fd9-d829-4a02-a7e3-524e847b9084 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 366afc42-f8b8-4a45-99b9-f9203f39d3a5 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:40.653890 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-705c8fd9-d829-4a02-a7e3-524e847b9084 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5" status: 404 len: 111 microversion: 2.1 time: 0.045622 Feb 19 21:10:40.654760 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2125/4355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:40 2022] GET /compute/v2.1/servers/366afc42-f8b8-4a45-99b9-f9203f39d3a5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:40.666547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c71e275c-727d-438a-a42c-eb72253c5e87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.667317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c71e275c-727d-438a-a42c-eb72253c5e87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.674875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c71e275c-727d-438a-a42c-eb72253c5e87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.675810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c71e275c-727d-438a-a42c-eb72253c5e87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.677049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c71e275c-727d-438a-a42c-eb72253c5e87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.677836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c71e275c-727d-438a-a42c-eb72253c5e87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.719337 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c71e275c-727d-438a-a42c-eb72253c5e87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 6f620150-4262-4d39-9937-e1f00ea04a88 could not be found. Feb 19 21:10:40.719969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c71e275c-727d-438a-a42c-eb72253c5e87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 6f620150-4262-4d39-9937-e1f00ea04a88 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:40.724591 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c71e275c-727d-438a-a42c-eb72253c5e87 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 404 len: 111 microversion: 2.1 time: 0.062937 Feb 19 21:10:40.725177 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2126/4356] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:10:40 2022] DELETE /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:40.733990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61b3134e-6e69-425e-ab4d-95da81eb8f1f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.734609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-61b3134e-6e69-425e-ab4d-95da81eb8f1f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 6f620150-4262-4d39-9937-e1f00ea04a88] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.754132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61b3134e-6e69-425e-ab4d-95da81eb8f1f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.754743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61b3134e-6e69-425e-ab4d-95da81eb8f1f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.755814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61b3134e-6e69-425e-ab4d-95da81eb8f1f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.756248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61b3134e-6e69-425e-ab4d-95da81eb8f1f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.788447 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-61b3134e-6e69-425e-ab4d-95da81eb8f1f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 6f620150-4262-4d39-9937-e1f00ea04a88 could not be found. Feb 19 21:10:40.791097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61b3134e-6e69-425e-ab4d-95da81eb8f1f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 6f620150-4262-4d39-9937-e1f00ea04a88 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:40.794407 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-61b3134e-6e69-425e-ab4d-95da81eb8f1f tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88" status: 404 len: 111 microversion: 2.1 time: 0.063551 Feb 19 21:10:40.800957 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2127/4357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:40 2022] GET /compute/v2.1/servers/6f620150-4262-4d39-9937-e1f00ea04a88 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:40.813786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-230bf2b9-53d3-4de3-a77f-71eebe47f6d3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.815953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-230bf2b9-53d3-4de3-a77f-71eebe47f6d3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.833940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-230bf2b9-53d3-4de3-a77f-71eebe47f6d3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.835856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-230bf2b9-53d3-4de3-a77f-71eebe47f6d3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.841449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-230bf2b9-53d3-4de3-a77f-71eebe47f6d3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.841911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-230bf2b9-53d3-4de3-a77f-71eebe47f6d3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.884123 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-230bf2b9-53d3-4de3-a77f-71eebe47f6d3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 1e830f7e-f576-4d1a-8d33-16ac817471c9 could not be found. Feb 19 21:10:40.885461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-230bf2b9-53d3-4de3-a77f-71eebe47f6d3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 1e830f7e-f576-4d1a-8d33-16ac817471c9 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:40.887489 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-230bf2b9-53d3-4de3-a77f-71eebe47f6d3 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 404 len: 111 microversion: 2.1 time: 0.084223 Feb 19 21:10:40.892168 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2128/4358] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:10:40 2022] DELETE /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:40.929438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f2c04f93-b9cf-4f62-95a1-2c1930c884c1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:40.930404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f2c04f93-b9cf-4f62-95a1-2c1930c884c1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 1e830f7e-f576-4d1a-8d33-16ac817471c9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:40.965103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2c04f93-b9cf-4f62-95a1-2c1930c884c1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.966038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2c04f93-b9cf-4f62-95a1-2c1930c884c1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.967457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2c04f93-b9cf-4f62-95a1-2c1930c884c1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:40.968093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2c04f93-b9cf-4f62-95a1-2c1930c884c1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:40.986386 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-f2c04f93-b9cf-4f62-95a1-2c1930c884c1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 1e830f7e-f576-4d1a-8d33-16ac817471c9 could not be found. Feb 19 21:10:40.987412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f2c04f93-b9cf-4f62-95a1-2c1930c884c1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 1e830f7e-f576-4d1a-8d33-16ac817471c9 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:40.988710 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f2c04f93-b9cf-4f62-95a1-2c1930c884c1 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9" status: 404 len: 111 microversion: 2.1 time: 0.068424 Feb 19 21:10:40.994088 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2129/4359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:40 2022] GET /compute/v2.1/servers/1e830f7e-f576-4d1a-8d33-16ac817471c9 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:41.014093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-333be9f9-89d1-45c8-8903-e58bbf303e7a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:41.017630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-333be9f9-89d1-45c8-8903-e58bbf303e7a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:41.039617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-333be9f9-89d1-45c8-8903-e58bbf303e7a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:41.043326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-333be9f9-89d1-45c8-8903-e58bbf303e7a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:41.046094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-333be9f9-89d1-45c8-8903-e58bbf303e7a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:41.046763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-333be9f9-89d1-45c8-8903-e58bbf303e7a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:41.090359 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-333be9f9-89d1-45c8-8903-e58bbf303e7a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a could not be found. Feb 19 21:10:41.109929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-333be9f9-89d1-45c8-8903-e58bbf303e7a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:41.112797 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-333be9f9-89d1-45c8-8903-e58bbf303e7a tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a" status: 404 len: 111 microversion: 2.1 time: 0.115913 Feb 19 21:10:41.121008 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2130/4360] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:10:40 2022] DELETE /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:41.126699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:41.134866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f4d31a1-f5c4-4749-bee0-a8d6598f65fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:41.135390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:41.135546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f4d31a1-f5c4-4749-bee0-a8d6598f65fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:41.136987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:41.138172 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3088d002-d499-4c19-b84e-69df99731f86 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1729 microversion: 2.20 time: 0.692918 Feb 19 21:10:41.154702 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2231/4361] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:40 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1729 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:41.171926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f4d31a1-f5c4-4749-bee0-a8d6598f65fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:41.177270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f4d31a1-f5c4-4749-bee0-a8d6598f65fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:41.178201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f4d31a1-f5c4-4749-bee0-a8d6598f65fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:41.180106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f4d31a1-f5c4-4749-bee0-a8d6598f65fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:41.227471 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-3f4d31a1-f5c4-4749-bee0-a8d6598f65fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a could not be found. Feb 19 21:10:41.228172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f4d31a1-f5c4-4749-bee0-a8d6598f65fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 43e5f8b6-0d5f-4909-94fc-ae4d5d88117a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:41.234378 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f4d31a1-f5c4-4749-bee0-a8d6598f65fc tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a" status: 404 len: 111 microversion: 2.1 time: 0.112157 Feb 19 21:10:41.234995 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2131/4362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:41 2022] GET /compute/v2.1/servers/43e5f8b6-0d5f-4909-94fc-ae4d5d88117a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:41.540697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-806ee8a7-d948-47b1-bde7-627a9a3e23d7 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:41.541895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-806ee8a7-d948-47b1-bde7-627a9a3e23d7 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:41.557839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-806ee8a7-d948-47b1-bde7-627a9a3e23d7 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:41.558310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-806ee8a7-d948-47b1-bde7-627a9a3e23d7 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:41.559128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-806ee8a7-d948-47b1-bde7-627a9a3e23d7 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:41.559569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-806ee8a7-d948-47b1-bde7-627a9a3e23d7 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:41.801353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-806ee8a7-d948-47b1-bde7-627a9a3e23d7 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:41.811963 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-806ee8a7-d948-47b1-bde7-627a9a3e23d7 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1272 microversion: 2.1 time: 0.274963 Feb 19 21:10:41.812958 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2232/4363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:41 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:42.173502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:42.174129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:42.185210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.185675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.186498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.186947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.397712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:42.418860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:42.428153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:42.430921 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-308e37c3-9cf7-4015-8bd8-b2ad7f33a90c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1716 microversion: 2.20 time: 0.260931 Feb 19 21:10:42.432135 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2132/4364] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:10:42 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1716 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:10:42.451968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e209a448-900b-4cc4-a94f-a6462f7fc54b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:42.455382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e209a448-900b-4cc4-a94f-a6462f7fc54b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:42.463739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e209a448-900b-4cc4-a94f-a6462f7fc54b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.464445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e209a448-900b-4cc4-a94f-a6462f7fc54b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.465424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e209a448-900b-4cc4-a94f-a6462f7fc54b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.467049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e209a448-900b-4cc4-a94f-a6462f7fc54b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.488810 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e209a448-900b-4cc4-a94f-a6462f7fc54b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 could not be found. Feb 19 21:10:42.490726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e209a448-900b-4cc4-a94f-a6462f7fc54b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:42.492300 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e209a448-900b-4cc4-a94f-a6462f7fc54b tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 404 len: 111 microversion: 2.1 time: 0.046248 Feb 19 21:10:42.494012 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2233/4365] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:10:42 2022] DELETE /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:42.506373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-99e66f4c-ff52-4d88-9631-4b2bede88d9d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:42.507376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-99e66f4c-ff52-4d88-9631-4b2bede88d9d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: dc1a6553-3c84-44a4-a3f7-159e22f8c9e2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:42.515242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99e66f4c-ff52-4d88-9631-4b2bede88d9d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.516059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99e66f4c-ff52-4d88-9631-4b2bede88d9d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.517320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99e66f4c-ff52-4d88-9631-4b2bede88d9d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.518006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-99e66f4c-ff52-4d88-9631-4b2bede88d9d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.536844 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-99e66f4c-ff52-4d88-9631-4b2bede88d9d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 could not be found. Feb 19 21:10:42.537893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-99e66f4c-ff52-4d88-9631-4b2bede88d9d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:42.539253 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-99e66f4c-ff52-4d88-9631-4b2bede88d9d tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2" status: 404 len: 111 microversion: 2.1 time: 0.039163 Feb 19 21:10:42.540281 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2133/4366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:42 2022] GET /compute/v2.1/servers/dc1a6553-3c84-44a4-a3f7-159e22f8c9e2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:42.552967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4b71b7d-6ad1-449f-8094-d808709328d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:42.553705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e4b71b7d-6ad1-449f-8094-d808709328d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:42.566231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4b71b7d-6ad1-449f-8094-d808709328d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.566917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4b71b7d-6ad1-449f-8094-d808709328d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.568465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4b71b7d-6ad1-449f-8094-d808709328d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.569366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4b71b7d-6ad1-449f-8094-d808709328d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.596915 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e4b71b7d-6ad1-449f-8094-d808709328d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 76ca5e86-5e05-49e1-a775-7d5553410ecb could not be found. Feb 19 21:10:42.598691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4b71b7d-6ad1-449f-8094-d808709328d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 76ca5e86-5e05-49e1-a775-7d5553410ecb could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:42.600433 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e4b71b7d-6ad1-449f-8094-d808709328d9 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 404 len: 111 microversion: 2.1 time: 0.055071 Feb 19 21:10:42.601968 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2234/4367] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:10:42 2022] DELETE /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:42.611699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d303259c-04c1-4101-ac89-78a1aa81c353 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:42.612688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d303259c-04c1-4101-ac89-78a1aa81c353 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] [instance: 76ca5e86-5e05-49e1-a775-7d5553410ecb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:42.621786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d303259c-04c1-4101-ac89-78a1aa81c353 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.621786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d303259c-04c1-4101-ac89-78a1aa81c353 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.621786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d303259c-04c1-4101-ac89-78a1aa81c353 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.621786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d303259c-04c1-4101-ac89-78a1aa81c353 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.658190 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-d303259c-04c1-4101-ac89-78a1aa81c353 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] HTTP exception thrown: Instance 76ca5e86-5e05-49e1-a775-7d5553410ecb could not be found. Feb 19 21:10:42.659074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d303259c-04c1-4101-ac89-78a1aa81c353 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] Returning 404 to user: Instance 76ca5e86-5e05-49e1-a775-7d5553410ecb could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:10:42.660792 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d303259c-04c1-4101-ac89-78a1aa81c353 tempest-DeleteServersTestJSON-1663057627 tempest-DeleteServersTestJSON-1663057627-project] 10.222.0.30 "GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb" status: 404 len: 111 microversion: 2.1 time: 0.053417 Feb 19 21:10:42.665464 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2134/4368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:42 2022] GET /compute/v2.1/servers/76ca5e86-5e05-49e1-a775-7d5553410ecb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:10:42.829963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96c318c3-9a86-44dc-928b-5c071bce4cf5 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:42.830909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-96c318c3-9a86-44dc-928b-5c071bce4cf5 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:42.839633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c318c3-9a86-44dc-928b-5c071bce4cf5 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.840406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c318c3-9a86-44dc-928b-5c071bce4cf5 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:42.841586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c318c3-9a86-44dc-928b-5c071bce4cf5 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:42.842449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c318c3-9a86-44dc-928b-5c071bce4cf5 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:43.144252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-96c318c3-9a86-44dc-928b-5c071bce4cf5 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:43.157053 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96c318c3-9a86-44dc-928b-5c071bce4cf5 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1314 microversion: 2.1 time: 0.329111 Feb 19 21:10:43.161966 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2235/4369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:42 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:44.184656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-70445b26-0d44-4093-8e4a-2e7e16bb337b tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:44.186334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-70445b26-0d44-4093-8e4a-2e7e16bb337b tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:44.203270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70445b26-0d44-4093-8e4a-2e7e16bb337b tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:44.203840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70445b26-0d44-4093-8e4a-2e7e16bb337b tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:44.204567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70445b26-0d44-4093-8e4a-2e7e16bb337b tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:44.205009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70445b26-0d44-4093-8e4a-2e7e16bb337b tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:44.519911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-70445b26-0d44-4093-8e4a-2e7e16bb337b tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:44.555768 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-70445b26-0d44-4093-8e4a-2e7e16bb337b tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1314 microversion: 2.1 time: 0.381363 Feb 19 21:10:44.557108 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2135/4370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:44 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:44.978852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-60ebfe0c-9c32-4024-a77d-dd0e263e3066 req-0f7c9123-cbb8-4828-ad9f-636ad56ca5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fbc665c-bed1-40cf-a142-b1d8fae201e6", "tag": "1dfaf2c3-a63e-4dde-890c-bade6dd9c52c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:44.987647 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:44.987647 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:10:45.014780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-60ebfe0c-9c32-4024-a77d-dd0e263e3066 req-0f7c9123-cbb8-4828-ad9f-636ad56ca5f1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:45.017723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-60ebfe0c-9c32-4024-a77d-dd0e263e3066 req-0f7c9123-cbb8-4828-ad9f-636ad56ca5f1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:45.052913 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-60ebfe0c-9c32-4024-a77d-dd0e263e3066 req-0f7c9123-cbb8-4828-ad9f-636ad56ca5f1 service nova] Creating event network-changed:1dfaf2c3-a63e-4dde-890c-bade6dd9c52c for instance 5fbc665c-bed1-40cf-a142-b1d8fae201e6 on nch1-master-1 Feb 19 21:10:45.075979 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-60ebfe0c-9c32-4024-a77d-dd0e263e3066 req-0f7c9123-cbb8-4828-ad9f-636ad56ca5f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103705 Feb 19 21:10:45.077286 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2236/4371] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:45.577054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fca84692-8b0b-415f-9466-f745384f9406 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:45.577054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fca84692-8b0b-415f-9466-f745384f9406 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:45.593321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fca84692-8b0b-415f-9466-f745384f9406 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:45.594097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fca84692-8b0b-415f-9466-f745384f9406 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:45.594918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fca84692-8b0b-415f-9466-f745384f9406 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:45.595359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fca84692-8b0b-415f-9466-f745384f9406 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:45.894272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fca84692-8b0b-415f-9466-f745384f9406 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:45.903058 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fca84692-8b0b-415f-9466-f745384f9406 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1314 microversion: 2.1 time: 0.332832 Feb 19 21:10:45.915497 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2136/4372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:45 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:46.922885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-65a55c17-6d23-4762-bcd1-4ae067ff276a tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:46.923723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-65a55c17-6d23-4762-bcd1-4ae067ff276a tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:46.931180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65a55c17-6d23-4762-bcd1-4ae067ff276a tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:46.931734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65a55c17-6d23-4762-bcd1-4ae067ff276a tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:46.932684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65a55c17-6d23-4762-bcd1-4ae067ff276a tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:46.933324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65a55c17-6d23-4762-bcd1-4ae067ff276a tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:47.195068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-65a55c17-6d23-4762-bcd1-4ae067ff276a tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:47.208089 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-65a55c17-6d23-4762-bcd1-4ae067ff276a tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1314 microversion: 2.1 time: 0.289083 Feb 19 21:10:47.210403 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2237/4373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:46 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:47.748009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2018738622", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "530ab937-7c94-4c19-a3c3-ff58dabc202f"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:47.836555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] validate_networks() for [('530ab937-7c94-4c19-a3c3-ff58dabc202f', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:10:48.226557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d86cba02-84f1-4b78-8174-09069ca51c4f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:48.227955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d86cba02-84f1-4b78-8174-09069ca51c4f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:48.264631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d86cba02-84f1-4b78-8174-09069ca51c4f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:48.265372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d86cba02-84f1-4b78-8174-09069ca51c4f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:48.266743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d86cba02-84f1-4b78-8174-09069ca51c4f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:48.267606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d86cba02-84f1-4b78-8174-09069ca51c4f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:48.578591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d86cba02-84f1-4b78-8174-09069ca51c4f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:48.586996 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d86cba02-84f1-4b78-8174-09069ca51c4f tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1314 microversion: 2.1 time: 0.365087 Feb 19 21:10:48.593732 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2238/4374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:48 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:48.622426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:10:48.622868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:10:48.623566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:10:48.624018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:10:48.625780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:10:48.662059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:48.663662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:48.664801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:48.665433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:48.689920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Getting quotas for project 85755c1b89f44eb0a4db800f8bf319f0. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:10:48.696666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Getting quotas for user 664f926973a242fcad5a2f1a02f773d7 and project 85755c1b89f44eb0a4db800f8bf319f0. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:10:48.717915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:10:48.720799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:10:48.802490 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c8515861-a5c8-44ec-bfb3-dc3cb92d3086 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381863 Feb 19 21:10:48.803552 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2137/4375] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:10:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:10:49.037133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1835230968", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "530ab937-7c94-4c19-a3c3-ff58dabc202f"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:49.154192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] validate_networks() for [('530ab937-7c94-4c19-a3c3-ff58dabc202f', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:10:49.610825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eb7e4a94-6ece-413e-a7b6-6b5e9de660c9 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:49.611847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eb7e4a94-6ece-413e-a7b6-6b5e9de660c9 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:49.626085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a94-6ece-413e-a7b6-6b5e9de660c9 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:49.628419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a94-6ece-413e-a7b6-6b5e9de660c9 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:49.631696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a94-6ece-413e-a7b6-6b5e9de660c9 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:49.632549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eb7e4a94-6ece-413e-a7b6-6b5e9de660c9 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:50.243324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eb7e4a94-6ece-413e-a7b6-6b5e9de660c9 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:50.252842 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eb7e4a94-6ece-413e-a7b6-6b5e9de660c9 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1314 microversion: 2.1 time: 0.645975 Feb 19 21:10:50.263572 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2138/4376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:49 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:50.276317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:10:50.277435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:10:50.277959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:10:50.278592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:10:50.279011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:10:50.292408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:50.293605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:50.294799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:50.295299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:50.318082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Getting quotas for project 85755c1b89f44eb0a4db800f8bf319f0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:10:50.324504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Getting quotas for user 664f926973a242fcad5a2f1a02f773d7 and project 85755c1b89f44eb0a4db800f8bf319f0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:10:50.341664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:10:50.344648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:10:50.450967 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b4ac13c3-8322-405b-9f15-4be752d18f8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414852 Feb 19 21:10:50.452451 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2239/4377] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:10:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:10:50.872152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1968573823", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "451", "networks": [{"uuid": "530ab937-7c94-4c19-a3c3-ff58dabc202f"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:50.988690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] validate_networks() for [('530ab937-7c94-4c19-a3c3-ff58dabc202f', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:10:51.276852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0735d85e-7aa7-4d8b-b73c-927673d407de tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:51.278551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0735d85e-7aa7-4d8b-b73c-927673d407de tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:51.291732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0735d85e-7aa7-4d8b-b73c-927673d407de tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:51.294533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0735d85e-7aa7-4d8b-b73c-927673d407de tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:51.297221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0735d85e-7aa7-4d8b-b73c-927673d407de tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:51.298003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0735d85e-7aa7-4d8b-b73c-927673d407de tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:51.840282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0735d85e-7aa7-4d8b-b73c-927673d407de tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:51.852715 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0735d85e-7aa7-4d8b-b73c-927673d407de tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1314 microversion: 2.1 time: 0.579808 Feb 19 21:10:51.858477 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2240/4378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:51 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:52.873429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-557ff154-ae04-4950-a42b-e20bea18e104 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:52.874205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-557ff154-ae04-4950-a42b-e20bea18e104 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:52.887648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-557ff154-ae04-4950-a42b-e20bea18e104 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:52.888467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-557ff154-ae04-4950-a42b-e20bea18e104 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:52.895258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-557ff154-ae04-4950-a42b-e20bea18e104 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:52.899306 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-557ff154-ae04-4950-a42b-e20bea18e104 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:53.084666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:10:53.086349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:10:53.087420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:10:53.088134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:10:53.089321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:10:53.115532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:53.116014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:53.116857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:53.117296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:53.182614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Getting quotas for project 85755c1b89f44eb0a4db800f8bf319f0. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:10:53.198941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Getting quotas for user 664f926973a242fcad5a2f1a02f773d7 and project 85755c1b89f44eb0a4db800f8bf319f0. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:10:53.221904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:10:53.225966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:10:53.310878 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a20bd033-f822-4318-b263-36363f98b2d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.442345 Feb 19 21:10:53.312213 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2139/4379] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:10:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:10:53.324710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-3df5610c-dc44-442d-94c1-dd9762d1f374 req-b73c9469-2685-4cb7-b815-2b569881b978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf50ff4-6ad5-42d5-b141-7e521a04dd0d", "tag": "d4b03175-1616-42fe-9b96-eb62614d66b0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:53.339189 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:53.339189 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:53.358281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3df5610c-dc44-442d-94c1-dd9762d1f374 req-b73c9469-2685-4cb7-b815-2b569881b978 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:53.358766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3df5610c-dc44-442d-94c1-dd9762d1f374 req-b73c9469-2685-4cb7-b815-2b569881b978 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:53.411221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-557ff154-ae04-4950-a42b-e20bea18e104 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:53.415411 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3df5610c-dc44-442d-94c1-dd9762d1f374 req-b73c9469-2685-4cb7-b815-2b569881b978 service nova] Creating event network-changed:d4b03175-1616-42fe-9b96-eb62614d66b0 for instance 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d on nch2-master-1 Feb 19 21:10:53.419569 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-557ff154-ae04-4950-a42b-e20bea18e104 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1314 microversion: 2.1 time: 0.550121 Feb 19 21:10:53.423828 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2241/4380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:52 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:53.435587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6a7536c6-47e9-475d-89c9-b9bf9d206928 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:53.436537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6a7536c6-47e9-475d-89c9-b9bf9d206928 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:53.453815 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-3df5610c-dc44-442d-94c1-dd9762d1f374 req-b73c9469-2685-4cb7-b815-2b569881b978 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135633 Feb 19 21:10:53.457321 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2140/4381] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:53.567632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6a7536c6-47e9-475d-89c9-b9bf9d206928 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:53.582916 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6a7536c6-47e9-475d-89c9-b9bf9d206928 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1221 microversion: 2.1 time: 0.157237 Feb 19 21:10:53.584446 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2242/4382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:53 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:54.154826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4b8394ca-66e9-4db1-9fbd-29e0a7bc051a req-2e51aab4-0294-4e53-94f8-0df162a70276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbc665c-bed1-40cf-a142-b1d8fae201e6", "name": "network-vif-plugged", "status": "completed", "tag": "1dfaf2c3-a63e-4dde-890c-bade6dd9c52c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:54.157951 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:54.157951 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:54.178384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4b8394ca-66e9-4db1-9fbd-29e0a7bc051a req-2e51aab4-0294-4e53-94f8-0df162a70276 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:54.181829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4b8394ca-66e9-4db1-9fbd-29e0a7bc051a req-2e51aab4-0294-4e53-94f8-0df162a70276 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:54.217688 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4b8394ca-66e9-4db1-9fbd-29e0a7bc051a req-2e51aab4-0294-4e53-94f8-0df162a70276 service nova] Creating event network-vif-plugged:1dfaf2c3-a63e-4dde-890c-bade6dd9c52c for instance 5fbc665c-bed1-40cf-a142-b1d8fae201e6 on nch1-master-1 Feb 19 21:10:54.225178 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4b8394ca-66e9-4db1-9fbd-29e0a7bc051a req-2e51aab4-0294-4e53-94f8-0df162a70276 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076824 Feb 19 21:10:54.250978 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2141/4383] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:54.437811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-607600a5-477e-4202-8bf2-40f3a60923f6 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:54.438621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-607600a5-477e-4202-8bf2-40f3a60923f6 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:54.450758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-607600a5-477e-4202-8bf2-40f3a60923f6 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:54.453621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-607600a5-477e-4202-8bf2-40f3a60923f6 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:54.457086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-607600a5-477e-4202-8bf2-40f3a60923f6 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:54.457573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-607600a5-477e-4202-8bf2-40f3a60923f6 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:54.602632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31a2ad17-affc-4c40-aa8f-4d5b66349dc9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:54.603573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-31a2ad17-affc-4c40-aa8f-4d5b66349dc9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:54.616933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31a2ad17-affc-4c40-aa8f-4d5b66349dc9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:54.617707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31a2ad17-affc-4c40-aa8f-4d5b66349dc9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:54.621801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31a2ad17-affc-4c40-aa8f-4d5b66349dc9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:54.622630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31a2ad17-affc-4c40-aa8f-4d5b66349dc9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:54.839231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-31a2ad17-affc-4c40-aa8f-4d5b66349dc9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:54.849143 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-31a2ad17-affc-4c40-aa8f-4d5b66349dc9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1273 microversion: 2.1 time: 0.251609 Feb 19 21:10:54.864503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-607600a5-477e-4202-8bf2-40f3a60923f6 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:54.873917 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2142/4384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:54 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:54.874265 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-607600a5-477e-4202-8bf2-40f3a60923f6 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1314 microversion: 2.1 time: 0.440103 Feb 19 21:10:54.875156 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2243/4385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:54 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:55.665862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5d9f6e0b-fe8a-4051-b444-4d0be04b4c13 req-f7a55824-7f5d-481f-9910-e6d0715119ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7be926-97c1-45e3-87aa-defbd74b9903", "tag": "3d24b8e8-a542-4ef2-8ffb-7e4f8a40e896"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:55.667447 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:55.667447 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:10:55.696813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5d9f6e0b-fe8a-4051-b444-4d0be04b4c13 req-f7a55824-7f5d-481f-9910-e6d0715119ce service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:55.697651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5d9f6e0b-fe8a-4051-b444-4d0be04b4c13 req-f7a55824-7f5d-481f-9910-e6d0715119ce service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:55.714603 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5d9f6e0b-fe8a-4051-b444-4d0be04b4c13 req-f7a55824-7f5d-481f-9910-e6d0715119ce service nova] Creating event network-changed:3d24b8e8-a542-4ef2-8ffb-7e4f8a40e896 for instance bf7be926-97c1-45e3-87aa-defbd74b9903 on nch2-master-1 Feb 19 21:10:55.723751 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5d9f6e0b-fe8a-4051-b444-4d0be04b4c13 req-f7a55824-7f5d-481f-9910-e6d0715119ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295404 Feb 19 21:10:55.725021 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2143/4386] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:55.867934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9d2abd66-eff8-4376-b9af-2ab418b9256c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:55.868754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9d2abd66-eff8-4376-b9af-2ab418b9256c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:55.876069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d2abd66-eff8-4376-b9af-2ab418b9256c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:55.876557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d2abd66-eff8-4376-b9af-2ab418b9256c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:55.877359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d2abd66-eff8-4376-b9af-2ab418b9256c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:55.877774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d2abd66-eff8-4376-b9af-2ab418b9256c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:55.900377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-75e1595e-65e7-498c-84d8-9f3b1a10601e tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:55.901325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-75e1595e-65e7-498c-84d8-9f3b1a10601e tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:55.918477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e1595e-65e7-498c-84d8-9f3b1a10601e tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:55.918943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e1595e-65e7-498c-84d8-9f3b1a10601e tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:55.919753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e1595e-65e7-498c-84d8-9f3b1a10601e tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:55.921958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e1595e-65e7-498c-84d8-9f3b1a10601e tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:56.059229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9d2abd66-eff8-4376-b9af-2ab418b9256c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:56.077571 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9d2abd66-eff8-4376-b9af-2ab418b9256c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1279 microversion: 2.1 time: 0.212636 Feb 19 21:10:56.088361 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2244/4387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:55 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:10:56.285638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-75e1595e-65e7-498c-84d8-9f3b1a10601e tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:56.299284 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-75e1595e-65e7-498c-84d8-9f3b1a10601e tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1462 microversion: 2.1 time: 0.408887 Feb 19 21:10:56.299887 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2144/4388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:55 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1462 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:10:56.328216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-619b420d-862a-4231-a47a-7b68a819defd tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46718fc1-de22-4f32-9233-e05f81bf31e3", "device": "/dev/sdb"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:56.329575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-619b420d-862a-4231-a47a-7b68a819defd tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:56.340677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-619b420d-862a-4231-a47a-7b68a819defd tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:56.340976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-619b420d-862a-4231-a47a-7b68a819defd tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:56.342120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-619b420d-862a-4231-a47a-7b68a819defd tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:56.342806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-619b420d-862a-4231-a47a-7b68a819defd tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:56.820600 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-619b420d-862a-4231-a47a-7b68a819defd tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "POST /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495214 Feb 19 21:10:56.826065 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2245/4389] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:10:56 2022] POST /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:57.095046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bc9e170f-271c-4cfc-b988-6b72e38c7469 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:57.095701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc9e170f-271c-4cfc-b988-6b72e38c7469 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:57.120531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc9e170f-271c-4cfc-b988-6b72e38c7469 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:57.120531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc9e170f-271c-4cfc-b988-6b72e38c7469 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:57.120852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc9e170f-271c-4cfc-b988-6b72e38c7469 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:57.121303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc9e170f-271c-4cfc-b988-6b72e38c7469 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:57.578772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bc9e170f-271c-4cfc-b988-6b72e38c7469 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:57.592063 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc9e170f-271c-4cfc-b988-6b72e38c7469 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1321 microversion: 2.1 time: 0.499958 Feb 19 21:10:57.593168 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2145/4390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:57 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:57.827083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-eae17dc9-721f-45c9-90f9-61352091047e req-66b3eb6e-2167-4294-a244-16fae4da21d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b07cde3-2638-435a-b995-472fca98b7a3", "tag": "6e144d59-57f6-487f-8459-313c58617556"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:57.837982 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:10:57.837982 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:10:57.862588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-eae17dc9-721f-45c9-90f9-61352091047e req-66b3eb6e-2167-4294-a244-16fae4da21d1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:57.863854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-eae17dc9-721f-45c9-90f9-61352091047e req-66b3eb6e-2167-4294-a244-16fae4da21d1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:57.891960 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-eae17dc9-721f-45c9-90f9-61352091047e req-66b3eb6e-2167-4294-a244-16fae4da21d1 service nova] Creating event network-changed:6e144d59-57f6-487f-8459-313c58617556 for instance 7b07cde3-2638-435a-b995-472fca98b7a3 on nch1-master-1 Feb 19 21:10:57.912771 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-eae17dc9-721f-45c9-90f9-61352091047e req-66b3eb6e-2167-4294-a244-16fae4da21d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093782 Feb 19 21:10:57.917839 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2246/4391] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:10:58.609930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5c8f2869-d11a-43c6-ae6e-521094e684e1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:58.611348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5c8f2869-d11a-43c6-ae6e-521094e684e1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:58.621776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c8f2869-d11a-43c6-ae6e-521094e684e1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:58.622691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c8f2869-d11a-43c6-ae6e-521094e684e1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:58.623666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c8f2869-d11a-43c6-ae6e-521094e684e1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:58.624367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5c8f2869-d11a-43c6-ae6e-521094e684e1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:58.826311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5c8f2869-d11a-43c6-ae6e-521094e684e1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:10:58.836412 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5c8f2869-d11a-43c6-ae6e-521094e684e1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1321 microversion: 2.1 time: 0.230289 Feb 19 21:10:58.846432 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2146/4392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:58 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:59.516176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-165026f9-7f47-4830-9e9d-a9cf25d69521 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Action: 'create', calling method: .version_select at 0x7f6467ee9ca0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-981519187"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:10:59.531003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-165026f9-7f47-4830-9e9d-a9cf25d69521 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Getting quotas for project 9f4ed687e80941d9a5befe1031923ed5. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:10:59.538965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-165026f9-7f47-4830-9e9d-a9cf25d69521 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Getting quotas for user b9e2bf42ef6446c69f1775a25ef76a92 and project 9f4ed687e80941d9a5befe1031923ed5. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:10:59.808254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-165026f9-7f47-4830-9e9d-a9cf25d69521 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Getting quotas for project 9f4ed687e80941d9a5befe1031923ed5. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:10:59.813630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-165026f9-7f47-4830-9e9d-a9cf25d69521 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Getting quotas for user b9e2bf42ef6446c69f1775a25ef76a92 and project 9f4ed687e80941d9a5befe1031923ed5. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:10:59.829583 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-165026f9-7f47-4830-9e9d-a9cf25d69521 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.493071 Feb 19 21:10:59.830214 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2247/4393] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:10:59 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:10:59.853705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b9f4cbeb-ef51-4845-bd2b-ac470e311cf3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:10:59.854521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b9f4cbeb-ef51-4845-bd2b-ac470e311cf3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:10:59.864258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9f4cbeb-ef51-4845-bd2b-ac470e311cf3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:59.864903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9f4cbeb-ef51-4845-bd2b-ac470e311cf3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:10:59.865962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9f4cbeb-ef51-4845-bd2b-ac470e311cf3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:10:59.867699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9f4cbeb-ef51-4845-bd2b-ac470e311cf3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:00.134550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b9f4cbeb-ef51-4845-bd2b-ac470e311cf3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:00.146611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b38b56b4-c6eb-48f3-8101-959de52fa26a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:00.147762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b38b56b4-c6eb-48f3-8101-959de52fa26a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:00.148259 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b9f4cbeb-ef51-4845-bd2b-ac470e311cf3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1321 microversion: 2.1 time: 0.298131 Feb 19 21:11:00.150902 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2147/4394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:10:59 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:00.162259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b38b56b4-c6eb-48f3-8101-959de52fa26a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:00.162707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b38b56b4-c6eb-48f3-8101-959de52fa26a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:00.163651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b38b56b4-c6eb-48f3-8101-959de52fa26a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:00.165934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b38b56b4-c6eb-48f3-8101-959de52fa26a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:00.204384 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b38b56b4-c6eb-48f3-8101-959de52fa26a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068105 Feb 19 21:11:00.205283 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2248/4395] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:11:00 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:11:00.317607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-481e2f19-e298-45fe-b10b-c9c9fee00bb9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:00.317607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-481e2f19-e298-45fe-b10b-c9c9fee00bb9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:00.334513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-481e2f19-e298-45fe-b10b-c9c9fee00bb9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:00.334989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-481e2f19-e298-45fe-b10b-c9c9fee00bb9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:00.339536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-481e2f19-e298-45fe-b10b-c9c9fee00bb9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:00.340695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-481e2f19-e298-45fe-b10b-c9c9fee00bb9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:00.376317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-481e2f19-e298-45fe-b10b-c9c9fee00bb9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:11:00.527106 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-481e2f19-e298-45fe-b10b-c9c9fee00bb9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 204 len: 0 microversion: 2.1 time: 0.217610 Feb 19 21:11:00.533088 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2148/4396] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:11:00 2022] DELETE /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:11:00.538237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4926e007-335b-4cee-89ae-0744a737966c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:00.538852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4926e007-335b-4cee-89ae-0744a737966c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:00.549241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4926e007-335b-4cee-89ae-0744a737966c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:00.549700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4926e007-335b-4cee-89ae-0744a737966c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:00.551617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4926e007-335b-4cee-89ae-0744a737966c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:00.552060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4926e007-335b-4cee-89ae-0744a737966c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:00.936018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4926e007-335b-4cee-89ae-0744a737966c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:00.967460 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4926e007-335b-4cee-89ae-0744a737966c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1672 microversion: 2.1 time: 0.433084 Feb 19 21:11:00.968069 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2249/4397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:00 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1672 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:01.123577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5bba1fda-84c2-45c1-832b-644fb46ca88f req-b29863f3-b972-41d3-b172-881f45c7c899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf50ff4-6ad5-42d5-b141-7e521a04dd0d", "name": "network-vif-plugged", "status": "completed", "tag": "d4b03175-1616-42fe-9b96-eb62614d66b0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:01.126020 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:01.126020 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:01.141366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5bba1fda-84c2-45c1-832b-644fb46ca88f req-b29863f3-b972-41d3-b172-881f45c7c899 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:01.141815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5bba1fda-84c2-45c1-832b-644fb46ca88f req-b29863f3-b972-41d3-b172-881f45c7c899 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:01.166326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7ed37a6f-6e78-48e8-a63e-893719f45fab tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:01.167502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7ed37a6f-6e78-48e8-a63e-893719f45fab tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:01.178517 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5bba1fda-84c2-45c1-832b-644fb46ca88f req-b29863f3-b972-41d3-b172-881f45c7c899 service nova] Creating event network-vif-plugged:d4b03175-1616-42fe-9b96-eb62614d66b0 for instance 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d on nch2-master-1 Feb 19 21:11:01.179794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ed37a6f-6e78-48e8-a63e-893719f45fab tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:01.181318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ed37a6f-6e78-48e8-a63e-893719f45fab tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:01.182952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ed37a6f-6e78-48e8-a63e-893719f45fab tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:01.183403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ed37a6f-6e78-48e8-a63e-893719f45fab tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:01.183740 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5bba1fda-84c2-45c1-832b-644fb46ca88f req-b29863f3-b972-41d3-b172-881f45c7c899 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064165 Feb 19 21:11:01.184380 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2149/4398] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:01.595091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7ed37a6f-6e78-48e8-a63e-893719f45fab tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:01.620514 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7ed37a6f-6e78-48e8-a63e-893719f45fab tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1321 microversion: 2.1 time: 0.457721 Feb 19 21:11:01.621109 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2250/4399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:01 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:01.988177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bd06333c-7b8a-41d0-b804-a8e24edee9b8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:01.989062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bd06333c-7b8a-41d0-b804-a8e24edee9b8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:01.998166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd06333c-7b8a-41d0-b804-a8e24edee9b8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:01.998628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd06333c-7b8a-41d0-b804-a8e24edee9b8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:01.999481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd06333c-7b8a-41d0-b804-a8e24edee9b8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:01.999929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd06333c-7b8a-41d0-b804-a8e24edee9b8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:02.642077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6a2fde6a-3e8c-4600-b6eb-0e21b336f098 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:02.642882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6a2fde6a-3e8c-4600-b6eb-0e21b336f098 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:02.655741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a2fde6a-3e8c-4600-b6eb-0e21b336f098 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:02.656285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a2fde6a-3e8c-4600-b6eb-0e21b336f098 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:02.657430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a2fde6a-3e8c-4600-b6eb-0e21b336f098 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:02.658227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a2fde6a-3e8c-4600-b6eb-0e21b336f098 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:02.672707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bd06333c-7b8a-41d0-b804-a8e24edee9b8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:02.685012 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bd06333c-7b8a-41d0-b804-a8e24edee9b8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1672 microversion: 2.1 time: 0.701317 Feb 19 21:11:02.685953 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2150/4400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:01 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1672 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:02.996564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6a2fde6a-3e8c-4600-b6eb-0e21b336f098 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:03.007332 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6a2fde6a-3e8c-4600-b6eb-0e21b336f098 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1321 microversion: 2.1 time: 0.373976 Feb 19 21:11:03.007942 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2251/4401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:02 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:03.703164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2353c0b7-86aa-4216-bd06-a748c9f09088 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:03.704097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2353c0b7-86aa-4216-bd06-a748c9f09088 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:03.711818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2353c0b7-86aa-4216-bd06-a748c9f09088 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:03.712394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2353c0b7-86aa-4216-bd06-a748c9f09088 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:03.713994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2353c0b7-86aa-4216-bd06-a748c9f09088 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:03.714525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2353c0b7-86aa-4216-bd06-a748c9f09088 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:04.024106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9cfa5119-5c6e-4e9d-8e60-a065bdf0c350 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:04.024762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9cfa5119-5c6e-4e9d-8e60-a065bdf0c350 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:04.039261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cfa5119-5c6e-4e9d-8e60-a065bdf0c350 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:04.041088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cfa5119-5c6e-4e9d-8e60-a065bdf0c350 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:04.042651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cfa5119-5c6e-4e9d-8e60-a065bdf0c350 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:04.045188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cfa5119-5c6e-4e9d-8e60-a065bdf0c350 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:04.199690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2353c0b7-86aa-4216-bd06-a748c9f09088 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:04.221081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2353c0b7-86aa-4216-bd06-a748c9f09088 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1672 microversion: 2.1 time: 0.519095 Feb 19 21:11:04.232039 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2151/4402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:03 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1672 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:04.264173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2219b0e5-f35f-4d0d-9888-0616fd750a49 req-c873aa16-e378-4312-a0ac-976882e2d2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b07cde3-2638-435a-b995-472fca98b7a3", "name": "network-vif-plugged", "status": "completed", "tag": "6e144d59-57f6-487f-8459-313c58617556"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:04.266415 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:04.266415 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:04.286941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2219b0e5-f35f-4d0d-9888-0616fd750a49 req-c873aa16-e378-4312-a0ac-976882e2d2f8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:04.289502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2219b0e5-f35f-4d0d-9888-0616fd750a49 req-c873aa16-e378-4312-a0ac-976882e2d2f8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:04.321335 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2219b0e5-f35f-4d0d-9888-0616fd750a49 req-c873aa16-e378-4312-a0ac-976882e2d2f8 service nova] Creating event network-vif-plugged:6e144d59-57f6-487f-8459-313c58617556 for instance 7b07cde3-2638-435a-b995-472fca98b7a3 on nch1-master-1 Feb 19 21:11:04.334556 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2219b0e5-f35f-4d0d-9888-0616fd750a49 req-c873aa16-e378-4312-a0ac-976882e2d2f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076195 Feb 19 21:11:04.336439 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2152/4403] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:11:04.420077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9cfa5119-5c6e-4e9d-8e60-a065bdf0c350 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:04.428242 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9cfa5119-5c6e-4e9d-8e60-a065bdf0c350 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1321 microversion: 2.1 time: 0.408798 Feb 19 21:11:04.428857 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2252/4404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:04 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1321 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:05.253075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-fa757219-47d3-4bd3-a4e2-32c00574e622 req-2d0b30b7-2555-4d63-bc4c-ac6f40e38a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc97c9dc-bc47-4884-b42e-fa373a918258", "name": "network-vif-deleted", "tag": "60b74908-1902-4216-8619-32cd92b10359"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:05.254336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3df5b8a0-a44d-4276-b51f-7243e12b3983 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:05.257716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3df5b8a0-a44d-4276-b51f-7243e12b3983 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:05.258494 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:05.258494 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:05.288723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3df5b8a0-a44d-4276-b51f-7243e12b3983 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:05.296566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3df5b8a0-a44d-4276-b51f-7243e12b3983 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:05.297572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3df5b8a0-a44d-4276-b51f-7243e12b3983 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:05.298040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3df5b8a0-a44d-4276-b51f-7243e12b3983 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:05.304665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fa757219-47d3-4bd3-a4e2-32c00574e622 req-2d0b30b7-2555-4d63-bc4c-ac6f40e38a2c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:05.305132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fa757219-47d3-4bd3-a4e2-32c00574e622 req-2d0b30b7-2555-4d63-bc4c-ac6f40e38a2c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:05.368421 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-fa757219-47d3-4bd3-a4e2-32c00574e622 req-2d0b30b7-2555-4d63-bc4c-ac6f40e38a2c service nova] Creating event network-vif-deleted:60b74908-1902-4216-8619-32cd92b10359 for instance cc97c9dc-bc47-4884-b42e-fa373a918258 on nch2-master-1 Feb 19 21:11:05.385746 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-fa757219-47d3-4bd3-a4e2-32c00574e622 req-2d0b30b7-2555-4d63-bc4c-ac6f40e38a2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147579 Feb 19 21:11:05.386381 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2253/4405] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:05.449586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5358a00f-29d9-41b5-bf54-debf7bf4dbb1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:05.450339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5358a00f-29d9-41b5-bf54-debf7bf4dbb1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:05.461768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5358a00f-29d9-41b5-bf54-debf7bf4dbb1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:05.461768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5358a00f-29d9-41b5-bf54-debf7bf4dbb1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:05.462514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5358a00f-29d9-41b5-bf54-debf7bf4dbb1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:05.462710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5358a00f-29d9-41b5-bf54-debf7bf4dbb1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:05.490225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3df5b8a0-a44d-4276-b51f-7243e12b3983 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:05.509461 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3df5b8a0-a44d-4276-b51f-7243e12b3983 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 200 len: 1322 microversion: 2.1 time: 0.273665 Feb 19 21:11:05.510874 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2153/4406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:05 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:05.739894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5358a00f-29d9-41b5-bf54-debf7bf4dbb1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:05.757819 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5358a00f-29d9-41b5-bf54-debf7bf4dbb1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1321 microversion: 2.1 time: 0.314443 Feb 19 21:11:05.759350 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2254/4407] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:05 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:06.389246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b2426c79-c77f-47ff-bea2-81b3256f2a66 req-9b3c4c89-c600-4dda-a5ff-14f9c2463cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7be926-97c1-45e3-87aa-defbd74b9903", "name": "network-vif-plugged", "status": "completed", "tag": "3d24b8e8-a542-4ef2-8ffb-7e4f8a40e896"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:06.391612 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:06.391612 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:06.412240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b2426c79-c77f-47ff-bea2-81b3256f2a66 req-9b3c4c89-c600-4dda-a5ff-14f9c2463cfb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:06.412726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b2426c79-c77f-47ff-bea2-81b3256f2a66 req-9b3c4c89-c600-4dda-a5ff-14f9c2463cfb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:06.444703 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b2426c79-c77f-47ff-bea2-81b3256f2a66 req-9b3c4c89-c600-4dda-a5ff-14f9c2463cfb service nova] Creating event network-vif-plugged:3d24b8e8-a542-4ef2-8ffb-7e4f8a40e896 for instance bf7be926-97c1-45e3-87aa-defbd74b9903 on nch2-master-1 Feb 19 21:11:06.454096 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b2426c79-c77f-47ff-bea2-81b3256f2a66 req-9b3c4c89-c600-4dda-a5ff-14f9c2463cfb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070683 Feb 19 21:11:06.454781 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2154/4408] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:06.535664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-486de530-70cc-4973-8c05-ab74c7abe4db tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:06.536599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-486de530-70cc-4973-8c05-ab74c7abe4db tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:06.567577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-486de530-70cc-4973-8c05-ab74c7abe4db tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:06.571938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-486de530-70cc-4973-8c05-ab74c7abe4db tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:06.575187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-486de530-70cc-4973-8c05-ab74c7abe4db tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:06.578454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-486de530-70cc-4973-8c05-ab74c7abe4db tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:06.621627 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-486de530-70cc-4973-8c05-ab74c7abe4db tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] HTTP exception thrown: Instance cc97c9dc-bc47-4884-b42e-fa373a918258 could not be found. Feb 19 21:11:06.624837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-486de530-70cc-4973-8c05-ab74c7abe4db tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Returning 404 to user: Instance cc97c9dc-bc47-4884-b42e-fa373a918258 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:06.625845 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-486de530-70cc-4973-8c05-ab74c7abe4db tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 404 len: 111 microversion: 2.1 time: 0.097947 Feb 19 21:11:06.629022 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2255/4409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:06 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:11:06.648400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6aae9332-0cab-4456-b306-c44d8870de8e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '.version_select at 0x7f6467ea69d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:06.703590 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6aae9332-0cab-4456-b306-c44d8870de8e tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065561836" status: 202 len: 0 microversion: 2.1 time: 0.069184 Feb 19 21:11:06.704486 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2155/4410] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065561836 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:11:06.774942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-411fc03c-f438-42cf-a836-43a6a1cf2623 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:06.775753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-411fc03c-f438-42cf-a836-43a6a1cf2623 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:06.782489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-411fc03c-f438-42cf-a836-43a6a1cf2623 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:06.782879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-411fc03c-f438-42cf-a836-43a6a1cf2623 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:06.783690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-411fc03c-f438-42cf-a836-43a6a1cf2623 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:06.784127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-411fc03c-f438-42cf-a836-43a6a1cf2623 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:07.076120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4ab344bb-fe64-438e-b52c-7368b3978d80 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:07.082147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4ab344bb-fe64-438e-b52c-7368b3978d80 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:07.091708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ab344bb-fe64-438e-b52c-7368b3978d80 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:07.096276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ab344bb-fe64-438e-b52c-7368b3978d80 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:07.097510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ab344bb-fe64-438e-b52c-7368b3978d80 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:07.099809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4ab344bb-fe64-438e-b52c-7368b3978d80 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:07.232302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-411fc03c-f438-42cf-a836-43a6a1cf2623 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:07.244634 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-411fc03c-f438-42cf-a836-43a6a1cf2623 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1513 microversion: 2.1 time: 0.473236 Feb 19 21:11:07.260749 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2256/4411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:06 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1513 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:07.266932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-abeb45d2-508b-437d-8925-f9e5ccef09d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:07.267546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-abeb45d2-508b-437d-8925-f9e5ccef09d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:07.292025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abeb45d2-508b-437d-8925-f9e5ccef09d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:07.292511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abeb45d2-508b-437d-8925-f9e5ccef09d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:07.295078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abeb45d2-508b-437d-8925-f9e5ccef09d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:07.329105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abeb45d2-508b-437d-8925-f9e5ccef09d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:07.345545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-4ab344bb-fe64-438e-b52c-7368b3978d80 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lazy-loading 'services' on Instance uuid 5fbc665c-bed1-40cf-a142-b1d8fae201e6 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:11:07.512093 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4ab344bb-fe64-438e-b52c-7368b3978d80 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6/os-volume_attachments/46718fc1-de22-4f32-9233-e05f81bf31e3" status: 202 len: 0 microversion: 2.1 time: 0.448413 Feb 19 21:11:07.513073 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2156/4412] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:11:07 2022] DELETE /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6/os-volume_attachments/46718fc1-de22-4f32-9233-e05f81bf31e3 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:11:07.657465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-abeb45d2-508b-437d-8925-f9e5ccef09d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:07.669921 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-abeb45d2-508b-437d-8925-f9e5ccef09d9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1513 microversion: 2.1 time: 0.407477 Feb 19 21:11:07.676790 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2257/4413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:07 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:07.701610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43e182f5-cc35-415f-b555-c401a41161a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:07.702696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-43e182f5-cc35-415f-b555-c401a41161a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:07.714987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43e182f5-cc35-415f-b555-c401a41161a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:07.715737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43e182f5-cc35-415f-b555-c401a41161a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:07.717588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43e182f5-cc35-415f-b555-c401a41161a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:07.718269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43e182f5-cc35-415f-b555-c401a41161a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:07.929868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-43e182f5-cc35-415f-b555-c401a41161a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:07.939929 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-43e182f5-cc35-415f-b555-c401a41161a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903" status: 200 len: 1321 microversion: 2.1 time: 0.246934 Feb 19 21:11:07.941173 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2157/4414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:07 2022] GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:08.761346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-31fec462-1a62-4595-a4b2-3471b3aacebb tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:08.762001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-31fec462-1a62-4595-a4b2-3471b3aacebb tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:08.773460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31fec462-1a62-4595-a4b2-3471b3aacebb tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:08.774169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31fec462-1a62-4595-a4b2-3471b3aacebb tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:08.775515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31fec462-1a62-4595-a4b2-3471b3aacebb tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:08.776117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31fec462-1a62-4595-a4b2-3471b3aacebb tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:08.821353 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a7fe43a0-b11f-4ed5-87dc-9f43114372f3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'create', calling method: .version_select at 0x7f6467d70af0>, body: {"keypair": {"name": "tempest-keypair-1162194394"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:08.828750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-31fec462-1a62-4595-a4b2-3471b3aacebb tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:11:08.870312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a7fe43a0-b11f-4ed5-87dc-9f43114372f3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for project adecc012aca243138d03c189f5623f73. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:11:08.888181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a7fe43a0-b11f-4ed5-87dc-9f43114372f3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for user 7132cae4ebd549d491f5d0dcf83394ed and project adecc012aca243138d03c189f5623f73. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:11:09.008475 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-31fec462-1a62-4595-a4b2-3471b3aacebb tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 204 len: 0 microversion: 2.1 time: 0.252434 Feb 19 21:11:09.010076 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2258/4415] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:11:08 2022] DELETE /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:11:09.022980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9bd2a976-21d2-43ba-b3d2-3b9b500c749f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:09.027800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9bd2a976-21d2-43ba-b3d2-3b9b500c749f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:09.038686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bd2a976-21d2-43ba-b3d2-3b9b500c749f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:09.040652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bd2a976-21d2-43ba-b3d2-3b9b500c749f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:09.041641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bd2a976-21d2-43ba-b3d2-3b9b500c749f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:09.045403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9bd2a976-21d2-43ba-b3d2-3b9b500c749f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:09.239102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a7fe43a0-b11f-4ed5-87dc-9f43114372f3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for project adecc012aca243138d03c189f5623f73. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:11:09.259126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a7fe43a0-b11f-4ed5-87dc-9f43114372f3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for user 7132cae4ebd549d491f5d0dcf83394ed and project adecc012aca243138d03c189f5623f73. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:11:09.282130 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a7fe43a0-b11f-4ed5-87dc-9f43114372f3 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.466527 Feb 19 21:11:09.288497 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2158/4416] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:11:08 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:09.290196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-212b19df-69ef-41dd-992d-d00faebb1182 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:09.290454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-212b19df-69ef-41dd-992d-d00faebb1182 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:09.297702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212b19df-69ef-41dd-992d-d00faebb1182 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:09.298551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212b19df-69ef-41dd-992d-d00faebb1182 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:09.299132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212b19df-69ef-41dd-992d-d00faebb1182 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:09.299580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-212b19df-69ef-41dd-992d-d00faebb1182 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:09.343370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9bd2a976-21d2-43ba-b3d2-3b9b500c749f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:09.355614 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9bd2a976-21d2-43ba-b3d2-3b9b500c749f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903" status: 200 len: 1513 microversion: 2.1 time: 0.342971 Feb 19 21:11:09.356474 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2259/4417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:09 2022] GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903 => generated 1513 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:09.373090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:09.381765 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:09.381765 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:09.384800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:09.387099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:09.406079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:09.406833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:09.407854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:09.409976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:09.571718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-212b19df-69ef-41dd-992d-d00faebb1182 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:09.581464 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-212b19df-69ef-41dd-992d-d00faebb1182 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1468 microversion: 2.1 time: 0.296981 Feb 19 21:11:09.581608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:09.589217 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2159/4418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:09 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1468 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:09.673701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:09.683129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:09.684154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:10.321373 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab61a113-cd00-46d3-9c8d-89979a53103d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.951685 Feb 19 21:11:10.322316 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2260/4419] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Feb 19 21:11:09 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:10.340631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:10.344409 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:10.344409 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:10.345473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:10.346346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2018738622', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:10.356701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:10.357609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:10.358583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:10.359043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:10.474879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:10.599585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f1e080a-ae0f-400f-815a-6555c4d52e11 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:10.600521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2f1e080a-ae0f-400f-815a-6555c4d52e11 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:10.607284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f1e080a-ae0f-400f-815a-6555c4d52e11 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:10.607740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f1e080a-ae0f-400f-815a-6555c4d52e11 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:10.608667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f1e080a-ae0f-400f-815a-6555c4d52e11 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:10.609215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f1e080a-ae0f-400f-815a-6555c4d52e11 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:10.614713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:10.621679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:10.622135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:10.835583 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fdd3d5b0-daa6-4b9d-9f84-955ec229a4f2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2018738622" status: 200 len: 1516 microversion: 2.1 time: 0.498847 Feb 19 21:11:10.836717 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2160/4420] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 21:11:10 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2018738622 => generated 1516 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:10.842111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f1e080a-ae0f-400f-815a-6555c4d52e11 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:10.854128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:10.857530 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f1e080a-ae0f-400f-815a-6555c4d52e11 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1468 microversion: 2.1 time: 0.262216 Feb 19 21:11:10.860054 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2261/4421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:10 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1468 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:10.869326 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:10.869326 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:10.869326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:10.869326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:10.874713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:10.875511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:10.876431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:10.876981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:10.993029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:11.077367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:11.087163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:11.087631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:11.238413 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5506ba3c-180d-4ce2-8ebc-cd8d81db18a8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4522 microversion: 2.1 time: 0.388334 Feb 19 21:11:11.239105 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2161/4422] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Feb 19 21:11:10 2022] GET /compute/v2.1/servers/detail?status=active => generated 4522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:11.261589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:11.265762 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:11.265762 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:11.267470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:11.268501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.compute.servers [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Removing options 'limit' from query {{(pid=136094) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Feb 19 21:11:11.269516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:11.277340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:11.280378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:11.283257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:11.283953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:11.327661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:11.335155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:11.335751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:11.546697 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-435bbbee-cc83-4c84-8a13-999c43138625 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.288858 Feb 19 21:11:11.548801 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2262/4423] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 21:11:11 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:11.569298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ba856052-6ccc-4acc-8500-687a8d76bb3a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:11.574503 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:11.574503 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:11.576392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ba856052-6ccc-4acc-8500-687a8d76bb3a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:11.577721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ba856052-6ccc-4acc-8500-687a8d76bb3a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:11.585820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba856052-6ccc-4acc-8500-687a8d76bb3a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:11.586513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba856052-6ccc-4acc-8500-687a8d76bb3a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:11.587490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba856052-6ccc-4acc-8500-687a8d76bb3a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:11.588141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba856052-6ccc-4acc-8500-687a8d76bb3a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:11.794441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-ba856052-6ccc-4acc-8500-687a8d76bb3a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:11.879999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d3ff58e2-9361-4b18-bc09-3989dbd04981 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:11.880621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d3ff58e2-9361-4b18-bc09-3989dbd04981 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:11.893094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d3ff58e2-9361-4b18-bc09-3989dbd04981 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:11.895741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d3ff58e2-9361-4b18-bc09-3989dbd04981 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:11.897956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d3ff58e2-9361-4b18-bc09-3989dbd04981 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:11.900189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d3ff58e2-9361-4b18-bc09-3989dbd04981 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:11.952610 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ba856052-6ccc-4acc-8500-687a8d76bb3a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.387990 Feb 19 21:11:11.953245 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2162/4424] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:11:11 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:11.975289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:11.982324 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:11.982324 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:11.983480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:11.983950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.compute.servers [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Removing options 'limit' from query {{(pid=136095) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Feb 19 21:11:11.984662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:12.008532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:12.009658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:12.012898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:12.013548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:12.232628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:12.291124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d3ff58e2-9361-4b18-bc09-3989dbd04981 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:12.301872 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d3ff58e2-9361-4b18-bc09-3989dbd04981 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1468 microversion: 2.1 time: 0.428987 Feb 19 21:11:12.314808 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2263/4425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:11 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1468 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:12.339948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-652266592-access_point-1919204727", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "a9a97e8b-3567-444c-be37-4a0ea2e09d31"}], "key_name": "tempest-TestSecurityGroupsBasicOps-981519187", "security_groups": [{"name": "tempest-secgroup_access--2094348636"}, {"name": "tempest-secgroup_general--1176446622"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:12.424472 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-27011efb-4a35-4647-896d-8e44397709e9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.455557 Feb 19 21:11:12.427340 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2163/4426] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Feb 19 21:11:11 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:12.443627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-293130a5-c903-4d1b-ab43-1bc6bc193bb2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:12.454514 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:12.454514 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:12.455709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-293130a5-c903-4d1b-ab43-1bc6bc193bb2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:12.457024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-293130a5-c903-4d1b-ab43-1bc6bc193bb2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:12.469459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-293130a5-c903-4d1b-ab43-1bc6bc193bb2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:12.472791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-293130a5-c903-4d1b-ab43-1bc6bc193bb2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:12.474424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-293130a5-c903-4d1b-ab43-1bc6bc193bb2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:12.476978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-293130a5-c903-4d1b-ab43-1bc6bc193bb2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:12.546785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-293130a5-c903-4d1b-ab43-1bc6bc193bb2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:12.591829 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-293130a5-c903-4d1b-ab43-1bc6bc193bb2 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.158236 Feb 19 21:11:12.594023 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2164/4427] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 21:11:12 2022] GET /compute/v2.1/servers => generated 1012 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:12.613889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f516e70e-c62f-4a00-82dd-eeecf07e1c30 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:12.629014 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:12.629014 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:12.633227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f516e70e-c62f-4a00-82dd-eeecf07e1c30 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:12.634737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f516e70e-c62f-4a00-82dd-eeecf07e1c30 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:12.656726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] validate_networks() for [('a9a97e8b-3567-444c-be37-4a0ea2e09d31', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:11:12.672250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f516e70e-c62f-4a00-82dd-eeecf07e1c30 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:12.672749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f516e70e-c62f-4a00-82dd-eeecf07e1c30 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:12.676117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f516e70e-c62f-4a00-82dd-eeecf07e1c30 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:12.676631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f516e70e-c62f-4a00-82dd-eeecf07e1c30 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:12.834669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-f516e70e-c62f-4a00-82dd-eeecf07e1c30 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:12.966531 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f516e70e-c62f-4a00-82dd-eeecf07e1c30 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.363220 Feb 19 21:11:12.979775 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2165/4428] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 21:11:12 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:11:12.986140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-148772e9-82b1-4f7d-9b5f-832431647bc1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:13.015568 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:13.015568 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:13.017160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-148772e9-82b1-4f7d-9b5f-832431647bc1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:13.018355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.compute.servers [None req-148772e9-82b1-4f7d-9b5f-832431647bc1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Removing options 'limit' from query {{(pid=136095) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Feb 19 21:11:13.019819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-148772e9-82b1-4f7d-9b5f-832431647bc1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:13.029268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-148772e9-82b1-4f7d-9b5f-832431647bc1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.031116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-148772e9-82b1-4f7d-9b5f-832431647bc1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.038125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-148772e9-82b1-4f7d-9b5f-832431647bc1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.038732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-148772e9-82b1-4f7d-9b5f-832431647bc1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.087974 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-148772e9-82b1-4f7d-9b5f-832431647bc1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.106703 Feb 19 21:11:13.088652 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2166/4429] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Feb 19 21:11:12 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:13.114321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-995e57ad-aff5-4077-b518-ecfbd5b6115d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:13.124739 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:13.124739 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:13.134606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-995e57ad-aff5-4077-b518-ecfbd5b6115d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:13.136530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-995e57ad-aff5-4077-b518-ecfbd5b6115d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2018738622', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:13.166756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-995e57ad-aff5-4077-b518-ecfbd5b6115d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.168085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-995e57ad-aff5-4077-b518-ecfbd5b6115d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.169106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-995e57ad-aff5-4077-b518-ecfbd5b6115d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.169600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-995e57ad-aff5-4077-b518-ecfbd5b6115d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.361878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-995e57ad-aff5-4077-b518-ecfbd5b6115d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:13.405579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:11:13.406692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:11:13.407502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:11:13.407999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:11:13.408517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:11:13.419921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.420847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.421879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.422625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.447072 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-995e57ad-aff5-4077-b518-ecfbd5b6115d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2018738622" status: 200 len: 346 microversion: 2.1 time: 0.349070 Feb 19 21:11:13.452485 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2167/4430] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:11:13 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2018738622 => generated 346 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:13.455887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Getting quotas for project 9f4ed687e80941d9a5befe1031923ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:11:13.458661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-013c5a28-1b6e-42e7-962a-9bd121fcd4ce req-9049cf6d-b619-4041-96ad-01ab8ac0bb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbc665c-bed1-40cf-a142-b1d8fae201e6", "name": "network-vif-deleted", "tag": "1dfaf2c3-a63e-4dde-890c-bade6dd9c52c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:13.461123 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:13.461123 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:13.465912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Getting quotas for user b9e2bf42ef6446c69f1775a25ef76a92 and project 9f4ed687e80941d9a5befe1031923ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:11:13.469449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-013c5a28-1b6e-42e7-962a-9bd121fcd4ce req-9049cf6d-b619-4041-96ad-01ab8ac0bb29 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.469996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-013c5a28-1b6e-42e7-962a-9bd121fcd4ce req-9049cf6d-b619-4041-96ad-01ab8ac0bb29 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.483345 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-013c5a28-1b6e-42e7-962a-9bd121fcd4ce req-9049cf6d-b619-4041-96ad-01ab8ac0bb29 service nova] Creating event network-vif-deleted:1dfaf2c3-a63e-4dde-890c-bade6dd9c52c for instance 5fbc665c-bed1-40cf-a142-b1d8fae201e6 on nch1-master-1 Feb 19 21:11:13.483900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:11:13.486860 ncdv-master-1 devstack@n-api.service[136094]: WARNING nova.utils [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-652266592-access_point-1919204727 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-652266592-acc Feb 19 21:11:13.487914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:11:13.490191 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-013c5a28-1b6e-42e7-962a-9bd121fcd4ce req-9049cf6d-b619-4041-96ad-01ab8ac0bb29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040198 Feb 19 21:11:13.492478 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2168/4431] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:13.498082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:13.498255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:13.505311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.505872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.506954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.507485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.570279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.570776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.571285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lazy-loading 'fault' on Instance uuid 5fbc665c-bed1-40cf-a142-b1d8fae201e6 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:11:13.603826 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4b56af02-d9e4-4463-907e-0f24b43c846b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.268349 Feb 19 21:11:13.616450 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2264/4432] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:11:12 2022] POST /compute/v2.1/servers => generated 458 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:11:13.627673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fa915ab0-643c-4a1f-b470-1ef2c3f77995 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:13.629582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52c7a837477849768d5a90636fddf7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463a97fa588d4fc2bb01401ca0fcb8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:13.644665 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb5f3819-20da-4445-a93f-32baa92c9293 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 200 len: 1304 microversion: 2.1 time: 0.152019 Feb 19 21:11:13.645770 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2169/4433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:13 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:13.654295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-73208779-5462-4a84-b39e-914cf0897325 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:13.655150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-73208779-5462-4a84-b39e-914cf0897325 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:13.684734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa915ab0-643c-4a1f-b470-1ef2c3f77995 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.685436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa915ab0-643c-4a1f-b470-1ef2c3f77995 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.714043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa915ab0-643c-4a1f-b470-1ef2c3f77995 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Going to try to stop instance {{(pid=136094) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:11:13.732123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-73208779-5462-4a84-b39e-914cf0897325 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:13.743819 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-73208779-5462-4a84-b39e-914cf0897325 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1293 microversion: 2.1 time: 0.093171 Feb 19 21:11:13.746035 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2170/4434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:13 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:13.826472 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fa915ab0-643c-4a1f-b470-1ef2c3f77995 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "POST /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d/action" status: 202 len: 0 microversion: 2.1 time: 0.207842 Feb 19 21:11:13.827249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2265/4435] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:11:13 2022] POST /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:11:13.836364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-92ed3a21-9b21-45b9-a013-6f0ae61949d1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:13.838390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-92ed3a21-9b21-45b9-a013-6f0ae61949d1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:13.851476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92ed3a21-9b21-45b9-a013-6f0ae61949d1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.855681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92ed3a21-9b21-45b9-a013-6f0ae61949d1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:13.856848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92ed3a21-9b21-45b9-a013-6f0ae61949d1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:13.857346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92ed3a21-9b21-45b9-a013-6f0ae61949d1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:14.233741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-92ed3a21-9b21-45b9-a013-6f0ae61949d1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:14.245355 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-92ed3a21-9b21-45b9-a013-6f0ae61949d1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 0.413208 Feb 19 21:11:14.246075 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2171/4436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:13 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:14.629670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1677931713", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "813ad1c1-0059-4a59-91cb-1222ec1b44c2"}], "security_groups": [{"name": "tempest-securitygroup--1182585515"}], "key_name": "tempest-keypair-1162194394", "user_data": "}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:14.664895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f2ad1f5-cff7-48bb-837d-438eb3e45dc0 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:14.665718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f2ad1f5-cff7-48bb-837d-438eb3e45dc0 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] [instance: 5fbc665c-bed1-40cf-a142-b1d8fae201e6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:14.679379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f2ad1f5-cff7-48bb-837d-438eb3e45dc0 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:14.679841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f2ad1f5-cff7-48bb-837d-438eb3e45dc0 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:14.680694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f2ad1f5-cff7-48bb-837d-438eb3e45dc0 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:14.682199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f2ad1f5-cff7-48bb-837d-438eb3e45dc0 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:14.706150 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-7f2ad1f5-cff7-48bb-837d-438eb3e45dc0 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] HTTP exception thrown: Instance 5fbc665c-bed1-40cf-a142-b1d8fae201e6 could not be found. Feb 19 21:11:14.706753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f2ad1f5-cff7-48bb-837d-438eb3e45dc0 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] Returning 404 to user: Instance 5fbc665c-bed1-40cf-a142-b1d8fae201e6 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:14.707621 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f2ad1f5-cff7-48bb-837d-438eb3e45dc0 tempest-VolumesBackupsTest-1229161186 tempest-VolumesBackupsTest-1229161186-project] 10.222.0.30 "GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6" status: 404 len: 111 microversion: 2.1 time: 0.048566 Feb 19 21:11:14.711506 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2172/4437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:14 2022] GET /compute/v2.1/servers/5fbc665c-bed1-40cf-a142-b1d8fae201e6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:11:14.762505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2309c107-e181-473e-a214-e7cbaf421443 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:14.763350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2309c107-e181-473e-a214-e7cbaf421443 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:14.772121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2309c107-e181-473e-a214-e7cbaf421443 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:14.772786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2309c107-e181-473e-a214-e7cbaf421443 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:14.775283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2309c107-e181-473e-a214-e7cbaf421443 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:14.779387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2309c107-e181-473e-a214-e7cbaf421443 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:14.812664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] validate_networks() for [('813ad1c1-0059-4a59-91cb-1222ec1b44c2', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:11:14.969263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2309c107-e181-473e-a214-e7cbaf421443 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:14.977494 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2309c107-e181-473e-a214-e7cbaf421443 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1289 microversion: 2.1 time: 0.218552 Feb 19 21:11:14.980207 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2173/4438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:14 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1289 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:15.265636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b3221f77-4b79-455b-b119-e750b4b6343e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:15.266259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b3221f77-4b79-455b-b119-e750b4b6343e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:15.280026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3221f77-4b79-455b-b119-e750b4b6343e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:15.280796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3221f77-4b79-455b-b119-e750b4b6343e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:15.282690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3221f77-4b79-455b-b119-e750b4b6343e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:15.283390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3221f77-4b79-455b-b119-e750b4b6343e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:15.694246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b3221f77-4b79-455b-b119-e750b4b6343e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:15.695878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:11:15.696947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:11:15.697674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:11:15.698290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:11:15.699996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:11:15.712849 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b3221f77-4b79-455b-b119-e750b4b6343e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 0.452564 Feb 19 21:11:15.714066 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2174/4439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:15 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:15.719339 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-97fb843b-7828-41ba-bbde-ca8b238ad81c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:15.721368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:15.721826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:15.722653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:15.723239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-97fb843b-7828-41ba-bbde-ca8b238ad81c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:15.731388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:15.756308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97fb843b-7828-41ba-bbde-ca8b238ad81c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:15.757202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97fb843b-7828-41ba-bbde-ca8b238ad81c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:15.758731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97fb843b-7828-41ba-bbde-ca8b238ad81c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:15.760972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97fb843b-7828-41ba-bbde-ca8b238ad81c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:15.808816 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-97fb843b-7828-41ba-bbde-ca8b238ad81c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.093175 Feb 19 21:11:15.814779 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2175/4440] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Feb 19 21:11:15 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:15.832509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for project adecc012aca243138d03c189f5623f73. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:11:15.851820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Getting quotas for user 7132cae4ebd549d491f5d0dcf83394ed and project adecc012aca243138d03c189f5623f73. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:11:15.892612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2dc1c3fe-f585-4beb-b9fd-a6877ad835f7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:15.894109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2dc1c3fe-f585-4beb-b9fd-a6877ad835f7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:15.901551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dc1c3fe-f585-4beb-b9fd-a6877ad835f7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:15.902006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dc1c3fe-f585-4beb-b9fd-a6877ad835f7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:15.903341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dc1c3fe-f585-4beb-b9fd-a6877ad835f7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:15.903776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dc1c3fe-f585-4beb-b9fd-a6877ad835f7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:15.910035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:11:15.913615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:11:15.979906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2dc1c3fe-f585-4beb-b9fd-a6877ad835f7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:11:16.004962 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0c3d3984-7596-4860-ba33-7438019352f7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.660356 Feb 19 21:11:16.006165 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2266/4441] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:11:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:11:16.021086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b47bfb8-a5df-42b5-9a45-85f7d3036974 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:16.025900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9b47bfb8-a5df-42b5-9a45-85f7d3036974 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:16.043792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b47bfb8-a5df-42b5-9a45-85f7d3036974 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:16.044539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b47bfb8-a5df-42b5-9a45-85f7d3036974 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:16.046277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b47bfb8-a5df-42b5-9a45-85f7d3036974 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:16.046928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b47bfb8-a5df-42b5-9a45-85f7d3036974 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:16.158173 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2dc1c3fe-f585-4beb-b9fd-a6877ad835f7 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 204 len: 0 microversion: 2.20 time: 0.271198 Feb 19 21:11:16.161898 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2176/4442] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:11:15 2022] DELETE /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 19 21:11:16.171244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d5bec177-9465-4f76-a907-8bbfc58378de tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:16.173691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d5bec177-9465-4f76-a907-8bbfc58378de tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:16.225808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9b47bfb8-a5df-42b5-9a45-85f7d3036974 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:16.241552 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b47bfb8-a5df-42b5-9a45-85f7d3036974 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1351 microversion: 2.1 time: 0.232901 Feb 19 21:11:16.242793 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2267/4443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:16 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1351 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:16.250511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:16.251568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:16.268414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:16.270651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:16.272514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:16.272514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:16.358668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d5bec177-9465-4f76-a907-8bbfc58378de tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:16.366162 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d5bec177-9465-4f76-a907-8bbfc58378de tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1238 microversion: 2.1 time: 0.202784 Feb 19 21:11:16.366768 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2177/4444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:16 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1238 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:16.584662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:16.599043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:16.601448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:16.603415 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-74ed74a7-0d7c-4197-8071-4970aba073ea tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.359324 Feb 19 21:11:16.616195 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2268/4445] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:11:16 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:11:16.734721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e494b774-3a14-4a6b-9dec-1be927f7e882 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:16.735939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e494b774-3a14-4a6b-9dec-1be927f7e882 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:16.773232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e494b774-3a14-4a6b-9dec-1be927f7e882 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:16.774504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e494b774-3a14-4a6b-9dec-1be927f7e882 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:16.775537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e494b774-3a14-4a6b-9dec-1be927f7e882 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:16.783289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e494b774-3a14-4a6b-9dec-1be927f7e882 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:17.259332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6767afb8-30bf-45a6-a0d4-ed3abb11b043 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:17.259955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6767afb8-30bf-45a6-a0d4-ed3abb11b043 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:17.267064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6767afb8-30bf-45a6-a0d4-ed3abb11b043 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:17.267519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6767afb8-30bf-45a6-a0d4-ed3abb11b043 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:17.268384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6767afb8-30bf-45a6-a0d4-ed3abb11b043 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:17.275948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6767afb8-30bf-45a6-a0d4-ed3abb11b043 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:17.443429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e494b774-3a14-4a6b-9dec-1be927f7e882 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:17.453663 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e494b774-3a14-4a6b-9dec-1be927f7e882 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 0.725968 Feb 19 21:11:17.454523 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2178/4446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:16 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:17.460493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae749f00-ac19-4bf0-9de8-592d0ddf33c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:17.461380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae749f00-ac19-4bf0-9de8-592d0ddf33c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:17.469233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae749f00-ac19-4bf0-9de8-592d0ddf33c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:17.469971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae749f00-ac19-4bf0-9de8-592d0ddf33c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:17.470936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae749f00-ac19-4bf0-9de8-592d0ddf33c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:17.472510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae749f00-ac19-4bf0-9de8-592d0ddf33c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:17.674009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae749f00-ac19-4bf0-9de8-592d0ddf33c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:17.687629 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae749f00-ac19-4bf0-9de8-592d0ddf33c9 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1290 microversion: 2.1 time: 0.231845 Feb 19 21:11:17.689307 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2179/4447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:17 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1290 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:17.714398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:17.716310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:17.734896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:17.736107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:17.736992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:17.738679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:18.094808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6767afb8-30bf-45a6-a0d4-ed3abb11b043 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:18.108116 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6767afb8-30bf-45a6-a0d4-ed3abb11b043 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1471 microversion: 2.1 time: 0.852789 Feb 19 21:11:18.108799 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2269/4448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:17 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1471 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:18.244499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e8c1724e-de16-4665-a7bc-ed152170811b req-6f7f5c08-66ff-4ed4-b6af-d2cbe959f2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26035c7e-8e0f-48e4-bbef-0d0eae15c929", "tag": "9fef2353-c49f-4800-8469-da61cf4f519d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:18.246147 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:18.246147 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:18.263410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e8c1724e-de16-4665-a7bc-ed152170811b req-6f7f5c08-66ff-4ed4-b6af-d2cbe959f2dc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:18.263966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e8c1724e-de16-4665-a7bc-ed152170811b req-6f7f5c08-66ff-4ed4-b6af-d2cbe959f2dc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:18.291108 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e8c1724e-de16-4665-a7bc-ed152170811b req-6f7f5c08-66ff-4ed4-b6af-d2cbe959f2dc service nova] Creating event network-changed:9fef2353-c49f-4800-8469-da61cf4f519d for instance 26035c7e-8e0f-48e4-bbef-0d0eae15c929 on nch1-master-1 Feb 19 21:11:18.301139 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e8c1724e-de16-4665-a7bc-ed152170811b req-6f7f5c08-66ff-4ed4-b6af-d2cbe959f2dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060203 Feb 19 21:11:18.305413 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2270/4449] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:11:18.475106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2cecc78-c34b-4cd3-9956-18f99b35230f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:18.476428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b2cecc78-c34b-4cd3-9956-18f99b35230f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:18.488769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2cecc78-c34b-4cd3-9956-18f99b35230f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:18.489227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2cecc78-c34b-4cd3-9956-18f99b35230f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:18.498111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2cecc78-c34b-4cd3-9956-18f99b35230f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:18.498676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2cecc78-c34b-4cd3-9956-18f99b35230f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:19.178769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:19.194417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:19.196175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:19.197839 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a14a9de1-72d3-47d4-9c56-256ba0ebc482 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 1.507225 Feb 19 21:11:19.198910 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2180/4450] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:11:17 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:11:19.214483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4db18d94-0af9-464f-bfc8-e423b286cb15 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:19.215175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4db18d94-0af9-464f-bfc8-e423b286cb15 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:19.227177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4db18d94-0af9-464f-bfc8-e423b286cb15 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:19.227177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4db18d94-0af9-464f-bfc8-e423b286cb15 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:19.227177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4db18d94-0af9-464f-bfc8-e423b286cb15 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:19.227177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4db18d94-0af9-464f-bfc8-e423b286cb15 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:19.399965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4db18d94-0af9-464f-bfc8-e423b286cb15 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:19.412321 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4db18d94-0af9-464f-bfc8-e423b286cb15 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1296 microversion: 2.1 time: 0.211698 Feb 19 21:11:19.414036 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2181/4451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:19 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1296 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:19.423674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-992b0f37-0ce3-485a-a1f0-e53d87ae0f0e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:19.426176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-992b0f37-0ce3-485a-a1f0-e53d87ae0f0e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:19.433738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-992b0f37-0ce3-485a-a1f0-e53d87ae0f0e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:19.434547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-992b0f37-0ce3-485a-a1f0-e53d87ae0f0e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:19.435841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-992b0f37-0ce3-485a-a1f0-e53d87ae0f0e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:19.436534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-992b0f37-0ce3-485a-a1f0-e53d87ae0f0e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:19.653044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b2cecc78-c34b-4cd3-9956-18f99b35230f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:19.661877 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2cecc78-c34b-4cd3-9956-18f99b35230f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 1.193568 Feb 19 21:11:19.671548 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2271/4452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:18 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:20.131112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-992b0f37-0ce3-485a-a1f0-e53d87ae0f0e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:20.166574 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-992b0f37-0ce3-485a-a1f0-e53d87ae0f0e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1471 microversion: 2.1 time: 0.747278 Feb 19 21:11:20.166574 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2182/4453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:19 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1471 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:20.219236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:20.219760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:20.228570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:20.229532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:20.231852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:20.233535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:20.431187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71b3eb61-7190-4922-b2e9-21cd89830917 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:20.431961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-71b3eb61-7190-4922-b2e9-21cd89830917 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:20.445420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71b3eb61-7190-4922-b2e9-21cd89830917 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:20.445988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71b3eb61-7190-4922-b2e9-21cd89830917 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:20.447230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71b3eb61-7190-4922-b2e9-21cd89830917 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:20.447713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71b3eb61-7190-4922-b2e9-21cd89830917 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:20.623173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-71b3eb61-7190-4922-b2e9-21cd89830917 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:20.632313 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71b3eb61-7190-4922-b2e9-21cd89830917 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1296 microversion: 2.1 time: 0.205957 Feb 19 21:11:20.633201 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2183/4454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:20 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1296 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:20.692764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ac3892e4-1315-43eb-9866-866a205625e8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:20.694446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ac3892e4-1315-43eb-9866-866a205625e8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:20.724352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac3892e4-1315-43eb-9866-866a205625e8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:20.724961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac3892e4-1315-43eb-9866-866a205625e8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:20.735100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac3892e4-1315-43eb-9866-866a205625e8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:20.736029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac3892e4-1315-43eb-9866-866a205625e8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:20.924605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:20.943564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:20.946927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:20.948685 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54250cc8-e026-4610-855b-03fbd3f34f2e tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1722 microversion: 2.20 time: 0.734782 Feb 19 21:11:20.949477 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2272/4455] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:11:20 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1722 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:11:21.182788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1365f4bc-0fe8-4efb-b12b-0874edde558c tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:21.183824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1365f4bc-0fe8-4efb-b12b-0874edde558c tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:21.198556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1365f4bc-0fe8-4efb-b12b-0874edde558c tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:21.199008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1365f4bc-0fe8-4efb-b12b-0874edde558c tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:21.199811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1365f4bc-0fe8-4efb-b12b-0874edde558c tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:21.200249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1365f4bc-0fe8-4efb-b12b-0874edde558c tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:21.571719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ac3892e4-1315-43eb-9866-866a205625e8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:21.598179 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ac3892e4-1315-43eb-9866-866a205625e8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 0.921400 Feb 19 21:11:21.610697 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2184/4456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:20 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:21.650842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d60fdd36-25d9-4166-a7ac-42e49e4697c1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:21.651484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d60fdd36-25d9-4166-a7ac-42e49e4697c1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:21.661960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d60fdd36-25d9-4166-a7ac-42e49e4697c1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:21.662418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d60fdd36-25d9-4166-a7ac-42e49e4697c1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:21.664936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d60fdd36-25d9-4166-a7ac-42e49e4697c1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:21.668481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d60fdd36-25d9-4166-a7ac-42e49e4697c1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:22.079782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1365f4bc-0fe8-4efb-b12b-0874edde558c tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:22.100644 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1365f4bc-0fe8-4efb-b12b-0874edde558c tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1471 microversion: 2.1 time: 0.922520 Feb 19 21:11:22.104040 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2273/4457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:21 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1471 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:22.116668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:22.117570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:22.125053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:22.125742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:22.126794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:22.127432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:22.475989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:22.487020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:22.489674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a388edbf88ba4749b3abb2a42b750757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ad9ca9c0944ba68443aaa71a10eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:22.491386 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-066b9700-82c4-425b-a9dd-f37a7441626c tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 200 len: 1654 microversion: 2.20 time: 0.387345 Feb 19 21:11:22.492090 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2274/4458] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:11:22 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 1654 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:11:22.620117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3b6efc69-80f9-4a00-890d-3e22242096a6 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:22.621075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3b6efc69-80f9-4a00-890d-3e22242096a6 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:22.627217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d60fdd36-25d9-4166-a7ac-42e49e4697c1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:22.633759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b6efc69-80f9-4a00-890d-3e22242096a6 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:22.634521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b6efc69-80f9-4a00-890d-3e22242096a6 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:22.635742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b6efc69-80f9-4a00-890d-3e22242096a6 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:22.636494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b6efc69-80f9-4a00-890d-3e22242096a6 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:22.645345 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d60fdd36-25d9-4166-a7ac-42e49e4697c1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1364 microversion: 2.1 time: 0.996861 Feb 19 21:11:22.652516 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2185/4459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:21 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1364 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:23.122878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1376712d-bf45-493f-b7c1-7f190853e697 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:23.123804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1376712d-bf45-493f-b7c1-7f190853e697 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:23.142575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1376712d-bf45-493f-b7c1-7f190853e697 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:23.144052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1376712d-bf45-493f-b7c1-7f190853e697 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:23.145375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1376712d-bf45-493f-b7c1-7f190853e697 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:23.146098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1376712d-bf45-493f-b7c1-7f190853e697 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:23.723873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3b6efc69-80f9-4a00-890d-3e22242096a6 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:23.769261 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3b6efc69-80f9-4a00-890d-3e22242096a6 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 1.151406 Feb 19 21:11:23.779507 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2275/4460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:22 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:23.796562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6baf2c38-af01-41d9-900e-2e31424c7ad3 req-f8ab07fd-a22f-4b7b-86fc-e648b24cd8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9598d4a9-3a39-4e96-b6ea-d437e2050247", "name": "network-vif-deleted", "tag": "705d433e-42c6-442d-adce-cb0486512277"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:23.802050 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:23.802050 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:23.812492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6baf2c38-af01-41d9-900e-2e31424c7ad3 req-f8ab07fd-a22f-4b7b-86fc-e648b24cd8b6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:23.813185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6baf2c38-af01-41d9-900e-2e31424c7ad3 req-f8ab07fd-a22f-4b7b-86fc-e648b24cd8b6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:23.828463 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6baf2c38-af01-41d9-900e-2e31424c7ad3 req-f8ab07fd-a22f-4b7b-86fc-e648b24cd8b6 service nova] Creating event network-vif-deleted:705d433e-42c6-442d-adce-cb0486512277 for instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 on nch1-master-1 Feb 19 21:11:23.837307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6baf2c38-af01-41d9-900e-2e31424c7ad3 req-f8ab07fd-a22f-4b7b-86fc-e648b24cd8b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055352 Feb 19 21:11:23.838767 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2276/4461] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:23.846510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-219954f2-7f35-4c8a-827d-be79e48391b2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:23.848756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-219954f2-7f35-4c8a-827d-be79e48391b2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:23.866950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-219954f2-7f35-4c8a-827d-be79e48391b2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:23.867407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-219954f2-7f35-4c8a-827d-be79e48391b2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:23.868437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-219954f2-7f35-4c8a-827d-be79e48391b2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:23.869708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-219954f2-7f35-4c8a-827d-be79e48391b2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:23.922739 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-219954f2-7f35-4c8a-827d-be79e48391b2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] HTTP exception thrown: Instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 could not be found. Feb 19 21:11:23.924102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-219954f2-7f35-4c8a-827d-be79e48391b2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Returning 404 to user: Instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:23.927823 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-219954f2-7f35-4c8a-827d-be79e48391b2 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 404 len: 111 microversion: 2.20 time: 0.086969 Feb 19 21:11:23.932269 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2277/4462] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:11:23 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:11:23.945755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd68b37b-7790-4981-bd00-bad5e07d60dd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:23.956993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dd68b37b-7790-4981-bd00-bad5e07d60dd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:23.968322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1376712d-bf45-493f-b7c1-7f190853e697 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:23.972878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd68b37b-7790-4981-bd00-bad5e07d60dd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:23.974815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd68b37b-7790-4981-bd00-bad5e07d60dd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:23.977484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd68b37b-7790-4981-bd00-bad5e07d60dd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:23.981216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd68b37b-7790-4981-bd00-bad5e07d60dd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:23.985463 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1376712d-bf45-493f-b7c1-7f190853e697 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1471 microversion: 2.1 time: 0.868381 Feb 19 21:11:23.990358 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2186/4463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:23 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1471 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:24.004717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fd73d167-3251-4503-8f5c-821e5c301baf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '.version_select at 0x7f64743474c0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:24.080694 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fd73d167-3251-4503-8f5c-821e5c301baf tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425274070" status: 204 len: 0 microversion: 2.20 time: 0.088529 Feb 19 21:11:24.087748 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2187/4464] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 21:11:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425274070 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:11:24.515283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b0234b60-17cf-44c9-8a3c-aa4b7dc623da req-53308aac-0c44-4eb1-8ef0-40790867c049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26035c7e-8e0f-48e4-bbef-0d0eae15c929", "name": "network-vif-plugged", "status": "completed", "tag": "9fef2353-c49f-4800-8469-da61cf4f519d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:24.520595 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:24.520595 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:24.541885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b0234b60-17cf-44c9-8a3c-aa4b7dc623da req-53308aac-0c44-4eb1-8ef0-40790867c049 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:24.543597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b0234b60-17cf-44c9-8a3c-aa4b7dc623da req-53308aac-0c44-4eb1-8ef0-40790867c049 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:24.575354 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b0234b60-17cf-44c9-8a3c-aa4b7dc623da req-53308aac-0c44-4eb1-8ef0-40790867c049 service nova] Creating event network-vif-plugged:9fef2353-c49f-4800-8469-da61cf4f519d for instance 26035c7e-8e0f-48e4-bbef-0d0eae15c929 on nch1-master-1 Feb 19 21:11:24.588079 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b0234b60-17cf-44c9-8a3c-aa4b7dc623da req-53308aac-0c44-4eb1-8ef0-40790867c049 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219873 Feb 19 21:11:24.590991 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2188/4465] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:24.815152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0c188351-b61e-4ce3-92d1-5bbd8eaeda7c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:24.823928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0c188351-b61e-4ce3-92d1-5bbd8eaeda7c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:24.845569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c188351-b61e-4ce3-92d1-5bbd8eaeda7c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:24.845569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c188351-b61e-4ce3-92d1-5bbd8eaeda7c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:24.845569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c188351-b61e-4ce3-92d1-5bbd8eaeda7c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:24.863402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0c188351-b61e-4ce3-92d1-5bbd8eaeda7c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:25.637973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dd68b37b-7790-4981-bd00-bad5e07d60dd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:25.649077 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dd68b37b-7790-4981-bd00-bad5e07d60dd tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1364 microversion: 2.1 time: 1.715299 Feb 19 21:11:25.649662 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2278/4466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:23 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1364 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:25.670786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b46b9a3-225c-4c3f-9de2-954bfd057eb1 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:25.671697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9b46b9a3-225c-4c3f-9de2-954bfd057eb1 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:25.680783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b46b9a3-225c-4c3f-9de2-954bfd057eb1 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:25.684612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b46b9a3-225c-4c3f-9de2-954bfd057eb1 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:25.684612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b46b9a3-225c-4c3f-9de2-954bfd057eb1 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:25.684612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b46b9a3-225c-4c3f-9de2-954bfd057eb1 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:25.955875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0c188351-b61e-4ce3-92d1-5bbd8eaeda7c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:25.968381 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0c188351-b61e-4ce3-92d1-5bbd8eaeda7c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 1.168739 Feb 19 21:11:25.977515 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2189/4467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:24 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:26.246244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-58280efb-755c-4b9e-b2c0-5edc8d4d783f req-e0696ac2-7168-47b2-89b1-b2c187869773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39379933-a0d4-41b1-a9ba-ced8e7b82b4f", "tag": "72c6a85b-be73-4cca-80b1-c2d505f4fabf"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:26.250325 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:26.250325 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:26.299310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9b46b9a3-225c-4c3f-9de2-954bfd057eb1 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:26.318695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-58280efb-755c-4b9e-b2c0-5edc8d4d783f req-e0696ac2-7168-47b2-89b1-b2c187869773 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:26.321274 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b46b9a3-225c-4c3f-9de2-954bfd057eb1 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1471 microversion: 2.1 time: 0.665702 Feb 19 21:11:26.322104 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2279/4468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:25 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1471 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:26.332303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-58280efb-755c-4b9e-b2c0-5edc8d4d783f req-e0696ac2-7168-47b2-89b1-b2c187869773 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:26.355764 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-58280efb-755c-4b9e-b2c0-5edc8d4d783f req-e0696ac2-7168-47b2-89b1-b2c187869773 service nova] Creating event network-changed:72c6a85b-be73-4cca-80b1-c2d505f4fabf for instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f on nch2-master-1 Feb 19 21:11:26.366837 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-58280efb-755c-4b9e-b2c0-5edc8d4d783f req-e0696ac2-7168-47b2-89b1-b2c187869773 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144263 Feb 19 21:11:26.369722 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2190/4469] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:26.666816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-755fea28-f899-4182-8abc-83d454fff5a2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:26.668717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-755fea28-f899-4182-8abc-83d454fff5a2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:26.691296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-755fea28-f899-4182-8abc-83d454fff5a2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:26.694166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-755fea28-f899-4182-8abc-83d454fff5a2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:26.697935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-755fea28-f899-4182-8abc-83d454fff5a2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:26.700002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-755fea28-f899-4182-8abc-83d454fff5a2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:26.997090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-993bab8a-51fa-4841-bf70-10f5666efa88 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:26.998508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-993bab8a-51fa-4841-bf70-10f5666efa88 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:27.031695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-993bab8a-51fa-4841-bf70-10f5666efa88 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:27.035269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-993bab8a-51fa-4841-bf70-10f5666efa88 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:27.036375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-993bab8a-51fa-4841-bf70-10f5666efa88 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:27.036985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-993bab8a-51fa-4841-bf70-10f5666efa88 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:27.481968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-755fea28-f899-4182-8abc-83d454fff5a2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:27.500505 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-755fea28-f899-4182-8abc-83d454fff5a2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1364 microversion: 2.1 time: 0.837498 Feb 19 21:11:27.501346 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2280/4470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:26 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1364 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:27.506536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7fdf9691-5947-41e4-a062-4568bff94689 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:27.517271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7fdf9691-5947-41e4-a062-4568bff94689 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:27.524549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fdf9691-5947-41e4-a062-4568bff94689 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:27.525188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fdf9691-5947-41e4-a062-4568bff94689 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:27.528705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fdf9691-5947-41e4-a062-4568bff94689 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:27.529348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7fdf9691-5947-41e4-a062-4568bff94689 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:27.797087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-993bab8a-51fa-4841-bf70-10f5666efa88 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:27.822104 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-993bab8a-51fa-4841-bf70-10f5666efa88 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 0.830731 Feb 19 21:11:27.826324 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2191/4471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:26 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:28.156276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7fdf9691-5947-41e4-a062-4568bff94689 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:28.175654 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7fdf9691-5947-41e4-a062-4568bff94689 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1644 microversion: 2.1 time: 0.672897 Feb 19 21:11:28.176697 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2281/4472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:27 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1644 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:28.200289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ed0849af-038c-4fba-a42d-388871eca0ed tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:28.201321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ed0849af-038c-4fba-a42d-388871eca0ed tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:28.218202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed0849af-038c-4fba-a42d-388871eca0ed tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:28.236370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed0849af-038c-4fba-a42d-388871eca0ed tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:28.238399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed0849af-038c-4fba-a42d-388871eca0ed tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:28.241949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed0849af-038c-4fba-a42d-388871eca0ed tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:28.522712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0af511a7-1589-4df5-8a69-00c203720c88 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:28.526283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0af511a7-1589-4df5-8a69-00c203720c88 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:28.540103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0af511a7-1589-4df5-8a69-00c203720c88 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:28.540565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0af511a7-1589-4df5-8a69-00c203720c88 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:28.541310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0af511a7-1589-4df5-8a69-00c203720c88 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:28.541743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0af511a7-1589-4df5-8a69-00c203720c88 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:28.977150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ed0849af-038c-4fba-a42d-388871eca0ed tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:29.031462 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ed0849af-038c-4fba-a42d-388871eca0ed tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1644 microversion: 2.1 time: 0.841089 Feb 19 21:11:29.038713 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2192/4473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:28 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1644 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:29.059178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f96c3df-47fb-4a1b-bb57-f2fe970dd2b4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:29.060028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f96c3df-47fb-4a1b-bb57-f2fe970dd2b4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:29.068531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f96c3df-47fb-4a1b-bb57-f2fe970dd2b4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:29.068531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f96c3df-47fb-4a1b-bb57-f2fe970dd2b4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:29.068823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f96c3df-47fb-4a1b-bb57-f2fe970dd2b4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:29.069314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f96c3df-47fb-4a1b-bb57-f2fe970dd2b4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:29.305017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0af511a7-1589-4df5-8a69-00c203720c88 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:29.327945 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0af511a7-1589-4df5-8a69-00c203720c88 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1364 microversion: 2.1 time: 0.809866 Feb 19 21:11:29.331710 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2282/4474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:28 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1364 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:29.337884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a7de99b3-323d-4bad-9e9a-c57742489337 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:29.348660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a7de99b3-323d-4bad-9e9a-c57742489337 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:29.357438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7de99b3-323d-4bad-9e9a-c57742489337 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:29.358172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7de99b3-323d-4bad-9e9a-c57742489337 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:29.359295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7de99b3-323d-4bad-9e9a-c57742489337 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:29.360905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7de99b3-323d-4bad-9e9a-c57742489337 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:29.554340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9f96c3df-47fb-4a1b-bb57-f2fe970dd2b4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:29.562923 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f96c3df-47fb-4a1b-bb57-f2fe970dd2b4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 0.522580 Feb 19 21:11:29.563646 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2193/4475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:29 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:30.097323 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a7de99b3-323d-4bad-9e9a-c57742489337 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1795 microversion: 2.1 time: 0.763842 Feb 19 21:11:30.109873 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2283/4476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:29 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1795 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:30.351814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-38138b7c-74c6-4468-9e04-a41d91bce9fe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:30.352886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-38138b7c-74c6-4468-9e04-a41d91bce9fe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:30.361226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38138b7c-74c6-4468-9e04-a41d91bce9fe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:30.362036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38138b7c-74c6-4468-9e04-a41d91bce9fe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:30.362897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38138b7c-74c6-4468-9e04-a41d91bce9fe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:30.364126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-38138b7c-74c6-4468-9e04-a41d91bce9fe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:30.584632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f78e73a-50af-4d4c-8761-0f43d6fcf364 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:30.587418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f78e73a-50af-4d4c-8761-0f43d6fcf364 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:30.603419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f78e73a-50af-4d4c-8761-0f43d6fcf364 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:30.604447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f78e73a-50af-4d4c-8761-0f43d6fcf364 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:30.606350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f78e73a-50af-4d4c-8761-0f43d6fcf364 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:30.607012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f78e73a-50af-4d4c-8761-0f43d6fcf364 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:30.744091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-38138b7c-74c6-4468-9e04-a41d91bce9fe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:30.753590 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-38138b7c-74c6-4468-9e04-a41d91bce9fe tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1364 microversion: 2.1 time: 0.405040 Feb 19 21:11:30.754573 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2194/4477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:30 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1364 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:30.922471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f78e73a-50af-4d4c-8761-0f43d6fcf364 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:30.931216 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f78e73a-50af-4d4c-8761-0f43d6fcf364 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 0.351250 Feb 19 21:11:30.931840 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2284/4478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:30 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:31.199435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6690db15-148f-4456-8644-0add1cc01720 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:31.199934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6690db15-148f-4456-8644-0add1cc01720 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:31.210485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6690db15-148f-4456-8644-0add1cc01720 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:31.211487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6690db15-148f-4456-8644-0add1cc01720 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:31.212492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6690db15-148f-4456-8644-0add1cc01720 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:31.213209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6690db15-148f-4456-8644-0add1cc01720 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:31.228290 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-6690db15-148f-4456-8644-0add1cc01720 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] HTTP exception thrown: Instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 could not be found. Feb 19 21:11:31.228993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6690db15-148f-4456-8644-0add1cc01720 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Returning 404 to user: Instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:31.229853 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6690db15-148f-4456-8644-0add1cc01720 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 404 len: 111 microversion: 2.20 time: 0.034127 Feb 19 21:11:31.230944 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2195/4479] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:11:31 2022] DELETE /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:11:31.239897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-051272f0-fff8-4c26-8907-da038daf953d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:31.240555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-051272f0-fff8-4c26-8907-da038daf953d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 9598d4a9-3a39-4e96-b6ea-d437e2050247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:31.253428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-051272f0-fff8-4c26-8907-da038daf953d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:31.253935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-051272f0-fff8-4c26-8907-da038daf953d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:31.255286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-051272f0-fff8-4c26-8907-da038daf953d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:31.256853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-051272f0-fff8-4c26-8907-da038daf953d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:31.272693 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-051272f0-fff8-4c26-8907-da038daf953d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] HTTP exception thrown: Instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 could not be found. Feb 19 21:11:31.273319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-051272f0-fff8-4c26-8907-da038daf953d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Returning 404 to user: Instance 9598d4a9-3a39-4e96-b6ea-d437e2050247 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:31.274187 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-051272f0-fff8-4c26-8907-da038daf953d tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247" status: 404 len: 111 microversion: 2.20 time: 0.038365 Feb 19 21:11:31.274924 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2285/4480] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:11:31 2022] GET /compute/v2.1/servers/9598d4a9-3a39-4e96-b6ea-d437e2050247 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 19 21:11:31.770316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7e16f334-2174-48f7-83c3-c08cd12a43a0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:31.771105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7e16f334-2174-48f7-83c3-c08cd12a43a0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:31.779317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e16f334-2174-48f7-83c3-c08cd12a43a0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:31.780076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e16f334-2174-48f7-83c3-c08cd12a43a0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:31.781143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e16f334-2174-48f7-83c3-c08cd12a43a0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:31.781602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7e16f334-2174-48f7-83c3-c08cd12a43a0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:31.952321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f383a653-9961-41a4-ab61-9a7f4d09ff4e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:31.953689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f383a653-9961-41a4-ab61-9a7f4d09ff4e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:31.966848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f383a653-9961-41a4-ab61-9a7f4d09ff4e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:31.967224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f383a653-9961-41a4-ab61-9a7f4d09ff4e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:31.968224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f383a653-9961-41a4-ab61-9a7f4d09ff4e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:31.969773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f383a653-9961-41a4-ab61-9a7f4d09ff4e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:32.199201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7e16f334-2174-48f7-83c3-c08cd12a43a0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:32.216679 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7e16f334-2174-48f7-83c3-c08cd12a43a0 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1364 microversion: 2.1 time: 0.447790 Feb 19 21:11:32.218239 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2196/4481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:31 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1364 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:32.351778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f383a653-9961-41a4-ab61-9a7f4d09ff4e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:32.359993 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f383a653-9961-41a4-ab61-9a7f4d09ff4e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 0.412889 Feb 19 21:11:32.360721 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2286/4482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:31 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:32.443853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-246ab1a7-2cbf-4146-a0e0-78d3325366ee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:32.443853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-246ab1a7-2cbf-4146-a0e0-78d3325366ee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:32.449858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246ab1a7-2cbf-4146-a0e0-78d3325366ee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:32.450317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246ab1a7-2cbf-4146-a0e0-78d3325366ee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:32.451264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246ab1a7-2cbf-4146-a0e0-78d3325366ee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:32.451887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-246ab1a7-2cbf-4146-a0e0-78d3325366ee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:32.468623 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-246ab1a7-2cbf-4146-a0e0-78d3325366ee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] HTTP exception thrown: Instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 could not be found. Feb 19 21:11:32.469485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-246ab1a7-2cbf-4146-a0e0-78d3325366ee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Returning 404 to user: Instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:32.470546 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-246ab1a7-2cbf-4146-a0e0-78d3325366ee tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 404 len: 111 microversion: 2.20 time: 0.038404 Feb 19 21:11:32.471115 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2197/4483] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:11:32 2022] DELETE /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:11:32.480659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fc92da19-7b56-4dcd-8cdb-42fe49b4e252 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:32.481710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fc92da19-7b56-4dcd-8cdb-42fe49b4e252 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] [instance: 17524174-4cfd-409a-b6f4-15bde7d2c4d1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:32.489985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc92da19-7b56-4dcd-8cdb-42fe49b4e252 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:32.491540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc92da19-7b56-4dcd-8cdb-42fe49b4e252 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:32.493544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc92da19-7b56-4dcd-8cdb-42fe49b4e252 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:32.494279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc92da19-7b56-4dcd-8cdb-42fe49b4e252 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:32.515101 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-fc92da19-7b56-4dcd-8cdb-42fe49b4e252 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] HTTP exception thrown: Instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 could not be found. Feb 19 21:11:32.516363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fc92da19-7b56-4dcd-8cdb-42fe49b4e252 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] Returning 404 to user: Instance 17524174-4cfd-409a-b6f4-15bde7d2c4d1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:32.517540 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fc92da19-7b56-4dcd-8cdb-42fe49b4e252 tempest-AttachVolumeShelveTestJSON-322283970 tempest-AttachVolumeShelveTestJSON-322283970-project] 10.222.0.30 "GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1" status: 404 len: 111 microversion: 2.20 time: 0.041139 Feb 19 21:11:32.518976 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2287/4484] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:11:32 2022] GET /compute/v2.1/servers/17524174-4cfd-409a-b6f4-15bde7d2c4d1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:11:33.236535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2ce4f51-82e9-4ac9-9867-50ea8697e188 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:33.238010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2ce4f51-82e9-4ac9-9867-50ea8697e188 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:33.255702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2ce4f51-82e9-4ac9-9867-50ea8697e188 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:33.257254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2ce4f51-82e9-4ac9-9867-50ea8697e188 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:33.260576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2ce4f51-82e9-4ac9-9867-50ea8697e188 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:33.261361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2ce4f51-82e9-4ac9-9867-50ea8697e188 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:33.381525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8e372634-53ad-4be4-ad00-ea542159446b tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:33.382153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8e372634-53ad-4be4-ad00-ea542159446b tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:33.403995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e372634-53ad-4be4-ad00-ea542159446b tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:33.404501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e372634-53ad-4be4-ad00-ea542159446b tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:33.405320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e372634-53ad-4be4-ad00-ea542159446b tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:33.409466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e372634-53ad-4be4-ad00-ea542159446b tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:34.108085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2ce4f51-82e9-4ac9-9867-50ea8697e188 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:34.119072 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2ce4f51-82e9-4ac9-9867-50ea8697e188 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1364 microversion: 2.1 time: 0.887668 Feb 19 21:11:34.120027 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2198/4485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:33 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1364 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:34.185881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8e372634-53ad-4be4-ad00-ea542159446b tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:34.201654 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8e372634-53ad-4be4-ad00-ea542159446b tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1523 microversion: 2.1 time: 0.827087 Feb 19 21:11:34.206016 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2288/4486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:33 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1523 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:34.413119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-cb66f0a3-9fa0-4b07-869d-95d97955e1d8 req-327813aa-476e-469f-9f03-a0ec2351bc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26035c7e-8e0f-48e4-bbef-0d0eae15c929", "tag": "9fef2353-c49f-4800-8469-da61cf4f519d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:34.415667 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:34.415667 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:34.436518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cb66f0a3-9fa0-4b07-869d-95d97955e1d8 req-327813aa-476e-469f-9f03-a0ec2351bc70 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:34.438578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cb66f0a3-9fa0-4b07-869d-95d97955e1d8 req-327813aa-476e-469f-9f03-a0ec2351bc70 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:34.467828 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-cb66f0a3-9fa0-4b07-869d-95d97955e1d8 req-327813aa-476e-469f-9f03-a0ec2351bc70 service nova] Creating event network-changed:9fef2353-c49f-4800-8469-da61cf4f519d for instance 26035c7e-8e0f-48e4-bbef-0d0eae15c929 on nch1-master-1 Feb 19 21:11:34.479704 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-cb66f0a3-9fa0-4b07-869d-95d97955e1d8 req-327813aa-476e-469f-9f03-a0ec2351bc70 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074833 Feb 19 21:11:34.483322 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2199/4487] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:35.024297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-57a8d5d5-31aa-43c4-9994-1dc8436bea27 req-d6fbcb53-5e23-415f-81f5-109d2120ecff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39379933-a0d4-41b1-a9ba-ced8e7b82b4f", "name": "network-vif-plugged", "status": "completed", "tag": "72c6a85b-be73-4cca-80b1-c2d505f4fabf"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:35.027418 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:35.027418 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:35.055075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-57a8d5d5-31aa-43c4-9994-1dc8436bea27 req-d6fbcb53-5e23-415f-81f5-109d2120ecff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:35.058310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-57a8d5d5-31aa-43c4-9994-1dc8436bea27 req-d6fbcb53-5e23-415f-81f5-109d2120ecff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:35.083331 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-57a8d5d5-31aa-43c4-9994-1dc8436bea27 req-d6fbcb53-5e23-415f-81f5-109d2120ecff service nova] Creating event network-vif-plugged:72c6a85b-be73-4cca-80b1-c2d505f4fabf for instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f on nch2-master-1 Feb 19 21:11:35.103230 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-57a8d5d5-31aa-43c4-9994-1dc8436bea27 req-d6fbcb53-5e23-415f-81f5-109d2120ecff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083543 Feb 19 21:11:35.104038 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2289/4488] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:35.137821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-88c48608-6ff7-4546-b4ae-1a631e550e32 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:35.138706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-88c48608-6ff7-4546-b4ae-1a631e550e32 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:35.156670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88c48608-6ff7-4546-b4ae-1a631e550e32 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:35.158525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88c48608-6ff7-4546-b4ae-1a631e550e32 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:35.161661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88c48608-6ff7-4546-b4ae-1a631e550e32 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:35.166318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88c48608-6ff7-4546-b4ae-1a631e550e32 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:35.220885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44f9512b-c28b-4a52-a143-a4ab503c075c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:35.222430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-44f9512b-c28b-4a52-a143-a4ab503c075c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:35.232267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44f9512b-c28b-4a52-a143-a4ab503c075c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:35.235539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44f9512b-c28b-4a52-a143-a4ab503c075c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:35.238017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44f9512b-c28b-4a52-a143-a4ab503c075c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:35.238535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44f9512b-c28b-4a52-a143-a4ab503c075c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:36.257628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44f9512b-c28b-4a52-a143-a4ab503c075c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:36.295853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-88c48608-6ff7-4546-b4ae-1a631e550e32 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:36.316721 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-88c48608-6ff7-4546-b4ae-1a631e550e32 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1364 microversion: 2.1 time: 1.184161 Feb 19 21:11:36.318847 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2200/4489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:35 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1364 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:36.340068 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44f9512b-c28b-4a52-a143-a4ab503c075c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1500 microversion: 2.1 time: 1.124499 Feb 19 21:11:36.353854 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2290/4490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:35 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1500 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:36.361483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ea49656e-cadd-4a82-a5ae-59f0858e9b90 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:36.366324 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:36.366324 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:36.370588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ea49656e-cadd-4a82-a5ae-59f0858e9b90 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:36.373449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ea49656e-cadd-4a82-a5ae-59f0858e9b90 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:36.383649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea49656e-cadd-4a82-a5ae-59f0858e9b90 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:36.390182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea49656e-cadd-4a82-a5ae-59f0858e9b90 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:36.391142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea49656e-cadd-4a82-a5ae-59f0858e9b90 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:36.391728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ea49656e-cadd-4a82-a5ae-59f0858e9b90 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:36.435213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-ea49656e-cadd-4a82-a5ae-59f0858e9b90 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:36.497508 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ea49656e-cadd-4a82-a5ae-59f0858e9b90 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.141245 Feb 19 21:11:36.498715 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2201/4491] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Feb 19 21:11:36 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:36.509850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8137eedd-fd4e-4ebf-bccd-96b036401f46 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:36.517857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8137eedd-fd4e-4ebf-bccd-96b036401f46 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:36.531690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8137eedd-fd4e-4ebf-bccd-96b036401f46 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:36.575068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8137eedd-fd4e-4ebf-bccd-96b036401f46 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Going to try to start instance {{(pid=136094) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 19 21:11:36.719290 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8137eedd-fd4e-4ebf-bccd-96b036401f46 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "POST /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d/action" status: 202 len: 0 microversion: 2.1 time: 0.213498 Feb 19 21:11:36.744048 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2291/4492] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:11:36 2022] POST /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:11:36.759428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff4cc2a7-fae2-4fcf-953a-ae668fe1708f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:36.760974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff4cc2a7-fae2-4fcf-953a-ae668fe1708f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:36.772135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff4cc2a7-fae2-4fcf-953a-ae668fe1708f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:36.774309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff4cc2a7-fae2-4fcf-953a-ae668fe1708f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:36.775403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff4cc2a7-fae2-4fcf-953a-ae668fe1708f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:36.776717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff4cc2a7-fae2-4fcf-953a-ae668fe1708f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:37.328045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ff4cc2a7-fae2-4fcf-953a-ae668fe1708f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:37.351608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0c9ec1fa-2a02-4406-bad1-e891b6ccefab tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:37.353889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0c9ec1fa-2a02-4406-bad1-e891b6ccefab tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:37.355749 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff4cc2a7-fae2-4fcf-953a-ae668fe1708f tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1509 microversion: 2.1 time: 0.606623 Feb 19 21:11:37.358258 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2202/4493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:36 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1509 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:37.375548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c9ec1fa-2a02-4406-bad1-e891b6ccefab tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:37.376160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c9ec1fa-2a02-4406-bad1-e891b6ccefab tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:37.382752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c9ec1fa-2a02-4406-bad1-e891b6ccefab tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:37.382752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0c9ec1fa-2a02-4406-bad1-e891b6ccefab tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:38.117026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0c9ec1fa-2a02-4406-bad1-e891b6ccefab tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:38.146509 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0c9ec1fa-2a02-4406-bad1-e891b6ccefab tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1364 microversion: 2.1 time: 0.812455 Feb 19 21:11:38.147066 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2292/4494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:37 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1364 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:38.380259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-20c602f9-4be2-405c-9a2e-4a5621bb15c3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:38.380883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-20c602f9-4be2-405c-9a2e-4a5621bb15c3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:38.396285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20c602f9-4be2-405c-9a2e-4a5621bb15c3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:38.397785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20c602f9-4be2-405c-9a2e-4a5621bb15c3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:38.398848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20c602f9-4be2-405c-9a2e-4a5621bb15c3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:38.399470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20c602f9-4be2-405c-9a2e-4a5621bb15c3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:38.836436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-20c602f9-4be2-405c-9a2e-4a5621bb15c3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:38.857330 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-20c602f9-4be2-405c-9a2e-4a5621bb15c3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1509 microversion: 2.1 time: 0.481987 Feb 19 21:11:38.858715 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2203/4495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:38 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1509 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:39.166855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cb71990f-2129-4380-97f6-fcbd1e07f9c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:39.167878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cb71990f-2129-4380-97f6-fcbd1e07f9c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:39.200814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb71990f-2129-4380-97f6-fcbd1e07f9c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:39.201521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb71990f-2129-4380-97f6-fcbd1e07f9c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:39.202864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb71990f-2129-4380-97f6-fcbd1e07f9c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:39.203555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb71990f-2129-4380-97f6-fcbd1e07f9c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:39.466889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cb71990f-2129-4380-97f6-fcbd1e07f9c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:39.478838 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cb71990f-2129-4380-97f6-fcbd1e07f9c8 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1551 microversion: 2.1 time: 0.319369 Feb 19 21:11:39.479926 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2293/4496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:39 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1551 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:39.508524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-496c8161-32e1-4040-a12c-6ca5b65f9dba tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:39.509390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-496c8161-32e1-4040-a12c-6ca5b65f9dba tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:39.525407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-496c8161-32e1-4040-a12c-6ca5b65f9dba tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:39.525869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-496c8161-32e1-4040-a12c-6ca5b65f9dba tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:39.526677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-496c8161-32e1-4040-a12c-6ca5b65f9dba tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:39.530622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-496c8161-32e1-4040-a12c-6ca5b65f9dba tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:39.769574 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-496c8161-32e1-4040-a12c-6ca5b65f9dba tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.273664 Feb 19 21:11:39.770684 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2204/4497] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:11:39 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:11:39.888350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-16e498a9-d3b0-4217-8619-6ddc06f32ac4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:39.890660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-16e498a9-d3b0-4217-8619-6ddc06f32ac4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:39.919173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16e498a9-d3b0-4217-8619-6ddc06f32ac4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:39.920517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16e498a9-d3b0-4217-8619-6ddc06f32ac4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:39.923952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16e498a9-d3b0-4217-8619-6ddc06f32ac4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:39.926891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16e498a9-d3b0-4217-8619-6ddc06f32ac4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:40.504236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-16e498a9-d3b0-4217-8619-6ddc06f32ac4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:40.522500 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-16e498a9-d3b0-4217-8619-6ddc06f32ac4 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1513 microversion: 2.1 time: 0.643112 Feb 19 21:11:40.528130 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2294/4498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:39 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1513 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:40.555571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fa5f8db6-d783-4846-b039-a515e6c3e38a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:40.562262 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:40.562262 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:40.566968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fa5f8db6-d783-4846-b039-a515e6c3e38a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:40.567980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.compute.servers [None req-fa5f8db6-d783-4846-b039-a515e6c3e38a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Removing options 'limit' from query {{(pid=136095) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Feb 19 21:11:40.571276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fa5f8db6-d783-4846-b039-a515e6c3e38a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:40.573030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa5f8db6-d783-4846-b039-a515e6c3e38a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:40.576119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa5f8db6-d783-4846-b039-a515e6c3e38a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:40.577510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa5f8db6-d783-4846-b039-a515e6c3e38a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:40.578385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fa5f8db6-d783-4846-b039-a515e6c3e38a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:40.579883 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fa5f8db6-d783-4846-b039-a515e6c3e38a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.031750 Feb 19 21:11:40.585020 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2205/4499] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Feb 19 21:11:40 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:11:40.599548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9d342b1e-53be-4a73-bd3d-45b466b9eb7a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:40.600677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9d342b1e-53be-4a73-bd3d-45b466b9eb7a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:40.615330 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d342b1e-53be-4a73-bd3d-45b466b9eb7a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:40.615800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d342b1e-53be-4a73-bd3d-45b466b9eb7a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:40.631714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d342b1e-53be-4a73-bd3d-45b466b9eb7a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:40.632573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d342b1e-53be-4a73-bd3d-45b466b9eb7a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:41.447027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9d342b1e-53be-4a73-bd3d-45b466b9eb7a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:41.458679 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9d342b1e-53be-4a73-bd3d-45b466b9eb7a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1513 microversion: 2.1 time: 0.864705 Feb 19 21:11:41.460798 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2295/4500] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:40 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1513 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:11:41.477724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2167184f-e09d-49cf-99ee-5240c2c6b289 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:41.478648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2167184f-e09d-49cf-99ee-5240c2c6b289 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:41.487715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2167184f-e09d-49cf-99ee-5240c2c6b289 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:41.488518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2167184f-e09d-49cf-99ee-5240c2c6b289 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:41.489470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2167184f-e09d-49cf-99ee-5240c2c6b289 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:41.490793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2167184f-e09d-49cf-99ee-5240c2c6b289 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:41.906952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2167184f-e09d-49cf-99ee-5240c2c6b289 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:41.921120 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2167184f-e09d-49cf-99ee-5240c2c6b289 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903" status: 200 len: 1513 microversion: 2.1 time: 0.448479 Feb 19 21:11:41.933952 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2206/4501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:41 2022] GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903 => generated 1513 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:41.946652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fa085558-561f-4868-9446-28f7fe4c2cb7 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:41.947481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa085558-561f-4868-9446-28f7fe4c2cb7 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:41.963807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa085558-561f-4868-9446-28f7fe4c2cb7 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:41.964256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa085558-561f-4868-9446-28f7fe4c2cb7 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:41.966136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa085558-561f-4868-9446-28f7fe4c2cb7 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:41.966770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa085558-561f-4868-9446-28f7fe4c2cb7 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:42.521825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fa085558-561f-4868-9446-28f7fe4c2cb7 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:42.531647 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fa085558-561f-4868-9446-28f7fe4c2cb7 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1513 microversion: 2.1 time: 0.593891 Feb 19 21:11:42.532652 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2296/4502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:41 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1513 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:42.550338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fd551f69-8e6f-4a9d-8fe9-f14b97000d6c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:42.554783 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:42.554783 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:42.556458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fd551f69-8e6f-4a9d-8fe9-f14b97000d6c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:42.557391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fd551f69-8e6f-4a9d-8fe9-f14b97000d6c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:42.815626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd551f69-8e6f-4a9d-8fe9-f14b97000d6c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:42.815626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd551f69-8e6f-4a9d-8fe9-f14b97000d6c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:42.817985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd551f69-8e6f-4a9d-8fe9-f14b97000d6c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:42.818938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd551f69-8e6f-4a9d-8fe9-f14b97000d6c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:42.934234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8a54abe7-4ab0-4959-992d-60d0d3b8f93d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:42.935482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8a54abe7-4ab0-4959-992d-60d0d3b8f93d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:42.948689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a54abe7-4ab0-4959-992d-60d0d3b8f93d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:42.952468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a54abe7-4ab0-4959-992d-60d0d3b8f93d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:42.959751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a54abe7-4ab0-4959-992d-60d0d3b8f93d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:42.960460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a54abe7-4ab0-4959-992d-60d0d3b8f93d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:43.010349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-fd551f69-8e6f-4a9d-8fe9-f14b97000d6c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:43.016171 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8a54abe7-4ab0-4959-992d-60d0d3b8f93d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/ips" status: 200 len: 107 microversion: 2.1 time: 0.085389 Feb 19 21:11:43.022368 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2297/4503] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:11:42 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/ips => generated 107 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:43.034892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f9f2d134-5d62-48e3-8330-460abcd8e493 req-f1ee2611-7078-4771-ae42-91909a044a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39379933-a0d4-41b1-a9ba-ced8e7b82b4f", "tag": "72c6a85b-be73-4cca-80b1-c2d505f4fabf"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:43.036298 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:43.036298 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:43.065787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f9f2d134-5d62-48e3-8330-460abcd8e493 req-f1ee2611-7078-4771-ae42-91909a044a4c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:43.066352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f9f2d134-5d62-48e3-8330-460abcd8e493 req-f1ee2611-7078-4771-ae42-91909a044a4c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:43.104765 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f9f2d134-5d62-48e3-8330-460abcd8e493 req-f1ee2611-7078-4771-ae42-91909a044a4c service nova] Creating event network-changed:72c6a85b-be73-4cca-80b1-c2d505f4fabf for instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f on nch2-master-1 Feb 19 21:11:43.130882 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f9f2d134-5d62-48e3-8330-460abcd8e493 req-f1ee2611-7078-4771-ae42-91909a044a4c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099010 Feb 19 21:11:43.132509 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2298/4504] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:43.159274 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fd551f69-8e6f-4a9d-8fe9-f14b97000d6c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.610167 Feb 19 21:11:43.164518 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2207/4505] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Feb 19 21:11:42 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:43.169602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fc768e94-c1b5-4a1c-af04-28550a765e3c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:43.170310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fc768e94-c1b5-4a1c-af04-28550a765e3c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:43.177524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc768e94-c1b5-4a1c-af04-28550a765e3c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:43.177971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc768e94-c1b5-4a1c-af04-28550a765e3c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:43.178764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc768e94-c1b5-4a1c-af04-28550a765e3c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:43.179193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc768e94-c1b5-4a1c-af04-28550a765e3c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:43.578682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fc768e94-c1b5-4a1c-af04-28550a765e3c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:43.587479 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fc768e94-c1b5-4a1c-af04-28550a765e3c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1513 microversion: 2.1 time: 0.421827 Feb 19 21:11:43.609312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad5fd752-2218-47cb-93ad-e92f07a025f9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:43.610170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ad5fd752-2218-47cb-93ad-e92f07a025f9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:43.615136 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2299/4506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:43 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1513 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:43.619021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad5fd752-2218-47cb-93ad-e92f07a025f9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:43.620317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad5fd752-2218-47cb-93ad-e92f07a025f9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:43.621333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad5fd752-2218-47cb-93ad-e92f07a025f9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:43.621950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad5fd752-2218-47cb-93ad-e92f07a025f9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:43.990057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ad5fd752-2218-47cb-93ad-e92f07a025f9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:44.000801 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad5fd752-2218-47cb-93ad-e92f07a025f9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903" status: 200 len: 1513 microversion: 2.1 time: 0.395290 Feb 19 21:11:44.005562 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2208/4507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:43 2022] GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903 => generated 1513 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:44.022613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1967e3a1-5472-455d-960f-182fff0a850c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:44.024353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1967e3a1-5472-455d-960f-182fff0a850c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:44.034591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1967e3a1-5472-455d-960f-182fff0a850c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:44.035440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1967e3a1-5472-455d-960f-182fff0a850c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:44.037793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1967e3a1-5472-455d-960f-182fff0a850c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:44.056059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1967e3a1-5472-455d-960f-182fff0a850c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:44.622712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-518971d3-3dbb-4502-9c6b-82c4181b23e1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f3bd27c-8a13-48ab-a47f-0f43117dfdf2"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:44.623842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-518971d3-3dbb-4502-9c6b-82c4181b23e1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:44.646713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-518971d3-3dbb-4502-9c6b-82c4181b23e1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:44.647610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-518971d3-3dbb-4502-9c6b-82c4181b23e1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:44.649138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-518971d3-3dbb-4502-9c6b-82c4181b23e1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:44.650643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-518971d3-3dbb-4502-9c6b-82c4181b23e1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:44.986760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1967e3a1-5472-455d-960f-182fff0a850c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:45.006143 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1967e3a1-5472-455d-960f-182fff0a850c tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1513 microversion: 2.1 time: 0.989141 Feb 19 21:11:45.016583 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2300/4508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:44 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1513 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:45.046173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:45.059177 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:45.059177 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:45.061979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:45.062890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:45.071048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:45.071785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:45.073293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:45.074029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:45.093836 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-518971d3-3dbb-4502-9c6b-82c4181b23e1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.475501 Feb 19 21:11:45.094584 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2209/4509] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:11:44 2022] POST /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:11:45.121856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:45.168746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:45.223826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:45.225890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:45.619726 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-94a28930-394e-485b-b7b2-3f62429ec385 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 4522 microversion: 2.1 time: 0.590567 Feb 19 21:11:45.624406 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2301/4510] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 21:11:45 2022] GET /compute/v2.1/servers/detail => generated 4522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:45.647736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d150261f-3dfc-4c3a-9fdb-15da145cc407 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:45.652284 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:45.652284 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:45.653384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d150261f-3dfc-4c3a-9fdb-15da145cc407 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:45.654156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d150261f-3dfc-4c3a-9fdb-15da145cc407 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:45.772352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d150261f-3dfc-4c3a-9fdb-15da145cc407 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:45.772845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d150261f-3dfc-4c3a-9fdb-15da145cc407 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:45.773721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d150261f-3dfc-4c3a-9fdb-15da145cc407 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:45.776394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d150261f-3dfc-4c3a-9fdb-15da145cc407 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:45.845395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] Action: 'create', calling method: .version_select at 0x7f64791060d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-706880872", "metadata": {"Type": "work"}}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:45.850824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-d150261f-3dfc-4c3a-9fdb-15da145cc407 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:45.926143 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d150261f-3dfc-4c3a-9fdb-15da145cc407 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1012 microversion: 2.1 time: 0.290579 Feb 19 21:11:45.927138 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2210/4511] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:11:45 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1012 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:45.942040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8a7f3434-10f3-44ff-b0a1-e6368949bbd3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:45.947630 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:45.947630 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:45.950758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8a7f3434-10f3-44ff-b0a1-e6368949bbd3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:45.953859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8a7f3434-10f3-44ff-b0a1-e6368949bbd3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:45.960111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a7f3434-10f3-44ff-b0a1-e6368949bbd3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:45.960597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a7f3434-10f3-44ff-b0a1-e6368949bbd3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:45.961410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a7f3434-10f3-44ff-b0a1-e6368949bbd3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:45.961849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a7f3434-10f3-44ff-b0a1-e6368949bbd3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:46.374572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-8a7f3434-10f3-44ff-b0a1-e6368949bbd3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:46.458349 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8a7f3434-10f3-44ff-b0a1-e6368949bbd3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.519860 Feb 19 21:11:46.459546 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2211/4512] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Feb 19 21:11:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:46.484542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b46c6349-1198-4e78-95fc-7db24a9af5a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:46.488403 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:46.488403 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:46.490395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b46c6349-1198-4e78-95fc-7db24a9af5a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:46.493419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b46c6349-1198-4e78-95fc-7db24a9af5a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:46.510455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b46c6349-1198-4e78-95fc-7db24a9af5a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:46.512711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b46c6349-1198-4e78-95fc-7db24a9af5a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:46.515054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b46c6349-1198-4e78-95fc-7db24a9af5a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:46.520542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b46c6349-1198-4e78-95fc-7db24a9af5a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:46.627990 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8abfb80d-c05a-4b3e-9fa8-d6fdcfdc2a52 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.989885 Feb 19 21:11:46.629199 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2302/4513] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:11:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 992 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 19 21:11:46.640262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-13f6165b-2358-4cf5-9e87-4eb96e98223c tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] Calling method '.version_select at 0x7f6467776ca0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:46.657719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-b46c6349-1198-4e78-95fc-7db24a9af5a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:46.727542 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b46c6349-1198-4e78-95fc-7db24a9af5a3 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.260075 Feb 19 21:11:46.728516 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2212/4514] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Feb 19 21:11:46 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:46.739364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b34d2c0c-b116-4be8-bcf0-8ba14b6b26aa tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:46.744313 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:46.744313 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:46.746173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b34d2c0c-b116-4be8-bcf0-8ba14b6b26aa tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:46.747102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b34d2c0c-b116-4be8-bcf0-8ba14b6b26aa tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'name': '2018738622', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:46.755759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b34d2c0c-b116-4be8-bcf0-8ba14b6b26aa tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:46.756664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b34d2c0c-b116-4be8-bcf0-8ba14b6b26aa tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:46.757692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b34d2c0c-b116-4be8-bcf0-8ba14b6b26aa tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:46.758393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b34d2c0c-b116-4be8-bcf0-8ba14b6b26aa tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:46.806220 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-13f6165b-2358-4cf5-9e87-4eb96e98223c tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917" status: 200 len: 345 microversion: 2.1 time: 0.169474 Feb 19 21:11:46.808547 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2303/4515] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:11:46 2022] GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917 => generated 345 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:46.876781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-b34d2c0c-b116-4be8-bcf0-8ba14b6b26aa tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:46.943362 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b34d2c0c-b116-4be8-bcf0-8ba14b6b26aa tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?name=2018738622" status: 200 len: 346 microversion: 2.1 time: 0.207715 Feb 19 21:11:46.944540 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2213/4516] 10.222.0.30 () {58 vars in 1155 bytes} [Sat Feb 19 21:11:46 2022] GET /compute/v2.1/servers?name=2018738622 => generated 346 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:11:46.958424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-29e51e22-4f23-4ba3-8234-df81eee06128 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:46.962751 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:46.962751 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:46.964251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29e51e22-4f23-4ba3-8234-df81eee06128 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:46.965305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-29e51e22-4f23-4ba3-8234-df81eee06128 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:46.973752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29e51e22-4f23-4ba3-8234-df81eee06128 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:46.973752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29e51e22-4f23-4ba3-8234-df81eee06128 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:46.973938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29e51e22-4f23-4ba3-8234-df81eee06128 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:46.974542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29e51e22-4f23-4ba3-8234-df81eee06128 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:47.070351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-29e51e22-4f23-4ba3-8234-df81eee06128 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:47.132880 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-29e51e22-4f23-4ba3-8234-df81eee06128 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.180686 Feb 19 21:11:47.133476 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2304/4517] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Feb 19 21:11:46 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:47.154241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-803ba41e-1105-4dfe-a69f-18fd70e71a1d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:47.159362 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:47.159362 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:47.160797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-803ba41e-1105-4dfe-a69f-18fd70e71a1d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:47.161560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-803ba41e-1105-4dfe-a69f-18fd70e71a1d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-201873862', 'deleted': False, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:11:47.167312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-803ba41e-1105-4dfe-a69f-18fd70e71a1d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:47.167770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-803ba41e-1105-4dfe-a69f-18fd70e71a1d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:47.168618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-803ba41e-1105-4dfe-a69f-18fd70e71a1d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:47.169060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-803ba41e-1105-4dfe-a69f-18fd70e71a1d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:47.258110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-803ba41e-1105-4dfe-a69f-18fd70e71a1d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:11:47.316495 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-803ba41e-1105-4dfe-a69f-18fd70e71a1d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-201873862" status: 200 len: 346 microversion: 2.1 time: 0.176137 Feb 19 21:11:47.317124 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2214/4518] 10.222.0.30 () {58 vars in 1227 bytes} [Sat Feb 19 21:11:47 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-201873862 => generated 346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:47.332657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d8f92605-738d-4df6-aa84-6c2449bd94fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:47.333570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8f92605-738d-4df6-aa84-6c2449bd94fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:47.341503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8f92605-738d-4df6-aa84-6c2449bd94fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:47.342017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8f92605-738d-4df6-aa84-6c2449bd94fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:47.342801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8f92605-738d-4df6-aa84-6c2449bd94fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:47.343236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8f92605-738d-4df6-aa84-6c2449bd94fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:47.371028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8f92605-738d-4df6-aa84-6c2449bd94fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:11:47.459280 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d8f92605-738d-4df6-aa84-6c2449bd94fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 204 len: 0 microversion: 2.1 time: 0.133951 Feb 19 21:11:47.460017 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2305/4519] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:11:47 2022] DELETE /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:11:47.468988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-65932d6c-7868-40ed-87bb-977f91d5d2fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:47.469684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-65932d6c-7868-40ed-87bb-977f91d5d2fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:47.476288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65932d6c-7868-40ed-87bb-977f91d5d2fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:47.476771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65932d6c-7868-40ed-87bb-977f91d5d2fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:47.477571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65932d6c-7868-40ed-87bb-977f91d5d2fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:47.478012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65932d6c-7868-40ed-87bb-977f91d5d2fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:47.637160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-65932d6c-7868-40ed-87bb-977f91d5d2fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:47.645611 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-65932d6c-7868-40ed-87bb-977f91d5d2fc tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1519 microversion: 2.1 time: 0.181144 Feb 19 21:11:47.646359 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2215/4520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:47 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:47.826923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d6cc3b9-acad-44be-bb7c-94489f2a436b tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] Calling method '.version_select at 0x7f64791289d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:47.887453 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d6cc3b9-acad-44be-bb7c-94489f2a436b tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917" status: 200 len: 346 microversion: 2.1 time: 0.065025 Feb 19 21:11:47.888036 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2306/4521] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:11:47 2022] GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917 => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:47.902853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-41e37da8-a9ff-488d-9be2-bb6e62b28a21 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] Calling method '.version_select at 0x7f6467d48430>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:47.964799 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-41e37da8-a9ff-488d-9be2-bb6e62b28a21 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917" status: 200 len: 346 microversion: 2.1 time: 0.065459 Feb 19 21:11:47.965385 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2216/4522] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:11:47 2022] GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917 => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:47.977183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e5dd18f9-c295-41e5-a859-aa7415c86b2e tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] Calling method '.version_select at 0x7f6479110820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:48.050861 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e5dd18f9-c295-41e5-a859-aa7415c86b2e tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917" status: 202 len: 0 microversion: 2.1 time: 0.077056 Feb 19 21:11:48.051664 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2307/4523] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:11:47 2022] DELETE /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:11:48.059813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-844cd895-aa58-4d32-b17b-12d780e7c0f8 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] Calling method '.version_select at 0x7f6479204040>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:48.119280 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-844cd895-aa58-4d32-b17b-12d780e7c0f8 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917" status: 200 len: 345 microversion: 2.1 time: 0.063056 Feb 19 21:11:48.120078 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2217/4524] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:11:48 2022] GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:48.665994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5642e37d-71e3-436d-b215-9ce3f616bc8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:48.666975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5642e37d-71e3-436d-b215-9ce3f616bc8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:48.688991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5642e37d-71e3-436d-b215-9ce3f616bc8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:48.689423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5642e37d-71e3-436d-b215-9ce3f616bc8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:48.691414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5642e37d-71e3-436d-b215-9ce3f616bc8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:48.692159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5642e37d-71e3-436d-b215-9ce3f616bc8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:48.784280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31d66292-7e6d-4ee9-88ac-f204377349be tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:48.789892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-31d66292-7e6d-4ee9-88ac-f204377349be tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:48.797864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31d66292-7e6d-4ee9-88ac-f204377349be tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:48.798889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31d66292-7e6d-4ee9-88ac-f204377349be tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:48.800840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31d66292-7e6d-4ee9-88ac-f204377349be tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:48.801203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31d66292-7e6d-4ee9-88ac-f204377349be tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:48.843992 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-31d66292-7e6d-4ee9-88ac-f204377349be tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064303 Feb 19 21:11:48.845191 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2218/4525] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:11:48 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:11:48.864126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4b8b6296-c7ad-479f-a5ed-d190e3a5918d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:48.865113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4b8b6296-c7ad-479f-a5ed-d190e3a5918d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:48.872529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b8b6296-c7ad-479f-a5ed-d190e3a5918d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:48.872977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b8b6296-c7ad-479f-a5ed-d190e3a5918d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:48.873767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b8b6296-c7ad-479f-a5ed-d190e3a5918d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:48.874370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b8b6296-c7ad-479f-a5ed-d190e3a5918d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:48.911389 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4b8b6296-c7ad-479f-a5ed-d190e3a5918d tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/0f3bd27c-8a13-48ab-a47f-0f43117dfdf2" status: 200 len: 194 microversion: 2.1 time: 0.059872 Feb 19 21:11:48.913036 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2219/4526] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Feb 19 21:11:48 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/0f3bd27c-8a13-48ab-a47f-0f43117dfdf2 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:49.137286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e390d3bc-2c7a-4d67-8ad9-c44287ed50a8 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] Calling method '.version_select at 0x7f6467d48e50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:49.255774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5642e37d-71e3-436d-b215-9ce3f616bc8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:49.269306 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5642e37d-71e3-436d-b215-9ce3f616bc8d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1519 microversion: 2.1 time: 0.604953 Feb 19 21:11:49.270390 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2308/4527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:48 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1519 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:49.287819 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e390d3bc-2c7a-4d67-8ad9-c44287ed50a8 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917" status: 200 len: 345 microversion: 2.1 time: 0.158502 Feb 19 21:11:49.289219 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2220/4528] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:11:49 2022] GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917 => generated 345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:11:50.124396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-fb7b2ed1-9334-4a51-9d33-cca550aceb56 req-63297944-227d-438d-b655-eb03e1d68af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b07cde3-2638-435a-b995-472fca98b7a3", "name": "network-vif-deleted", "tag": "6e144d59-57f6-487f-8459-313c58617556"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:50.127718 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:50.127718 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:11:50.148724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fb7b2ed1-9334-4a51-9d33-cca550aceb56 req-63297944-227d-438d-b655-eb03e1d68af3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:50.149416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fb7b2ed1-9334-4a51-9d33-cca550aceb56 req-63297944-227d-438d-b655-eb03e1d68af3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:50.172694 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-fb7b2ed1-9334-4a51-9d33-cca550aceb56 req-63297944-227d-438d-b655-eb03e1d68af3 service nova] Creating event network-vif-deleted:6e144d59-57f6-487f-8459-313c58617556 for instance 7b07cde3-2638-435a-b995-472fca98b7a3 on nch1-master-1 Feb 19 21:11:50.187165 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-fb7b2ed1-9334-4a51-9d33-cca550aceb56 req-63297944-227d-438d-b655-eb03e1d68af3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067032 Feb 19 21:11:50.188130 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2309/4529] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:50.287749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:50.297104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:50.303365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:50.307559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f4f15cbc-4277-458e-a2a7-69e25ae73df5 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] Calling method '.version_select at 0x7f64790c05e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:50.314064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:50.323356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:50.324129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:50.356173 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-f4f15cbc-4277-458e-a2a7-69e25ae73df5 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] HTTP exception thrown: Volume 33f80f39-1b96-40e4-93f6-176f37f7d917 could not be found. Feb 19 21:11:50.356899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f4f15cbc-4277-458e-a2a7-69e25ae73df5 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] Returning 404 to user: Volume 33f80f39-1b96-40e4-93f6-176f37f7d917 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:50.357970 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f4f15cbc-4277-458e-a2a7-69e25ae73df5 tempest-VolumesGetTestJSON-1507485463 tempest-VolumesGetTestJSON-1507485463-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917" status: 404 len: 109 microversion: 2.1 time: 0.054879 Feb 19 21:11:50.361515 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2310/4530] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:11:50 2022] GET /compute/v2.1/os-volumes/33f80f39-1b96-40e4-93f6-176f37f7d917 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:11:50.401771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:50.402337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:50.402875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lazy-loading 'fault' on Instance uuid 7b07cde3-2638-435a-b995-472fca98b7a3 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:11:50.421443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-22f32107-77dc-47a3-9ca5-238f82e18807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cee237d-58ba-4236-9933-9466b75876a7"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:50.423305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-22f32107-77dc-47a3-9ca5-238f82e18807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:50.442839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22f32107-77dc-47a3-9ca5-238f82e18807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:50.444691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22f32107-77dc-47a3-9ca5-238f82e18807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:50.445641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22f32107-77dc-47a3-9ca5-238f82e18807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:50.450067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22f32107-77dc-47a3-9ca5-238f82e18807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:50.542073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:50.551386 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-55183c56-7684-4099-aa56-62167af6fd2d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 200 len: 1311 microversion: 2.1 time: 0.268183 Feb 19 21:11:50.552360 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2221/4531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:50 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 1311 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:51.046062 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-22f32107-77dc-47a3-9ca5-238f82e18807 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "POST /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.628991 Feb 19 21:11:51.047001 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2311/4532] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:11:50 2022] POST /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:11:51.571749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-32325fe3-47ea-4515-9a3e-f254dd4df5c9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:51.573494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-32325fe3-47ea-4515-9a3e-f254dd4df5c9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 7b07cde3-2638-435a-b995-472fca98b7a3] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:51.586016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32325fe3-47ea-4515-9a3e-f254dd4df5c9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:51.587495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32325fe3-47ea-4515-9a3e-f254dd4df5c9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:51.588792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32325fe3-47ea-4515-9a3e-f254dd4df5c9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:51.589472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32325fe3-47ea-4515-9a3e-f254dd4df5c9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:51.622041 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-32325fe3-47ea-4515-9a3e-f254dd4df5c9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] HTTP exception thrown: Instance 7b07cde3-2638-435a-b995-472fca98b7a3 could not be found. Feb 19 21:11:51.622989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-32325fe3-47ea-4515-9a3e-f254dd4df5c9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Returning 404 to user: Instance 7b07cde3-2638-435a-b995-472fca98b7a3 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:51.624080 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-32325fe3-47ea-4515-9a3e-f254dd4df5c9 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3" status: 404 len: 111 microversion: 2.1 time: 0.057873 Feb 19 21:11:51.625470 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2222/4533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:51 2022] GET /compute/v2.1/servers/7b07cde3-2638-435a-b995-472fca98b7a3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:11:51.637574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b336efd-5480-4328-8f23-d46320abcf0a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:51.640069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7b336efd-5480-4328-8f23-d46320abcf0a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:51.651776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b336efd-5480-4328-8f23-d46320abcf0a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:51.657169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b336efd-5480-4328-8f23-d46320abcf0a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:51.658423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b336efd-5480-4328-8f23-d46320abcf0a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:51.660650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b336efd-5480-4328-8f23-d46320abcf0a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:51.739850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7b336efd-5480-4328-8f23-d46320abcf0a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:11:51.944783 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b336efd-5480-4328-8f23-d46320abcf0a tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903" status: 204 len: 0 microversion: 2.1 time: 0.313576 Feb 19 21:11:51.945378 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2312/4534] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:11:51 2022] DELETE /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:11:51.962453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-777ce6a8-8868-4711-a880-515639b783f1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:51.964183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-777ce6a8-8868-4711-a880-515639b783f1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:51.993818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-777ce6a8-8868-4711-a880-515639b783f1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:51.995617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-777ce6a8-8868-4711-a880-515639b783f1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:51.997655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-777ce6a8-8868-4711-a880-515639b783f1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:51.998109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-777ce6a8-8868-4711-a880-515639b783f1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:52.412469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-777ce6a8-8868-4711-a880-515639b783f1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:52.431407 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-777ce6a8-8868-4711-a880-515639b783f1 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903" status: 200 len: 1519 microversion: 2.1 time: 0.481484 Feb 19 21:11:52.434245 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2223/4535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:51 2022] GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903 => generated 1519 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:53.483235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e6a7ad2b-4a7a-4e30-b408-bb359ff87c65 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:53.485815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e6a7ad2b-4a7a-4e30-b408-bb359ff87c65 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:53.510656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6a7ad2b-4a7a-4e30-b408-bb359ff87c65 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:53.519822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6a7ad2b-4a7a-4e30-b408-bb359ff87c65 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:53.522782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6a7ad2b-4a7a-4e30-b408-bb359ff87c65 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:53.523502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6a7ad2b-4a7a-4e30-b408-bb359ff87c65 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:53.934500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5ef407a3-e3d9-4809-a100-8f109ced2d9d tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Action: 'create', calling method: .version_select at 0x7f6467e99550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-490124659", "metadata": {"Type": "work"}}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:53.938227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5ef407a3-e3d9-4809-a100-8f109ced2d9d tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:53.942074 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5ef407a3-e3d9-4809-a100-8f109ced2d9d tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.305447 Feb 19 21:11:53.944214 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2224/4536] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:11:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:11:53.955295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a0240d38-ce18-4d07-a791-740d3508903f tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Action: 'create', calling method: .version_select at 0x7f6479140b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1326893916", "metadata": {"Type": "work"}}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:53.957969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a0240d38-ce18-4d07-a791-740d3508903f tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:53.959252 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a0240d38-ce18-4d07-a791-740d3508903f tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007807 Feb 19 21:11:53.960386 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2225/4537] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:11:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 19 21:11:53.979073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-95161b50-2b66-4bb8-ba01-c06451a91472 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Action: 'create', calling method: .version_select at 0x7f6467e99550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2087593568", "metadata": {"Type": "work"}}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:53.980658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-95161b50-2b66-4bb8-ba01-c06451a91472 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:53.982223 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-95161b50-2b66-4bb8-ba01-c06451a91472 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012657 Feb 19 21:11:53.983777 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2226/4538] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Feb 19 21:11:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 19 21:11:53.995479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-698df524-267c-4939-9f2b-e2673b8ddf9a tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Calling method '.version_select at 0x7f64792523a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:54.048131 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-698df524-267c-4939-9f2b-e2673b8ddf9a tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] HTTP exception thrown: Volume tempest-invalid-1085668839 could not be found. Feb 19 21:11:54.051538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-698df524-267c-4939-9f2b-e2673b8ddf9a tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Returning 404 to user: Volume tempest-invalid-1085668839 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:54.055245 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-698df524-267c-4939-9f2b-e2673b8ddf9a tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1085668839" status: 404 len: 99 microversion: 2.1 time: 0.063294 Feb 19 21:11:54.058441 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2227/4539] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 21:11:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1085668839 => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 19 21:11:54.062899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e6a7ad2b-4a7a-4e30-b408-bb359ff87c65 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:54.075386 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e6a7ad2b-4a7a-4e30-b408-bb359ff87c65 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903" status: 200 len: 1519 microversion: 2.1 time: 0.608328 Feb 19 21:11:54.076969 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-383c1bb0-3438-4516-80cd-10469fd655c5 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012643 Feb 19 21:11:54.081689 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2228/4540] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Feb 19 21:11:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 19 21:11:54.085484 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2313/4541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:53 2022] GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903 => generated 1519 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:54.104777 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-78633ecf-fbbd-4cc8-9b9d-1ec84bcf2501 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017845 Feb 19 21:11:54.105703 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2314/4542] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 21:11:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 19 21:11:54.120004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cfb87280-0696-4d68-b098-71e804620dc9 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Calling method '.version_select at 0x7f647489f670>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:54.165312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-cfb87280-0696-4d68-b098-71e804620dc9 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] HTTP exception thrown: Volume 41b9caaf-d4af-4678-a77e-99240453da08 could not be found. Feb 19 21:11:54.166324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cfb87280-0696-4d68-b098-71e804620dc9 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Returning 404 to user: Volume 41b9caaf-d4af-4678-a77e-99240453da08 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:54.167703 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cfb87280-0696-4d68-b098-71e804620dc9 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/41b9caaf-d4af-4678-a77e-99240453da08" status: 404 len: 109 microversion: 2.1 time: 0.054128 Feb 19 21:11:54.168802 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2229/4543] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Feb 19 21:11:54 2022] DELETE /compute/v2.1/os-volumes/41b9caaf-d4af-4678-a77e-99240453da08 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:11:54.178228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-272e2c4b-49e0-413d-81f5-e9d86c58ccf9 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Calling method '.version_select at 0x7f6467e42280>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:54.226655 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-272e2c4b-49e0-413d-81f5-e9d86c58ccf9 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] HTTP exception thrown: Volume 15395393-1ed7-4ede-826c-e30fa540cffe could not be found. Feb 19 21:11:54.227526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-272e2c4b-49e0-413d-81f5-e9d86c58ccf9 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] Returning 404 to user: Volume 15395393-1ed7-4ede-826c-e30fa540cffe could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:54.228588 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-272e2c4b-49e0-413d-81f5-e9d86c58ccf9 tempest-VolumesNegativeTest-1406124223 tempest-VolumesNegativeTest-1406124223-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/15395393-1ed7-4ede-826c-e30fa540cffe" status: 404 len: 109 microversion: 2.1 time: 0.054277 Feb 19 21:11:54.229148 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2315/4544] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Feb 19 21:11:54 2022] GET /compute/v2.1/os-volumes/15395393-1ed7-4ede-826c-e30fa540cffe => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:11:54.862420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4708cfe0-8310-4d2b-aa2d-5685ce6c2af7 req-37407c92-eb7a-4e17-bc1f-936526429d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7be926-97c1-45e3-87aa-defbd74b9903", "name": "network-vif-deleted", "tag": "3d24b8e8-a542-4ef2-8ffb-7e4f8a40e896"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:11:54.865219 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:11:54.865219 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:11:54.874604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4708cfe0-8310-4d2b-aa2d-5685ce6c2af7 req-37407c92-eb7a-4e17-bc1f-936526429d1f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:54.875281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4708cfe0-8310-4d2b-aa2d-5685ce6c2af7 req-37407c92-eb7a-4e17-bc1f-936526429d1f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:54.891149 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4708cfe0-8310-4d2b-aa2d-5685ce6c2af7 req-37407c92-eb7a-4e17-bc1f-936526429d1f service nova] Creating event network-vif-deleted:3d24b8e8-a542-4ef2-8ffb-7e4f8a40e896 for instance bf7be926-97c1-45e3-87aa-defbd74b9903 on nch2-master-1 Feb 19 21:11:54.898331 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4708cfe0-8310-4d2b-aa2d-5685ce6c2af7 req-37407c92-eb7a-4e17-bc1f-936526429d1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042286 Feb 19 21:11:54.903777 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2230/4545] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:55.100067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:55.102087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:55.120752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:55.121510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:55.122538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:55.123218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:55.208749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:55.209332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:55.209968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lazy-loading 'fault' on Instance uuid bf7be926-97c1-45e3-87aa-defbd74b9903 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:11:55.320281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:55.353027 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d2731aab-852b-47f4-bb41-93dff5ac3504 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903" status: 200 len: 1311 microversion: 2.1 time: 0.247820 Feb 19 21:11:55.353680 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2316/4546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:55 2022] GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903 => generated 1311 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:55.753919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ab6a333a-33aa-45bf-b50d-3adff6b4c0ef tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:55.755543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ab6a333a-33aa-45bf-b50d-3adff6b4c0ef tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:55.766335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab6a333a-33aa-45bf-b50d-3adff6b4c0ef tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:55.766801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab6a333a-33aa-45bf-b50d-3adff6b4c0ef tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:55.767601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab6a333a-33aa-45bf-b50d-3adff6b4c0ef tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:55.768107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab6a333a-33aa-45bf-b50d-3adff6b4c0ef tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:55.810765 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ab6a333a-33aa-45bf-b50d-3adff6b4c0ef tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061968 Feb 19 21:11:55.811368 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2231/4547] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:11:55 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:11:56.371582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2458ecbb-2463-46e2-b5d8-c03c85876c57 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:56.372188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2458ecbb-2463-46e2-b5d8-c03c85876c57 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: bf7be926-97c1-45e3-87aa-defbd74b9903] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:56.381817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2458ecbb-2463-46e2-b5d8-c03c85876c57 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:56.397239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2458ecbb-2463-46e2-b5d8-c03c85876c57 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:56.398690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2458ecbb-2463-46e2-b5d8-c03c85876c57 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:56.399334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2458ecbb-2463-46e2-b5d8-c03c85876c57 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:56.424934 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-2458ecbb-2463-46e2-b5d8-c03c85876c57 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] HTTP exception thrown: Instance bf7be926-97c1-45e3-87aa-defbd74b9903 could not be found. Feb 19 21:11:56.425932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2458ecbb-2463-46e2-b5d8-c03c85876c57 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Returning 404 to user: Instance bf7be926-97c1-45e3-87aa-defbd74b9903 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:11:56.426987 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2458ecbb-2463-46e2-b5d8-c03c85876c57 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903" status: 404 len: 111 microversion: 2.1 time: 0.059179 Feb 19 21:11:56.427748 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2317/4548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:56 2022] GET /compute/v2.1/servers/bf7be926-97c1-45e3-87aa-defbd74b9903 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:11:56.441367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-124dd0a0-41b3-4c16-9b49-10f6d7e86d10 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:56.442175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-124dd0a0-41b3-4c16-9b49-10f6d7e86d10 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:56.457962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-124dd0a0-41b3-4c16-9b49-10f6d7e86d10 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:56.458895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-124dd0a0-41b3-4c16-9b49-10f6d7e86d10 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:56.460272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-124dd0a0-41b3-4c16-9b49-10f6d7e86d10 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:56.462452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-124dd0a0-41b3-4c16-9b49-10f6d7e86d10 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:56.515981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-124dd0a0-41b3-4c16-9b49-10f6d7e86d10 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:11:56.706883 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-124dd0a0-41b3-4c16-9b49-10f6d7e86d10 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 204 len: 0 microversion: 2.1 time: 0.271676 Feb 19 21:11:56.708494 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2232/4549] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:11:56 2022] DELETE /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:11:56.720120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6fdb0385-4f2a-4f0d-9b1f-f21bdbb295d8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:56.722770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6fdb0385-4f2a-4f0d-9b1f-f21bdbb295d8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:56.737665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fdb0385-4f2a-4f0d-9b1f-f21bdbb295d8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:56.738293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fdb0385-4f2a-4f0d-9b1f-f21bdbb295d8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:56.741254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fdb0385-4f2a-4f0d-9b1f-f21bdbb295d8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:56.745847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6fdb0385-4f2a-4f0d-9b1f-f21bdbb295d8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:57.015814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6fdb0385-4f2a-4f0d-9b1f-f21bdbb295d8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:57.026446 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6fdb0385-4f2a-4f0d-9b1f-f21bdbb295d8 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1519 microversion: 2.1 time: 0.313267 Feb 19 21:11:57.027419 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2318/4550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:56 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1519 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:58.047718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-80265bdc-2fe8-4883-b2e1-fdfbebce359d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:58.048462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-80265bdc-2fe8-4883-b2e1-fdfbebce359d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:11:58.065609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80265bdc-2fe8-4883-b2e1-fdfbebce359d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:58.070636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80265bdc-2fe8-4883-b2e1-fdfbebce359d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:58.072634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80265bdc-2fe8-4883-b2e1-fdfbebce359d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:11:58.075024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-80265bdc-2fe8-4883-b2e1-fdfbebce359d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:11:58.940550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-80265bdc-2fe8-4883-b2e1-fdfbebce359d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:11:58.975265 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-80265bdc-2fe8-4883-b2e1-fdfbebce359d tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1519 microversion: 2.1 time: 0.926141 Feb 19 21:11:58.978393 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2233/4551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:58 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1519 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:11:59.994031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-72760467-acb6-4524-b8d5-1e8a674e2a8e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:11:59.996961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-72760467-acb6-4524-b8d5-1e8a674e2a8e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:00.013369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72760467-acb6-4524-b8d5-1e8a674e2a8e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:00.013830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72760467-acb6-4524-b8d5-1e8a674e2a8e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:00.014641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72760467-acb6-4524-b8d5-1e8a674e2a8e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:00.015080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72760467-acb6-4524-b8d5-1e8a674e2a8e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:00.240215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-72760467-acb6-4524-b8d5-1e8a674e2a8e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664f926973a242fcad5a2f1a02f773d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85755c1b89f44eb0a4db800f8bf319f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:00.249246 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-72760467-acb6-4524-b8d5-1e8a674e2a8e tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 200 len: 1477 microversion: 2.1 time: 0.258798 Feb 19 21:12:00.251656 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2319/4552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:11:59 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:00.283318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-59e6a494-be4e-4970-b717-b16440984d1a req-271d757d-cecd-4995-b626-94180647decf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf50ff4-6ad5-42d5-b141-7e521a04dd0d", "name": "network-vif-deleted", "tag": "d4b03175-1616-42fe-9b96-eb62614d66b0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:00.286737 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:00.286737 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:12:00.303841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-59e6a494-be4e-4970-b717-b16440984d1a req-271d757d-cecd-4995-b626-94180647decf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:00.307075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-59e6a494-be4e-4970-b717-b16440984d1a req-271d757d-cecd-4995-b626-94180647decf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:00.338747 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-59e6a494-be4e-4970-b717-b16440984d1a req-271d757d-cecd-4995-b626-94180647decf service nova] Creating event network-vif-deleted:d4b03175-1616-42fe-9b96-eb62614d66b0 for instance 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d on nch2-master-1 Feb 19 21:12:00.351852 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-59e6a494-be4e-4970-b717-b16440984d1a req-271d757d-cecd-4995-b626-94180647decf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071609 Feb 19 21:12:00.356143 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2234/4553] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:12:01.270572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c26b026f-3393-441a-aa2f-3f9650868a16 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:01.272185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c26b026f-3393-441a-aa2f-3f9650868a16 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] [instance: 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:01.284440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c26b026f-3393-441a-aa2f-3f9650868a16 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:01.285241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c26b026f-3393-441a-aa2f-3f9650868a16 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:01.286239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c26b026f-3393-441a-aa2f-3f9650868a16 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:01.288428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c26b026f-3393-441a-aa2f-3f9650868a16 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:01.326150 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-c26b026f-3393-441a-aa2f-3f9650868a16 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] HTTP exception thrown: Instance 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d could not be found. Feb 19 21:12:01.327125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c26b026f-3393-441a-aa2f-3f9650868a16 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] Returning 404 to user: Instance 4cf50ff4-6ad5-42d5-b141-7e521a04dd0d could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:12:01.327635 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c26b026f-3393-441a-aa2f-3f9650868a16 tempest-ListServerFiltersTestJSON-947864663 tempest-ListServerFiltersTestJSON-947864663-project] 10.222.0.30 "GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d" status: 404 len: 111 microversion: 2.1 time: 0.062515 Feb 19 21:12:01.328212 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2320/4554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:01 2022] GET /compute/v2.1/servers/4cf50ff4-6ad5-42d5-b141-7e521a04dd0d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:12:07.285886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-65246142", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": "none"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:07.405664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:12:07.406991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:12:07.407673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:12:07.408476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:12:07.409619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:12:07.444482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:07.444982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:07.446061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:07.448941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:07.537012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Getting quotas for project 96ce8f5b3827425fa697e340178b84c6. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:12:07.563069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Getting quotas for user cab2d6ba2dfb4adfa951ce21075a3b20 and project 96ce8f5b3827425fa697e340178b84c6. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:12:07.616682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:12:07.641575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: bd182d79-55da-4df0-a293-742e79cd21ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:12:07.809792 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae8bb9cd-e33b-43dd-aec3-113d5df4cbdb tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.019166 Feb 19 21:12:07.815917 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2235/4555] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 21:12:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 21:12:07.840092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-270803d2-08c8-485f-adb9-206dde82cb79 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:07.841361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-270803d2-08c8-485f-adb9-206dde82cb79 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: bd182d79-55da-4df0-a293-742e79cd21ec] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:07.983432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-270803d2-08c8-485f-adb9-206dde82cb79 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:08.016625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-270803d2-08c8-485f-adb9-206dde82cb79 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:08.019158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-270803d2-08c8-485f-adb9-206dde82cb79 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:08.027258 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-270803d2-08c8-485f-adb9-206dde82cb79 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec" status: 200 len: 1276 microversion: 2.47 time: 0.190980 Feb 19 21:12:08.037678 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2321/4556] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:07 2022] GET /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:08.414825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1439311520", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": "none"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:08.554057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:12:08.560944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:12:08.563478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:12:08.565338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:12:08.570938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:12:08.621839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:08.624119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:08.627043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:08.631370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:08.738716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Getting quotas for project 96ce8f5b3827425fa697e340178b84c6. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:12:08.775154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Getting quotas for user cab2d6ba2dfb4adfa951ce21075a3b20 and project 96ce8f5b3827425fa697e340178b84c6. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:12:08.856304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:12:08.858629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:12:09.047515 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1cb92bfc-2fa1-4ad6-bc4b-2fda09c9e83a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.638561 Feb 19 21:12:09.063861 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2236/4557] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 21:12:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 21:12:09.077741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7ea6b670-d174-4afc-9632-e584a84b4ff4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:09.079456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7ea6b670-d174-4afc-9632-e584a84b4ff4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:09.278631 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7ea6b670-d174-4afc-9632-e584a84b4ff4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "PUT /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 992 microversion: 2.47 time: 0.196941 Feb 19 21:12:09.290270 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2322/4558] 10.222.0.30 () {62 vars in 1296 bytes} [Sat Feb 19 21:12:09 2022] PUT /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 992 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:12:09.301164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c0ec2cb9-6816-403c-b623-21bbf4367d23 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:09.302230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c0ec2cb9-6816-403c-b623-21bbf4367d23 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:09.520173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c0ec2cb9-6816-403c-b623-21bbf4367d23 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:09.536706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c0ec2cb9-6816-403c-b623-21bbf4367d23 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:09.541722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c0ec2cb9-6816-403c-b623-21bbf4367d23 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:09.543963 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c0ec2cb9-6816-403c-b623-21bbf4367d23 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1278 microversion: 2.47 time: 0.246353 Feb 19 21:12:09.561115 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2237/4559] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:09 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1278 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:10.591502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:10.597309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:10.643750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:10.644506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:10.645306 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:10.645781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:10.951676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:10.987381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:11.000779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:11.010493 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5dda87bb-31ac-47df-b84d-24574790d154 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1282 microversion: 2.47 time: 0.418626 Feb 19 21:12:11.013062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2323/4560] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:10 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1282 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:12.030992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:12.032102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:12.047913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:12.061211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:12.063158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:12.064391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:12.248231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:12.284512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:12.288934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:12.291496 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-22efa390-e5de-4a4c-a021-f95f72bc9eb0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1336 microversion: 2.47 time: 0.264137 Feb 19 21:12:12.296854 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2238/4561] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:12 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1336 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:13.316129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:13.317178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:13.337049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:13.354791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:13.357909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:13.366890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:13.565251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:13.577142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:13.582055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:13.583443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a4ae6a2f-d3ae-4591-8be4-061fbdf69702 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1336 microversion: 2.47 time: 0.272676 Feb 19 21:12:13.600632 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2324/4562] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:13 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1336 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:14.603453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:14.604185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:14.616379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:14.617824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:14.619665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:14.620366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:14.886973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:14.906055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:14.909900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:14.911648 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e00a2979-5ded-45ee-a25a-a74e941882e4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1357 microversion: 2.47 time: 0.312362 Feb 19 21:12:14.925623 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2239/4563] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:14 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1357 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:14.934877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f75529b9-2911-475e-b974-4af06053c17c"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:14.941030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:14.956029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:14.956552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:14.958370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:14.959019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:15.109779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:12:15.110376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:12:15.110945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:12:15.111584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:12:15.112196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:12:15.232301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:15.250773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:15.253447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:15.255279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:15.258631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:15.343056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8d678d92-5d7e-4e11-986d-20984455946e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "POST /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19/action" status: 202 len: 1079 microversion: 2.47 time: 0.406672 Feb 19 21:12:15.352550 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2325/4564] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Feb 19 21:12:14 2022] POST /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19/action => generated 1079 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Feb 19 21:12:15.365157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:15.366405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:15.386322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:15.387303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:15.397616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:15.397616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:15.530158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:15.543325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:15.545375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:15.547642 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-53e13e8d-0031-4f71-a830-8567622eb629 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.188839 Feb 19 21:12:15.549159 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2240/4565] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:15 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:15.974133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14d9594d-4d82-4f69-9b93-33103fedfea4 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Action: 'create', calling method: .version_select at 0x7f6479077670>, body: {"keypair": {"name": "tempest-TestServerBasicOps-970814824"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:15.989714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-14d9594d-4d82-4f69-9b93-33103fedfea4 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Getting quotas for project da6216f26c814fceaa94fc64e78c8efc. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:12:15.995462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-14d9594d-4d82-4f69-9b93-33103fedfea4 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Getting quotas for user 9f1e1cafad4f475dad7bc93b50312279 and project da6216f26c814fceaa94fc64e78c8efc. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:12:16.131028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-14d9594d-4d82-4f69-9b93-33103fedfea4 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Getting quotas for project da6216f26c814fceaa94fc64e78c8efc. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:12:16.137515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-14d9594d-4d82-4f69-9b93-33103fedfea4 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Getting quotas for user 9f1e1cafad4f475dad7bc93b50312279 and project da6216f26c814fceaa94fc64e78c8efc. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:12:16.158786 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14d9594d-4d82-4f69-9b93-33103fedfea4 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.550206 Feb 19 21:12:16.160041 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2326/4566] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:12:15 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:16.567195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:16.567887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:16.583192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:16.583658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:16.584519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:16.584966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:16.763924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:16.777892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:16.781342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:16.786746 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-89aa61bf-8409-40cb-a470-f2d375e707ee tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.223424 Feb 19 21:12:16.790580 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2241/4567] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:16 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:17.821675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:17.822291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:17.845762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:17.846665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:17.847583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:17.848020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:18.074735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:18.085502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:18.087044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:18.098491 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f55529a4-0df2-47c5-aae4-3826cbc3a171 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.281882 Feb 19 21:12:18.099693 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2327/4568] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:17 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:18.636475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1885135296", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "e5dab1b4-ce43-4f18-aa34-7f3b528a083c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-981519187", "security_groups": []}, "os:scheduler_hints": {"different_host": ["26035c7e-8e0f-48e4-bbef-0d0eae15c929"]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:18.775640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] validate_networks() for [('e5dab1b4-ce43-4f18-aa34-7f3b528a083c', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:12:19.121313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:19.121829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:19.135950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:19.138041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:19.140211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:19.142335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:19.422031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:19.431674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:19.438629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:19.441952 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0375178-15b7-4406-ab93-64d0516ab7e0 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.325032 Feb 19 21:12:19.444419 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2328/4569] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:19 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:12:19.810739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1076885260", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-970814824", "security_groups": [{"name": "tempest-secgroup-smoke-228398377"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f42bca65-bbe1-406f-ae65-02b04761560d"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:20.106794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] validate_networks() for [('f42bca65-bbe1-406f-ae65-02b04761560d', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:12:20.787358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:12:20.787894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:12:20.788241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:12:20.788973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:12:20.789531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:12:20.817191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:20.817665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:20.818496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:20.819232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:20.954087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Getting quotas for project 9f4ed687e80941d9a5befe1031923ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:12:20.986625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Getting quotas for user b9e2bf42ef6446c69f1775a25ef76a92 and project 9f4ed687e80941d9a5befe1031923ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:12:21.036465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:12:21.046504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:12:21.232630 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5a0e7925-d4f7-4b09-b86b-df453509b0db tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.600110 Feb 19 21:12:21.233871 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2242/4570] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:12:18 2022] POST /compute/v2.1/servers => generated 361 bytes in 2603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:12:21.261348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:21.262484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:21.300509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:21.301979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:21.303878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:21.304964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:21.664276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Getting quotas for project da6216f26c814fceaa94fc64e78c8efc. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:12:21.696633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Getting quotas for user 9f1e1cafad4f475dad7bc93b50312279 and project da6216f26c814fceaa94fc64e78c8efc. Resources: dict_keys(['metadata_items']) {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:12:21.763838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:12:21.764605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:12:21.765511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:12:21.766200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:12:21.773202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:12:21.809850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:21.848457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:21.853846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:21.857236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:21.860022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:21.862116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:21.871383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:21.873933 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-86a628a7-13f8-4a06-99c5-1ca4f1e386ec tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.619354 Feb 19 21:12:21.880898 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2243/4571] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:21 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:21.903702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6e8cfc94-7adf-46ef-9a91-d92d962e0f80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:21.905306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6e8cfc94-7adf-46ef-9a91-d92d962e0f80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:21.950981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Getting quotas for project da6216f26c814fceaa94fc64e78c8efc. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:12:21.980660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Getting quotas for user 9f1e1cafad4f475dad7bc93b50312279 and project da6216f26c814fceaa94fc64e78c8efc. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:12:22.039846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:12:22.046908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:12:22.152364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6e8cfc94-7adf-46ef-9a91-d92d962e0f80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:22.179765 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6e8cfc94-7adf-46ef-9a91-d92d962e0f80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1241 microversion: 2.1 time: 0.296075 Feb 19 21:12:22.207264 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2244/4572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:21 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1241 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:22.275552 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3081e2d4-9c86-49ff-865a-e7998ae3ca82 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.468711 Feb 19 21:12:22.285032 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2329/4573] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:12:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 2479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:12:22.293648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1d1e47fb-9ba3-4757-b484-e98946c84ece tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:22.295427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1d1e47fb-9ba3-4757-b484-e98946c84ece tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:22.399637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41e466d0-431f-4257-a167-c006fdc0de6b tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:22.400525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41e466d0-431f-4257-a167-c006fdc0de6b tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:22.451768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e466d0-431f-4257-a167-c006fdc0de6b tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:22.454831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e466d0-431f-4257-a167-c006fdc0de6b tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:22.457470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e466d0-431f-4257-a167-c006fdc0de6b tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:22.458315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e466d0-431f-4257-a167-c006fdc0de6b tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:22.522558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41e466d0-431f-4257-a167-c006fdc0de6b tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:12:22.720540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1d1e47fb-9ba3-4757-b484-e98946c84ece tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:22.742221 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1d1e47fb-9ba3-4757-b484-e98946c84ece tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1302 microversion: 2.1 time: 0.454939 Feb 19 21:12:22.749047 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2245/4574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:22 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1302 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:22.770692 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41e466d0-431f-4257-a167-c006fdc0de6b tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 204 len: 0 microversion: 2.32 time: 0.375973 Feb 19 21:12:22.775202 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2330/4575] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:12:22 2022] DELETE /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 19 21:12:22.901984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:22.903236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:22.925747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:22.926224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:22.930939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:22.931745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:23.145601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:23.157952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:23.171389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:23.180750 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6b3da7f8-99f9-4aaa-8cd7-c5cb9e05235c tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.284231 Feb 19 21:12:23.181351 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2331/4576] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:22 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:12:23.238376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-424b70a5-ae19-4474-b9d7-685ea4467d12 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:23.239335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-424b70a5-ae19-4474-b9d7-685ea4467d12 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:23.261418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-424b70a5-ae19-4474-b9d7-685ea4467d12 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:23.262015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-424b70a5-ae19-4474-b9d7-685ea4467d12 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:23.262916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-424b70a5-ae19-4474-b9d7-685ea4467d12 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:23.263575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-424b70a5-ae19-4474-b9d7-685ea4467d12 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:23.271929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:23.272725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:23.285606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:23.286067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:23.286880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:23.307579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:23.536362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-424b70a5-ae19-4474-b9d7-685ea4467d12 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:23.567326 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-424b70a5-ae19-4474-b9d7-685ea4467d12 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1293 microversion: 2.1 time: 0.330389 Feb 19 21:12:23.576312 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2332/4577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:23 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1293 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:12:23.768216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6be0bd0d-7bae-437f-808e-74c4347f1908 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:23.769014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6be0bd0d-7bae-437f-808e-74c4347f1908 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:23.787371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6be0bd0d-7bae-437f-808e-74c4347f1908 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:23.788057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6be0bd0d-7bae-437f-808e-74c4347f1908 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:23.790569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6be0bd0d-7bae-437f-808e-74c4347f1908 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:23.791426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6be0bd0d-7bae-437f-808e-74c4347f1908 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:24.126411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6be0bd0d-7bae-437f-808e-74c4347f1908 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:24.146396 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6be0bd0d-7bae-437f-808e-74c4347f1908 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1306 microversion: 2.1 time: 0.383056 Feb 19 21:12:24.151447 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2333/4578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:23 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1306 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:12:24.199226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:24.199844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:24.208091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:24.208962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:24.210598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:24.212866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:24.342492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:24.358232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:24.360212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:24.368648 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f0ff5746-7a14-4d4a-801d-301fbda468c8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.165926 Feb 19 21:12:24.371991 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2334/4579] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:24 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:12:24.587458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-37214853-3ca4-42e7-b9df-dcfecd0eaf80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:24.588074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-37214853-3ca4-42e7-b9df-dcfecd0eaf80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:24.623134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37214853-3ca4-42e7-b9df-dcfecd0eaf80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:24.623779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37214853-3ca4-42e7-b9df-dcfecd0eaf80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:24.624677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37214853-3ca4-42e7-b9df-dcfecd0eaf80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:24.625114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37214853-3ca4-42e7-b9df-dcfecd0eaf80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:25.056259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:25.079842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:25.082550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:25.084021 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-be01f0c2-4d20-4920-87c9-a73080e730aa tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2947 microversion: 2.32 time: 2.307640 Feb 19 21:12:25.084764 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2246/4580] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:22 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2947 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:25.165281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-61b86a66-546f-4fd3-a119-5246d76032d9 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:25.166186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-61b86a66-546f-4fd3-a119-5246d76032d9 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:25.174670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61b86a66-546f-4fd3-a119-5246d76032d9 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:25.181006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61b86a66-546f-4fd3-a119-5246d76032d9 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:25.187677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61b86a66-546f-4fd3-a119-5246d76032d9 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:25.191040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-61b86a66-546f-4fd3-a119-5246d76032d9 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:25.278247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-37214853-3ca4-42e7-b9df-dcfecd0eaf80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:25.290654 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-37214853-3ca4-42e7-b9df-dcfecd0eaf80 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.706773 Feb 19 21:12:25.292774 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2335/4581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:24 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:12:25.380789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-61b86a66-546f-4fd3-a119-5246d76032d9 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:25.393872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:25.395458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:25.405032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:25.409050 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-61b86a66-546f-4fd3-a119-5246d76032d9 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1360 microversion: 2.1 time: 0.247093 Feb 19 21:12:25.412055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:25.413029 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2247/4582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:25 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1360 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:12:25.424787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:25.425378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:25.595033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:25.611864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:25.613860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:25.614867 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-21c3bd44-ecea-477b-ac6e-30a59d393bc7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.226378 Feb 19 21:12:25.616998 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2336/4583] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:25 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:26.106660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:26.108659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:26.121024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:26.121829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:26.122840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:26.123864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:26.310273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-43142497-bcf2-4895-a4d6-4bd1e2fd625e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:26.310894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-43142497-bcf2-4895-a4d6-4bd1e2fd625e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:26.319756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43142497-bcf2-4895-a4d6-4bd1e2fd625e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:26.329161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43142497-bcf2-4895-a4d6-4bd1e2fd625e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:26.335054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43142497-bcf2-4895-a4d6-4bd1e2fd625e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:26.335831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-43142497-bcf2-4895-a4d6-4bd1e2fd625e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:26.751117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-43142497-bcf2-4895-a4d6-4bd1e2fd625e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:26.759513 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-43142497-bcf2-4895-a4d6-4bd1e2fd625e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.452899 Feb 19 21:12:26.767398 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2337/4584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:26 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:12:26.779091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-632baf1f-18cc-4a5c-b18b-e706f3cc9e67 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:26.780009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-632baf1f-18cc-4a5c-b18b-e706f3cc9e67 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:26.794381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-632baf1f-18cc-4a5c-b18b-e706f3cc9e67 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:26.797548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-632baf1f-18cc-4a5c-b18b-e706f3cc9e67 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:26.802399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-632baf1f-18cc-4a5c-b18b-e706f3cc9e67 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:26.803156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-632baf1f-18cc-4a5c-b18b-e706f3cc9e67 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:27.671294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:27.686991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:27.693366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:27.695962 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3aa7d5b4-4453-4ca8-a43c-f1d07c7764a4 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2947 microversion: 2.32 time: 1.594342 Feb 19 21:12:27.698103 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2248/4585] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:26 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2947 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:27.713064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:27.714020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:27.728369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:27.728908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:27.734897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:27.735460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:27.942811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:27.961681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:27.968231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:27.969626 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e513ecd0-ac33-4846-8976-fe68446055e7 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.270221 Feb 19 21:12:27.971779 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2249/4586] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:27 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:27.983483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a083b59-98d2-45b7-a5c2-1ca1139af1ae tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:27.984528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a083b59-98d2-45b7-a5c2-1ca1139af1ae tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:27.999840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a083b59-98d2-45b7-a5c2-1ca1139af1ae tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:28.005414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a083b59-98d2-45b7-a5c2-1ca1139af1ae tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:28.008600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a083b59-98d2-45b7-a5c2-1ca1139af1ae tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:28.009252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a083b59-98d2-45b7-a5c2-1ca1139af1ae tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:28.093624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-632baf1f-18cc-4a5c-b18b-e706f3cc9e67 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:28.102806 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-632baf1f-18cc-4a5c-b18b-e706f3cc9e67 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 1.333520 Feb 19 21:12:28.103450 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2338/4587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:26 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:28.412860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9a083b59-98d2-45b7-a5c2-1ca1139af1ae tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:28.422375 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a083b59-98d2-45b7-a5c2-1ca1139af1ae tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.448097 Feb 19 21:12:28.426160 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2250/4588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:27 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:28.608095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d0884f3d-a27c-4168-8638-49a7495ec688 req-fc27b75a-b98a-4fde-9ac7-0b49e8c85328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016a5d8a-93e3-4e79-843c-332e7c910a78", "tag": "792bb0c5-b976-4078-a9fa-692ece7d2d12"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:28.610597 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:28.610597 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:12:28.632115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d0884f3d-a27c-4168-8638-49a7495ec688 req-fc27b75a-b98a-4fde-9ac7-0b49e8c85328 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:28.632975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d0884f3d-a27c-4168-8638-49a7495ec688 req-fc27b75a-b98a-4fde-9ac7-0b49e8c85328 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:28.665555 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d0884f3d-a27c-4168-8638-49a7495ec688 req-fc27b75a-b98a-4fde-9ac7-0b49e8c85328 service nova] Creating event network-changed:792bb0c5-b976-4078-a9fa-692ece7d2d12 for instance 016a5d8a-93e3-4e79-843c-332e7c910a78 on nch2-master-1 Feb 19 21:12:28.676801 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d0884f3d-a27c-4168-8638-49a7495ec688 req-fc27b75a-b98a-4fde-9ac7-0b49e8c85328 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073185 Feb 19 21:12:28.682447 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2339/4589] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:28.732666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:28.735765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:28.745812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:28.768604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:28.768604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:28.768604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:29.000112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:29.000865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:29.050155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:29.051033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:29.066684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:29.075765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:29.332793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:29.344853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:29.351852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:29.354700 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7ed00af-4b12-4f4c-92ee-3d8d9153801f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.368092 Feb 19 21:12:29.359375 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2340/4590] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:28 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:29.365377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14633a7b-4d8f-47ee-a3f1-fa91afd7f342 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:29.366310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-14633a7b-4d8f-47ee-a3f1-fa91afd7f342 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:29.382003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14633a7b-4d8f-47ee-a3f1-fa91afd7f342 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:29.382605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14633a7b-4d8f-47ee-a3f1-fa91afd7f342 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:29.384187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14633a7b-4d8f-47ee-a3f1-fa91afd7f342 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:29.384665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14633a7b-4d8f-47ee-a3f1-fa91afd7f342 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:30.009548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-14633a7b-4d8f-47ee-a3f1-fa91afd7f342 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:30.020854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:30.021413 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14633a7b-4d8f-47ee-a3f1-fa91afd7f342 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 0.659365 Feb 19 21:12:30.021539 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2341/4591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:29 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:30.046273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:30.050877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-049e1b11-a89e-4a27-82b0-a21dab8e2c32 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:30.051570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:30.052958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-049e1b11-a89e-4a27-82b0-a21dab8e2c32 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:30.053626 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f024df4-5574-435c-a29c-39ae6244a067 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2926 microversion: 2.32 time: 1.324949 Feb 19 21:12:30.056515 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2251/4592] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:28 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2926 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:30.084258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-049e1b11-a89e-4a27-82b0-a21dab8e2c32 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:30.100027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-049e1b11-a89e-4a27-82b0-a21dab8e2c32 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:30.100950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-049e1b11-a89e-4a27-82b0-a21dab8e2c32 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:30.101401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-049e1b11-a89e-4a27-82b0-a21dab8e2c32 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:30.343910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-62289552-1a20-466f-b64b-229b227689f1 req-c24ccbef-5a43-4414-8861-d22c8e267fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "452de813-e220-4db1-8f6c-6d03d6b88559", "tag": "fd590ea4-9502-47f9-a804-41b8d37bcda0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:30.345962 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:30.345962 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:12:30.363782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-62289552-1a20-466f-b64b-229b227689f1 req-c24ccbef-5a43-4414-8861-d22c8e267fec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:30.364830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-62289552-1a20-466f-b64b-229b227689f1 req-c24ccbef-5a43-4414-8861-d22c8e267fec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:30.400052 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-62289552-1a20-466f-b64b-229b227689f1 req-c24ccbef-5a43-4414-8861-d22c8e267fec service nova] Creating event network-changed:fd590ea4-9502-47f9-a804-41b8d37bcda0 for instance 452de813-e220-4db1-8f6c-6d03d6b88559 on nch2-master-1 Feb 19 21:12:30.417753 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-62289552-1a20-466f-b64b-229b227689f1 req-c24ccbef-5a43-4414-8861-d22c8e267fec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.359736 Feb 19 21:12:30.421621 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2252/4593] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:30.443087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:30.444319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:30.467366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:30.469781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:30.472376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:30.474576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:30.602937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-049e1b11-a89e-4a27-82b0-a21dab8e2c32 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:30.611960 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-049e1b11-a89e-4a27-82b0-a21dab8e2c32 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.581785 Feb 19 21:12:30.612613 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2342/4594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:30 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:30.630795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1eb8f8ef-d5f7-4d1e-8e42-a34230b127eb req-dcb29f68-794d-4995-92e2-50988885c060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-unplugged", "status": "completed", "tag": "70eb9392-ffac-4852-9582-a01fcfe48d7c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:30.632500 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:30.632500 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:12:30.651154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1eb8f8ef-d5f7-4d1e-8e42-a34230b127eb req-dcb29f68-794d-4995-92e2-50988885c060 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:30.651893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1eb8f8ef-d5f7-4d1e-8e42-a34230b127eb req-dcb29f68-794d-4995-92e2-50988885c060 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:30.665817 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1eb8f8ef-d5f7-4d1e-8e42-a34230b127eb req-dcb29f68-794d-4995-92e2-50988885c060 service nova] Creating event network-vif-unplugged:70eb9392-ffac-4852-9582-a01fcfe48d7c for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:30.675882 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1eb8f8ef-d5f7-4d1e-8e42-a34230b127eb req-dcb29f68-794d-4995-92e2-50988885c060 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052943 Feb 19 21:12:30.677261 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2343/4595] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:30.786227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:30.803369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:30.806652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:30.808548 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9ad09835-a601-43f4-a095-8f70e2914c36 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.385338 Feb 19 21:12:30.810783 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2253/4596] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:30 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:31.048542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-45ad2727-d9a0-48f4-86e4-bfc0955ea275 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:31.049559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-45ad2727-d9a0-48f4-86e4-bfc0955ea275 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:31.066421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45ad2727-d9a0-48f4-86e4-bfc0955ea275 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:31.066862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45ad2727-d9a0-48f4-86e4-bfc0955ea275 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:31.076212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:31.077504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:31.078804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45ad2727-d9a0-48f4-86e4-bfc0955ea275 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:31.079128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45ad2727-d9a0-48f4-86e4-bfc0955ea275 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:31.087871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:31.093171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:31.094315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:31.094905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:32.388980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-45ad2727-d9a0-48f4-86e4-bfc0955ea275 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:32.404744 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-45ad2727-d9a0-48f4-86e4-bfc0955ea275 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 1.370212 Feb 19 21:12:32.410360 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2344/4597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:31 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:32.422584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-992e5d8b-4928-4a6c-9e7e-808ddd78c07a tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:32.423592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-992e5d8b-4928-4a6c-9e7e-808ddd78c07a tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:32.435208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-992e5d8b-4928-4a6c-9e7e-808ddd78c07a tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:32.436273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-992e5d8b-4928-4a6c-9e7e-808ddd78c07a tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:32.437293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-992e5d8b-4928-4a6c-9e7e-808ddd78c07a tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:32.437721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-992e5d8b-4928-4a6c-9e7e-808ddd78c07a tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:32.547894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:32.576842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:32.590412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:32.595415 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dbb91040-047c-423a-994a-1d369e35ce61 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2905 microversion: 2.32 time: 1.523860 Feb 19 21:12:32.598524 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2254/4598] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:31 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2905 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:12:32.607595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:32.609305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:32.627001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:32.628131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:32.629206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:32.629887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:32.837663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-992e5d8b-4928-4a6c-9e7e-808ddd78c07a tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:32.848463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:32.856698 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-992e5d8b-4928-4a6c-9e7e-808ddd78c07a tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.444866 Feb 19 21:12:32.862513 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2345/4599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:32 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:32.866416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:32.872585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:32.876923 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2d4870a-2ef5-4d54-b753-8824b86819b4 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.276213 Feb 19 21:12:32.880033 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2255/4600] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:32 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:32.889754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5132a567-4f70-4477-9c9e-84933219f173 req-02878477-d66c-4689-927f-d58dbd482ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-unplugged", "status": "completed", "tag": "953183ea-8af2-4363-894d-4fc5565d335c"}, {"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-unplugged", "status": "completed", "tag": "9ed98a2b-9925-480d-95be-fe4ae1e28f6e"}, {"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-unplugged", "status": "completed", "tag": "95e9c0f7-4a48-40c7-a205-d0efe0ce4387"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:32.892021 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:32.892021 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:12:32.908264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5132a567-4f70-4477-9c9e-84933219f173 req-02878477-d66c-4689-927f-d58dbd482ea3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:32.909137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5132a567-4f70-4477-9c9e-84933219f173 req-02878477-d66c-4689-927f-d58dbd482ea3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:32.942136 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5132a567-4f70-4477-9c9e-84933219f173 req-02878477-d66c-4689-927f-d58dbd482ea3 service nova] Creating event network-vif-unplugged:953183ea-8af2-4363-894d-4fc5565d335c for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:32.942662 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5132a567-4f70-4477-9c9e-84933219f173 req-02878477-d66c-4689-927f-d58dbd482ea3 service nova] Creating event network-vif-unplugged:9ed98a2b-9925-480d-95be-fe4ae1e28f6e for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:32.943226 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5132a567-4f70-4477-9c9e-84933219f173 req-02878477-d66c-4689-927f-d58dbd482ea3 service nova] Creating event network-vif-unplugged:95e9c0f7-4a48-40c7-a205-d0efe0ce4387 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:33.009056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5132a567-4f70-4477-9c9e-84933219f173 req-02878477-d66c-4689-927f-d58dbd482ea3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.130631 Feb 19 21:12:33.014871 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2346/4601] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:33.427589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bd4ca15e-f8d8-4c42-8341-688911a14060 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:33.428112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bd4ca15e-f8d8-4c42-8341-688911a14060 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:33.436690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd4ca15e-f8d8-4c42-8341-688911a14060 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:33.437341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd4ca15e-f8d8-4c42-8341-688911a14060 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:33.438142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd4ca15e-f8d8-4c42-8341-688911a14060 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:33.438784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd4ca15e-f8d8-4c42-8341-688911a14060 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:33.618941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:33.620282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:33.627937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:33.641856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:33.643746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:33.644393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:34.150574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bd4ca15e-f8d8-4c42-8341-688911a14060 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:34.171842 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bd4ca15e-f8d8-4c42-8341-688911a14060 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 0.747647 Feb 19 21:12:34.174669 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2256/4602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:33 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:34.193883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a5e7165d-cb40-4ea7-b8b0-81986722bddc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:34.199105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a5e7165d-cb40-4ea7-b8b0-81986722bddc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:34.228858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5e7165d-cb40-4ea7-b8b0-81986722bddc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:34.229632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5e7165d-cb40-4ea7-b8b0-81986722bddc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:34.231885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5e7165d-cb40-4ea7-b8b0-81986722bddc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:34.233287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5e7165d-cb40-4ea7-b8b0-81986722bddc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:34.627766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a5e7165d-cb40-4ea7-b8b0-81986722bddc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:34.632989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:34.639743 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a5e7165d-cb40-4ea7-b8b0-81986722bddc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.459464 Feb 19 21:12:34.642897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:34.645876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:34.647146 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-93512d73-3bf2-4b05-bce7-39d4063ff223 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2905 microversion: 2.32 time: 1.033107 Feb 19 21:12:34.647712 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2347/4603] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:33 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2905 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:12:34.660092 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2257/4604] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:34 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:34.667008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:34.670197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:34.689131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:34.691886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:34.693511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:34.696821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:34.839077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:34.859330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:34.865590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:34.867426 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f3476811-e0c5-4ca8-8f91-8916955742e8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.212288 Feb 19 21:12:34.868553 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2258/4605] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:34 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:34.951658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-355d292e-1724-4683-9892-f27ea3577ad9 req-8e66d3bd-2f6a-4bae-9aaf-99b0a4dbb271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-deleted", "tag": "953183ea-8af2-4363-894d-4fc5565d335c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:34.953821 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:34.953821 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:12:34.970123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-355d292e-1724-4683-9892-f27ea3577ad9 req-8e66d3bd-2f6a-4bae-9aaf-99b0a4dbb271 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:34.974669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-355d292e-1724-4683-9892-f27ea3577ad9 req-8e66d3bd-2f6a-4bae-9aaf-99b0a4dbb271 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:35.009864 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-355d292e-1724-4683-9892-f27ea3577ad9 req-8e66d3bd-2f6a-4bae-9aaf-99b0a4dbb271 service nova] Creating event network-vif-deleted:953183ea-8af2-4363-894d-4fc5565d335c for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:35.025631 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-355d292e-1724-4683-9892-f27ea3577ad9 req-8e66d3bd-2f6a-4bae-9aaf-99b0a4dbb271 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077822 Feb 19 21:12:35.026408 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2348/4606] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:35.118559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-295b56a3-60ee-4cac-bd26-084350f4b43c req-09aa043b-4a51-41e0-95a6-bf75de68d884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-unplugged", "status": "completed", "tag": "e67957f6-071e-404a-a727-94c417e4d265"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:35.120416 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:35.120416 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:12:35.132807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-295b56a3-60ee-4cac-bd26-084350f4b43c req-09aa043b-4a51-41e0-95a6-bf75de68d884 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:35.142039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-295b56a3-60ee-4cac-bd26-084350f4b43c req-09aa043b-4a51-41e0-95a6-bf75de68d884 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:35.163272 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-295b56a3-60ee-4cac-bd26-084350f4b43c req-09aa043b-4a51-41e0-95a6-bf75de68d884 service nova] Creating event network-vif-unplugged:e67957f6-071e-404a-a727-94c417e4d265 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:35.191794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-50e8a597-8629-4d7f-9d98-6c331778d0fa tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:35.192555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-50e8a597-8629-4d7f-9d98-6c331778d0fa tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:35.200799 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-295b56a3-60ee-4cac-bd26-084350f4b43c req-09aa043b-4a51-41e0-95a6-bf75de68d884 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088151 Feb 19 21:12:35.204721 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2259/4607] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:35.206824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50e8a597-8629-4d7f-9d98-6c331778d0fa tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:35.207651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50e8a597-8629-4d7f-9d98-6c331778d0fa tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:35.208584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50e8a597-8629-4d7f-9d98-6c331778d0fa tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:35.208922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50e8a597-8629-4d7f-9d98-6c331778d0fa tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:35.602792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-50e8a597-8629-4d7f-9d98-6c331778d0fa tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:35.616391 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-50e8a597-8629-4d7f-9d98-6c331778d0fa tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 0.429277 Feb 19 21:12:35.619511 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2349/4608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:35 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:35.659773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-29b2e008-75dd-48ec-9936-b97eb06bedbc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:35.660877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-29b2e008-75dd-48ec-9936-b97eb06bedbc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:35.668732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29b2e008-75dd-48ec-9936-b97eb06bedbc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:35.669437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29b2e008-75dd-48ec-9936-b97eb06bedbc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:35.670049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:35.670901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:35.671509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29b2e008-75dd-48ec-9936-b97eb06bedbc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:35.672860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29b2e008-75dd-48ec-9936-b97eb06bedbc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:35.690919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:35.691469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:35.694513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:35.699924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:35.962395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-29b2e008-75dd-48ec-9936-b97eb06bedbc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:35.994957 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-29b2e008-75dd-48ec-9936-b97eb06bedbc tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.338356 Feb 19 21:12:35.996473 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2260/4609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:35 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:36.003078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:36.003969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:36.032047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:36.032698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:36.033782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:36.034329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:36.098724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:36.109787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:36.111781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:36.113293 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3aaa885b-cebe-4bc6-800a-6b0535d4ed50 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2528 microversion: 2.32 time: 0.450146 Feb 19 21:12:36.124748 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2350/4610] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:35 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2528 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:36.127344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:36.137358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:36.139336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:36.140947 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b4e4a30f-5fa2-4d63-9b56-37c72c37abe8 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.143226 Feb 19 21:12:36.141742 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2261/4611] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:35 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:36.633422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f138a457-5939-45e2-a196-df9f3d7d3146 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:36.634048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f138a457-5939-45e2-a196-df9f3d7d3146 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:36.642914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f138a457-5939-45e2-a196-df9f3d7d3146 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:36.643376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f138a457-5939-45e2-a196-df9f3d7d3146 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:36.644184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f138a457-5939-45e2-a196-df9f3d7d3146 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:36.649096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f138a457-5939-45e2-a196-df9f3d7d3146 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:37.015069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-abc62d30-9ed2-4f68-9441-6b8f1a496a4f tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:37.018865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-abc62d30-9ed2-4f68-9441-6b8f1a496a4f tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:37.029700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-abc62d30-9ed2-4f68-9441-6b8f1a496a4f tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:37.030517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-abc62d30-9ed2-4f68-9441-6b8f1a496a4f tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:37.031585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-abc62d30-9ed2-4f68-9441-6b8f1a496a4f tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:37.032276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-abc62d30-9ed2-4f68-9441-6b8f1a496a4f tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:37.424957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f138a457-5939-45e2-a196-df9f3d7d3146 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:37.435587 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f138a457-5939-45e2-a196-df9f3d7d3146 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 0.805866 Feb 19 21:12:37.436191 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2351/4612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:36 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:37.459500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-05fe9e3b-2b04-45bb-a290-969ae241c9db req-fa777a85-e2f7-4786-839b-18f114970b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-deleted", "tag": "70eb9392-ffac-4852-9582-a01fcfe48d7c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:37.461081 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:37.461081 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:12:37.469261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-05fe9e3b-2b04-45bb-a290-969ae241c9db req-fa777a85-e2f7-4786-839b-18f114970b89 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:37.469707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-05fe9e3b-2b04-45bb-a290-969ae241c9db req-fa777a85-e2f7-4786-839b-18f114970b89 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:37.472886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-abc62d30-9ed2-4f68-9441-6b8f1a496a4f tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:37.492639 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-05fe9e3b-2b04-45bb-a290-969ae241c9db req-fa777a85-e2f7-4786-839b-18f114970b89 service nova] Creating event network-vif-deleted:70eb9392-ffac-4852-9582-a01fcfe48d7c for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:37.507747 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-05fe9e3b-2b04-45bb-a290-969ae241c9db req-fa777a85-e2f7-4786-839b-18f114970b89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067751 Feb 19 21:12:37.510979 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2352/4613] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:37.524607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:37.527478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:37.542156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:37.543514 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-abc62d30-9ed2-4f68-9441-6b8f1a496a4f tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.518632 Feb 19 21:12:37.543725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:37.544430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:37.544878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:37.546655 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2262/4614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:37 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:37.574942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:37.575907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:37.590298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:37.591950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:37.593585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:37.594333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:37.870461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:37.886361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:37.894103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:37.895836 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ee2090b4-dbb5-4b1f-9847-4cee2f56fb1b tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.347169 Feb 19 21:12:37.899023 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2263/4615] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:37 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:38.223983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:38.233604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:38.235462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:38.237541 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-645a652f-84d1-48d3-ac5c-f07e1365ea35 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2369 microversion: 2.32 time: 0.725169 Feb 19 21:12:38.238555 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2353/4616] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:37 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2369 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:38.464829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c8bc1b3-60ff-4276-8d19-ea03d5869533 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:38.466049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c8bc1b3-60ff-4276-8d19-ea03d5869533 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:38.480086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c8bc1b3-60ff-4276-8d19-ea03d5869533 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:38.481946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c8bc1b3-60ff-4276-8d19-ea03d5869533 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:38.483347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c8bc1b3-60ff-4276-8d19-ea03d5869533 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:38.487082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c8bc1b3-60ff-4276-8d19-ea03d5869533 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:38.565974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-01cf4b8f-08a1-4efd-b477-d8b30eae9dc2 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:38.567415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-01cf4b8f-08a1-4efd-b477-d8b30eae9dc2 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:38.575657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01cf4b8f-08a1-4efd-b477-d8b30eae9dc2 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:38.576442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01cf4b8f-08a1-4efd-b477-d8b30eae9dc2 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:38.577433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01cf4b8f-08a1-4efd-b477-d8b30eae9dc2 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:38.578082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-01cf4b8f-08a1-4efd-b477-d8b30eae9dc2 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:38.827867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c8bc1b3-60ff-4276-8d19-ea03d5869533 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:38.837370 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c8bc1b3-60ff-4276-8d19-ea03d5869533 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 0.377290 Feb 19 21:12:38.845738 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2264/4617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:38 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:38.854470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-01cf4b8f-08a1-4efd-b477-d8b30eae9dc2 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:38.867055 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-01cf4b8f-08a1-4efd-b477-d8b30eae9dc2 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.306745 Feb 19 21:12:38.867675 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2354/4618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:38 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:38.922539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:38.923161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:38.930628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:38.931076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:38.932142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:38.932612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:39.038556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:39.076274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:39.079500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:39.081050 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f67b7566-1aa3-48f7-99a6-d2ed621d6d35 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.162537 Feb 19 21:12:39.095763 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2265/4619] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:38 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:39.258604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:39.259247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:39.278109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:39.278841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:39.280520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:39.281132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:39.309595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-3d9c2f75-6311-43c5-a309-18ec12ab312a req-cfd8491e-1a22-49da-bee2-048b84c82435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016a5d8a-93e3-4e79-843c-332e7c910a78", "name": "network-vif-plugged", "status": "completed", "tag": "792bb0c5-b976-4078-a9fa-692ece7d2d12"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:39.314054 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:39.314054 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:12:39.328873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3d9c2f75-6311-43c5-a309-18ec12ab312a req-cfd8491e-1a22-49da-bee2-048b84c82435 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:39.330500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3d9c2f75-6311-43c5-a309-18ec12ab312a req-cfd8491e-1a22-49da-bee2-048b84c82435 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:39.361096 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3d9c2f75-6311-43c5-a309-18ec12ab312a req-cfd8491e-1a22-49da-bee2-048b84c82435 service nova] Creating event network-vif-plugged:792bb0c5-b976-4078-a9fa-692ece7d2d12 for instance 016a5d8a-93e3-4e79-843c-332e7c910a78 on nch2-master-1 Feb 19 21:12:39.373682 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-3d9c2f75-6311-43c5-a309-18ec12ab312a req-cfd8491e-1a22-49da-bee2-048b84c82435 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070138 Feb 19 21:12:39.375001 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2266/4620] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:12:39.406730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:39.418618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:39.420388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:39.421945 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9fc6ac2e-4f4b-4bfd-841d-ebee1993f9e8 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 2258 microversion: 2.32 time: 0.167153 Feb 19 21:12:39.423100 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2355/4621] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:39 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 2258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:39.584084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-3204c33e-df98-4900-a187-71db96be9885 req-13ba08c4-2cae-43a5-b42f-ad8b4f9a28e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-deleted", "tag": "9ed98a2b-9925-480d-95be-fe4ae1e28f6e"}, {"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-deleted", "tag": "95e9c0f7-4a48-40c7-a205-d0efe0ce4387"}, {"server_uuid": "d857117a-ec86-4b8f-ba54-6e01374d484b", "name": "network-vif-deleted", "tag": "e67957f6-071e-404a-a727-94c417e4d265"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:39.585960 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:39.585960 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:12:39.617697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3204c33e-df98-4900-a187-71db96be9885 req-13ba08c4-2cae-43a5-b42f-ad8b4f9a28e7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:39.623275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3204c33e-df98-4900-a187-71db96be9885 req-13ba08c4-2cae-43a5-b42f-ad8b4f9a28e7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:39.649817 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3204c33e-df98-4900-a187-71db96be9885 req-13ba08c4-2cae-43a5-b42f-ad8b4f9a28e7 service nova] Creating event network-vif-deleted:9ed98a2b-9925-480d-95be-fe4ae1e28f6e for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:39.650544 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3204c33e-df98-4900-a187-71db96be9885 req-13ba08c4-2cae-43a5-b42f-ad8b4f9a28e7 service nova] Creating event network-vif-deleted:95e9c0f7-4a48-40c7-a205-d0efe0ce4387 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:39.651244 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3204c33e-df98-4900-a187-71db96be9885 req-13ba08c4-2cae-43a5-b42f-ad8b4f9a28e7 service nova] Creating event network-vif-deleted:e67957f6-071e-404a-a727-94c417e4d265 for instance d857117a-ec86-4b8f-ba54-6e01374d484b on nch1-master-1 Feb 19 21:12:39.662507 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-3204c33e-df98-4900-a187-71db96be9885 req-13ba08c4-2cae-43a5-b42f-ad8b4f9a28e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.094234 Feb 19 21:12:39.666396 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2267/4622] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:39.855881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-675feba3-7c90-4dc6-a652-99d0be85ab0f tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:39.857433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-675feba3-7c90-4dc6-a652-99d0be85ab0f tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:39.873277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-675feba3-7c90-4dc6-a652-99d0be85ab0f tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:39.873751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-675feba3-7c90-4dc6-a652-99d0be85ab0f tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:39.874632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-675feba3-7c90-4dc6-a652-99d0be85ab0f tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:39.875090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-675feba3-7c90-4dc6-a652-99d0be85ab0f tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:39.885339 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a2b9897b-dd10-442d-8917-e7878bc488bd tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:39.886353 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a2b9897b-dd10-442d-8917-e7878bc488bd tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:39.910935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2b9897b-dd10-442d-8917-e7878bc488bd tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:39.912473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2b9897b-dd10-442d-8917-e7878bc488bd tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:39.913400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2b9897b-dd10-442d-8917-e7878bc488bd tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:39.913757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a2b9897b-dd10-442d-8917-e7878bc488bd tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:40.113607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a2b9897b-dd10-442d-8917-e7878bc488bd tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:40.121715 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a2b9897b-dd10-442d-8917-e7878bc488bd tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1299 microversion: 2.1 time: 0.240481 Feb 19 21:12:40.123011 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2268/4623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:39 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1299 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:12:40.129330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:40.130186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:40.142154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:40.143859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:40.144953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:40.145593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:40.198283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-675feba3-7c90-4dc6-a652-99d0be85ab0f tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:40.209928 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-675feba3-7c90-4dc6-a652-99d0be85ab0f tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 0.357712 Feb 19 21:12:40.210829 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2356/4624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:39 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:40.229110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:40.241756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:40.243535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:40.244766 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ac4fc550-0d2d-4001-8b6f-9be4791c0255 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.120560 Feb 19 21:12:40.245501 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2269/4625] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:40 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:40.442773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:40.443396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:40.451368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:40.452103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:40.453087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:40.453710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:40.515040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:40.515813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:40.519137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lazy-loading 'fault' on Instance uuid d857117a-ec86-4b8f-ba54-6e01374d484b {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:12:40.569138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:40.581616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:40.583417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ee3e5caf3e44b21b66cf9ad197e5999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f260ed47c5994487a4cc293c33dae3ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:40.585527 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2eecffc9-b05f-45f5-bf10-48bae833f043 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 200 len: 1372 microversion: 2.32 time: 0.147912 Feb 19 21:12:40.588630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2357/4626] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:40 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:41.141635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2ba95f5f-e54c-47c0-85dd-037efcb3a1e8 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:41.143536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2ba95f5f-e54c-47c0-85dd-037efcb3a1e8 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:41.152546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ba95f5f-e54c-47c0-85dd-037efcb3a1e8 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.153286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ba95f5f-e54c-47c0-85dd-037efcb3a1e8 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.154447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ba95f5f-e54c-47c0-85dd-037efcb3a1e8 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.156165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ba95f5f-e54c-47c0-85dd-037efcb3a1e8 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.234188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ce1afa46-a110-421b-bbc2-b1775e61a17e tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:41.235197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ce1afa46-a110-421b-bbc2-b1775e61a17e tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:41.246783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce1afa46-a110-421b-bbc2-b1775e61a17e tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.247242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce1afa46-a110-421b-bbc2-b1775e61a17e tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.248205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce1afa46-a110-421b-bbc2-b1775e61a17e tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.248683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce1afa46-a110-421b-bbc2-b1775e61a17e tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.305667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2ba95f5f-e54c-47c0-85dd-037efcb3a1e8 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:41.318588 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2ba95f5f-e54c-47c0-85dd-037efcb3a1e8 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1471 microversion: 2.1 time: 0.182078 Feb 19 21:12:41.324749 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2270/4627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:41 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:41.342053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:41.342689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:41.356041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.356672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.360972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.361542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.558931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:41.589065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:41.599724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:41.607690 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1d67d65d-2900-45cf-b179-a7a0da342015 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1366 microversion: 2.47 time: 0.278737 Feb 19 21:12:41.609260 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2271/4628] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:41 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:41.637189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4eca049f-8cbe-486a-b22a-e130fef3304e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:41.637770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4eca049f-8cbe-486a-b22a-e130fef3304e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:41.662016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4eca049f-8cbe-486a-b22a-e130fef3304e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.662480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4eca049f-8cbe-486a-b22a-e130fef3304e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.663287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4eca049f-8cbe-486a-b22a-e130fef3304e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.663728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4eca049f-8cbe-486a-b22a-e130fef3304e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.870216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ce1afa46-a110-421b-bbc2-b1775e61a17e tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:41.882245 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ce1afa46-a110-421b-bbc2-b1775e61a17e tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 0.656437 Feb 19 21:12:41.882847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2358/4629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:41 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:41.887868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-88aa5c57-d926-40c9-ad99-4c29fe2ca95a req-ad57842e-88c5-40a4-a364-ed40ae5c11c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452de813-e220-4db1-8f6c-6d03d6b88559", "name": "network-vif-plugged", "status": "completed", "tag": "fd590ea4-9502-47f9-a804-41b8d37bcda0"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:41.892033 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:41.892033 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:12:41.902600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-88aa5c57-d926-40c9-ad99-4c29fe2ca95a req-ad57842e-88c5-40a4-a364-ed40ae5c11c1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.903323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-88aa5c57-d926-40c9-ad99-4c29fe2ca95a req-ad57842e-88c5-40a4-a364-ed40ae5c11c1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.909690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4eca049f-8cbe-486a-b22a-e130fef3304e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:41.918324 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-88aa5c57-d926-40c9-ad99-4c29fe2ca95a req-ad57842e-88c5-40a4-a364-ed40ae5c11c1 service nova] Creating event network-vif-plugged:fd590ea4-9502-47f9-a804-41b8d37bcda0 for instance 452de813-e220-4db1-8f6c-6d03d6b88559 on nch2-master-1 Feb 19 21:12:41.920797 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4eca049f-8cbe-486a-b22a-e130fef3304e tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1471 microversion: 2.1 time: 0.307096 Feb 19 21:12:41.925374 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2272/4630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:41 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:41.940424 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-88aa5c57-d926-40c9-ad99-4c29fe2ca95a req-ad57842e-88c5-40a4-a364-ed40ae5c11c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053989 Feb 19 21:12:41.942066 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2359/4631] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:41.946399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c78c9e5-290b-4580-b2ee-8a1ab989daae tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:41.947454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8c78c9e5-290b-4580-b2ee-8a1ab989daae tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:41.951971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-23147276-a9a4-4a3d-89e2-ee63b09d628d tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:41.953598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-23147276-a9a4-4a3d-89e2-ee63b09d628d tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:41.961936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23147276-a9a4-4a3d-89e2-ee63b09d628d tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.962938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23147276-a9a4-4a3d-89e2-ee63b09d628d tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.964257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c78c9e5-290b-4580-b2ee-8a1ab989daae tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.964543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23147276-a9a4-4a3d-89e2-ee63b09d628d tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.964864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c78c9e5-290b-4580-b2ee-8a1ab989daae tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.965518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23147276-a9a4-4a3d-89e2-ee63b09d628d tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.969776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c78c9e5-290b-4580-b2ee-8a1ab989daae tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:41.970445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c78c9e5-290b-4580-b2ee-8a1ab989daae tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:41.988881 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8c78c9e5-290b-4580-b2ee-8a1ab989daae tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] HTTP exception thrown: Instance d857117a-ec86-4b8f-ba54-6e01374d484b could not be found. Feb 19 21:12:41.990660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c78c9e5-290b-4580-b2ee-8a1ab989daae tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Returning 404 to user: Instance d857117a-ec86-4b8f-ba54-6e01374d484b could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:12:41.991751 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c78c9e5-290b-4580-b2ee-8a1ab989daae tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 404 len: 111 microversion: 2.32 time: 0.056772 Feb 19 21:12:41.994750 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2273/4632] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:41 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:12:42.010485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7330051b-63b7-4329-add7-6dab9ae871cb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '.version_select at 0x7f6467e6a0d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:42.048369 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7330051b-63b7-4329-add7-6dab9ae871cb tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865563910" status: 204 len: 0 microversion: 2.32 time: 0.047172 Feb 19 21:12:42.060578 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2274/4633] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Feb 19 21:12:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865563910 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:12:42.395157 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-23147276-a9a4-4a3d-89e2-ee63b09d628d tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1622 microversion: 2.1 time: 0.450814 Feb 19 21:12:42.395760 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2360/4634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:41 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1622 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:42.412281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-92623eb0-44dc-4daa-84fd-e15d60d16513 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:42.412941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-92623eb0-44dc-4daa-84fd-e15d60d16513 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:42.419908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92623eb0-44dc-4daa-84fd-e15d60d16513 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:42.420279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92623eb0-44dc-4daa-84fd-e15d60d16513 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:42.421108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92623eb0-44dc-4daa-84fd-e15d60d16513 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:42.421555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92623eb0-44dc-4daa-84fd-e15d60d16513 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:42.628572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:42.629329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:42.635666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:42.636217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:42.637058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:42.637496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:42.975684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:42.985876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:42.988958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:42.990735 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5b42ef9c-f83a-41f9-9437-54589a6eb951 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1372 microversion: 2.47 time: 0.366356 Feb 19 21:12:42.991634 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2361/4635] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:42 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1372 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:42.996569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fbfb1d7f-dc8a-4450-b0b1-f43af472dfc5 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:42.997336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fbfb1d7f-dc8a-4450-b0b1-f43af472dfc5 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:43.003515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbfb1d7f-dc8a-4450-b0b1-f43af472dfc5 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:43.004183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbfb1d7f-dc8a-4450-b0b1-f43af472dfc5 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:43.005113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbfb1d7f-dc8a-4450-b0b1-f43af472dfc5 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:43.005616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fbfb1d7f-dc8a-4450-b0b1-f43af472dfc5 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:43.293586 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-92623eb0-44dc-4daa-84fd-e15d60d16513 tempest-TestSecurityGroupsBasicOps-2050863166 tempest-TestSecurityGroupsBasicOps-2050863166-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1914 microversion: 2.1 time: 0.886086 Feb 19 21:12:43.294449 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2275/4636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:42 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1914 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:43.621990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1b860430-76b0-42bf-8007-37e10efe1482 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:43.623868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1b860430-76b0-42bf-8007-37e10efe1482 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:43.632018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b860430-76b0-42bf-8007-37e10efe1482 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:43.632805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b860430-76b0-42bf-8007-37e10efe1482 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:43.633777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b860430-76b0-42bf-8007-37e10efe1482 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:43.634346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b860430-76b0-42bf-8007-37e10efe1482 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:43.663405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1b860430-76b0-42bf-8007-37e10efe1482 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:12:43.681737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fbfb1d7f-dc8a-4450-b0b1-f43af472dfc5 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:43.691128 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fbfb1d7f-dc8a-4450-b0b1-f43af472dfc5 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1427 microversion: 2.1 time: 0.698180 Feb 19 21:12:43.692047 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2362/4637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:42 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1427 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:43.769538 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1b860430-76b0-42bf-8007-37e10efe1482 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "DELETE /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 204 len: 0 microversion: 2.1 time: 0.150669 Feb 19 21:12:43.771583 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2276/4638] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:12:43 2022] DELETE /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:12:43.779821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d670182d-eb5d-48ec-b008-49067f103085 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:43.780485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d670182d-eb5d-48ec-b008-49067f103085 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:43.787480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d670182d-eb5d-48ec-b008-49067f103085 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:43.787873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d670182d-eb5d-48ec-b008-49067f103085 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:43.788694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d670182d-eb5d-48ec-b008-49067f103085 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:43.789136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d670182d-eb5d-48ec-b008-49067f103085 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:44.020011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d670182d-eb5d-48ec-b008-49067f103085 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:44.030776 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d670182d-eb5d-48ec-b008-49067f103085 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1477 microversion: 2.1 time: 0.254512 Feb 19 21:12:44.032067 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2363/4639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:43 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:44.032282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:44.034033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:44.044774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:44.045519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:44.046362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:44.046847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:44.190152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:44.199471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:44.201431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:44.202874 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f9d1b375-e5d1-4622-a198-07495c490c72 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1372 microversion: 2.47 time: 0.175317 Feb 19 21:12:44.203902 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2277/4640] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:44 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:44.709505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-851ba159-47e8-4ca4-93cd-d0479d420760 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:44.710243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-851ba159-47e8-4ca4-93cd-d0479d420760 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:44.718920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-851ba159-47e8-4ca4-93cd-d0479d420760 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:44.719727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-851ba159-47e8-4ca4-93cd-d0479d420760 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:44.724504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-851ba159-47e8-4ca4-93cd-d0479d420760 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:44.724874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-851ba159-47e8-4ca4-93cd-d0479d420760 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.014016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-851ba159-47e8-4ca4-93cd-d0479d420760 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.024855 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-851ba159-47e8-4ca4-93cd-d0479d420760 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1608 microversion: 2.1 time: 0.319417 Feb 19 21:12:45.025577 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2364/4641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:44 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1608 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:45.041390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c57c8271-3394-4187-8cd9-65622c533694 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:45.042613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c57c8271-3394-4187-8cd9-65622c533694 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:45.051067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c57c8271-3394-4187-8cd9-65622c533694 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.051759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c57c8271-3394-4187-8cd9-65622c533694 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.052768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c57c8271-3394-4187-8cd9-65622c533694 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.053357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c57c8271-3394-4187-8cd9-65622c533694 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.054359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-873da8a6-f213-49bd-9779-6aad6360c868 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:45.055645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-873da8a6-f213-49bd-9779-6aad6360c868 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:45.067451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873da8a6-f213-49bd-9779-6aad6360c868 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.069979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873da8a6-f213-49bd-9779-6aad6360c868 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.087364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873da8a6-f213-49bd-9779-6aad6360c868 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.088305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-873da8a6-f213-49bd-9779-6aad6360c868 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.294066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-873da8a6-f213-49bd-9779-6aad6360c868 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.316648 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-873da8a6-f213-49bd-9779-6aad6360c868 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1477 microversion: 2.1 time: 0.271630 Feb 19 21:12:45.319177 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2365/4642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:45 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:12:45.325506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:45.327274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:45.346050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.346909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.348011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.348787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.385300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c57c8271-3394-4187-8cd9-65622c533694 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.393800 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c57c8271-3394-4187-8cd9-65622c533694 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1608 microversion: 2.1 time: 0.355977 Feb 19 21:12:45.418579 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2278/4643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:45 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1608 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:45.429390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-df18e314-e0b3-4e52-aa5e-2f98eb59ed7b tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:45.432746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-df18e314-e0b3-4e52-aa5e-2f98eb59ed7b tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:45.445426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df18e314-e0b3-4e52-aa5e-2f98eb59ed7b tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.450890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df18e314-e0b3-4e52-aa5e-2f98eb59ed7b tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.452009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df18e314-e0b3-4e52-aa5e-2f98eb59ed7b tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.455490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df18e314-e0b3-4e52-aa5e-2f98eb59ed7b tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.490282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.502537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.510926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.510926 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a3853ce6-73cc-4658-9cba-e3a6334dd909 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1357 microversion: 2.47 time: 0.188693 Feb 19 21:12:45.513264 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2366/4644] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:45 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:45.543088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:45.547634 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:45.547634 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:12:45.549633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.550706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Searching by: {'deleted': False, 'project_id': '96ce8f5b3827425fa697e340178b84c6'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:12:45.559325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.560204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.560780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.561287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.738830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:12:45.850090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.857380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.857964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.871951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.873535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:45.943956 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8f063799-f232-49c7-bd3f-8ef462ca5186 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.405228 Feb 19 21:12:45.949091 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2367/4645] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Feb 19 21:12:45 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:12:45.971675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-abc0d674-c842-445f-a6a5-8f0e714768fa tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:45.972228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-abc0d674-c842-445f-a6a5-8f0e714768fa tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:45.979724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abc0d674-c842-445f-a6a5-8f0e714768fa tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.980235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abc0d674-c842-445f-a6a5-8f0e714768fa tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:45.981100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abc0d674-c842-445f-a6a5-8f0e714768fa tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:45.981546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abc0d674-c842-445f-a6a5-8f0e714768fa tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:46.040014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-abc0d674-c842-445f-a6a5-8f0e714768fa tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:12:46.058556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-df18e314-e0b3-4e52-aa5e-2f98eb59ed7b tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:46.067200 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-df18e314-e0b3-4e52-aa5e-2f98eb59ed7b tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1608 microversion: 2.1 time: 0.647211 Feb 19 21:12:46.079247 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2279/4646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:45 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1608 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:46.282523 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-abc0d674-c842-445f-a6a5-8f0e714768fa tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 204 len: 0 microversion: 2.47 time: 0.314866 Feb 19 21:12:46.283948 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2368/4647] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:12:45 2022] DELETE /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 19 21:12:46.291718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:46.292758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:46.300012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:46.312136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:46.313498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:46.314953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:46.336890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6d491f12-bc23-4122-bce1-0d07e0c813a0 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:46.337909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6d491f12-bc23-4122-bce1-0d07e0c813a0 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:46.356238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d491f12-bc23-4122-bce1-0d07e0c813a0 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:46.358336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d491f12-bc23-4122-bce1-0d07e0c813a0 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:46.360351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d491f12-bc23-4122-bce1-0d07e0c813a0 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:46.361300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d491f12-bc23-4122-bce1-0d07e0c813a0 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:46.719965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:46.759129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:46.769008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:46.774164 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f4c9b48-0a88-4ceb-b76b-6590c4a9ec0a tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1363 microversion: 2.47 time: 0.485318 Feb 19 21:12:46.779078 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2280/4648] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:46 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1363 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:47.125884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6d491f12-bc23-4122-bce1-0d07e0c813a0 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:47.139544 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6d491f12-bc23-4122-bce1-0d07e0c813a0 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1477 microversion: 2.1 time: 0.806851 Feb 19 21:12:47.140725 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2369/4649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:46 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1477 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:12:47.703555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-aa238d91-e1da-48c3-abb5-6c3cb6e6af03 req-c8b022a4-1f6d-46d1-85b6-852ed7a1ac90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016a5d8a-93e3-4e79-843c-332e7c910a78", "name": "network-vif-deleted", "tag": "792bb0c5-b976-4078-a9fa-692ece7d2d12"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:47.706860 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:47.706860 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:12:47.752825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-aa238d91-e1da-48c3-abb5-6c3cb6e6af03 req-c8b022a4-1f6d-46d1-85b6-852ed7a1ac90 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:47.754007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-aa238d91-e1da-48c3-abb5-6c3cb6e6af03 req-c8b022a4-1f6d-46d1-85b6-852ed7a1ac90 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:47.795026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:47.795792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:47.807982 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-aa238d91-e1da-48c3-abb5-6c3cb6e6af03 req-c8b022a4-1f6d-46d1-85b6-852ed7a1ac90 service nova] Creating event network-vif-deleted:792bb0c5-b976-4078-a9fa-692ece7d2d12 for instance 016a5d8a-93e3-4e79-843c-332e7c910a78 on nch2-master-1 Feb 19 21:12:47.817096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:47.822203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:47.822661 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-aa238d91-e1da-48c3-abb5-6c3cb6e6af03 req-c8b022a4-1f6d-46d1-85b6-852ed7a1ac90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122348 Feb 19 21:12:47.824356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:47.826963 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2281/4650] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:47.827447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:48.044784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:48.056312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:48.063232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:48.065978 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f6b1df6-a790-4eee-a63c-1adf39860729 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1363 microversion: 2.47 time: 0.274180 Feb 19 21:12:48.079529 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2370/4651] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:47 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:48.160969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:48.161989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:48.174292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:48.174747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:48.178579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:48.179063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:48.252278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:48.252775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:48.253238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lazy-loading 'fault' on Instance uuid 016a5d8a-93e3-4e79-843c-332e7c910a78 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:12:48.343248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:48.354878 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-76e92967-f51f-448a-aab0-863489132b16 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 200 len: 1331 microversion: 2.1 time: 0.198493 Feb 19 21:12:48.356174 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2282/4652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:48 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 1331 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:12:49.087401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:49.089147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:49.102343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:49.103080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:49.104402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:49.106542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:49.178280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:49.179618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:49.180364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lazy-loading 'fault' on Instance uuid 9a308bbd-d895-4947-80d9-087e746ade19 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:12:49.266744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:49.274949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:49.276816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:49.278243 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5781a40c-fda1-4fec-9511-f8bc52a85487 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 200 len: 1368 microversion: 2.47 time: 0.194874 Feb 19 21:12:49.279357 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2371/4653] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:49 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:49.381262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fcbfca49-dfe5-4b56-8668-72832438e600 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:49.382516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fcbfca49-dfe5-4b56-8668-72832438e600 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 016a5d8a-93e3-4e79-843c-332e7c910a78] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:49.391190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcbfca49-dfe5-4b56-8668-72832438e600 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:49.391822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcbfca49-dfe5-4b56-8668-72832438e600 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:49.393058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcbfca49-dfe5-4b56-8668-72832438e600 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:49.393671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fcbfca49-dfe5-4b56-8668-72832438e600 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:49.432323 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-fcbfca49-dfe5-4b56-8668-72832438e600 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] HTTP exception thrown: Instance 016a5d8a-93e3-4e79-843c-332e7c910a78 could not be found. Feb 19 21:12:49.433117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fcbfca49-dfe5-4b56-8668-72832438e600 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Returning 404 to user: Instance 016a5d8a-93e3-4e79-843c-332e7c910a78 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:12:49.434556 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fcbfca49-dfe5-4b56-8668-72832438e600 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78" status: 404 len: 111 microversion: 2.1 time: 0.058667 Feb 19 21:12:49.450695 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2283/4654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:12:49 2022] GET /compute/v2.1/servers/016a5d8a-93e3-4e79-843c-332e7c910a78 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:12:50.123164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9151e044-1344-466f-a4c6-605fa4de5f46 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:50.124283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9151e044-1344-466f-a4c6-605fa4de5f46 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:50.132664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9151e044-1344-466f-a4c6-605fa4de5f46 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.143906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9151e044-1344-466f-a4c6-605fa4de5f46 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:50.148272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9151e044-1344-466f-a4c6-605fa4de5f46 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.150443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9151e044-1344-466f-a4c6-605fa4de5f46 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:50.187029 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-9151e044-1344-466f-a4c6-605fa4de5f46 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] HTTP exception thrown: Instance d857117a-ec86-4b8f-ba54-6e01374d484b could not be found. Feb 19 21:12:50.187856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9151e044-1344-466f-a4c6-605fa4de5f46 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Returning 404 to user: Instance d857117a-ec86-4b8f-ba54-6e01374d484b could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:12:50.189215 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9151e044-1344-466f-a4c6-605fa4de5f46 tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 404 len: 111 microversion: 2.32 time: 0.069510 Feb 19 21:12:50.190270 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2372/4655] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:12:50 2022] DELETE /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:12:50.199819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d62db03d-0bc8-4bd2-959b-f84b2d8a3baf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:50.200886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d62db03d-0bc8-4bd2-959b-f84b2d8a3baf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] [instance: d857117a-ec86-4b8f-ba54-6e01374d484b] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:50.208662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d62db03d-0bc8-4bd2-959b-f84b2d8a3baf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.209398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d62db03d-0bc8-4bd2-959b-f84b2d8a3baf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:50.210513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d62db03d-0bc8-4bd2-959b-f84b2d8a3baf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.211136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d62db03d-0bc8-4bd2-959b-f84b2d8a3baf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:50.232309 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-d62db03d-0bc8-4bd2-959b-f84b2d8a3baf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] HTTP exception thrown: Instance d857117a-ec86-4b8f-ba54-6e01374d484b could not be found. Feb 19 21:12:50.233512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d62db03d-0bc8-4bd2-959b-f84b2d8a3baf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] Returning 404 to user: Instance d857117a-ec86-4b8f-ba54-6e01374d484b could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:12:50.235670 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d62db03d-0bc8-4bd2-959b-f84b2d8a3baf tempest-TaggedBootDevicesTest-1240914161 tempest-TaggedBootDevicesTest-1240914161-project] 10.222.0.30 "GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b" status: 404 len: 111 microversion: 2.32 time: 0.040544 Feb 19 21:12:50.242178 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2284/4656] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:50 2022] GET /compute/v2.1/servers/d857117a-ec86-4b8f-ba54-6e01374d484b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:12:50.301545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0c3795a-b0cc-40d4-af0c-e7ab5dbdea21 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:50.303073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d0c3795a-b0cc-40d4-af0c-e7ab5dbdea21 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: 9a308bbd-d895-4947-80d9-087e746ade19] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:50.315948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0c3795a-b0cc-40d4-af0c-e7ab5dbdea21 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.316762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0c3795a-b0cc-40d4-af0c-e7ab5dbdea21 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:50.318530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0c3795a-b0cc-40d4-af0c-e7ab5dbdea21 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.319625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0c3795a-b0cc-40d4-af0c-e7ab5dbdea21 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:50.341990 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-d0c3795a-b0cc-40d4-af0c-e7ab5dbdea21 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] HTTP exception thrown: Instance 9a308bbd-d895-4947-80d9-087e746ade19 could not be found. Feb 19 21:12:50.342651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0c3795a-b0cc-40d4-af0c-e7ab5dbdea21 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Returning 404 to user: Instance 9a308bbd-d895-4947-80d9-087e746ade19 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:12:50.349028 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d0c3795a-b0cc-40d4-af0c-e7ab5dbdea21 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19" status: 404 len: 111 microversion: 2.47 time: 0.054803 Feb 19 21:12:50.352101 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2373/4657] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:50 2022] GET /compute/v2.1/servers/9a308bbd-d895-4947-80d9-087e746ade19 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:12:50.358163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-846efad2-351d-4a5b-b34f-34e0e79b7b4e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:50.358686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-846efad2-351d-4a5b-b34f-34e0e79b7b4e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: bd182d79-55da-4df0-a293-742e79cd21ec] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:50.375981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846efad2-351d-4a5b-b34f-34e0e79b7b4e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.376629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846efad2-351d-4a5b-b34f-34e0e79b7b4e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:50.386709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846efad2-351d-4a5b-b34f-34e0e79b7b4e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.387913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-846efad2-351d-4a5b-b34f-34e0e79b7b4e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:50.453154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-846efad2-351d-4a5b-b34f-34e0e79b7b4e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: bd182d79-55da-4df0-a293-742e79cd21ec] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:12:50.598335 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-846efad2-351d-4a5b-b34f-34e0e79b7b4e tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec" status: 204 len: 0 microversion: 2.47 time: 0.242290 Feb 19 21:12:50.600689 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2285/4658] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:12:50 2022] DELETE /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:12:50.618363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:50.629557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: bd182d79-55da-4df0-a293-742e79cd21ec] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:50.652869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.653461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:50.656502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:50.657199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:51.145022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:51.168385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:51.172611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:51.179661 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-855ed881-7500-4903-8d9c-03ebbda7e503 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec" status: 200 len: 1361 microversion: 2.47 time: 0.574542 Feb 19 21:12:51.183624 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2374/4659] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:50 2022] GET /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:52.136456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e58b2d59-6296-47c6-a3ae-5ceeb964d2f0 req-ee80f43d-14f1-4402-a7a4-fa19a5d9e530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "452de813-e220-4db1-8f6c-6d03d6b88559", "tag": "fd590ea4-9502-47f9-a804-41b8d37bcda0"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:52.138619 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:12:52.138619 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:12:52.166582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e58b2d59-6296-47c6-a3ae-5ceeb964d2f0 req-ee80f43d-14f1-4402-a7a4-fa19a5d9e530 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:52.167033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e58b2d59-6296-47c6-a3ae-5ceeb964d2f0 req-ee80f43d-14f1-4402-a7a4-fa19a5d9e530 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:52.200180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:52.200856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: bd182d79-55da-4df0-a293-742e79cd21ec] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:52.205334 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e58b2d59-6296-47c6-a3ae-5ceeb964d2f0 req-ee80f43d-14f1-4402-a7a4-fa19a5d9e530 service nova] Creating event network-changed:fd590ea4-9502-47f9-a804-41b8d37bcda0 for instance 452de813-e220-4db1-8f6c-6d03d6b88559 on nch2-master-1 Feb 19 21:12:52.213449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:52.213935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:52.214734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:52.215243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:52.220011 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e58b2d59-6296-47c6-a3ae-5ceeb964d2f0 req-ee80f43d-14f1-4402-a7a4-fa19a5d9e530 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081007 Feb 19 21:12:52.238648 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2286/4660] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:52.364413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:52.381049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:52.386715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cab2d6ba2dfb4adfa951ce21075a3b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ce8f5b3827425fa697e340178b84c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:12:52.394151 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-58143226-7198-4e5b-a90c-fadb5fd1a200 tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec" status: 200 len: 1361 microversion: 2.47 time: 0.198445 Feb 19 21:12:52.395339 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2375/4661] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:52 2022] GET /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:12:53.415374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-314bc9d0-3df1-4fef-8375-c07136828e2f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:53.416072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-314bc9d0-3df1-4fef-8375-c07136828e2f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] [instance: bd182d79-55da-4df0-a293-742e79cd21ec] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:53.431179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-314bc9d0-3df1-4fef-8375-c07136828e2f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:53.431992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-314bc9d0-3df1-4fef-8375-c07136828e2f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:53.433415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-314bc9d0-3df1-4fef-8375-c07136828e2f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:53.434008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-314bc9d0-3df1-4fef-8375-c07136828e2f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:53.471365 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-314bc9d0-3df1-4fef-8375-c07136828e2f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] HTTP exception thrown: Instance bd182d79-55da-4df0-a293-742e79cd21ec could not be found. Feb 19 21:12:53.471980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-314bc9d0-3df1-4fef-8375-c07136828e2f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] Returning 404 to user: Instance bd182d79-55da-4df0-a293-742e79cd21ec could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:12:53.472977 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-314bc9d0-3df1-4fef-8375-c07136828e2f tempest-ServerShowV247Test-2114390429 tempest-ServerShowV247Test-2114390429-project] 10.222.0.30 "GET /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec" status: 404 len: 111 microversion: 2.47 time: 0.062451 Feb 19 21:12:53.473466 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2287/4662] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:12:53 2022] GET /compute/v2.1/servers/bd182d79-55da-4df0-a293-742e79cd21ec => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:12:56.256119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96ad061f-e55f-4d2a-957c-89baecc9cf83 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:56.259902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-96ad061f-e55f-4d2a-957c-89baecc9cf83 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:56.271228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96ad061f-e55f-4d2a-957c-89baecc9cf83 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:56.272081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96ad061f-e55f-4d2a-957c-89baecc9cf83 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:56.273286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96ad061f-e55f-4d2a-957c-89baecc9cf83 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:56.274481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96ad061f-e55f-4d2a-957c-89baecc9cf83 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:56.312151 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96ad061f-e55f-4d2a-957c-89baecc9cf83 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/0f3bd27c-8a13-48ab-a47f-0f43117dfdf2" status: 200 len: 194 microversion: 2.1 time: 0.065419 Feb 19 21:12:56.326236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:56.327405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:56.334129 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2376/4663] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Feb 19 21:12:56 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/0f3bd27c-8a13-48ab-a47f-0f43117dfdf2 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:56.337939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:56.338694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:56.339696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:56.340706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:56.529600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lazy-loading 'services' on Instance uuid 39379933-a0d4-41b1-a9ba-ced8e7b82b4f {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:12:56.684316 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-72b0c6fe-ad9f-4f2f-a7bf-2a39dc129319 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/0f3bd27c-8a13-48ab-a47f-0f43117dfdf2" status: 202 len: 0 microversion: 2.1 time: 0.361707 Feb 19 21:12:56.684994 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2288/4664] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:12:56 2022] DELETE /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/0f3bd27c-8a13-48ab-a47f-0f43117dfdf2 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:12:57.820832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9fadd429-0e19-4e36-b19f-504a2c4d1ec1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:57.821397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9fadd429-0e19-4e36-b19f-504a2c4d1ec1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:57.828347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fadd429-0e19-4e36-b19f-504a2c4d1ec1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:57.828877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fadd429-0e19-4e36-b19f-504a2c4d1ec1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:57.829698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fadd429-0e19-4e36-b19f-504a2c4d1ec1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:57.830199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9fadd429-0e19-4e36-b19f-504a2c4d1ec1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:57.865147 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9fadd429-0e19-4e36-b19f-504a2c4d1ec1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/9cee237d-58ba-4236-9933-9466b75876a7" status: 200 len: 194 microversion: 2.1 time: 0.048262 Feb 19 21:12:57.866342 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2377/4665] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Feb 19 21:12:57 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/9cee237d-58ba-4236-9933-9466b75876a7 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:12:57.878933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:57.880210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:57.889699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:57.890150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:57.890946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:57.891380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:57.991112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lazy-loading 'services' on Instance uuid 39379933-a0d4-41b1-a9ba-ced8e7b82b4f {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:12:58.095128 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fba6f35e-d2e5-49d4-8d53-f12d8b71b604 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/9cee237d-58ba-4236-9933-9466b75876a7" status: 202 len: 0 microversion: 2.1 time: 0.222306 Feb 19 21:12:58.096664 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2289/4666] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:12:57 2022] DELETE /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments/9cee237d-58ba-4236-9933-9466b75876a7 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:12:58.950191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-68607326", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "d3b5c251-7e40-4705-8f65-349582f371c6"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:12:59.044591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] validate_networks() for [('d3b5c251-7e40-4705-8f65-349582f371c6', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:12:59.477498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c82269c5-ba3c-4d62-b4ae-66e6507d4145 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:59.479400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c82269c5-ba3c-4d62-b4ae-66e6507d4145 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:59.497630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c82269c5-ba3c-4d62-b4ae-66e6507d4145 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:59.498255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c82269c5-ba3c-4d62-b4ae-66e6507d4145 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:59.499481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c82269c5-ba3c-4d62-b4ae-66e6507d4145 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:59.500745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c82269c5-ba3c-4d62-b4ae-66e6507d4145 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:59.558892 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c82269c5-ba3c-4d62-b4ae-66e6507d4145 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103899 Feb 19 21:12:59.560182 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2290/4667] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:12:59 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 21:12:59.712809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4d650982-3cbc-47b3-9470-3c3fd642f57c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:59.713818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4d650982-3cbc-47b3-9470-3c3fd642f57c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:59.730688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d650982-3cbc-47b3-9470-3c3fd642f57c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:59.731227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d650982-3cbc-47b3-9470-3c3fd642f57c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:59.738645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d650982-3cbc-47b3-9470-3c3fd642f57c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:59.740111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d650982-3cbc-47b3-9470-3c3fd642f57c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:59.838220 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4d650982-3cbc-47b3-9470-3c3fd642f57c tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134391 Feb 19 21:12:59.838831 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2291/4668] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:12:59 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 21:12:59.942511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f704575-4eaa-40c8-8657-4935cf0de58a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:12:59.947587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f704575-4eaa-40c8-8657-4935cf0de58a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:12:59.968695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f704575-4eaa-40c8-8657-4935cf0de58a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:59.980130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f704575-4eaa-40c8-8657-4935cf0de58a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:12:59.981557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f704575-4eaa-40c8-8657-4935cf0de58a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:12:59.982310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f704575-4eaa-40c8-8657-4935cf0de58a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:00.012926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f704575-4eaa-40c8-8657-4935cf0de58a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:13:00.054223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:13:00.055243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:13:00.056295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:13:00.056295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:13:00.056621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:13:00.071600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:00.072054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:00.074364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:00.075026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:00.105111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:13:00.113970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:13:00.139356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:13:00.143287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:13:00.151902 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8f704575-4eaa-40c8-8657-4935cf0de58a tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 204 len: 0 microversion: 2.1 time: 0.216297 Feb 19 21:13:00.152941 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2292/4669] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:12:59 2022] DELETE /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:13:00.172212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2876401f-1551-4611-aeb8-19b121c66045 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:00.176865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2876401f-1551-4611-aeb8-19b121c66045 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:00.184661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2876401f-1551-4611-aeb8-19b121c66045 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:00.185398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2876401f-1551-4611-aeb8-19b121c66045 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:00.186407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2876401f-1551-4611-aeb8-19b121c66045 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:00.187046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2876401f-1551-4611-aeb8-19b121c66045 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:00.212857 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9ac798f6-db08-49df-a0f2-9a560ee528be tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431501 Feb 19 21:13:00.219493 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2378/4670] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:13:00.224572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7fa35046-fa54-463c-b2a3-515de6cc50f4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:00.225199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7fa35046-fa54-463c-b2a3-515de6cc50f4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:00.373292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7fa35046-fa54-463c-b2a3-515de6cc50f4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:00.389883 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7fa35046-fa54-463c-b2a3-515de6cc50f4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1191 microversion: 2.1 time: 0.164179 Feb 19 21:13:00.390558 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2379/4671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:00 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1191 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:00.704306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2876401f-1551-4611-aeb8-19b121c66045 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:00.714156 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2876401f-1551-4611-aeb8-19b121c66045 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1676 microversion: 2.1 time: 0.552409 Feb 19 21:13:00.731245 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2293/4672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:00 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1676 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:01.406924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d2d2f207-8574-48ee-9c48-2aa7bc0593dc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:01.407689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d2d2f207-8574-48ee-9c48-2aa7bc0593dc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:01.426226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2d2f207-8574-48ee-9c48-2aa7bc0593dc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:01.427376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2d2f207-8574-48ee-9c48-2aa7bc0593dc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:01.428685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2d2f207-8574-48ee-9c48-2aa7bc0593dc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:01.429299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2d2f207-8574-48ee-9c48-2aa7bc0593dc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:01.596474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d2d2f207-8574-48ee-9c48-2aa7bc0593dc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:01.604164 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d2d2f207-8574-48ee-9c48-2aa7bc0593dc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1243 microversion: 2.1 time: 0.200935 Feb 19 21:13:01.623491 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2380/4673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:01 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1243 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:01.734982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9165c320-466e-4b11-8b58-724fd36fa436 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:01.735606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9165c320-466e-4b11-8b58-724fd36fa436 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:01.742727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9165c320-466e-4b11-8b58-724fd36fa436 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:01.753104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9165c320-466e-4b11-8b58-724fd36fa436 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:01.753997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9165c320-466e-4b11-8b58-724fd36fa436 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:01.754436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9165c320-466e-4b11-8b58-724fd36fa436 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:02.365807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9165c320-466e-4b11-8b58-724fd36fa436 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:02.373632 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9165c320-466e-4b11-8b58-724fd36fa436 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1676 microversion: 2.1 time: 0.645141 Feb 19 21:13:02.374232 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2294/4674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:01 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1676 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:02.631178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a41072e-a690-46e7-baa3-364de37b8c17 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:02.632546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a41072e-a690-46e7-baa3-364de37b8c17 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:02.647143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a41072e-a690-46e7-baa3-364de37b8c17 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:02.647893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a41072e-a690-46e7-baa3-364de37b8c17 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:02.650595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a41072e-a690-46e7-baa3-364de37b8c17 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:02.651977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a41072e-a690-46e7-baa3-364de37b8c17 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:02.671591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bd9eb158-f04b-41ef-914c-107ba29ff37b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:02.674117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bd9eb158-f04b-41ef-914c-107ba29ff37b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:02.696382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd9eb158-f04b-41ef-914c-107ba29ff37b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:02.701406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd9eb158-f04b-41ef-914c-107ba29ff37b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:02.702547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd9eb158-f04b-41ef-914c-107ba29ff37b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:02.703222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bd9eb158-f04b-41ef-914c-107ba29ff37b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:02.760929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bd9eb158-f04b-41ef-914c-107ba29ff37b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:13:02.872922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a41072e-a690-46e7-baa3-364de37b8c17 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:02.887412 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bd9eb158-f04b-41ef-914c-107ba29ff37b tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 204 len: 0 microversion: 2.1 time: 0.219677 Feb 19 21:13:02.889457 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2295/4675] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:13:02 2022] DELETE /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:13:02.894520 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a41072e-a690-46e7-baa3-364de37b8c17 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1249 microversion: 2.1 time: 0.260261 Feb 19 21:13:02.898031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-47bd16d8-a83e-4387-9744-d22ecca1895d req-bb722783-d835-473a-94b9-49fb84ed2b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26035c7e-8e0f-48e4-bbef-0d0eae15c929", "tag": "9fef2353-c49f-4800-8469-da61cf4f519d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:02.898513 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2381/4676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:02 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1249 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:02.900717 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:02.900717 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:02.909873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-47bd16d8-a83e-4387-9744-d22ecca1895d req-bb722783-d835-473a-94b9-49fb84ed2b94 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:02.910732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-47bd16d8-a83e-4387-9744-d22ecca1895d req-bb722783-d835-473a-94b9-49fb84ed2b94 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:02.913944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f36c609-ab59-432d-9947-48198222fddf tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:02.922922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3f36c609-ab59-432d-9947-48198222fddf tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:02.927582 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-47bd16d8-a83e-4387-9744-d22ecca1895d req-bb722783-d835-473a-94b9-49fb84ed2b94 service nova] Creating event network-changed:9fef2353-c49f-4800-8469-da61cf4f519d for instance 26035c7e-8e0f-48e4-bbef-0d0eae15c929 on nch1-master-1 Feb 19 21:13:02.934030 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-47bd16d8-a83e-4387-9744-d22ecca1895d req-bb722783-d835-473a-94b9-49fb84ed2b94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042882 Feb 19 21:13:02.935166 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2296/4677] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:02.938457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f36c609-ab59-432d-9947-48198222fddf tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:02.939974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f36c609-ab59-432d-9947-48198222fddf tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:02.941093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f36c609-ab59-432d-9947-48198222fddf tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:02.941901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f36c609-ab59-432d-9947-48198222fddf tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:03.392822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9e77f641-34c1-4c6f-ac7a-302802174d1f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:03.393798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9e77f641-34c1-4c6f-ac7a-302802174d1f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:03.416215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e77f641-34c1-4c6f-ac7a-302802174d1f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:03.416971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e77f641-34c1-4c6f-ac7a-302802174d1f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:03.420249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e77f641-34c1-4c6f-ac7a-302802174d1f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:03.421210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e77f641-34c1-4c6f-ac7a-302802174d1f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:04.677086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3f36c609-ab59-432d-9947-48198222fddf tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:04.713753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f36c609-ab59-432d-9947-48198222fddf tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1769 microversion: 2.1 time: 1.812617 Feb 19 21:13:04.716916 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2382/4678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:02 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1769 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:04.721898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-796fc6f7-3769-4b83-a792-040a2995b0b6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:04.722797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-796fc6f7-3769-4b83-a792-040a2995b0b6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:04.740960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-796fc6f7-3769-4b83-a792-040a2995b0b6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:04.741777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-796fc6f7-3769-4b83-a792-040a2995b0b6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:04.742843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-796fc6f7-3769-4b83-a792-040a2995b0b6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:04.744796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-796fc6f7-3769-4b83-a792-040a2995b0b6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:04.807967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9e77f641-34c1-4c6f-ac7a-302802174d1f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:04.820596 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9e77f641-34c1-4c6f-ac7a-302802174d1f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1676 microversion: 2.1 time: 1.433290 Feb 19 21:13:04.825096 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2297/4679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:03 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1676 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:04.882069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-796fc6f7-3769-4b83-a792-040a2995b0b6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:04.900580 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-796fc6f7-3769-4b83-a792-040a2995b0b6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1249 microversion: 2.1 time: 0.180382 Feb 19 21:13:04.902510 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2383/4680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:04 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1249 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:05.740282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-44184372-11ef-4bfc-8012-cb2941059b4d tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:05.745323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-44184372-11ef-4bfc-8012-cb2941059b4d tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:05.757688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44184372-11ef-4bfc-8012-cb2941059b4d tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:05.758393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44184372-11ef-4bfc-8012-cb2941059b4d tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:05.759366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44184372-11ef-4bfc-8012-cb2941059b4d tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:05.760006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44184372-11ef-4bfc-8012-cb2941059b4d tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.014813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f00f34b-3075-436b-8525-5dddb38b9116 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159-project-admin] Calling method '.version_select at 0x7f6466f475e0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:06.015829 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:06.015829 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:06.017604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f00f34b-3075-436b-8525-5dddb38b9116 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:06.018068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f00f34b-3075-436b-8525-5dddb38b9116 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.036106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f00f34b-3075-436b-8525-5dddb38b9116 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:06.036911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f00f34b-3075-436b-8525-5dddb38b9116 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.068855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f00f34b-3075-436b-8525-5dddb38b9116 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:06.069880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f00f34b-3075-436b-8525-5dddb38b9116 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.078409 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f00f34b-3075-436b-8525-5dddb38b9116 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159 tempest-PortsAdminExtendedAttrsIpV6TestJSON-953557159-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.302096 Feb 19 21:13:06.084839 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2384/4681] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 21:13:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:06.093094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d32b9744-beee-452d-8a7e-df3de1751020 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:06.093995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d32b9744-beee-452d-8a7e-df3de1751020 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:06.102383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d32b9744-beee-452d-8a7e-df3de1751020 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:06.103124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d32b9744-beee-452d-8a7e-df3de1751020 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.105247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d32b9744-beee-452d-8a7e-df3de1751020 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:06.105780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d32b9744-beee-452d-8a7e-df3de1751020 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.310999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d32b9744-beee-452d-8a7e-df3de1751020 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:06.339060 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d32b9744-beee-452d-8a7e-df3de1751020 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1608 microversion: 2.1 time: 0.250301 Feb 19 21:13:06.339755 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2385/4682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:06 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1608 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:06.349376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bf8462ae-a131-4784-b058-80da2ce7ecc9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:06.350870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bf8462ae-a131-4784-b058-80da2ce7ecc9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:06.362308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf8462ae-a131-4784-b058-80da2ce7ecc9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:06.364494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf8462ae-a131-4784-b058-80da2ce7ecc9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.368954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf8462ae-a131-4784-b058-80da2ce7ecc9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:06.369603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bf8462ae-a131-4784-b058-80da2ce7ecc9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.676397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-44184372-11ef-4bfc-8012-cb2941059b4d tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e2bf42ef6446c69f1775a25ef76a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f4ed687e80941d9a5befe1031923ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:06.686521 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-44184372-11ef-4bfc-8012-cb2941059b4d tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 200 len: 1650 microversion: 2.1 time: 0.952384 Feb 19 21:13:06.690652 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2298/4683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:05 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 1650 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:06.705734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-84f46c9a-0445-46b2-a6d1-840ec8a02328 req-609d25b4-ee5c-48e2-8231-d0f58740f5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26035c7e-8e0f-48e4-bbef-0d0eae15c929", "name": "network-vif-deleted", "tag": "9fef2353-c49f-4800-8469-da61cf4f519d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:06.707312 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:06.707312 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:06.727243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-84f46c9a-0445-46b2-a6d1-840ec8a02328 req-609d25b4-ee5c-48e2-8231-d0f58740f5fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:06.727993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-84f46c9a-0445-46b2-a6d1-840ec8a02328 req-609d25b4-ee5c-48e2-8231-d0f58740f5fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.752433 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-84f46c9a-0445-46b2-a6d1-840ec8a02328 req-609d25b4-ee5c-48e2-8231-d0f58740f5fe service nova] Creating event network-vif-deleted:9fef2353-c49f-4800-8469-da61cf4f519d for instance 26035c7e-8e0f-48e4-bbef-0d0eae15c929 on nch1-master-1 Feb 19 21:13:06.758574 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-84f46c9a-0445-46b2-a6d1-840ec8a02328 req-609d25b4-ee5c-48e2-8231-d0f58740f5fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066243 Feb 19 21:13:06.759786 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2299/4684] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:06.853248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a84cc68a-b98b-45be-900a-42e54d58dbd6 req-d00227cb-b3c2-4b0e-ab54-f09494aa24b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39379933-a0d4-41b1-a9ba-ced8e7b82b4f", "name": "network-vif-deleted", "tag": "72c6a85b-be73-4cca-80b1-c2d505f4fabf"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:06.857409 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:06.857409 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:06.886809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a84cc68a-b98b-45be-900a-42e54d58dbd6 req-d00227cb-b3c2-4b0e-ab54-f09494aa24b9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:06.888780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a84cc68a-b98b-45be-900a-42e54d58dbd6 req-d00227cb-b3c2-4b0e-ab54-f09494aa24b9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:06.918507 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a84cc68a-b98b-45be-900a-42e54d58dbd6 req-d00227cb-b3c2-4b0e-ab54-f09494aa24b9 service nova] Creating event network-vif-deleted:72c6a85b-be73-4cca-80b1-c2d505f4fabf for instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f on nch2-master-1 Feb 19 21:13:06.925144 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a84cc68a-b98b-45be-900a-42e54d58dbd6 req-d00227cb-b3c2-4b0e-ab54-f09494aa24b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091186 Feb 19 21:13:06.926826 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2300/4685] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:07.026633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bf8462ae-a131-4784-b058-80da2ce7ecc9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:07.039000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bf8462ae-a131-4784-b058-80da2ce7ecc9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1291 microversion: 2.1 time: 0.695868 Feb 19 21:13:07.051191 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2386/4686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:06 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1291 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:07.363466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:07.364767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:07.375752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:07.376694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:07.377867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:07.378757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:07.467253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:07.469613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:07.472924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lazy-loading 'fault' on Instance uuid 39379933-a0d4-41b1-a9ba-ced8e7b82b4f {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:13:07.570352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7132cae4ebd549d491f5d0dcf83394ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecc012aca243138d03c189f5623f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:07.578057 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d0b27616-4599-4e47-8e6f-53613fb62be1 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 200 len: 1328 microversion: 2.1 time: 0.222273 Feb 19 21:13:07.579940 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2301/4687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:07 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 1328 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:07.715799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f6c114e-df2f-4475-8ec7-2813b905aa61 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:07.717519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f6c114e-df2f-4475-8ec7-2813b905aa61 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] [instance: 26035c7e-8e0f-48e4-bbef-0d0eae15c929] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:07.737636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f6c114e-df2f-4475-8ec7-2813b905aa61 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:07.739251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f6c114e-df2f-4475-8ec7-2813b905aa61 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:07.740613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f6c114e-df2f-4475-8ec7-2813b905aa61 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:07.742061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f6c114e-df2f-4475-8ec7-2813b905aa61 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:07.764951 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-5f6c114e-df2f-4475-8ec7-2813b905aa61 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] HTTP exception thrown: Instance 26035c7e-8e0f-48e4-bbef-0d0eae15c929 could not be found. Feb 19 21:13:07.766822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f6c114e-df2f-4475-8ec7-2813b905aa61 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Returning 404 to user: Instance 26035c7e-8e0f-48e4-bbef-0d0eae15c929 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:07.769456 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f6c114e-df2f-4475-8ec7-2813b905aa61 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929" status: 404 len: 111 microversion: 2.1 time: 0.062454 Feb 19 21:13:07.770281 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2387/4688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:07 2022] GET /compute/v2.1/servers/26035c7e-8e0f-48e4-bbef-0d0eae15c929 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:13:08.061396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e41a6147-000d-4646-8884-39d79e31427f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:08.062644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e41a6147-000d-4646-8884-39d79e31427f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:08.077800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e41a6147-000d-4646-8884-39d79e31427f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:08.078527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e41a6147-000d-4646-8884-39d79e31427f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:08.080314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e41a6147-000d-4646-8884-39d79e31427f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:08.081359 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e41a6147-000d-4646-8884-39d79e31427f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:08.597488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-619c3ff6-c5b0-4d21-8293-4652cb8d55d7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:08.598789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-619c3ff6-c5b0-4d21-8293-4652cb8d55d7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:08.607883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-619c3ff6-c5b0-4d21-8293-4652cb8d55d7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:08.609320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-619c3ff6-c5b0-4d21-8293-4652cb8d55d7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:08.611590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-619c3ff6-c5b0-4d21-8293-4652cb8d55d7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:08.612855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-619c3ff6-c5b0-4d21-8293-4652cb8d55d7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:08.635985 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-619c3ff6-c5b0-4d21-8293-4652cb8d55d7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] HTTP exception thrown: Instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f could not be found. Feb 19 21:13:08.636615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-619c3ff6-c5b0-4d21-8293-4652cb8d55d7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Returning 404 to user: Instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:08.637454 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-619c3ff6-c5b0-4d21-8293-4652cb8d55d7 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 404 len: 111 microversion: 2.1 time: 0.044918 Feb 19 21:13:08.638368 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2388/4689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:08 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:13:08.647309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9ba5772f-5b51-4dbd-9ac1-613e3dbea783 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '.version_select at 0x7f64670a6c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:08.685228 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9ba5772f-5b51-4dbd-9ac1-613e3dbea783 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162194394" status: 202 len: 0 microversion: 2.1 time: 0.035383 Feb 19 21:13:08.687121 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2389/4690] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Feb 19 21:13:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162194394 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:13:08.979400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-73f12246-c6bb-4eeb-9231-e698be3f9ecc req-8000b000-162b-40cf-9557-0a7e4a8a3d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b35b33f5-0976-42bb-a8af-ed5a596f08d5", "tag": "26602451-8ab7-4868-aff7-0faa278f42dc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:08.985765 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:08.985765 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:08.997598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-73f12246-c6bb-4eeb-9231-e698be3f9ecc req-8000b000-162b-40cf-9557-0a7e4a8a3d44 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:08.998421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-73f12246-c6bb-4eeb-9231-e698be3f9ecc req-8000b000-162b-40cf-9557-0a7e4a8a3d44 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:09.011992 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-73f12246-c6bb-4eeb-9231-e698be3f9ecc req-8000b000-162b-40cf-9557-0a7e4a8a3d44 service nova] Creating event network-changed:26602451-8ab7-4868-aff7-0faa278f42dc for instance b35b33f5-0976-42bb-a8af-ed5a596f08d5 on nch1-master-1 Feb 19 21:13:09.021482 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-73f12246-c6bb-4eeb-9231-e698be3f9ecc req-8000b000-162b-40cf-9557-0a7e4a8a3d44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045262 Feb 19 21:13:09.023477 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2390/4691] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:09.130244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e41a6147-000d-4646-8884-39d79e31427f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:09.140602 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e41a6147-000d-4646-8884-39d79e31427f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1291 microversion: 2.1 time: 1.086078 Feb 19 21:13:09.141209 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2302/4692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:08 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1291 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:10.160571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f377e8c-7cf4-42a2-9c75-288165aa81c3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:10.163340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f377e8c-7cf4-42a2-9c75-288165aa81c3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:10.179362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f377e8c-7cf4-42a2-9c75-288165aa81c3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:10.180164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f377e8c-7cf4-42a2-9c75-288165aa81c3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:10.181487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f377e8c-7cf4-42a2-9c75-288165aa81c3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:10.182294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f377e8c-7cf4-42a2-9c75-288165aa81c3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:10.702826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f377e8c-7cf4-42a2-9c75-288165aa81c3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:10.718508 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f377e8c-7cf4-42a2-9c75-288165aa81c3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1291 microversion: 2.1 time: 0.563349 Feb 19 21:13:10.719689 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2391/4693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:10 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1291 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:11.738027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ceee4e22-33e8-45d0-b704-c96241174602 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:11.739291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ceee4e22-33e8-45d0-b704-c96241174602 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:11.751667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceee4e22-33e8-45d0-b704-c96241174602 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:11.756435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceee4e22-33e8-45d0-b704-c96241174602 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:11.757803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceee4e22-33e8-45d0-b704-c96241174602 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:11.758407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceee4e22-33e8-45d0-b704-c96241174602 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:12.350227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ceee4e22-33e8-45d0-b704-c96241174602 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:12.363170 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ceee4e22-33e8-45d0-b704-c96241174602 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1291 microversion: 2.1 time: 0.630601 Feb 19 21:13:12.381178 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2303/4694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:11 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1291 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:13.389332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3789a33e-6328-4859-9ede-0e0c7106f2ea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:13.390648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3789a33e-6328-4859-9ede-0e0c7106f2ea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:13.399963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3789a33e-6328-4859-9ede-0e0c7106f2ea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:13.401716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3789a33e-6328-4859-9ede-0e0c7106f2ea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:13.402784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3789a33e-6328-4859-9ede-0e0c7106f2ea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:13.403441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3789a33e-6328-4859-9ede-0e0c7106f2ea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:13.831408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3789a33e-6328-4859-9ede-0e0c7106f2ea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:13.844230 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3789a33e-6328-4859-9ede-0e0c7106f2ea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1291 microversion: 2.1 time: 0.464946 Feb 19 21:13:13.851666 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2392/4695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:13 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1291 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:13.957827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0172227b-b43c-478e-8e1b-61111e8064e2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:13.958355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0172227b-b43c-478e-8e1b-61111e8064e2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:13.965381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0172227b-b43c-478e-8e1b-61111e8064e2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:13.965832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0172227b-b43c-478e-8e1b-61111e8064e2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:13.967448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0172227b-b43c-478e-8e1b-61111e8064e2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:13.968285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0172227b-b43c-478e-8e1b-61111e8064e2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:13.983821 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-0172227b-b43c-478e-8e1b-61111e8064e2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] HTTP exception thrown: Instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f could not be found. Feb 19 21:13:13.984463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0172227b-b43c-478e-8e1b-61111e8064e2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Returning 404 to user: Instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:13.985317 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0172227b-b43c-478e-8e1b-61111e8064e2 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 404 len: 111 microversion: 2.1 time: 0.032703 Feb 19 21:13:13.986078 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2304/4696] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:13:13 2022] DELETE /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:13:13.996781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-24122459-11c8-4e04-8f8e-789ff1548c85 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:13.997510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-24122459-11c8-4e04-8f8e-789ff1548c85 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: 39379933-a0d4-41b1-a9ba-ced8e7b82b4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:14.006926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24122459-11c8-4e04-8f8e-789ff1548c85 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:14.008605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24122459-11c8-4e04-8f8e-789ff1548c85 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:14.009671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24122459-11c8-4e04-8f8e-789ff1548c85 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:14.010590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24122459-11c8-4e04-8f8e-789ff1548c85 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:14.033396 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-24122459-11c8-4e04-8f8e-789ff1548c85 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] HTTP exception thrown: Instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f could not be found. Feb 19 21:13:14.034080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-24122459-11c8-4e04-8f8e-789ff1548c85 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Returning 404 to user: Instance 39379933-a0d4-41b1-a9ba-ced8e7b82b4f could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:14.034977 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-24122459-11c8-4e04-8f8e-789ff1548c85 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f" status: 404 len: 111 microversion: 2.1 time: 0.043359 Feb 19 21:13:14.035884 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2393/4697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:13 2022] GET /compute/v2.1/servers/39379933-a0d4-41b1-a9ba-ced8e7b82b4f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:13:14.868408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-817f987a-d9eb-4345-8289-2772a94f36da tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:14.872730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-817f987a-d9eb-4345-8289-2772a94f36da tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:14.894648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-817f987a-d9eb-4345-8289-2772a94f36da tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:14.895780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-817f987a-d9eb-4345-8289-2772a94f36da tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:14.896998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-817f987a-d9eb-4345-8289-2772a94f36da tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:14.897675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-817f987a-d9eb-4345-8289-2772a94f36da tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:15.030610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a88a8e10-34ab-4202-a6ac-25a7639d5c0f req-3f14a3c3-bd05-4bca-81ff-a68a6f47f916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35b33f5-0976-42bb-a8af-ed5a596f08d5", "name": "network-vif-plugged", "status": "completed", "tag": "26602451-8ab7-4868-aff7-0faa278f42dc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:15.033799 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:15.033799 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:15.047771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a88a8e10-34ab-4202-a6ac-25a7639d5c0f req-3f14a3c3-bd05-4bca-81ff-a68a6f47f916 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:15.056801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a88a8e10-34ab-4202-a6ac-25a7639d5c0f req-3f14a3c3-bd05-4bca-81ff-a68a6f47f916 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:15.099176 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a88a8e10-34ab-4202-a6ac-25a7639d5c0f req-3f14a3c3-bd05-4bca-81ff-a68a6f47f916 service nova] Creating event network-vif-plugged:26602451-8ab7-4868-aff7-0faa278f42dc for instance b35b33f5-0976-42bb-a8af-ed5a596f08d5 on nch1-master-1 Feb 19 21:13:15.109935 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a88a8e10-34ab-4202-a6ac-25a7639d5c0f req-3f14a3c3-bd05-4bca-81ff-a68a6f47f916 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082589 Feb 19 21:13:15.111684 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2394/4698] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Feb 19 21:13:15.241813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-86b33bc1-bc77-4589-bc6d-0c191c84860f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:15.242427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-86b33bc1-bc77-4589-bc6d-0c191c84860f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:15.254946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86b33bc1-bc77-4589-bc6d-0c191c84860f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:15.255439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86b33bc1-bc77-4589-bc6d-0c191c84860f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:15.260257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86b33bc1-bc77-4589-bc6d-0c191c84860f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:15.260787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-86b33bc1-bc77-4589-bc6d-0c191c84860f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:15.296734 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-86b33bc1-bc77-4589-bc6d-0c191c84860f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] HTTP exception thrown: Instance cc97c9dc-bc47-4884-b42e-fa373a918258 could not be found. Feb 19 21:13:15.299055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-86b33bc1-bc77-4589-bc6d-0c191c84860f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Returning 404 to user: Instance cc97c9dc-bc47-4884-b42e-fa373a918258 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:15.299925 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-86b33bc1-bc77-4589-bc6d-0c191c84860f tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 404 len: 111 microversion: 2.1 time: 0.063569 Feb 19 21:13:15.300582 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2395/4699] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:13:15 2022] DELETE /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:13:15.309169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-60e5c720-c95c-4d1e-87ac-d748ad90ca28 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:15.309779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-60e5c720-c95c-4d1e-87ac-d748ad90ca28 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] [instance: cc97c9dc-bc47-4884-b42e-fa373a918258] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:15.334881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60e5c720-c95c-4d1e-87ac-d748ad90ca28 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:15.335917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60e5c720-c95c-4d1e-87ac-d748ad90ca28 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:15.337309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60e5c720-c95c-4d1e-87ac-d748ad90ca28 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:15.337971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-60e5c720-c95c-4d1e-87ac-d748ad90ca28 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:15.365379 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-60e5c720-c95c-4d1e-87ac-d748ad90ca28 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] HTTP exception thrown: Instance cc97c9dc-bc47-4884-b42e-fa373a918258 could not be found. Feb 19 21:13:15.365772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-60e5c720-c95c-4d1e-87ac-d748ad90ca28 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] Returning 404 to user: Instance cc97c9dc-bc47-4884-b42e-fa373a918258 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:15.375104 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-60e5c720-c95c-4d1e-87ac-d748ad90ca28 tempest-AttachVolumeTestJSON-597381258 tempest-AttachVolumeTestJSON-597381258-project] 10.222.0.30 "GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258" status: 404 len: 111 microversion: 2.1 time: 0.063543 Feb 19 21:13:15.375104 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2396/4700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:15 2022] GET /compute/v2.1/servers/cc97c9dc-bc47-4884-b42e-fa373a918258 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:13:15.452978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-817f987a-d9eb-4345-8289-2772a94f36da tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:15.464867 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-817f987a-d9eb-4345-8289-2772a94f36da tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1291 microversion: 2.1 time: 0.599031 Feb 19 21:13:15.476637 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2305/4701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:14 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1291 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:16.484357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-45b78d26-9e92-49dd-ba69-7a625d86673e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:16.486186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-45b78d26-9e92-49dd-ba69-7a625d86673e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:16.495650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45b78d26-9e92-49dd-ba69-7a625d86673e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:16.496392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45b78d26-9e92-49dd-ba69-7a625d86673e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:16.497341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45b78d26-9e92-49dd-ba69-7a625d86673e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:16.497989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45b78d26-9e92-49dd-ba69-7a625d86673e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:16.769435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-45b78d26-9e92-49dd-ba69-7a625d86673e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:16.789391 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-45b78d26-9e92-49dd-ba69-7a625d86673e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1291 microversion: 2.1 time: 0.305532 Feb 19 21:13:16.790784 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2397/4702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:16 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1291 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:17.807096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-87a2a8ed-fd03-44e5-ab76-6119593e2a5f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:17.807716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-87a2a8ed-fd03-44e5-ab76-6119593e2a5f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:17.818734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87a2a8ed-fd03-44e5-ab76-6119593e2a5f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:17.819455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87a2a8ed-fd03-44e5-ab76-6119593e2a5f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:17.820753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87a2a8ed-fd03-44e5-ab76-6119593e2a5f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:17.821363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87a2a8ed-fd03-44e5-ab76-6119593e2a5f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:18.267641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-87a2a8ed-fd03-44e5-ab76-6119593e2a5f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:18.288005 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-87a2a8ed-fd03-44e5-ab76-6119593e2a5f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1472 microversion: 2.1 time: 0.483779 Feb 19 21:13:18.289454 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2306/4703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:17 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1472 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:18.443026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-845011528", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:18.501105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] validate_networks() for [('d3b5c251-7e40-4705-8f65-349582f371c6', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:13:18.788978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2e4d59a7-aaed-484a-8f76-e6d84fcaf366 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] Calling method '.version_select at 0x7f6467b41c10>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:18.809599 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2e4d59a7-aaed-484a-8f76-e6d84fcaf366 tempest-TestSecurityGroupsBasicOps-652266592 tempest-TestSecurityGroupsBasicOps-652266592-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-981519187" status: 202 len: 0 microversion: 2.1 time: 0.024083 Feb 19 21:13:18.810251 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2307/4704] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:13:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-981519187 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:13:19.479793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:13:19.480699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:13:19.481243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:13:19.482057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:13:19.483451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:13:19.506996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:19.507501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:19.526778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:19.527341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:19.582106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:13:19.596521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:13:19.624691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:13:19.632584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0cb08c52-954e-4d64-888c-710bfbccb2eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:13:19.746907 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bae9996a-028a-4433-b388-6c38d251f7f0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308876 Feb 19 21:13:19.750687 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2398/4705] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:13:19.762261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5c692e87-e932-4098-beca-322577d9233b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:19.763060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5c692e87-e932-4098-beca-322577d9233b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0cb08c52-954e-4d64-888c-710bfbccb2eb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:19.814350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5c692e87-e932-4098-beca-322577d9233b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0cb08c52-954e-4d64-888c-710bfbccb2eb] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:13:21.037358 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.compute.api [None req-5c692e87-e932-4098-beca-322577d9233b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0cb08c52-954e-4d64-888c-710bfbccb2eb] Instance Mapping does not exist while attempting local delete cleanup. Feb 19 21:13:21.038845 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5c692e87-e932-4098-beca-322577d9233b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0cb08c52-954e-4d64-888c-710bfbccb2eb" status: 204 len: 0 microversion: 2.1 time: 1.281317 Feb 19 21:13:21.042923 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2308/4706] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:13:19 2022] DELETE /compute/v2.1/servers/0cb08c52-954e-4d64-888c-710bfbccb2eb => generated 0 bytes in 1283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:13:21.049297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a265383f-494f-4f61-b5fd-809262cb8060 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:21.050658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a265383f-494f-4f61-b5fd-809262cb8060 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0cb08c52-954e-4d64-888c-710bfbccb2eb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:21.066748 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a265383f-494f-4f61-b5fd-809262cb8060 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 0cb08c52-954e-4d64-888c-710bfbccb2eb could not be found. Feb 19 21:13:21.068310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a265383f-494f-4f61-b5fd-809262cb8060 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 0cb08c52-954e-4d64-888c-710bfbccb2eb could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:21.069691 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a265383f-494f-4f61-b5fd-809262cb8060 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0cb08c52-954e-4d64-888c-710bfbccb2eb" status: 404 len: 111 microversion: 2.1 time: 0.025433 Feb 19 21:13:21.083220 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2399/4707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:21 2022] GET /compute/v2.1/servers/0cb08c52-954e-4d64-888c-710bfbccb2eb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:13:21.305168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2091493082", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "d3b5c251-7e40-4705-8f65-349582f371c6"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:21.421429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] validate_networks() for [('d3b5c251-7e40-4705-8f65-349582f371c6', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:13:23.153882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:13:23.154528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:13:23.155013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:13:23.155427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:13:23.155843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:13:23.174032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:23.174489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:23.183709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:23.184640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:23.250333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:13:23.270842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:13:23.295231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:13:23.299129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:13:23.383382 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-267c76cf-f39c-4fe3-bdef-c1bc09c66a9b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.085570 Feb 19 21:13:23.384754 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2309/4708] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:13:23.397041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98d8f073-e9f1-4268-98fd-d46a8d4e9856 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:23.398175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-98d8f073-e9f1-4268-98fd-d46a8d4e9856 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:23.692414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98d8f073-e9f1-4268-98fd-d46a8d4e9856 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:23.707694 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98d8f073-e9f1-4268-98fd-d46a8d4e9856 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1221 microversion: 2.1 time: 0.316905 Feb 19 21:13:23.711764 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2310/4709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:23 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1221 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:23.885490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1712608227", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "91a3dfa9-4535-458a-a281-34048815a558"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:23.993987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] validate_networks() for [('91a3dfa9-4535-458a-a281-34048815a558', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:13:24.725958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e27c8c65-c282-4392-b28e-98ab07eaa660 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:24.726636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e27c8c65-c282-4392-b28e-98ab07eaa660 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:24.746471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e27c8c65-c282-4392-b28e-98ab07eaa660 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:24.748798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e27c8c65-c282-4392-b28e-98ab07eaa660 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:24.749988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e27c8c65-c282-4392-b28e-98ab07eaa660 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:24.753894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e27c8c65-c282-4392-b28e-98ab07eaa660 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:24.979910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e27c8c65-c282-4392-b28e-98ab07eaa660 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:24.993177 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e27c8c65-c282-4392-b28e-98ab07eaa660 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1217 microversion: 2.1 time: 0.271397 Feb 19 21:13:24.996000 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2311/4710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:24 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1217 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:25.694412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:13:25.697601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:13:25.698323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:13:25.699165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:13:25.699604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:13:25.723890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:25.724989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:25.726535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:25.727229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:25.795215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Getting quotas for project 1c438bd56e19499a91a00c3757b6f9f0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:13:25.807135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Getting quotas for user 1d25416fd67e4dd08da5ed2408649327 and project 1c438bd56e19499a91a00c3757b6f9f0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:13:25.853980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Going to run 3 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:13:25.861997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:13:25.947661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 20fbf3c8-6c17-4667-9092-8d7221c23eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=43ab5b91-8dc1-4507-bec8-18ee6000acf7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:13:26.017854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d658af6e-e5e1-41d0-baad-6e0fc353c574 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:26.020070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d658af6e-e5e1-41d0-baad-6e0fc353c574 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:26.025150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=20fbf3c8-6c17-4667-9092-8d7221c23eaa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:13:26.031923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d658af6e-e5e1-41d0-baad-6e0fc353c574 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:26.033453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d658af6e-e5e1-41d0-baad-6e0fc353c574 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:26.034750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d658af6e-e5e1-41d0-baad-6e0fc353c574 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:26.035474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d658af6e-e5e1-41d0-baad-6e0fc353c574 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:26.164414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d658af6e-e5e1-41d0-baad-6e0fc353c574 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:26.183240 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d658af6e-e5e1-41d0-baad-6e0fc353c574 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1279 microversion: 2.1 time: 0.171623 Feb 19 21:13:26.184557 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2312/4711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:26 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:26.206987 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-98f02364-7f4c-40c2-ad9c-181ddfe7f287 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.876459 Feb 19 21:13:26.208249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2400/4712] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:13:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:13:26.218267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40c90a81-0181-441d-a8b4-423f9c3c358a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:26.222592 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:26.222592 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:26.228536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40c90a81-0181-441d-a8b4-423f9c3c358a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:26.236767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-40c90a81-0181-441d-a8b4-423f9c3c358a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Searching by: {'deleted': False, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:13:26.263409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40c90a81-0181-441d-a8b4-423f9c3c358a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:26.264082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40c90a81-0181-441d-a8b4-423f9c3c358a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:26.265130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40c90a81-0181-441d-a8b4-423f9c3c358a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:26.265734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40c90a81-0181-441d-a8b4-423f9c3c358a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:26.297900 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-40c90a81-0181-441d-a8b4-423f9c3c358a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.083449 Feb 19 21:13:26.310723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-146f6200-cbf1-485c-a4c0-d74a8d4f5a3b tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:26.311416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-146f6200-cbf1-485c-a4c0-d74a8d4f5a3b tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:26.317283 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2313/4713] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 21:13:26 2022] GET /compute/v2.1/servers => generated 1018 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:26.385432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-146f6200-cbf1-485c-a4c0-d74a8d4f5a3b tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:26.397343 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-146f6200-cbf1-485c-a4c0-d74a8d4f5a3b tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1223 microversion: 2.1 time: 0.090663 Feb 19 21:13:26.397947 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2401/4714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:26 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:27.201574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5f79b23f-4bd5-494b-af2a-2df14ed702ee tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:27.203516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5f79b23f-4bd5-494b-af2a-2df14ed702ee tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:27.219239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f79b23f-4bd5-494b-af2a-2df14ed702ee tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:27.219999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f79b23f-4bd5-494b-af2a-2df14ed702ee tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:27.221022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f79b23f-4bd5-494b-af2a-2df14ed702ee tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:27.221712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f79b23f-4bd5-494b-af2a-2df14ed702ee tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:27.415298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a19d79be-31c2-47b9-809a-386a513beb9a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:27.416879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a19d79be-31c2-47b9-809a-386a513beb9a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:27.740554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a19d79be-31c2-47b9-809a-386a513beb9a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:27.754057 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a19d79be-31c2-47b9-809a-386a513beb9a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1223 microversion: 2.1 time: 0.342910 Feb 19 21:13:27.755521 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2402/4715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:27 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1223 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:27.969625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5f79b23f-4bd5-494b-af2a-2df14ed702ee tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:27.985028 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5f79b23f-4bd5-494b-af2a-2df14ed702ee tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1321 microversion: 2.1 time: 0.786857 Feb 19 21:13:27.989401 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2314/4716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:27 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1321 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:28.616664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8a8f7d9e-0b13-4f2c-af1f-bc4b9ead4d80 req-31c4555a-7729-4f7a-8626-2d956a869915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0543e742-9e7b-4aed-8cc3-fe6c6dc22212", "tag": "47b3f659-f115-4731-b8ae-0ab87f1dffdb"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:28.620197 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:28.620197 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:28.645092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8a8f7d9e-0b13-4f2c-af1f-bc4b9ead4d80 req-31c4555a-7729-4f7a-8626-2d956a869915 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:28.646850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8a8f7d9e-0b13-4f2c-af1f-bc4b9ead4d80 req-31c4555a-7729-4f7a-8626-2d956a869915 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:28.663608 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8a8f7d9e-0b13-4f2c-af1f-bc4b9ead4d80 req-31c4555a-7729-4f7a-8626-2d956a869915 service nova] Creating event network-changed:47b3f659-f115-4731-b8ae-0ab87f1dffdb for instance 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 on nch2-master-1 Feb 19 21:13:28.679218 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8a8f7d9e-0b13-4f2c-af1f-bc4b9ead4d80 req-31c4555a-7729-4f7a-8626-2d956a869915 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067111 Feb 19 21:13:28.680922 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2403/4717] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:13:28.774300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2894e4e6-f83d-435c-8b20-ff0114216ba4 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:28.779326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2894e4e6-f83d-435c-8b20-ff0114216ba4 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:28.798866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2894e4e6-f83d-435c-8b20-ff0114216ba4 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:28.799382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2894e4e6-f83d-435c-8b20-ff0114216ba4 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:28.800249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2894e4e6-f83d-435c-8b20-ff0114216ba4 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:28.800728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2894e4e6-f83d-435c-8b20-ff0114216ba4 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:29.005326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f6373e0-f12a-4ad2-9176-69c90bbab56a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:29.006344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f6373e0-f12a-4ad2-9176-69c90bbab56a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:29.020420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f6373e0-f12a-4ad2-9176-69c90bbab56a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:29.023183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f6373e0-f12a-4ad2-9176-69c90bbab56a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:29.026134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f6373e0-f12a-4ad2-9176-69c90bbab56a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:29.027788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f6373e0-f12a-4ad2-9176-69c90bbab56a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:29.029082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2894e4e6-f83d-435c-8b20-ff0114216ba4 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:29.041725 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2894e4e6-f83d-435c-8b20-ff0114216ba4 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1283 microversion: 2.1 time: 0.273795 Feb 19 21:13:29.059309 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2315/4718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:28 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1283 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:29.491844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1302000173", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "5dcb556e-7200-41f7-af8e-4f52d2bfd4af"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:29.575055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] validate_networks() for [('5dcb556e-7200-41f7-af8e-4f52d2bfd4af', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:13:30.061517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f6373e0-f12a-4ad2-9176-69c90bbab56a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:30.083087 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f6373e0-f12a-4ad2-9176-69c90bbab56a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1321 microversion: 2.1 time: 1.084036 Feb 19 21:13:30.096438 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2404/4719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:28 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1321 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:30.101354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8f003862-6a22-4cd1-85b0-c9b18abba8dd tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:30.102381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8f003862-6a22-4cd1-85b0-c9b18abba8dd tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:30.109500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f003862-6a22-4cd1-85b0-c9b18abba8dd tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:30.112958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f003862-6a22-4cd1-85b0-c9b18abba8dd tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:30.113995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f003862-6a22-4cd1-85b0-c9b18abba8dd tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:30.114642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f003862-6a22-4cd1-85b0-c9b18abba8dd tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:30.280841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8f003862-6a22-4cd1-85b0-c9b18abba8dd tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:30.290436 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8f003862-6a22-4cd1-85b0-c9b18abba8dd tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1281 microversion: 2.1 time: 0.192564 Feb 19 21:13:30.291782 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2405/4720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:30 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:30.642423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:13:30.643450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:13:30.644255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:13:30.644962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:13:30.645482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:13:30.656724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:30.658714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:30.659827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:30.660481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:30.679260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Getting quotas for project 9f7a8678732a40b383cedd20600e102e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:13:30.695382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Getting quotas for user 5e825e0ef42743238263e6758e53e28c and project 9f7a8678732a40b383cedd20600e102e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:13:30.715613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:13:30.718686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:13:30.806007 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cfadfe6a-0f89-4ad9-9115-6b49c82289f9 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544128 Feb 19 21:13:30.807765 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2316/4721] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:13:30.825388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e121e357-1780-41c8-b646-df00efe4d55c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:30.826359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e121e357-1780-41c8-b646-df00efe4d55c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:30.946768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e121e357-1780-41c8-b646-df00efe4d55c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:30.963331 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e121e357-1780-41c8-b646-df00efe4d55c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1218 microversion: 2.1 time: 0.147300 Feb 19 21:13:30.964561 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2406/4722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:30 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:31.104620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e35c0f84-3b3a-4f85-9053-cb899fdb220b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:31.105991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e35c0f84-3b3a-4f85-9053-cb899fdb220b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:31.118806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e35c0f84-3b3a-4f85-9053-cb899fdb220b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:31.120504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e35c0f84-3b3a-4f85-9053-cb899fdb220b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:31.122193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e35c0f84-3b3a-4f85-9053-cb899fdb220b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:31.123015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e35c0f84-3b3a-4f85-9053-cb899fdb220b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:31.320294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c9627a7a-2131-4a91-90c2-97056d888f62 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:31.322221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c9627a7a-2131-4a91-90c2-97056d888f62 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:31.333090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9627a7a-2131-4a91-90c2-97056d888f62 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:31.334243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9627a7a-2131-4a91-90c2-97056d888f62 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:31.335743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9627a7a-2131-4a91-90c2-97056d888f62 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:31.336813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c9627a7a-2131-4a91-90c2-97056d888f62 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:31.855564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e35c0f84-3b3a-4f85-9053-cb899fdb220b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:31.871419 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e35c0f84-3b3a-4f85-9053-cb899fdb220b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1321 microversion: 2.1 time: 0.771373 Feb 19 21:13:31.874555 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2317/4723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:31 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1321 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:31.956997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c9627a7a-2131-4a91-90c2-97056d888f62 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:31.969864 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c9627a7a-2131-4a91-90c2-97056d888f62 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1323 microversion: 2.1 time: 0.663586 Feb 19 21:13:31.971253 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2407/4724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:31 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1323 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:31.986401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a2176ac-84f4-464b-9be4-20f68e049052 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:31.987334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a2176ac-84f4-464b-9be4-20f68e049052 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:31.993690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a2176ac-84f4-464b-9be4-20f68e049052 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:31.994391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a2176ac-84f4-464b-9be4-20f68e049052 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:31.995356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a2176ac-84f4-464b-9be4-20f68e049052 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:31.995956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a2176ac-84f4-464b-9be4-20f68e049052 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:32.137242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5a2176ac-84f4-464b-9be4-20f68e049052 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:32.151352 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5a2176ac-84f4-464b-9be4-20f68e049052 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1270 microversion: 2.1 time: 0.167533 Feb 19 21:13:32.153410 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2318/4725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:31 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:32.890897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bff2a12d-37e8-4cdd-bf66-17e5cc4ca31f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:32.892250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bff2a12d-37e8-4cdd-bf66-17e5cc4ca31f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:32.899571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bff2a12d-37e8-4cdd-bf66-17e5cc4ca31f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:32.900416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bff2a12d-37e8-4cdd-bf66-17e5cc4ca31f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:32.901454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bff2a12d-37e8-4cdd-bf66-17e5cc4ca31f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:32.901995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bff2a12d-37e8-4cdd-bf66-17e5cc4ca31f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:32.995057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e2e4f99f-b11e-44e9-8091-180d8b40734f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:32.997807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e2e4f99f-b11e-44e9-8091-180d8b40734f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:33.009559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2e4f99f-b11e-44e9-8091-180d8b40734f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:33.010489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2e4f99f-b11e-44e9-8091-180d8b40734f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:33.011542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2e4f99f-b11e-44e9-8091-180d8b40734f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:33.012310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e2e4f99f-b11e-44e9-8091-180d8b40734f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:33.826099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bff2a12d-37e8-4cdd-bf66-17e5cc4ca31f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:33.844193 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bff2a12d-37e8-4cdd-bf66-17e5cc4ca31f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1321 microversion: 2.1 time: 0.956843 Feb 19 21:13:33.845140 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2408/4726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:32 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1321 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:33.868311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87231e86-5374-4793-afce-ee60acf04a26 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:33.869345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-87231e86-5374-4793-afce-ee60acf04a26 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:33.882499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87231e86-5374-4793-afce-ee60acf04a26 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:33.883412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87231e86-5374-4793-afce-ee60acf04a26 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:33.884784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87231e86-5374-4793-afce-ee60acf04a26 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:33.885453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87231e86-5374-4793-afce-ee60acf04a26 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:34.223529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e2e4f99f-b11e-44e9-8091-180d8b40734f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:34.246277 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e2e4f99f-b11e-44e9-8091-180d8b40734f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1323 microversion: 2.1 time: 1.259807 Feb 19 21:13:34.246906 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2319/4727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:32 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1323 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:34.264728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-3d65a81d-8ebf-4b2a-a92e-a8511c4b7bad req-bf0eed88-06c0-41dc-88e0-5592cb70210b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20fbf3c8-6c17-4667-9092-8d7221c23eaa", "tag": "356ca7b7-90a9-48f4-a800-3ae550ebde56"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:34.274128 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:34.274128 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:34.288948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3d65a81d-8ebf-4b2a-a92e-a8511c4b7bad req-bf0eed88-06c0-41dc-88e0-5592cb70210b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:34.298632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3d65a81d-8ebf-4b2a-a92e-a8511c4b7bad req-bf0eed88-06c0-41dc-88e0-5592cb70210b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:34.333857 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3d65a81d-8ebf-4b2a-a92e-a8511c4b7bad req-bf0eed88-06c0-41dc-88e0-5592cb70210b service nova] Creating event network-changed:356ca7b7-90a9-48f4-a800-3ae550ebde56 for instance 20fbf3c8-6c17-4667-9092-8d7221c23eaa on nch1-master-1 Feb 19 21:13:34.346902 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-3d65a81d-8ebf-4b2a-a92e-a8511c4b7bad req-bf0eed88-06c0-41dc-88e0-5592cb70210b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095822 Feb 19 21:13:34.348205 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2320/4728] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:34.444364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-87231e86-5374-4793-afce-ee60acf04a26 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:34.455068 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-87231e86-5374-4793-afce-ee60acf04a26 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1318 microversion: 2.1 time: 0.608676 Feb 19 21:13:34.462796 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2409/4729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:33 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:34.756114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-7334b4b4-1939-4568-b474-77f83075422c req-d82514bc-9737-4bb1-a73d-583b17a94eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1336813f-479c-48e1-adee-30fce72af1ba", "tag": "3405bd1c-c5f9-4a4b-b087-90cfc9728cab"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:34.760857 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:34.760857 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:34.787580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7334b4b4-1939-4568-b474-77f83075422c req-d82514bc-9737-4bb1-a73d-583b17a94eb1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:34.789696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7334b4b4-1939-4568-b474-77f83075422c req-d82514bc-9737-4bb1-a73d-583b17a94eb1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:34.829581 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-7334b4b4-1939-4568-b474-77f83075422c req-d82514bc-9737-4bb1-a73d-583b17a94eb1 service nova] Creating event network-changed:3405bd1c-c5f9-4a4b-b087-90cfc9728cab for instance 1336813f-479c-48e1-adee-30fce72af1ba on nch2-master-1 Feb 19 21:13:34.835480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-7334b4b4-1939-4568-b474-77f83075422c req-d82514bc-9737-4bb1-a73d-583b17a94eb1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086463 Feb 19 21:13:34.836394 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2321/4730] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:34.864050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2708f1ff-60fb-42c5-9d11-30b7c956e00b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:34.864997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2708f1ff-60fb-42c5-9d11-30b7c956e00b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:34.883413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2708f1ff-60fb-42c5-9d11-30b7c956e00b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:34.884148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2708f1ff-60fb-42c5-9d11-30b7c956e00b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:34.885149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2708f1ff-60fb-42c5-9d11-30b7c956e00b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:34.885986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2708f1ff-60fb-42c5-9d11-30b7c956e00b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:35.264950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4d8cbeb5-88c8-4555-9a0a-915395084fdc tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:35.266950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4d8cbeb5-88c8-4555-9a0a-915395084fdc tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:35.274803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d8cbeb5-88c8-4555-9a0a-915395084fdc tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:35.275528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d8cbeb5-88c8-4555-9a0a-915395084fdc tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:35.276570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d8cbeb5-88c8-4555-9a0a-915395084fdc tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:35.277176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d8cbeb5-88c8-4555-9a0a-915395084fdc tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:35.419187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2708f1ff-60fb-42c5-9d11-30b7c956e00b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:35.432090 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2708f1ff-60fb-42c5-9d11-30b7c956e00b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1321 microversion: 2.1 time: 0.572519 Feb 19 21:13:35.446989 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2410/4731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:34 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:35.478284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1052df3e-5fd6-4301-a22a-26bc28742e52 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:35.479103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1052df3e-5fd6-4301-a22a-26bc28742e52 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:35.489536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1052df3e-5fd6-4301-a22a-26bc28742e52 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:35.490372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1052df3e-5fd6-4301-a22a-26bc28742e52 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:35.491400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1052df3e-5fd6-4301-a22a-26bc28742e52 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:35.492000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1052df3e-5fd6-4301-a22a-26bc28742e52 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:35.942553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4d8cbeb5-88c8-4555-9a0a-915395084fdc tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:35.954069 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4d8cbeb5-88c8-4555-9a0a-915395084fdc tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1323 microversion: 2.1 time: 0.693358 Feb 19 21:13:35.955307 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2322/4732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:35 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1323 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:36.243096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1052df3e-5fd6-4301-a22a-26bc28742e52 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:36.261315 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1052df3e-5fd6-4301-a22a-26bc28742e52 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1318 microversion: 2.1 time: 0.792485 Feb 19 21:13:36.271564 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2411/4733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:35 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1318 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:36.397545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-cb459bc6-96ce-41f5-8a2a-7a5108670455 req-0a724212-10a0-42af-a337-d7986dca77e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0543e742-9e7b-4aed-8cc3-fe6c6dc22212", "name": "network-vif-plugged", "status": "completed", "tag": "47b3f659-f115-4731-b8ae-0ab87f1dffdb"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:36.400272 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:36.400272 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:36.411418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cb459bc6-96ce-41f5-8a2a-7a5108670455 req-0a724212-10a0-42af-a337-d7986dca77e9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:36.412169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cb459bc6-96ce-41f5-8a2a-7a5108670455 req-0a724212-10a0-42af-a337-d7986dca77e9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:36.433063 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-cb459bc6-96ce-41f5-8a2a-7a5108670455 req-0a724212-10a0-42af-a337-d7986dca77e9 service nova] Creating event network-vif-plugged:47b3f659-f115-4731-b8ae-0ab87f1dffdb for instance 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 on nch2-master-1 Feb 19 21:13:36.443589 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-cb459bc6-96ce-41f5-8a2a-7a5108670455 req-0a724212-10a0-42af-a337-d7986dca77e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056135 Feb 19 21:13:36.445601 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2323/4734] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:36.453188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9002efb4-9c35-4eee-a1a5-013c7cc4ab22 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:36.455578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9002efb4-9c35-4eee-a1a5-013c7cc4ab22 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:36.491930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9002efb4-9c35-4eee-a1a5-013c7cc4ab22 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:36.492838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9002efb4-9c35-4eee-a1a5-013c7cc4ab22 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:36.494032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9002efb4-9c35-4eee-a1a5-013c7cc4ab22 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:36.494636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9002efb4-9c35-4eee-a1a5-013c7cc4ab22 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:36.951338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ff7dd3af-fb5e-4774-ae23-53ed19ce7e96 req-a5e4f92b-9d92-43fc-b3e5-2b2ee863c872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ab5b91-8dc1-4507-bec8-18ee6000acf7", "tag": "fdf459f0-54b4-43fd-9db6-b559c98f4c65"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:36.953204 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:36.953204 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:36.976873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ff7dd3af-fb5e-4774-ae23-53ed19ce7e96 req-a5e4f92b-9d92-43fc-b3e5-2b2ee863c872 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:36.977733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ff7dd3af-fb5e-4774-ae23-53ed19ce7e96 req-a5e4f92b-9d92-43fc-b3e5-2b2ee863c872 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:37.006199 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ff7dd3af-fb5e-4774-ae23-53ed19ce7e96 req-a5e4f92b-9d92-43fc-b3e5-2b2ee863c872 service nova] Creating event network-changed:fdf459f0-54b4-43fd-9db6-b559c98f4c65 for instance 43ab5b91-8dc1-4507-bec8-18ee6000acf7 on nch1-master-1 Feb 19 21:13:37.014847 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ff7dd3af-fb5e-4774-ae23-53ed19ce7e96 req-a5e4f92b-9d92-43fc-b3e5-2b2ee863c872 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069244 Feb 19 21:13:37.021018 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2324/4735] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:37.030060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d4d82af8-40f5-44e5-bd8a-ae3823a5040a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:37.030877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d4d82af8-40f5-44e5-bd8a-ae3823a5040a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:37.049129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4d82af8-40f5-44e5-bd8a-ae3823a5040a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:37.049591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4d82af8-40f5-44e5-bd8a-ae3823a5040a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:37.050407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4d82af8-40f5-44e5-bd8a-ae3823a5040a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:37.050856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4d82af8-40f5-44e5-bd8a-ae3823a5040a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:37.184860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9002efb4-9c35-4eee-a1a5-013c7cc4ab22 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:37.192959 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9002efb4-9c35-4eee-a1a5-013c7cc4ab22 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1321 microversion: 2.1 time: 0.745533 Feb 19 21:13:37.195539 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2412/4736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:36 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1321 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:37.280390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-65d56a2a-e85d-4de3-b4ba-575f62dc5c70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:37.281019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-65d56a2a-e85d-4de3-b4ba-575f62dc5c70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:37.288864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65d56a2a-e85d-4de3-b4ba-575f62dc5c70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:37.289313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65d56a2a-e85d-4de3-b4ba-575f62dc5c70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:37.290598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65d56a2a-e85d-4de3-b4ba-575f62dc5c70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:37.291239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65d56a2a-e85d-4de3-b4ba-575f62dc5c70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:37.643779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d4d82af8-40f5-44e5-bd8a-ae3823a5040a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:37.654699 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d4d82af8-40f5-44e5-bd8a-ae3823a5040a tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1323 microversion: 2.1 time: 0.632271 Feb 19 21:13:37.656969 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2325/4737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:37 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:37.899480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-65d56a2a-e85d-4de3-b4ba-575f62dc5c70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:37.916977 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-65d56a2a-e85d-4de3-b4ba-575f62dc5c70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1318 microversion: 2.1 time: 0.640824 Feb 19 21:13:37.919389 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2413/4738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:37 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:38.046552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4317c7e3-0cb5-45db-b74a-fe6a42a56896 req-11a19966-c604-497c-b9f5-74c1bfcd51cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb9bd42-4d71-472f-937f-5a5192838186", "tag": "4ffc28f0-49dd-404e-8b0d-b3e2f567d170"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:38.049957 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:38.049957 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:38.072252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4317c7e3-0cb5-45db-b74a-fe6a42a56896 req-11a19966-c604-497c-b9f5-74c1bfcd51cd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:38.073069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4317c7e3-0cb5-45db-b74a-fe6a42a56896 req-11a19966-c604-497c-b9f5-74c1bfcd51cd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:38.089818 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4317c7e3-0cb5-45db-b74a-fe6a42a56896 req-11a19966-c604-497c-b9f5-74c1bfcd51cd service nova] Creating event network-changed:4ffc28f0-49dd-404e-8b0d-b3e2f567d170 for instance 1fb9bd42-4d71-472f-937f-5a5192838186 on nch2-master-1 Feb 19 21:13:38.096170 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4317c7e3-0cb5-45db-b74a-fe6a42a56896 req-11a19966-c604-497c-b9f5-74c1bfcd51cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053375 Feb 19 21:13:38.097561 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2326/4739] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:38.210815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5c9f66e6-82a0-4997-8fee-ee28c906ea25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:38.211432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5c9f66e6-82a0-4997-8fee-ee28c906ea25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:38.228059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c9f66e6-82a0-4997-8fee-ee28c906ea25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:38.228551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c9f66e6-82a0-4997-8fee-ee28c906ea25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:38.229355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c9f66e6-82a0-4997-8fee-ee28c906ea25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:38.229799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c9f66e6-82a0-4997-8fee-ee28c906ea25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:38.675326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66419a8f-50c2-4352-8da3-2746207c2737 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:38.676033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-66419a8f-50c2-4352-8da3-2746207c2737 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:38.683969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66419a8f-50c2-4352-8da3-2746207c2737 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:38.689325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66419a8f-50c2-4352-8da3-2746207c2737 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:38.690379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66419a8f-50c2-4352-8da3-2746207c2737 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:38.690984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66419a8f-50c2-4352-8da3-2746207c2737 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:39.331509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5c9f66e6-82a0-4997-8fee-ee28c906ea25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:39.377153 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5c9f66e6-82a0-4997-8fee-ee28c906ea25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1321 microversion: 2.1 time: 1.164778 Feb 19 21:13:39.379211 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2414/4740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:38 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1321 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:39.392788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-66419a8f-50c2-4352-8da3-2746207c2737 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:39.394307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4911a194-51d1-4950-90d2-4a9c62c74b2b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:39.395172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4911a194-51d1-4950-90d2-4a9c62c74b2b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:39.403544 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-66419a8f-50c2-4352-8da3-2746207c2737 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1323 microversion: 2.1 time: 0.733181 Feb 19 21:13:39.413822 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2327/4741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:38 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1323 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:39.414226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4911a194-51d1-4950-90d2-4a9c62c74b2b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:39.414690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4911a194-51d1-4950-90d2-4a9c62c74b2b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:39.415664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4911a194-51d1-4950-90d2-4a9c62c74b2b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:39.416081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4911a194-51d1-4950-90d2-4a9c62c74b2b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:39.420722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-eb90fb92-920c-4b59-9389-0cea7f58b518 req-7ca25a23-fb10-4b9a-905f-6f521385ea3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20fbf3c8-6c17-4667-9092-8d7221c23eaa", "name": "network-vif-plugged", "status": "completed", "tag": "356ca7b7-90a9-48f4-a800-3ae550ebde56"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:39.422441 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:39.422441 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:39.430750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-eb90fb92-920c-4b59-9389-0cea7f58b518 req-7ca25a23-fb10-4b9a-905f-6f521385ea3d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:39.431515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-eb90fb92-920c-4b59-9389-0cea7f58b518 req-7ca25a23-fb10-4b9a-905f-6f521385ea3d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:39.446691 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-eb90fb92-920c-4b59-9389-0cea7f58b518 req-7ca25a23-fb10-4b9a-905f-6f521385ea3d service nova] Creating event network-vif-plugged:356ca7b7-90a9-48f4-a800-3ae550ebde56 for instance 20fbf3c8-6c17-4667-9092-8d7221c23eaa on nch1-master-1 Feb 19 21:13:39.452558 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-eb90fb92-920c-4b59-9389-0cea7f58b518 req-7ca25a23-fb10-4b9a-905f-6f521385ea3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036531 Feb 19 21:13:39.453631 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2328/4742] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:39.718653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4911a194-51d1-4950-90d2-4a9c62c74b2b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:39.733885 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4911a194-51d1-4950-90d2-4a9c62c74b2b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1318 microversion: 2.1 time: 0.352821 Feb 19 21:13:39.735166 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2415/4743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:39 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:40.396075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-836661b8-01c0-44dc-8759-653d3a2fc482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:40.397166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-836661b8-01c0-44dc-8759-653d3a2fc482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:40.406277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-836661b8-01c0-44dc-8759-653d3a2fc482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:40.407071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-836661b8-01c0-44dc-8759-653d3a2fc482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:40.408465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-836661b8-01c0-44dc-8759-653d3a2fc482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:40.408909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-836661b8-01c0-44dc-8759-653d3a2fc482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:40.421436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f00d6f8-ecee-4a14-a2bc-01bf7b08b926 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:40.423318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f00d6f8-ecee-4a14-a2bc-01bf7b08b926 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:40.434978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f00d6f8-ecee-4a14-a2bc-01bf7b08b926 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:40.435821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f00d6f8-ecee-4a14-a2bc-01bf7b08b926 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:40.436885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f00d6f8-ecee-4a14-a2bc-01bf7b08b926 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:40.437551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f00d6f8-ecee-4a14-a2bc-01bf7b08b926 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:40.863247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-836661b8-01c0-44dc-8759-653d3a2fc482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:40.890894 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-836661b8-01c0-44dc-8759-653d3a2fc482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1501 microversion: 2.1 time: 0.498213 Feb 19 21:13:40.892706 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2329/4744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:40 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1501 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:40.900168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c74294af-efdf-4bc5-9bf9-8c39f21405b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:40.901128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c74294af-efdf-4bc5-9bf9-8c39f21405b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:40.910249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c74294af-efdf-4bc5-9bf9-8c39f21405b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:40.910939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c74294af-efdf-4bc5-9bf9-8c39f21405b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:40.912875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c74294af-efdf-4bc5-9bf9-8c39f21405b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:40.913427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c74294af-efdf-4bc5-9bf9-8c39f21405b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:40.917886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f00d6f8-ecee-4a14-a2bc-01bf7b08b926 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:40.931936 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f00d6f8-ecee-4a14-a2bc-01bf7b08b926 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1323 microversion: 2.1 time: 0.511737 Feb 19 21:13:40.934381 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2416/4745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:40 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1323 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:40.949189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83f58fb0-4b08-40b4-828e-da1fbfb714aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:40.949815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83f58fb0-4b08-40b4-828e-da1fbfb714aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:40.965335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83f58fb0-4b08-40b4-828e-da1fbfb714aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:40.966113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83f58fb0-4b08-40b4-828e-da1fbfb714aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:40.967133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83f58fb0-4b08-40b4-828e-da1fbfb714aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:40.967735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83f58fb0-4b08-40b4-828e-da1fbfb714aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:41.282611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83f58fb0-4b08-40b4-828e-da1fbfb714aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:41.292306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c74294af-efdf-4bc5-9bf9-8c39f21405b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:41.294255 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83f58fb0-4b08-40b4-828e-da1fbfb714aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1501 microversion: 2.1 time: 0.358758 Feb 19 21:13:41.295064 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2417/4746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:40 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1501 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:41.312595 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c74294af-efdf-4bc5-9bf9-8c39f21405b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1318 microversion: 2.1 time: 0.417802 Feb 19 21:13:41.313654 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2330/4747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:40 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:41.314349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2fabdbbe-502f-41ec-abc0-262cddbb12c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:41.315801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2fabdbbe-502f-41ec-abc0-262cddbb12c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:41.322693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fabdbbe-502f-41ec-abc0-262cddbb12c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:41.323405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fabdbbe-502f-41ec-abc0-262cddbb12c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:41.324411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fabdbbe-502f-41ec-abc0-262cddbb12c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:41.325026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fabdbbe-502f-41ec-abc0-262cddbb12c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:41.362695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2fabdbbe-502f-41ec-abc0-262cddbb12c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:13:41.467014 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2fabdbbe-502f-41ec-abc0-262cddbb12c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 204 len: 0 microversion: 2.1 time: 0.157305 Feb 19 21:13:41.469016 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2418/4748] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:13:41 2022] DELETE /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:13:41.482396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a2f7bb4-89e0-476e-8809-c70857dde8aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:41.484086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a2f7bb4-89e0-476e-8809-c70857dde8aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:41.489937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ba25cf11-54d1-4b05-aebb-cca41946639e req-52290ae7-0429-4a48-ac89-5fc8cea7c2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ab5b91-8dc1-4507-bec8-18ee6000acf7", "name": "network-vif-plugged", "status": "completed", "tag": "fdf459f0-54b4-43fd-9db6-b559c98f4c65"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:41.494476 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:41.494476 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:41.495302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb4-89e0-476e-8809-c70857dde8aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:41.495959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb4-89e0-476e-8809-c70857dde8aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:41.497042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb4-89e0-476e-8809-c70857dde8aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:41.497651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb4-89e0-476e-8809-c70857dde8aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:41.508269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ba25cf11-54d1-4b05-aebb-cca41946639e req-52290ae7-0429-4a48-ac89-5fc8cea7c2df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:41.508743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ba25cf11-54d1-4b05-aebb-cca41946639e req-52290ae7-0429-4a48-ac89-5fc8cea7c2df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:41.538064 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ba25cf11-54d1-4b05-aebb-cca41946639e req-52290ae7-0429-4a48-ac89-5fc8cea7c2df service nova] Creating event network-vif-plugged:fdf459f0-54b4-43fd-9db6-b559c98f4c65 for instance 43ab5b91-8dc1-4507-bec8-18ee6000acf7 on nch1-master-1 Feb 19 21:13:41.546157 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ba25cf11-54d1-4b05-aebb-cca41946639e req-52290ae7-0429-4a48-ac89-5fc8cea7c2df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063993 Feb 19 21:13:41.548143 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2419/4749] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:41.804777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9a2f7bb4-89e0-476e-8809-c70857dde8aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:41.814608 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a2f7bb4-89e0-476e-8809-c70857dde8aa tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1507 microversion: 2.1 time: 0.338252 Feb 19 21:13:41.826934 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2331/4750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:41 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1507 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:41.952363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9339d0c9-8a6d-4fc4-9ed1-20af12cc372c tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:41.953362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9339d0c9-8a6d-4fc4-9ed1-20af12cc372c tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:41.961414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9339d0c9-8a6d-4fc4-9ed1-20af12cc372c tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:41.962431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9339d0c9-8a6d-4fc4-9ed1-20af12cc372c tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:41.963551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9339d0c9-8a6d-4fc4-9ed1-20af12cc372c tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:41.964844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9339d0c9-8a6d-4fc4-9ed1-20af12cc372c tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:42.255436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9339d0c9-8a6d-4fc4-9ed1-20af12cc372c tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:42.271020 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9339d0c9-8a6d-4fc4-9ed1-20af12cc372c tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1323 microversion: 2.1 time: 0.323082 Feb 19 21:13:42.272304 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2420/4751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:41 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:42.332279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e00c4532-b9bb-4487-87e1-361bf2eaf493 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:42.332886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e00c4532-b9bb-4487-87e1-361bf2eaf493 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:42.341328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e00c4532-b9bb-4487-87e1-361bf2eaf493 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:42.342239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e00c4532-b9bb-4487-87e1-361bf2eaf493 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:42.343224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e00c4532-b9bb-4487-87e1-361bf2eaf493 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:42.344133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e00c4532-b9bb-4487-87e1-361bf2eaf493 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:42.652940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e00c4532-b9bb-4487-87e1-361bf2eaf493 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:42.662217 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e00c4532-b9bb-4487-87e1-361bf2eaf493 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1318 microversion: 2.1 time: 0.334942 Feb 19 21:13:42.662918 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2332/4752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:42 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:42.832687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9836db77-4a15-43d2-9252-159f2b7c847a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:42.837392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9836db77-4a15-43d2-9252-159f2b7c847a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:42.849671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9836db77-4a15-43d2-9252-159f2b7c847a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:42.850113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9836db77-4a15-43d2-9252-159f2b7c847a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:42.857033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9836db77-4a15-43d2-9252-159f2b7c847a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:42.861359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9836db77-4a15-43d2-9252-159f2b7c847a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:43.289850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-813a4d38-5c9a-4f4d-b037-42db5d2b305f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:43.290505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-813a4d38-5c9a-4f4d-b037-42db5d2b305f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:43.301561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-813a4d38-5c9a-4f4d-b037-42db5d2b305f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:43.302222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-813a4d38-5c9a-4f4d-b037-42db5d2b305f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:43.303226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-813a4d38-5c9a-4f4d-b037-42db5d2b305f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:43.303840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-813a4d38-5c9a-4f4d-b037-42db5d2b305f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:43.871800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-813a4d38-5c9a-4f4d-b037-42db5d2b305f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:43.881128 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-813a4d38-5c9a-4f4d-b037-42db5d2b305f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1323 microversion: 2.1 time: 0.595963 Feb 19 21:13:43.881781 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2333/4753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:43 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1323 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:43.883499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9836db77-4a15-43d2-9252-159f2b7c847a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:43.896740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-624a0d35-c235-4fc3-90c6-e1a7b504b34e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:43.897618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-624a0d35-c235-4fc3-90c6-e1a7b504b34e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:43.903006 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9836db77-4a15-43d2-9252-159f2b7c847a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1507 microversion: 2.1 time: 1.073808 Feb 19 21:13:43.903604 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2421/4754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:42 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1507 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:43.904832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-624a0d35-c235-4fc3-90c6-e1a7b504b34e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:43.905496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-624a0d35-c235-4fc3-90c6-e1a7b504b34e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:43.906738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-624a0d35-c235-4fc3-90c6-e1a7b504b34e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:43.907899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-624a0d35-c235-4fc3-90c6-e1a7b504b34e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:43.919263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-606bcad7-e385-4271-83fa-b79ce7a735a8 req-c880954e-5576-4e7a-b265-1c8c407230d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1336813f-479c-48e1-adee-30fce72af1ba", "name": "network-vif-plugged", "status": "completed", "tag": "3405bd1c-c5f9-4a4b-b087-90cfc9728cab"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:43.921213 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:43.921213 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:43.930285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-606bcad7-e385-4271-83fa-b79ce7a735a8 req-c880954e-5576-4e7a-b265-1c8c407230d7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:43.931019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-606bcad7-e385-4271-83fa-b79ce7a735a8 req-c880954e-5576-4e7a-b265-1c8c407230d7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:43.944828 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-606bcad7-e385-4271-83fa-b79ce7a735a8 req-c880954e-5576-4e7a-b265-1c8c407230d7 service nova] Creating event network-vif-plugged:3405bd1c-c5f9-4a4b-b087-90cfc9728cab for instance 1336813f-479c-48e1-adee-30fce72af1ba on nch2-master-1 Feb 19 21:13:43.950547 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-606bcad7-e385-4271-83fa-b79ce7a735a8 req-c880954e-5576-4e7a-b265-1c8c407230d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041792 Feb 19 21:13:43.952421 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2422/4755] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:44.265353 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-624a0d35-c235-4fc3-90c6-e1a7b504b34e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:44.296109 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-624a0d35-c235-4fc3-90c6-e1a7b504b34e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1318 microversion: 2.1 time: 0.401231 Feb 19 21:13:44.305644 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2334/4756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:43 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:44.344097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-080c9a2d-b5cc-4108-abb0-359e25f1d7f5 req-ee0a2649-1949-485a-b87c-91da41d3d75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0543e742-9e7b-4aed-8cc3-fe6c6dc22212", "name": "network-vif-deleted", "tag": "47b3f659-f115-4731-b8ae-0ab87f1dffdb"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:44.346093 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:44.346093 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:44.358381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-080c9a2d-b5cc-4108-abb0-359e25f1d7f5 req-ee0a2649-1949-485a-b87c-91da41d3d75b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:44.359079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-080c9a2d-b5cc-4108-abb0-359e25f1d7f5 req-ee0a2649-1949-485a-b87c-91da41d3d75b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:44.374765 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-080c9a2d-b5cc-4108-abb0-359e25f1d7f5 req-ee0a2649-1949-485a-b87c-91da41d3d75b service nova] Creating event network-vif-deleted:47b3f659-f115-4731-b8ae-0ab87f1dffdb for instance 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 on nch2-master-1 Feb 19 21:13:44.381782 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-080c9a2d-b5cc-4108-abb0-359e25f1d7f5 req-ee0a2649-1949-485a-b87c-91da41d3d75b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043710 Feb 19 21:13:44.383107 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2423/4757] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:44.901941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5aed5dd7-6f45-4272-8238-970dc3fa6851 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:44.902763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5aed5dd7-6f45-4272-8238-970dc3fa6851 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:44.909874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5aed5dd7-6f45-4272-8238-970dc3fa6851 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:44.910552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5aed5dd7-6f45-4272-8238-970dc3fa6851 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:44.911409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5aed5dd7-6f45-4272-8238-970dc3fa6851 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:44.911915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5aed5dd7-6f45-4272-8238-970dc3fa6851 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:44.922158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:44.923588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:44.936173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:44.936815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:44.937625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:44.938087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:44.976002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:44.976533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:44.976990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lazy-loading 'fault' on Instance uuid 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:13:45.080809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:45.090064 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e1c7b42-f7ad-448b-b936-2aa2fa713e30 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 200 len: 1311 microversion: 2.1 time: 0.173913 Feb 19 21:13:45.090634 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2424/4758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:44 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:45.316156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e9c863b8-ecc1-458e-b8c2-6293780b060c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:45.316963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e9c863b8-ecc1-458e-b8c2-6293780b060c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:45.324130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9c863b8-ecc1-458e-b8c2-6293780b060c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:45.324615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9c863b8-ecc1-458e-b8c2-6293780b060c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:45.325412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9c863b8-ecc1-458e-b8c2-6293780b060c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:45.325853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e9c863b8-ecc1-458e-b8c2-6293780b060c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:45.358325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5aed5dd7-6f45-4272-8238-970dc3fa6851 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:45.370316 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5aed5dd7-6f45-4272-8238-970dc3fa6851 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1323 microversion: 2.1 time: 0.475540 Feb 19 21:13:45.371181 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2335/4759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:44 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:45.659317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e9c863b8-ecc1-458e-b8c2-6293780b060c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:45.667059 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e9c863b8-ecc1-458e-b8c2-6293780b060c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1318 microversion: 2.1 time: 0.354649 Feb 19 21:13:45.667636 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2425/4760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:45 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:45.971755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4a5a1c5a-d593-4c48-8749-d747e8b6f3dc req-b9d957d7-eb9c-4b04-832e-9adc6d5cdbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb9bd42-4d71-472f-937f-5a5192838186", "name": "network-vif-plugged", "status": "completed", "tag": "4ffc28f0-49dd-404e-8b0d-b3e2f567d170"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:45.974808 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:45.974808 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:45.986618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4a5a1c5a-d593-4c48-8749-d747e8b6f3dc req-b9d957d7-eb9c-4b04-832e-9adc6d5cdbf4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:45.987529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4a5a1c5a-d593-4c48-8749-d747e8b6f3dc req-b9d957d7-eb9c-4b04-832e-9adc6d5cdbf4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:46.003881 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4a5a1c5a-d593-4c48-8749-d747e8b6f3dc req-b9d957d7-eb9c-4b04-832e-9adc6d5cdbf4 service nova] Creating event network-vif-plugged:4ffc28f0-49dd-404e-8b0d-b3e2f567d170 for instance 1fb9bd42-4d71-472f-937f-5a5192838186 on nch2-master-1 Feb 19 21:13:46.009776 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4a5a1c5a-d593-4c48-8749-d747e8b6f3dc req-b9d957d7-eb9c-4b04-832e-9adc6d5cdbf4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045641 Feb 19 21:13:46.017355 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2336/4761] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:13:46.108451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1ae20622-7ebb-4792-ab94-1382af92a477 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:46.112980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1ae20622-7ebb-4792-ab94-1382af92a477 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:46.123236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ae20622-7ebb-4792-ab94-1382af92a477 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:46.123880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ae20622-7ebb-4792-ab94-1382af92a477 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:46.124906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ae20622-7ebb-4792-ab94-1382af92a477 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:46.125502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ae20622-7ebb-4792-ab94-1382af92a477 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:46.140564 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-1ae20622-7ebb-4792-ab94-1382af92a477 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 could not be found. Feb 19 21:13:46.141492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1ae20622-7ebb-4792-ab94-1382af92a477 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:46.142780 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1ae20622-7ebb-4792-ab94-1382af92a477 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 404 len: 111 microversion: 2.1 time: 0.039617 Feb 19 21:13:46.143639 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2426/4762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:46 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:13:46.154268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-81fee825-cdf8-4289-bc08-71bbfc8eeb92 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'create', calling method: .version_select at 0x7f6467b41ca0>, body: {"keypair": {"name": "tempest-key-1506752270"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:46.169117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-81fee825-cdf8-4289-bc08-71bbfc8eeb92 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:13:46.176434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-81fee825-cdf8-4289-bc08-71bbfc8eeb92 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:13:46.356505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-81fee825-cdf8-4289-bc08-71bbfc8eeb92 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:13:46.362062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-81fee825-cdf8-4289-bc08-71bbfc8eeb92 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:13:46.377186 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-81fee825-cdf8-4289-bc08-71bbfc8eeb92 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.226939 Feb 19 21:13:46.378172 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2337/4763] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:13:46 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:46.389435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eec1cde5-ffd7-45b6-8ae1-efdfe7ec84fa tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:46.389651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14f79b98-75b2-4488-93c3-483acd70b05d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '.version_select at 0x7f6466f629d0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:46.390180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eec1cde5-ffd7-45b6-8ae1-efdfe7ec84fa tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:46.393486 ncdv-master-1 devstack@n-api.service[136094]: WARNING oslo_db.sqlalchemy.utils [None req-14f79b98-75b2-4488-93c3-483acd70b05d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 19 21:13:46.398116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec1cde5-ffd7-45b6-8ae1-efdfe7ec84fa tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:46.398804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec1cde5-ffd7-45b6-8ae1-efdfe7ec84fa tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:46.399673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec1cde5-ffd7-45b6-8ae1-efdfe7ec84fa tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:46.399802 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14f79b98-75b2-4488-93c3-483acd70b05d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.014895 Feb 19 21:13:46.400109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec1cde5-ffd7-45b6-8ae1-efdfe7ec84fa tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:46.401100 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2427/4764] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Feb 19 21:13:46 2022] GET /compute/v2.1/os-keypairs => generated 545 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:13:46.548129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1038395547", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "key_name": "tempest-key-1506752270", "networks": [{"uuid": "d3b5c251-7e40-4705-8f65-349582f371c6"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:46.561474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eec1cde5-ffd7-45b6-8ae1-efdfe7ec84fa tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:46.569107 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eec1cde5-ffd7-45b6-8ae1-efdfe7ec84fa tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 200 len: 1516 microversion: 2.1 time: 0.184354 Feb 19 21:13:46.569920 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2338/4765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:46 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:46.586465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ec86ca88-9b06-41c2-9102-46920e875aab tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:46.587082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ec86ca88-9b06-41c2-9102-46920e875aab tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 20fbf3c8-6c17-4667-9092-8d7221c23eaa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:46.593539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec86ca88-9b06-41c2-9102-46920e875aab tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:46.593996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec86ca88-9b06-41c2-9102-46920e875aab tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:46.595626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec86ca88-9b06-41c2-9102-46920e875aab tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:46.596290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec86ca88-9b06-41c2-9102-46920e875aab tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:46.618807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] validate_networks() for [('d3b5c251-7e40-4705-8f65-349582f371c6', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:13:46.867440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ec86ca88-9b06-41c2-9102-46920e875aab tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:46.877064 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ec86ca88-9b06-41c2-9102-46920e875aab tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa" status: 200 len: 1516 microversion: 2.1 time: 0.293954 Feb 19 21:13:46.878005 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2339/4766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:46 2022] GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa => generated 1516 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:46.891799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-326d8064-8f16-42b2-89b0-309e5cf673c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:46.892678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-326d8064-8f16-42b2-89b0-309e5cf673c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:46.905302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-326d8064-8f16-42b2-89b0-309e5cf673c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:46.909907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-326d8064-8f16-42b2-89b0-309e5cf673c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:46.911325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-326d8064-8f16-42b2-89b0-309e5cf673c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:46.914315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-326d8064-8f16-42b2-89b0-309e5cf673c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:47.228871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:13:47.230047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:13:47.230804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:13:47.231421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:13:47.232045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:13:47.256308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:47.265835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:47.268966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:47.272313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:47.309530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:13:47.317617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-326d8064-8f16-42b2-89b0-309e5cf673c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:47.319417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:13:47.327679 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-326d8064-8f16-42b2-89b0-309e5cf673c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1318 microversion: 2.1 time: 0.448335 Feb 19 21:13:47.337154 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2340/4767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:46 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:47.350880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b244157-a084-42ec-b395-212c32cdd8ed tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:47.351514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b244157-a084-42ec-b395-212c32cdd8ed tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:47.354132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:13:47.357589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:13:47.363642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b244157-a084-42ec-b395-212c32cdd8ed tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:47.364103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b244157-a084-42ec-b395-212c32cdd8ed tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:47.365883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b244157-a084-42ec-b395-212c32cdd8ed tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:47.366345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b244157-a084-42ec-b395-212c32cdd8ed tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:47.420280 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-50d32a67-03bd-4e4c-8561-6214797898c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876374 Feb 19 21:13:47.424027 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2428/4768] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:13:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:13:47.433216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd84b9de-5066-4ec3-8be8-39ed3be7d2e5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:47.435030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cd84b9de-5066-4ec3-8be8-39ed3be7d2e5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:47.519547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cd84b9de-5066-4ec3-8be8-39ed3be7d2e5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:47.534480 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd84b9de-5066-4ec3-8be8-39ed3be7d2e5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1229 microversion: 2.1 time: 0.103740 Feb 19 21:13:47.538124 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2429/4769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:47 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:47.641924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b244157-a084-42ec-b395-212c32cdd8ed tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:47.651942 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b244157-a084-42ec-b395-212c32cdd8ed tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7" status: 200 len: 1516 microversion: 2.1 time: 0.313567 Feb 19 21:13:47.663603 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2341/4770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:47 2022] GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7 => generated 1516 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:47.669164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0d5c1915-c729-4353-aadd-438d68329c94 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:47.669663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0d5c1915-c729-4353-aadd-438d68329c94 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:47.678140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d5c1915-c729-4353-aadd-438d68329c94 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:47.678643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d5c1915-c729-4353-aadd-438d68329c94 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:47.679801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d5c1915-c729-4353-aadd-438d68329c94 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:47.680510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d5c1915-c729-4353-aadd-438d68329c94 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:47.717819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0d5c1915-c729-4353-aadd-438d68329c94 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:13:47.860651 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0d5c1915-c729-4353-aadd-438d68329c94 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "DELETE /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7" status: 204 len: 0 microversion: 2.1 time: 0.194227 Feb 19 21:13:47.862890 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2430/4771] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:13:47 2022] DELETE /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:13:47.871759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e6d08e4-d40a-430e-9768-afceb9872e20 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:47.872417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e6d08e4-d40a-430e-9768-afceb9872e20 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:47.887698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e6d08e4-d40a-430e-9768-afceb9872e20 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:47.888279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e6d08e4-d40a-430e-9768-afceb9872e20 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:47.889162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e6d08e4-d40a-430e-9768-afceb9872e20 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:47.889784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e6d08e4-d40a-430e-9768-afceb9872e20 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:48.124223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8e6d08e4-d40a-430e-9768-afceb9872e20 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:48.134918 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8e6d08e4-d40a-430e-9768-afceb9872e20 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7" status: 200 len: 1522 microversion: 2.1 time: 0.267713 Feb 19 21:13:48.135519 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2342/4772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:47 2022] GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:48.356109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-92500f8e-6f70-466a-97cb-eb1e4a46cb0b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:48.357495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-92500f8e-6f70-466a-97cb-eb1e4a46cb0b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:48.366070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92500f8e-6f70-466a-97cb-eb1e4a46cb0b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:48.366537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92500f8e-6f70-466a-97cb-eb1e4a46cb0b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:48.367638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92500f8e-6f70-466a-97cb-eb1e4a46cb0b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:48.368382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-92500f8e-6f70-466a-97cb-eb1e4a46cb0b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:48.556744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9597ac2c-ca90-4382-b1ea-b34f2e138465 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:48.557951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9597ac2c-ca90-4382-b1ea-b34f2e138465 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:48.570690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9597ac2c-ca90-4382-b1ea-b34f2e138465 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:48.574574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9597ac2c-ca90-4382-b1ea-b34f2e138465 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:48.575782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9597ac2c-ca90-4382-b1ea-b34f2e138465 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:48.576306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9597ac2c-ca90-4382-b1ea-b34f2e138465 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:48.683375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9597ac2c-ca90-4382-b1ea-b34f2e138465 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:48.691680 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9597ac2c-ca90-4382-b1ea-b34f2e138465 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1281 microversion: 2.1 time: 0.139790 Feb 19 21:13:48.695765 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2343/4773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:48 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:48.752879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-92500f8e-6f70-466a-97cb-eb1e4a46cb0b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:48.763474 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-92500f8e-6f70-466a-97cb-eb1e4a46cb0b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1507 microversion: 2.1 time: 0.412652 Feb 19 21:13:48.764414 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2431/4774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:48 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:49.154555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-86ea51c1-fd7e-4789-adf7-1f17dc5f2c28 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:49.155292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-86ea51c1-fd7e-4789-adf7-1f17dc5f2c28 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:49.162609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86ea51c1-fd7e-4789-adf7-1f17dc5f2c28 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:49.163582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86ea51c1-fd7e-4789-adf7-1f17dc5f2c28 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:49.164603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86ea51c1-fd7e-4789-adf7-1f17dc5f2c28 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:49.165203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86ea51c1-fd7e-4789-adf7-1f17dc5f2c28 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:49.709774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-64a6a5ad-63bb-4323-8718-21b5bb77a0a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:49.711158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-64a6a5ad-63bb-4323-8718-21b5bb77a0a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:49.723075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64a6a5ad-63bb-4323-8718-21b5bb77a0a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:49.723642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64a6a5ad-63bb-4323-8718-21b5bb77a0a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:49.728697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64a6a5ad-63bb-4323-8718-21b5bb77a0a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:49.729239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64a6a5ad-63bb-4323-8718-21b5bb77a0a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:49.803077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-86ea51c1-fd7e-4789-adf7-1f17dc5f2c28 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:49.820679 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-86ea51c1-fd7e-4789-adf7-1f17dc5f2c28 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7" status: 200 len: 1522 microversion: 2.1 time: 0.666559 Feb 19 21:13:49.821580 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2344/4775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:49 2022] GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7 => generated 1522 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:49.839751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-64a6a5ad-63bb-4323-8718-21b5bb77a0a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:49.856782 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-64a6a5ad-63bb-4323-8718-21b5bb77a0a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1287 microversion: 2.1 time: 0.142432 Feb 19 21:13:49.858041 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2432/4776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:49 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1287 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:50.387749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2565ac70-cb4c-41f8-acb2-71ebced09170 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "986bcdbd-6541-4e97-a01a-c58fbdba9f3c"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:50.389219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2565ac70-cb4c-41f8-acb2-71ebced09170 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:50.404662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2565ac70-cb4c-41f8-acb2-71ebced09170 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:50.405113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2565ac70-cb4c-41f8-acb2-71ebced09170 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:50.405906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2565ac70-cb4c-41f8-acb2-71ebced09170 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:50.407987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2565ac70-cb4c-41f8-acb2-71ebced09170 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:50.614807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-2b970574-9210-41ba-9e6f-5279ed976a02 req-043fad69-0d94-42e1-a939-f97a485a38ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ab5b91-8dc1-4507-bec8-18ee6000acf7", "name": "network-vif-deleted", "tag": "fdf459f0-54b4-43fd-9db6-b559c98f4c65"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:50.617021 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:50.617021 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:50.638020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2b970574-9210-41ba-9e6f-5279ed976a02 req-043fad69-0d94-42e1-a939-f97a485a38ad service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:50.638502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2b970574-9210-41ba-9e6f-5279ed976a02 req-043fad69-0d94-42e1-a939-f97a485a38ad service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:50.665486 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-2b970574-9210-41ba-9e6f-5279ed976a02 req-043fad69-0d94-42e1-a939-f97a485a38ad service nova] Creating event network-vif-deleted:fdf459f0-54b4-43fd-9db6-b559c98f4c65 for instance 43ab5b91-8dc1-4507-bec8-18ee6000acf7 on nch1-master-1 Feb 19 21:13:50.678280 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-2b970574-9210-41ba-9e6f-5279ed976a02 req-043fad69-0d94-42e1-a939-f97a485a38ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068041 Feb 19 21:13:50.679678 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2433/4777] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:50.839409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:50.841262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:50.856628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:50.857355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:50.858188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:50.858698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:50.921411 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2565ac70-cb4c-41f8-acb2-71ebced09170 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "POST /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.537224 Feb 19 21:13:50.930664 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2345/4778] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:13:50 2022] POST /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:50.943557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-22dde8f6-6c3c-474b-b6e7-dc000a6f1a1a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:50.946360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-22dde8f6-6c3c-474b-b6e7-dc000a6f1a1a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:50.961928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22dde8f6-6c3c-474b-b6e7-dc000a6f1a1a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:50.966974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22dde8f6-6c3c-474b-b6e7-dc000a6f1a1a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:50.968041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22dde8f6-6c3c-474b-b6e7-dc000a6f1a1a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:50.969122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:50.970030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22dde8f6-6c3c-474b-b6e7-dc000a6f1a1a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:50.970168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:50.972793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lazy-loading 'fault' on Instance uuid 43ab5b91-8dc1-4507-bec8-18ee6000acf7 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:13:51.133589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:51.154806 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-67f7a1c8-76f5-4a33-aa8c-8d1fea155683 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7" status: 200 len: 1313 microversion: 2.1 time: 0.319908 Feb 19 21:13:51.160038 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2434/4779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:50 2022] GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:51.679969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-22dde8f6-6c3c-474b-b6e7-dc000a6f1a1a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:51.691686 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-22dde8f6-6c3c-474b-b6e7-dc000a6f1a1a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.758388 Feb 19 21:13:51.694502 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2346/4780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:50 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:52.176627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a70c7b0-480f-4190-9508-2df5cdc47388 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.177284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a70c7b0-480f-4190-9508-2df5cdc47388 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:52.196020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a70c7b0-480f-4190-9508-2df5cdc47388 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.196541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a70c7b0-480f-4190-9508-2df5cdc47388 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.197359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a70c7b0-480f-4190-9508-2df5cdc47388 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.197790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a70c7b0-480f-4190-9508-2df5cdc47388 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.227902 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-7a70c7b0-480f-4190-9508-2df5cdc47388 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] HTTP exception thrown: Instance 43ab5b91-8dc1-4507-bec8-18ee6000acf7 could not be found. Feb 19 21:13:52.236602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a70c7b0-480f-4190-9508-2df5cdc47388 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Returning 404 to user: Instance 43ab5b91-8dc1-4507-bec8-18ee6000acf7 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:52.237679 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a70c7b0-480f-4190-9508-2df5cdc47388 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7" status: 404 len: 111 microversion: 2.1 time: 0.069053 Feb 19 21:13:52.238763 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2435/4781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:13:52.256872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1abd461e-77ae-40c8-bb0f-c5e24d542b2f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.263744 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:52.263744 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:52.272207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1abd461e-77ae-40c8-bb0f-c5e24d542b2f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:52.282538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1abd461e-77ae-40c8-bb0f-c5e24d542b2f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '1c438bd56e19499a91a00c3757b6f9f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:13:52.298188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1abd461e-77ae-40c8-bb0f-c5e24d542b2f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.301118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1abd461e-77ae-40c8-bb0f-c5e24d542b2f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.302263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1abd461e-77ae-40c8-bb0f-c5e24d542b2f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.303242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1abd461e-77ae-40c8-bb0f-c5e24d542b2f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.438282 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1abd461e-77ae-40c8-bb0f-c5e24d542b2f tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.188412 Feb 19 21:13:52.438785 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2347/4782] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:13:52.451674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9250d52c-04e3-46b5-9a31-f84525973c1b tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.453236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9250d52c-04e3-46b5-9a31-f84525973c1b tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:52.454883 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9250d52c-04e3-46b5-9a31-f84525973c1b tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.007581 Feb 19 21:13:52.455595 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2436/4783] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:13:52.471633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b97b9112-edfd-4619-9603-18c25feda6b6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.482799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b97b9112-edfd-4619-9603-18c25feda6b6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:52.486028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b97b9112-edfd-4619-9603-18c25feda6b6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Searching by: {'deleted': False, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:13:52.500785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b97b9112-edfd-4619-9603-18c25feda6b6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.502716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b97b9112-edfd-4619-9603-18c25feda6b6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.505388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b97b9112-edfd-4619-9603-18c25feda6b6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.506036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b97b9112-edfd-4619-9603-18c25feda6b6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.585341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-b97b9112-edfd-4619-9603-18c25feda6b6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:13:52.655970 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b97b9112-edfd-4619-9603-18c25feda6b6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.194802 Feb 19 21:13:52.657745 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2348/4784] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers => generated 683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:52.670690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.676198 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:52.676198 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:52.677696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:52.679186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.compute.servers [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Removing options 'limit' from query {{(pid=136094) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Feb 19 21:13:52.680801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Searching by: {'deleted': False, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:13:52.690784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.691150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.692253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.693449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.710636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5f14115d-b052-43cf-84a6-cd7a1d87703c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.711241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5f14115d-b052-43cf-84a6-cd7a1d87703c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:52.721755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f14115d-b052-43cf-84a6-cd7a1d87703c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.729591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f14115d-b052-43cf-84a6-cd7a1d87703c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.730568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f14115d-b052-43cf-84a6-cd7a1d87703c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.731024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f14115d-b052-43cf-84a6-cd7a1d87703c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.772262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.multi_cell_list [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=136094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:13:52.815664 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fd912234-c09c-44e4-a43a-2e6b8e82ee59 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.151535 Feb 19 21:13:52.817185 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2437/4785] 10.222.0.30 () {58 vars in 1143 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:52.827935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e1328368-edad-4a32-b956-d4906cb72490 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.829527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e1328368-edad-4a32-b956-d4906cb72490 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:52.830501 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e1328368-edad-4a32-b956-d4906cb72490 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.006116 Feb 19 21:13:52.835809 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2438/4786] 10.222.0.30 () {58 vars in 1141 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 19 21:13:52.840858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fcb2819c-489b-43b3-ac38-f176c4a81184 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.842324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fcb2819c-489b-43b3-ac38-f176c4a81184 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:52.843314 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fcb2819c-489b-43b3-ac38-f176c4a81184 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.006089 Feb 19 21:13:52.848892 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2439/4787] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:13:52.854436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-182f16b5-5724-4a6f-88e1-61d8d24644c6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.858450 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:52.858450 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:52.860666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-182f16b5-5724-4a6f-88e1-61d8d24644c6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:52.861643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-182f16b5-5724-4a6f-88e1-61d8d24644c6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:13:52.875413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.compute.servers [None req-182f16b5-5724-4a6f-88e1-61d8d24644c6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Flavor 'non_existing_flavor' could not be found {{(pid=136094) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Feb 19 21:13:52.878048 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-182f16b5-5724-4a6f-88e1-61d8d24644c6 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.027886 Feb 19 21:13:52.886340 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2440/4788] 10.222.0.30 () {58 vars in 1177 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:13:52.897035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b6f1c533-06a2-474a-96f6-d696b0dd6a33 req-b0def512-c1c2-4018-9093-ad51eba9e0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d995f8-d42a-4848-8c2b-0ba8fb85618a", "tag": "144a18d3-5bc9-4052-88dd-48df6dad1d99"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:52.898881 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:52.898881 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:52.907123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b6f1c533-06a2-474a-96f6-d696b0dd6a33 req-b0def512-c1c2-4018-9093-ad51eba9e0cf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.907904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b6f1c533-06a2-474a-96f6-d696b0dd6a33 req-b0def512-c1c2-4018-9093-ad51eba9e0cf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.921110 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b6f1c533-06a2-474a-96f6-d696b0dd6a33 req-b0def512-c1c2-4018-9093-ad51eba9e0cf service nova] Creating event network-changed:144a18d3-5bc9-4052-88dd-48df6dad1d99 for instance d0d995f8-d42a-4848-8c2b-0ba8fb85618a on nch2-master-1 Feb 19 21:13:52.927012 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b6f1c533-06a2-474a-96f6-d696b0dd6a33 req-b0def512-c1c2-4018-9093-ad51eba9e0cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038781 Feb 19 21:13:52.928278 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2441/4789] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:52.933737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e7269cc7-08ba-4b6e-a9d2-bb3d7c9508ad tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:52.937532 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:52.937532 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:13:52.939762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e7269cc7-08ba-4b6e-a9d2-bb3d7c9508ad tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:52.941978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e7269cc7-08ba-4b6e-a9d2-bb3d7c9508ad tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:13:52.949763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7269cc7-08ba-4b6e-a9d2-bb3d7c9508ad tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.950412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7269cc7-08ba-4b6e-a9d2-bb3d7c9508ad tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:52.951448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7269cc7-08ba-4b6e-a9d2-bb3d7c9508ad tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:52.952004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7269cc7-08ba-4b6e-a9d2-bb3d7c9508ad tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.044195 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e7269cc7-08ba-4b6e-a9d2-bb3d7c9508ad tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.114369 Feb 19 21:13:53.054425 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2442/4790] 10.222.0.30 () {58 vars in 1173 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:13:53.060024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a8b5ab93-dbbd-44be-ad98-c924f258e996 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:53.066257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a8b5ab93-dbbd-44be-ad98-c924f258e996 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:53.066969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a8b5ab93-dbbd-44be-ad98-c924f258e996 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0'} {{(pid=136094) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:13:53.072762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab93-dbbd-44be-ad98-c924f258e996 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.073217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab93-dbbd-44be-ad98-c924f258e996 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.074085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab93-dbbd-44be-ad98-c924f258e996 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.074763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab93-dbbd-44be-ad98-c924f258e996 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.128710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5f14115d-b052-43cf-84a6-cd7a1d87703c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:53.142435 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5f14115d-b052-43cf-84a6-cd7a1d87703c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.435361 Feb 19 21:13:53.143032 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2349/4791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:52 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:53.193415 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a8b5ab93-dbbd-44be-ad98-c924f258e996 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.137639 Feb 19 21:13:53.196580 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2443/4792] 10.222.0.30 () {58 vars in 1183 bytes} [Sat Feb 19 21:13:53 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:13:53.211111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:53.215150 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:53.215150 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:53.216205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:53.216999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Searching by: {'deleted': False, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:13:53.231113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.232256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.234054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.234527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.274604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:13:53.395237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:53.402920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.403847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.745822 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c870e59-e88c-40dd-a21d-ee2124295c84 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.538152 Feb 19 21:13:53.747084 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2350/4793] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 21:13:53 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:53.769627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-10a99475-f5f4-4faf-8cee-c367e883f919 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:53.775531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-10a99475-f5f4-4faf-8cee-c367e883f919 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:53.776821 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-10a99475-f5f4-4faf-8cee-c367e883f919 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013456 Feb 19 21:13:53.786568 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2444/4794] 10.222.0.30 () {58 vars in 1177 bytes} [Sat Feb 19 21:13:53 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:13:53.790727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-69a5815a-aafb-4039-a161-c49283b6beef tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:53.798270 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:53.798270 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:53.800080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-69a5815a-aafb-4039-a161-c49283b6beef tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:53.801018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-69a5815a-aafb-4039-a161-c49283b6beef tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Searching by: {'deleted': False, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:13:53.808498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-aafb-4039-a161-c49283b6beef tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.809325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-aafb-4039-a161-c49283b6beef tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.810816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-aafb-4039-a161-c49283b6beef tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.811773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-aafb-4039-a161-c49283b6beef tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.847783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-69a5815a-aafb-4039-a161-c49283b6beef tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:13:53.882579 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-69a5815a-aafb-4039-a161-c49283b6beef tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.094764 Feb 19 21:13:53.889122 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2351/4795] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 21:13:53 2022] GET /compute/v2.1/servers => generated 683 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:13:53.895948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe2adacb-9a5e-4f90-a018-87aa34224158 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:53.899016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fe2adacb-9a5e-4f90-a018-87aa34224158 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:53.907749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe2adacb-9a5e-4f90-a018-87aa34224158 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.909158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe2adacb-9a5e-4f90-a018-87aa34224158 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.910225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe2adacb-9a5e-4f90-a018-87aa34224158 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.910911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe2adacb-9a5e-4f90-a018-87aa34224158 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.954137 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-fe2adacb-9a5e-4f90-a018-87aa34224158 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] HTTP exception thrown: Instance 43ab5b91-8dc1-4507-bec8-18ee6000acf7 could not be found. Feb 19 21:13:53.955421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe2adacb-9a5e-4f90-a018-87aa34224158 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Returning 404 to user: Instance 43ab5b91-8dc1-4507-bec8-18ee6000acf7 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:53.956926 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fe2adacb-9a5e-4f90-a018-87aa34224158 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "DELETE /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7" status: 404 len: 111 microversion: 2.1 time: 0.064552 Feb 19 21:13:53.966159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bab43a0e-d88c-4cee-a9c0-d197ae4db4f5 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:53.966822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bab43a0e-d88c-4cee-a9c0-d197ae4db4f5 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 20fbf3c8-6c17-4667-9092-8d7221c23eaa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:53.969814 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2445/4796] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:13:53 2022] DELETE /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:13:53.977534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bab43a0e-d88c-4cee-a9c0-d197ae4db4f5 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.978120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bab43a0e-d88c-4cee-a9c0-d197ae4db4f5 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:53.978961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bab43a0e-d88c-4cee-a9c0-d197ae4db4f5 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:53.979478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bab43a0e-d88c-4cee-a9c0-d197ae4db4f5 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:54.031340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bab43a0e-d88c-4cee-a9c0-d197ae4db4f5 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 20fbf3c8-6c17-4667-9092-8d7221c23eaa] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:13:54.161569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-03923f6f-4ed3-4450-9eb6-c23af2d6a8a9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:54.162555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-03923f6f-4ed3-4450-9eb6-c23af2d6a8a9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:54.178705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03923f6f-4ed3-4450-9eb6-c23af2d6a8a9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:54.179955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03923f6f-4ed3-4450-9eb6-c23af2d6a8a9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:54.181395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03923f6f-4ed3-4450-9eb6-c23af2d6a8a9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:54.184007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03923f6f-4ed3-4450-9eb6-c23af2d6a8a9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:54.191341 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bab43a0e-d88c-4cee-a9c0-d197ae4db4f5 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "DELETE /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa" status: 204 len: 0 microversion: 2.1 time: 0.228310 Feb 19 21:13:54.199160 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2352/4797] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:13:53 2022] DELETE /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:13:54.206368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-88cfbd59-486d-4992-abb0-ae0b79e833fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:54.212732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-88cfbd59-486d-4992-abb0-ae0b79e833fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:54.224969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88cfbd59-486d-4992-abb0-ae0b79e833fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:54.225426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88cfbd59-486d-4992-abb0-ae0b79e833fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:54.228569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88cfbd59-486d-4992-abb0-ae0b79e833fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:54.229213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88cfbd59-486d-4992-abb0-ae0b79e833fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:54.388851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-88cfbd59-486d-4992-abb0-ae0b79e833fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:13:54.600984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-03923f6f-4ed3-4450-9eb6-c23af2d6a8a9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:54.610579 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-03923f6f-4ed3-4450-9eb6-c23af2d6a8a9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.454336 Feb 19 21:13:54.611755 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2446/4798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:54 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:54.664074 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-88cfbd59-486d-4992-abb0-ae0b79e833fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 204 len: 0 microversion: 2.1 time: 0.461008 Feb 19 21:13:54.665183 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2353/4799] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:13:54 2022] DELETE /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:13:54.675202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-229104e2-696b-42ad-ab07-c09d7497a9b8 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:54.676293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-229104e2-696b-42ad-ab07-c09d7497a9b8 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 43ab5b91-8dc1-4507-bec8-18ee6000acf7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:54.688261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-229104e2-696b-42ad-ab07-c09d7497a9b8 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:54.689245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-229104e2-696b-42ad-ab07-c09d7497a9b8 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:54.690220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-229104e2-696b-42ad-ab07-c09d7497a9b8 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:54.690818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-229104e2-696b-42ad-ab07-c09d7497a9b8 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:54.709663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2061146671", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "5dcb556e-7200-41f7-af8e-4f52d2bfd4af"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:54.749868 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-229104e2-696b-42ad-ab07-c09d7497a9b8 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] HTTP exception thrown: Instance 43ab5b91-8dc1-4507-bec8-18ee6000acf7 could not be found. Feb 19 21:13:54.752448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-229104e2-696b-42ad-ab07-c09d7497a9b8 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Returning 404 to user: Instance 43ab5b91-8dc1-4507-bec8-18ee6000acf7 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:54.754854 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-229104e2-696b-42ad-ab07-c09d7497a9b8 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7" status: 404 len: 111 microversion: 2.1 time: 0.084157 Feb 19 21:13:54.755665 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2447/4800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:54 2022] GET /compute/v2.1/servers/43ab5b91-8dc1-4507-bec8-18ee6000acf7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:13:54.767692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-936b38fc-7156-487b-b070-49dcae575f73 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:54.768498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-936b38fc-7156-487b-b070-49dcae575f73 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 20fbf3c8-6c17-4667-9092-8d7221c23eaa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:54.777408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] validate_networks() for [('5dcb556e-7200-41f7-af8e-4f52d2bfd4af', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:13:54.779107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-936b38fc-7156-487b-b070-49dcae575f73 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:54.779783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-936b38fc-7156-487b-b070-49dcae575f73 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:54.780972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-936b38fc-7156-487b-b070-49dcae575f73 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:54.782320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-936b38fc-7156-487b-b070-49dcae575f73 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:55.262013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-936b38fc-7156-487b-b070-49dcae575f73 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:55.277547 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-936b38fc-7156-487b-b070-49dcae575f73 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa" status: 200 len: 1522 microversion: 2.1 time: 0.516922 Feb 19 21:13:55.278790 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2448/4801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:54 2022] GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:55.631545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-71d1bd6a-de77-44b6-90a9-9fbd16f4d39a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:55.632104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-71d1bd6a-de77-44b6-90a9-9fbd16f4d39a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:55.648850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71d1bd6a-de77-44b6-90a9-9fbd16f4d39a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:55.649396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71d1bd6a-de77-44b6-90a9-9fbd16f4d39a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:55.651271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71d1bd6a-de77-44b6-90a9-9fbd16f4d39a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:55.651717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-71d1bd6a-de77-44b6-90a9-9fbd16f4d39a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:56.004982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:13:56.005442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:13:56.005859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:13:56.006442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:13:56.007139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:13:56.018351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:56.018914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:56.020709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:56.021259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:56.046526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Getting quotas for project 9f7a8678732a40b383cedd20600e102e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:13:56.059673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Getting quotas for user 5e825e0ef42743238263e6758e53e28c and project 9f7a8678732a40b383cedd20600e102e. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:13:56.093915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:13:56.101405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:13:56.127650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-71d1bd6a-de77-44b6-90a9-9fbd16f4d39a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:56.139878 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-71d1bd6a-de77-44b6-90a9-9fbd16f4d39a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.516317 Feb 19 21:13:56.148581 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2449/4802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:55 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:56.243339 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-af858e04-2747-4b44-8105-694fac041e20 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.537761 Feb 19 21:13:56.247014 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2354/4803] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:13:56.256752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8f5c881b-8db8-4c2e-b77e-26592ebb99cf tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:56.257682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8f5c881b-8db8-4c2e-b77e-26592ebb99cf tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:56.296821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff44730e-d670-4855-b6a0-c4385ad830fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:56.297731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff44730e-d670-4855-b6a0-c4385ad830fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 20fbf3c8-6c17-4667-9092-8d7221c23eaa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:56.309491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff44730e-d670-4855-b6a0-c4385ad830fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:56.310450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff44730e-d670-4855-b6a0-c4385ad830fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:56.311749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff44730e-d670-4855-b6a0-c4385ad830fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:56.312561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff44730e-d670-4855-b6a0-c4385ad830fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:57.014876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8f5c881b-8db8-4c2e-b77e-26592ebb99cf tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:57.025485 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8f5c881b-8db8-4c2e-b77e-26592ebb99cf tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1218 microversion: 2.1 time: 0.772293 Feb 19 21:13:57.051963 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2450/4804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:56 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1218 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:57.166331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f298c756-fa6c-4f45-b92f-418544659cc8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:57.167107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f298c756-fa6c-4f45-b92f-418544659cc8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:57.179155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f298c756-fa6c-4f45-b92f-418544659cc8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:57.179795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f298c756-fa6c-4f45-b92f-418544659cc8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:57.182615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f298c756-fa6c-4f45-b92f-418544659cc8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:57.184911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f298c756-fa6c-4f45-b92f-418544659cc8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:57.392269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ff44730e-d670-4855-b6a0-c4385ad830fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:57.421405 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff44730e-d670-4855-b6a0-c4385ad830fe tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa" status: 200 len: 1522 microversion: 2.1 time: 1.130148 Feb 19 21:13:57.422296 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2355/4805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:56 2022] GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa => generated 1522 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:57.682436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f298c756-fa6c-4f45-b92f-418544659cc8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:57.706110 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f298c756-fa6c-4f45-b92f-418544659cc8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.542163 Feb 19 21:13:57.719278 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2451/4806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:57 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:13:57.789876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-92622505-3739-4437-97af-7d7297c57a25 req-df620ae1-e642-433c-975a-481087a126fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20fbf3c8-6c17-4667-9092-8d7221c23eaa", "name": "network-vif-deleted", "tag": "356ca7b7-90a9-48f4-a800-3ae550ebde56"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:57.793953 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:57.793953 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:57.804188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-92622505-3739-4437-97af-7d7297c57a25 req-df620ae1-e642-433c-975a-481087a126fd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:57.805033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-92622505-3739-4437-97af-7d7297c57a25 req-df620ae1-e642-433c-975a-481087a126fd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:57.818903 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-92622505-3739-4437-97af-7d7297c57a25 req-df620ae1-e642-433c-975a-481087a126fd service nova] Creating event network-vif-deleted:356ca7b7-90a9-48f4-a800-3ae550ebde56 for instance 20fbf3c8-6c17-4667-9092-8d7221c23eaa on nch1-master-1 Feb 19 21:13:57.833610 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-92622505-3739-4437-97af-7d7297c57a25 req-df620ae1-e642-433c-975a-481087a126fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047250 Feb 19 21:13:57.835593 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2356/4807] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:58.050301 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a179d54b-9ab6-4437-ad0b-b47dc5ad79d3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:58.051553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a179d54b-9ab6-4437-ad0b-b47dc5ad79d3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:58.060074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a179d54b-9ab6-4437-ad0b-b47dc5ad79d3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:58.060939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a179d54b-9ab6-4437-ad0b-b47dc5ad79d3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:58.062707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a179d54b-9ab6-4437-ad0b-b47dc5ad79d3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:58.063941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a179d54b-9ab6-4437-ad0b-b47dc5ad79d3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:58.208556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a179d54b-9ab6-4437-ad0b-b47dc5ad79d3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:58.226634 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a179d54b-9ab6-4437-ad0b-b47dc5ad79d3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1278 microversion: 2.1 time: 0.179905 Feb 19 21:13:58.228272 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2452/4808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:58 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:58.390247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-23856bc2-5be2-4153-8c75-127ae7b1be31 req-85f0f27a-12c9-46c3-bd66-00358d0d8f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1336813f-479c-48e1-adee-30fce72af1ba", "name": "network-vif-deleted", "tag": "3405bd1c-c5f9-4a4b-b087-90cfc9728cab"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:13:58.392831 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:13:58.392831 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:13:58.412028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-23856bc2-5be2-4153-8c75-127ae7b1be31 req-85f0f27a-12c9-46c3-bd66-00358d0d8f99 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:58.412914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-23856bc2-5be2-4153-8c75-127ae7b1be31 req-85f0f27a-12c9-46c3-bd66-00358d0d8f99 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:58.438335 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-23856bc2-5be2-4153-8c75-127ae7b1be31 req-85f0f27a-12c9-46c3-bd66-00358d0d8f99 service nova] Creating event network-vif-deleted:3405bd1c-c5f9-4a4b-b087-90cfc9728cab for instance 1336813f-479c-48e1-adee-30fce72af1ba on nch2-master-1 Feb 19 21:13:58.440824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:58.441661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 20fbf3c8-6c17-4667-9092-8d7221c23eaa] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:58.452236 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-23856bc2-5be2-4153-8c75-127ae7b1be31 req-85f0f27a-12c9-46c3-bd66-00358d0d8f99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066198 Feb 19 21:13:58.459626 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2357/4809] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:13:58.465406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:58.466355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:58.468963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:58.470387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:58.586128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:58.586640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:58.587108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lazy-loading 'fault' on Instance uuid 20fbf3c8-6c17-4667-9092-8d7221c23eaa {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:13:58.657731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d25416fd67e4dd08da5ed2408649327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c438bd56e19499a91a00c3757b6f9f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:58.669523 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a8b4e44e-d9d6-4992-85f6-68719fc95443 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa" status: 200 len: 1313 microversion: 2.1 time: 0.232367 Feb 19 21:13:58.670141 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2453/4810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:58 2022] GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:58.725211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ccd3953d-8ff9-487d-a757-bedcc68df414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:58.726171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ccd3953d-8ff9-487d-a757-bedcc68df414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:58.737639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccd3953d-8ff9-487d-a757-bedcc68df414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:58.739593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccd3953d-8ff9-487d-a757-bedcc68df414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:58.742426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccd3953d-8ff9-487d-a757-bedcc68df414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:58.744917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccd3953d-8ff9-487d-a757-bedcc68df414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:59.247960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4abef660-5de8-42a2-b1da-c13f0c6bc7a3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:59.249447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4abef660-5de8-42a2-b1da-c13f0c6bc7a3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:59.265195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4abef660-5de8-42a2-b1da-c13f0c6bc7a3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:59.268746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4abef660-5de8-42a2-b1da-c13f0c6bc7a3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:59.271617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4abef660-5de8-42a2-b1da-c13f0c6bc7a3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:59.272883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4abef660-5de8-42a2-b1da-c13f0c6bc7a3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:59.437042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ccd3953d-8ff9-487d-a757-bedcc68df414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:13:59.455114 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ccd3953d-8ff9-487d-a757-bedcc68df414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.730481 Feb 19 21:13:59.460411 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2358/4811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:58 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:13:59.686484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a0ba536-9462-4ebd-8dcd-312c67b87a33 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:59.688803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a0ba536-9462-4ebd-8dcd-312c67b87a33 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 20fbf3c8-6c17-4667-9092-8d7221c23eaa] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:59.699450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a0ba536-9462-4ebd-8dcd-312c67b87a33 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:59.701498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a0ba536-9462-4ebd-8dcd-312c67b87a33 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:59.707524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a0ba536-9462-4ebd-8dcd-312c67b87a33 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:59.709004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a0ba536-9462-4ebd-8dcd-312c67b87a33 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:59.735335 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9a0ba536-9462-4ebd-8dcd-312c67b87a33 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] HTTP exception thrown: Instance 20fbf3c8-6c17-4667-9092-8d7221c23eaa could not be found. Feb 19 21:13:59.744381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a0ba536-9462-4ebd-8dcd-312c67b87a33 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Returning 404 to user: Instance 20fbf3c8-6c17-4667-9092-8d7221c23eaa could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:59.745529 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a0ba536-9462-4ebd-8dcd-312c67b87a33 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa" status: 404 len: 111 microversion: 2.1 time: 0.062650 Feb 19 21:13:59.751181 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2359/4812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:59 2022] GET /compute/v2.1/servers/20fbf3c8-6c17-4667-9092-8d7221c23eaa => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:13:59.765275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bba0d91e-39db-4ab0-9a9e-9d4d237b1411 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:13:59.766784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bba0d91e-39db-4ab0-9a9e-9d4d237b1411 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] [instance: 1336813f-479c-48e1-adee-30fce72af1ba] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:13:59.776259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bba0d91e-39db-4ab0-9a9e-9d4d237b1411 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:59.781763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bba0d91e-39db-4ab0-9a9e-9d4d237b1411 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:59.782948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bba0d91e-39db-4ab0-9a9e-9d4d237b1411 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:13:59.783567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bba0d91e-39db-4ab0-9a9e-9d4d237b1411 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:13:59.823790 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-bba0d91e-39db-4ab0-9a9e-9d4d237b1411 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] HTTP exception thrown: Instance 1336813f-479c-48e1-adee-30fce72af1ba could not be found. Feb 19 21:13:59.824717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bba0d91e-39db-4ab0-9a9e-9d4d237b1411 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] Returning 404 to user: Instance 1336813f-479c-48e1-adee-30fce72af1ba could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:13:59.826451 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bba0d91e-39db-4ab0-9a9e-9d4d237b1411 tempest-ListServersNegativeTestJSON-34025696 tempest-ListServersNegativeTestJSON-34025696-project] 10.222.0.30 "GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba" status: 404 len: 111 microversion: 2.1 time: 0.073895 Feb 19 21:13:59.827577 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2360/4813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:59 2022] GET /compute/v2.1/servers/1336813f-479c-48e1-adee-30fce72af1ba => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:14:00.235475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4abef660-5de8-42a2-b1da-c13f0c6bc7a3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:00.259721 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4abef660-5de8-42a2-b1da-c13f0c6bc7a3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1318 microversion: 2.1 time: 1.007729 Feb 19 21:14:00.276712 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2454/4814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:13:59 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1318 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:00.472066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f2543631-65a0-4356-9164-78398b746bcf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:00.472873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f2543631-65a0-4356-9164-78398b746bcf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:00.486747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2543631-65a0-4356-9164-78398b746bcf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:00.487781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2543631-65a0-4356-9164-78398b746bcf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:00.489968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2543631-65a0-4356-9164-78398b746bcf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:00.490495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f2543631-65a0-4356-9164-78398b746bcf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:01.153062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f2543631-65a0-4356-9164-78398b746bcf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:01.167094 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f2543631-65a0-4356-9164-78398b746bcf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.696718 Feb 19 21:14:01.170234 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2361/4815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:00 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:01.279385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a7b81380-013c-4332-a56e-b9a3c115a8cc tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:01.279997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a7b81380-013c-4332-a56e-b9a3c115a8cc tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:01.290533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7b81380-013c-4332-a56e-b9a3c115a8cc tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:01.290991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7b81380-013c-4332-a56e-b9a3c115a8cc tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:01.291794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7b81380-013c-4332-a56e-b9a3c115a8cc tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:01.292228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7b81380-013c-4332-a56e-b9a3c115a8cc tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:01.649536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a7b81380-013c-4332-a56e-b9a3c115a8cc tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:01.677733 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a7b81380-013c-4332-a56e-b9a3c115a8cc tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1318 microversion: 2.1 time: 0.403204 Feb 19 21:14:01.679042 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2455/4816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:01 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:02.008571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4df08c1e-896a-497a-90cb-b6f1fb46dda6 req-a5455c28-ec74-428f-9937-8b5b0911b61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43336a9-8a01-4986-a4a4-2db673d84070", "tag": "4b0c96ca-51f8-4dad-8d80-6cbca55d06e4"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:02.031011 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:02.031011 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:14:02.061826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4df08c1e-896a-497a-90cb-b6f1fb46dda6 req-a5455c28-ec74-428f-9937-8b5b0911b61c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:02.066281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4df08c1e-896a-497a-90cb-b6f1fb46dda6 req-a5455c28-ec74-428f-9937-8b5b0911b61c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:02.104176 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4df08c1e-896a-497a-90cb-b6f1fb46dda6 req-a5455c28-ec74-428f-9937-8b5b0911b61c service nova] Creating event network-changed:4b0c96ca-51f8-4dad-8d80-6cbca55d06e4 for instance f43336a9-8a01-4986-a4a4-2db673d84070 on nch1-master-1 Feb 19 21:14:02.118071 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4df08c1e-896a-497a-90cb-b6f1fb46dda6 req-a5455c28-ec74-428f-9937-8b5b0911b61c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114160 Feb 19 21:14:02.121444 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2362/4817] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:14:02.185160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a9bc8d43-5deb-44d7-b152-7962a30d69f3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:02.185772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a9bc8d43-5deb-44d7-b152-7962a30d69f3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:02.202248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9bc8d43-5deb-44d7-b152-7962a30d69f3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:02.202711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9bc8d43-5deb-44d7-b152-7962a30d69f3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:02.204151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9bc8d43-5deb-44d7-b152-7962a30d69f3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:02.204660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9bc8d43-5deb-44d7-b152-7962a30d69f3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:02.241714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6d978ec8-4ec8-455e-974c-1772632bb89a tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:02.242413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6d978ec8-4ec8-455e-974c-1772632bb89a tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:02.255949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d978ec8-4ec8-455e-974c-1772632bb89a tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:02.257412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d978ec8-4ec8-455e-974c-1772632bb89a tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:02.258274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d978ec8-4ec8-455e-974c-1772632bb89a tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:02.259309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d978ec8-4ec8-455e-974c-1772632bb89a tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:02.331165 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6d978ec8-4ec8-455e-974c-1772632bb89a tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.102586 Feb 19 21:14:02.331779 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2363/4818] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Feb 19 21:14:02 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559/os-server-password => generated 116 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:02.656317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a9bc8d43-5deb-44d7-b152-7962a30d69f3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:02.671384 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a9bc8d43-5deb-44d7-b152-7962a30d69f3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.489621 Feb 19 21:14:02.673191 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2456/4819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:02 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:02.707029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1049853e-72ac-4630-b352-b9b326b0a48e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:02.708224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1049853e-72ac-4630-b352-b9b326b0a48e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:02.721222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1049853e-72ac-4630-b352-b9b326b0a48e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:02.722186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1049853e-72ac-4630-b352-b9b326b0a48e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:02.723465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1049853e-72ac-4630-b352-b9b326b0a48e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:02.724669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1049853e-72ac-4630-b352-b9b326b0a48e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:03.402816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1049853e-72ac-4630-b352-b9b326b0a48e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:03.438733 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1049853e-72ac-4630-b352-b9b326b0a48e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1318 microversion: 2.1 time: 0.744125 Feb 19 21:14:03.440647 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2364/4820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:02 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:03.690892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0a92413-4687-4376-ac01-2cfd4db36e09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:03.691513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0a92413-4687-4376-ac01-2cfd4db36e09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:03.704114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a92413-4687-4376-ac01-2cfd4db36e09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:03.704114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a92413-4687-4376-ac01-2cfd4db36e09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:03.706680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a92413-4687-4376-ac01-2cfd4db36e09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:03.709088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a92413-4687-4376-ac01-2cfd4db36e09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:04.122618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e0a92413-4687-4376-ac01-2cfd4db36e09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:04.133341 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0a92413-4687-4376-ac01-2cfd4db36e09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.447242 Feb 19 21:14:04.137507 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2457/4821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:03 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:04.438421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6bf60cd5-796b-4c70-baab-9d81f00e7890 req-3145b77c-c7b2-48ec-bc04-db66beed5f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d995f8-d42a-4848-8c2b-0ba8fb85618a", "name": "network-vif-plugged", "status": "completed", "tag": "144a18d3-5bc9-4052-88dd-48df6dad1d99"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:04.447144 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:04.447144 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:14:04.459630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c0da9972-8f5a-4200-a433-a05e4a689a05 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:04.460619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c0da9972-8f5a-4200-a433-a05e4a689a05 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:04.473529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6bf60cd5-796b-4c70-baab-9d81f00e7890 req-3145b77c-c7b2-48ec-bc04-db66beed5f37 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:04.475737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6bf60cd5-796b-4c70-baab-9d81f00e7890 req-3145b77c-c7b2-48ec-bc04-db66beed5f37 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:04.488612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0da9972-8f5a-4200-a433-a05e4a689a05 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:04.492266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0da9972-8f5a-4200-a433-a05e4a689a05 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:04.493695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0da9972-8f5a-4200-a433-a05e4a689a05 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:04.494768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c0da9972-8f5a-4200-a433-a05e4a689a05 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:04.529801 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6bf60cd5-796b-4c70-baab-9d81f00e7890 req-3145b77c-c7b2-48ec-bc04-db66beed5f37 service nova] Creating event network-vif-plugged:144a18d3-5bc9-4052-88dd-48df6dad1d99 for instance d0d995f8-d42a-4848-8c2b-0ba8fb85618a on nch2-master-1 Feb 19 21:14:04.558798 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6bf60cd5-796b-4c70-baab-9d81f00e7890 req-3145b77c-c7b2-48ec-bc04-db66beed5f37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136833 Feb 19 21:14:04.559925 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2365/4822] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:04.846427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c0da9972-8f5a-4200-a433-a05e4a689a05 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:04.856137 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c0da9972-8f5a-4200-a433-a05e4a689a05 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1318 microversion: 2.1 time: 0.402483 Feb 19 21:14:04.860277 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2458/4823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:04 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:05.162853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4663fedd-38de-48a6-8352-6a0af09e8024 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:05.167450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4663fedd-38de-48a6-8352-6a0af09e8024 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:05.194597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4663fedd-38de-48a6-8352-6a0af09e8024 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:05.195060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4663fedd-38de-48a6-8352-6a0af09e8024 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:05.196131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4663fedd-38de-48a6-8352-6a0af09e8024 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:05.196792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4663fedd-38de-48a6-8352-6a0af09e8024 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:05.430529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4663fedd-38de-48a6-8352-6a0af09e8024 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:05.439001 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4663fedd-38de-48a6-8352-6a0af09e8024 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.286772 Feb 19 21:14:05.452010 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2366/4824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:05 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:05.885426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-42cba5c3-4b01-4fdb-a72d-272fc12e1839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:05.888135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-42cba5c3-4b01-4fdb-a72d-272fc12e1839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:05.911313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42cba5c3-4b01-4fdb-a72d-272fc12e1839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:05.912023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42cba5c3-4b01-4fdb-a72d-272fc12e1839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:05.913002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42cba5c3-4b01-4fdb-a72d-272fc12e1839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:05.913600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42cba5c3-4b01-4fdb-a72d-272fc12e1839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:06.388825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-42cba5c3-4b01-4fdb-a72d-272fc12e1839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:06.408222 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-42cba5c3-4b01-4fdb-a72d-272fc12e1839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1318 microversion: 2.1 time: 0.524521 Feb 19 21:14:06.420676 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2459/4825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:05 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:06.457666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8fb9dd05-d4de-45ae-95c0-a461cdc1522a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:06.458897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8fb9dd05-d4de-45ae-95c0-a461cdc1522a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:06.481018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fb9dd05-d4de-45ae-95c0-a461cdc1522a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:06.481516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fb9dd05-d4de-45ae-95c0-a461cdc1522a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:06.482362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fb9dd05-d4de-45ae-95c0-a461cdc1522a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:06.496984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fb9dd05-d4de-45ae-95c0-a461cdc1522a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:06.826489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-363647866", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "1a11fd51-a195-4c65-859d-a83464dc0844"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:06.895188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8fb9dd05-d4de-45ae-95c0-a461cdc1522a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:06.905953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] validate_networks() for [('1a11fd51-a195-4c65-859d-a83464dc0844', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:14:06.912032 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8fb9dd05-d4de-45ae-95c0-a461cdc1522a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1329 microversion: 2.1 time: 0.459396 Feb 19 21:14:06.914068 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2367/4826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:06 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1329 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:07.428185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-340e979c-bb77-47d8-9cb7-e9f0273f1c69 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:07.429057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-340e979c-bb77-47d8-9cb7-e9f0273f1c69 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:07.439172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-340e979c-bb77-47d8-9cb7-e9f0273f1c69 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:07.441213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-340e979c-bb77-47d8-9cb7-e9f0273f1c69 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:07.442829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-340e979c-bb77-47d8-9cb7-e9f0273f1c69 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:07.443729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-340e979c-bb77-47d8-9cb7-e9f0273f1c69 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:07.636263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:14:07.636876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:14:07.637347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:14:07.638219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:14:07.638631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:14:07.650822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:07.652391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:07.653418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:07.654032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:07.681293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Getting quotas for project 03bf8706a07449ecbf023ba907fd7c38. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:14:07.689833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Getting quotas for user 2ed46d2f9d344a398d541d54ae22b626 and project 03bf8706a07449ecbf023ba907fd7c38. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:14:07.711770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:14:07.715576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:14:07.750985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-340e979c-bb77-47d8-9cb7-e9f0273f1c69 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:07.761560 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-340e979c-bb77-47d8-9cb7-e9f0273f1c69 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1318 microversion: 2.1 time: 0.337248 Feb 19 21:14:07.775220 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2368/4827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:07 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:07.799187 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-37337464-77e0-4451-b9f5-418617ddfed5 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.205864 Feb 19 21:14:07.810696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-abc2e922-3a94-4c4d-8b4a-897b19bce7e2 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:07.811319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-abc2e922-3a94-4c4d-8b4a-897b19bce7e2 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:07.817685 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2460/4828] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:14:07.930483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-abc2e922-3a94-4c4d-8b4a-897b19bce7e2 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:07.930680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-357aa338-350d-43f4-a08a-0999fbe8f814 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:07.931902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-357aa338-350d-43f4-a08a-0999fbe8f814 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:07.940708 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-abc2e922-3a94-4c4d-8b4a-897b19bce7e2 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1223 microversion: 2.1 time: 0.134537 Feb 19 21:14:07.942106 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2369/4829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:07 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:07.954157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-357aa338-350d-43f4-a08a-0999fbe8f814 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:07.954885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-357aa338-350d-43f4-a08a-0999fbe8f814 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:07.955870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-357aa338-350d-43f4-a08a-0999fbe8f814 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:07.956525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-357aa338-350d-43f4-a08a-0999fbe8f814 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:08.315607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-357aa338-350d-43f4-a08a-0999fbe8f814 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:08.327731 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-357aa338-350d-43f4-a08a-0999fbe8f814 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1510 microversion: 2.1 time: 0.398558 Feb 19 21:14:08.336663 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2461/4830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:07 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:08.350072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9e52c974-04b5-4cb9-8f09-4ae095eea8a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:08.350783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9e52c974-04b5-4cb9-8f09-4ae095eea8a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:08.359108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e52c974-04b5-4cb9-8f09-4ae095eea8a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:08.361001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e52c974-04b5-4cb9-8f09-4ae095eea8a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:08.362508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e52c974-04b5-4cb9-8f09-4ae095eea8a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:08.364454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9e52c974-04b5-4cb9-8f09-4ae095eea8a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:08.782581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7170e77f-5098-416b-814a-27449f27f857 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:08.783291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7170e77f-5098-416b-814a-27449f27f857 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:08.799350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7170e77f-5098-416b-814a-27449f27f857 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:08.802875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7170e77f-5098-416b-814a-27449f27f857 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:08.804183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7170e77f-5098-416b-814a-27449f27f857 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:08.805937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9e52c974-04b5-4cb9-8f09-4ae095eea8a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:08.806656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7170e77f-5098-416b-814a-27449f27f857 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:08.818373 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9e52c974-04b5-4cb9-8f09-4ae095eea8a2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1510 microversion: 2.1 time: 0.474642 Feb 19 21:14:08.818989 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2370/4831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:08 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:08.835045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ee8e66f-0dd6-4214-a36f-bbfb3e5bec5c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:08.835540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8ee8e66f-0dd6-4214-a36f-bbfb3e5bec5c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:08.867662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ee8e66f-0dd6-4214-a36f-bbfb3e5bec5c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:08.868305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ee8e66f-0dd6-4214-a36f-bbfb3e5bec5c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:08.869088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ee8e66f-0dd6-4214-a36f-bbfb3e5bec5c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:08.869522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ee8e66f-0dd6-4214-a36f-bbfb3e5bec5c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:08.900146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8ee8e66f-0dd6-4214-a36f-bbfb3e5bec5c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:14:09.121226 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ee8e66f-0dd6-4214-a36f-bbfb3e5bec5c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 204 len: 0 microversion: 2.1 time: 0.289756 Feb 19 21:14:09.122705 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2371/4832] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:14:08 2022] DELETE /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:14:09.137765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f3dfd0e-390b-4c41-aaf6-d2e291c23f01 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:09.140283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f3dfd0e-390b-4c41-aaf6-d2e291c23f01 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:09.162382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f3dfd0e-390b-4c41-aaf6-d2e291c23f01 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:09.163623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f3dfd0e-390b-4c41-aaf6-d2e291c23f01 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:09.164775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f3dfd0e-390b-4c41-aaf6-d2e291c23f01 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:09.165618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f3dfd0e-390b-4c41-aaf6-d2e291c23f01 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:09.419768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8f3dfd0e-390b-4c41-aaf6-d2e291c23f01 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:09.436935 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8f3dfd0e-390b-4c41-aaf6-d2e291c23f01 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1275 microversion: 2.1 time: 0.312223 Feb 19 21:14:09.438067 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2372/4833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:09 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:09.452740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-db4e5326-9c67-4c7d-8484-93ba97b203ca tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:09.453483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-db4e5326-9c67-4c7d-8484-93ba97b203ca tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:09.470259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-db4e5326-9c67-4c7d-8484-93ba97b203ca tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:09.471034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-db4e5326-9c67-4c7d-8484-93ba97b203ca tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:09.473181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-db4e5326-9c67-4c7d-8484-93ba97b203ca tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:09.473845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-db4e5326-9c67-4c7d-8484-93ba97b203ca tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:10.176734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7170e77f-5098-416b-814a-27449f27f857 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:10.193705 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7170e77f-5098-416b-814a-27449f27f857 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1318 microversion: 2.1 time: 1.416024 Feb 19 21:14:10.195022 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2462/4834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:08 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1318 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:10.200447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-398b26cd-ea25-450f-9678-f2d47e7d5e1b req-e4a05210-4b07-44cc-8fd0-b64ab28cf938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43336a9-8a01-4986-a4a4-2db673d84070", "name": "network-vif-plugged", "status": "completed", "tag": "4b0c96ca-51f8-4dad-8d80-6cbca55d06e4"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:10.204246 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:10.204246 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:14:10.213718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-398b26cd-ea25-450f-9678-f2d47e7d5e1b req-e4a05210-4b07-44cc-8fd0-b64ab28cf938 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:10.214639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-398b26cd-ea25-450f-9678-f2d47e7d5e1b req-e4a05210-4b07-44cc-8fd0-b64ab28cf938 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:10.226781 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-398b26cd-ea25-450f-9678-f2d47e7d5e1b req-e4a05210-4b07-44cc-8fd0-b64ab28cf938 service nova] Creating event network-vif-plugged:4b0c96ca-51f8-4dad-8d80-6cbca55d06e4 for instance f43336a9-8a01-4986-a4a4-2db673d84070 on nch1-master-1 Feb 19 21:14:10.233545 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-398b26cd-ea25-450f-9678-f2d47e7d5e1b req-e4a05210-4b07-44cc-8fd0-b64ab28cf938 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036800 Feb 19 21:14:10.234295 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2463/4835] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:10.455978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f790d906-e497-4da4-aa2d-378b300c4b08 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:10.456725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f790d906-e497-4da4-aa2d-378b300c4b08 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:10.463475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f790d906-e497-4da4-aa2d-378b300c4b08 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:10.463963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f790d906-e497-4da4-aa2d-378b300c4b08 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:10.464780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f790d906-e497-4da4-aa2d-378b300c4b08 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:10.465225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f790d906-e497-4da4-aa2d-378b300c4b08 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:10.502040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-db4e5326-9c67-4c7d-8484-93ba97b203ca tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:10.509776 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-db4e5326-9c67-4c7d-8484-93ba97b203ca tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1516 microversion: 2.1 time: 1.070390 Feb 19 21:14:10.519534 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2373/4836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:09 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1516 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:10.610004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f790d906-e497-4da4-aa2d-378b300c4b08 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:10.627924 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f790d906-e497-4da4-aa2d-378b300c4b08 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1281 microversion: 2.1 time: 0.175854 Feb 19 21:14:10.629472 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2464/4837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:10 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1281 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:11.212893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3ae65ac1-3825-4c1c-abdf-9d7ec896dea1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:11.213805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3ae65ac1-3825-4c1c-abdf-9d7ec896dea1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:11.230030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ae65ac1-3825-4c1c-abdf-9d7ec896dea1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:11.230832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ae65ac1-3825-4c1c-abdf-9d7ec896dea1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:11.231827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ae65ac1-3825-4c1c-abdf-9d7ec896dea1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:11.232486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ae65ac1-3825-4c1c-abdf-9d7ec896dea1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:11.527262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f9ba8c6-ce62-441e-ab61-b5665a191d15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:11.527865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3f9ba8c6-ce62-441e-ab61-b5665a191d15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:11.543844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f9ba8c6-ce62-441e-ab61-b5665a191d15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:11.544458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f9ba8c6-ce62-441e-ab61-b5665a191d15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:11.546473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f9ba8c6-ce62-441e-ab61-b5665a191d15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:11.547897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f9ba8c6-ce62-441e-ab61-b5665a191d15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:11.983100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3ae65ac1-3825-4c1c-abdf-9d7ec896dea1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:12.007646 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3ae65ac1-3825-4c1c-abdf-9d7ec896dea1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1318 microversion: 2.1 time: 0.797999 Feb 19 21:14:12.008448 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2374/4838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:11 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1318 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:12.021006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ec0d004c-a005-4e85-908b-07cb47c73e4b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:12.022229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ec0d004c-a005-4e85-908b-07cb47c73e4b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:12.044537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec0d004c-a005-4e85-908b-07cb47c73e4b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:12.045579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec0d004c-a005-4e85-908b-07cb47c73e4b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:12.047731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec0d004c-a005-4e85-908b-07cb47c73e4b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:12.048380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ec0d004c-a005-4e85-908b-07cb47c73e4b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:12.067244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3f9ba8c6-ce62-441e-ab61-b5665a191d15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:12.096824 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f9ba8c6-ce62-441e-ab61-b5665a191d15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 200 len: 1516 microversion: 2.1 time: 0.573372 Feb 19 21:14:12.117273 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2465/4839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:11 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 1516 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:12.255985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-59055e62-e89d-45dc-ae26-35fb864d91ff req-105edd36-04b8-4353-bd7d-55812759ca92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d995f8-d42a-4848-8c2b-0ba8fb85618a", "name": "network-vif-deleted", "tag": "144a18d3-5bc9-4052-88dd-48df6dad1d99"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:12.257772 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:12.257772 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:14:12.284855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-59055e62-e89d-45dc-ae26-35fb864d91ff req-105edd36-04b8-4353-bd7d-55812759ca92 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:12.285320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-59055e62-e89d-45dc-ae26-35fb864d91ff req-105edd36-04b8-4353-bd7d-55812759ca92 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:12.322733 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-59055e62-e89d-45dc-ae26-35fb864d91ff req-105edd36-04b8-4353-bd7d-55812759ca92 service nova] Creating event network-vif-deleted:144a18d3-5bc9-4052-88dd-48df6dad1d99 for instance d0d995f8-d42a-4848-8c2b-0ba8fb85618a on nch2-master-1 Feb 19 21:14:12.337875 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-59055e62-e89d-45dc-ae26-35fb864d91ff req-105edd36-04b8-4353-bd7d-55812759ca92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090087 Feb 19 21:14:12.338512 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2466/4840] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:14:12.520910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ec0d004c-a005-4e85-908b-07cb47c73e4b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:12.539723 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ec0d004c-a005-4e85-908b-07cb47c73e4b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1323 microversion: 2.1 time: 0.529109 Feb 19 21:14:12.541081 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2375/4841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:12 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1323 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:13.026193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1b256db5-4e50-4c6e-af3f-a00c25f8f0b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:13.028692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1b256db5-4e50-4c6e-af3f-a00c25f8f0b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:13.037790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b256db5-4e50-4c6e-af3f-a00c25f8f0b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:13.039277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b256db5-4e50-4c6e-af3f-a00c25f8f0b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:13.040812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b256db5-4e50-4c6e-af3f-a00c25f8f0b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:13.042095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b256db5-4e50-4c6e-af3f-a00c25f8f0b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:13.130173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cfeacb71-2c2e-410a-a264-c68870fdabef tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:13.131879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cfeacb71-2c2e-410a-a264-c68870fdabef tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:13.138976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfeacb71-2c2e-410a-a264-c68870fdabef tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:13.139748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfeacb71-2c2e-410a-a264-c68870fdabef tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:13.141463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfeacb71-2c2e-410a-a264-c68870fdabef tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:13.142134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cfeacb71-2c2e-410a-a264-c68870fdabef tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:13.158285 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-cfeacb71-2c2e-410a-a264-c68870fdabef tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance d0d995f8-d42a-4848-8c2b-0ba8fb85618a could not be found. Feb 19 21:14:13.159298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cfeacb71-2c2e-410a-a264-c68870fdabef tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance d0d995f8-d42a-4848-8c2b-0ba8fb85618a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:13.160496 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cfeacb71-2c2e-410a-a264-c68870fdabef tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 404 len: 111 microversion: 2.1 time: 0.041360 Feb 19 21:14:13.161667 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2376/4842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:13 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:14:13.173998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c6075ef8-83da-444f-b0aa-73e3fd79b513 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '.version_select at 0x7f647915d700>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:13.211375 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c6075ef8-83da-444f-b0aa-73e3fd79b513 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-key-1506752270" status: 202 len: 0 microversion: 2.1 time: 0.040591 Feb 19 21:14:13.212454 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2377/4843] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Feb 19 21:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1506752270 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:14:13.390691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-910941130", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "d3b5c251-7e40-4705-8f65-349582f371c6"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:13.474237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] validate_networks() for [('d3b5c251-7e40-4705-8f65-349582f371c6', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:14:13.494069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1b256db5-4e50-4c6e-af3f-a00c25f8f0b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:13.527922 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1b256db5-4e50-4c6e-af3f-a00c25f8f0b4 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1508 microversion: 2.1 time: 0.506558 Feb 19 21:14:13.545413 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2467/4844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:13 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1508 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:13.551425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c198965-939e-4ab3-bda5-7ffaeb773f8d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "986bcdbd-6541-4e97-a01a-c58fbdba9f3c"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:13.553122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7c198965-939e-4ab3-bda5-7ffaeb773f8d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:13.559821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c198965-939e-4ab3-bda5-7ffaeb773f8d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:13.560617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c198965-939e-4ab3-bda5-7ffaeb773f8d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:13.561637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c198965-939e-4ab3-bda5-7ffaeb773f8d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:13.562287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c198965-939e-4ab3-bda5-7ffaeb773f8d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:13.690065 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-7c198965-939e-4ab3-bda5-7ffaeb773f8d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] HTTP exception thrown: Invalid volume: volume 986bcdbd-6541-4e97-a01a-c58fbdba9f3c is already attached to instances: 1fb9bd42-4d71-472f-937f-5a5192838186 Feb 19 21:14:13.690927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c198965-939e-4ab3-bda5-7ffaeb773f8d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Returning 400 to user: Invalid volume: volume 986bcdbd-6541-4e97-a01a-c58fbdba9f3c is already attached to instances: 1fb9bd42-4d71-472f-937f-5a5192838186 {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:13.691784 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c198965-939e-4ab3-bda5-7ffaeb773f8d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "POST /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145109 Feb 19 21:14:13.692408 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2468/4845] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:14:13 2022] POST /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:14:13.716134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2c277ce4-6b09-43ed-92c5-fd6a22d19b70 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:13.716927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2c277ce4-6b09-43ed-92c5-fd6a22d19b70 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:13.735487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c277ce4-6b09-43ed-92c5-fd6a22d19b70 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:13.736027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c277ce4-6b09-43ed-92c5-fd6a22d19b70 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:13.745476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c277ce4-6b09-43ed-92c5-fd6a22d19b70 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:13.746019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c277ce4-6b09-43ed-92c5-fd6a22d19b70 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:14.299189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2c277ce4-6b09-43ed-92c5-fd6a22d19b70 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:14.313690 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2c277ce4-6b09-43ed-92c5-fd6a22d19b70 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1323 microversion: 2.1 time: 0.607818 Feb 19 21:14:14.324423 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2469/4846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:13 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1323 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:14.330764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9e611b59-e1a6-41c8-9328-39b29db4a072 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:14.331611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9e611b59-e1a6-41c8-9328-39b29db4a072 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:14.341897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e611b59-e1a6-41c8-9328-39b29db4a072 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:14.345256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e611b59-e1a6-41c8-9328-39b29db4a072 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:14.348789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e611b59-e1a6-41c8-9328-39b29db4a072 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:14.349594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9e611b59-e1a6-41c8-9328-39b29db4a072 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:14.471224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-9e611b59-e1a6-41c8-9328-39b29db4a072 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lazy-loading 'services' on Instance uuid 1fb9bd42-4d71-472f-937f-5a5192838186 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:14:14.563440 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9e611b59-e1a6-41c8-9328-39b29db4a072 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186/os-volume_attachments/986bcdbd-6541-4e97-a01a-c58fbdba9f3c" status: 202 len: 0 microversion: 2.1 time: 0.237289 Feb 19 21:14:14.569792 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2470/4847] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:14:14 2022] DELETE /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186/os-volume_attachments/986bcdbd-6541-4e97-a01a-c58fbdba9f3c => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:14:14.576040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-08e4d2ba-da4e-4c6d-af54-3220da9ac378 req-b019169e-96dc-4e29-8579-10043c4b90d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ad378f-fdc8-4c27-a154-41419121c26a", "tag": "8ab5f58d-dfe5-4ba3-b14c-b348e44ce521"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:14.586829 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:14.586829 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:14:14.608264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-08e4d2ba-da4e-4c6d-af54-3220da9ac378 req-b019169e-96dc-4e29-8579-10043c4b90d5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:14.615359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-08e4d2ba-da4e-4c6d-af54-3220da9ac378 req-b019169e-96dc-4e29-8579-10043c4b90d5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:14.627569 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-08e4d2ba-da4e-4c6d-af54-3220da9ac378 req-b019169e-96dc-4e29-8579-10043c4b90d5 service nova] Creating event network-changed:8ab5f58d-dfe5-4ba3-b14c-b348e44ce521 for instance b3ad378f-fdc8-4c27-a154-41419121c26a on nch1-master-1 Feb 19 21:14:14.637263 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-08e4d2ba-da4e-4c6d-af54-3220da9ac378 req-b019169e-96dc-4e29-8579-10043c4b90d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065398 Feb 19 21:14:14.638251 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2471/4848] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:14.645932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9781613b-9477-4478-b635-50ce2c7db368 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:14.647254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9781613b-9477-4478-b635-50ce2c7db368 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:14.672691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9781613b-9477-4478-b635-50ce2c7db368 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:14.673523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9781613b-9477-4478-b635-50ce2c7db368 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:14.674606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9781613b-9477-4478-b635-50ce2c7db368 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:14.678660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9781613b-9477-4478-b635-50ce2c7db368 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:14.721992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:14:14.723169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:14:14.723799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:14:14.724312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:14:14.725636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:14:14.748010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:14.749360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:14.750817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:14.752159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:14.757245 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9781613b-9477-4478-b635-50ce2c7db368 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117004 Feb 19 21:14:14.769029 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2472/4849] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:14:14 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:14.781428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:14:14.787845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:14:14.802161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:14:14.804942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:14:14.874251 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a5212c10-4f95-4b17-8a64-328af6438d31 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.487701 Feb 19 21:14:14.876116 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2378/4850] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:14:14.886825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-939061d9-5faa-4256-b854-b2f5617d289c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:14.887562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-939061d9-5faa-4256-b854-b2f5617d289c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:14.995240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-939061d9-5faa-4256-b854-b2f5617d289c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:15.002911 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-939061d9-5faa-4256-b854-b2f5617d289c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1208 microversion: 2.1 time: 0.120370 Feb 19 21:14:15.003494 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2473/4851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:14 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1208 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:15.335234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4284d086-8618-4624-a150-a0b421be9598 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:15.336195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4284d086-8618-4624-a150-a0b421be9598 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:15.369066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4284d086-8618-4624-a150-a0b421be9598 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:15.369490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4284d086-8618-4624-a150-a0b421be9598 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:15.376658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4284d086-8618-4624-a150-a0b421be9598 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:15.377552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4284d086-8618-4624-a150-a0b421be9598 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:15.784621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e2671c6-7dbe-49b8-b11d-2e5b5255c1a7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:15.785787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e2671c6-7dbe-49b8-b11d-2e5b5255c1a7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:15.801934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e2671c6-7dbe-49b8-b11d-2e5b5255c1a7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:15.804509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e2671c6-7dbe-49b8-b11d-2e5b5255c1a7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:15.805425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e2671c6-7dbe-49b8-b11d-2e5b5255c1a7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:15.806598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e2671c6-7dbe-49b8-b11d-2e5b5255c1a7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:15.860213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4284d086-8618-4624-a150-a0b421be9598 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:15.870694 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4284d086-8618-4624-a150-a0b421be9598 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1323 microversion: 2.1 time: 0.542963 Feb 19 21:14:15.881942 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2379/4852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:15 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1323 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:15.882254 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6e2671c6-7dbe-49b8-b11d-2e5b5255c1a7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104130 Feb 19 21:14:15.885622 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2474/4853] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:14:15 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 21:14:16.020275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0e54cac2-6c15-4a4c-aabd-93d25c3bd366 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:16.021019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0e54cac2-6c15-4a4c-aabd-93d25c3bd366 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:16.029186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e54cac2-6c15-4a4c-aabd-93d25c3bd366 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:16.029635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e54cac2-6c15-4a4c-aabd-93d25c3bd366 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:16.032491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e54cac2-6c15-4a4c-aabd-93d25c3bd366 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:16.033177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e54cac2-6c15-4a4c-aabd-93d25c3bd366 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:16.114673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-703885836", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "5dcb556e-7200-41f7-af8e-4f52d2bfd4af"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:16.180773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] validate_networks() for [('5dcb556e-7200-41f7-af8e-4f52d2bfd4af', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:14:16.543546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0e54cac2-6c15-4a4c-aabd-93d25c3bd366 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:16.569321 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0e54cac2-6c15-4a4c-aabd-93d25c3bd366 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1260 microversion: 2.1 time: 0.552744 Feb 19 21:14:16.587265 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2380/4854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:16 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1260 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:16.898744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d69d5a2d-ba51-41b6-a590-17366e5af939 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:16.901602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d69d5a2d-ba51-41b6-a590-17366e5af939 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:16.910425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d69d5a2d-ba51-41b6-a590-17366e5af939 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:16.911140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d69d5a2d-ba51-41b6-a590-17366e5af939 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:16.912155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d69d5a2d-ba51-41b6-a590-17366e5af939 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:16.912891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d69d5a2d-ba51-41b6-a590-17366e5af939 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:17.419463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d69d5a2d-ba51-41b6-a590-17366e5af939 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:17.427633 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d69d5a2d-ba51-41b6-a590-17366e5af939 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1323 microversion: 2.1 time: 0.534156 Feb 19 21:14:17.439143 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2381/4855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:16 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1323 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:17.442028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:14:17.442880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:14:17.443421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:14:17.443850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:14:17.444269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:14:17.455410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:17.455872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:17.456863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:17.457385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:17.475660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Getting quotas for project 9f7a8678732a40b383cedd20600e102e. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:14:17.481230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Getting quotas for user 5e825e0ef42743238263e6758e53e28c and project 9f7a8678732a40b383cedd20600e102e. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:14:17.494772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:14:17.497174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:14:17.550466 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-99c09011-e9d7-40ce-88e1-754df34ccf63 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439795 Feb 19 21:14:17.551209 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2475/4856] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:14:17.566364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06de455c-bc47-4060-8294-483abde3104c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:17.567209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06de455c-bc47-4060-8294-483abde3104c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:17.596155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2b680988-9e64-4957-8ac1-98be3ea1c936 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:17.596832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2b680988-9e64-4957-8ac1-98be3ea1c936 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:17.609317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b680988-9e64-4957-8ac1-98be3ea1c936 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:17.610122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b680988-9e64-4957-8ac1-98be3ea1c936 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:17.611188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b680988-9e64-4957-8ac1-98be3ea1c936 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:17.611830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b680988-9e64-4957-8ac1-98be3ea1c936 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:17.712768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-06de455c-bc47-4060-8294-483abde3104c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:17.725776 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06de455c-bc47-4060-8294-483abde3104c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1217 microversion: 2.1 time: 0.163719 Feb 19 21:14:17.726461 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2382/4857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:17 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:17.773878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2b680988-9e64-4957-8ac1-98be3ea1c936 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:17.783984 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2b680988-9e64-4957-8ac1-98be3ea1c936 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1266 microversion: 2.1 time: 0.196553 Feb 19 21:14:17.784641 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2476/4858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:17 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:18.445939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7063bd02-7cfd-49b8-8dc6-c4913495c622 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:18.447465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7063bd02-7cfd-49b8-8dc6-c4913495c622 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:18.457130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7063bd02-7cfd-49b8-8dc6-c4913495c622 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:18.458011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7063bd02-7cfd-49b8-8dc6-c4913495c622 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:18.459201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7063bd02-7cfd-49b8-8dc6-c4913495c622 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:18.460362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7063bd02-7cfd-49b8-8dc6-c4913495c622 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:18.679707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7063bd02-7cfd-49b8-8dc6-c4913495c622 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:18.690720 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7063bd02-7cfd-49b8-8dc6-c4913495c622 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1323 microversion: 2.1 time: 0.248600 Feb 19 21:14:18.692179 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2383/4859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:18 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:18.742900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57ddec04-4628-4ab3-82d2-bac35a70517d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:18.744137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-57ddec04-4628-4ab3-82d2-bac35a70517d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:18.751927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57ddec04-4628-4ab3-82d2-bac35a70517d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:18.752660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57ddec04-4628-4ab3-82d2-bac35a70517d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:18.753619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57ddec04-4628-4ab3-82d2-bac35a70517d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:18.754217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57ddec04-4628-4ab3-82d2-bac35a70517d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:18.801645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-87f41893-3837-4da7-a6f8-71e5b0bcf97c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:18.802626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-87f41893-3837-4da7-a6f8-71e5b0bcf97c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:18.813697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87f41893-3837-4da7-a6f8-71e5b0bcf97c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:18.814236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87f41893-3837-4da7-a6f8-71e5b0bcf97c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:18.815467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87f41893-3837-4da7-a6f8-71e5b0bcf97c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:18.816097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87f41893-3837-4da7-a6f8-71e5b0bcf97c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:18.882641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57ddec04-4628-4ab3-82d2-bac35a70517d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:18.904073 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-57ddec04-4628-4ab3-82d2-bac35a70517d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1269 microversion: 2.1 time: 0.164664 Feb 19 21:14:18.907085 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2477/4860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:18 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:19.478029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-038ad7cb-81c0-44a7-a6c1-f11b0369ec92 req-57464cbb-ace6-447d-9e18-af431c1dd865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4819c51a-7d85-497a-8852-84fad8704ddf", "tag": "012d99e0-2593-45ae-8b96-96e14113b289"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:19.479866 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:19.479866 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:14:19.489508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-038ad7cb-81c0-44a7-a6c1-f11b0369ec92 req-57464cbb-ace6-447d-9e18-af431c1dd865 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:19.490047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-038ad7cb-81c0-44a7-a6c1-f11b0369ec92 req-57464cbb-ace6-447d-9e18-af431c1dd865 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:19.502827 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-038ad7cb-81c0-44a7-a6c1-f11b0369ec92 req-57464cbb-ace6-447d-9e18-af431c1dd865 service nova] Creating event network-changed:012d99e0-2593-45ae-8b96-96e14113b289 for instance 4819c51a-7d85-497a-8852-84fad8704ddf on nch2-master-1 Feb 19 21:14:19.508883 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-038ad7cb-81c0-44a7-a6c1-f11b0369ec92 req-57464cbb-ace6-447d-9e18-af431c1dd865 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037565 Feb 19 21:14:19.510197 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2478/4861] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:19.633824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-87f41893-3837-4da7-a6f8-71e5b0bcf97c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:19.643335 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-87f41893-3837-4da7-a6f8-71e5b0bcf97c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1308 microversion: 2.1 time: 0.845433 Feb 19 21:14:19.643939 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2384/4862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:18 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1308 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:19.711441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5faad7a5-80a2-430a-8a3e-74188d869a18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:19.712667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5faad7a5-80a2-430a-8a3e-74188d869a18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:19.721251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5faad7a5-80a2-430a-8a3e-74188d869a18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:19.721714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5faad7a5-80a2-430a-8a3e-74188d869a18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:19.722694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5faad7a5-80a2-430a-8a3e-74188d869a18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:19.723154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5faad7a5-80a2-430a-8a3e-74188d869a18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:19.922914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c1aeab5f-9352-46e6-832d-2b9462f378e1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:19.923863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c1aeab5f-9352-46e6-832d-2b9462f378e1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:19.937033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1aeab5f-9352-46e6-832d-2b9462f378e1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:19.938987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1aeab5f-9352-46e6-832d-2b9462f378e1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:19.940041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1aeab5f-9352-46e6-832d-2b9462f378e1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:19.940727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1aeab5f-9352-46e6-832d-2b9462f378e1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:20.123653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c1aeab5f-9352-46e6-832d-2b9462f378e1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:20.131527 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c1aeab5f-9352-46e6-832d-2b9462f378e1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1275 microversion: 2.1 time: 0.212313 Feb 19 21:14:20.132422 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2385/4863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:19 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:20.246508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5faad7a5-80a2-430a-8a3e-74188d869a18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:20.255593 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5faad7a5-80a2-430a-8a3e-74188d869a18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1323 microversion: 2.1 time: 0.551085 Feb 19 21:14:20.256551 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2479/4864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:19 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1323 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:20.662956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bb2b1d2f-b23a-4428-a61e-8b35d6af39fd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:20.664853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bb2b1d2f-b23a-4428-a61e-8b35d6af39fd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:20.674787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb2b1d2f-b23a-4428-a61e-8b35d6af39fd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:20.675457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb2b1d2f-b23a-4428-a61e-8b35d6af39fd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:20.676484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb2b1d2f-b23a-4428-a61e-8b35d6af39fd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:20.677244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bb2b1d2f-b23a-4428-a61e-8b35d6af39fd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:20.969473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1850af5a-ce61-448c-8797-eae29f4b106c req-64e11094-edc7-4492-88ca-a50ebc17e6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ad378f-fdc8-4c27-a154-41419121c26a", "name": "network-vif-plugged", "status": "completed", "tag": "8ab5f58d-dfe5-4ba3-b14c-b348e44ce521"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:20.973265 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:20.973265 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:14:20.985278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1850af5a-ce61-448c-8797-eae29f4b106c req-64e11094-edc7-4492-88ca-a50ebc17e6b8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:20.988475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1850af5a-ce61-448c-8797-eae29f4b106c req-64e11094-edc7-4492-88ca-a50ebc17e6b8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:21.008665 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1850af5a-ce61-448c-8797-eae29f4b106c req-64e11094-edc7-4492-88ca-a50ebc17e6b8 service nova] Creating event network-vif-plugged:8ab5f58d-dfe5-4ba3-b14c-b348e44ce521 for instance b3ad378f-fdc8-4c27-a154-41419121c26a on nch1-master-1 Feb 19 21:14:21.016092 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1850af5a-ce61-448c-8797-eae29f4b106c req-64e11094-edc7-4492-88ca-a50ebc17e6b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051116 Feb 19 21:14:21.017605 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2480/4865] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:14:21.151126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7aef2874-22f0-4ad6-bd07-b45f383d2fde tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:21.152742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7aef2874-22f0-4ad6-bd07-b45f383d2fde tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:21.164794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aef2874-22f0-4ad6-bd07-b45f383d2fde tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:21.169384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aef2874-22f0-4ad6-bd07-b45f383d2fde tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:21.170662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aef2874-22f0-4ad6-bd07-b45f383d2fde tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:21.171315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aef2874-22f0-4ad6-bd07-b45f383d2fde tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:21.691077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bb2b1d2f-b23a-4428-a61e-8b35d6af39fd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:21.699294 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bb2b1d2f-b23a-4428-a61e-8b35d6af39fd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1308 microversion: 2.1 time: 1.041311 Feb 19 21:14:21.710235 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2386/4866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:20 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1308 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:21.715650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-902e1a12-a2f0-4763-8970-0a9d73e963cb tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:21.716472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-902e1a12-a2f0-4763-8970-0a9d73e963cb tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:21.723562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-902e1a12-a2f0-4763-8970-0a9d73e963cb tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:21.724281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-902e1a12-a2f0-4763-8970-0a9d73e963cb tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:21.725328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-902e1a12-a2f0-4763-8970-0a9d73e963cb tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:21.725990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-902e1a12-a2f0-4763-8970-0a9d73e963cb tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:21.896092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7aef2874-22f0-4ad6-bd07-b45f383d2fde tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:21.911535 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7aef2874-22f0-4ad6-bd07-b45f383d2fde tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 0.763299 Feb 19 21:14:21.912571 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2481/4867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:21 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:22.061300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-902e1a12-a2f0-4763-8970-0a9d73e963cb tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:22.075064 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-902e1a12-a2f0-4763-8970-0a9d73e963cb tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1323 microversion: 2.1 time: 0.363395 Feb 19 21:14:22.075680 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2387/4868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:21 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:22.719371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9c0714f7-335e-42d4-bad0-5a520355aa4d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:22.720006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9c0714f7-335e-42d4-bad0-5a520355aa4d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:22.753185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c0714f7-335e-42d4-bad0-5a520355aa4d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:22.754144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c0714f7-335e-42d4-bad0-5a520355aa4d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:22.755356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c0714f7-335e-42d4-bad0-5a520355aa4d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:22.756225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c0714f7-335e-42d4-bad0-5a520355aa4d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:22.906957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-21b37403-63b1-4cbd-baef-1f520764542b req-d43723d3-ea97-40f3-ab8a-ef3c604431bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76b930a3-3352-432b-a506-7782e9a22efe", "tag": "9f45f4da-a05f-4f9c-bf37-98035a0c7170"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:22.908551 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:22.908551 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:14:22.937203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-21b37403-63b1-4cbd-baef-1f520764542b req-d43723d3-ea97-40f3-ab8a-ef3c604431bf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:22.938281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-21b37403-63b1-4cbd-baef-1f520764542b req-d43723d3-ea97-40f3-ab8a-ef3c604431bf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:22.964468 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-21b37403-63b1-4cbd-baef-1f520764542b req-d43723d3-ea97-40f3-ab8a-ef3c604431bf service nova] Creating event network-changed:9f45f4da-a05f-4f9c-bf37-98035a0c7170 for instance 76b930a3-3352-432b-a506-7782e9a22efe on nch2-master-1 Feb 19 21:14:22.978405 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-21b37403-63b1-4cbd-baef-1f520764542b req-d43723d3-ea97-40f3-ab8a-ef3c604431bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073250 Feb 19 21:14:22.979658 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2388/4869] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:22.988847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9c82fae7-3512-4913-9039-8089b51b3e0a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:22.989559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9c82fae7-3512-4913-9039-8089b51b3e0a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:22.999650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c82fae7-3512-4913-9039-8089b51b3e0a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:23.001346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c82fae7-3512-4913-9039-8089b51b3e0a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:23.005120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c82fae7-3512-4913-9039-8089b51b3e0a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:23.006221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c82fae7-3512-4913-9039-8089b51b3e0a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:23.200276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9c0714f7-335e-42d4-bad0-5a520355aa4d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:23.216065 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9c0714f7-335e-42d4-bad0-5a520355aa4d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1308 microversion: 2.1 time: 0.500818 Feb 19 21:14:23.217650 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2482/4870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:22 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1308 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:23.224736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6d13263d-f5ff-4996-ae36-7056e3ed65ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:23.225653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6d13263d-f5ff-4996-ae36-7056e3ed65ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:23.238904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d13263d-f5ff-4996-ae36-7056e3ed65ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:23.238904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d13263d-f5ff-4996-ae36-7056e3ed65ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:23.238904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d13263d-f5ff-4996-ae36-7056e3ed65ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:23.238904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6d13263d-f5ff-4996-ae36-7056e3ed65ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:23.486114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9c82fae7-3512-4913-9039-8089b51b3e0a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:23.494315 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9c82fae7-3512-4913-9039-8089b51b3e0a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 0.511918 Feb 19 21:14:23.495510 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2389/4871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:22 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:23.710533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6d13263d-f5ff-4996-ae36-7056e3ed65ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:23.718383 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6d13263d-f5ff-4996-ae36-7056e3ed65ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1519 microversion: 2.1 time: 0.499336 Feb 19 21:14:23.719605 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2483/4872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:23 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1519 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:23.784178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-14dafc37-3692-4332-8673-0cf4e9c030ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1072776869", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1a11fd51-a195-4c65-859d-a83464dc0844"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:23.788385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-14dafc37-3692-4332-8673-0cf4e9c030ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:23.788385 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-14dafc37-3692-4332-8673-0cf4e9c030ca tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.009229 Feb 19 21:14:23.793622 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2390/4873] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:23 2022] POST /compute/v2.1/servers => generated 175 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:14:23.800299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5dd0b98-0bd3-4aa0-9bd9-5acf7234e586 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:23.800863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a5dd0b98-0bd3-4aa0-9bd9-5acf7234e586 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: 80fc4843-0daf-45e1-a6f1-439fbadb15dd] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:23.807115 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a5dd0b98-0bd3-4aa0-9bd9-5acf7234e586 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] HTTP exception thrown: Instance 80fc4843-0daf-45e1-a6f1-439fbadb15dd could not be found. Feb 19 21:14:23.807887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5dd0b98-0bd3-4aa0-9bd9-5acf7234e586 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Returning 404 to user: Instance 80fc4843-0daf-45e1-a6f1-439fbadb15dd could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:23.808947 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a5dd0b98-0bd3-4aa0-9bd9-5acf7234e586 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/80fc4843-0daf-45e1-a6f1-439fbadb15dd/metadata" status: 404 len: 111 microversion: 2.1 time: 0.013306 Feb 19 21:14:23.809513 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2484/4874] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 21:14:23 2022] GET /compute/v2.1/servers/80fc4843-0daf-45e1-a6f1-439fbadb15dd/metadata => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:14:23.871944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-42abb808-aabb-45a6-a995-c95eddc064af tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1616826988", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1a11fd51-a195-4c65-859d-a83464dc0844"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:23.873460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-42abb808-aabb-45a6-a995-c95eddc064af tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:23.874650 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-42abb808-aabb-45a6-a995-c95eddc064af tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.006798 Feb 19 21:14:23.876000 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2391/4875] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:23 2022] POST /compute/v2.1/servers => generated 687 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:14:23.959396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b91e1a20-1ca3-461f-9e1f-d7990e74f215 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1176435211", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1a11fd51-a195-4c65-859d-a83464dc0844"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:23.961244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b91e1a20-1ca3-461f-9e1f-d7990e74f215 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:23.973237 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b91e1a20-1ca3-461f-9e1f-d7990e74f215 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.019676 Feb 19 21:14:23.975249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2485/4876] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:23 2022] POST /compute/v2.1/servers => generated 689 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:14:24.047659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f3443d22-c9ab-45ac-a183-f141e21c1145 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1937376088", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1a11fd51-a195-4c65-859d-a83464dc0844"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:24.049367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f3443d22-c9ab-45ac-a183-f141e21c1145 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:24.050207 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f3443d22-c9ab-45ac-a183-f141e21c1145 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.011230 Feb 19 21:14:24.052615 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2392/4877] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:24 2022] POST /compute/v2.1/servers => generated 1197 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Feb 19 21:14:24.214119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-411d3032-173c-4d9b-adda-83bfb8e11cf3 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1476169527", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1a11fd51-a195-4c65-859d-a83464dc0844"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:24.217367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-411d3032-173c-4d9b-adda-83bfb8e11cf3 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:24.218970 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-411d3032-173c-4d9b-adda-83bfb8e11cf3 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010447 Feb 19 21:14:24.219862 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2486/4878] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Feb 19 21:14:24 2022] POST /compute/v2.1/servers => generated 2221 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Feb 19 21:14:24.231283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76ec3fbd-bfb2-41cd-92c8-8a4914291b77 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:24.232023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-76ec3fbd-bfb2-41cd-92c8-8a4914291b77 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: 6d1947b8-e029-47ad-b993-ce4747397711] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:24.237932 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-76ec3fbd-bfb2-41cd-92c8-8a4914291b77 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] HTTP exception thrown: Instance 6d1947b8-e029-47ad-b993-ce4747397711 could not be found. Feb 19 21:14:24.238522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76ec3fbd-bfb2-41cd-92c8-8a4914291b77 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Returning 404 to user: Instance 6d1947b8-e029-47ad-b993-ce4747397711 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:24.239543 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-76ec3fbd-bfb2-41cd-92c8-8a4914291b77 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/6d1947b8-e029-47ad-b993-ce4747397711/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.013253 Feb 19 21:14:24.245187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2520d3f7-6cf7-48bd-a4e7-3bab5247a96e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:24.246078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2520d3f7-6cf7-48bd-a4e7-3bab5247a96e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:24.250476 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2393/4879] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Feb 19 21:14:24 2022] GET /compute/v2.1/servers/6d1947b8-e029-47ad-b993-ce4747397711/metadata/test2 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:14:24.253676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2520d3f7-6cf7-48bd-a4e7-3bab5247a96e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:24.254242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2520d3f7-6cf7-48bd-a4e7-3bab5247a96e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:24.255153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2520d3f7-6cf7-48bd-a4e7-3bab5247a96e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:24.255699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2520d3f7-6cf7-48bd-a4e7-3bab5247a96e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:24.261778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c345be3-c776-44e1-878c-0c9e4997d8ce tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:24.262404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8c345be3-c776-44e1-878c-0c9e4997d8ce tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:24.269913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c345be3-c776-44e1-878c-0c9e4997d8ce tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:24.270535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c345be3-c776-44e1-878c-0c9e4997d8ce tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:24.271683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c345be3-c776-44e1-878c-0c9e4997d8ce tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:24.273116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c345be3-c776-44e1-878c-0c9e4997d8ce tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:24.312264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8c345be3-c776-44e1-878c-0c9e4997d8ce tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:14:24.429849 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c345be3-c776-44e1-878c-0c9e4997d8ce tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 204 len: 0 microversion: 2.1 time: 0.175552 Feb 19 21:14:24.430546 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2394/4880] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:14:24 2022] DELETE /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:14:24.441035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2cf82b43-6da5-4340-8e71-56df046ec77b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:24.442231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2cf82b43-6da5-4340-8e71-56df046ec77b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:24.450971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cf82b43-6da5-4340-8e71-56df046ec77b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:24.451803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cf82b43-6da5-4340-8e71-56df046ec77b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:24.453074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cf82b43-6da5-4340-8e71-56df046ec77b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:24.453621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2cf82b43-6da5-4340-8e71-56df046ec77b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:24.607414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2520d3f7-6cf7-48bd-a4e7-3bab5247a96e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:24.615878 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2520d3f7-6cf7-48bd-a4e7-3bab5247a96e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1308 microversion: 2.1 time: 0.375226 Feb 19 21:14:24.617378 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2487/4881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:24 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:24.624805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-542f87cf-a35d-4e36-94a3-767832eb0fb8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:24.626676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-542f87cf-a35d-4e36-94a3-767832eb0fb8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:24.633324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-542f87cf-a35d-4e36-94a3-767832eb0fb8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:24.634080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-542f87cf-a35d-4e36-94a3-767832eb0fb8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:24.635075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-542f87cf-a35d-4e36-94a3-767832eb0fb8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:24.635684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-542f87cf-a35d-4e36-94a3-767832eb0fb8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:25.065921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2cf82b43-6da5-4340-8e71-56df046ec77b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:25.079707 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2cf82b43-6da5-4340-8e71-56df046ec77b tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1525 microversion: 2.1 time: 0.644544 Feb 19 21:14:25.080311 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2395/4882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:24 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1525 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:25.192442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-542f87cf-a35d-4e36-94a3-767832eb0fb8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:25.201339 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-542f87cf-a35d-4e36-94a3-767832eb0fb8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 0.582580 Feb 19 21:14:25.201919 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2488/4883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:24 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:25.640156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c62367d4-d356-4b3b-a19e-28038bf0c335 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:25.643743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c62367d4-d356-4b3b-a19e-28038bf0c335 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:25.655806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c62367d4-d356-4b3b-a19e-28038bf0c335 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:25.660087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c62367d4-d356-4b3b-a19e-28038bf0c335 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:25.663119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c62367d4-d356-4b3b-a19e-28038bf0c335 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:25.663654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c62367d4-d356-4b3b-a19e-28038bf0c335 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:26.030584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c62367d4-d356-4b3b-a19e-28038bf0c335 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:26.038218 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c62367d4-d356-4b3b-a19e-28038bf0c335 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1308 microversion: 2.1 time: 0.408115 Feb 19 21:14:26.039402 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2396/4884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:25 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:26.101387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c707a6e-65b8-494f-a060-4b31a5d0cb2e tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:26.103250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c707a6e-65b8-494f-a060-4b31a5d0cb2e tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:26.114691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c707a6e-65b8-494f-a060-4b31a5d0cb2e tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:26.115545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c707a6e-65b8-494f-a060-4b31a5d0cb2e tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:26.117968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c707a6e-65b8-494f-a060-4b31a5d0cb2e tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:26.118667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c707a6e-65b8-494f-a060-4b31a5d0cb2e tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:26.218297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9d11073e-f374-43f1-8eb4-6d0190f79034 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:26.220191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9d11073e-f374-43f1-8eb4-6d0190f79034 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:26.231625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d11073e-f374-43f1-8eb4-6d0190f79034 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:26.244526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d11073e-f374-43f1-8eb4-6d0190f79034 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:26.247414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d11073e-f374-43f1-8eb4-6d0190f79034 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:26.249288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d11073e-f374-43f1-8eb4-6d0190f79034 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:26.557071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8c707a6e-65b8-494f-a060-4b31a5d0cb2e tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed46d2f9d344a398d541d54ae22b626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bf8706a07449ecbf023ba907fd7c38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:26.567157 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c707a6e-65b8-494f-a060-4b31a5d0cb2e tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 200 len: 1525 microversion: 2.1 time: 0.473516 Feb 19 21:14:26.569173 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2489/4885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:26 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 1525 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:26.665996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4e202465-6e29-4331-891b-bbb00ca1019d req-493c7a3e-5290-4401-881d-4c747c95940b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ad378f-fdc8-4c27-a154-41419121c26a", "name": "network-vif-deleted", "tag": "8ab5f58d-dfe5-4ba3-b14c-b348e44ce521"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:26.667794 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:26.667794 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:14:26.675870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4e202465-6e29-4331-891b-bbb00ca1019d req-493c7a3e-5290-4401-881d-4c747c95940b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:26.676595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4e202465-6e29-4331-891b-bbb00ca1019d req-493c7a3e-5290-4401-881d-4c747c95940b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:26.689116 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4e202465-6e29-4331-891b-bbb00ca1019d req-493c7a3e-5290-4401-881d-4c747c95940b service nova] Creating event network-vif-deleted:8ab5f58d-dfe5-4ba3-b14c-b348e44ce521 for instance b3ad378f-fdc8-4c27-a154-41419121c26a on nch1-master-1 Feb 19 21:14:26.694838 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4e202465-6e29-4331-891b-bbb00ca1019d req-493c7a3e-5290-4401-881d-4c747c95940b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033257 Feb 19 21:14:26.705103 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2490/4886] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:26.744654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9d11073e-f374-43f1-8eb4-6d0190f79034 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:26.755621 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9d11073e-f374-43f1-8eb4-6d0190f79034 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 0.540848 Feb 19 21:14:26.765139 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2397/4887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:26 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:27.058092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6776a881-fb6c-4775-acec-ab9cda6fc077 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:27.058889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6776a881-fb6c-4775-acec-ab9cda6fc077 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:27.066018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6776a881-fb6c-4775-acec-ab9cda6fc077 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:27.066612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6776a881-fb6c-4775-acec-ab9cda6fc077 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:27.067739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6776a881-fb6c-4775-acec-ab9cda6fc077 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:27.068443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6776a881-fb6c-4775-acec-ab9cda6fc077 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:27.354332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6776a881-fb6c-4775-acec-ab9cda6fc077 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:27.387687 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6776a881-fb6c-4775-acec-ab9cda6fc077 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1308 microversion: 2.1 time: 0.330110 Feb 19 21:14:27.388960 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2491/4888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:27 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:27.587584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-28bcedf9-cff6-4b69-8bdd-15675bc52f18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:27.596145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-28bcedf9-cff6-4b69-8bdd-15675bc52f18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] [instance: b3ad378f-fdc8-4c27-a154-41419121c26a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:27.614211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28bcedf9-cff6-4b69-8bdd-15675bc52f18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:27.614978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28bcedf9-cff6-4b69-8bdd-15675bc52f18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:27.615817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28bcedf9-cff6-4b69-8bdd-15675bc52f18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:27.616867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-28bcedf9-cff6-4b69-8bdd-15675bc52f18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:27.625098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-57d5e2ce-0093-4544-aa81-49001f644242 req-c983b9db-e1c4-4bd5-894a-71f60a3b8f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4819c51a-7d85-497a-8852-84fad8704ddf", "name": "network-vif-plugged", "status": "completed", "tag": "012d99e0-2593-45ae-8b96-96e14113b289"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:27.626903 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:27.626903 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:14:27.642523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-57d5e2ce-0093-4544-aa81-49001f644242 req-c983b9db-e1c4-4bd5-894a-71f60a3b8f93 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:27.643125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-57d5e2ce-0093-4544-aa81-49001f644242 req-c983b9db-e1c4-4bd5-894a-71f60a3b8f93 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:27.665983 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-28bcedf9-cff6-4b69-8bdd-15675bc52f18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] HTTP exception thrown: Instance b3ad378f-fdc8-4c27-a154-41419121c26a could not be found. Feb 19 21:14:27.666597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-28bcedf9-cff6-4b69-8bdd-15675bc52f18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] Returning 404 to user: Instance b3ad378f-fdc8-4c27-a154-41419121c26a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:27.669904 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-57d5e2ce-0093-4544-aa81-49001f644242 req-c983b9db-e1c4-4bd5-894a-71f60a3b8f93 service nova] Creating event network-vif-plugged:012d99e0-2593-45ae-8b96-96e14113b289 for instance 4819c51a-7d85-497a-8852-84fad8704ddf on nch2-master-1 Feb 19 21:14:27.670699 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-28bcedf9-cff6-4b69-8bdd-15675bc52f18 tempest-ServerMetadataNegativeTestJSON-1291089555 tempest-ServerMetadataNegativeTestJSON-1291089555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a" status: 404 len: 111 microversion: 2.1 time: 0.090554 Feb 19 21:14:27.671290 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2398/4889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:27 2022] GET /compute/v2.1/servers/b3ad378f-fdc8-4c27-a154-41419121c26a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:14:27.691394 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-57d5e2ce-0093-4544-aa81-49001f644242 req-c983b9db-e1c4-4bd5-894a-71f60a3b8f93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070592 Feb 19 21:14:27.695568 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2492/4890] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:27.776191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-deb5cbf2-681e-494c-80ff-a2065882e585 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:27.776847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-deb5cbf2-681e-494c-80ff-a2065882e585 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:27.784590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-deb5cbf2-681e-494c-80ff-a2065882e585 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:27.785035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-deb5cbf2-681e-494c-80ff-a2065882e585 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:27.786142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-deb5cbf2-681e-494c-80ff-a2065882e585 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:27.786893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-deb5cbf2-681e-494c-80ff-a2065882e585 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:28.117879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-deb5cbf2-681e-494c-80ff-a2065882e585 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:28.128579 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-deb5cbf2-681e-494c-80ff-a2065882e585 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 0.356086 Feb 19 21:14:28.129834 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2399/4891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:27 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:28.408121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cfda65a5-25c5-4845-87d8-c418096fc08a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:28.409137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cfda65a5-25c5-4845-87d8-c418096fc08a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:28.416914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfda65a5-25c5-4845-87d8-c418096fc08a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:28.417647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfda65a5-25c5-4845-87d8-c418096fc08a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:28.418969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfda65a5-25c5-4845-87d8-c418096fc08a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:28.419606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfda65a5-25c5-4845-87d8-c418096fc08a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:28.726501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cfda65a5-25c5-4845-87d8-c418096fc08a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:28.737434 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cfda65a5-25c5-4845-87d8-c418096fc08a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1308 microversion: 2.1 time: 0.333751 Feb 19 21:14:28.744815 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2493/4892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:28 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:29.147154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-12ce1898-c90a-4f88-8343-fa968fbcbc70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:29.148647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-12ce1898-c90a-4f88-8343-fa968fbcbc70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:29.157302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12ce1898-c90a-4f88-8343-fa968fbcbc70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:29.158265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12ce1898-c90a-4f88-8343-fa968fbcbc70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:29.159375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12ce1898-c90a-4f88-8343-fa968fbcbc70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:29.160033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12ce1898-c90a-4f88-8343-fa968fbcbc70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:29.758507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-55ea4717-992b-4825-b056-ef5ede40a2c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:29.760174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-55ea4717-992b-4825-b056-ef5ede40a2c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:29.772050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-55ea4717-992b-4825-b056-ef5ede40a2c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:29.774284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-55ea4717-992b-4825-b056-ef5ede40a2c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:29.775408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-55ea4717-992b-4825-b056-ef5ede40a2c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:29.777223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-55ea4717-992b-4825-b056-ef5ede40a2c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:29.868322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-12ce1898-c90a-4f88-8343-fa968fbcbc70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:29.887507 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-12ce1898-c90a-4f88-8343-fa968fbcbc70 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 0.744850 Feb 19 21:14:29.900452 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2400/4893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:29 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:30.109377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1691739162", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": "none"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:30.169358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:14:30.169964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:14:30.170234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:14:30.170640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:14:30.171044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:14:30.180723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:30.181402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:30.182407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:30.183000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:30.202699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Getting quotas for project a918d8dc64fe475f9f79a25749df103f. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:14:30.209380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Getting quotas for user 5263c2242ebb4de49dcefd4cdf52ffa4 and project a918d8dc64fe475f9f79a25749df103f. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:14:30.224017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-55ea4717-992b-4825-b056-ef5ede40a2c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:30.224178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:14:30.226948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:14:30.231826 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-55ea4717-992b-4825-b056-ef5ede40a2c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1489 microversion: 2.1 time: 0.478783 Feb 19 21:14:30.232446 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2494/4894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:29 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1489 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:30.310942 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a73c481f-1fe3-410c-9f4f-7fe14ff892b4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.362916 Feb 19 21:14:30.314186 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2401/4895] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Feb 19 21:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 367 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 19 21:14:30.324888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-17ff9594-97ab-4864-92e7-382f2e8107fb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:30.325524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17ff9594-97ab-4864-92e7-382f2e8107fb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:30.392268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-910941130", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "d3b5c251-7e40-4705-8f65-349582f371c6"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:30.486576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] validate_networks() for [('d3b5c251-7e40-4705-8f65-349582f371c6', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:14:30.506208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17ff9594-97ab-4864-92e7-382f2e8107fb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:30.514059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17ff9594-97ab-4864-92e7-382f2e8107fb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:30.516148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17ff9594-97ab-4864-92e7-382f2e8107fb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:30.517339 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-17ff9594-97ab-4864-92e7-382f2e8107fb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1278 microversion: 2.57 time: 0.196886 Feb 19 21:14:30.518091 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2495/4896] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:30 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:14:30.931728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-05f81ebe-7136-4976-b277-b0b295066f61 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:30.932434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-05f81ebe-7136-4976-b277-b0b295066f61 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:30.948314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-05f81ebe-7136-4976-b277-b0b295066f61 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:30.951799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-05f81ebe-7136-4976-b277-b0b295066f61 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:30.957334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-05f81ebe-7136-4976-b277-b0b295066f61 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:30.957986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-05f81ebe-7136-4976-b277-b0b295066f61 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:31.414335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:14:31.416008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:14:31.416925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:14:31.417634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:14:31.418545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:14:31.430406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:31.431247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:31.432349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:31.433684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:31.458955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:14:31.467581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:14:31.485156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:14:31.488907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:14:31.507680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-05f81ebe-7136-4976-b277-b0b295066f61 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:31.519343 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-05f81ebe-7136-4976-b277-b0b295066f61 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 0.597889 Feb 19 21:14:31.519976 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2496/4897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:30 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:31.541457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:31.542049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:31.548932 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8a725645-ff2c-45e0-8d2f-2eca877cdc09 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160867 Feb 19 21:14:31.550618 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2402/4898] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:14:31.560107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1f7440f8-48f7-43df-9105-783cd7553d10 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:31.565876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:31.569123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:31.569269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1f7440f8-48f7-43df-9105-783cd7553d10 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:31.570383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:31.572013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:31.821241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:31.822364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f7440f8-48f7-43df-9105-783cd7553d10 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:31.835414 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1f7440f8-48f7-43df-9105-783cd7553d10 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1208 microversion: 2.1 time: 0.278843 Feb 19 21:14:31.839144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:31.840189 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2403/4899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:31 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1208 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:31.852365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:31.855809 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b44b3145-f7d2-4a77-8744-693da7c53ccf tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1330 microversion: 2.57 time: 0.321569 Feb 19 21:14:31.862227 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2497/4900] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:31 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1330 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:32.554606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-646e3c52-eb52-45ec-afae-9930c6f9f026 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:32.558509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-646e3c52-eb52-45ec-afae-9930c6f9f026 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:32.567420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-646e3c52-eb52-45ec-afae-9930c6f9f026 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:32.570387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-646e3c52-eb52-45ec-afae-9930c6f9f026 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:32.571720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-646e3c52-eb52-45ec-afae-9930c6f9f026 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:32.573075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-646e3c52-eb52-45ec-afae-9930c6f9f026 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:32.857954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f62b067-e500-4fb6-a266-abd8c1922bc3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:32.858586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f62b067-e500-4fb6-a266-abd8c1922bc3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:32.858719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-646e3c52-eb52-45ec-afae-9930c6f9f026 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:32.866683 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-646e3c52-eb52-45ec-afae-9930c6f9f026 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 0.333395 Feb 19 21:14:32.866899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f62b067-e500-4fb6-a266-abd8c1922bc3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:32.867307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f62b067-e500-4fb6-a266-abd8c1922bc3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:32.868005 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2404/4901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:32 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:32.868137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f62b067-e500-4fb6-a266-abd8c1922bc3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:32.868579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f62b067-e500-4fb6-a266-abd8c1922bc3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:32.883485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:32.884094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:32.898310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:32.898780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:32.900123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:32.900550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:32.977676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1f62b067-e500-4fb6-a266-abd8c1922bc3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:32.995631 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f62b067-e500-4fb6-a266-abd8c1922bc3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1260 microversion: 2.1 time: 0.138732 Feb 19 21:14:32.997041 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2498/4902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:32 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1260 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:33.086946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:33.124700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:33.154246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:33.155916 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-79dcf05c-14f0-4154-9699-246a6c38fb4a tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1336 microversion: 2.57 time: 0.276221 Feb 19 21:14:33.157422 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2405/4903] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:32 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1336 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:33.677379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-68fb3025-00d8-494f-a0f4-a2eff058a20f req-930ed14b-efa2-4985-9e6c-7c1f025ed6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76b930a3-3352-432b-a506-7782e9a22efe", "name": "network-vif-plugged", "status": "completed", "tag": "9f45f4da-a05f-4f9c-bf37-98035a0c7170"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:33.679460 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:33.679460 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:14:33.690325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-68fb3025-00d8-494f-a0f4-a2eff058a20f req-930ed14b-efa2-4985-9e6c-7c1f025ed6d7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:33.690867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-68fb3025-00d8-494f-a0f4-a2eff058a20f req-930ed14b-efa2-4985-9e6c-7c1f025ed6d7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:33.721179 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-68fb3025-00d8-494f-a0f4-a2eff058a20f req-930ed14b-efa2-4985-9e6c-7c1f025ed6d7 service nova] Creating event network-vif-plugged:9f45f4da-a05f-4f9c-bf37-98035a0c7170 for instance 76b930a3-3352-432b-a506-7782e9a22efe on nch2-master-1 Feb 19 21:14:33.742350 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-68fb3025-00d8-494f-a0f4-a2eff058a20f req-930ed14b-efa2-4985-9e6c-7c1f025ed6d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068168 Feb 19 21:14:33.744487 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2499/4904] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:33.887123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f7ff226b-4d4d-46ba-955a-a6fb7ae1fc1c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:33.887758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f7ff226b-4d4d-46ba-955a-a6fb7ae1fc1c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:33.898161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7ff226b-4d4d-46ba-955a-a6fb7ae1fc1c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:33.899142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7ff226b-4d4d-46ba-955a-a6fb7ae1fc1c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:33.900483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7ff226b-4d4d-46ba-955a-a6fb7ae1fc1c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:33.901168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7ff226b-4d4d-46ba-955a-a6fb7ae1fc1c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:34.014764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5a886975-8ff7-4133-be79-f53a162596e1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:34.016204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5a886975-8ff7-4133-be79-f53a162596e1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:34.028239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a886975-8ff7-4133-be79-f53a162596e1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:34.028714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a886975-8ff7-4133-be79-f53a162596e1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:34.029515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a886975-8ff7-4133-be79-f53a162596e1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:34.029988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a886975-8ff7-4133-be79-f53a162596e1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:34.167318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5a886975-8ff7-4133-be79-f53a162596e1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:34.179037 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5a886975-8ff7-4133-be79-f53a162596e1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1266 microversion: 2.1 time: 0.168278 Feb 19 21:14:34.190186 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2500/4905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:34 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:34.195435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:34.196609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:34.221303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:34.222169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:34.224769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:34.225975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:34.684593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:34.705448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:34.713151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:34.714737 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d1466d3-196d-42ea-9d65-c48c011774d3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1336 microversion: 2.57 time: 0.522898 Feb 19 21:14:34.726627 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2501/4906] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:34 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1336 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:34.987619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f7ff226b-4d4d-46ba-955a-a6fb7ae1fc1c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:34.999454 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f7ff226b-4d4d-46ba-955a-a6fb7ae1fc1c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 1.116849 Feb 19 21:14:35.012067 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2406/4907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:33 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:35.212198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dcef5835-064e-42cc-a73c-7cc7eb2147d3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:35.212837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dcef5835-064e-42cc-a73c-7cc7eb2147d3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:35.229770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcef5835-064e-42cc-a73c-7cc7eb2147d3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:35.233628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcef5835-064e-42cc-a73c-7cc7eb2147d3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:35.235424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcef5835-064e-42cc-a73c-7cc7eb2147d3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:35.236739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcef5835-064e-42cc-a73c-7cc7eb2147d3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:35.547641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dcef5835-064e-42cc-a73c-7cc7eb2147d3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:35.564053 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dcef5835-064e-42cc-a73c-7cc7eb2147d3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1308 microversion: 2.1 time: 0.370191 Feb 19 21:14:35.564870 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2502/4908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:35 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:35.737676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:35.738290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:35.745600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:35.746048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:35.746842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:35.747280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:35.861772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:35.873487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:35.875728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:35.877171 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5762c965-874b-40fd-9fda-2db0fee37483 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1357 microversion: 2.57 time: 0.143698 Feb 19 21:14:35.877727 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2407/4909] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:35 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:35.896868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:35.898788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:35.918835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:35.919584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:35.921354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:35.922602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:35.923525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ce5d1bc5-3dda-4adf-b2e8-564f118e5050 req-40756660-91ba-4d45-93f5-e269f2c46849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fa017c-ffad-48ee-9373-656f213dda89", "tag": "e944839a-b42c-46af-832e-3765a3547680"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:35.927345 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:35.927345 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:14:35.954222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ce5d1bc5-3dda-4adf-b2e8-564f118e5050 req-40756660-91ba-4d45-93f5-e269f2c46849 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:35.955070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ce5d1bc5-3dda-4adf-b2e8-564f118e5050 req-40756660-91ba-4d45-93f5-e269f2c46849 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:35.988385 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ce5d1bc5-3dda-4adf-b2e8-564f118e5050 req-40756660-91ba-4d45-93f5-e269f2c46849 service nova] Creating event network-changed:e944839a-b42c-46af-832e-3765a3547680 for instance 22fa017c-ffad-48ee-9373-656f213dda89 on nch1-master-1 Feb 19 21:14:35.995194 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ce5d1bc5-3dda-4adf-b2e8-564f118e5050 req-40756660-91ba-4d45-93f5-e269f2c46849 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078719 Feb 19 21:14:35.996121 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2408/4910] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:14:36.020977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1f554d6-69ad-4154-8382-d9a2e0af16ae tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:36.021836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1f554d6-69ad-4154-8382-d9a2e0af16ae tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:36.029530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:14:36.029963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:14:36.030712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:14:36.031331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:14:36.031913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:14:36.045848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1f554d6-69ad-4154-8382-d9a2e0af16ae tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:36.046395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1f554d6-69ad-4154-8382-d9a2e0af16ae tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:36.049325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1f554d6-69ad-4154-8382-d9a2e0af16ae tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:36.049852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1f554d6-69ad-4154-8382-d9a2e0af16ae tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:36.108985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:36.122014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:36.123181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:36.124711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:36.127385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:36.206196 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-baa229fb-866d-4908-a565-f49f3efd5e78 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "POST /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4/action" status: 202 len: 1138 microversion: 2.57 time: 0.314488 Feb 19 21:14:36.208864 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2503/4911] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Feb 19 21:14:35 2022] POST /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4/action => generated 1138 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Feb 19 21:14:36.226292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:36.227758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:36.237441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:36.238195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:36.239849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:36.240636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:36.383395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:36.393222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:36.395166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:36.396788 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fe31c642-d706-4436-99b1-23240c73641d tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.174547 Feb 19 21:14:36.397626 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2504/4912] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:36 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:36.586466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c36f9c38-a68c-4385-943a-661d9aa989cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:36.587563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c36f9c38-a68c-4385-943a-661d9aa989cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:36.602717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c36f9c38-a68c-4385-943a-661d9aa989cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:36.603369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c36f9c38-a68c-4385-943a-661d9aa989cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:36.604794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c36f9c38-a68c-4385-943a-661d9aa989cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:36.605226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c36f9c38-a68c-4385-943a-661d9aa989cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:36.615069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e1f554d6-69ad-4154-8382-d9a2e0af16ae tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:36.626771 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1f554d6-69ad-4154-8382-d9a2e0af16ae tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1317 microversion: 2.1 time: 0.612451 Feb 19 21:14:36.627676 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2409/4913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:36 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:36.910003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c36f9c38-a68c-4385-943a-661d9aa989cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:36.921282 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c36f9c38-a68c-4385-943a-661d9aa989cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1308 microversion: 2.1 time: 0.342248 Feb 19 21:14:36.923051 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2505/4914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:36 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:37.418557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:37.419155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:37.429170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:37.430170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:37.431286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:37.432073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:37.520498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:37.536217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:37.538431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:37.541708 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-261a193d-7d51-4770-b17a-c9add8413312 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.126915 Feb 19 21:14:37.543421 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2410/4915] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:37 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:37.646452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-185d156d-b6b1-49e4-8bb0-7741aed14bd6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:37.647081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-185d156d-b6b1-49e4-8bb0-7741aed14bd6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:37.658812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-185d156d-b6b1-49e4-8bb0-7741aed14bd6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:37.659278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-185d156d-b6b1-49e4-8bb0-7741aed14bd6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:37.660084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-185d156d-b6b1-49e4-8bb0-7741aed14bd6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:37.662917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-185d156d-b6b1-49e4-8bb0-7741aed14bd6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:37.942206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-147270b0-0b5a-443b-a336-2103b7fffd04 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:37.942901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-147270b0-0b5a-443b-a336-2103b7fffd04 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:37.951088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-147270b0-0b5a-443b-a336-2103b7fffd04 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:37.951838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-147270b0-0b5a-443b-a336-2103b7fffd04 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:37.953571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-147270b0-0b5a-443b-a336-2103b7fffd04 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:37.954355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-147270b0-0b5a-443b-a336-2103b7fffd04 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:37.970838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-185d156d-b6b1-49e4-8bb0-7741aed14bd6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:37.982915 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-185d156d-b6b1-49e4-8bb0-7741aed14bd6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1507 microversion: 2.1 time: 0.340102 Feb 19 21:14:37.983612 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2506/4916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:37 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:38.358282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-147270b0-0b5a-443b-a336-2103b7fffd04 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:38.369270 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-147270b0-0b5a-443b-a336-2103b7fffd04 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1308 microversion: 2.1 time: 0.433006 Feb 19 21:14:38.371033 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2411/4917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:37 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:38.562520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:38.563178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:38.570710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:38.571470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:38.572372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:38.572889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:38.657107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:38.667579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:38.670552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:38.674333 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d73d0ec-76dd-4370-b228-51d444361d01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.116004 Feb 19 21:14:38.675497 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2507/4918] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:38 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:39.387638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-26a06e90-9b4b-4e64-a141-20f3fbf20a64 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:39.389143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-26a06e90-9b4b-4e64-a141-20f3fbf20a64 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:39.400263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26a06e90-9b4b-4e64-a141-20f3fbf20a64 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:39.400858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26a06e90-9b4b-4e64-a141-20f3fbf20a64 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:39.401937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26a06e90-9b4b-4e64-a141-20f3fbf20a64 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:39.402454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26a06e90-9b4b-4e64-a141-20f3fbf20a64 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:39.551992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-938f1f0b-5983-40d8-8473-9f210565f33c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "279e111c-6c3e-4e53-a347-c4612e7ecea6"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:39.553912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-938f1f0b-5983-40d8-8473-9f210565f33c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:39.560504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938f1f0b-5983-40d8-8473-9f210565f33c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:39.561278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938f1f0b-5983-40d8-8473-9f210565f33c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:39.562366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938f1f0b-5983-40d8-8473-9f210565f33c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:39.563261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-938f1f0b-5983-40d8-8473-9f210565f33c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:39.633252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-26a06e90-9b4b-4e64-a141-20f3fbf20a64 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:39.642958 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-26a06e90-9b4b-4e64-a141-20f3fbf20a64 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1308 microversion: 2.1 time: 0.259755 Feb 19 21:14:39.643550 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2412/4919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:39 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:39.706731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:39.707852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:39.715582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:39.717415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:39.719218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:39.720366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:39.821933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:39.839832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:39.841720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:39.847349 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e22fe3f9-39a6-4c72-b0f0-12be0e4cabed tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.156208 Feb 19 21:14:39.849665 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2413/4920] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:39 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:14:40.004707 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-938f1f0b-5983-40d8-8473-9f210565f33c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "POST /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453197 Feb 19 21:14:40.007850 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2508/4921] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:14:39 2022] POST /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:40.666530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d559b3b0-7232-4ff8-a4ca-1d8fa071cff9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:40.668517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d559b3b0-7232-4ff8-a4ca-1d8fa071cff9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:40.678276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d559b3b0-7232-4ff8-a4ca-1d8fa071cff9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:40.679285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d559b3b0-7232-4ff8-a4ca-1d8fa071cff9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:40.680978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d559b3b0-7232-4ff8-a4ca-1d8fa071cff9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:40.681803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d559b3b0-7232-4ff8-a4ca-1d8fa071cff9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:40.879065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:40.881133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:40.904659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:40.905714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:40.907512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:40.908272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:40.993965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d559b3b0-7232-4ff8-a4ca-1d8fa071cff9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:41.002705 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d559b3b0-7232-4ff8-a4ca-1d8fa071cff9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1308 microversion: 2.1 time: 0.344408 Feb 19 21:14:41.007925 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2414/4922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:40 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:41.058851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:41.092847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:41.097001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:41.099128 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9720198a-f78b-47f8-9f61-76e11699e469 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.228121 Feb 19 21:14:41.100176 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2509/4923] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:40 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:41.356666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d0edd5b0-a867-49fc-93a3-e222d25ccbb0 req-1432d48f-fe07-4b1d-a5e5-48a3e1895362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fa017c-ffad-48ee-9373-656f213dda89", "name": "network-vif-plugged", "status": "completed", "tag": "e944839a-b42c-46af-832e-3765a3547680"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:41.358507 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:41.358507 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:14:41.379779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d0edd5b0-a867-49fc-93a3-e222d25ccbb0 req-1432d48f-fe07-4b1d-a5e5-48a3e1895362 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:41.386243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d0edd5b0-a867-49fc-93a3-e222d25ccbb0 req-1432d48f-fe07-4b1d-a5e5-48a3e1895362 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:41.410432 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d0edd5b0-a867-49fc-93a3-e222d25ccbb0 req-1432d48f-fe07-4b1d-a5e5-48a3e1895362 service nova] Creating event network-vif-plugged:e944839a-b42c-46af-832e-3765a3547680 for instance 22fa017c-ffad-48ee-9373-656f213dda89 on nch1-master-1 Feb 19 21:14:41.428535 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d0edd5b0-a867-49fc-93a3-e222d25ccbb0 req-1432d48f-fe07-4b1d-a5e5-48a3e1895362 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076583 Feb 19 21:14:41.429173 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2415/4924] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:42.031191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a2019417-049f-4825-a2ee-9a82c92b9c59 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:42.032561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a2019417-049f-4825-a2ee-9a82c92b9c59 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:42.053269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2019417-049f-4825-a2ee-9a82c92b9c59 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:42.054159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2019417-049f-4825-a2ee-9a82c92b9c59 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:42.057141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2019417-049f-4825-a2ee-9a82c92b9c59 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:42.058705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2019417-049f-4825-a2ee-9a82c92b9c59 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:42.125687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:42.126619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:42.134942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:42.136907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:42.138397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:42.139067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:42.244995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:42.259652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:42.261621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:42.263002 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-446caffb-58ba-43ed-939b-cfffe084a8da tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.143724 Feb 19 21:14:42.278484 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2416/4925] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:42 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:42.693142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a2019417-049f-4825-a2ee-9a82c92b9c59 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:42.711036 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a2019417-049f-4825-a2ee-9a82c92b9c59 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1308 microversion: 2.1 time: 0.687319 Feb 19 21:14:42.712461 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2510/4926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:42 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1308 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:43.295418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:43.297781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:43.315130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.316006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.316875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.317404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.416688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:43.425595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-49ade30e-b381-4100-b62c-ba909313c331 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "279e111c-6c3e-4e53-a347-c4612e7ecea6"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:43.426722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-49ade30e-b381-4100-b62c-ba909313c331 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:43.432027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:43.433822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:43.434717 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d005809f-564f-4b7e-9b13-97ab7e020aae tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.143733 Feb 19 21:14:43.435472 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2417/4927] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:43 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:43.451667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49ade30e-b381-4100-b62c-ba909313c331 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.452133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49ade30e-b381-4100-b62c-ba909313c331 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.453103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49ade30e-b381-4100-b62c-ba909313c331 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.453451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49ade30e-b381-4100-b62c-ba909313c331 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.563134 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-49ade30e-b381-4100-b62c-ba909313c331 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] HTTP exception thrown: Invalid volume: volume 279e111c-6c3e-4e53-a347-c4612e7ecea6 is already attached to instances: 76b930a3-3352-432b-a506-7782e9a22efe Feb 19 21:14:43.563914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-49ade30e-b381-4100-b62c-ba909313c331 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Returning 400 to user: Invalid volume: volume 279e111c-6c3e-4e53-a347-c4612e7ecea6 is already attached to instances: 76b930a3-3352-432b-a506-7782e9a22efe {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:43.564685 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-49ade30e-b381-4100-b62c-ba909313c331 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "POST /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143504 Feb 19 21:14:43.569113 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2511/4928] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:14:43 2022] POST /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments => generated 174 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 19 21:14:43.639322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-be273ec4-a749-4252-accf-880ad258396e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:43.640291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-be273ec4-a749-4252-accf-880ad258396e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:43.646955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be273ec4-a749-4252-accf-880ad258396e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.647680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be273ec4-a749-4252-accf-880ad258396e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.649012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be273ec4-a749-4252-accf-880ad258396e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.649731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be273ec4-a749-4252-accf-880ad258396e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.730721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3d5a3d1-771a-4a38-ab7b-406ca7a4c555 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:43.731518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e3d5a3d1-771a-4a38-ab7b-406ca7a4c555 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:43.740811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3d5a3d1-771a-4a38-ab7b-406ca7a4c555 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.741894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3d5a3d1-771a-4a38-ab7b-406ca7a4c555 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.743091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3d5a3d1-771a-4a38-ab7b-406ca7a4c555 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.744115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3d5a3d1-771a-4a38-ab7b-406ca7a4c555 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.753437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-be273ec4-a749-4252-accf-880ad258396e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lazy-loading 'services' on Instance uuid 76b930a3-3352-432b-a506-7782e9a22efe {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:14:43.854922 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-be273ec4-a749-4252-accf-880ad258396e tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments/279e111c-6c3e-4e53-a347-c4612e7ecea6" status: 202 len: 0 microversion: 2.1 time: 0.219596 Feb 19 21:14:43.859042 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2418/4929] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:14:43 2022] DELETE /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments/279e111c-6c3e-4e53-a347-c4612e7ecea6 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:14:43.865251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b7f7cbcc-f8c3-485b-b99d-eeff819f4e4c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:43.866376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b7f7cbcc-f8c3-485b-b99d-eeff819f4e4c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:43.873125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbcc-f8c3-485b-b99d-eeff819f4e4c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.873951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbcc-f8c3-485b-b99d-eeff819f4e4c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.875586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbcc-f8c3-485b-b99d-eeff819f4e4c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:43.876293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbcc-f8c3-485b-b99d-eeff819f4e4c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:43.915741 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b7f7cbcc-f8c3-485b-b99d-eeff819f4e4c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054540 Feb 19 21:14:43.917298 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2419/4930] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:14:43 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:44.180486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e3d5a3d1-771a-4a38-ab7b-406ca7a4c555 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:44.201855 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e3d5a3d1-771a-4a38-ab7b-406ca7a4c555 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1488 microversion: 2.1 time: 0.475470 Feb 19 21:14:44.204811 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2512/4931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:43 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1488 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:44.222958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fe1b62ad-82aa-4362-acb6-effe671a956d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:44.224131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fe1b62ad-82aa-4362-acb6-effe671a956d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:44.235218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fe1b62ad-82aa-4362-acb6-effe671a956d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.236252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fe1b62ad-82aa-4362-acb6-effe671a956d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.237688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fe1b62ad-82aa-4362-acb6-effe671a956d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.238784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fe1b62ad-82aa-4362-acb6-effe671a956d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.460463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:44.461807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:44.475531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.476526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.479261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.480698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.518213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fe1b62ad-82aa-4362-acb6-effe671a956d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:44.535685 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fe1b62ad-82aa-4362-acb6-effe671a956d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1489 microversion: 2.1 time: 0.318866 Feb 19 21:14:44.550257 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2420/4932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:44 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1489 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:44.557674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8897d59f-b03d-494f-a503-be29073c1bea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:44.558678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8897d59f-b03d-494f-a503-be29073c1bea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:44.600969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8897d59f-b03d-494f-a503-be29073c1bea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.601816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8897d59f-b03d-494f-a503-be29073c1bea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.602906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8897d59f-b03d-494f-a503-be29073c1bea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.603404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8897d59f-b03d-494f-a503-be29073c1bea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.633253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:44.645950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:44.650643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:44.651875 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7b7d79f-3c4b-4687-bef6-216a7ddc3c8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.200259 Feb 19 21:14:44.652473 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2513/4933] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:44 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:44.837292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8897d59f-b03d-494f-a503-be29073c1bea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:44.846686 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8897d59f-b03d-494f-a503-be29073c1bea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1488 microversion: 2.1 time: 0.294926 Feb 19 21:14:44.847876 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2421/4934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:44 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1488 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:44.869150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-af60fc09-74e5-4881-8a6b-0fe725addff3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:44.874376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-af60fc09-74e5-4881-8a6b-0fe725addff3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:44.883636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af60fc09-74e5-4881-8a6b-0fe725addff3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.884406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af60fc09-74e5-4881-8a6b-0fe725addff3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.885422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af60fc09-74e5-4881-8a6b-0fe725addff3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.886031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af60fc09-74e5-4881-8a6b-0fe725addff3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.929475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fccc2747-a338-4f05-a73f-6f0faf6ba9c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:44.931302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fccc2747-a338-4f05-a73f-6f0faf6ba9c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:44.954606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fccc2747-a338-4f05-a73f-6f0faf6ba9c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.958418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fccc2747-a338-4f05-a73f-6f0faf6ba9c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.961546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fccc2747-a338-4f05-a73f-6f0faf6ba9c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:44.968132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fccc2747-a338-4f05-a73f-6f0faf6ba9c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:44.978693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-af60fc09-74e5-4881-8a6b-0fe725addff3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:14:45.031529 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fccc2747-a338-4f05-a73f-6f0faf6ba9c3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104868 Feb 19 21:14:45.036876 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2422/4935] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:14:44 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:14:45.249721 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-af60fc09-74e5-4881-8a6b-0fe725addff3 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 204 len: 0 microversion: 2.1 time: 0.387934 Feb 19 21:14:45.252874 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2514/4936] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:14:44 2022] DELETE /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:14:45.262661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5f8563cb-63d6-4014-a447-9efd163c92c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:45.263525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5f8563cb-63d6-4014-a447-9efd163c92c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:45.274138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f8563cb-63d6-4014-a447-9efd163c92c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:45.280599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f8563cb-63d6-4014-a447-9efd163c92c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:45.282242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f8563cb-63d6-4014-a447-9efd163c92c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:45.285432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f8563cb-63d6-4014-a447-9efd163c92c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:45.358750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-398070946", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "5dcb556e-7200-41f7-af8e-4f52d2bfd4af"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:45.458151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] validate_networks() for [('5dcb556e-7200-41f7-af8e-4f52d2bfd4af', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:14:45.862627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5f8563cb-63d6-4014-a447-9efd163c92c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:45.875286 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5f8563cb-63d6-4014-a447-9efd163c92c1 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1494 microversion: 2.1 time: 0.615089 Feb 19 21:14:45.879435 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2423/4937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:45 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1494 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:45.893311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:45.894610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:45.905944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:45.906904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:45.910344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:45.910808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:46.160777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:46.180490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:46.183163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:46.185507 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ab7a4c0f-bea5-4dfe-9500-382d9c43f7f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.304221 Feb 19 21:14:46.189978 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2424/4938] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:45 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:46.659753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:14:46.660701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:14:46.660701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:14:46.661079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:14:46.661662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:14:46.683995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:46.684680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:46.685661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:46.686254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:46.742842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Getting quotas for project 9f7a8678732a40b383cedd20600e102e. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:14:46.748774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Getting quotas for user 5e825e0ef42743238263e6758e53e28c and project 9f7a8678732a40b383cedd20600e102e. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:14:46.787918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:14:46.796947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:14:46.901733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98df1fd5-0272-48d8-b015-e140977b7180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:46.906341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-98df1fd5-0272-48d8-b015-e140977b7180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:46.943006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98df1fd5-0272-48d8-b015-e140977b7180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:46.943368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98df1fd5-0272-48d8-b015-e140977b7180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:46.944176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98df1fd5-0272-48d8-b015-e140977b7180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:46.944646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98df1fd5-0272-48d8-b015-e140977b7180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:46.957197 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f32b47af-7520-4403-bc6a-837a61bf8fea tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601245 Feb 19 21:14:46.961843 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2515/4939] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:14:46.979955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-12031aa0-527b-4f8f-86e1-2bcdb109c560 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:46.982004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-12031aa0-527b-4f8f-86e1-2bcdb109c560 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:47.177937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-12031aa0-527b-4f8f-86e1-2bcdb109c560 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:47.198172 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-12031aa0-527b-4f8f-86e1-2bcdb109c560 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1217 microversion: 2.1 time: 0.226611 Feb 19 21:14:47.201007 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2516/4940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:46 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:47.220908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:47.225737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:47.246600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:47.250850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:47.254500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:47.255223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:47.528287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:47.549228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98df1fd5-0272-48d8-b015-e140977b7180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:47.554322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:47.555922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:47.565440 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98df1fd5-0272-48d8-b015-e140977b7180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1494 microversion: 2.1 time: 0.672911 Feb 19 21:14:47.566306 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2425/4941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:46 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1494 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:14:47.569192 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f3887819-b159-4c56-836d-459d36df2653 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.356256 Feb 19 21:14:47.571483 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2517/4942] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:47 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:14:48.228101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a1d02cc2-3eac-4e79-a995-03faaa7aabd2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:48.231858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a1d02cc2-3eac-4e79-a995-03faaa7aabd2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:48.269513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1d02cc2-3eac-4e79-a995-03faaa7aabd2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:48.271147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1d02cc2-3eac-4e79-a995-03faaa7aabd2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:48.282798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1d02cc2-3eac-4e79-a995-03faaa7aabd2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:48.284508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1d02cc2-3eac-4e79-a995-03faaa7aabd2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:48.486188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a1d02cc2-3eac-4e79-a995-03faaa7aabd2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:48.504867 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a1d02cc2-3eac-4e79-a995-03faaa7aabd2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1269 microversion: 2.1 time: 0.288994 Feb 19 21:14:48.509540 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2426/4943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:48 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1269 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:48.529101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-dd683cd0-c4ec-4274-a5be-adef6b61631d req-cef6f3b6-a3d2-4b06-a962-e83558feb1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fa017c-ffad-48ee-9373-656f213dda89", "name": "network-vif-deleted", "tag": "e944839a-b42c-46af-832e-3765a3547680"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:48.532027 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:48.532027 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:14:48.551805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-dd683cd0-c4ec-4274-a5be-adef6b61631d req-cef6f3b6-a3d2-4b06-a962-e83558feb1c6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:48.556433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-dd683cd0-c4ec-4274-a5be-adef6b61631d req-cef6f3b6-a3d2-4b06-a962-e83558feb1c6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:48.595941 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-dd683cd0-c4ec-4274-a5be-adef6b61631d req-cef6f3b6-a3d2-4b06-a962-e83558feb1c6 service nova] Creating event network-vif-deleted:e944839a-b42c-46af-832e-3765a3547680 for instance 22fa017c-ffad-48ee-9373-656f213dda89 on nch1-master-1 Feb 19 21:14:48.605926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-67967f06-f1f0-4cc8-9514-ee5e964e594d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:48.607596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-67967f06-f1f0-4cc8-9514-ee5e964e594d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:48.611120 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-dd683cd0-c4ec-4274-a5be-adef6b61631d req-cef6f3b6-a3d2-4b06-a962-e83558feb1c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089780 Feb 19 21:14:48.620156 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2518/4944] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:48.628127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:48.635204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-67967f06-f1f0-4cc8-9514-ee5e964e594d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:48.636077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-67967f06-f1f0-4cc8-9514-ee5e964e594d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:48.637170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-67967f06-f1f0-4cc8-9514-ee5e964e594d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:48.638139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-67967f06-f1f0-4cc8-9514-ee5e964e594d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:48.666485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:48.681601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:48.682055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:48.703820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:48.703975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:49.273989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-67967f06-f1f0-4cc8-9514-ee5e964e594d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:49.285269 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-67967f06-f1f0-4cc8-9514-ee5e964e594d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 200 len: 1293 microversion: 2.1 time: 0.695571 Feb 19 21:14:49.293267 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2427/4945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:48 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 1293 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:49.323542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:49.333617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:49.340184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:49.341672 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c539d7f5-9704-4c88-9eae-f23fbb3d9dc9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.719738 Feb 19 21:14:49.342323 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2519/4946] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:48 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:49.527051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-42fbbe02-299a-4d85-8ec7-b0ed6b541913 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:49.527709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-42fbbe02-299a-4d85-8ec7-b0ed6b541913 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:49.535515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42fbbe02-299a-4d85-8ec7-b0ed6b541913 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:49.536235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42fbbe02-299a-4d85-8ec7-b0ed6b541913 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:49.537251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42fbbe02-299a-4d85-8ec7-b0ed6b541913 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:49.537894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42fbbe02-299a-4d85-8ec7-b0ed6b541913 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:49.630133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-42fbbe02-299a-4d85-8ec7-b0ed6b541913 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:49.645644 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-42fbbe02-299a-4d85-8ec7-b0ed6b541913 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1275 microversion: 2.1 time: 0.121933 Feb 19 21:14:49.648023 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2428/4947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:49 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:50.312725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ef977c2c-72a2-4c21-bef3-42703ed3d4b2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:50.313467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ef977c2c-72a2-4c21-bef3-42703ed3d4b2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:50.329911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef977c2c-72a2-4c21-bef3-42703ed3d4b2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.330967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef977c2c-72a2-4c21-bef3-42703ed3d4b2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.332628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef977c2c-72a2-4c21-bef3-42703ed3d4b2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.333534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ef977c2c-72a2-4c21-bef3-42703ed3d4b2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.368639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:50.370975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:50.379437 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ef977c2c-72a2-4c21-bef3-42703ed3d4b2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 22fa017c-ffad-48ee-9373-656f213dda89 could not be found. Feb 19 21:14:50.385661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ef977c2c-72a2-4c21-bef3-42703ed3d4b2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 22fa017c-ffad-48ee-9373-656f213dda89 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:50.389184 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ef977c2c-72a2-4c21-bef3-42703ed3d4b2 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 404 len: 111 microversion: 2.1 time: 0.081935 Feb 19 21:14:50.394977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.395906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.396742 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2520/4948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:50 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:14:50.397937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.398683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.412316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5af0f235-b048-4a91-b190-4aaa629f8179 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:50.413260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5af0f235-b048-4a91-b190-4aaa629f8179 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:50.429615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5af0f235-b048-4a91-b190-4aaa629f8179 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.433173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5af0f235-b048-4a91-b190-4aaa629f8179 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.436384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5af0f235-b048-4a91-b190-4aaa629f8179 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.438076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5af0f235-b048-4a91-b190-4aaa629f8179 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.488282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5af0f235-b048-4a91-b190-4aaa629f8179 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:14:50.564938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:50.579544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:50.582042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:50.583506 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-542280ca-f984-4b9f-99d4-06344ea8f978 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.220719 Feb 19 21:14:50.584792 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2429/4949] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:50 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:14:50.614465 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5af0f235-b048-4a91-b190-4aaa629f8179 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 204 len: 0 microversion: 2.1 time: 0.207900 Feb 19 21:14:50.616423 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2521/4950] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:14:50 2022] DELETE /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:14:50.628297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d0baef7-86bf-4ed3-a524-a38884851f12 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:50.629262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2d0baef7-86bf-4ed3-a524-a38884851f12 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:50.643014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0baef7-86bf-4ed3-a524-a38884851f12 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.643712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0baef7-86bf-4ed3-a524-a38884851f12 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.645045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0baef7-86bf-4ed3-a524-a38884851f12 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.645789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0baef7-86bf-4ed3-a524-a38884851f12 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.665945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2fe2ac62-7543-4f51-8ef7-23b07b03c02b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:50.667318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2fe2ac62-7543-4f51-8ef7-23b07b03c02b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:50.683671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fe2ac62-7543-4f51-8ef7-23b07b03c02b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.684373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fe2ac62-7543-4f51-8ef7-23b07b03c02b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.685011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fe2ac62-7543-4f51-8ef7-23b07b03c02b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:50.685387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2fe2ac62-7543-4f51-8ef7-23b07b03c02b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:50.928072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2fe2ac62-7543-4f51-8ef7-23b07b03c02b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:50.937065 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2fe2ac62-7543-4f51-8ef7-23b07b03c02b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1275 microversion: 2.1 time: 0.275992 Feb 19 21:14:50.941443 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2522/4951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:50 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:51.342631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d0baef7-86bf-4ed3-a524-a38884851f12 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:51.361318 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2d0baef7-86bf-4ed3-a524-a38884851f12 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1495 microversion: 2.1 time: 0.739758 Feb 19 21:14:51.362519 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2430/4952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:50 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1495 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:51.602303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:51.602923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:51.631865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:51.632564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:51.633543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:51.634327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:51.761404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:51.771709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:51.773270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:51.774455 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a3e7f9b3-35dd-449a-a362-3104ab4a75a4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.176008 Feb 19 21:14:51.775025 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2523/4953] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:51 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:51.960400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-94c90834-fa34-44fa-8e8f-425f665a87b2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:51.961250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-94c90834-fa34-44fa-8e8f-425f665a87b2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:51.979575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94c90834-fa34-44fa-8e8f-425f665a87b2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:51.980224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94c90834-fa34-44fa-8e8f-425f665a87b2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:51.981335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94c90834-fa34-44fa-8e8f-425f665a87b2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:51.981826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94c90834-fa34-44fa-8e8f-425f665a87b2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:52.378421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d50c5677-b68b-48de-bc02-6eada56fd807 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:52.379045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d50c5677-b68b-48de-bc02-6eada56fd807 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:52.391280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d50c5677-b68b-48de-bc02-6eada56fd807 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:52.391738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d50c5677-b68b-48de-bc02-6eada56fd807 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:52.393018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d50c5677-b68b-48de-bc02-6eada56fd807 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:52.396941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d50c5677-b68b-48de-bc02-6eada56fd807 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:53.149526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-94c90834-fa34-44fa-8e8f-425f665a87b2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:53.159843 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-94c90834-fa34-44fa-8e8f-425f665a87b2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1317 microversion: 2.1 time: 1.203722 Feb 19 21:14:53.163435 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2431/4954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:51 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1317 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:53.172741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:53.175829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:53.194291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:53.195027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:53.196244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:53.196867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:53.342426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:53.359816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:53.367705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:53.373406 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-91d314d5-17ec-41ba-87dd-e306349ba1e9 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.207621 Feb 19 21:14:53.379319 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2432/4955] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:53 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:53.388951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d50c5677-b68b-48de-bc02-6eada56fd807 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:53.398707 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d50c5677-b68b-48de-bc02-6eada56fd807 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1495 microversion: 2.1 time: 1.024269 Feb 19 21:14:53.400799 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2524/4956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:52 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1495 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:53.878887 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-91bce9b3-0099-4942-8560-f12f8f666d3d req-1513730e-f03b-439d-81f7-e189427b2d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28d5a7d-b392-4111-858b-f4c3609c3f20", "tag": "563b9354-91da-4442-9dd5-54c813f9d4b8"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:53.882355 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:53.882355 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:14:53.912915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-91bce9b3-0099-4942-8560-f12f8f666d3d req-1513730e-f03b-439d-81f7-e189427b2d84 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:53.913767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-91bce9b3-0099-4942-8560-f12f8f666d3d req-1513730e-f03b-439d-81f7-e189427b2d84 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:53.932121 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-91bce9b3-0099-4942-8560-f12f8f666d3d req-1513730e-f03b-439d-81f7-e189427b2d84 service nova] Creating event network-changed:563b9354-91da-4442-9dd5-54c813f9d4b8 for instance a28d5a7d-b392-4111-858b-f4c3609c3f20 on nch2-master-1 Feb 19 21:14:53.939497 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-91bce9b3-0099-4942-8560-f12f8f666d3d req-1513730e-f03b-439d-81f7-e189427b2d84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068762 Feb 19 21:14:53.940749 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2433/4957] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:54.185215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0f04249e-9c7a-445d-bfed-66cbfa948520 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:54.188677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0f04249e-9c7a-445d-bfed-66cbfa948520 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:54.205640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f04249e-9c7a-445d-bfed-66cbfa948520 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:54.206485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f04249e-9c7a-445d-bfed-66cbfa948520 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:54.207806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f04249e-9c7a-445d-bfed-66cbfa948520 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:54.208781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0f04249e-9c7a-445d-bfed-66cbfa948520 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:54.318552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c4a0b928-e2f4-4c8d-9849-e47e1d233834 req-85a66e80-7bef-4d2c-9264-dde58024bed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4819c51a-7d85-497a-8852-84fad8704ddf", "name": "network-vif-deleted", "tag": "012d99e0-2593-45ae-8b96-96e14113b289"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:54.320161 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:14:54.320161 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:14:54.333821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c4a0b928-e2f4-4c8d-9849-e47e1d233834 req-85a66e80-7bef-4d2c-9264-dde58024bed8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:54.337249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c4a0b928-e2f4-4c8d-9849-e47e1d233834 req-85a66e80-7bef-4d2c-9264-dde58024bed8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:54.355767 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c4a0b928-e2f4-4c8d-9849-e47e1d233834 req-85a66e80-7bef-4d2c-9264-dde58024bed8 service nova] Creating event network-vif-deleted:012d99e0-2593-45ae-8b96-96e14113b289 for instance 4819c51a-7d85-497a-8852-84fad8704ddf on nch2-master-1 Feb 19 21:14:54.365987 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c4a0b928-e2f4-4c8d-9849-e47e1d233834 req-85a66e80-7bef-4d2c-9264-dde58024bed8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051176 Feb 19 21:14:54.375973 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2434/4958] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:14:54.396183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:54.397315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:54.408499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:54.410940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:54.413763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:54.417058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:54.722331 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:54.757667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:54.760512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:54.762623 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3dd54dbf-7090-4890-a4b7-541284a74e8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.370601 Feb 19 21:14:54.775357 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2435/4959] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:54 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:14:54.780808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:54.791566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:54.799684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:54.800412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:54.801375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:54.802576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:54.844955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:54.845808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:54.846557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lazy-loading 'fault' on Instance uuid 4819c51a-7d85-497a-8852-84fad8704ddf {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:14:54.999203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:55.011254 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-192acc77-ae65-41a3-9413-e46ddc2a71bc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 200 len: 1298 microversion: 2.1 time: 0.234140 Feb 19 21:14:55.012505 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2436/4960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:54 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 1298 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:55.098459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0f04249e-9c7a-445d-bfed-66cbfa948520 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:55.110767 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0f04249e-9c7a-445d-bfed-66cbfa948520 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1317 microversion: 2.1 time: 0.930812 Feb 19 21:14:55.121637 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2525/4961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:54 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1317 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:55.795592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:55.801447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:55.817779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:55.818842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:55.820907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:55.821851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:55.992063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:56.029613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:56.031331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82a1866c-80b2-4f29-b155-4c3c878a2857 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:56.032042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-82a1866c-80b2-4f29-b155-4c3c878a2857 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:56.038805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:56.039326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82a1866c-80b2-4f29-b155-4c3c878a2857 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:56.039789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82a1866c-80b2-4f29-b155-4c3c878a2857 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:56.040297 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f0c84ca3-b920-4dc7-a7f3-7e9f8ed329d7 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.259141 Feb 19 21:14:56.040611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82a1866c-80b2-4f29-b155-4c3c878a2857 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:56.040959 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2437/4962] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:55 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:56.041079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82a1866c-80b2-4f29-b155-4c3c878a2857 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:56.101815 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-82a1866c-80b2-4f29-b155-4c3c878a2857 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 4819c51a-7d85-497a-8852-84fad8704ddf could not be found. Feb 19 21:14:56.102431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82a1866c-80b2-4f29-b155-4c3c878a2857 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 4819c51a-7d85-497a-8852-84fad8704ddf could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:14:56.103271 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-82a1866c-80b2-4f29-b155-4c3c878a2857 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 404 len: 111 microversion: 2.1 time: 0.077104 Feb 19 21:14:56.111487 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2526/4963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:56 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:14:56.135271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-10a38912-6f2a-46ef-bae9-d116bdb54b50 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:56.140809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-10a38912-6f2a-46ef-bae9-d116bdb54b50 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:56.162279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10a38912-6f2a-46ef-bae9-d116bdb54b50 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:56.162950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10a38912-6f2a-46ef-bae9-d116bdb54b50 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:56.164913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10a38912-6f2a-46ef-bae9-d116bdb54b50 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:56.166599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10a38912-6f2a-46ef-bae9-d116bdb54b50 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:56.352389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1093731940", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "d3b5c251-7e40-4705-8f65-349582f371c6"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:14:56.451362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] validate_networks() for [('d3b5c251-7e40-4705-8f65-349582f371c6', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:14:57.048848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-10a38912-6f2a-46ef-bae9-d116bdb54b50 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:57.073344 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-10a38912-6f2a-46ef-bae9-d116bdb54b50 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1317 microversion: 2.1 time: 0.946217 Feb 19 21:14:57.112382 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2438/4964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:56 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1317 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:57.133865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:57.136672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:57.155250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:57.156441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:57.162193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:57.163892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:57.378934 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:57.387793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:57.394599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:57.399253 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a0d97561-63bc-4003-99c7-f71382d40d51 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.285777 Feb 19 21:14:57.400321 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2439/4965] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:57 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:57.924752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:14:57.925766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:14:57.926460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:14:57.926882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:14:57.927308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:14:57.944683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:57.945140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:57.946419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:57.947061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:57.989169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:14:57.995735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:14:58.016205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:14:58.019198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:14:58.081280 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f28a906f-c169-44fa-b671-f02fdedd3f5a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732509 Feb 19 21:14:58.082657 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2527/4966] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:14:58.096916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e14770be-8c45-4708-97ee-77a179f97d62 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:58.097661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e14770be-8c45-4708-97ee-77a179f97d62 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:58.112228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aec43371-a9f2-44d0-8def-6fd6c926ed7b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:58.112900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aec43371-a9f2-44d0-8def-6fd6c926ed7b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:58.145810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aec43371-a9f2-44d0-8def-6fd6c926ed7b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:58.147144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aec43371-a9f2-44d0-8def-6fd6c926ed7b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:58.149291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aec43371-a9f2-44d0-8def-6fd6c926ed7b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:58.149923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aec43371-a9f2-44d0-8def-6fd6c926ed7b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:58.261474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e14770be-8c45-4708-97ee-77a179f97d62 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:58.278004 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e14770be-8c45-4708-97ee-77a179f97d62 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1209 microversion: 2.1 time: 0.189334 Feb 19 21:14:58.278651 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2440/4967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:58 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1209 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:58.420698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:58.421930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:58.434898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:58.435902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:58.436982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:58.437602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:58.530546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aec43371-a9f2-44d0-8def-6fd6c926ed7b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:58.543506 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aec43371-a9f2-44d0-8def-6fd6c926ed7b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1317 microversion: 2.1 time: 0.442716 Feb 19 21:14:58.552639 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2528/4968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:58 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:58.612222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:58.626021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:58.630822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:58.632316 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-64af2aed-15a7-4669-93b0-8d6a181c3624 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.217130 Feb 19 21:14:58.634760 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2441/4969] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:58 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:14:59.295053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c96fed40-f69d-42dd-b6e8-a9ec436bd46e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:59.296912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c96fed40-f69d-42dd-b6e8-a9ec436bd46e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:59.305215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c96fed40-f69d-42dd-b6e8-a9ec436bd46e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:59.306230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c96fed40-f69d-42dd-b6e8-a9ec436bd46e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:59.306671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c96fed40-f69d-42dd-b6e8-a9ec436bd46e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:59.307409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c96fed40-f69d-42dd-b6e8-a9ec436bd46e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:59.428564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c96fed40-f69d-42dd-b6e8-a9ec436bd46e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:59.444552 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c96fed40-f69d-42dd-b6e8-a9ec436bd46e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1261 microversion: 2.1 time: 0.153084 Feb 19 21:14:59.445662 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2529/4970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:59 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:14:59.570318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3ab163aa-95f3-4478-8306-cfb9a8607839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:59.571835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3ab163aa-95f3-4478-8306-cfb9a8607839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:59.581852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ab163aa-95f3-4478-8306-cfb9a8607839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:59.582304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ab163aa-95f3-4478-8306-cfb9a8607839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:59.583113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ab163aa-95f3-4478-8306-cfb9a8607839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:59.583556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ab163aa-95f3-4478-8306-cfb9a8607839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:59.654949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:14:59.655268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:14:59.663207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:59.663756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:59.664744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:14:59.665430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:14:59.791477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:59.801093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:59.803059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:59.804780 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-97718bc6-2c70-4c2a-a9ff-5937f4bfdfeb tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.154473 Feb 19 21:14:59.806033 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2530/4971] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:14:59 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:14:59.845669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3ab163aa-95f3-4478-8306-cfb9a8607839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:14:59.855369 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3ab163aa-95f3-4478-8306-cfb9a8607839 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1317 microversion: 2.1 time: 0.289058 Feb 19 21:14:59.860215 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2442/4972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:14:59 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:00.465166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-45a75c1e-7425-4df4-bdbe-36018f2870d5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:00.466057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-45a75c1e-7425-4df4-bdbe-36018f2870d5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:00.472605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45a75c1e-7425-4df4-bdbe-36018f2870d5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:00.473136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45a75c1e-7425-4df4-bdbe-36018f2870d5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:00.473863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45a75c1e-7425-4df4-bdbe-36018f2870d5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:00.474304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45a75c1e-7425-4df4-bdbe-36018f2870d5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:00.573285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-45a75c1e-7425-4df4-bdbe-36018f2870d5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:00.586713 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-45a75c1e-7425-4df4-bdbe-36018f2870d5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1267 microversion: 2.1 time: 0.125784 Feb 19 21:15:00.598440 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2531/4973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:00 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:00.828141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:00.829558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:00.861320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:00.861787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:00.863268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:00.863896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:00.880449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b6a6185c-c352-4b63-a1f2-73b097292c3b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:00.881152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b6a6185c-c352-4b63-a1f2-73b097292c3b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:00.893822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6a6185c-c352-4b63-a1f2-73b097292c3b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:00.894347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6a6185c-c352-4b63-a1f2-73b097292c3b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:00.901946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6a6185c-c352-4b63-a1f2-73b097292c3b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:00.905193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6a6185c-c352-4b63-a1f2-73b097292c3b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:01.004005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:01.036516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:01.048037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:01.052971 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a91d10ab-8ff8-46d0-a582-fb85d5b983fd tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.225878 Feb 19 21:15:01.055443 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2443/4974] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:15:00 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:15:01.415208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b6a6185c-c352-4b63-a1f2-73b097292c3b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:01.423696 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b6a6185c-c352-4b63-a1f2-73b097292c3b tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1317 microversion: 2.1 time: 0.550105 Feb 19 21:15:01.434042 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2532/4975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:00 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:01.606488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-170523b1-7f13-4e75-828d-0516bfc603e6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:01.607417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-170523b1-7f13-4e75-828d-0516bfc603e6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:01.616056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-170523b1-7f13-4e75-828d-0516bfc603e6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:01.616931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-170523b1-7f13-4e75-828d-0516bfc603e6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:01.617927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-170523b1-7f13-4e75-828d-0516bfc603e6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:01.618590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-170523b1-7f13-4e75-828d-0516bfc603e6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:01.966980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-210ca73e-5e79-4997-87d3-dbcfb4e84d6c req-7bcf0829-29ef-4e07-8a41-c72a35ef873c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd412862-beb2-41a2-9188-583a3f8c78b9", "tag": "9b47d2b0-1deb-47b3-ae15-ca797f7e5084"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:01.969392 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:01.969392 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:15:01.985916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-210ca73e-5e79-4997-87d3-dbcfb4e84d6c req-7bcf0829-29ef-4e07-8a41-c72a35ef873c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:01.986453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-210ca73e-5e79-4997-87d3-dbcfb4e84d6c req-7bcf0829-29ef-4e07-8a41-c72a35ef873c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:02.001468 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-210ca73e-5e79-4997-87d3-dbcfb4e84d6c req-7bcf0829-29ef-4e07-8a41-c72a35ef873c service nova] Creating event network-changed:9b47d2b0-1deb-47b3-ae15-ca797f7e5084 for instance cd412862-beb2-41a2-9188-583a3f8c78b9 on nch1-master-1 Feb 19 21:15:02.003528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-170523b1-7f13-4e75-828d-0516bfc603e6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:02.009054 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-210ca73e-5e79-4997-87d3-dbcfb4e84d6c req-7bcf0829-29ef-4e07-8a41-c72a35ef873c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045421 Feb 19 21:15:02.010333 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2533/4976] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:15:02.013400 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-170523b1-7f13-4e75-828d-0516bfc603e6 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1309 microversion: 2.1 time: 0.411159 Feb 19 21:15:02.025300 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2444/4977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:01 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1309 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:02.073642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:02.074736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:02.082942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:02.083642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:02.084882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:02.085564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:02.250073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:02.268884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:02.271826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:02.274403 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2b47ed3d-347c-4d1c-a5dc-caf364b37b01 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1366 microversion: 2.57 time: 0.205454 Feb 19 21:15:02.284421 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2534/4978] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:15:02 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:15:02.346033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-73973bf9-5293-4af9-8e0d-3feb434ed4f7 req-6cc74256-bfa8-4465-8e83-e714cefda0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28d5a7d-b392-4111-858b-f4c3609c3f20", "name": "network-vif-plugged", "status": "completed", "tag": "563b9354-91da-4442-9dd5-54c813f9d4b8"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:02.348400 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:02.348400 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:15:02.357183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-73973bf9-5293-4af9-8e0d-3feb434ed4f7 req-6cc74256-bfa8-4465-8e83-e714cefda0fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:02.357895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-73973bf9-5293-4af9-8e0d-3feb434ed4f7 req-6cc74256-bfa8-4465-8e83-e714cefda0fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:02.374059 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-73973bf9-5293-4af9-8e0d-3feb434ed4f7 req-6cc74256-bfa8-4465-8e83-e714cefda0fe service nova] Creating event network-vif-plugged:563b9354-91da-4442-9dd5-54c813f9d4b8 for instance a28d5a7d-b392-4111-858b-f4c3609c3f20 on nch2-master-1 Feb 19 21:15:02.380235 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-73973bf9-5293-4af9-8e0d-3feb434ed4f7 req-6cc74256-bfa8-4465-8e83-e714cefda0fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038740 Feb 19 21:15:02.381447 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2445/4979] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:02.456686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-392c9e35-955d-4e4c-8531-358a903228f2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:02.459461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-392c9e35-955d-4e4c-8531-358a903228f2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:02.483686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-392c9e35-955d-4e4c-8531-358a903228f2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:02.484991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-392c9e35-955d-4e4c-8531-358a903228f2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:02.486886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-392c9e35-955d-4e4c-8531-358a903228f2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:02.487838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-392c9e35-955d-4e4c-8531-358a903228f2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:03.035231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-24d58d9b-492f-4a2a-a96f-8c3ea75b04af tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:03.036080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-24d58d9b-492f-4a2a-a96f-8c3ea75b04af tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:03.047095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24d58d9b-492f-4a2a-a96f-8c3ea75b04af tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:03.052211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24d58d9b-492f-4a2a-a96f-8c3ea75b04af tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:03.053050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24d58d9b-492f-4a2a-a96f-8c3ea75b04af tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:03.053495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24d58d9b-492f-4a2a-a96f-8c3ea75b04af tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:03.288666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-392c9e35-955d-4e4c-8531-358a903228f2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:03.302775 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-392c9e35-955d-4e4c-8531-358a903228f2 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1317 microversion: 2.1 time: 0.863864 Feb 19 21:15:03.304357 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2535/4980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:02 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:03.311753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:03.314182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:03.321894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:03.322762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:03.323870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:03.324528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:03.417392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:03.429874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:03.431997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:03.435429 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-888268ff-f0aa-4651-b5d2-3023b00a7e2e tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1372 microversion: 2.57 time: 0.129449 Feb 19 21:15:03.445139 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2536/4981] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:15:03 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1372 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:15:03.445438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-24d58d9b-492f-4a2a-a96f-8c3ea75b04af tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:03.460640 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-24d58d9b-492f-4a2a-a96f-8c3ea75b04af tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1309 microversion: 2.1 time: 0.432395 Feb 19 21:15:03.463121 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2446/4982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:03 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:04.329878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14f4a918-260c-4f6d-ae21-0cde1a360774 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:04.333187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-14f4a918-260c-4f6d-ae21-0cde1a360774 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:04.341200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14f4a918-260c-4f6d-ae21-0cde1a360774 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:04.341654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14f4a918-260c-4f6d-ae21-0cde1a360774 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:04.342810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14f4a918-260c-4f6d-ae21-0cde1a360774 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:04.343695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14f4a918-260c-4f6d-ae21-0cde1a360774 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:04.489173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:04.490352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:04.497649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:04.498370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:04.499460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:04.500603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:04.639230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:04.648750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:04.650382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:04.651750 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7fa912e7-9346-4f88-afcb-06f09d9ae480 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1372 microversion: 2.57 time: 0.193628 Feb 19 21:15:04.664358 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2447/4983] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:15:04 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:15:04.668170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bad3bcf1-d066-4f1a-b73e-ddeabd478ff5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:04.669173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bad3bcf1-d066-4f1a-b73e-ddeabd478ff5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:04.677463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bad3bcf1-d066-4f1a-b73e-ddeabd478ff5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:04.677970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bad3bcf1-d066-4f1a-b73e-ddeabd478ff5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:04.679053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bad3bcf1-d066-4f1a-b73e-ddeabd478ff5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:04.679732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bad3bcf1-d066-4f1a-b73e-ddeabd478ff5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:04.726681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-14f4a918-260c-4f6d-ae21-0cde1a360774 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:04.737602 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14f4a918-260c-4f6d-ae21-0cde1a360774 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1317 microversion: 2.1 time: 0.418720 Feb 19 21:15:04.738208 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2537/4984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:04 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:04.941496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bad3bcf1-d066-4f1a-b73e-ddeabd478ff5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:04.952175 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bad3bcf1-d066-4f1a-b73e-ddeabd478ff5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1309 microversion: 2.1 time: 0.292030 Feb 19 21:15:04.954794 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2448/4985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:04 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1309 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:05.675020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:05.676442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:05.687666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:05.688122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:05.688967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:05.689411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:05.755004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6850b0e3-d18d-457e-af50-0f0d221ee851 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:05.755693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6850b0e3-d18d-457e-af50-0f0d221ee851 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:05.762380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6850b0e3-d18d-457e-af50-0f0d221ee851 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:05.762841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6850b0e3-d18d-457e-af50-0f0d221ee851 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:05.763632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6850b0e3-d18d-457e-af50-0f0d221ee851 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:05.764072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6850b0e3-d18d-457e-af50-0f0d221ee851 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:05.828852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:05.845892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:05.847572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:05.848899 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f52c5998-dcff-41da-979b-bb1727077413 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1357 microversion: 2.57 time: 0.178207 Feb 19 21:15:05.850954 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2538/4986] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:15:05 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 21:15:05.875324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-607940e0-37e0-423c-83e6-332559f437f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:05.875827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-607940e0-37e0-423c-83e6-332559f437f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:05.883059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-607940e0-37e0-423c-83e6-332559f437f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:05.883519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-607940e0-37e0-423c-83e6-332559f437f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:05.884321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-607940e0-37e0-423c-83e6-332559f437f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:05.884785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-607940e0-37e0-423c-83e6-332559f437f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:05.920439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-607940e0-37e0-423c-83e6-332559f437f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:15:06.019541 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-607940e0-37e0-423c-83e6-332559f437f4 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 204 len: 0 microversion: 2.57 time: 0.148065 Feb 19 21:15:06.020835 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2539/4987] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Feb 19 21:15:05 2022] DELETE /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 21:15:06.032011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec4ae8e7-4447-4c92-a5ac-8d39ec1598ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:06.036059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ec4ae8e7-4447-4c92-a5ac-8d39ec1598ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:06.052579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec4ae8e7-4447-4c92-a5ac-8d39ec1598ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:06.053037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec4ae8e7-4447-4c92-a5ac-8d39ec1598ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:06.053993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec4ae8e7-4447-4c92-a5ac-8d39ec1598ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:06.054521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec4ae8e7-4447-4c92-a5ac-8d39ec1598ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:06.220842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6850b0e3-d18d-457e-af50-0f0d221ee851 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:06.238263 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6850b0e3-d18d-457e-af50-0f0d221ee851 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1506 microversion: 2.1 time: 0.486938 Feb 19 21:15:06.251537 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2449/4988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:05 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:06.257141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:06.257674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:06.264406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:06.265688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:06.266919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:06.267578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:06.418016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:06.427605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:06.429494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:06.430897 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cdd4c3df-2ae0-437e-acb8-47b1e7159214 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1363 microversion: 2.57 time: 0.177876 Feb 19 21:15:06.431939 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2450/4989] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:15:06 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:15:06.565235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec4ae8e7-4447-4c92-a5ac-8d39ec1598ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:06.577622 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec4ae8e7-4447-4c92-a5ac-8d39ec1598ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1309 microversion: 2.1 time: 0.554505 Feb 19 21:15:06.578362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2540/4990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:06 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1309 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:07.162655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8c8b389b-1821-438f-88c9-6bb75d14cf78 req-84b08e27-efb3-48b7-97a8-072eed4b0fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd412862-beb2-41a2-9188-583a3f8c78b9", "name": "network-vif-plugged", "status": "completed", "tag": "9b47d2b0-1deb-47b3-ae15-ca797f7e5084"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:07.164392 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:07.164392 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:15:07.175886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8c8b389b-1821-438f-88c9-6bb75d14cf78 req-84b08e27-efb3-48b7-97a8-072eed4b0fce service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:07.176647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8c8b389b-1821-438f-88c9-6bb75d14cf78 req-84b08e27-efb3-48b7-97a8-072eed4b0fce service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:07.200375 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8c8b389b-1821-438f-88c9-6bb75d14cf78 req-84b08e27-efb3-48b7-97a8-072eed4b0fce service nova] Creating event network-vif-plugged:9b47d2b0-1deb-47b3-ae15-ca797f7e5084 for instance cd412862-beb2-41a2-9188-583a3f8c78b9 on nch1-master-1 Feb 19 21:15:07.208669 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8c8b389b-1821-438f-88c9-6bb75d14cf78 req-84b08e27-efb3-48b7-97a8-072eed4b0fce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051979 Feb 19 21:15:07.210378 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2451/4991] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:07.457399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:07.458874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:07.468044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:07.468908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:07.470231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:07.470966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:07.573337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:07.582714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:07.584613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5263c2242ebb4de49dcefd4cdf52ffa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a918d8dc64fe475f9f79a25749df103f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:07.585902 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5bc22326-6dbe-44cd-98a7-ffb912eb4df3 tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 200 len: 1363 microversion: 2.57 time: 0.134998 Feb 19 21:15:07.587046 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2541/4992] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:15:07 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 1363 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 21:15:07.596064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-08f58041-a03f-4406-9d32-ffb9a8a72b73 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:07.596798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-08f58041-a03f-4406-9d32-ffb9a8a72b73 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:07.605937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f58041-a03f-4406-9d32-ffb9a8a72b73 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:07.606629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f58041-a03f-4406-9d32-ffb9a8a72b73 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:07.607616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f58041-a03f-4406-9d32-ffb9a8a72b73 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:07.608217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-08f58041-a03f-4406-9d32-ffb9a8a72b73 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:07.684079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6021867b-8707-4f8d-8c57-52acc37bcdb6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85d7e961-c212-4d16-b876-da38ded42947"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:07.685642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6021867b-8707-4f8d-8c57-52acc37bcdb6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:07.698413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6021867b-8707-4f8d-8c57-52acc37bcdb6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:07.698888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6021867b-8707-4f8d-8c57-52acc37bcdb6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:07.700422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6021867b-8707-4f8d-8c57-52acc37bcdb6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:07.700674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6021867b-8707-4f8d-8c57-52acc37bcdb6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:07.911215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-08f58041-a03f-4406-9d32-ffb9a8a72b73 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:07.919372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-08f58041-a03f-4406-9d32-ffb9a8a72b73 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1309 microversion: 2.1 time: 0.328297 Feb 19 21:15:07.921298 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2452/4993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:07 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1309 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:08.012293 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6021867b-8707-4f8d-8c57-52acc37bcdb6 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "POST /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331703 Feb 19 21:15:08.013079 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2542/4994] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:15:07 2022] POST /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:08.608039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ceba3a8-0c12-4088-b7e1-3577895cec8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:08.609384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ceba3a8-0c12-4088-b7e1-3577895cec8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] [instance: fa06f77d-ee4b-4a09-bc87-a3764b2b59f4] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:08.619937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ceba3a8-0c12-4088-b7e1-3577895cec8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:08.620836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ceba3a8-0c12-4088-b7e1-3577895cec8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:08.621977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ceba3a8-0c12-4088-b7e1-3577895cec8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:08.622763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ceba3a8-0c12-4088-b7e1-3577895cec8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:08.641790 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-7ceba3a8-0c12-4088-b7e1-3577895cec8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] HTTP exception thrown: Instance fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 could not be found. Feb 19 21:15:08.642824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ceba3a8-0c12-4088-b7e1-3577895cec8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] Returning 404 to user: Instance fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:15:08.643967 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ceba3a8-0c12-4088-b7e1-3577895cec8b tempest-ServerShowV257Test-2144113726 tempest-ServerShowV257Test-2144113726-project] 10.222.0.30 "GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4" status: 404 len: 111 microversion: 2.57 time: 0.040813 Feb 19 21:15:08.645649 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2453/4995] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Feb 19 21:15:08 2022] GET /compute/v2.1/servers/fa06f77d-ee4b-4a09-bc87-a3764b2b59f4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:15:08.939616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1de7ea25-4158-4898-bebd-08baee8b1250 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:08.940556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1de7ea25-4158-4898-bebd-08baee8b1250 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:08.952938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1de7ea25-4158-4898-bebd-08baee8b1250 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:08.953473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1de7ea25-4158-4898-bebd-08baee8b1250 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:08.954338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1de7ea25-4158-4898-bebd-08baee8b1250 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:08.954897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1de7ea25-4158-4898-bebd-08baee8b1250 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:09.340650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1de7ea25-4158-4898-bebd-08baee8b1250 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:09.350041 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1de7ea25-4158-4898-bebd-08baee8b1250 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1490 microversion: 2.1 time: 0.416669 Feb 19 21:15:09.363517 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2543/4996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:08 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1490 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:09.372275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-01a12522-a38b-4426-990e-ae2ab417e180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:09.373916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-01a12522-a38b-4426-990e-ae2ab417e180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:09.381445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01a12522-a38b-4426-990e-ae2ab417e180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:09.382167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01a12522-a38b-4426-990e-ae2ab417e180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:09.385451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01a12522-a38b-4426-990e-ae2ab417e180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:09.386133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-01a12522-a38b-4426-990e-ae2ab417e180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:09.461451 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-01a12522-a38b-4426-990e-ae2ab417e180 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "PUT /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1085 microversion: 2.1 time: 0.093736 Feb 19 21:15:09.462180 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2454/4997] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 21:15:09 2022] PUT /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1085 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:09.477816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4fe8cb14-e1f3-481c-8ab2-435434a1a83a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:09.478726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4fe8cb14-e1f3-481c-8ab2-435434a1a83a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:09.485346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4fe8cb14-e1f3-481c-8ab2-435434a1a83a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:09.486249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4fe8cb14-e1f3-481c-8ab2-435434a1a83a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:09.487156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4fe8cb14-e1f3-481c-8ab2-435434a1a83a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:09.487898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4fe8cb14-e1f3-481c-8ab2-435434a1a83a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:09.685439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4fe8cb14-e1f3-481c-8ab2-435434a1a83a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:09.694737 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4fe8cb14-e1f3-481c-8ab2-435434a1a83a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1511 microversion: 2.1 time: 0.220819 Feb 19 21:15:09.695341 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2544/4998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:09 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:09.712802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13180dab-d5bd-4f05-9e4f-d31993782912 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:09.713710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-13180dab-d5bd-4f05-9e4f-d31993782912 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:09.731464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13180dab-d5bd-4f05-9e4f-d31993782912 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:09.731923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13180dab-d5bd-4f05-9e4f-d31993782912 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:09.733346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13180dab-d5bd-4f05-9e4f-d31993782912 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:09.735926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13180dab-d5bd-4f05-9e4f-d31993782912 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:09.973127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13180dab-d5bd-4f05-9e4f-d31993782912 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:09.984427 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13180dab-d5bd-4f05-9e4f-d31993782912 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1511 microversion: 2.1 time: 0.275237 Feb 19 21:15:09.986483 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2455/4999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:09 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:10.003727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d2a30bc5-c83e-4ab0-8d6b-ecb2230dceea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:10.013654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d2a30bc5-c83e-4ab0-8d6b-ecb2230dceea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:10.026411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2a30bc5-c83e-4ab0-8d6b-ecb2230dceea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:10.027628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2a30bc5-c83e-4ab0-8d6b-ecb2230dceea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:10.028781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2a30bc5-c83e-4ab0-8d6b-ecb2230dceea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:10.029418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d2a30bc5-c83e-4ab0-8d6b-ecb2230dceea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:10.062373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d2a30bc5-c83e-4ab0-8d6b-ecb2230dceea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:15:10.180669 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d2a30bc5-c83e-4ab0-8d6b-ecb2230dceea tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 204 len: 0 microversion: 2.1 time: 0.178717 Feb 19 21:15:10.184542 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2545/5000] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:15:09 2022] DELETE /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:15:10.190971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fbdd29a7-10ce-4972-ab9b-1f36873ee830 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:10.191776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fbdd29a7-10ce-4972-ab9b-1f36873ee830 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:10.199508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbdd29a7-10ce-4972-ab9b-1f36873ee830 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:10.200356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbdd29a7-10ce-4972-ab9b-1f36873ee830 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:10.201332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbdd29a7-10ce-4972-ab9b-1f36873ee830 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:10.201925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbdd29a7-10ce-4972-ab9b-1f36873ee830 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:10.527898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fbdd29a7-10ce-4972-ab9b-1f36873ee830 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:10.555750 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fbdd29a7-10ce-4972-ab9b-1f36873ee830 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1517 microversion: 2.1 time: 0.369492 Feb 19 21:15:10.568012 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2456/5001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:10 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1517 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:11.588569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b63775d-dc78-484c-a2aa-03b039bb0e3f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:11.589889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9b63775d-dc78-484c-a2aa-03b039bb0e3f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:11.608680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b63775d-dc78-484c-a2aa-03b039bb0e3f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:11.609618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b63775d-dc78-484c-a2aa-03b039bb0e3f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:11.610413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b63775d-dc78-484c-a2aa-03b039bb0e3f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:11.615964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b63775d-dc78-484c-a2aa-03b039bb0e3f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:12.030729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8a44e023-6b40-438e-b00c-10d1c20211f8 tempest-ExtensionsTest-268987014 tempest-ExtensionsTest-268987014-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:12.032720 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8a44e023-6b40-438e-b00c-10d1c20211f8 tempest-ExtensionsTest-268987014 tempest-ExtensionsTest-268987014-project] 10.222.0.30 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.388371 Feb 19 21:15:12.033278 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2457/5002] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Feb 19 21:15:11 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:15:12.039584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:12.040087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:12.058341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:12.059573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:12.061380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:12.063218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:12.121361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9b63775d-dc78-484c-a2aa-03b039bb0e3f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:12.129753 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b63775d-dc78-484c-a2aa-03b039bb0e3f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1517 microversion: 2.1 time: 0.545545 Feb 19 21:15:12.142333 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2546/5003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:11 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1517 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:12.168198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c8cc2f0b-2bf7-42fc-ab28-c0fd7e4c4800 tempest-ExtensionsTest-268987014 tempest-ExtensionsTest-268987014-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:12.178545 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c8cc2f0b-2bf7-42fc-ab28-c0fd7e4c4800 tempest-ExtensionsTest-268987014 tempest-ExtensionsTest-268987014-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.034763 Feb 19 21:15:12.183130 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2547/5004] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Feb 19 21:15:12 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:15:12.268625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lazy-loading 'services' on Instance uuid a28d5a7d-b392-4111-858b-f4c3609c3f20 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:15:12.424690 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c82b6a05-f5d0-4d38-b559-cafbc6c93e59 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20/os-volume_attachments/85d7e961-c212-4d16-b876-da38ded42947" status: 202 len: 0 microversion: 2.1 time: 0.389388 Feb 19 21:15:12.432595 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2458/5005] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:15:12 2022] DELETE /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20/os-volume_attachments/85d7e961-c212-4d16-b876-da38ded42947 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:15:12.439955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-074815fa-f35d-42ff-a193-acc48f15fbf3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:12.441985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-074815fa-f35d-42ff-a193-acc48f15fbf3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:12.475469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-074815fa-f35d-42ff-a193-acc48f15fbf3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:12.476106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-074815fa-f35d-42ff-a193-acc48f15fbf3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:12.486161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-074815fa-f35d-42ff-a193-acc48f15fbf3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:12.487124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-074815fa-f35d-42ff-a193-acc48f15fbf3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:12.578795 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-074815fa-f35d-42ff-a193-acc48f15fbf3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145618 Feb 19 21:15:12.579927 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2548/5006] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:15:12 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:12.728493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-33f55325-b2ff-42f9-b0a2-2b2957f55f99 req-00fe05f8-0589-4a2b-abf3-36f0b1b8255a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd412862-beb2-41a2-9188-583a3f8c78b9", "name": "network-vif-deleted", "tag": "9b47d2b0-1deb-47b3-ae15-ca797f7e5084"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:12.731093 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:12.731093 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:15:12.757397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-33f55325-b2ff-42f9-b0a2-2b2957f55f99 req-00fe05f8-0589-4a2b-abf3-36f0b1b8255a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:12.763469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-33f55325-b2ff-42f9-b0a2-2b2957f55f99 req-00fe05f8-0589-4a2b-abf3-36f0b1b8255a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:12.785906 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-33f55325-b2ff-42f9-b0a2-2b2957f55f99 req-00fe05f8-0589-4a2b-abf3-36f0b1b8255a service nova] Creating event network-vif-deleted:9b47d2b0-1deb-47b3-ae15-ca797f7e5084 for instance cd412862-beb2-41a2-9188-583a3f8c78b9 on nch1-master-1 Feb 19 21:15:12.794300 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-33f55325-b2ff-42f9-b0a2-2b2957f55f99 req-00fe05f8-0589-4a2b-abf3-36f0b1b8255a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073275 Feb 19 21:15:12.795354 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2459/5007] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:13.174695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:13.178818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:13.203777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:13.206410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:13.207554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:13.209910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:13.291835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:13.292995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:13.293702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lazy-loading 'fault' on Instance uuid cd412862-beb2-41a2-9188-583a3f8c78b9 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:15:13.506823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:13.517632 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cacc1945-d09f-472c-86b9-e5eed4a4134e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 200 len: 1320 microversion: 2.1 time: 0.351935 Feb 19 21:15:13.518371 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2549/5008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:13 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 1320 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:13.597599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-caf406b8-838f-4449-8c25-df89de73e21a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:13.600216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-caf406b8-838f-4449-8c25-df89de73e21a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:13.610425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-caf406b8-838f-4449-8c25-df89de73e21a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:13.611297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-caf406b8-838f-4449-8c25-df89de73e21a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:13.612698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-caf406b8-838f-4449-8c25-df89de73e21a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:13.613755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-caf406b8-838f-4449-8c25-df89de73e21a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:13.660374 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-caf406b8-838f-4449-8c25-df89de73e21a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070186 Feb 19 21:15:13.661456 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2460/5009] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:15:13 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:15:14.548969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27290d1b-8b40-44e3-88b8-b01fe6861a43 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:14.549703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-27290d1b-8b40-44e3-88b8-b01fe6861a43 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:14.565800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27290d1b-8b40-44e3-88b8-b01fe6861a43 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:14.570914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27290d1b-8b40-44e3-88b8-b01fe6861a43 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:14.576205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27290d1b-8b40-44e3-88b8-b01fe6861a43 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:14.576841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27290d1b-8b40-44e3-88b8-b01fe6861a43 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:14.617905 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-27290d1b-8b40-44e3-88b8-b01fe6861a43 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance cd412862-beb2-41a2-9188-583a3f8c78b9 could not be found. Feb 19 21:15:14.618529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27290d1b-8b40-44e3-88b8-b01fe6861a43 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance cd412862-beb2-41a2-9188-583a3f8c78b9 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:15:14.619387 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-27290d1b-8b40-44e3-88b8-b01fe6861a43 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 404 len: 111 microversion: 2.1 time: 0.075447 Feb 19 21:15:14.623350 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2550/5010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:14 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:15:14.911722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-864096782", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "d3b5c251-7e40-4705-8f65-349582f371c6"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:14.998541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] validate_networks() for [('d3b5c251-7e40-4705-8f65-349582f371c6', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:15:15.039366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-89e719e1-8a19-4023-9e12-259cb1ff1a76 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:15.039956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-89e719e1-8a19-4023-9e12-259cb1ff1a76 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:15.053405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89e719e1-8a19-4023-9e12-259cb1ff1a76 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:15.053865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89e719e1-8a19-4023-9e12-259cb1ff1a76 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:15.056630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89e719e1-8a19-4023-9e12-259cb1ff1a76 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:15.057193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89e719e1-8a19-4023-9e12-259cb1ff1a76 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:15.122673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-89e719e1-8a19-4023-9e12-259cb1ff1a76 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:15:15.332312 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-89e719e1-8a19-4023-9e12-259cb1ff1a76 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 204 len: 0 microversion: 2.1 time: 0.296218 Feb 19 21:15:15.334288 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2551/5011] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:15:15 2022] DELETE /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:15:15.352379 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5ea5a5a6-f46f-4197-8665-08697d8ac662 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:15.356279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5ea5a5a6-f46f-4197-8665-08697d8ac662 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:15.379317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ea5a5a6-f46f-4197-8665-08697d8ac662 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:15.380131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ea5a5a6-f46f-4197-8665-08697d8ac662 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:15.381633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ea5a5a6-f46f-4197-8665-08697d8ac662 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:15.382368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ea5a5a6-f46f-4197-8665-08697d8ac662 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:15.868750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5ea5a5a6-f46f-4197-8665-08697d8ac662 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:15.877903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:15:15.878819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:15:15.879935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:15:15.880905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:15:15.881731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:15:15.882791 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5ea5a5a6-f46f-4197-8665-08697d8ac662 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1512 microversion: 2.1 time: 0.544595 Feb 19 21:15:15.883690 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2552/5012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:15 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:15.911531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:15.912494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:15.913787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:15.914612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:15.968491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:15:15.988757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Getting quotas for user 614b36c5d1d64be3a2432a59a05c3dca and project ab36d6d50f8f40408962ab92e9cd1671. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:15:16.023785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:15:16.028104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:15:16.137716 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f5225154-3635-47f7-82a8-6e9a3d983686 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230147 Feb 19 21:15:16.138652 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2461/5013] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:15:16.148641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c06173e8-ae35-4247-b3f6-f5bcbbf821e0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:16.149364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c06173e8-ae35-4247-b3f6-f5bcbbf821e0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:16.316056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c06173e8-ae35-4247-b3f6-f5bcbbf821e0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:16.334611 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c06173e8-ae35-4247-b3f6-f5bcbbf821e0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1208 microversion: 2.1 time: 0.189714 Feb 19 21:15:16.335206 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2553/5014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:16 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1208 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:16.907559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5992a6ed-a1b1-4bab-b81c-77d5b78fb225 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:16.908573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5992a6ed-a1b1-4bab-b81c-77d5b78fb225 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:16.917436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5992a6ed-a1b1-4bab-b81c-77d5b78fb225 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:16.924436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5992a6ed-a1b1-4bab-b81c-77d5b78fb225 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:16.925757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5992a6ed-a1b1-4bab-b81c-77d5b78fb225 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:16.926395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5992a6ed-a1b1-4bab-b81c-77d5b78fb225 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:17.257051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5992a6ed-a1b1-4bab-b81c-77d5b78fb225 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:17.269029 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5992a6ed-a1b1-4bab-b81c-77d5b78fb225 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1512 microversion: 2.1 time: 0.365677 Feb 19 21:15:17.269831 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2462/5015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:16 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:17.358080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5721505-f8c2-4c2c-9116-e54edbc18fd5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:17.359020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a5721505-f8c2-4c2c-9116-e54edbc18fd5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:17.373730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5721505-f8c2-4c2c-9116-e54edbc18fd5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:17.374320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5721505-f8c2-4c2c-9116-e54edbc18fd5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:17.375590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5721505-f8c2-4c2c-9116-e54edbc18fd5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:17.376275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5721505-f8c2-4c2c-9116-e54edbc18fd5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:17.463237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a5721505-f8c2-4c2c-9116-e54edbc18fd5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:17.470882 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a5721505-f8c2-4c2c-9116-e54edbc18fd5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1260 microversion: 2.1 time: 0.117127 Feb 19 21:15:17.482529 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2554/5016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:17 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1260 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:17.688141 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:15:17.688486 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 21:15:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:15:18.299663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c0d90b9f-12c2-496a-87ab-1e510a1e9ee8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:18.300836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c0d90b9f-12c2-496a-87ab-1e510a1e9ee8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:18.315741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0d90b9f-12c2-496a-87ab-1e510a1e9ee8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:18.317456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0d90b9f-12c2-496a-87ab-1e510a1e9ee8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:18.319407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0d90b9f-12c2-496a-87ab-1e510a1e9ee8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:18.320629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0d90b9f-12c2-496a-87ab-1e510a1e9ee8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:18.489483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6de66f2d-4f33-49f3-a1a1-cf7dddfd1f5e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:18.491348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6de66f2d-4f33-49f3-a1a1-cf7dddfd1f5e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:18.506553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6de66f2d-4f33-49f3-a1a1-cf7dddfd1f5e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:18.513449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6de66f2d-4f33-49f3-a1a1-cf7dddfd1f5e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:18.519894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6de66f2d-4f33-49f3-a1a1-cf7dddfd1f5e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:18.521271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6de66f2d-4f33-49f3-a1a1-cf7dddfd1f5e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:18.738822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6de66f2d-4f33-49f3-a1a1-cf7dddfd1f5e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:18.763083 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6de66f2d-4f33-49f3-a1a1-cf7dddfd1f5e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1266 microversion: 2.1 time: 0.277261 Feb 19 21:15:18.768255 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2555/5017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:18 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:18.847311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c0d90b9f-12c2-496a-87ab-1e510a1e9ee8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:18.856264 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c0d90b9f-12c2-496a-87ab-1e510a1e9ee8 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1512 microversion: 2.1 time: 0.564946 Feb 19 21:15:18.856895 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2463/5018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:18 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1512 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:19.207598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-42b18b53-0af3-49c1-a8d3-ab46ebaf770d req-c70e4ea6-20f6-4d75-bd78-3897b22e5cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28d5a7d-b392-4111-858b-f4c3609c3f20", "name": "network-vif-deleted", "tag": "563b9354-91da-4442-9dd5-54c813f9d4b8"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:19.211660 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:19.211660 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:15:19.223502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-42b18b53-0af3-49c1-a8d3-ab46ebaf770d req-c70e4ea6-20f6-4d75-bd78-3897b22e5cbe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:19.223943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-42b18b53-0af3-49c1-a8d3-ab46ebaf770d req-c70e4ea6-20f6-4d75-bd78-3897b22e5cbe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:19.272663 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-42b18b53-0af3-49c1-a8d3-ab46ebaf770d req-c70e4ea6-20f6-4d75-bd78-3897b22e5cbe service nova] Creating event network-vif-deleted:563b9354-91da-4442-9dd5-54c813f9d4b8 for instance a28d5a7d-b392-4111-858b-f4c3609c3f20 on nch2-master-1 Feb 19 21:15:19.284407 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-42b18b53-0af3-49c1-a8d3-ab46ebaf770d req-c70e4ea6-20f6-4d75-bd78-3897b22e5cbe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080715 Feb 19 21:15:19.285291 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2556/5019] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:19.817270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d9e0108-e682-4193-a3c9-ec64db739ecd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:19.819439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2d9e0108-e682-4193-a3c9-ec64db739ecd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:19.844677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d9e0108-e682-4193-a3c9-ec64db739ecd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:19.845799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d9e0108-e682-4193-a3c9-ec64db739ecd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:19.847383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d9e0108-e682-4193-a3c9-ec64db739ecd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:19.848308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d9e0108-e682-4193-a3c9-ec64db739ecd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:19.881651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:19.883187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:19.896230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:19.898503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:19.899557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:19.909564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:20.002737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:20.003864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:20.004255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lazy-loading 'fault' on Instance uuid a28d5a7d-b392-4111-858b-f4c3609c3f20 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:15:20.279879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:20.296613 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5cccfc69-8775-4cdf-acbf-c8aed6c2633c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 200 len: 1307 microversion: 2.1 time: 0.418746 Feb 19 21:15:20.308375 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2557/5020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:19 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 1307 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:20.482724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d9e0108-e682-4193-a3c9-ec64db739ecd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:20.502081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2d9e0108-e682-4193-a3c9-ec64db739ecd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1308 microversion: 2.1 time: 0.711146 Feb 19 21:15:20.506066 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2464/5021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:19 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1308 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:21.323300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6827d74e-da59-41f5-b5ac-1c954599dff1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:21.325582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6827d74e-da59-41f5-b5ac-1c954599dff1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: a28d5a7d-b392-4111-858b-f4c3609c3f20] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:21.345706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6827d74e-da59-41f5-b5ac-1c954599dff1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:21.376552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d0e6053a-665a-4710-8917-61574b294efd req-a343b827-468e-491f-a790-1dedc3e99918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f147bf0-9df9-4222-85dc-df35ee5063b1", "tag": "3c00e454-f41f-4b4a-a75e-e389847f6009"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:21.378771 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:21.378771 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:15:21.380485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6827d74e-da59-41f5-b5ac-1c954599dff1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:21.383465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6827d74e-da59-41f5-b5ac-1c954599dff1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:21.383937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6827d74e-da59-41f5-b5ac-1c954599dff1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:21.393579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d0e6053a-665a-4710-8917-61574b294efd req-a343b827-468e-491f-a790-1dedc3e99918 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:21.398979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d0e6053a-665a-4710-8917-61574b294efd req-a343b827-468e-491f-a790-1dedc3e99918 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:21.430614 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-6827d74e-da59-41f5-b5ac-1c954599dff1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] HTTP exception thrown: Instance a28d5a7d-b392-4111-858b-f4c3609c3f20 could not be found. Feb 19 21:15:21.431220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6827d74e-da59-41f5-b5ac-1c954599dff1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Returning 404 to user: Instance a28d5a7d-b392-4111-858b-f4c3609c3f20 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:15:21.434040 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6827d74e-da59-41f5-b5ac-1c954599dff1 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20" status: 404 len: 111 microversion: 2.1 time: 0.118988 Feb 19 21:15:21.437182 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2558/5022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:21 2022] GET /compute/v2.1/servers/a28d5a7d-b392-4111-858b-f4c3609c3f20 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:15:21.440014 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d0e6053a-665a-4710-8917-61574b294efd req-a343b827-468e-491f-a790-1dedc3e99918 service nova] Creating event network-changed:3c00e454-f41f-4b4a-a75e-e389847f6009 for instance 8f147bf0-9df9-4222-85dc-df35ee5063b1 on nch1-master-1 Feb 19 21:15:21.458476 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d0e6053a-665a-4710-8917-61574b294efd req-a343b827-468e-491f-a790-1dedc3e99918 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083833 Feb 19 21:15:21.460592 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2465/5023] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:15:21.525674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d6da6c1f-522b-44cb-859a-8ae167ff12c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:21.526303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d6da6c1f-522b-44cb-859a-8ae167ff12c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:21.538383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6da6c1f-522b-44cb-859a-8ae167ff12c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:21.538905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6da6c1f-522b-44cb-859a-8ae167ff12c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:21.539744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6da6c1f-522b-44cb-859a-8ae167ff12c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:21.540546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d6da6c1f-522b-44cb-859a-8ae167ff12c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:22.464568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d6da6c1f-522b-44cb-859a-8ae167ff12c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:22.482857 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d6da6c1f-522b-44cb-859a-8ae167ff12c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1308 microversion: 2.1 time: 0.962103 Feb 19 21:15:22.489451 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2559/5024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:21 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1308 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:22.879009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dfa440c7-df9e-421b-8b67-18d86ddac7f0 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:22.880275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dfa440c7-df9e-421b-8b67-18d86ddac7f0 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:22.888578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dfa440c7-df9e-421b-8b67-18d86ddac7f0 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:22.889306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dfa440c7-df9e-421b-8b67-18d86ddac7f0 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:22.891260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dfa440c7-df9e-421b-8b67-18d86ddac7f0 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:22.892059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dfa440c7-df9e-421b-8b67-18d86ddac7f0 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:22.935087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dfa440c7-df9e-421b-8b67-18d86ddac7f0 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:15:23.116438 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dfa440c7-df9e-421b-8b67-18d86ddac7f0 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 204 len: 0 microversion: 2.1 time: 0.242654 Feb 19 21:15:23.127856 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2466/5025] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:15:22 2022] DELETE /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:15:23.131356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a6f7a70a-8da1-4223-bb90-47a40293bfb7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:23.132538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a6f7a70a-8da1-4223-bb90-47a40293bfb7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:23.139238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6f7a70a-8da1-4223-bb90-47a40293bfb7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:23.142564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6f7a70a-8da1-4223-bb90-47a40293bfb7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:23.144547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6f7a70a-8da1-4223-bb90-47a40293bfb7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:23.149241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6f7a70a-8da1-4223-bb90-47a40293bfb7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:23.508817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-12bef15d-be20-4ff0-bbff-544d58f5c9cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:23.510853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-12bef15d-be20-4ff0-bbff-544d58f5c9cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:23.524871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12bef15d-be20-4ff0-bbff-544d58f5c9cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:23.525427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12bef15d-be20-4ff0-bbff-544d58f5c9cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:23.526229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12bef15d-be20-4ff0-bbff-544d58f5c9cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:23.526850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12bef15d-be20-4ff0-bbff-544d58f5c9cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:23.607996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a6f7a70a-8da1-4223-bb90-47a40293bfb7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:23.620196 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a6f7a70a-8da1-4223-bb90-47a40293bfb7 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1513 microversion: 2.1 time: 0.498185 Feb 19 21:15:23.621412 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2560/5026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:23 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1513 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:23.917621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-12bef15d-be20-4ff0-bbff-544d58f5c9cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:23.930833 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-12bef15d-be20-4ff0-bbff-544d58f5c9cc tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1308 microversion: 2.1 time: 0.425903 Feb 19 21:15:23.933340 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2467/5027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:23 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1308 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:24.638507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b415495b-1d97-44b2-bae9-a69dfd532f18 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:24.640954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b415495b-1d97-44b2-bae9-a69dfd532f18 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:24.649768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b415495b-1d97-44b2-bae9-a69dfd532f18 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:24.650646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b415495b-1d97-44b2-bae9-a69dfd532f18 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:24.651670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b415495b-1d97-44b2-bae9-a69dfd532f18 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:24.652524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b415495b-1d97-44b2-bae9-a69dfd532f18 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:24.954003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a7e10313-d0e3-41f8-9d08-6f9a45d118ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:24.956020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a7e10313-d0e3-41f8-9d08-6f9a45d118ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:24.987434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7e10313-d0e3-41f8-9d08-6f9a45d118ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:24.988619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7e10313-d0e3-41f8-9d08-6f9a45d118ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:24.990295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7e10313-d0e3-41f8-9d08-6f9a45d118ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:24.991554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7e10313-d0e3-41f8-9d08-6f9a45d118ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:25.087104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b415495b-1d97-44b2-bae9-a69dfd532f18 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:25.100385 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b415495b-1d97-44b2-bae9-a69dfd532f18 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1513 microversion: 2.1 time: 0.464595 Feb 19 21:15:25.108555 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2561/5028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:24 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1513 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:25.368747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a7e10313-d0e3-41f8-9d08-6f9a45d118ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:25.386728 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a7e10313-d0e3-41f8-9d08-6f9a45d118ce tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1308 microversion: 2.1 time: 0.439450 Feb 19 21:15:25.394867 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2468/5029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:24 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:26.126487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f56d610-c535-456f-bdda-b1b6cee30153 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:26.131732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f56d610-c535-456f-bdda-b1b6cee30153 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:26.140984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-814d44e3-f2ab-4d25-b762-57eae1c28c2e req-863dd3f3-b898-4993-b7f3-76d323389aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76b930a3-3352-432b-a506-7782e9a22efe", "name": "network-vif-deleted", "tag": "9f45f4da-a05f-4f9c-bf37-98035a0c7170"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:26.143208 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:26.143208 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:15:26.153073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-814d44e3-f2ab-4d25-b762-57eae1c28c2e req-863dd3f3-b898-4993-b7f3-76d323389aba service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:26.153796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-814d44e3-f2ab-4d25-b762-57eae1c28c2e req-863dd3f3-b898-4993-b7f3-76d323389aba service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:26.167783 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-814d44e3-f2ab-4d25-b762-57eae1c28c2e req-863dd3f3-b898-4993-b7f3-76d323389aba service nova] Creating event network-vif-deleted:9f45f4da-a05f-4f9c-bf37-98035a0c7170 for instance 76b930a3-3352-432b-a506-7782e9a22efe on nch2-master-1 Feb 19 21:15:26.186358 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-814d44e3-f2ab-4d25-b762-57eae1c28c2e req-863dd3f3-b898-4993-b7f3-76d323389aba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038756 Feb 19 21:15:26.188372 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2469/5030] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:26.195031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f56d610-c535-456f-bdda-b1b6cee30153 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:26.195826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f56d610-c535-456f-bdda-b1b6cee30153 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:26.197545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f56d610-c535-456f-bdda-b1b6cee30153 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:26.211336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f56d610-c535-456f-bdda-b1b6cee30153 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:26.413279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-af15c4c0-5a12-4780-b8e6-f3e2febe5c78 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:26.414031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-af15c4c0-5a12-4780-b8e6-f3e2febe5c78 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:26.425420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af15c4c0-5a12-4780-b8e6-f3e2febe5c78 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:26.425888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af15c4c0-5a12-4780-b8e6-f3e2febe5c78 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:26.426693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af15c4c0-5a12-4780-b8e6-f3e2febe5c78 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:26.427129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af15c4c0-5a12-4780-b8e6-f3e2febe5c78 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:26.898880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1f56d610-c535-456f-bdda-b1b6cee30153 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:26.926381 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f56d610-c535-456f-bdda-b1b6cee30153 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 200 len: 1302 microversion: 2.1 time: 0.809712 Feb 19 21:15:26.928789 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2562/5031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:26 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 1302 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:26.960175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-af15c4c0-5a12-4780-b8e6-f3e2febe5c78 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:26.972214 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-af15c4c0-5a12-4780-b8e6-f3e2febe5c78 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1308 microversion: 2.1 time: 0.561418 Feb 19 21:15:26.995228 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2470/5032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:26 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1308 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:27.945729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4978d429-79c7-4b61-bbba-41a2311e2427 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:27.947569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4978d429-79c7-4b61-bbba-41a2311e2427 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 76b930a3-3352-432b-a506-7782e9a22efe] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:27.955943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4978d429-79c7-4b61-bbba-41a2311e2427 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:27.956931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4978d429-79c7-4b61-bbba-41a2311e2427 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:27.958259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4978d429-79c7-4b61-bbba-41a2311e2427 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:27.959092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4978d429-79c7-4b61-bbba-41a2311e2427 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:27.975621 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-4978d429-79c7-4b61-bbba-41a2311e2427 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] HTTP exception thrown: Instance 76b930a3-3352-432b-a506-7782e9a22efe could not be found. Feb 19 21:15:27.976483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4978d429-79c7-4b61-bbba-41a2311e2427 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Returning 404 to user: Instance 76b930a3-3352-432b-a506-7782e9a22efe could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:15:27.977738 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4978d429-79c7-4b61-bbba-41a2311e2427 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe" status: 404 len: 111 microversion: 2.1 time: 0.035926 Feb 19 21:15:27.990163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b4d2d2bb-e56c-4b6b-8005-f0184f71241a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:27.990888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b4d2d2bb-e56c-4b6b-8005-f0184f71241a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:27.995547 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2563/5033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:27 2022] GET /compute/v2.1/servers/76b930a3-3352-432b-a506-7782e9a22efe => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:15:28.003860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a738b894-6e14-412d-862b-d1ddf897c391 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:28.004542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4d2d2bb-e56c-4b6b-8005-f0184f71241a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:28.005268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4d2d2bb-e56c-4b6b-8005-f0184f71241a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:28.006471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4d2d2bb-e56c-4b6b-8005-f0184f71241a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:28.007120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4d2d2bb-e56c-4b6b-8005-f0184f71241a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:28.008545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a738b894-6e14-412d-862b-d1ddf897c391 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:28.022935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a738b894-6e14-412d-862b-d1ddf897c391 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:28.024986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a738b894-6e14-412d-862b-d1ddf897c391 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:28.028630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a738b894-6e14-412d-862b-d1ddf897c391 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:28.029537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a738b894-6e14-412d-862b-d1ddf897c391 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:28.062794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b4d2d2bb-e56c-4b6b-8005-f0184f71241a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:15:28.301002 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b4d2d2bb-e56c-4b6b-8005-f0184f71241a tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 204 len: 0 microversion: 2.1 time: 0.314781 Feb 19 21:15:28.302389 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2471/5034] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:15:27 2022] DELETE /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:15:28.314432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a487538f-b077-4c79-99bf-2dab9fc3d37f tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:28.322129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a487538f-b077-4c79-99bf-2dab9fc3d37f tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:28.332998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a738b894-6e14-412d-862b-d1ddf897c391 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:28.344795 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a738b894-6e14-412d-862b-d1ddf897c391 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1308 microversion: 2.1 time: 0.347595 Feb 19 21:15:28.349313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a487538f-b077-4c79-99bf-2dab9fc3d37f tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:28.350206 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2564/5035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:27 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:28.351352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a487538f-b077-4c79-99bf-2dab9fc3d37f tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:28.356804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a487538f-b077-4c79-99bf-2dab9fc3d37f tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:28.360638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a487538f-b077-4c79-99bf-2dab9fc3d37f tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:28.987259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a487538f-b077-4c79-99bf-2dab9fc3d37f tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:28.995184 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a487538f-b077-4c79-99bf-2dab9fc3d37f tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1514 microversion: 2.1 time: 0.688494 Feb 19 21:15:28.996544 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2472/5036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:28 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1514 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:29.318228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ff388a4d-604a-43ce-b55f-5a5d9fbd6980 req-46879314-d654-496a-a906-d3cb079833d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f147bf0-9df9-4222-85dc-df35ee5063b1", "name": "network-vif-plugged", "status": "completed", "tag": "3c00e454-f41f-4b4a-a75e-e389847f6009"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:29.322360 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:29.322360 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:15:29.333930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ff388a4d-604a-43ce-b55f-5a5d9fbd6980 req-46879314-d654-496a-a906-d3cb079833d4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:29.335295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ff388a4d-604a-43ce-b55f-5a5d9fbd6980 req-46879314-d654-496a-a906-d3cb079833d4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:29.354159 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ff388a4d-604a-43ce-b55f-5a5d9fbd6980 req-46879314-d654-496a-a906-d3cb079833d4 service nova] Creating event network-vif-plugged:3c00e454-f41f-4b4a-a75e-e389847f6009 for instance 8f147bf0-9df9-4222-85dc-df35ee5063b1 on nch1-master-1 Feb 19 21:15:29.363362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2e43e3dc-60a4-4b3b-9a83-ac331bc85cf4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:29.363986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2e43e3dc-60a4-4b3b-9a83-ac331bc85cf4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:29.365207 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ff388a4d-604a-43ce-b55f-5a5d9fbd6980 req-46879314-d654-496a-a906-d3cb079833d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051894 Feb 19 21:15:29.366566 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2565/5037] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:15:29.397150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e43e3dc-60a4-4b3b-9a83-ac331bc85cf4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:29.397992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e43e3dc-60a4-4b3b-9a83-ac331bc85cf4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:29.403716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e43e3dc-60a4-4b3b-9a83-ac331bc85cf4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:29.404990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2e43e3dc-60a4-4b3b-9a83-ac331bc85cf4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:29.766790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2e43e3dc-60a4-4b3b-9a83-ac331bc85cf4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:29.776622 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2e43e3dc-60a4-4b3b-9a83-ac331bc85cf4 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1308 microversion: 2.1 time: 0.417482 Feb 19 21:15:29.789435 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2473/5038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:29 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1308 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:30.033523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-463be897-2d82-4c32-a32a-fe321aa05612 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:30.035337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-463be897-2d82-4c32-a32a-fe321aa05612 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:30.052188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-463be897-2d82-4c32-a32a-fe321aa05612 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:30.053899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-463be897-2d82-4c32-a32a-fe321aa05612 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:30.055512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-463be897-2d82-4c32-a32a-fe321aa05612 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:30.056661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-463be897-2d82-4c32-a32a-fe321aa05612 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:30.438235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-463be897-2d82-4c32-a32a-fe321aa05612 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:30.457371 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-463be897-2d82-4c32-a32a-fe321aa05612 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 200 len: 1514 microversion: 2.1 time: 0.442219 Feb 19 21:15:30.468760 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2566/5039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:30 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 1514 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:30.691700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d5935dcd-d334-433f-95ac-3f8ca38347ae req-bb1a7b63-2215-4116-99f9-03704dfd9e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43336a9-8a01-4986-a4a4-2db673d84070", "name": "network-vif-deleted", "tag": "4b0c96ca-51f8-4dad-8d80-6cbca55d06e4"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:30.695409 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:30.695409 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:15:30.725445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d5935dcd-d334-433f-95ac-3f8ca38347ae req-bb1a7b63-2215-4116-99f9-03704dfd9e96 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:30.726055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d5935dcd-d334-433f-95ac-3f8ca38347ae req-bb1a7b63-2215-4116-99f9-03704dfd9e96 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:30.765682 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d5935dcd-d334-433f-95ac-3f8ca38347ae req-bb1a7b63-2215-4116-99f9-03704dfd9e96 service nova] Creating event network-vif-deleted:4b0c96ca-51f8-4dad-8d80-6cbca55d06e4 for instance f43336a9-8a01-4986-a4a4-2db673d84070 on nch1-master-1 Feb 19 21:15:30.777697 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d5935dcd-d334-433f-95ac-3f8ca38347ae req-bb1a7b63-2215-4116-99f9-03704dfd9e96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089837 Feb 19 21:15:30.778327 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2474/5040] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:15:30.795372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a79002bc-9fd6-4b73-bd2a-611bacc8c369 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:30.797169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a79002bc-9fd6-4b73-bd2a-611bacc8c369 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:30.809545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a79002bc-9fd6-4b73-bd2a-611bacc8c369 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:30.809918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a79002bc-9fd6-4b73-bd2a-611bacc8c369 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:30.810906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a79002bc-9fd6-4b73-bd2a-611bacc8c369 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:30.821140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a79002bc-9fd6-4b73-bd2a-611bacc8c369 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:31.179682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a79002bc-9fd6-4b73-bd2a-611bacc8c369 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:31.188381 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a79002bc-9fd6-4b73-bd2a-611bacc8c369 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1488 microversion: 2.1 time: 0.396647 Feb 19 21:15:31.203241 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2567/5041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:30 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1488 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:31.215913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c26e42c-6807-4ea5-8197-e96539933802 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2135238079"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:31.219085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c26e42c-6807-4ea5-8197-e96539933802 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:31.238635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c26e42c-6807-4ea5-8197-e96539933802 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:31.240154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c26e42c-6807-4ea5-8197-e96539933802 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:31.243201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c26e42c-6807-4ea5-8197-e96539933802 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:31.244179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c26e42c-6807-4ea5-8197-e96539933802 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:31.422709 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c26e42c-6807-4ea5-8197-e96539933802 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "PUT /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1074 microversion: 2.1 time: 0.220442 Feb 19 21:15:31.423378 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2475/5042] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 21:15:31 2022] PUT /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1074 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:31.439347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1d78754b-1a04-432a-bff7-1a2a97150403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:31.440222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1d78754b-1a04-432a-bff7-1a2a97150403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:31.450696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d78754b-1a04-432a-bff7-1a2a97150403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:31.451159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d78754b-1a04-432a-bff7-1a2a97150403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:31.451962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d78754b-1a04-432a-bff7-1a2a97150403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:31.453026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1d78754b-1a04-432a-bff7-1a2a97150403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:31.487625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-474d6d05-aa84-41e2-8a37-8d0989a5d48c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:31.488251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-474d6d05-aa84-41e2-8a37-8d0989a5d48c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: f43336a9-8a01-4986-a4a4-2db673d84070] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:31.498238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-474d6d05-aa84-41e2-8a37-8d0989a5d48c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:31.498695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-474d6d05-aa84-41e2-8a37-8d0989a5d48c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:31.503922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-474d6d05-aa84-41e2-8a37-8d0989a5d48c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:31.504584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-474d6d05-aa84-41e2-8a37-8d0989a5d48c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:31.522258 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-474d6d05-aa84-41e2-8a37-8d0989a5d48c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] HTTP exception thrown: Instance f43336a9-8a01-4986-a4a4-2db673d84070 could not be found. Feb 19 21:15:31.522872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-474d6d05-aa84-41e2-8a37-8d0989a5d48c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Returning 404 to user: Instance f43336a9-8a01-4986-a4a4-2db673d84070 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:15:31.523716 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-474d6d05-aa84-41e2-8a37-8d0989a5d48c tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070" status: 404 len: 111 microversion: 2.1 time: 0.041151 Feb 19 21:15:31.524290 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2476/5043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:31 2022] GET /compute/v2.1/servers/f43336a9-8a01-4986-a4a4-2db673d84070 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:15:31.998589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1d78754b-1a04-432a-bff7-1a2a97150403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:32.011493 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1d78754b-1a04-432a-bff7-1a2a97150403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1500 microversion: 2.1 time: 0.577101 Feb 19 21:15:32.013634 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2568/5044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:31 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1500 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:32.044833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-33349eed-a698-4b3f-96c2-49fe0860c525 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:32.047545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-33349eed-a698-4b3f-96c2-49fe0860c525 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:32.067045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33349eed-a698-4b3f-96c2-49fe0860c525 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:32.067864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33349eed-a698-4b3f-96c2-49fe0860c525 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:32.072921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33349eed-a698-4b3f-96c2-49fe0860c525 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:32.073802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33349eed-a698-4b3f-96c2-49fe0860c525 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:32.381042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-33349eed-a698-4b3f-96c2-49fe0860c525 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:32.394209 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-33349eed-a698-4b3f-96c2-49fe0860c525 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1500 microversion: 2.1 time: 0.358968 Feb 19 21:15:32.396306 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2477/5045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:32 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1500 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:32.425241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dce95d04-2757-417c-a19a-49968e0fba62 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:32.438673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dce95d04-2757-417c-a19a-49968e0fba62 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:32.440027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dce95d04-2757-417c-a19a-49968e0fba62 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:32.492421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dce95d04-2757-417c-a19a-49968e0fba62 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Going to try to stop instance {{(pid=136094) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:15:32.627223 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dce95d04-2757-417c-a19a-49968e0fba62 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "POST /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1/action" status: 202 len: 0 microversion: 2.1 time: 0.208618 Feb 19 21:15:32.644851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-55afcb51-af9e-4415-8f8c-ee24f5a116b5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:32.645259 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2569/5046] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:15:32 2022] POST /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:15:32.645672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-55afcb51-af9e-4415-8f8c-ee24f5a116b5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:32.659224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55afcb51-af9e-4415-8f8c-ee24f5a116b5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:32.659741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55afcb51-af9e-4415-8f8c-ee24f5a116b5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:32.661269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55afcb51-af9e-4415-8f8c-ee24f5a116b5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:32.664421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55afcb51-af9e-4415-8f8c-ee24f5a116b5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:32.817273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-786e5eb2-28c7-4efb-8084-07aa107081b3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:32.818156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-786e5eb2-28c7-4efb-8084-07aa107081b3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:32.834163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-786e5eb2-28c7-4efb-8084-07aa107081b3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:32.835430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-786e5eb2-28c7-4efb-8084-07aa107081b3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:32.836990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-786e5eb2-28c7-4efb-8084-07aa107081b3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:32.837973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-786e5eb2-28c7-4efb-8084-07aa107081b3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:32.903818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-786e5eb2-28c7-4efb-8084-07aa107081b3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:15:33.145991 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-786e5eb2-28c7-4efb-8084-07aa107081b3 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 204 len: 0 microversion: 2.1 time: 0.334107 Feb 19 21:15:33.146970 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2570/5047] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:15:32 2022] DELETE /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:15:33.180198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e7916da5-013b-4c0e-83ec-400002421c0d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:33.181046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e7916da5-013b-4c0e-83ec-400002421c0d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:33.194569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7916da5-013b-4c0e-83ec-400002421c0d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:33.194907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7916da5-013b-4c0e-83ec-400002421c0d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:33.196000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7916da5-013b-4c0e-83ec-400002421c0d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:33.196812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e7916da5-013b-4c0e-83ec-400002421c0d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:33.474011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-55afcb51-af9e-4415-8f8c-ee24f5a116b5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:33.511205 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-55afcb51-af9e-4415-8f8c-ee24f5a116b5 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.876077 Feb 19 21:15:33.512641 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2478/5048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:32 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:33.652447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e7916da5-013b-4c0e-83ec-400002421c0d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:33.661207 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e7916da5-013b-4c0e-83ec-400002421c0d tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1513 microversion: 2.1 time: 0.494282 Feb 19 21:15:33.662127 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2571/5049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:33 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1513 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:34.543008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-15082861-fe0c-4048-a817-8c514a715482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:34.543897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-15082861-fe0c-4048-a817-8c514a715482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:34.550817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15082861-fe0c-4048-a817-8c514a715482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:34.551545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15082861-fe0c-4048-a817-8c514a715482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:34.552367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15082861-fe0c-4048-a817-8c514a715482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:34.553271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15082861-fe0c-4048-a817-8c514a715482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:34.679659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4815990d-fe14-4628-9af9-9d96bde00468 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:34.680408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4815990d-fe14-4628-9af9-9d96bde00468 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:34.689800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4815990d-fe14-4628-9af9-9d96bde00468 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:34.690266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4815990d-fe14-4628-9af9-9d96bde00468 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:34.691258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4815990d-fe14-4628-9af9-9d96bde00468 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:34.691876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4815990d-fe14-4628-9af9-9d96bde00468 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:34.835439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-15082861-fe0c-4048-a817-8c514a715482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:34.847839 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-15082861-fe0c-4048-a817-8c514a715482 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.308378 Feb 19 21:15:34.859752 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2479/5050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:34 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:35.001564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4815990d-fe14-4628-9af9-9d96bde00468 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:35.019236 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4815990d-fe14-4628-9af9-9d96bde00468 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1513 microversion: 2.1 time: 0.342758 Feb 19 21:15:35.020375 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2572/5051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:34 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1513 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:35.709568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-346662e9-8619-4873-9316-d05fa4a401f0 req-3423d007-a278-4e8a-a0a8-d62c4d713287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb9bd42-4d71-472f-937f-5a5192838186", "name": "network-vif-deleted", "tag": "4ffc28f0-49dd-404e-8b0d-b3e2f567d170"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:35.711730 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:35.711730 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:15:35.723258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-346662e9-8619-4873-9316-d05fa4a401f0 req-3423d007-a278-4e8a-a0a8-d62c4d713287 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:35.724065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-346662e9-8619-4873-9316-d05fa4a401f0 req-3423d007-a278-4e8a-a0a8-d62c4d713287 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:35.753347 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-346662e9-8619-4873-9316-d05fa4a401f0 req-3423d007-a278-4e8a-a0a8-d62c4d713287 service nova] Creating event network-vif-deleted:4ffc28f0-49dd-404e-8b0d-b3e2f567d170 for instance 1fb9bd42-4d71-472f-937f-5a5192838186 on nch2-master-1 Feb 19 21:15:35.766592 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-346662e9-8619-4873-9316-d05fa4a401f0 req-3423d007-a278-4e8a-a0a8-d62c4d713287 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060509 Feb 19 21:15:35.768796 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2480/5052] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:35.870982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d33fde0c-3145-4d75-96c1-0321a4d193ba tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:35.871744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d33fde0c-3145-4d75-96c1-0321a4d193ba tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:35.902101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d33fde0c-3145-4d75-96c1-0321a4d193ba tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:35.909117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d33fde0c-3145-4d75-96c1-0321a4d193ba tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:35.915370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d33fde0c-3145-4d75-96c1-0321a4d193ba tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:35.915972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d33fde0c-3145-4d75-96c1-0321a4d193ba tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:36.047297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:36.048473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:36.061109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:36.062096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:36.064203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:36.065597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:36.140500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:36.141682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:36.143462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lazy-loading 'fault' on Instance uuid 1fb9bd42-4d71-472f-937f-5a5192838186 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:15:36.248124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e825e0ef42743238263e6758e53e28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a8678732a40b383cedd20600e102e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:36.263393 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d044ea49-23f4-41a4-87ba-5178afbe9227 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 200 len: 1308 microversion: 2.1 time: 0.220842 Feb 19 21:15:36.264266 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2481/5053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:36 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:36.316352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d33fde0c-3145-4d75-96c1-0321a4d193ba tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:36.324716 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d33fde0c-3145-4d75-96c1-0321a4d193ba tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.461736 Feb 19 21:15:36.325309 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2573/5054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:35 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:37.287661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-10c26979-3a84-4f62-8984-ca81dcffd701 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:37.288846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-10c26979-3a84-4f62-8984-ca81dcffd701 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] [instance: 1fb9bd42-4d71-472f-937f-5a5192838186] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:37.301558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10c26979-3a84-4f62-8984-ca81dcffd701 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:37.301776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10c26979-3a84-4f62-8984-ca81dcffd701 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:37.302579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10c26979-3a84-4f62-8984-ca81dcffd701 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:37.303015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10c26979-3a84-4f62-8984-ca81dcffd701 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:37.363509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c8c880d2-f2e5-4e98-a497-b855f54ebe8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:37.367208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c8c880d2-f2e5-4e98-a497-b855f54ebe8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:37.384628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-10c26979-3a84-4f62-8984-ca81dcffd701 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] HTTP exception thrown: Instance 1fb9bd42-4d71-472f-937f-5a5192838186 could not be found. Feb 19 21:15:37.385475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-10c26979-3a84-4f62-8984-ca81dcffd701 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] Returning 404 to user: Instance 1fb9bd42-4d71-472f-937f-5a5192838186 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:15:37.389051 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-10c26979-3a84-4f62-8984-ca81dcffd701 tempest-AttachVolumeNegativeTest-1367384515 tempest-AttachVolumeNegativeTest-1367384515-project] 10.222.0.30 "GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186" status: 404 len: 111 microversion: 2.1 time: 0.105368 Feb 19 21:15:37.395758 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2482/5055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:37 2022] GET /compute/v2.1/servers/1fb9bd42-4d71-472f-937f-5a5192838186 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:15:37.397051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8c880d2-f2e5-4e98-a497-b855f54ebe8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:37.397738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8c880d2-f2e5-4e98-a497-b855f54ebe8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:37.398949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8c880d2-f2e5-4e98-a497-b855f54ebe8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:37.411462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c8c880d2-f2e5-4e98-a497-b855f54ebe8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:37.793172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c8c880d2-f2e5-4e98-a497-b855f54ebe8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:37.809250 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c8c880d2-f2e5-4e98-a497-b855f54ebe8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.458872 Feb 19 21:15:37.827034 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2574/5056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:37 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:38.838736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b97a046b-9edd-4381-81f1-691a3b2a74bf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:38.838736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b97a046b-9edd-4381-81f1-691a3b2a74bf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:38.842924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b97a046b-9edd-4381-81f1-691a3b2a74bf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:38.843450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b97a046b-9edd-4381-81f1-691a3b2a74bf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:38.844419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b97a046b-9edd-4381-81f1-691a3b2a74bf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:38.844973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b97a046b-9edd-4381-81f1-691a3b2a74bf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:39.075550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b97a046b-9edd-4381-81f1-691a3b2a74bf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:39.087042 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b97a046b-9edd-4381-81f1-691a3b2a74bf tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.255527 Feb 19 21:15:39.094471 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2483/5057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:38 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:40.117420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-435662bf-92ab-4d8c-987c-b3c55a83a95a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:40.119038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-435662bf-92ab-4d8c-987c-b3c55a83a95a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:40.129473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435662bf-92ab-4d8c-987c-b3c55a83a95a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:40.130827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435662bf-92ab-4d8c-987c-b3c55a83a95a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:40.132177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435662bf-92ab-4d8c-987c-b3c55a83a95a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:40.133139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-435662bf-92ab-4d8c-987c-b3c55a83a95a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:40.335907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-435662bf-92ab-4d8c-987c-b3c55a83a95a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:40.345646 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-435662bf-92ab-4d8c-987c-b3c55a83a95a tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.233371 Feb 19 21:15:40.346249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2575/5058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:40 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:41.369360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ab1735ee-20e2-4aee-b36d-ed189960d66b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:41.370840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ab1735ee-20e2-4aee-b36d-ed189960d66b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:41.379914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab1735ee-20e2-4aee-b36d-ed189960d66b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:41.382075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab1735ee-20e2-4aee-b36d-ed189960d66b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:41.382921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab1735ee-20e2-4aee-b36d-ed189960d66b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:41.383375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ab1735ee-20e2-4aee-b36d-ed189960d66b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:41.607198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ab1735ee-20e2-4aee-b36d-ed189960d66b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:41.618149 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ab1735ee-20e2-4aee-b36d-ed189960d66b tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.252216 Feb 19 21:15:41.620511 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2484/5059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:41 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:42.639341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68488950-d7c4-47e2-be54-d71d6d5ffe51 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:42.640200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-68488950-d7c4-47e2-be54-d71d6d5ffe51 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:42.653462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68488950-d7c4-47e2-be54-d71d6d5ffe51 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:42.653923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68488950-d7c4-47e2-be54-d71d6d5ffe51 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:42.654752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68488950-d7c4-47e2-be54-d71d6d5ffe51 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:42.655202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68488950-d7c4-47e2-be54-d71d6d5ffe51 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:42.997264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-68488950-d7c4-47e2-be54-d71d6d5ffe51 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:43.014503 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-68488950-d7c4-47e2-be54-d71d6d5ffe51 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.381061 Feb 19 21:15:43.015970 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2576/5060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:42 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:44.039141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-15394cbe-b2c3-42ba-807f-ee9e4d37fe60 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:44.039762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-15394cbe-b2c3-42ba-807f-ee9e4d37fe60 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:44.048313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15394cbe-b2c3-42ba-807f-ee9e4d37fe60 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:44.049074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15394cbe-b2c3-42ba-807f-ee9e4d37fe60 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:44.049222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1171878131", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "e5a29e46-9acc-46cd-9f60-d7bca6965158"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:44.050546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15394cbe-b2c3-42ba-807f-ee9e4d37fe60 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:44.051155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-15394cbe-b2c3-42ba-807f-ee9e4d37fe60 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:44.156913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] validate_networks() for [('e5a29e46-9acc-46cd-9f60-d7bca6965158', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:15:44.942563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-15394cbe-b2c3-42ba-807f-ee9e4d37fe60 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:44.960683 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-15394cbe-b2c3-42ba-807f-ee9e4d37fe60 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.918796 Feb 19 21:15:44.974223 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2577/5061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:44 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:45.366384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:15:45.367131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:15:45.367377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:15:45.368077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:15:45.368851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:15:45.416224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:45.429541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:45.430485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:45.430933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:45.498091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Getting quotas for project 4929d77b858b4d848172346c97160377. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:15:45.511965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Getting quotas for user ad93f38d6b384bcf9b1b190a9abb27ce and project 4929d77b858b4d848172346c97160377. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:15:45.537744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:15:45.540473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:15:45.615380 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e0235576-9942-45ee-ac9d-a46277612100 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.847479 Feb 19 21:15:45.628766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5d15acdb-b5fe-4ea6-ab8f-3c58104ba576 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:45.630049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5d15acdb-b5fe-4ea6-ab8f-3c58104ba576 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:45.634216 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2485/5062] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:15:45.790931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5d15acdb-b5fe-4ea6-ab8f-3c58104ba576 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:45.805835 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5d15acdb-b5fe-4ea6-ab8f-3c58104ba576 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1214 microversion: 2.1 time: 0.180615 Feb 19 21:15:45.820817 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2578/5063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:45 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:45.981070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b1e7fe4-f3b4-4eea-8d25-3138f7254403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:45.981690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b1e7fe4-f3b4-4eea-8d25-3138f7254403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:45.999790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b1e7fe4-f3b4-4eea-8d25-3138f7254403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:46.000249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b1e7fe4-f3b4-4eea-8d25-3138f7254403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:46.001087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b1e7fe4-f3b4-4eea-8d25-3138f7254403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:46.001586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b1e7fe4-f3b4-4eea-8d25-3138f7254403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:46.548854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b1e7fe4-f3b4-4eea-8d25-3138f7254403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:46.564129 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b1e7fe4-f3b4-4eea-8d25-3138f7254403 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.586448 Feb 19 21:15:46.569539 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2486/5064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:45 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:46.837340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-08154770-b4f7-4927-b2a8-a2ec2f98dbc6 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:46.838065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-08154770-b4f7-4927-b2a8-a2ec2f98dbc6 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:46.850107 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08154770-b4f7-4927-b2a8-a2ec2f98dbc6 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:46.850613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08154770-b4f7-4927-b2a8-a2ec2f98dbc6 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:46.853879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08154770-b4f7-4927-b2a8-a2ec2f98dbc6 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:46.854451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-08154770-b4f7-4927-b2a8-a2ec2f98dbc6 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:47.035484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-08154770-b4f7-4927-b2a8-a2ec2f98dbc6 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:47.045013 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-08154770-b4f7-4927-b2a8-a2ec2f98dbc6 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1210 microversion: 2.1 time: 0.220780 Feb 19 21:15:47.048720 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2579/5065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:46 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1210 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:47.589881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-73a9f456-0555-4dbe-a02d-1c0b6c001176 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:47.590992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-73a9f456-0555-4dbe-a02d-1c0b6c001176 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:47.622168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73a9f456-0555-4dbe-a02d-1c0b6c001176 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:47.624639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73a9f456-0555-4dbe-a02d-1c0b6c001176 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:47.625733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73a9f456-0555-4dbe-a02d-1c0b6c001176 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:47.630106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73a9f456-0555-4dbe-a02d-1c0b6c001176 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:48.076703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1731acd6-042d-4ac2-a8cd-d463715969c2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:48.079566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1731acd6-042d-4ac2-a8cd-d463715969c2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:48.093133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1731acd6-042d-4ac2-a8cd-d463715969c2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:48.094157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1731acd6-042d-4ac2-a8cd-d463715969c2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:48.095789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1731acd6-042d-4ac2-a8cd-d463715969c2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:48.096675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1731acd6-042d-4ac2-a8cd-d463715969c2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:48.213755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-73a9f456-0555-4dbe-a02d-1c0b6c001176 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:48.225838 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-73a9f456-0555-4dbe-a02d-1c0b6c001176 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.638698 Feb 19 21:15:48.226701 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2487/5066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:47 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:48.260739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1731acd6-042d-4ac2-a8cd-d463715969c2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:48.273009 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1731acd6-042d-4ac2-a8cd-d463715969c2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1272 microversion: 2.1 time: 0.213188 Feb 19 21:15:48.278102 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2580/5067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:48 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:49.245597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-16465b65-3335-44c3-8990-e02e3dfd8020 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:49.248041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-16465b65-3335-44c3-8990-e02e3dfd8020 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:49.267082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16465b65-3335-44c3-8990-e02e3dfd8020 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:49.270458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16465b65-3335-44c3-8990-e02e3dfd8020 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:49.273825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16465b65-3335-44c3-8990-e02e3dfd8020 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:49.275711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16465b65-3335-44c3-8990-e02e3dfd8020 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:49.298964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c601e3f5-6dfa-4696-92f1-d044a633438d tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:49.302830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c601e3f5-6dfa-4696-92f1-d044a633438d tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:49.314346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c601e3f5-6dfa-4696-92f1-d044a633438d tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:49.315110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c601e3f5-6dfa-4696-92f1-d044a633438d tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:49.316116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c601e3f5-6dfa-4696-92f1-d044a633438d tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:49.317339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c601e3f5-6dfa-4696-92f1-d044a633438d tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:50.210131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-16465b65-3335-44c3-8990-e02e3dfd8020 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:50.226120 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-16465b65-3335-44c3-8990-e02e3dfd8020 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.985792 Feb 19 21:15:50.238765 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2488/5068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:49 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:50.285032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c601e3f5-6dfa-4696-92f1-d044a633438d tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:50.295117 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c601e3f5-6dfa-4696-92f1-d044a633438d tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1314 microversion: 2.1 time: 1.005232 Feb 19 21:15:50.298335 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2581/5069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:49 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1314 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:51.246870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-50fb48dd-b9fb-4338-be05-5141ec57aa15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:51.247829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-50fb48dd-b9fb-4338-be05-5141ec57aa15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:51.260414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50fb48dd-b9fb-4338-be05-5141ec57aa15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:51.261265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50fb48dd-b9fb-4338-be05-5141ec57aa15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:51.263244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50fb48dd-b9fb-4338-be05-5141ec57aa15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:51.264059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50fb48dd-b9fb-4338-be05-5141ec57aa15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:51.314534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7bfb8ff9-0665-422f-babf-762a89858bd2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:51.315528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7bfb8ff9-0665-422f-babf-762a89858bd2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:51.335590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bfb8ff9-0665-422f-babf-762a89858bd2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:51.337997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bfb8ff9-0665-422f-babf-762a89858bd2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:51.338882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bfb8ff9-0665-422f-babf-762a89858bd2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:51.339333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bfb8ff9-0665-422f-babf-762a89858bd2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:51.786283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-50fb48dd-b9fb-4338-be05-5141ec57aa15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:51.806959 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-50fb48dd-b9fb-4338-be05-5141ec57aa15 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.565814 Feb 19 21:15:51.807558 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2489/5070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:51 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:51.815501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-34b0f1a1-1888-4a01-8327-94f979370cc9 req-efd3bff1-3305-48b4-bef0-94fc5e0a4ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00dedc93-b220-4908-8f4f-506d606555be", "tag": "373ba6f9-858a-4bc3-b3bf-ba987c52475f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:51.819142 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:51.819142 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:15:51.828560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-34b0f1a1-1888-4a01-8327-94f979370cc9 req-efd3bff1-3305-48b4-bef0-94fc5e0a4ee6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:51.829244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-34b0f1a1-1888-4a01-8327-94f979370cc9 req-efd3bff1-3305-48b4-bef0-94fc5e0a4ee6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:51.845381 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-34b0f1a1-1888-4a01-8327-94f979370cc9 req-efd3bff1-3305-48b4-bef0-94fc5e0a4ee6 service nova] Creating event network-changed:373ba6f9-858a-4bc3-b3bf-ba987c52475f for instance 00dedc93-b220-4908-8f4f-506d606555be on nch2-master-1 Feb 19 21:15:51.855533 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-34b0f1a1-1888-4a01-8327-94f979370cc9 req-efd3bff1-3305-48b4-bef0-94fc5e0a4ee6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041640 Feb 19 21:15:51.856805 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2490/5071] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:51.893483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7bfb8ff9-0665-422f-babf-762a89858bd2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:51.903096 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7bfb8ff9-0665-422f-babf-762a89858bd2 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1314 microversion: 2.1 time: 0.592821 Feb 19 21:15:51.903704 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2582/5072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:51 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:52.825781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eac86d7d-c72c-42d5-878c-193a5519f8c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:52.826532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eac86d7d-c72c-42d5-878c-193a5519f8c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:52.841234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eac86d7d-c72c-42d5-878c-193a5519f8c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:52.843672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eac86d7d-c72c-42d5-878c-193a5519f8c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:52.847241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eac86d7d-c72c-42d5-878c-193a5519f8c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:52.847624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eac86d7d-c72c-42d5-878c-193a5519f8c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:52.921571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fa1033d2-6b71-42af-97a7-cf5b8982405e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:52.922281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa1033d2-6b71-42af-97a7-cf5b8982405e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:52.936001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa1033d2-6b71-42af-97a7-cf5b8982405e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:52.937371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa1033d2-6b71-42af-97a7-cf5b8982405e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:52.938214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa1033d2-6b71-42af-97a7-cf5b8982405e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:52.938657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa1033d2-6b71-42af-97a7-cf5b8982405e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:53.710173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eac86d7d-c72c-42d5-878c-193a5519f8c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:53.740360 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eac86d7d-c72c-42d5-878c-193a5519f8c9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.919170 Feb 19 21:15:53.755762 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2491/5073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:52 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:53.826058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fa1033d2-6b71-42af-97a7-cf5b8982405e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:53.846512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fa1033d2-6b71-42af-97a7-cf5b8982405e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1314 microversion: 2.1 time: 0.926363 Feb 19 21:15:53.854514 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2583/5074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:52 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1314 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:54.768493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-55f4ef50-4887-41dd-87a2-35b650f42b2d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:54.769248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-55f4ef50-4887-41dd-87a2-35b650f42b2d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:54.781450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55f4ef50-4887-41dd-87a2-35b650f42b2d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:54.781938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55f4ef50-4887-41dd-87a2-35b650f42b2d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:54.782831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55f4ef50-4887-41dd-87a2-35b650f42b2d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:54.783206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55f4ef50-4887-41dd-87a2-35b650f42b2d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:54.863875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14640dfa-c174-4486-909d-bf09cecc7252 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:54.865258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-14640dfa-c174-4486-909d-bf09cecc7252 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:54.881754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14640dfa-c174-4486-909d-bf09cecc7252 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:54.883714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14640dfa-c174-4486-909d-bf09cecc7252 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:54.887049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14640dfa-c174-4486-909d-bf09cecc7252 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:54.887801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14640dfa-c174-4486-909d-bf09cecc7252 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:55.296104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-55f4ef50-4887-41dd-87a2-35b650f42b2d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:55.306767 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-55f4ef50-4887-41dd-87a2-35b650f42b2d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.542171 Feb 19 21:15:55.308488 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2492/5075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:54 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:55.331274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-14640dfa-c174-4486-909d-bf09cecc7252 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:55.341982 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14640dfa-c174-4486-909d-bf09cecc7252 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1314 microversion: 2.1 time: 0.481807 Feb 19 21:15:55.344112 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2584/5076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:54 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:56.325916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4d5943b7-0365-4469-8a1a-a75991b73c29 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:56.326447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4d5943b7-0365-4469-8a1a-a75991b73c29 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:56.344738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d5943b7-0365-4469-8a1a-a75991b73c29 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:56.346711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d5943b7-0365-4469-8a1a-a75991b73c29 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:56.351874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d5943b7-0365-4469-8a1a-a75991b73c29 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:56.352960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d5943b7-0365-4469-8a1a-a75991b73c29 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:56.362051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b5ef319-b2c7-4604-a6c5-be636571c82e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:56.363749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7b5ef319-b2c7-4604-a6c5-be636571c82e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:56.381235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b5ef319-b2c7-4604-a6c5-be636571c82e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:56.382251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b5ef319-b2c7-4604-a6c5-be636571c82e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:56.386136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b5ef319-b2c7-4604-a6c5-be636571c82e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:56.389990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b5ef319-b2c7-4604-a6c5-be636571c82e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:56.986354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4d5943b7-0365-4469-8a1a-a75991b73c29 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:56.999621 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4d5943b7-0365-4469-8a1a-a75991b73c29 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1510 microversion: 2.1 time: 0.677339 Feb 19 21:15:57.000674 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2493/5077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:56 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1510 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:57.039926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7b5ef319-b2c7-4604-a6c5-be636571c82e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:57.055635 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b5ef319-b2c7-4604-a6c5-be636571c82e tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1314 microversion: 2.1 time: 0.698547 Feb 19 21:15:57.056422 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2585/5078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:56 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1314 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:58.028917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-862a4b89-42f8-4b44-b934-05be793ab95f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:58.029530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-862a4b89-42f8-4b44-b934-05be793ab95f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:58.051620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-862a4b89-42f8-4b44-b934-05be793ab95f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:58.052264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-862a4b89-42f8-4b44-b934-05be793ab95f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:58.053440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-862a4b89-42f8-4b44-b934-05be793ab95f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:58.053810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-862a4b89-42f8-4b44-b934-05be793ab95f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:58.083057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-517c2b2c-2a2f-4894-b40f-9f6cf10bbe50 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:58.084371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-517c2b2c-2a2f-4894-b40f-9f6cf10bbe50 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:58.096732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517c2b2c-2a2f-4894-b40f-9f6cf10bbe50 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:58.098757 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517c2b2c-2a2f-4894-b40f-9f6cf10bbe50 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:58.101676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517c2b2c-2a2f-4894-b40f-9f6cf10bbe50 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:58.102451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-517c2b2c-2a2f-4894-b40f-9f6cf10bbe50 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:58.455311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-862a4b89-42f8-4b44-b934-05be793ab95f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:58.478082 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-862a4b89-42f8-4b44-b934-05be793ab95f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1487 microversion: 2.1 time: 0.456223 Feb 19 21:15:58.489461 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2494/5079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:58 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1487 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:58.526623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d09a2bd3-6421-443a-8637-453599611217 req-2a31f0ad-d5c6-48a0-bcba-48cf52ead677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dedc93-b220-4908-8f4f-506d606555be", "name": "network-vif-plugged", "status": "completed", "tag": "373ba6f9-858a-4bc3-b3bf-ba987c52475f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:58.532146 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:15:58.532146 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:15:58.543393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d09a2bd3-6421-443a-8637-453599611217 req-2a31f0ad-d5c6-48a0-bcba-48cf52ead677 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:58.544259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d09a2bd3-6421-443a-8637-453599611217 req-2a31f0ad-d5c6-48a0-bcba-48cf52ead677 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:58.561799 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d09a2bd3-6421-443a-8637-453599611217 req-2a31f0ad-d5c6-48a0-bcba-48cf52ead677 service nova] Creating event network-vif-plugged:373ba6f9-858a-4bc3-b3bf-ba987c52475f for instance 00dedc93-b220-4908-8f4f-506d606555be on nch2-master-1 Feb 19 21:15:58.567895 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d09a2bd3-6421-443a-8637-453599611217 req-2a31f0ad-d5c6-48a0-bcba-48cf52ead677 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076281 Feb 19 21:15:58.568140 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2495/5080] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:15:58.575328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2a83950d-3e55-4338-a6c3-5cc90e961a25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1616400041"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:15:58.577899 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2a83950d-3e55-4338-a6c3-5cc90e961a25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:58.586307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a83950d-3e55-4338-a6c3-5cc90e961a25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:58.586968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a83950d-3e55-4338-a6c3-5cc90e961a25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:58.597157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a83950d-3e55-4338-a6c3-5cc90e961a25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:58.599005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a83950d-3e55-4338-a6c3-5cc90e961a25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:58.688002 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2a83950d-3e55-4338-a6c3-5cc90e961a25 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "PUT /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1060 microversion: 2.1 time: 0.118035 Feb 19 21:15:58.688693 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2496/5081] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 21:15:58 2022] PUT /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1060 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:58.712516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-825482c2-6dff-4831-9f9c-1d328066d085 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:58.714058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-825482c2-6dff-4831-9f9c-1d328066d085 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:58.749630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-825482c2-6dff-4831-9f9c-1d328066d085 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:58.751961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-825482c2-6dff-4831-9f9c-1d328066d085 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:58.756985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-825482c2-6dff-4831-9f9c-1d328066d085 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:58.758669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-825482c2-6dff-4831-9f9c-1d328066d085 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:58.786306 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-517c2b2c-2a2f-4894-b40f-9f6cf10bbe50 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:58.796816 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-517c2b2c-2a2f-4894-b40f-9f6cf10bbe50 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1314 microversion: 2.1 time: 0.717772 Feb 19 21:15:58.797935 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2586/5082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:58 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:15:58.987509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-825482c2-6dff-4831-9f9c-1d328066d085 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:58.996237 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-825482c2-6dff-4831-9f9c-1d328066d085 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1487 microversion: 2.1 time: 0.294342 Feb 19 21:15:58.997230 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2497/5083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:58 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1487 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:59.013917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74e087e4-b501-4800-9726-adcec848bc53 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:59.015326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-74e087e4-b501-4800-9726-adcec848bc53 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:59.022708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74e087e4-b501-4800-9726-adcec848bc53 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:59.023326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74e087e4-b501-4800-9726-adcec848bc53 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:59.024466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74e087e4-b501-4800-9726-adcec848bc53 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:59.025311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74e087e4-b501-4800-9726-adcec848bc53 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:59.224065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-74e087e4-b501-4800-9726-adcec848bc53 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:59.235626 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-74e087e4-b501-4800-9726-adcec848bc53 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1487 microversion: 2.1 time: 0.225442 Feb 19 21:15:59.238099 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2587/5084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:59 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1487 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:59.253118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c6098483-5f07-4558-8978-a0f7969c6a8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:59.254021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c6098483-5f07-4558-8978-a0f7969c6a8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:59.267803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6098483-5f07-4558-8978-a0f7969c6a8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:59.268366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6098483-5f07-4558-8978-a0f7969c6a8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:59.269382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6098483-5f07-4558-8978-a0f7969c6a8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:59.270754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c6098483-5f07-4558-8978-a0f7969c6a8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:59.304742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c6098483-5f07-4558-8978-a0f7969c6a8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:15:59.416449 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c6098483-5f07-4558-8978-a0f7969c6a8d tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 204 len: 0 microversion: 2.1 time: 0.168016 Feb 19 21:15:59.417638 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2498/5085] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:15:59 2022] DELETE /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:15:59.426471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ecab830b-ecdd-457b-94bf-a34e841ebd2f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:59.427993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ecab830b-ecdd-457b-94bf-a34e841ebd2f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:59.437376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ecab830b-ecdd-457b-94bf-a34e841ebd2f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:59.438205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ecab830b-ecdd-457b-94bf-a34e841ebd2f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:59.439393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ecab830b-ecdd-457b-94bf-a34e841ebd2f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:59.440529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ecab830b-ecdd-457b-94bf-a34e841ebd2f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:59.622302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ecab830b-ecdd-457b-94bf-a34e841ebd2f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:15:59.631756 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ecab830b-ecdd-457b-94bf-a34e841ebd2f tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1493 microversion: 2.1 time: 0.209539 Feb 19 21:15:59.632868 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2588/5086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:59 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1493 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:15:59.817704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-53a61764-f820-4637-be4e-adaf07c3d151 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:15:59.819495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-53a61764-f820-4637-be4e-adaf07c3d151 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:15:59.831408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53a61764-f820-4637-be4e-adaf07c3d151 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:59.831995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53a61764-f820-4637-be4e-adaf07c3d151 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:15:59.832965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53a61764-f820-4637-be4e-adaf07c3d151 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:15:59.833642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53a61764-f820-4637-be4e-adaf07c3d151 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:00.154132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53a61764-f820-4637-be4e-adaf07c3d151 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:00.163523 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-53a61764-f820-4637-be4e-adaf07c3d151 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1314 microversion: 2.1 time: 0.351095 Feb 19 21:16:00.168972 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2499/5087] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:15:59 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:16:00.651601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d867eb54-593d-4a05-964e-f3eea18285bd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:00.653058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d867eb54-593d-4a05-964e-f3eea18285bd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:00.668163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d867eb54-593d-4a05-964e-f3eea18285bd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:00.668962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d867eb54-593d-4a05-964e-f3eea18285bd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:00.672025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d867eb54-593d-4a05-964e-f3eea18285bd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:00.673036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d867eb54-593d-4a05-964e-f3eea18285bd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:01.095979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d867eb54-593d-4a05-964e-f3eea18285bd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:01.112444 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d867eb54-593d-4a05-964e-f3eea18285bd tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1493 microversion: 2.1 time: 0.466213 Feb 19 21:16:01.113480 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2589/5088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:00 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1493 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:16:01.181158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2634072f-2e4e-43cd-9734-277a1b932ac1 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:01.181937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2634072f-2e4e-43cd-9734-277a1b932ac1 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:01.192741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2634072f-2e4e-43cd-9734-277a1b932ac1 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:01.193196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2634072f-2e4e-43cd-9734-277a1b932ac1 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:01.193995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2634072f-2e4e-43cd-9734-277a1b932ac1 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:01.194432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2634072f-2e4e-43cd-9734-277a1b932ac1 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:01.663774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2634072f-2e4e-43cd-9734-277a1b932ac1 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:01.674725 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2634072f-2e4e-43cd-9734-277a1b932ac1 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1499 microversion: 2.1 time: 0.494827 Feb 19 21:16:01.675332 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2500/5089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:01 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1499 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:16:02.138954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:02.139995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:02.151402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:02.153206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:02.155811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:02.162780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:02.272465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-aa3ec59e-586b-48d1-8c91-c68ecab357bd req-9daf3458-f873-4e92-92aa-f4be46ff6e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f147bf0-9df9-4222-85dc-df35ee5063b1", "name": "network-vif-deleted", "tag": "3c00e454-f41f-4b4a-a75e-e389847f6009"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:16:02.274973 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:02.274973 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:16:02.292134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:02.302884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-aa3ec59e-586b-48d1-8c91-c68ecab357bd req-9daf3458-f873-4e92-92aa-f4be46ff6e49 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:02.306876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:02.307902 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lazy-loading 'fault' on Instance uuid 8f147bf0-9df9-4222-85dc-df35ee5063b1 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:16:02.308682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-aa3ec59e-586b-48d1-8c91-c68ecab357bd req-9daf3458-f873-4e92-92aa-f4be46ff6e49 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:02.343463 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-aa3ec59e-586b-48d1-8c91-c68ecab357bd req-9daf3458-f873-4e92-92aa-f4be46ff6e49 service nova] Creating event network-vif-deleted:3c00e454-f41f-4b4a-a75e-e389847f6009 for instance 8f147bf0-9df9-4222-85dc-df35ee5063b1 on nch1-master-1 Feb 19 21:16:02.375418 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-aa3ec59e-586b-48d1-8c91-c68ecab357bd req-9daf3458-f873-4e92-92aa-f4be46ff6e49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.440154 Feb 19 21:16:02.376147 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2590/5090] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:16:02.417011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:02.429741 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6a310330-1e63-470a-ae75-d85a1a781437 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 200 len: 1310 microversion: 2.1 time: 0.294529 Feb 19 21:16:02.430845 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2501/5091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:02 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 1310 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:16:03.449047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1019fd40-0334-4101-84f2-bce9cef8d09c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.449763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1019fd40-0334-4101-84f2-bce9cef8d09c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.473277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1019fd40-0334-4101-84f2-bce9cef8d09c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.477664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1019fd40-0334-4101-84f2-bce9cef8d09c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.478524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1019fd40-0334-4101-84f2-bce9cef8d09c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.478963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1019fd40-0334-4101-84f2-bce9cef8d09c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.516298 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-1019fd40-0334-4101-84f2-bce9cef8d09c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 8f147bf0-9df9-4222-85dc-df35ee5063b1 could not be found. Feb 19 21:16:03.516972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1019fd40-0334-4101-84f2-bce9cef8d09c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 8f147bf0-9df9-4222-85dc-df35ee5063b1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:03.517830 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1019fd40-0334-4101-84f2-bce9cef8d09c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 404 len: 111 microversion: 2.1 time: 0.074266 Feb 19 21:16:03.522672 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2591/5092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:03 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:03.533490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b055634c-ad73-4962-a035-e7442e2c031c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.534081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b055634c-ad73-4962-a035-e7442e2c031c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.546913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b055634c-ad73-4962-a035-e7442e2c031c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.547409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b055634c-ad73-4962-a035-e7442e2c031c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.549322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b055634c-ad73-4962-a035-e7442e2c031c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.552754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b055634c-ad73-4962-a035-e7442e2c031c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.586300 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-b055634c-ad73-4962-a035-e7442e2c031c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 8f147bf0-9df9-4222-85dc-df35ee5063b1 could not be found. Feb 19 21:16:03.586930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b055634c-ad73-4962-a035-e7442e2c031c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 8f147bf0-9df9-4222-85dc-df35ee5063b1 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:03.587799 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b055634c-ad73-4962-a035-e7442e2c031c tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 404 len: 111 microversion: 2.1 time: 0.058429 Feb 19 21:16:03.588412 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2502/5093] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:16:03 2022] DELETE /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:03.597140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2598a039-f09d-4303-9b1d-fc3d290cdf32 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.597758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2598a039-f09d-4303-9b1d-fc3d290cdf32 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 8f147bf0-9df9-4222-85dc-df35ee5063b1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.606231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2598a039-f09d-4303-9b1d-fc3d290cdf32 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.606685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2598a039-f09d-4303-9b1d-fc3d290cdf32 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.623849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2598a039-f09d-4303-9b1d-fc3d290cdf32 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.624485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2598a039-f09d-4303-9b1d-fc3d290cdf32 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.663420 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-2598a039-f09d-4303-9b1d-fc3d290cdf32 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 8f147bf0-9df9-4222-85dc-df35ee5063b1 could not be found. Feb 19 21:16:03.665705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2598a039-f09d-4303-9b1d-fc3d290cdf32 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 8f147bf0-9df9-4222-85dc-df35ee5063b1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:03.666856 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2598a039-f09d-4303-9b1d-fc3d290cdf32 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1" status: 404 len: 111 microversion: 2.1 time: 0.073374 Feb 19 21:16:03.667969 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2592/5094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:03 2022] GET /compute/v2.1/servers/8f147bf0-9df9-4222-85dc-df35ee5063b1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:03.675591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11d62054-30b6-4685-80b4-de6e7f4965df tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.676102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11d62054-30b6-4685-80b4-de6e7f4965df tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.682414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11d62054-30b6-4685-80b4-de6e7f4965df tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.683128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11d62054-30b6-4685-80b4-de6e7f4965df tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.684120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11d62054-30b6-4685-80b4-de6e7f4965df tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.684766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11d62054-30b6-4685-80b4-de6e7f4965df tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.699942 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-11d62054-30b6-4685-80b4-de6e7f4965df tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance cd412862-beb2-41a2-9188-583a3f8c78b9 could not be found. Feb 19 21:16:03.700865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11d62054-30b6-4685-80b4-de6e7f4965df tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance cd412862-beb2-41a2-9188-583a3f8c78b9 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:03.702607 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11d62054-30b6-4685-80b4-de6e7f4965df tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 404 len: 111 microversion: 2.1 time: 0.030763 Feb 19 21:16:03.703650 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2503/5095] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:16:03 2022] DELETE /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:03.711425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a2996ed2-fa0c-4ad6-9cd5-6ce96efe43ed tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.712400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a2996ed2-fa0c-4ad6-9cd5-6ce96efe43ed tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: cd412862-beb2-41a2-9188-583a3f8c78b9] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.721394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2996ed2-fa0c-4ad6-9cd5-6ce96efe43ed tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.722839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2996ed2-fa0c-4ad6-9cd5-6ce96efe43ed tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.727019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2996ed2-fa0c-4ad6-9cd5-6ce96efe43ed tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.727664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2996ed2-fa0c-4ad6-9cd5-6ce96efe43ed tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.744098 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-a2996ed2-fa0c-4ad6-9cd5-6ce96efe43ed tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance cd412862-beb2-41a2-9188-583a3f8c78b9 could not be found. Feb 19 21:16:03.744098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a2996ed2-fa0c-4ad6-9cd5-6ce96efe43ed tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance cd412862-beb2-41a2-9188-583a3f8c78b9 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:03.745216 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a2996ed2-fa0c-4ad6-9cd5-6ce96efe43ed tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9" status: 404 len: 111 microversion: 2.1 time: 0.037646 Feb 19 21:16:03.746310 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2593/5096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:03 2022] GET /compute/v2.1/servers/cd412862-beb2-41a2-9188-583a3f8c78b9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:03.754088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0838ad49-d924-4731-bdc7-a24ed0c66dc7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.754651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0838ad49-d924-4731-bdc7-a24ed0c66dc7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.764867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0838ad49-d924-4731-bdc7-a24ed0c66dc7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.765485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0838ad49-d924-4731-bdc7-a24ed0c66dc7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.766389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0838ad49-d924-4731-bdc7-a24ed0c66dc7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.766944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0838ad49-d924-4731-bdc7-a24ed0c66dc7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.782007 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-0838ad49-d924-4731-bdc7-a24ed0c66dc7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 22fa017c-ffad-48ee-9373-656f213dda89 could not be found. Feb 19 21:16:03.785065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0838ad49-d924-4731-bdc7-a24ed0c66dc7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 22fa017c-ffad-48ee-9373-656f213dda89 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:03.785945 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0838ad49-d924-4731-bdc7-a24ed0c66dc7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 404 len: 111 microversion: 2.1 time: 0.035855 Feb 19 21:16:03.795925 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2504/5097] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:16:03 2022] DELETE /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:03.801941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-662a32a8-f0f0-4b6d-a981-cda34e5acbb7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.802488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-662a32a8-f0f0-4b6d-a981-cda34e5acbb7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 22fa017c-ffad-48ee-9373-656f213dda89] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.815362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-662a32a8-f0f0-4b6d-a981-cda34e5acbb7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.816078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-662a32a8-f0f0-4b6d-a981-cda34e5acbb7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.817344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-662a32a8-f0f0-4b6d-a981-cda34e5acbb7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.818977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-662a32a8-f0f0-4b6d-a981-cda34e5acbb7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.878582 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-662a32a8-f0f0-4b6d-a981-cda34e5acbb7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 22fa017c-ffad-48ee-9373-656f213dda89 could not be found. Feb 19 21:16:03.880779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-662a32a8-f0f0-4b6d-a981-cda34e5acbb7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 22fa017c-ffad-48ee-9373-656f213dda89 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:03.882053 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-662a32a8-f0f0-4b6d-a981-cda34e5acbb7 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89" status: 404 len: 111 microversion: 2.1 time: 0.084607 Feb 19 21:16:03.887478 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2594/5098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:03 2022] GET /compute/v2.1/servers/22fa017c-ffad-48ee-9373-656f213dda89 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:03.892090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ed2903df-bc9a-4945-a7a5-ab452d3e91eb tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.892773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ed2903df-bc9a-4945-a7a5-ab452d3e91eb tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.904206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed2903df-bc9a-4945-a7a5-ab452d3e91eb tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.905434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed2903df-bc9a-4945-a7a5-ab452d3e91eb tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.909680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed2903df-bc9a-4945-a7a5-ab452d3e91eb tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.910290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ed2903df-bc9a-4945-a7a5-ab452d3e91eb tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.929655 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-ed2903df-bc9a-4945-a7a5-ab452d3e91eb tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 4819c51a-7d85-497a-8852-84fad8704ddf could not be found. Feb 19 21:16:03.931289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ed2903df-bc9a-4945-a7a5-ab452d3e91eb tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 4819c51a-7d85-497a-8852-84fad8704ddf could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:03.932503 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ed2903df-bc9a-4945-a7a5-ab452d3e91eb tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 404 len: 111 microversion: 2.1 time: 0.044654 Feb 19 21:16:03.933383 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2505/5099] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:16:03 2022] DELETE /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:16:03.941812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4801d433-c215-4025-95c5-f7d1be241d08 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.943382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4801d433-c215-4025-95c5-f7d1be241d08 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 4819c51a-7d85-497a-8852-84fad8704ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.950436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4801d433-c215-4025-95c5-f7d1be241d08 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.951331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4801d433-c215-4025-95c5-f7d1be241d08 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.952424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4801d433-c215-4025-95c5-f7d1be241d08 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.953098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4801d433-c215-4025-95c5-f7d1be241d08 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.971103 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-4801d433-c215-4025-95c5-f7d1be241d08 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 4819c51a-7d85-497a-8852-84fad8704ddf could not be found. Feb 19 21:16:03.972155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4801d433-c215-4025-95c5-f7d1be241d08 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 4819c51a-7d85-497a-8852-84fad8704ddf could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:03.973611 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4801d433-c215-4025-95c5-f7d1be241d08 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf" status: 404 len: 111 microversion: 2.1 time: 0.035816 Feb 19 21:16:03.974629 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2595/5100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:03 2022] GET /compute/v2.1/servers/4819c51a-7d85-497a-8852-84fad8704ddf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:16:03.986140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-88d1be12-3e21-4d31-9a4e-fd1bd2739fb9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:03.987448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-88d1be12-3e21-4d31-9a4e-fd1bd2739fb9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:03.995795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88d1be12-3e21-4d31-9a4e-fd1bd2739fb9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.996469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88d1be12-3e21-4d31-9a4e-fd1bd2739fb9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:03.998630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88d1be12-3e21-4d31-9a4e-fd1bd2739fb9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:03.998630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88d1be12-3e21-4d31-9a4e-fd1bd2739fb9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.016025 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-88d1be12-3e21-4d31-9a4e-fd1bd2739fb9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance d0d995f8-d42a-4848-8c2b-0ba8fb85618a could not be found. Feb 19 21:16:04.018324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-88d1be12-3e21-4d31-9a4e-fd1bd2739fb9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance d0d995f8-d42a-4848-8c2b-0ba8fb85618a could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:04.020720 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-88d1be12-3e21-4d31-9a4e-fd1bd2739fb9 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 404 len: 111 microversion: 2.1 time: 0.040303 Feb 19 21:16:04.021740 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2506/5101] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:16:03 2022] DELETE /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:04.030518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68a412b0-d34a-493e-ae18-236d0e36fb89 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:04.031562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-68a412b0-d34a-493e-ae18-236d0e36fb89 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: d0d995f8-d42a-4848-8c2b-0ba8fb85618a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:04.043071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68a412b0-d34a-493e-ae18-236d0e36fb89 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.048649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68a412b0-d34a-493e-ae18-236d0e36fb89 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.049553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68a412b0-d34a-493e-ae18-236d0e36fb89 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.050046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68a412b0-d34a-493e-ae18-236d0e36fb89 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.083803 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-68a412b0-d34a-493e-ae18-236d0e36fb89 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance d0d995f8-d42a-4848-8c2b-0ba8fb85618a could not be found. Feb 19 21:16:04.084566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68a412b0-d34a-493e-ae18-236d0e36fb89 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance d0d995f8-d42a-4848-8c2b-0ba8fb85618a could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:04.085998 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-68a412b0-d34a-493e-ae18-236d0e36fb89 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a" status: 404 len: 111 microversion: 2.1 time: 0.060403 Feb 19 21:16:04.087812 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2596/5102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:04 2022] GET /compute/v2.1/servers/d0d995f8-d42a-4848-8c2b-0ba8fb85618a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:04.095581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ceeb8bce-28db-44fd-afec-f3f5f9173073 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:04.096534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ceeb8bce-28db-44fd-afec-f3f5f9173073 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:04.103399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceeb8bce-28db-44fd-afec-f3f5f9173073 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.108835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceeb8bce-28db-44fd-afec-f3f5f9173073 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.111281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceeb8bce-28db-44fd-afec-f3f5f9173073 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.112224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ceeb8bce-28db-44fd-afec-f3f5f9173073 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.154469 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-ceeb8bce-28db-44fd-afec-f3f5f9173073 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 could not be found. Feb 19 21:16:04.156362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ceeb8bce-28db-44fd-afec-f3f5f9173073 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:04.158000 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ceeb8bce-28db-44fd-afec-f3f5f9173073 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 404 len: 111 microversion: 2.1 time: 0.067177 Feb 19 21:16:04.162405 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2507/5103] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:16:04 2022] DELETE /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:04.167029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-328c31a6-30e3-40c3-b068-c16dbfb514c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:04.167651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-328c31a6-30e3-40c3-b068-c16dbfb514c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0543e742-9e7b-4aed-8cc3-fe6c6dc22212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:04.181779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-328c31a6-30e3-40c3-b068-c16dbfb514c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.182347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-328c31a6-30e3-40c3-b068-c16dbfb514c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.184177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-328c31a6-30e3-40c3-b068-c16dbfb514c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.185124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-328c31a6-30e3-40c3-b068-c16dbfb514c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.211896 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-328c31a6-30e3-40c3-b068-c16dbfb514c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 could not be found. Feb 19 21:16:04.212669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-328c31a6-30e3-40c3-b068-c16dbfb514c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 0543e742-9e7b-4aed-8cc3-fe6c6dc22212 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:04.215039 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-328c31a6-30e3-40c3-b068-c16dbfb514c8 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212" status: 404 len: 111 microversion: 2.1 time: 0.051280 Feb 19 21:16:04.226958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a81a5043-ddda-4e94-ae6c-5a457db8d414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:04.228258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a81a5043-ddda-4e94-ae6c-5a457db8d414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0cb08c52-954e-4d64-888c-710bfbccb2eb] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:04.235054 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2597/5104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:04 2022] GET /compute/v2.1/servers/0543e742-9e7b-4aed-8cc3-fe6c6dc22212 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:04.237850 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-a81a5043-ddda-4e94-ae6c-5a457db8d414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 0cb08c52-954e-4d64-888c-710bfbccb2eb could not be found. Feb 19 21:16:04.238264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a81a5043-ddda-4e94-ae6c-5a457db8d414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 0cb08c52-954e-4d64-888c-710bfbccb2eb could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:04.239379 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a81a5043-ddda-4e94-ae6c-5a457db8d414 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0cb08c52-954e-4d64-888c-710bfbccb2eb" status: 404 len: 111 microversion: 2.1 time: 0.019155 Feb 19 21:16:04.240450 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2508/5105] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:16:04 2022] DELETE /compute/v2.1/servers/0cb08c52-954e-4d64-888c-710bfbccb2eb => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:04.267298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd97ba16-0397-49c4-b695-113b0db86405 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:04.280070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dd97ba16-0397-49c4-b695-113b0db86405 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: 0cb08c52-954e-4d64-888c-710bfbccb2eb] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:04.287400 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-dd97ba16-0397-49c4-b695-113b0db86405 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance 0cb08c52-954e-4d64-888c-710bfbccb2eb could not be found. Feb 19 21:16:04.288323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd97ba16-0397-49c4-b695-113b0db86405 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance 0cb08c52-954e-4d64-888c-710bfbccb2eb could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:04.289633 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dd97ba16-0397-49c4-b695-113b0db86405 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/0cb08c52-954e-4d64-888c-710bfbccb2eb" status: 404 len: 111 microversion: 2.1 time: 0.037816 Feb 19 21:16:04.291607 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2598/5106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:04 2022] GET /compute/v2.1/servers/0cb08c52-954e-4d64-888c-710bfbccb2eb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:04.300024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-127be18d-e669-4af4-aad9-e9c8da87c089 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:04.300558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-127be18d-e669-4af4-aad9-e9c8da87c089 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:04.315870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-127be18d-e669-4af4-aad9-e9c8da87c089 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.318532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-127be18d-e669-4af4-aad9-e9c8da87c089 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.319611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-127be18d-e669-4af4-aad9-e9c8da87c089 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.321283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-127be18d-e669-4af4-aad9-e9c8da87c089 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.379787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-127be18d-e669-4af4-aad9-e9c8da87c089 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:16:04.555568 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-127be18d-e669-4af4-aad9-e9c8da87c089 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 204 len: 0 microversion: 2.1 time: 0.258949 Feb 19 21:16:04.559182 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2509/5107] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:16:04 2022] DELETE /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:16:04.568317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-63f222c2-22e5-45fe-980f-2abe5b83b1b0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:04.569021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-63f222c2-22e5-45fe-980f-2abe5b83b1b0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:04.591803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63f222c2-22e5-45fe-980f-2abe5b83b1b0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.592938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63f222c2-22e5-45fe-980f-2abe5b83b1b0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:04.593988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63f222c2-22e5-45fe-980f-2abe5b83b1b0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:04.594601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63f222c2-22e5-45fe-980f-2abe5b83b1b0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:05.123979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-63f222c2-22e5-45fe-980f-2abe5b83b1b0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:05.136572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-97ed184a-7f23-4e2b-b45a-737e6f6ad7ce tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:05.137565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-97ed184a-7f23-4e2b-b45a-737e6f6ad7ce tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:05.148764 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-63f222c2-22e5-45fe-980f-2abe5b83b1b0 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1478 microversion: 2.1 time: 0.584748 Feb 19 21:16:05.149638 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2599/5108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:04 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1478 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:16:05.172247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97ed184a-7f23-4e2b-b45a-737e6f6ad7ce tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:05.172815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97ed184a-7f23-4e2b-b45a-737e6f6ad7ce tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:05.175079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97ed184a-7f23-4e2b-b45a-737e6f6ad7ce tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:05.175842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97ed184a-7f23-4e2b-b45a-737e6f6ad7ce tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:05.213328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-97ed184a-7f23-4e2b-b45a-737e6f6ad7ce tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:16:05.380850 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-97ed184a-7f23-4e2b-b45a-737e6f6ad7ce tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "DELETE /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 204 len: 0 microversion: 2.1 time: 0.252765 Feb 19 21:16:05.381779 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2510/5109] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:16:05 2022] DELETE /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:16:05.392966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0a36ff8-468d-4b88-b5ab-160c36d44923 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:05.393870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0a36ff8-468d-4b88-b5ab-160c36d44923 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:05.402069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a36ff8-468d-4b88-b5ab-160c36d44923 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:05.403558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a36ff8-468d-4b88-b5ab-160c36d44923 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:05.405542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a36ff8-468d-4b88-b5ab-160c36d44923 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:05.406163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0a36ff8-468d-4b88-b5ab-160c36d44923 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:05.844111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e0a36ff8-468d-4b88-b5ab-160c36d44923 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:05.863174 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0a36ff8-468d-4b88-b5ab-160c36d44923 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1505 microversion: 2.1 time: 0.466990 Feb 19 21:16:05.864922 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2600/5110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:05 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:16:06.171969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cede9733-3f82-4493-949b-e59d9062681e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:06.173416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cede9733-3f82-4493-949b-e59d9062681e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:06.181695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cede9733-3f82-4493-949b-e59d9062681e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:06.182541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cede9733-3f82-4493-949b-e59d9062681e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:06.183594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cede9733-3f82-4493-949b-e59d9062681e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:06.184250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cede9733-3f82-4493-949b-e59d9062681e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:06.882609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-52e71ef5-8a27-419f-9c3c-ff6573c4fa57 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:06.883214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-52e71ef5-8a27-419f-9c3c-ff6573c4fa57 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:06.892906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52e71ef5-8a27-419f-9c3c-ff6573c4fa57 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:06.893356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52e71ef5-8a27-419f-9c3c-ff6573c4fa57 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:06.902619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52e71ef5-8a27-419f-9c3c-ff6573c4fa57 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:06.903001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-52e71ef5-8a27-419f-9c3c-ff6573c4fa57 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:06.979316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cede9733-3f82-4493-949b-e59d9062681e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:07.045300 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cede9733-3f82-4493-949b-e59d9062681e tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1478 microversion: 2.1 time: 0.878396 Feb 19 21:16:07.046325 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2511/5111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:06 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1478 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:16:07.642937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-52e71ef5-8a27-419f-9c3c-ff6573c4fa57 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:07.672742 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-52e71ef5-8a27-419f-9c3c-ff6573c4fa57 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1505 microversion: 2.1 time: 0.794617 Feb 19 21:16:07.673949 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2601/5112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:06 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1505 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:16:08.063074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4d7426c-9f4c-4f19-8831-bc7862cfc637 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:08.063684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e4d7426c-9f4c-4f19-8831-bc7862cfc637 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:08.077981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4d7426c-9f4c-4f19-8831-bc7862cfc637 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:08.078396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4d7426c-9f4c-4f19-8831-bc7862cfc637 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:08.079400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4d7426c-9f4c-4f19-8831-bc7862cfc637 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:08.079848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e4d7426c-9f4c-4f19-8831-bc7862cfc637 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:08.242772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e4d7426c-9f4c-4f19-8831-bc7862cfc637 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614b36c5d1d64be3a2432a59a05c3dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36d6d50f8f40408962ab92e9cd1671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:08.254253 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e4d7426c-9f4c-4f19-8831-bc7862cfc637 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 200 len: 1436 microversion: 2.1 time: 0.195428 Feb 19 21:16:08.255507 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2512/5113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:08 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 1436 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:16:08.316476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0ebace5b-8279-4a04-9850-b5e76e4f75ed req-49683453-bac8-49e7-9d47-6215211faa81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35b33f5-0976-42bb-a8af-ed5a596f08d5", "name": "network-vif-deleted", "tag": "26602451-8ab7-4868-aff7-0faa278f42dc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:16:08.318412 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:08.318412 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:16:08.336903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0ebace5b-8279-4a04-9850-b5e76e4f75ed req-49683453-bac8-49e7-9d47-6215211faa81 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:08.337351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0ebace5b-8279-4a04-9850-b5e76e4f75ed req-49683453-bac8-49e7-9d47-6215211faa81 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:08.374166 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0ebace5b-8279-4a04-9850-b5e76e4f75ed req-49683453-bac8-49e7-9d47-6215211faa81 service nova] Creating event network-vif-deleted:26602451-8ab7-4868-aff7-0faa278f42dc for instance b35b33f5-0976-42bb-a8af-ed5a596f08d5 on nch1-master-1 Feb 19 21:16:08.380099 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0ebace5b-8279-4a04-9850-b5e76e4f75ed req-49683453-bac8-49e7-9d47-6215211faa81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071760 Feb 19 21:16:08.380951 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2602/5114] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:16:08.722120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:08.738352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:08.771240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:08.774735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:08.779640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:08.781232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:08.853171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:08.855843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:08.856319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lazy-loading 'fault' on Instance uuid 00dedc93-b220-4908-8f4f-506d606555be {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:16:08.973758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad93f38d6b384bcf9b1b190a9abb27ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929d77b858b4d848172346c97160377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:16:08.981835 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c743bd3d-45e9-4381-9b7d-cc224e689948 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 200 len: 1304 microversion: 2.1 time: 0.294979 Feb 19 21:16:08.991996 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2513/5115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:08 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 1304 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:16:09.274795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b52634c5-db12-44ca-bb73-36984c957900 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:09.275991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b52634c5-db12-44ca-bb73-36984c957900 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] [instance: b35b33f5-0976-42bb-a8af-ed5a596f08d5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:09.290860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b52634c5-db12-44ca-bb73-36984c957900 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:09.292432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b52634c5-db12-44ca-bb73-36984c957900 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:09.294329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b52634c5-db12-44ca-bb73-36984c957900 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:09.294978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b52634c5-db12-44ca-bb73-36984c957900 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:09.347550 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-b52634c5-db12-44ca-bb73-36984c957900 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] HTTP exception thrown: Instance b35b33f5-0976-42bb-a8af-ed5a596f08d5 could not be found. Feb 19 21:16:09.352700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b52634c5-db12-44ca-bb73-36984c957900 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] Returning 404 to user: Instance b35b33f5-0976-42bb-a8af-ed5a596f08d5 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:09.354145 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b52634c5-db12-44ca-bb73-36984c957900 tempest-ServersTestJSON-1270518497 tempest-ServersTestJSON-1270518497-project] 10.222.0.30 "GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5" status: 404 len: 111 microversion: 2.1 time: 0.084526 Feb 19 21:16:09.356461 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2603/5116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:09 2022] GET /compute/v2.1/servers/b35b33f5-0976-42bb-a8af-ed5a596f08d5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:16:09.998946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c612fc2-8a07-4e80-aae9-91308543d8b9 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:10.000235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c612fc2-8a07-4e80-aae9-91308543d8b9 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] [instance: 00dedc93-b220-4908-8f4f-506d606555be] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:16:10.007603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c612fc2-8a07-4e80-aae9-91308543d8b9 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:10.017119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c612fc2-8a07-4e80-aae9-91308543d8b9 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:10.018278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c612fc2-8a07-4e80-aae9-91308543d8b9 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:10.018797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c612fc2-8a07-4e80-aae9-91308543d8b9 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:10.046613 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-2c612fc2-8a07-4e80-aae9-91308543d8b9 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] HTTP exception thrown: Instance 00dedc93-b220-4908-8f4f-506d606555be could not be found. Feb 19 21:16:10.047464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c612fc2-8a07-4e80-aae9-91308543d8b9 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] Returning 404 to user: Instance 00dedc93-b220-4908-8f4f-506d606555be could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:16:10.050296 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c612fc2-8a07-4e80-aae9-91308543d8b9 tempest-VolumesActionsTest-1474651639 tempest-VolumesActionsTest-1474651639-project] 10.222.0.30 "GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be" status: 404 len: 111 microversion: 2.1 time: 0.053453 Feb 19 21:16:10.051760 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2514/5117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:16:09 2022] GET /compute/v2.1/servers/00dedc93-b220-4908-8f4f-506d606555be => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:16:10.425047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6fa9d042-85d4-4f60-87cc-652b515f4d44 req-6f2543c3-47df-4972-9802-ab9c3a499524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dedc93-b220-4908-8f4f-506d606555be", "name": "network-vif-deleted", "tag": "373ba6f9-858a-4bc3-b3bf-ba987c52475f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:16:10.450407 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:16:10.450407 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:16:10.479873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6fa9d042-85d4-4f60-87cc-652b515f4d44 req-6f2543c3-47df-4972-9802-ab9c3a499524 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:16:10.480178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6fa9d042-85d4-4f60-87cc-652b515f4d44 req-6f2543c3-47df-4972-9802-ab9c3a499524 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:16:10.493307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6fa9d042-85d4-4f60-87cc-652b515f4d44 req-6f2543c3-47df-4972-9802-ab9c3a499524 service nova] Creating event network-vif-deleted:373ba6f9-858a-4bc3-b3bf-ba987c52475f for instance 00dedc93-b220-4908-8f4f-506d606555be on nch2-master-1 Feb 19 21:16:10.499631 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6fa9d042-85d4-4f60-87cc-652b515f4d44 req-6f2543c3-47df-4972-9802-ab9c3a499524 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080745 Feb 19 21:16:10.500761 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2604/5118] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:16:12.940165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c245048f-c753-4ae6-8bdc-e949fad41936 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Calling method '.version_select at 0x7f6466b7e160>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:13.251501 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c245048f-c753-4ae6-8bdc-e949fad41936 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.554821 Feb 19 21:16:13.252179 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2515/5119] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:16:12 2022] GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7/defaults => generated 371 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:16:13.264392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad702d42-3365-4781-8a74-4fae0ee98553 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Calling method '.version_select at 0x7f6467686f70>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:13.385086 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ad702d42-3365-4781-8a74-4fae0ee98553 tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7" status: 200 len: 371 microversion: 2.1 time: 0.123406 Feb 19 21:16:13.391717 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2605/5120] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:16:13 2022] GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7 => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:16:13.402601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c31f64be-cbfa-4f17-bf54-990d7ddbce2a tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Calling method '.version_select at 0x7f6479200820>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:13.933858 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c31f64be-cbfa-4f17-bf54-990d7ddbce2a tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.534876 Feb 19 21:16:13.934747 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2516/5121] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:16:13 2022] GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7/defaults => generated 371 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:16:13.948861 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b5d0bf87-3651-4c4e-9696-9425007cfc1b tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Calling method '.version_select at 0x7f6467db8a60>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:14.182600 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b5d0bf87-3651-4c4e-9696-9425007cfc1b tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7" status: 200 len: 371 microversion: 2.1 time: 0.238561 Feb 19 21:16:14.183253 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2606/5122] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:16:13 2022] GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7 => generated 371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:16:14.194863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4009470-dd7c-4374-9fc2-6bd3488a5b8d tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Calling method '.version_select at 0x7f6467ac33a0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:14.604734 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e4009470-dd7c-4374-9fc2-6bd3488a5b8d tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7?user_id=f4440cb2216f470d8267320f3c14bc00" status: 200 len: 371 microversion: 2.1 time: 0.414332 Feb 19 21:16:14.609983 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2517/5123] 10.222.0.30 () {58 vars in 1322 bytes} [Sat Feb 19 21:16:14 2022] GET /compute/v2.1/os-quota-sets/e84fb425ca4049869c3cb1643d2097a7?user_id=f4440cb2216f470d8267320f3c14bc00 => generated 371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:16:18.414629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b5d0bf87-3651-4c4e-9696-9425007cfc1b tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:18.416471 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b5d0bf87-3651-4c4e-9696-9425007cfc1b tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002146 Feb 19 21:16:18.417805 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2607/5124] 10.222.0.30 () {56 vars in 885 bytes} [Sat Feb 19 21:16:18 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Feb 19 21:16:18.426794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4009470-dd7c-4374-9fc2-6bd3488a5b8d tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:18.428742 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e4009470-dd7c-4374-9fc2-6bd3488a5b8d tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] 10.222.0.30 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002573 Feb 19 21:16:18.429773 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2518/5125] 10.222.0.30 () {54 vars in 1034 bytes} [Sat Feb 19 21:16:18 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Feb 19 21:16:18.435982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b5d0bf87-3651-4c4e-9696-9425007cfc1b tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:18.437891 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b5d0bf87-3651-4c4e-9696-9425007cfc1b tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002393 Feb 19 21:16:18.438537 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2608/5126] 10.222.0.30 () {54 vars in 1040 bytes} [Sat Feb 19 21:16:18 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:16:18.449775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e4009470-dd7c-4374-9fc2-6bd3488a5b8d tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:16:18.454638 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e4009470-dd7c-4374-9fc2-6bd3488a5b8d tempest-QuotasTestJSON-133935982 tempest-QuotasTestJSON-133935982-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.008288 Feb 19 21:16:18.455361 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2519/5127] 10.222.0.30 () {56 vars in 885 bytes} [Sat Feb 19 21:16:18 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Feb 19 21:16:59.545403 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:16:59.546665 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 21:16:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:17:47.130180 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 21:17:47.347576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82598751-1a63-44d4-9c9d-c7c7d8341fd2 tempest-PortsAdminExtendedAttrsTestJSON-637872976 tempest-PortsAdminExtendedAttrsTestJSON-637872976-project-admin] Calling method '.version_select at 0x7f6467a9de50>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:17:47.349121 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:17:47.349121 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:17:47.359047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82598751-1a63-44d4-9c9d-c7c7d8341fd2 tempest-PortsAdminExtendedAttrsTestJSON-637872976 tempest-PortsAdminExtendedAttrsTestJSON-637872976-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:17:47.359616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82598751-1a63-44d4-9c9d-c7c7d8341fd2 tempest-PortsAdminExtendedAttrsTestJSON-637872976 tempest-PortsAdminExtendedAttrsTestJSON-637872976-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:17:47.391187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82598751-1a63-44d4-9c9d-c7c7d8341fd2 tempest-PortsAdminExtendedAttrsTestJSON-637872976 tempest-PortsAdminExtendedAttrsTestJSON-637872976-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:17:47.391900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82598751-1a63-44d4-9c9d-c7c7d8341fd2 tempest-PortsAdminExtendedAttrsTestJSON-637872976 tempest-PortsAdminExtendedAttrsTestJSON-637872976-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:17:47.407407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82598751-1a63-44d4-9c9d-c7c7d8341fd2 tempest-PortsAdminExtendedAttrsTestJSON-637872976 tempest-PortsAdminExtendedAttrsTestJSON-637872976-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:17:47.408170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82598751-1a63-44d4-9c9d-c7c7d8341fd2 tempest-PortsAdminExtendedAttrsTestJSON-637872976 tempest-PortsAdminExtendedAttrsTestJSON-637872976-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:17:47.418342 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-82598751-1a63-44d4-9c9d-c7c7d8341fd2 tempest-PortsAdminExtendedAttrsTestJSON-637872976 tempest-PortsAdminExtendedAttrsTestJSON-637872976-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.294325 Feb 19 21:17:47.420809 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2609/5128] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 21:17:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:18:06.081752 ncdv-master-1 devstack@n-api.service[136095]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02a8a3ca-f500-48fe-b8eb-c416084a9cb7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 21:18:06.391813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b6668e78-429e-4291-b39a-225c746a895d tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:06.394287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b6668e78-429e-4291-b39a-225c746a895d tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:06.403223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6668e78-429e-4291-b39a-225c746a895d tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:06.404290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6668e78-429e-4291-b39a-225c746a895d tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:06.406010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6668e78-429e-4291-b39a-225c746a895d tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:06.407055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6668e78-429e-4291-b39a-225c746a895d tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:06.450857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b6668e78-429e-4291-b39a-225c746a895d tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:18:06.613337 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b6668e78-429e-4291-b39a-225c746a895d tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "DELETE /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 204 len: 0 microversion: 2.1 time: 0.533534 Feb 19 21:18:06.621619 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2520/5129] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:18:06 2022] DELETE /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:18:06.626071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-adfaac29-53d0-471b-afee-8f392f094bc2 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:06.626736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-adfaac29-53d0-471b-afee-8f392f094bc2 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:06.643171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-adfaac29-53d0-471b-afee-8f392f094bc2 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:06.644601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-adfaac29-53d0-471b-afee-8f392f094bc2 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:06.646685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-adfaac29-53d0-471b-afee-8f392f094bc2 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:06.647422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-adfaac29-53d0-471b-afee-8f392f094bc2 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:06.666162 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57620. Feb 19 21:18:07.849422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-adfaac29-53d0-471b-afee-8f392f094bc2 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:07.865335 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-adfaac29-53d0-471b-afee-8f392f094bc2 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1732 microversion: 2.1 time: 1.242945 Feb 19 21:18:07.868355 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2610/5130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:06 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1732 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:18:08.885816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-03d4506d-a9ac-4177-a255-58003d08e9ee tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:08.886658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-03d4506d-a9ac-4177-a255-58003d08e9ee tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:08.894464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03d4506d-a9ac-4177-a255-58003d08e9ee tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:08.895253 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03d4506d-a9ac-4177-a255-58003d08e9ee tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:08.896269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03d4506d-a9ac-4177-a255-58003d08e9ee tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:08.896728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-03d4506d-a9ac-4177-a255-58003d08e9ee tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:08.904065 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] [02a8a3ca-f500-48fe-b8eb-c416084a9cb7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57654. Feb 19 21:18:10.211466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-03d4506d-a9ac-4177-a255-58003d08e9ee tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:10.223287 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-03d4506d-a9ac-4177-a255-58003d08e9ee tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1732 microversion: 2.1 time: 1.341449 Feb 19 21:18:10.225347 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2521/5131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:08 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1732 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:18:11.245576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a6450987-c445-4d02-981c-93f44f9703ff tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:11.248213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a6450987-c445-4d02-981c-93f44f9703ff tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:11.258130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6450987-c445-4d02-981c-93f44f9703ff tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:11.258934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6450987-c445-4d02-981c-93f44f9703ff tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:11.260038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6450987-c445-4d02-981c-93f44f9703ff tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:11.260732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6450987-c445-4d02-981c-93f44f9703ff tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:11.437655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a6450987-c445-4d02-981c-93f44f9703ff tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:11.447294 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a6450987-c445-4d02-981c-93f44f9703ff tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1665 microversion: 2.1 time: 0.206082 Feb 19 21:18:11.448302 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2611/5132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:11 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1665 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:12.465038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-23c196bd-9ed5-4a94-9436-f19bddb32278 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:12.466355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-23c196bd-9ed5-4a94-9436-f19bddb32278 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:12.473573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23c196bd-9ed5-4a94-9436-f19bddb32278 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:12.474343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23c196bd-9ed5-4a94-9436-f19bddb32278 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:12.475314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23c196bd-9ed5-4a94-9436-f19bddb32278 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:12.475753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23c196bd-9ed5-4a94-9436-f19bddb32278 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:12.651740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-23c196bd-9ed5-4a94-9436-f19bddb32278 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e1cafad4f475dad7bc93b50312279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6216f26c814fceaa94fc64e78c8efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:12.667334 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-23c196bd-9ed5-4a94-9436-f19bddb32278 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 200 len: 1665 microversion: 2.1 time: 0.206159 Feb 19 21:18:12.670103 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2522/5133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:12 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 1665 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:12.829176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1de87b72-672b-49e6-b2b0-36cfd3c8d400 req-4cff8702-cce9-4e41-b0ce-aa92030332ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452de813-e220-4db1-8f6c-6d03d6b88559", "name": "network-vif-deleted", "tag": "fd590ea4-9502-47f9-a804-41b8d37bcda0"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:18:12.831884 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:18:12.831884 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:18:12.847594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1de87b72-672b-49e6-b2b0-36cfd3c8d400 req-4cff8702-cce9-4e41-b0ce-aa92030332ee service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:12.849806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1de87b72-672b-49e6-b2b0-36cfd3c8d400 req-4cff8702-cce9-4e41-b0ce-aa92030332ee service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:12.905609 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1de87b72-672b-49e6-b2b0-36cfd3c8d400 req-4cff8702-cce9-4e41-b0ce-aa92030332ee service nova] Creating event network-vif-deleted:fd590ea4-9502-47f9-a804-41b8d37bcda0 for instance 452de813-e220-4db1-8f6c-6d03d6b88559 on nch2-master-1 Feb 19 21:18:12.917637 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1de87b72-672b-49e6-b2b0-36cfd3c8d400 req-4cff8702-cce9-4e41-b0ce-aa92030332ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094310 Feb 19 21:18:12.919210 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2612/5134] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:18:13.688786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-55a2a886-3330-4497-92cb-2ac8930ab659 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:13.689451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-55a2a886-3330-4497-92cb-2ac8930ab659 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:13.709127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55a2a886-3330-4497-92cb-2ac8930ab659 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:13.709817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55a2a886-3330-4497-92cb-2ac8930ab659 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:13.710658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55a2a886-3330-4497-92cb-2ac8930ab659 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:13.711651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55a2a886-3330-4497-92cb-2ac8930ab659 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:13.730670 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-55a2a886-3330-4497-92cb-2ac8930ab659 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] HTTP exception thrown: Instance 452de813-e220-4db1-8f6c-6d03d6b88559 could not be found. Feb 19 21:18:13.734300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-55a2a886-3330-4497-92cb-2ac8930ab659 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Returning 404 to user: Instance 452de813-e220-4db1-8f6c-6d03d6b88559 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:18:13.735441 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-55a2a886-3330-4497-92cb-2ac8930ab659 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 404 len: 111 microversion: 2.1 time: 0.052772 Feb 19 21:18:13.739723 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2523/5135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:13 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:18:15.042417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-550c947f-7c5b-4649-92db-a634d62d97ce tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:15.042978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-550c947f-7c5b-4649-92db-a634d62d97ce tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:15.056050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-550c947f-7c5b-4649-92db-a634d62d97ce tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:15.057446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-550c947f-7c5b-4649-92db-a634d62d97ce tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:15.058515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-550c947f-7c5b-4649-92db-a634d62d97ce tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:15.059794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-550c947f-7c5b-4649-92db-a634d62d97ce tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:15.091074 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-550c947f-7c5b-4649-92db-a634d62d97ce tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] HTTP exception thrown: Instance 452de813-e220-4db1-8f6c-6d03d6b88559 could not be found. Feb 19 21:18:15.092106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-550c947f-7c5b-4649-92db-a634d62d97ce tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Returning 404 to user: Instance 452de813-e220-4db1-8f6c-6d03d6b88559 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:18:15.093612 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-550c947f-7c5b-4649-92db-a634d62d97ce tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "DELETE /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 404 len: 111 microversion: 2.1 time: 0.057170 Feb 19 21:18:15.094453 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2613/5136] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:18:15 2022] DELETE /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:18:15.103955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-377456b7-0d63-43b0-bae1-e310c5cced77 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:15.104630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-377456b7-0d63-43b0-bae1-e310c5cced77 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] [instance: 452de813-e220-4db1-8f6c-6d03d6b88559] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:15.115401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377456b7-0d63-43b0-bae1-e310c5cced77 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:15.115864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377456b7-0d63-43b0-bae1-e310c5cced77 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:15.124077 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377456b7-0d63-43b0-bae1-e310c5cced77 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:15.125050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-377456b7-0d63-43b0-bae1-e310c5cced77 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:15.155134 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-377456b7-0d63-43b0-bae1-e310c5cced77 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] HTTP exception thrown: Instance 452de813-e220-4db1-8f6c-6d03d6b88559 could not be found. Feb 19 21:18:15.155752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-377456b7-0d63-43b0-bae1-e310c5cced77 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Returning 404 to user: Instance 452de813-e220-4db1-8f6c-6d03d6b88559 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:18:15.161483 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-377456b7-0d63-43b0-bae1-e310c5cced77 tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559" status: 404 len: 111 microversion: 2.1 time: 0.062355 Feb 19 21:18:15.165435 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2524/5137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:15 2022] GET /compute/v2.1/servers/452de813-e220-4db1-8f6c-6d03d6b88559 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:18:16.226474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f836c45-2182-43cf-a8cb-ce9078e9f05a tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] Calling method '.version_select at 0x7f6467eb5670>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:16.227394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5e3b5719-253a-4321-bbf2-1a9d7afe258d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Action: 'create', calling method: .version_select at 0x7f6467ac33a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1209497056"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:18:16.269590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5e3b5719-253a-4321-bbf2-1a9d7afe258d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:18:16.295082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5e3b5719-253a-4321-bbf2-1a9d7afe258d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for user e1fde410660b47939139960a9420179a and project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:18:16.339179 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f836c45-2182-43cf-a8cb-ce9078e9f05a tempest-TestServerBasicOps-537861107 tempest-TestServerBasicOps-537861107-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-970814824" status: 202 len: 0 microversion: 2.1 time: 0.134706 Feb 19 21:18:16.341747 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2614/5138] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Feb 19 21:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-970814824 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:18:16.638486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5e3b5719-253a-4321-bbf2-1a9d7afe258d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:18:16.649656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5e3b5719-253a-4321-bbf2-1a9d7afe258d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for user e1fde410660b47939139960a9420179a and project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:18:16.685727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5e3b5719-253a-4321-bbf2-1a9d7afe258d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2309 microversion: 2.1 time: 0.463877 Feb 19 21:18:16.691107 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2525/5139] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:18:16 2022] POST /compute/v2.1/os-keypairs => generated 2309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:18:22.940485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1149240669", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "47eb1791-b4e6-4bd2-a055-e8f0ffe0b61f"}], "key_name": "tempest-TestNetworkBasicOps-1209497056", "security_groups": [{"name": "tempest-secgroup-smoke-1913659318"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:18:23.114349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] validate_networks() for [('47eb1791-b4e6-4bd2-a055-e8f0ffe0b61f', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:18:24.293665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:18:24.295804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:18:24.296694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:18:24.297293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:18:24.298788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:18:24.314481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:24.316995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:24.319008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:24.319944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:24.355252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:18:24.369711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for user e1fde410660b47939139960a9420179a and project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:18:24.403330 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:18:24.406869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:18:24.536395 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-04ec3443-cff6-43fa-b91e-4712bb573549 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.602112 Feb 19 21:18:24.544829 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2615/5140] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:18:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:18:24.550656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7bd63445-6b97-4ca5-85ab-69cf888b7eb0 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:24.551704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7bd63445-6b97-4ca5-85ab-69cf888b7eb0 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:24.705895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7bd63445-6b97-4ca5-85ab-69cf888b7eb0 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:24.712923 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7bd63445-6b97-4ca5-85ab-69cf888b7eb0 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1249 microversion: 2.1 time: 0.166604 Feb 19 21:18:24.713516 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2526/5141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:24 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1249 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:25.747578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-afda7d13-8370-4411-8c80-0d15f65ee04e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:25.748874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-afda7d13-8370-4411-8c80-0d15f65ee04e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:25.759827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afda7d13-8370-4411-8c80-0d15f65ee04e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:25.760302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afda7d13-8370-4411-8c80-0d15f65ee04e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:25.764629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afda7d13-8370-4411-8c80-0d15f65ee04e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:25.768381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afda7d13-8370-4411-8c80-0d15f65ee04e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:25.959960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-afda7d13-8370-4411-8c80-0d15f65ee04e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:25.969209 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-afda7d13-8370-4411-8c80-0d15f65ee04e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1245 microversion: 2.1 time: 0.234064 Feb 19 21:18:25.969828 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2616/5142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:25 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1245 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:27.003129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-16ccae63-1937-4cc3-a19b-131afad8e351 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:27.004483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-16ccae63-1937-4cc3-a19b-131afad8e351 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:27.013214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16ccae63-1937-4cc3-a19b-131afad8e351 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:27.014002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16ccae63-1937-4cc3-a19b-131afad8e351 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:27.015097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16ccae63-1937-4cc3-a19b-131afad8e351 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:27.015609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16ccae63-1937-4cc3-a19b-131afad8e351 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:27.161017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-16ccae63-1937-4cc3-a19b-131afad8e351 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:27.171306 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-16ccae63-1937-4cc3-a19b-131afad8e351 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1307 microversion: 2.1 time: 0.172087 Feb 19 21:18:27.172706 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2527/5143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:26 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:28.190948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b84d869e-557d-4447-af55-ebcc1c38aa20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:28.192252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b84d869e-557d-4447-af55-ebcc1c38aa20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:28.201471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b84d869e-557d-4447-af55-ebcc1c38aa20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:28.202191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b84d869e-557d-4447-af55-ebcc1c38aa20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:28.203261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b84d869e-557d-4447-af55-ebcc1c38aa20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:28.204201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b84d869e-557d-4447-af55-ebcc1c38aa20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:28.364989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b84d869e-557d-4447-af55-ebcc1c38aa20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:28.378308 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b84d869e-557d-4447-af55-ebcc1c38aa20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1307 microversion: 2.1 time: 0.192858 Feb 19 21:18:28.379612 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2617/5144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:28 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1307 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:29.395481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f474c26-644c-4dd0-ae86-3c08dbff79a6 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:29.396229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f474c26-644c-4dd0-ae86-3c08dbff79a6 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:29.408830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f474c26-644c-4dd0-ae86-3c08dbff79a6 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:29.409747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f474c26-644c-4dd0-ae86-3c08dbff79a6 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:29.410973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f474c26-644c-4dd0-ae86-3c08dbff79a6 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:29.412020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f474c26-644c-4dd0-ae86-3c08dbff79a6 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:30.285986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f474c26-644c-4dd0-ae86-3c08dbff79a6 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:30.305620 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f474c26-644c-4dd0-ae86-3c08dbff79a6 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1375 microversion: 2.1 time: 0.914143 Feb 19 21:18:30.306243 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2528/5145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:29 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1375 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:18:31.323210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b9da4a8c-0dc1-471f-8900-518c08f5e09f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:31.323782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b9da4a8c-0dc1-471f-8900-518c08f5e09f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:31.335327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9da4a8c-0dc1-471f-8900-518c08f5e09f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:31.336558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9da4a8c-0dc1-471f-8900-518c08f5e09f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:31.336771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9da4a8c-0dc1-471f-8900-518c08f5e09f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:31.337089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b9da4a8c-0dc1-471f-8900-518c08f5e09f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:32.889450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b9da4a8c-0dc1-471f-8900-518c08f5e09f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:32.912164 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b9da4a8c-0dc1-471f-8900-518c08f5e09f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1375 microversion: 2.1 time: 1.590138 Feb 19 21:18:32.924542 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2618/5146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:31 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1375 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:33.937834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-05097ad4-ba63-4349-bcd7-7f78914cdd14 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:33.940190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-05097ad4-ba63-4349-bcd7-7f78914cdd14 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:33.972476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05097ad4-ba63-4349-bcd7-7f78914cdd14 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:33.973812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05097ad4-ba63-4349-bcd7-7f78914cdd14 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:33.975008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05097ad4-ba63-4349-bcd7-7f78914cdd14 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:33.975556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05097ad4-ba63-4349-bcd7-7f78914cdd14 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:34.197152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-58a0f069-9373-44f7-ad55-da6dd700f146 req-9d29144a-ddbf-4f51-819a-79c9b43d4055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4445865a-4d52-4db4-9915-98e0de5f708a", "tag": "9fbcb5db-1672-47dd-aee8-5c671023daed"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:18:34.198768 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:18:34.198768 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:18:34.215206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-58a0f069-9373-44f7-ad55-da6dd700f146 req-9d29144a-ddbf-4f51-819a-79c9b43d4055 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:34.215206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-58a0f069-9373-44f7-ad55-da6dd700f146 req-9d29144a-ddbf-4f51-819a-79c9b43d4055 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:34.243256 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-58a0f069-9373-44f7-ad55-da6dd700f146 req-9d29144a-ddbf-4f51-819a-79c9b43d4055 service nova] Creating event network-changed:9fbcb5db-1672-47dd-aee8-5c671023daed for instance 4445865a-4d52-4db4-9915-98e0de5f708a on nch1-master-1 Feb 19 21:18:34.254680 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-58a0f069-9373-44f7-ad55-da6dd700f146 req-9d29144a-ddbf-4f51-819a-79c9b43d4055 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061030 Feb 19 21:18:34.255891 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2619/5147] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:18:34.567607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-05097ad4-ba63-4349-bcd7-7f78914cdd14 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:34.576559 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-05097ad4-ba63-4349-bcd7-7f78914cdd14 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1375 microversion: 2.1 time: 0.649210 Feb 19 21:18:34.587446 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2529/5148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:33 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1375 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:35.596715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e436626f-c811-4225-9697-fcc461c56f38 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:35.596715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e436626f-c811-4225-9697-fcc461c56f38 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:35.602150 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e436626f-c811-4225-9697-fcc461c56f38 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:35.602665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e436626f-c811-4225-9697-fcc461c56f38 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:35.603526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e436626f-c811-4225-9697-fcc461c56f38 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:35.604222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e436626f-c811-4225-9697-fcc461c56f38 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:36.231232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e436626f-c811-4225-9697-fcc461c56f38 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:36.255832 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e436626f-c811-4225-9697-fcc461c56f38 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1375 microversion: 2.1 time: 0.662617 Feb 19 21:18:36.271236 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2620/5149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:35 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1375 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:37.273407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e0265d33-12ca-4597-af6c-fbbe86c7ff85 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:37.274041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e0265d33-12ca-4597-af6c-fbbe86c7ff85 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:37.287905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0265d33-12ca-4597-af6c-fbbe86c7ff85 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:37.292056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0265d33-12ca-4597-af6c-fbbe86c7ff85 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:37.293878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0265d33-12ca-4597-af6c-fbbe86c7ff85 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:37.295873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0265d33-12ca-4597-af6c-fbbe86c7ff85 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:37.811126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e0265d33-12ca-4597-af6c-fbbe86c7ff85 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:37.826619 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e0265d33-12ca-4597-af6c-fbbe86c7ff85 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1375 microversion: 2.1 time: 0.554698 Feb 19 21:18:37.837272 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2530/5150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:37 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1375 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:38.872206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-04a66aa9-d37b-43d4-a564-e7dca6f5dfe3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:38.873425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-04a66aa9-d37b-43d4-a564-e7dca6f5dfe3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:38.909846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04a66aa9-d37b-43d4-a564-e7dca6f5dfe3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:38.911963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04a66aa9-d37b-43d4-a564-e7dca6f5dfe3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:38.915654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04a66aa9-d37b-43d4-a564-e7dca6f5dfe3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:38.918621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04a66aa9-d37b-43d4-a564-e7dca6f5dfe3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:39.515241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-04a66aa9-d37b-43d4-a564-e7dca6f5dfe3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:39.529409 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-04a66aa9-d37b-43d4-a564-e7dca6f5dfe3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1375 microversion: 2.1 time: 0.688009 Feb 19 21:18:39.541056 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2621/5151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:38 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1375 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:40.558892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1cee89bc-5e63-4a11-b73e-071529ad11fa tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:40.559661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1cee89bc-5e63-4a11-b73e-071529ad11fa tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:40.579689 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:18:40.580397 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 21:18:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Feb 19 21:18:40.589204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cee89bc-5e63-4a11-b73e-071529ad11fa tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:40.603223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cee89bc-5e63-4a11-b73e-071529ad11fa tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:40.604138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cee89bc-5e63-4a11-b73e-071529ad11fa tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:40.604637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cee89bc-5e63-4a11-b73e-071529ad11fa tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:40.689679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5d0e9e53-ca6a-4954-b924-c0c867c7ad86 req-cd075b5f-2080-4547-b0d9-01adccf16ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4445865a-4d52-4db4-9915-98e0de5f708a", "name": "network-vif-plugged", "status": "completed", "tag": "9fbcb5db-1672-47dd-aee8-5c671023daed"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:18:40.692993 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:18:40.692993 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:18:40.709040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5d0e9e53-ca6a-4954-b924-c0c867c7ad86 req-cd075b5f-2080-4547-b0d9-01adccf16ccd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:40.709713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5d0e9e53-ca6a-4954-b924-c0c867c7ad86 req-cd075b5f-2080-4547-b0d9-01adccf16ccd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:40.745312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5d0e9e53-ca6a-4954-b924-c0c867c7ad86 req-cd075b5f-2080-4547-b0d9-01adccf16ccd service nova] Creating event network-vif-plugged:9fbcb5db-1672-47dd-aee8-5c671023daed for instance 4445865a-4d52-4db4-9915-98e0de5f708a on nch1-master-1 Feb 19 21:18:40.757942 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5d0e9e53-ca6a-4954-b924-c0c867c7ad86 req-cd075b5f-2080-4547-b0d9-01adccf16ccd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369729 Feb 19 21:18:40.758568 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2531/5152] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:18:41.409336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1cee89bc-5e63-4a11-b73e-071529ad11fa tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:41.428866 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1cee89bc-5e63-4a11-b73e-071529ad11fa tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1375 microversion: 2.1 time: 0.886321 Feb 19 21:18:41.434403 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2622/5153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:40 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1375 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:42.451050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9fd1d240-970e-4c16-8bfe-52ed02e7fa00 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:42.451758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9fd1d240-970e-4c16-8bfe-52ed02e7fa00 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:42.468950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fd1d240-970e-4c16-8bfe-52ed02e7fa00 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:42.469423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fd1d240-970e-4c16-8bfe-52ed02e7fa00 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:42.470210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fd1d240-970e-4c16-8bfe-52ed02e7fa00 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:42.470664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fd1d240-970e-4c16-8bfe-52ed02e7fa00 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:42.813194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9fd1d240-970e-4c16-8bfe-52ed02e7fa00 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:42.825606 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9fd1d240-970e-4c16-8bfe-52ed02e7fa00 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1375 microversion: 2.1 time: 0.380202 Feb 19 21:18:42.837446 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2532/5154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:42 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1375 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:43.845198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0cecf774-ca41-47d4-ac79-f6ded125e243 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:43.845646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0cecf774-ca41-47d4-ac79-f6ded125e243 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:43.864275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cecf774-ca41-47d4-ac79-f6ded125e243 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:43.864901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cecf774-ca41-47d4-ac79-f6ded125e243 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:43.865831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cecf774-ca41-47d4-ac79-f6ded125e243 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:43.866291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0cecf774-ca41-47d4-ac79-f6ded125e243 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:44.384296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0cecf774-ca41-47d4-ac79-f6ded125e243 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:44.396192 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0cecf774-ca41-47d4-ac79-f6ded125e243 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1547 microversion: 2.1 time: 0.555010 Feb 19 21:18:44.410151 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2623/5155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:43 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1547 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:44.418379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-861a24d5-1af9-4738-83d1-3bdeb7207990 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:18:44.419048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-861a24d5-1af9-4738-83d1-3bdeb7207990 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:18:44.446980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-861a24d5-1af9-4738-83d1-3bdeb7207990 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:44.447301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-861a24d5-1af9-4738-83d1-3bdeb7207990 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:44.454049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-861a24d5-1af9-4738-83d1-3bdeb7207990 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:44.454512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-861a24d5-1af9-4738-83d1-3bdeb7207990 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:45.004596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-861a24d5-1af9-4738-83d1-3bdeb7207990 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:18:45.071445 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-861a24d5-1af9-4738-83d1-3bdeb7207990 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1547 microversion: 2.1 time: 0.654386 Feb 19 21:18:45.073867 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2533/5156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:18:44 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1547 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:18:53.289468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b5fd2043-2c59-4cbb-ba68-601fa2badcd2 req-4af9d22f-1ea6-4908-a68b-787ea017c1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4445865a-4d52-4db4-9915-98e0de5f708a", "tag": "9fbcb5db-1672-47dd-aee8-5c671023daed"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:18:53.292019 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:18:53.292019 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:18:53.318254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b5fd2043-2c59-4cbb-ba68-601fa2badcd2 req-4af9d22f-1ea6-4908-a68b-787ea017c1a6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:18:53.320115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b5fd2043-2c59-4cbb-ba68-601fa2badcd2 req-4af9d22f-1ea6-4908-a68b-787ea017c1a6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:18:53.358055 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b5fd2043-2c59-4cbb-ba68-601fa2badcd2 req-4af9d22f-1ea6-4908-a68b-787ea017c1a6 service nova] Creating event network-changed:9fbcb5db-1672-47dd-aee8-5c671023daed for instance 4445865a-4d52-4db4-9915-98e0de5f708a on nch1-master-1 Feb 19 21:18:53.369771 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b5fd2043-2c59-4cbb-ba68-601fa2badcd2 req-4af9d22f-1ea6-4908-a68b-787ea017c1a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085842 Feb 19 21:18:53.373899 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2624/5157] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:19:06.876297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d57076c1-32ca-4328-b3eb-cb54fd2d6041 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:19:06.877468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d57076c1-32ca-4328-b3eb-cb54fd2d6041 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:06.889573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d57076c1-32ca-4328-b3eb-cb54fd2d6041 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:06.890709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d57076c1-32ca-4328-b3eb-cb54fd2d6041 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:06.894066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d57076c1-32ca-4328-b3eb-cb54fd2d6041 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:06.897092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d57076c1-32ca-4328-b3eb-cb54fd2d6041 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:06.987318 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d57076c1-32ca-4328-b3eb-cb54fd2d6041 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "POST /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a/action" status: 200 len: 24576 microversion: 2.1 time: 0.116212 Feb 19 21:19:06.998106 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2534/5158] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:19:06 2022] POST /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a/action => generated 24576 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:19:26.069382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-95f7be79-98c5-4abe-88e9-419fbc07d38c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Action: 'create', calling method: .version_select at 0x7f6467f964c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1295871547"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:19:26.108872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-95f7be79-98c5-4abe-88e9-419fbc07d38c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:19:26.119898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-95f7be79-98c5-4abe-88e9-419fbc07d38c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for user e1fde410660b47939139960a9420179a and project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:19:26.301886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-95f7be79-98c5-4abe-88e9-419fbc07d38c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:19:26.314610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-95f7be79-98c5-4abe-88e9-419fbc07d38c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for user e1fde410660b47939139960a9420179a and project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:19:26.346175 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-95f7be79-98c5-4abe-88e9-419fbc07d38c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.274141 Feb 19 21:19:26.364392 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2625/5159] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:19:26 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:30.420781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-817845561", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "148acd2f-695f-4c39-8310-f59fe0c7f207"}], "key_name": "tempest-TestNetworkBasicOps-1295871547", "security_groups": [{"name": "tempest-secgroup-smoke-794099602"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:19:30.811644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] validate_networks() for [('148acd2f-695f-4c39-8310-f59fe0c7f207', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:19:32.272452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:19:32.273533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:19:32.274121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:19:32.274656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:19:32.274948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:19:32.291368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:32.291689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:32.297694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:32.297694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:32.316863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:19:32.322604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for user e1fde410660b47939139960a9420179a and project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:19:32.337136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:19:32.340248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:19:32.390823 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5a054d04-cc6a-4936-aa5e-76ce1ee53951 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.980977 Feb 19 21:19:32.397411 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2535/5160] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:19:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:19:32.403129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-10f66420-fb70-44e3-b8ac-cc1e89ac3408 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:32.405002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-10f66420-fb70-44e3-b8ac-cc1e89ac3408 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:32.517038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-10f66420-fb70-44e3-b8ac-cc1e89ac3408 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:32.531882 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-10f66420-fb70-44e3-b8ac-cc1e89ac3408 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1248 microversion: 2.1 time: 0.133507 Feb 19 21:19:32.533324 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2626/5161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:32 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1248 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:33.550003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3bb4c1e4-a31b-4bcc-a7dc-a0e7a413f94d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:33.550664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3bb4c1e4-a31b-4bcc-a7dc-a0e7a413f94d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:33.563646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bb4c1e4-a31b-4bcc-a7dc-a0e7a413f94d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:33.564578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bb4c1e4-a31b-4bcc-a7dc-a0e7a413f94d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:33.565548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bb4c1e4-a31b-4bcc-a7dc-a0e7a413f94d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:33.566419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3bb4c1e4-a31b-4bcc-a7dc-a0e7a413f94d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:33.651165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3bb4c1e4-a31b-4bcc-a7dc-a0e7a413f94d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:33.670661 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3bb4c1e4-a31b-4bcc-a7dc-a0e7a413f94d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1308 microversion: 2.1 time: 0.123352 Feb 19 21:19:33.671597 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2536/5162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:33 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:34.273758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-475203873", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "240980d9-788e-4e35-be1d-0653777578ac", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "aea80e2c-9b0e-4c05-b6af-09dfa51c0b19"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:19:34.409614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] validate_networks() for [('aea80e2c-9b0e-4c05-b6af-09dfa51c0b19', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:19:34.692503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7bec17aa-776f-4e71-a5fb-b3bab4f00e8c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:34.693427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7bec17aa-776f-4e71-a5fb-b3bab4f00e8c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:34.704445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bec17aa-776f-4e71-a5fb-b3bab4f00e8c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:34.705980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bec17aa-776f-4e71-a5fb-b3bab4f00e8c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:34.707010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bec17aa-776f-4e71-a5fb-b3bab4f00e8c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:34.712078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7bec17aa-776f-4e71-a5fb-b3bab4f00e8c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:35.226360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7bec17aa-776f-4e71-a5fb-b3bab4f00e8c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:35.238669 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7bec17aa-776f-4e71-a5fb-b3bab4f00e8c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1373 microversion: 2.1 time: 0.549963 Feb 19 21:19:35.239424 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2537/5163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:34 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1373 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:35.480762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:19:35.481737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:19:35.482433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:19:35.483036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:19:35.483631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:19:35.513025 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:35.515026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:35.531061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:35.532317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:35.551918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:19:35.558094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for user 2af13ad54ab048d495e5ff0c0453abb2 and project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:19:35.571279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:19:35.573506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='240980d9-788e-4e35-be1d-0653777578ac',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:19:35.685987 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a8bc7839-bd9d-4629-9ab3-fab0ce742532 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.415635 Feb 19 21:19:35.692319 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2627/5164] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:19:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:19:35.697016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0e64bb31-578a-4f82-9f91-a2a800aae0cc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:35.697648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0e64bb31-578a-4f82-9f91-a2a800aae0cc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:35.812175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0e64bb31-578a-4f82-9f91-a2a800aae0cc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:35.820449 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0e64bb31-578a-4f82-9f91-a2a800aae0cc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1056 microversion: 2.1 time: 0.127371 Feb 19 21:19:35.821053 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2538/5165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:35 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1056 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:19:36.264923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6b3c608e-defd-493a-877b-263dc13cd00b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:36.265846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6b3c608e-defd-493a-877b-263dc13cd00b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:36.297101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b3c608e-defd-493a-877b-263dc13cd00b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:36.297888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b3c608e-defd-493a-877b-263dc13cd00b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:36.299914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b3c608e-defd-493a-877b-263dc13cd00b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:36.300385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b3c608e-defd-493a-877b-263dc13cd00b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:36.335442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8c2e4c63-4487-4843-842d-b34e82038dfd req-4e991ef9-40e9-4c4c-95c9-d6a5c00522d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95431a52-ee4c-495a-a38d-1bce0f6ba247", "tag": "2bf532ef-8da2-48ca-bf67-64da6eca1b81"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:19:36.339569 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:19:36.339569 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:19:36.363485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8c2e4c63-4487-4843-842d-b34e82038dfd req-4e991ef9-40e9-4c4c-95c9-d6a5c00522d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:36.364866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8c2e4c63-4487-4843-842d-b34e82038dfd req-4e991ef9-40e9-4c4c-95c9-d6a5c00522d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:36.412626 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8c2e4c63-4487-4843-842d-b34e82038dfd req-4e991ef9-40e9-4c4c-95c9-d6a5c00522d9 service nova] Creating event network-changed:2bf532ef-8da2-48ca-bf67-64da6eca1b81 for instance 95431a52-ee4c-495a-a38d-1bce0f6ba247 on nch2-master-1 Feb 19 21:19:36.430639 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8c2e4c63-4487-4843-842d-b34e82038dfd req-4e991ef9-40e9-4c4c-95c9-d6a5c00522d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098148 Feb 19 21:19:36.436962 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2539/5166] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:19:36.839775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb4eb417-7b42-455e-9008-d7c6765c8738 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:36.840610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb4eb417-7b42-455e-9008-d7c6765c8738 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:36.854214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb4eb417-7b42-455e-9008-d7c6765c8738 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:36.857147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb4eb417-7b42-455e-9008-d7c6765c8738 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:36.858106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb4eb417-7b42-455e-9008-d7c6765c8738 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:36.859859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb4eb417-7b42-455e-9008-d7c6765c8738 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:36.999494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cb4eb417-7b42-455e-9008-d7c6765c8738 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:37.010250 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb4eb417-7b42-455e-9008-d7c6765c8738 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1052 microversion: 2.1 time: 0.175572 Feb 19 21:19:37.013982 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2540/5167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:36 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1052 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:37.038228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b3c608e-defd-493a-877b-263dc13cd00b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:37.062143 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6b3c608e-defd-493a-877b-263dc13cd00b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1373 microversion: 2.1 time: 0.809959 Feb 19 21:19:37.062901 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2628/5168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:36 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1373 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:38.028628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aef0f6e3-2436-4faa-b4e5-09dbd05e75de tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:38.029369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aef0f6e3-2436-4faa-b4e5-09dbd05e75de tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:38.049683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aef0f6e3-2436-4faa-b4e5-09dbd05e75de tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:38.051063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aef0f6e3-2436-4faa-b4e5-09dbd05e75de tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:38.053609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aef0f6e3-2436-4faa-b4e5-09dbd05e75de tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:38.068587 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aef0f6e3-2436-4faa-b4e5-09dbd05e75de tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:38.083052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f457f0b2-317c-49a4-83f2-aff6be337968 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:38.083682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f457f0b2-317c-49a4-83f2-aff6be337968 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:38.097040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f457f0b2-317c-49a4-83f2-aff6be337968 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:38.102541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f457f0b2-317c-49a4-83f2-aff6be337968 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:38.106641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f457f0b2-317c-49a4-83f2-aff6be337968 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:38.107535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f457f0b2-317c-49a4-83f2-aff6be337968 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:38.277335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aef0f6e3-2436-4faa-b4e5-09dbd05e75de tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:38.299471 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aef0f6e3-2436-4faa-b4e5-09dbd05e75de tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1126 microversion: 2.1 time: 0.275447 Feb 19 21:19:38.300799 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2541/5169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:38 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1126 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:38.726204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f457f0b2-317c-49a4-83f2-aff6be337968 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:38.747841 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f457f0b2-317c-49a4-83f2-aff6be337968 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1373 microversion: 2.1 time: 0.671555 Feb 19 21:19:38.753121 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2629/5170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:38 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1373 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:39.320296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c5e91e65-0eec-4c69-af13-f318890d4b65 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:39.322325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c5e91e65-0eec-4c69-af13-f318890d4b65 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:39.337574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5e91e65-0eec-4c69-af13-f318890d4b65 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:39.338483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5e91e65-0eec-4c69-af13-f318890d4b65 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:39.341480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5e91e65-0eec-4c69-af13-f318890d4b65 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:39.343007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5e91e65-0eec-4c69-af13-f318890d4b65 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:39.771029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96e76260-0acb-4c54-ac59-97e9f35e699c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:39.771858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-96e76260-0acb-4c54-ac59-97e9f35e699c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:39.785618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96e76260-0acb-4c54-ac59-97e9f35e699c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:39.786082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96e76260-0acb-4c54-ac59-97e9f35e699c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:39.793905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96e76260-0acb-4c54-ac59-97e9f35e699c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:39.794508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96e76260-0acb-4c54-ac59-97e9f35e699c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:40.065649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c5e91e65-0eec-4c69-af13-f318890d4b65 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:40.080745 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c5e91e65-0eec-4c69-af13-f318890d4b65 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1168 microversion: 2.1 time: 0.764200 Feb 19 21:19:40.083507 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2542/5171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:39 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1168 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:40.249001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-96e76260-0acb-4c54-ac59-97e9f35e699c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:40.257967 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96e76260-0acb-4c54-ac59-97e9f35e699c tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1373 microversion: 2.1 time: 0.490520 Feb 19 21:19:40.258630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2630/5172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:39 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1373 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:19:41.100551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d8214981-09cb-44a2-8cf6-54212c74506a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:41.101909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d8214981-09cb-44a2-8cf6-54212c74506a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:41.115322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8214981-09cb-44a2-8cf6-54212c74506a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:41.117281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8214981-09cb-44a2-8cf6-54212c74506a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:41.119003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8214981-09cb-44a2-8cf6-54212c74506a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:41.121153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8214981-09cb-44a2-8cf6-54212c74506a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:41.278473 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bd12f623-e117-4fdc-9956-b19ccdecf4ea tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:41.279894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bd12f623-e117-4fdc-9956-b19ccdecf4ea tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:41.295101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd12f623-e117-4fdc-9956-b19ccdecf4ea tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:41.296195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd12f623-e117-4fdc-9956-b19ccdecf4ea tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:41.298806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd12f623-e117-4fdc-9956-b19ccdecf4ea tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:41.299789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd12f623-e117-4fdc-9956-b19ccdecf4ea tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:41.778925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d8214981-09cb-44a2-8cf6-54212c74506a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:41.796058 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d8214981-09cb-44a2-8cf6-54212c74506a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1168 microversion: 2.1 time: 0.699247 Feb 19 21:19:41.801930 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2543/5173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:41 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1168 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:41.967518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bd12f623-e117-4fdc-9956-b19ccdecf4ea tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:41.980880 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bd12f623-e117-4fdc-9956-b19ccdecf4ea tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1373 microversion: 2.1 time: 0.707588 Feb 19 21:19:41.990593 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2631/5174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:41 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1373 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:19:42.134342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e199983e-590d-46de-b6a8-9f5bab394e42 req-79ffc169-c584-4dfe-be53-657dc84b6f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ed4dfb-3968-4425-b551-09f5497320a0", "tag": "6cd7846a-e096-42e2-9706-7df3720ee24b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:19:42.136840 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:19:42.136840 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:19:42.168383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e199983e-590d-46de-b6a8-9f5bab394e42 req-79ffc169-c584-4dfe-be53-657dc84b6f5e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:42.168883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e199983e-590d-46de-b6a8-9f5bab394e42 req-79ffc169-c584-4dfe-be53-657dc84b6f5e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:42.206928 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e199983e-590d-46de-b6a8-9f5bab394e42 req-79ffc169-c584-4dfe-be53-657dc84b6f5e service nova] Creating event network-changed:6cd7846a-e096-42e2-9706-7df3720ee24b for instance 39ed4dfb-3968-4425-b551-09f5497320a0 on nch1-master-1 Feb 19 21:19:42.214628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e199983e-590d-46de-b6a8-9f5bab394e42 req-79ffc169-c584-4dfe-be53-657dc84b6f5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084256 Feb 19 21:19:42.216027 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2544/5175] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:19:42.815742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8175b69e-fa57-4330-b706-38ede1d03d54 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:42.816388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8175b69e-fa57-4330-b706-38ede1d03d54 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:42.833936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8175b69e-fa57-4330-b706-38ede1d03d54 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:42.834390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8175b69e-fa57-4330-b706-38ede1d03d54 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:42.835411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8175b69e-fa57-4330-b706-38ede1d03d54 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:42.836020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8175b69e-fa57-4330-b706-38ede1d03d54 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:42.999210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-26c92280-9b47-40dd-b86c-2cc1592df40f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:43.004041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-26c92280-9b47-40dd-b86c-2cc1592df40f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:43.010264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26c92280-9b47-40dd-b86c-2cc1592df40f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:43.010264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26c92280-9b47-40dd-b86c-2cc1592df40f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:43.010264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26c92280-9b47-40dd-b86c-2cc1592df40f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:43.010264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26c92280-9b47-40dd-b86c-2cc1592df40f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:43.517887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8175b69e-fa57-4330-b706-38ede1d03d54 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:43.534460 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8175b69e-fa57-4330-b706-38ede1d03d54 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1168 microversion: 2.1 time: 0.724981 Feb 19 21:19:43.537756 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2632/5176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:42 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1168 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:43.570689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-26c92280-9b47-40dd-b86c-2cc1592df40f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:43.585305 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-26c92280-9b47-40dd-b86c-2cc1592df40f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1373 microversion: 2.1 time: 0.590483 Feb 19 21:19:43.585918 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2545/5177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:42 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1373 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:44.554635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-84e7afa3-0fb2-4848-8c42-95bbc7edfbfd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:44.555525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-84e7afa3-0fb2-4848-8c42-95bbc7edfbfd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:44.572604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84e7afa3-0fb2-4848-8c42-95bbc7edfbfd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:44.572604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84e7afa3-0fb2-4848-8c42-95bbc7edfbfd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:44.572604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84e7afa3-0fb2-4848-8c42-95bbc7edfbfd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:44.572604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-84e7afa3-0fb2-4848-8c42-95bbc7edfbfd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:44.603973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-83d99faf-991f-4f83-96b7-b7338d283891 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:44.605096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-83d99faf-991f-4f83-96b7-b7338d283891 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:44.620630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83d99faf-991f-4f83-96b7-b7338d283891 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:44.621154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83d99faf-991f-4f83-96b7-b7338d283891 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:44.623910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83d99faf-991f-4f83-96b7-b7338d283891 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:44.624431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-83d99faf-991f-4f83-96b7-b7338d283891 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:45.106476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-84e7afa3-0fb2-4848-8c42-95bbc7edfbfd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:45.119383 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-84e7afa3-0fb2-4848-8c42-95bbc7edfbfd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1202 microversion: 2.1 time: 0.569371 Feb 19 21:19:45.120441 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2633/5178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:44 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1202 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:45.142996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-21c97983-a89a-433c-9fb1-215a43229ff8 req-3cee9ad4-82af-48aa-b659-caa5f2558dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95431a52-ee4c-495a-a38d-1bce0f6ba247", "name": "network-vif-plugged", "status": "completed", "tag": "2bf532ef-8da2-48ca-bf67-64da6eca1b81"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:19:45.147561 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:19:45.147561 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:19:45.159390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-21c97983-a89a-433c-9fb1-215a43229ff8 req-3cee9ad4-82af-48aa-b659-caa5f2558dea service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:45.160137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-21c97983-a89a-433c-9fb1-215a43229ff8 req-3cee9ad4-82af-48aa-b659-caa5f2558dea service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:45.176990 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-21c97983-a89a-433c-9fb1-215a43229ff8 req-3cee9ad4-82af-48aa-b659-caa5f2558dea service nova] Creating event network-vif-plugged:2bf532ef-8da2-48ca-bf67-64da6eca1b81 for instance 95431a52-ee4c-495a-a38d-1bce0f6ba247 on nch2-master-1 Feb 19 21:19:45.184717 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-21c97983-a89a-433c-9fb1-215a43229ff8 req-3cee9ad4-82af-48aa-b659-caa5f2558dea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061875 Feb 19 21:19:45.185963 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2634/5179] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:19:45.238403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-83d99faf-991f-4f83-96b7-b7338d283891 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:45.248579 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-83d99faf-991f-4f83-96b7-b7338d283891 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1373 microversion: 2.1 time: 0.648745 Feb 19 21:19:45.249715 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2546/5180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:44 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1373 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:46.140167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d9f2bc8-7695-4d9e-82a7-36b86110b1d7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:46.140811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2d9f2bc8-7695-4d9e-82a7-36b86110b1d7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:46.150546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d9f2bc8-7695-4d9e-82a7-36b86110b1d7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:46.151526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d9f2bc8-7695-4d9e-82a7-36b86110b1d7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:46.153263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d9f2bc8-7695-4d9e-82a7-36b86110b1d7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:46.154509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d9f2bc8-7695-4d9e-82a7-36b86110b1d7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:46.277526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a3cbc56b-e25b-4fc4-876b-27dcb7f3ae33 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:46.278421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a3cbc56b-e25b-4fc4-876b-27dcb7f3ae33 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:46.285634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3cbc56b-e25b-4fc4-876b-27dcb7f3ae33 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:46.286360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3cbc56b-e25b-4fc4-876b-27dcb7f3ae33 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:46.287348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3cbc56b-e25b-4fc4-876b-27dcb7f3ae33 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:46.287993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3cbc56b-e25b-4fc4-876b-27dcb7f3ae33 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:46.469143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2d9f2bc8-7695-4d9e-82a7-36b86110b1d7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:46.483640 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d9f2bc8-7695-4d9e-82a7-36b86110b1d7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1202 microversion: 2.1 time: 0.347619 Feb 19 21:19:46.484495 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2635/5181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:46 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1202 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:46.586044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a3cbc56b-e25b-4fc4-876b-27dcb7f3ae33 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:46.596381 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a3cbc56b-e25b-4fc4-876b-27dcb7f3ae33 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1373 microversion: 2.1 time: 0.321875 Feb 19 21:19:46.605718 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2547/5182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:46 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1373 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:47.501851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-16ed7fd0-a8d5-4146-96e6-9ac76ed875c8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:47.502469 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-16ed7fd0-a8d5-4146-96e6-9ac76ed875c8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:47.510226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16ed7fd0-a8d5-4146-96e6-9ac76ed875c8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:47.512735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16ed7fd0-a8d5-4146-96e6-9ac76ed875c8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:47.519187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16ed7fd0-a8d5-4146-96e6-9ac76ed875c8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:47.519654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16ed7fd0-a8d5-4146-96e6-9ac76ed875c8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:47.613494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-46c3b179-4867-46e9-aba0-b8111838f248 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:47.614896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-46c3b179-4867-46e9-aba0-b8111838f248 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:47.625403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-46c3b179-4867-46e9-aba0-b8111838f248 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:47.627161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-46c3b179-4867-46e9-aba0-b8111838f248 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:47.628608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-46c3b179-4867-46e9-aba0-b8111838f248 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:47.629365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-46c3b179-4867-46e9-aba0-b8111838f248 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:47.844948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-16ed7fd0-a8d5-4146-96e6-9ac76ed875c8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:47.859131 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-16ed7fd0-a8d5-4146-96e6-9ac76ed875c8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1202 microversion: 2.1 time: 0.361164 Feb 19 21:19:47.869806 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2636/5183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:47 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1202 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:47.935479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-46c3b179-4867-46e9-aba0-b8111838f248 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:47.946682 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-46c3b179-4867-46e9-aba0-b8111838f248 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1545 microversion: 2.1 time: 0.336991 Feb 19 21:19:47.947301 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2548/5184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:47 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1545 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:19:47.964939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1670fd71-0be4-46ba-84a7-c452d4ac9e43 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:47.965562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1670fd71-0be4-46ba-84a7-c452d4ac9e43 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:47.972458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1670fd71-0be4-46ba-84a7-c452d4ac9e43 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:47.972911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1670fd71-0be4-46ba-84a7-c452d4ac9e43 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:47.973936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1670fd71-0be4-46ba-84a7-c452d4ac9e43 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:47.974564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1670fd71-0be4-46ba-84a7-c452d4ac9e43 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:48.226631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1670fd71-0be4-46ba-84a7-c452d4ac9e43 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:48.235715 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1670fd71-0be4-46ba-84a7-c452d4ac9e43 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1545 microversion: 2.1 time: 0.275239 Feb 19 21:19:48.258896 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2637/5185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:47 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1545 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:48.876637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b24c0042-a1a6-4e9b-9ff1-6505969a06cd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:48.877255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b24c0042-a1a6-4e9b-9ff1-6505969a06cd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:48.891814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b24c0042-a1a6-4e9b-9ff1-6505969a06cd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:48.893842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b24c0042-a1a6-4e9b-9ff1-6505969a06cd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:48.895153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b24c0042-a1a6-4e9b-9ff1-6505969a06cd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:48.896931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b24c0042-a1a6-4e9b-9ff1-6505969a06cd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:49.138639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b24c0042-a1a6-4e9b-9ff1-6505969a06cd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:49.159131 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b24c0042-a1a6-4e9b-9ff1-6505969a06cd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1202 microversion: 2.1 time: 0.286311 Feb 19 21:19:49.159961 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2549/5186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:48 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1202 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:50.176763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f394d46-6bc1-470e-bca1-4d234ab32ffb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:50.177228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9f394d46-6bc1-470e-bca1-4d234ab32ffb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:50.184707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f394d46-6bc1-470e-bca1-4d234ab32ffb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:50.185542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f394d46-6bc1-470e-bca1-4d234ab32ffb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:50.186551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f394d46-6bc1-470e-bca1-4d234ab32ffb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:50.187173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f394d46-6bc1-470e-bca1-4d234ab32ffb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:50.439136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9f394d46-6bc1-470e-bca1-4d234ab32ffb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:50.448663 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f394d46-6bc1-470e-bca1-4d234ab32ffb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1202 microversion: 2.1 time: 0.275287 Feb 19 21:19:50.458576 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2638/5187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:50 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1202 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:50.480743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4a31c8e1-7913-48b4-998f-3c6d44194beb req-49dad035-eef2-4c9a-936a-a531be88a804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ed4dfb-3968-4425-b551-09f5497320a0", "name": "network-vif-plugged", "status": "completed", "tag": "6cd7846a-e096-42e2-9706-7df3720ee24b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:19:50.483227 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:19:50.483227 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:19:50.493791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4a31c8e1-7913-48b4-998f-3c6d44194beb req-49dad035-eef2-4c9a-936a-a531be88a804 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:50.495515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4a31c8e1-7913-48b4-998f-3c6d44194beb req-49dad035-eef2-4c9a-936a-a531be88a804 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:50.521227 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4a31c8e1-7913-48b4-998f-3c6d44194beb req-49dad035-eef2-4c9a-936a-a531be88a804 service nova] Creating event network-vif-plugged:6cd7846a-e096-42e2-9706-7df3720ee24b for instance 39ed4dfb-3968-4425-b551-09f5497320a0 on nch1-master-1 Feb 19 21:19:50.531142 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4a31c8e1-7913-48b4-998f-3c6d44194beb req-49dad035-eef2-4c9a-936a-a531be88a804 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058464 Feb 19 21:19:50.531965 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2550/5188] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:19:51.466753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a603af6b-cc1d-4999-a17b-67d40250b8dd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:51.467627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a603af6b-cc1d-4999-a17b-67d40250b8dd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:51.488962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a603af6b-cc1d-4999-a17b-67d40250b8dd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:51.489522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a603af6b-cc1d-4999-a17b-67d40250b8dd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:51.490370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a603af6b-cc1d-4999-a17b-67d40250b8dd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:51.493810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a603af6b-cc1d-4999-a17b-67d40250b8dd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:51.906322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a603af6b-cc1d-4999-a17b-67d40250b8dd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:51.916354 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a603af6b-cc1d-4999-a17b-67d40250b8dd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1202 microversion: 2.1 time: 0.453859 Feb 19 21:19:51.931350 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2639/5189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:51 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1202 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:52.939300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a1376236-d1e3-4d10-b4e7-79043c488253 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:52.940194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a1376236-d1e3-4d10-b4e7-79043c488253 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:52.948816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1376236-d1e3-4d10-b4e7-79043c488253 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:52.951032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1376236-d1e3-4d10-b4e7-79043c488253 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:52.955564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1376236-d1e3-4d10-b4e7-79043c488253 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:52.965634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a1376236-d1e3-4d10-b4e7-79043c488253 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:53.506508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a1376236-d1e3-4d10-b4e7-79043c488253 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:53.520103 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a1376236-d1e3-4d10-b4e7-79043c488253 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1390 microversion: 2.1 time: 0.585311 Feb 19 21:19:53.521121 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2551/5190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:52 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1390 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:53.548486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3df68275-c167-48d6-815c-b9d4abe2a79e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:53.549224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3df68275-c167-48d6-815c-b9d4abe2a79e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:53.563217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3df68275-c167-48d6-815c-b9d4abe2a79e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:53.564658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3df68275-c167-48d6-815c-b9d4abe2a79e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:53.567105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3df68275-c167-48d6-815c-b9d4abe2a79e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:53.567744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3df68275-c167-48d6-815c-b9d4abe2a79e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:53.987383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3df68275-c167-48d6-815c-b9d4abe2a79e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:54.013349 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3df68275-c167-48d6-815c-b9d4abe2a79e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1390 microversion: 2.1 time: 0.469480 Feb 19 21:19:54.025559 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2640/5191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:53 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1390 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:54.035696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e7efa5d4-7f28-4a63-87ad-b3cd428a7309 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:54.037008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e7efa5d4-7f28-4a63-87ad-b3cd428a7309 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:54.081629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7efa5d4-7f28-4a63-87ad-b3cd428a7309 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:54.082943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7efa5d4-7f28-4a63-87ad-b3cd428a7309 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:54.086146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7efa5d4-7f28-4a63-87ad-b3cd428a7309 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:54.088453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7efa5d4-7f28-4a63-87ad-b3cd428a7309 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:54.485393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e7efa5d4-7f28-4a63-87ad-b3cd428a7309 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:54.500272 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e7efa5d4-7f28-4a63-87ad-b3cd428a7309 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1390 microversion: 2.1 time: 0.472922 Feb 19 21:19:54.501212 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2552/5192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:54 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1390 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:54.609527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b245d362-9474-4740-973e-805390c134a0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:54.609527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b245d362-9474-4740-973e-805390c134a0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:54.616500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b245d362-9474-4740-973e-805390c134a0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:54.617363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b245d362-9474-4740-973e-805390c134a0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:54.618442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b245d362-9474-4740-973e-805390c134a0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:54.619102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b245d362-9474-4740-973e-805390c134a0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:54.670866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b245d362-9474-4740-973e-805390c134a0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:19:54.853158 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b245d362-9474-4740-973e-805390c134a0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 204 len: 0 microversion: 2.1 time: 0.251429 Feb 19 21:19:54.854838 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2641/5193] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:19:54 2022] DELETE /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:19:54.864305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ab1d25a-fba3-47ee-bad2-07160c872b90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:54.866223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ab1d25a-fba3-47ee-bad2-07160c872b90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:54.885175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ab1d25a-fba3-47ee-bad2-07160c872b90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:54.886000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ab1d25a-fba3-47ee-bad2-07160c872b90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:54.887150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ab1d25a-fba3-47ee-bad2-07160c872b90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:54.889352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ab1d25a-fba3-47ee-bad2-07160c872b90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:55.184821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ab1d25a-fba3-47ee-bad2-07160c872b90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:55.203851 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ab1d25a-fba3-47ee-bad2-07160c872b90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1396 microversion: 2.1 time: 0.341394 Feb 19 21:19:55.214110 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2553/5194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:54 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1396 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:56.225633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7bf91ea1-88dc-4c0f-ac20-d4f18130987a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:56.229037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7bf91ea1-88dc-4c0f-ac20-d4f18130987a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:56.246532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bf91ea1-88dc-4c0f-ac20-d4f18130987a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:56.248733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bf91ea1-88dc-4c0f-ac20-d4f18130987a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:56.250858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bf91ea1-88dc-4c0f-ac20-d4f18130987a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:56.252583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bf91ea1-88dc-4c0f-ac20-d4f18130987a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:56.774158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7bf91ea1-88dc-4c0f-ac20-d4f18130987a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:56.785918 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7bf91ea1-88dc-4c0f-ac20-d4f18130987a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1396 microversion: 2.1 time: 0.567124 Feb 19 21:19:56.786840 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2642/5195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:56 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1396 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:57.521657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-06d269d3-a255-49f6-b449-88e118c98660 req-6bf1a0d7-2d33-438d-a368-879ec1a1e4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ed4dfb-3968-4425-b551-09f5497320a0", "name": "network-vif-deleted", "tag": "6cd7846a-e096-42e2-9706-7df3720ee24b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:19:57.524198 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:19:57.524198 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:19:57.562045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-06d269d3-a255-49f6-b449-88e118c98660 req-6bf1a0d7-2d33-438d-a368-879ec1a1e4e8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:57.569838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-06d269d3-a255-49f6-b449-88e118c98660 req-6bf1a0d7-2d33-438d-a368-879ec1a1e4e8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:57.615272 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-06d269d3-a255-49f6-b449-88e118c98660 req-6bf1a0d7-2d33-438d-a368-879ec1a1e4e8 service nova] Creating event network-vif-deleted:6cd7846a-e096-42e2-9706-7df3720ee24b for instance 39ed4dfb-3968-4425-b551-09f5497320a0 on nch1-master-1 Feb 19 21:19:57.625233 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-06d269d3-a255-49f6-b449-88e118c98660 req-6bf1a0d7-2d33-438d-a368-879ec1a1e4e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108509 Feb 19 21:19:57.628875 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2554/5196] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:19:57.806178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-453f4783-321a-4bfb-a9f1-9b9403dbf494 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:57.806977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-453f4783-321a-4bfb-a9f1-9b9403dbf494 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:57.819428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-453f4783-321a-4bfb-a9f1-9b9403dbf494 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:57.819986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-453f4783-321a-4bfb-a9f1-9b9403dbf494 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:57.822224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-453f4783-321a-4bfb-a9f1-9b9403dbf494 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:57.822668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-453f4783-321a-4bfb-a9f1-9b9403dbf494 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:57.923178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-453f4783-321a-4bfb-a9f1-9b9403dbf494 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:19:57.951590 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-453f4783-321a-4bfb-a9f1-9b9403dbf494 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 200 len: 1187 microversion: 2.1 time: 0.149081 Feb 19 21:19:57.960761 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2643/5197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:57 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 1187 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:19:58.970515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-33b67721-8136-4c37-9f23-77c8bf630080 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:19:58.971266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-33b67721-8136-4c37-9f23-77c8bf630080 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:19:58.982941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33b67721-8136-4c37-9f23-77c8bf630080 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:58.983388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33b67721-8136-4c37-9f23-77c8bf630080 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:58.984213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33b67721-8136-4c37-9f23-77c8bf630080 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:19:58.987200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33b67721-8136-4c37-9f23-77c8bf630080 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:19:59.002811 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-33b67721-8136-4c37-9f23-77c8bf630080 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 39ed4dfb-3968-4425-b551-09f5497320a0 could not be found. Feb 19 21:19:59.003355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-33b67721-8136-4c37-9f23-77c8bf630080 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 39ed4dfb-3968-4425-b551-09f5497320a0 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:19:59.004267 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-33b67721-8136-4c37-9f23-77c8bf630080 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 404 len: 111 microversion: 2.1 time: 0.038682 Feb 19 21:19:59.005351 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2555/5198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:19:58 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:20:00.094787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7a1676b-8ed9-4b59-a00f-636bbd9ea314 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:00.095318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d7a1676b-8ed9-4b59-a00f-636bbd9ea314 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:00.110605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7a1676b-8ed9-4b59-a00f-636bbd9ea314 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:00.111244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7a1676b-8ed9-4b59-a00f-636bbd9ea314 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:00.112305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7a1676b-8ed9-4b59-a00f-636bbd9ea314 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:00.112878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7a1676b-8ed9-4b59-a00f-636bbd9ea314 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:00.136748 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-d7a1676b-8ed9-4b59-a00f-636bbd9ea314 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 39ed4dfb-3968-4425-b551-09f5497320a0 could not be found. Feb 19 21:20:00.137774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7a1676b-8ed9-4b59-a00f-636bbd9ea314 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 39ed4dfb-3968-4425-b551-09f5497320a0 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:20:00.139268 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d7a1676b-8ed9-4b59-a00f-636bbd9ea314 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 404 len: 111 microversion: 2.1 time: 0.048840 Feb 19 21:20:00.139870 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2644/5199] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:20:00 2022] DELETE /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:00.147878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6da4a15b-ba7d-49d1-ab3b-23e3da2a1969 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:00.148546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6da4a15b-ba7d-49d1-ab3b-23e3da2a1969 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 39ed4dfb-3968-4425-b551-09f5497320a0] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:00.156150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6da4a15b-ba7d-49d1-ab3b-23e3da2a1969 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:00.156657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6da4a15b-ba7d-49d1-ab3b-23e3da2a1969 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:00.157460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6da4a15b-ba7d-49d1-ab3b-23e3da2a1969 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:00.157905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6da4a15b-ba7d-49d1-ab3b-23e3da2a1969 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:00.172158 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-6da4a15b-ba7d-49d1-ab3b-23e3da2a1969 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 39ed4dfb-3968-4425-b551-09f5497320a0 could not be found. Feb 19 21:20:00.172727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6da4a15b-ba7d-49d1-ab3b-23e3da2a1969 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 39ed4dfb-3968-4425-b551-09f5497320a0 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:20:00.173741 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6da4a15b-ba7d-49d1-ab3b-23e3da2a1969 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0" status: 404 len: 111 microversion: 2.1 time: 0.029585 Feb 19 21:20:00.174311 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2556/5200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:00 2022] GET /compute/v2.1/servers/39ed4dfb-3968-4425-b551-09f5497320a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:07.698557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1993585399", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:07.764738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] validate_networks() for None {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:20:08.262821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:20:08.263247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:20:08.264088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:20:08.265012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:20:08.265667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:20:08.281188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:08.281845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:08.282968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:08.283586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:08.316977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Getting quotas for project f101b14d492c4f419d522cfbd3a863e4. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:20:08.325015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Getting quotas for user 12833678dba14769b444cbff3ccdb9a0 and project f101b14d492c4f419d522cfbd3a863e4. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:20:08.359820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:20:08.367525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:20:08.429264 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cc10536c-9f84-4626-bf14-cc63b35a3ea3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735028 Feb 19 21:20:08.430797 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2645/5201] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:20:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:20:08.442800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-85d5aaa8-ace7-4c2f-a4a7-916895f57503 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:08.443465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-85d5aaa8-ace7-4c2f-a4a7-916895f57503 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:08.580645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-85d5aaa8-ace7-4c2f-a4a7-916895f57503 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:08.610978 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-85d5aaa8-ace7-4c2f-a4a7-916895f57503 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1215 microversion: 2.1 time: 0.158459 Feb 19 21:20:08.611980 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2557/5202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:08 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:09.631878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-031ce0fd-5776-41ab-9512-4be847d885de tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:09.632606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-031ce0fd-5776-41ab-9512-4be847d885de tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:09.643870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-031ce0fd-5776-41ab-9512-4be847d885de tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:09.644365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-031ce0fd-5776-41ab-9512-4be847d885de tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:09.645198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-031ce0fd-5776-41ab-9512-4be847d885de tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:09.650036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-031ce0fd-5776-41ab-9512-4be847d885de tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:09.760100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-031ce0fd-5776-41ab-9512-4be847d885de tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:09.790495 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-031ce0fd-5776-41ab-9512-4be847d885de tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1267 microversion: 2.1 time: 0.163193 Feb 19 21:20:09.791894 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2646/5203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:09 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:10.811396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0f6940b7-d221-4e3d-9975-af29d84db228 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:10.812042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0f6940b7-d221-4e3d-9975-af29d84db228 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:10.834539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f6940b7-d221-4e3d-9975-af29d84db228 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:10.836789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f6940b7-d221-4e3d-9975-af29d84db228 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:10.844606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f6940b7-d221-4e3d-9975-af29d84db228 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:10.846650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f6940b7-d221-4e3d-9975-af29d84db228 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:11.048388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0f6940b7-d221-4e3d-9975-af29d84db228 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:11.056375 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0f6940b7-d221-4e3d-9975-af29d84db228 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1273 microversion: 2.1 time: 0.250937 Feb 19 21:20:11.057520 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2558/5204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:10 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:12.079297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-29b1ecd4-922b-4a45-a8c8-28f40c0066d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:12.080122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-29b1ecd4-922b-4a45-a8c8-28f40c0066d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:12.115512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29b1ecd4-922b-4a45-a8c8-28f40c0066d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:12.116553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29b1ecd4-922b-4a45-a8c8-28f40c0066d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:12.118679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29b1ecd4-922b-4a45-a8c8-28f40c0066d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:12.119208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29b1ecd4-922b-4a45-a8c8-28f40c0066d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:12.234017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-31d06e19-367b-4c67-9aa8-75f1f33ec9f0 req-5cbe0743-1fd0-47fc-98e4-4a64e7dab450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e293ab4-3ad5-425e-b83d-9cb264c70ddf", "tag": "90fdab25-1b89-4d5c-ba82-9f1c831e690b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:12.236639 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:12.236639 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:20:12.253917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-31d06e19-367b-4c67-9aa8-75f1f33ec9f0 req-5cbe0743-1fd0-47fc-98e4-4a64e7dab450 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:12.255251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-31d06e19-367b-4c67-9aa8-75f1f33ec9f0 req-5cbe0743-1fd0-47fc-98e4-4a64e7dab450 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:12.285980 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-31d06e19-367b-4c67-9aa8-75f1f33ec9f0 req-5cbe0743-1fd0-47fc-98e4-4a64e7dab450 service nova] Creating event network-changed:90fdab25-1b89-4d5c-ba82-9f1c831e690b for instance 5e293ab4-3ad5-425e-b83d-9cb264c70ddf on nch1-master-1 Feb 19 21:20:12.294516 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-31d06e19-367b-4c67-9aa8-75f1f33ec9f0 req-5cbe0743-1fd0-47fc-98e4-4a64e7dab450 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067791 Feb 19 21:20:12.295777 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2559/5205] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:20:12.301606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1538914987", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "810eb069-3450-4d86-bd8b-728ffd2bc8f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "aea80e2c-9b0e-4c05-b6af-09dfa51c0b19"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:12.399088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] validate_networks() for [('aea80e2c-9b0e-4c05-b6af-09dfa51c0b19', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:20:12.631620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29b1ecd4-922b-4a45-a8c8-28f40c0066d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:12.640481 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-29b1ecd4-922b-4a45-a8c8-28f40c0066d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1315 microversion: 2.1 time: 0.566390 Feb 19 21:20:12.641461 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2647/5206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:12 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:13.552552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:20:13.553065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:20:13.555760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:20:13.557609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:20:13.559819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:20:13.580949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:13.581737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:13.582812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:13.583456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:13.609300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:20:13.615937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for user 2af13ad54ab048d495e5ff0c0453abb2 and project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:20:13.657888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e83cf2e4-278b-4a29-9b13-abef8fc9564c tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:13.659062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e83cf2e4-278b-4a29-9b13-abef8fc9564c tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:13.666441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e83cf2e4-278b-4a29-9b13-abef8fc9564c tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:13.666896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e83cf2e4-278b-4a29-9b13-abef8fc9564c tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:13.671645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e83cf2e4-278b-4a29-9b13-abef8fc9564c tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:13.672430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e83cf2e4-278b-4a29-9b13-abef8fc9564c tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:13.689300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:20:13.692879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='810eb069-3450-4d86-bd8b-728ffd2bc8f6',volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:20:13.871664 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5efc329b-b80a-4d50-b8bf-d54e30280c82 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574364 Feb 19 21:20:13.878411 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2560/5207] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:20:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:20:13.884541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9015dfb2-911c-42c6-bfc0-e7b518cc1e53 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:13.886172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9015dfb2-911c-42c6-bfc0-e7b518cc1e53 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:14.000867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9015dfb2-911c-42c6-bfc0-e7b518cc1e53 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:14.008897 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9015dfb2-911c-42c6-bfc0-e7b518cc1e53 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1071 microversion: 2.1 time: 0.128887 Feb 19 21:20:14.009618 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2561/5208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:13 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1071 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:14.117386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e83cf2e4-278b-4a29-9b13-abef8fc9564c tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:14.127683 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e83cf2e4-278b-4a29-9b13-abef8fc9564c tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1315 microversion: 2.1 time: 0.473338 Feb 19 21:20:14.138416 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2648/5209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:13 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:15.026910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0154bb6b-750c-4456-b700-cdbcbbeef77a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:15.027434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0154bb6b-750c-4456-b700-cdbcbbeef77a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:15.050916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0154bb6b-750c-4456-b700-cdbcbbeef77a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:15.051702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0154bb6b-750c-4456-b700-cdbcbbeef77a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:15.052745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0154bb6b-750c-4456-b700-cdbcbbeef77a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:15.053374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0154bb6b-750c-4456-b700-cdbcbbeef77a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:15.146820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-49e6ecc1-e42a-4e5b-8469-84ab6f01d7d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:15.147585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-49e6ecc1-e42a-4e5b-8469-84ab6f01d7d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:15.163626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49e6ecc1-e42a-4e5b-8469-84ab6f01d7d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:15.164077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49e6ecc1-e42a-4e5b-8469-84ab6f01d7d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:15.165057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49e6ecc1-e42a-4e5b-8469-84ab6f01d7d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:15.165889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49e6ecc1-e42a-4e5b-8469-84ab6f01d7d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:15.207813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0154bb6b-750c-4456-b700-cdbcbbeef77a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:15.218565 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0154bb6b-750c-4456-b700-cdbcbbeef77a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1177 microversion: 2.1 time: 0.195526 Feb 19 21:20:15.219295 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2562/5210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:15 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1177 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:15.442736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-49e6ecc1-e42a-4e5b-8469-84ab6f01d7d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:15.465522 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-49e6ecc1-e42a-4e5b-8469-84ab6f01d7d1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1315 microversion: 2.1 time: 0.322217 Feb 19 21:20:15.466251 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2649/5211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:15 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:16.241526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0ddd4b07-07d7-4086-8099-f1434db29760 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:16.243819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0ddd4b07-07d7-4086-8099-f1434db29760 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:16.273370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ddd4b07-07d7-4086-8099-f1434db29760 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:16.274316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ddd4b07-07d7-4086-8099-f1434db29760 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:16.275412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ddd4b07-07d7-4086-8099-f1434db29760 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:16.276488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ddd4b07-07d7-4086-8099-f1434db29760 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:16.496182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ac741e9b-f523-4fd0-9837-e16c4f1f7444 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:16.498356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ac741e9b-f523-4fd0-9837-e16c4f1f7444 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:16.506741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac741e9b-f523-4fd0-9837-e16c4f1f7444 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:16.507506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac741e9b-f523-4fd0-9837-e16c4f1f7444 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:16.511665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac741e9b-f523-4fd0-9837-e16c4f1f7444 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:16.512465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac741e9b-f523-4fd0-9837-e16c4f1f7444 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:16.886215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0ddd4b07-07d7-4086-8099-f1434db29760 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:16.907316 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0ddd4b07-07d7-4086-8099-f1434db29760 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1229 microversion: 2.1 time: 0.673158 Feb 19 21:20:16.911374 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2563/5212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:16 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1229 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:17.049651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ac741e9b-f523-4fd0-9837-e16c4f1f7444 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:17.060780 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ac741e9b-f523-4fd0-9837-e16c4f1f7444 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1315 microversion: 2.1 time: 0.574287 Feb 19 21:20:17.062452 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2650/5213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:16 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:17.926838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa64c3b3-7caf-4b9e-a6ec-f72082567859 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:17.927615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aa64c3b3-7caf-4b9e-a6ec-f72082567859 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:17.935957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa64c3b3-7caf-4b9e-a6ec-f72082567859 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:17.936573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa64c3b3-7caf-4b9e-a6ec-f72082567859 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:17.937482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa64c3b3-7caf-4b9e-a6ec-f72082567859 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:17.938062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa64c3b3-7caf-4b9e-a6ec-f72082567859 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:18.079688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a7d707d0-2c1d-4e47-9a29-b0ce5253f6f3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:18.080294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a7d707d0-2c1d-4e47-9a29-b0ce5253f6f3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:18.088013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7d707d0-2c1d-4e47-9a29-b0ce5253f6f3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:18.088690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7d707d0-2c1d-4e47-9a29-b0ce5253f6f3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:18.089641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7d707d0-2c1d-4e47-9a29-b0ce5253f6f3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:18.090360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7d707d0-2c1d-4e47-9a29-b0ce5253f6f3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:18.638371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa64c3b3-7caf-4b9e-a6ec-f72082567859 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:18.646567 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa64c3b3-7caf-4b9e-a6ec-f72082567859 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1217 microversion: 2.1 time: 0.724958 Feb 19 21:20:18.647411 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2564/5214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:17 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1217 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:18.653055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f69629a1-93ab-40b0-9578-4facc23ef54d req-f842f818-2525-4511-b7a9-5d7eaaaa7aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e04ff43-f955-4862-8ef9-abc8fd3d42f1", "tag": "ba67d66f-db64-4254-bc12-c3652b12e977"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:18.655126 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:18.655126 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:20:18.663698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f69629a1-93ab-40b0-9578-4facc23ef54d req-f842f818-2525-4511-b7a9-5d7eaaaa7aa6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:18.664964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f69629a1-93ab-40b0-9578-4facc23ef54d req-f842f818-2525-4511-b7a9-5d7eaaaa7aa6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:18.676804 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f69629a1-93ab-40b0-9578-4facc23ef54d req-f842f818-2525-4511-b7a9-5d7eaaaa7aa6 service nova] Creating event network-changed:ba67d66f-db64-4254-bc12-c3652b12e977 for instance 6e04ff43-f955-4862-8ef9-abc8fd3d42f1 on nch2-master-1 Feb 19 21:20:18.682594 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f69629a1-93ab-40b0-9578-4facc23ef54d req-f842f818-2525-4511-b7a9-5d7eaaaa7aa6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033648 Feb 19 21:20:18.683926 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2565/5215] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:20:18.691041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e96a9fb4-6a78-49bb-b86d-ccaa4e522a95 req-f5abcdb6-d900-4739-9a02-b7846d0c1b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e293ab4-3ad5-425e-b83d-9cb264c70ddf", "name": "network-vif-plugged", "status": "completed", "tag": "90fdab25-1b89-4d5c-ba82-9f1c831e690b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:18.693060 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:18.693060 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:20:18.703005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e96a9fb4-6a78-49bb-b86d-ccaa4e522a95 req-f5abcdb6-d900-4739-9a02-b7846d0c1b82 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:18.703693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e96a9fb4-6a78-49bb-b86d-ccaa4e522a95 req-f5abcdb6-d900-4739-9a02-b7846d0c1b82 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:18.718979 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e96a9fb4-6a78-49bb-b86d-ccaa4e522a95 req-f5abcdb6-d900-4739-9a02-b7846d0c1b82 service nova] Creating event network-vif-plugged:90fdab25-1b89-4d5c-ba82-9f1c831e690b for instance 5e293ab4-3ad5-425e-b83d-9cb264c70ddf on nch1-master-1 Feb 19 21:20:18.724303 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e96a9fb4-6a78-49bb-b86d-ccaa4e522a95 req-f5abcdb6-d900-4739-9a02-b7846d0c1b82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038826 Feb 19 21:20:18.725008 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2566/5216] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:20:18.792308 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a7d707d0-2c1d-4e47-9a29-b0ce5253f6f3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:18.803435 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a7d707d0-2c1d-4e47-9a29-b0ce5253f6f3 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1315 microversion: 2.1 time: 0.727847 Feb 19 21:20:18.804135 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2651/5217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:18 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:19.667310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4317b9f7-6d56-4165-b5a3-9d28dfed7b92 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:19.668395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4317b9f7-6d56-4165-b5a3-9d28dfed7b92 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:19.675659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4317b9f7-6d56-4165-b5a3-9d28dfed7b92 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:19.676189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4317b9f7-6d56-4165-b5a3-9d28dfed7b92 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:19.677150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4317b9f7-6d56-4165-b5a3-9d28dfed7b92 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:19.677746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4317b9f7-6d56-4165-b5a3-9d28dfed7b92 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:19.821342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-af57a488-62f9-43d9-bbf4-612c2ffd2b33 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:19.821959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-af57a488-62f9-43d9-bbf4-612c2ffd2b33 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:19.831180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af57a488-62f9-43d9-bbf4-612c2ffd2b33 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:19.831640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af57a488-62f9-43d9-bbf4-612c2ffd2b33 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:19.832472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af57a488-62f9-43d9-bbf4-612c2ffd2b33 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:19.833079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af57a488-62f9-43d9-bbf4-612c2ffd2b33 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:20.180524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4317b9f7-6d56-4165-b5a3-9d28dfed7b92 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:20.200179 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4317b9f7-6d56-4165-b5a3-9d28dfed7b92 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1217 microversion: 2.1 time: 0.538350 Feb 19 21:20:20.209901 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2567/5218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:19 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1217 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:20.306051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-af57a488-62f9-43d9-bbf4-612c2ffd2b33 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:20.316062 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-af57a488-62f9-43d9-bbf4-612c2ffd2b33 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1315 microversion: 2.1 time: 0.499238 Feb 19 21:20:20.325862 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2652/5219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:19 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:21.218746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d8774977-e9c8-4c63-89a6-dd973a447ddc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:21.219138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d8774977-e9c8-4c63-89a6-dd973a447ddc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:21.226927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8774977-e9c8-4c63-89a6-dd973a447ddc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:21.227488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8774977-e9c8-4c63-89a6-dd973a447ddc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:21.228284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8774977-e9c8-4c63-89a6-dd973a447ddc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:21.228784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8774977-e9c8-4c63-89a6-dd973a447ddc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:21.343594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a0657c9b-7e10-4397-bb58-55720a57624b tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:21.343594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a0657c9b-7e10-4397-bb58-55720a57624b tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:21.354433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0657c9b-7e10-4397-bb58-55720a57624b tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:21.355218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0657c9b-7e10-4397-bb58-55720a57624b tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:21.356530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0657c9b-7e10-4397-bb58-55720a57624b tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:21.357471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0657c9b-7e10-4397-bb58-55720a57624b tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:21.485546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d8774977-e9c8-4c63-89a6-dd973a447ddc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:21.513358 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d8774977-e9c8-4c63-89a6-dd973a447ddc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1217 microversion: 2.1 time: 0.296296 Feb 19 21:20:21.516580 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2568/5220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:21 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1217 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:21.766571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a0657c9b-7e10-4397-bb58-55720a57624b tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:21.775822 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a0657c9b-7e10-4397-bb58-55720a57624b tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1465 microversion: 2.1 time: 0.438279 Feb 19 21:20:21.788307 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2653/5221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:21 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1465 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:21.819904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d7d20ee-15d9-4cf3-b653-f46261fc9452 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:21.820756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d7d20ee-15d9-4cf3-b653-f46261fc9452 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:21.829846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d7d20ee-15d9-4cf3-b653-f46261fc9452 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:21.830730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d7d20ee-15d9-4cf3-b653-f46261fc9452 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:21.832530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d7d20ee-15d9-4cf3-b653-f46261fc9452 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:21.833394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d7d20ee-15d9-4cf3-b653-f46261fc9452 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:21.875132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d7d20ee-15d9-4cf3-b653-f46261fc9452 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:20:21.998527 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d7d20ee-15d9-4cf3-b653-f46261fc9452 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 204 len: 0 microversion: 2.1 time: 0.182446 Feb 19 21:20:21.999550 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2569/5222] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:20:21 2022] DELETE /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:20:22.010899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d786653d-cd7f-4784-8680-88269c8c0968 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:22.011755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d786653d-cd7f-4784-8680-88269c8c0968 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:22.022462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d786653d-cd7f-4784-8680-88269c8c0968 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:22.023178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d786653d-cd7f-4784-8680-88269c8c0968 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:22.024129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d786653d-cd7f-4784-8680-88269c8c0968 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:22.024753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d786653d-cd7f-4784-8680-88269c8c0968 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:22.420510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d786653d-cd7f-4784-8680-88269c8c0968 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:22.429837 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d786653d-cd7f-4784-8680-88269c8c0968 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1471 microversion: 2.1 time: 0.423862 Feb 19 21:20:22.430601 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2654/5223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:22 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1471 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:22.535696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a86b424-0684-4e22-adff-d7a6d5974868 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:22.536890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3a86b424-0684-4e22-adff-d7a6d5974868 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:22.546656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a86b424-0684-4e22-adff-d7a6d5974868 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:22.548460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a86b424-0684-4e22-adff-d7a6d5974868 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:22.549308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a86b424-0684-4e22-adff-d7a6d5974868 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:22.550133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a86b424-0684-4e22-adff-d7a6d5974868 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:22.960973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3a86b424-0684-4e22-adff-d7a6d5974868 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:22.976209 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3a86b424-0684-4e22-adff-d7a6d5974868 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1217 microversion: 2.1 time: 0.446516 Feb 19 21:20:22.980031 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2570/5224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:22 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1217 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:23.455280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-162db3f5-4dc5-40dc-ad17-48f2117358c1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:23.457649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-162db3f5-4dc5-40dc-ad17-48f2117358c1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:23.470043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-162db3f5-4dc5-40dc-ad17-48f2117358c1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:23.472504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-162db3f5-4dc5-40dc-ad17-48f2117358c1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:23.474838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-162db3f5-4dc5-40dc-ad17-48f2117358c1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:23.476256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-162db3f5-4dc5-40dc-ad17-48f2117358c1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:24.005588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4321f625-b6ca-4ef8-9427-14c6a5a7f340 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:24.007697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4321f625-b6ca-4ef8-9427-14c6a5a7f340 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:24.015903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-162db3f5-4dc5-40dc-ad17-48f2117358c1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:24.025396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4321f625-b6ca-4ef8-9427-14c6a5a7f340 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:24.026243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4321f625-b6ca-4ef8-9427-14c6a5a7f340 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:24.028610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4321f625-b6ca-4ef8-9427-14c6a5a7f340 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:24.029616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4321f625-b6ca-4ef8-9427-14c6a5a7f340 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:24.031071 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-162db3f5-4dc5-40dc-ad17-48f2117358c1 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1471 microversion: 2.1 time: 0.584619 Feb 19 21:20:24.031856 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2655/5225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:23 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1471 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:24.493065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4321f625-b6ca-4ef8-9427-14c6a5a7f340 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:24.502043 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4321f625-b6ca-4ef8-9427-14c6a5a7f340 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1217 microversion: 2.1 time: 0.508147 Feb 19 21:20:24.517487 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2571/5226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:23 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1217 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:24.883562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5303b003-df1e-49d8-b48c-90e3ee8f6ee7 req-273e4be6-009b-48c8-9588-66a230377adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e293ab4-3ad5-425e-b83d-9cb264c70ddf", "name": "network-vif-deleted", "tag": "90fdab25-1b89-4d5c-ba82-9f1c831e690b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:24.886455 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:24.886455 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:20:24.940533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5303b003-df1e-49d8-b48c-90e3ee8f6ee7 req-273e4be6-009b-48c8-9588-66a230377adc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:24.947062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5303b003-df1e-49d8-b48c-90e3ee8f6ee7 req-273e4be6-009b-48c8-9588-66a230377adc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:24.987216 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5303b003-df1e-49d8-b48c-90e3ee8f6ee7 req-273e4be6-009b-48c8-9588-66a230377adc service nova] Creating event network-vif-deleted:90fdab25-1b89-4d5c-ba82-9f1c831e690b for instance 5e293ab4-3ad5-425e-b83d-9cb264c70ddf on nch1-master-1 Feb 19 21:20:25.000731 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5303b003-df1e-49d8-b48c-90e3ee8f6ee7 req-273e4be6-009b-48c8-9588-66a230377adc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120749 Feb 19 21:20:25.004996 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2656/5227] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:20:25.062004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:25.062687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:25.079581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:25.081925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:25.085459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:25.087021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:25.149626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:25.150694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:25.152595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lazy-loading 'fault' on Instance uuid 5e293ab4-3ad5-425e-b83d-9cb264c70ddf {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:20:25.207622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12833678dba14769b444cbff3ccdb9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b14d492c4f419d522cfbd3a863e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:25.222305 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c1bcc633-7fd0-4028-8945-9cc71e47b66a tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 200 len: 1305 microversion: 2.1 time: 0.166499 Feb 19 21:20:25.233291 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2572/5228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:25 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:25.522101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe7e08a9-38fe-4529-b52f-48ef79ed3dd3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:25.523105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fe7e08a9-38fe-4529-b52f-48ef79ed3dd3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:25.535856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe7e08a9-38fe-4529-b52f-48ef79ed3dd3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:25.538779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe7e08a9-38fe-4529-b52f-48ef79ed3dd3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:25.541177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe7e08a9-38fe-4529-b52f-48ef79ed3dd3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:25.543808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe7e08a9-38fe-4529-b52f-48ef79ed3dd3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:25.570744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-345912f9-eb29-4cc9-93aa-93755cae8059 req-d144b584-4e7c-4ba0-9cb6-dba1468f67b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e04ff43-f955-4862-8ef9-abc8fd3d42f1", "name": "network-vif-plugged", "status": "completed", "tag": "ba67d66f-db64-4254-bc12-c3652b12e977"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:25.574199 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:25.574199 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:20:25.599149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-345912f9-eb29-4cc9-93aa-93755cae8059 req-d144b584-4e7c-4ba0-9cb6-dba1468f67b5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:25.600714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-345912f9-eb29-4cc9-93aa-93755cae8059 req-d144b584-4e7c-4ba0-9cb6-dba1468f67b5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:25.635614 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-345912f9-eb29-4cc9-93aa-93755cae8059 req-d144b584-4e7c-4ba0-9cb6-dba1468f67b5 service nova] Creating event network-vif-plugged:ba67d66f-db64-4254-bc12-c3652b12e977 for instance 6e04ff43-f955-4862-8ef9-abc8fd3d42f1 on nch2-master-1 Feb 19 21:20:25.648613 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-345912f9-eb29-4cc9-93aa-93755cae8059 req-d144b584-4e7c-4ba0-9cb6-dba1468f67b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081947 Feb 19 21:20:25.651281 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2573/5229] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:20:26.085687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe7e08a9-38fe-4529-b52f-48ef79ed3dd3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:26.098546 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fe7e08a9-38fe-4529-b52f-48ef79ed3dd3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1217 microversion: 2.1 time: 0.581766 Feb 19 21:20:26.099307 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2657/5230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:25 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1217 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:26.241218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f96eb62-6c5e-4b8e-8635-8b2a8c1beb90 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:26.242049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f96eb62-6c5e-4b8e-8635-8b2a8c1beb90 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] [instance: 5e293ab4-3ad5-425e-b83d-9cb264c70ddf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:26.250941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f96eb62-6c5e-4b8e-8635-8b2a8c1beb90 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:26.251724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f96eb62-6c5e-4b8e-8635-8b2a8c1beb90 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:26.252852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f96eb62-6c5e-4b8e-8635-8b2a8c1beb90 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:26.253611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f96eb62-6c5e-4b8e-8635-8b2a8c1beb90 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:26.273440 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8f96eb62-6c5e-4b8e-8635-8b2a8c1beb90 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] HTTP exception thrown: Instance 5e293ab4-3ad5-425e-b83d-9cb264c70ddf could not be found. Feb 19 21:20:26.274435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f96eb62-6c5e-4b8e-8635-8b2a8c1beb90 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] Returning 404 to user: Instance 5e293ab4-3ad5-425e-b83d-9cb264c70ddf could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:20:26.275450 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8f96eb62-6c5e-4b8e-8635-8b2a8c1beb90 tempest-VolumesNegativeTest-2097690783 tempest-VolumesNegativeTest-2097690783-project] 10.222.0.30 "GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf" status: 404 len: 111 microversion: 2.1 time: 0.038408 Feb 19 21:20:26.277738 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2574/5231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:26 2022] GET /compute/v2.1/servers/5e293ab4-3ad5-425e-b83d-9cb264c70ddf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:26.591085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9948b51b-bcee-4ebc-a2ba-4a9341e89bd3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:26.594804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9948b51b-bcee-4ebc-a2ba-4a9341e89bd3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:26.611650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9948b51b-bcee-4ebc-a2ba-4a9341e89bd3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:26.612376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9948b51b-bcee-4ebc-a2ba-4a9341e89bd3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:26.613429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9948b51b-bcee-4ebc-a2ba-4a9341e89bd3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:26.614083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9948b51b-bcee-4ebc-a2ba-4a9341e89bd3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:26.645468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9948b51b-bcee-4ebc-a2ba-4a9341e89bd3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:20:26.772432 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9948b51b-bcee-4ebc-a2ba-4a9341e89bd3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "DELETE /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 204 len: 0 microversion: 2.1 time: 0.195216 Feb 19 21:20:26.773467 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2658/5232] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:20:26 2022] DELETE /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:20:26.782900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-10d19a60-ef55-40bb-8037-4c1794cbdb1b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:26.783821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-10d19a60-ef55-40bb-8037-4c1794cbdb1b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:26.790664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10d19a60-ef55-40bb-8037-4c1794cbdb1b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:26.791440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10d19a60-ef55-40bb-8037-4c1794cbdb1b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:26.792675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10d19a60-ef55-40bb-8037-4c1794cbdb1b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:26.793375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-10d19a60-ef55-40bb-8037-4c1794cbdb1b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:27.129878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-26ec7bea-0729-41b6-b044-0fa72608ef6b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:27.133789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-26ec7bea-0729-41b6-b044-0fa72608ef6b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:27.158129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-26ec7bea-0729-41b6-b044-0fa72608ef6b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:27.158892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-26ec7bea-0729-41b6-b044-0fa72608ef6b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:27.164677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-26ec7bea-0729-41b6-b044-0fa72608ef6b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:27.165775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-26ec7bea-0729-41b6-b044-0fa72608ef6b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:27.277430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-10d19a60-ef55-40bb-8037-4c1794cbdb1b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:27.306303 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-10d19a60-ef55-40bb-8037-4c1794cbdb1b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1551 microversion: 2.1 time: 0.522648 Feb 19 21:20:27.307544 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2575/5233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:26 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1551 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:28.094733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-26ec7bea-0729-41b6-b044-0fa72608ef6b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:28.103959 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-26ec7bea-0729-41b6-b044-0fa72608ef6b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1217 microversion: 2.1 time: 0.981706 Feb 19 21:20:28.105501 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2659/5234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:27 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1217 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:28.325056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dd94f2ea-98bb-47e9-89c8-70a9a1bfeafe tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:28.326549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dd94f2ea-98bb-47e9-89c8-70a9a1bfeafe tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:28.336200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd94f2ea-98bb-47e9-89c8-70a9a1bfeafe tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:28.336799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd94f2ea-98bb-47e9-89c8-70a9a1bfeafe tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:28.337712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd94f2ea-98bb-47e9-89c8-70a9a1bfeafe tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:28.338293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd94f2ea-98bb-47e9-89c8-70a9a1bfeafe tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:28.879678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dd94f2ea-98bb-47e9-89c8-70a9a1bfeafe tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:28.891760 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dd94f2ea-98bb-47e9-89c8-70a9a1bfeafe tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1551 microversion: 2.1 time: 0.570511 Feb 19 21:20:28.893684 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2576/5235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:28 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1551 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:29.131529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5d02cfa9-bdb1-4906-b63b-736dfc5cbf8e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:29.132234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5d02cfa9-bdb1-4906-b63b-736dfc5cbf8e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:29.139919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d02cfa9-bdb1-4906-b63b-736dfc5cbf8e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:29.140393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d02cfa9-bdb1-4906-b63b-736dfc5cbf8e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:29.141332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d02cfa9-bdb1-4906-b63b-736dfc5cbf8e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:29.143260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d02cfa9-bdb1-4906-b63b-736dfc5cbf8e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:29.540831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5d02cfa9-bdb1-4906-b63b-736dfc5cbf8e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:29.571281 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5d02cfa9-bdb1-4906-b63b-736dfc5cbf8e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1404 microversion: 2.1 time: 0.451359 Feb 19 21:20:29.573262 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2660/5236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:29 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:29.593915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11f8f79f-8e73-4acd-b444-9959cc991078 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:29.595196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11f8f79f-8e73-4acd-b444-9959cc991078 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:29.604689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11f8f79f-8e73-4acd-b444-9959cc991078 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:29.605485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11f8f79f-8e73-4acd-b444-9959cc991078 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:29.606479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11f8f79f-8e73-4acd-b444-9959cc991078 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:29.607406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11f8f79f-8e73-4acd-b444-9959cc991078 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:29.781773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-2dd58f0e-cb6a-4a22-974b-a3ca337403dc req-95b48c89-a4ec-47d0-b365-0453f226f97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95431a52-ee4c-495a-a38d-1bce0f6ba247", "name": "network-vif-deleted", "tag": "2bf532ef-8da2-48ca-bf67-64da6eca1b81"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:29.785589 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:29.785589 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:20:29.817016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2dd58f0e-cb6a-4a22-974b-a3ca337403dc req-95b48c89-a4ec-47d0-b365-0453f226f97f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:29.817434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2dd58f0e-cb6a-4a22-974b-a3ca337403dc req-95b48c89-a4ec-47d0-b365-0453f226f97f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:29.858968 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-2dd58f0e-cb6a-4a22-974b-a3ca337403dc req-95b48c89-a4ec-47d0-b365-0453f226f97f service nova] Creating event network-vif-deleted:2bf532ef-8da2-48ca-bf67-64da6eca1b81 for instance 95431a52-ee4c-495a-a38d-1bce0f6ba247 on nch2-master-1 Feb 19 21:20:29.886382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11f8f79f-8e73-4acd-b444-9959cc991078 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:29.886863 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-2dd58f0e-cb6a-4a22-974b-a3ca337403dc req-95b48c89-a4ec-47d0-b365-0453f226f97f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129465 Feb 19 21:20:29.887652 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2661/5237] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:20:29.898682 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11f8f79f-8e73-4acd-b444-9959cc991078 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1404 microversion: 2.1 time: 0.306702 Feb 19 21:20:29.903495 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2577/5238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:29 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1404 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:29.911990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1394956654"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:29.913199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:29.924000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:29.924796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:29.925998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:29.926134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:29.926628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:29.927054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:29.962647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:29.964605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:29.965575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:29.966612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:30.050825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:30.051288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:30.051753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lazy-loading 'fault' on Instance uuid 95431a52-ee4c-495a-a38d-1bce0f6ba247 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:20:30.114459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:30.125242 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-889b7158-fe8b-46a7-b936-10da916bef9b tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 200 len: 1338 microversion: 2.1 time: 0.217504 Feb 19 21:20:30.136624 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2578/5239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:29 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:30.150138 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.compute.api [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Attempting to quiesce instance before volume snapshot. Feb 19 21:20:30.218779 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.compute.api [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Feb 19 21:20:30.378243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Creating snapshot from volume 810eb069-3450-4d86-bd8b-728ffd2bc8f6. {{(pid=136094) snapshot_instance /opt/stack/nova/nova/compute/api.py:3399}} Feb 19 21:20:31.143351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0ae634d4-1c9b-4774-97d3-68a41a310299 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:31.143883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0ae634d4-1c9b-4774-97d3-68a41a310299 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 95431a52-ee4c-495a-a38d-1bce0f6ba247] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:31.154835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ae634d4-1c9b-4774-97d3-68a41a310299 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:31.155743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ae634d4-1c9b-4774-97d3-68a41a310299 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:31.160526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ae634d4-1c9b-4774-97d3-68a41a310299 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:31.162322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ae634d4-1c9b-4774-97d3-68a41a310299 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:31.189248 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-0ae634d4-1c9b-4774-97d3-68a41a310299 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] HTTP exception thrown: Instance 95431a52-ee4c-495a-a38d-1bce0f6ba247 could not be found. Feb 19 21:20:31.191215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0ae634d4-1c9b-4774-97d3-68a41a310299 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Returning 404 to user: Instance 95431a52-ee4c-495a-a38d-1bce0f6ba247 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:20:31.201593 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0ae634d4-1c9b-4774-97d3-68a41a310299 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247" status: 404 len: 111 microversion: 2.1 time: 0.061300 Feb 19 21:20:31.209173 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2579/5240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:31 2022] GET /compute/v2.1/servers/95431a52-ee4c-495a-a38d-1bce0f6ba247 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:31.523550 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-91c144b1-07d1-4446-8558-ab517e21aa32 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "POST /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1/action" status: 202 len: 0 microversion: 2.1 time: 1.616428 Feb 19 21:20:31.524814 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2662/5241] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:20:29 2022] POST /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1/action => generated 0 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 21:20:31.761266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6c835c57-80f2-4c5e-8786-63efbe061cdb tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '.version_select at 0x7f6466b54310>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:31.783882 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6c835c57-80f2-4c5e-8786-63efbe061cdb tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1295871547" status: 202 len: 0 microversion: 2.1 time: 0.025168 Feb 19 21:20:31.785477 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2580/5242] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 21:20:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1295871547 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:20:32.849633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1310692156", "imageRef": "872267d5-fa70-4066-94dd-c679e1ed508a", "flavorRef": "452", "networks": [{"uuid": "aea80e2c-9b0e-4c05-b6af-09dfa51c0b19"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:32.920055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] validate_networks() for [('aea80e2c-9b0e-4c05-b6af-09dfa51c0b19', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:20:33.947580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:20:33.948756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:20:33.949261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:20:33.950338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:20:33.951029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:20:33.960320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:33.960841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:33.961682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:33.962136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:33.981510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:20:33.989494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for user 2af13ad54ab048d495e5ff0c0453abb2 and project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:20:34.002303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:20:34.005163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a1865bd6-93fe-4f68-a812-5347bf3eb3b4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:20:34.084175 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a6ba75fe-457d-4cca-8f2a-1ab476597dc9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239704 Feb 19 21:20:34.104446 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2663/5243] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:20:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:20:34.110659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-21664002-9669-4f4b-b5e1-63547a1a5e66 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:34.111952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-21664002-9669-4f4b-b5e1-63547a1a5e66 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:34.439839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-21664002-9669-4f4b-b5e1-63547a1a5e66 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:34.449506 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-21664002-9669-4f4b-b5e1-63547a1a5e66 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1230 microversion: 2.1 time: 0.343095 Feb 19 21:20:34.451229 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2581/5244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:34 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1230 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:35.435651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ae64b201-c6ac-438b-a4ff-1893b3b526e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:35.438739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae64b201-c6ac-438b-a4ff-1893b3b526e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:35.439250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-7238b874-27c0-4ebc-9436-48549a1a892a req-4ebdf9c1-181c-40fc-96ff-63cd33af5eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4445865a-4d52-4db4-9915-98e0de5f708a", "tag": "9fbcb5db-1672-47dd-aee8-5c671023daed"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:35.442876 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:35.442876 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:20:35.454432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae64b201-c6ac-438b-a4ff-1893b3b526e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:35.455290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae64b201-c6ac-438b-a4ff-1893b3b526e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:35.456660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae64b201-c6ac-438b-a4ff-1893b3b526e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:35.457339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae64b201-c6ac-438b-a4ff-1893b3b526e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:35.464128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7238b874-27c0-4ebc-9436-48549a1a892a req-4ebdf9c1-181c-40fc-96ff-63cd33af5eb5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:35.470841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7238b874-27c0-4ebc-9436-48549a1a892a req-4ebdf9c1-181c-40fc-96ff-63cd33af5eb5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:35.517487 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-7238b874-27c0-4ebc-9436-48549a1a892a req-4ebdf9c1-181c-40fc-96ff-63cd33af5eb5 service nova] Creating event network-changed:9fbcb5db-1672-47dd-aee8-5c671023daed for instance 4445865a-4d52-4db4-9915-98e0de5f708a on nch1-master-1 Feb 19 21:20:35.528257 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-7238b874-27c0-4ebc-9436-48549a1a892a req-4ebdf9c1-181c-40fc-96ff-63cd33af5eb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094199 Feb 19 21:20:35.530450 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2582/5245] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:20:35.540121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae64b201-c6ac-438b-a4ff-1893b3b526e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:20:35.551299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e2c82ae-70c8-48e9-9d68-fd8a702de880 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:35.554083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1e2c82ae-70c8-48e9-9d68-fd8a702de880 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:35.569719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e2c82ae-70c8-48e9-9d68-fd8a702de880 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:35.570498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e2c82ae-70c8-48e9-9d68-fd8a702de880 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:35.572435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e2c82ae-70c8-48e9-9d68-fd8a702de880 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:35.572435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e2c82ae-70c8-48e9-9d68-fd8a702de880 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:35.751174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1e2c82ae-70c8-48e9-9d68-fd8a702de880 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:35.764382 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ae64b201-c6ac-438b-a4ff-1893b3b526e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 204 len: 0 microversion: 2.1 time: 0.344778 Feb 19 21:20:35.767407 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e2c82ae-70c8-48e9-9d68-fd8a702de880 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1300 microversion: 2.1 time: 0.235292 Feb 19 21:20:35.768903 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2664/5246] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:20:35 2022] DELETE /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:20:35.770024 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2583/5247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:35 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1300 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:35.788030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36e17e70-76cf-4c9a-bca3-69db6d861371 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:35.789802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-36e17e70-76cf-4c9a-bca3-69db6d861371 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:35.814737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36e17e70-76cf-4c9a-bca3-69db6d861371 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:35.817401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36e17e70-76cf-4c9a-bca3-69db6d861371 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:35.818360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36e17e70-76cf-4c9a-bca3-69db6d861371 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:35.821450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36e17e70-76cf-4c9a-bca3-69db6d861371 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:36.190074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-36e17e70-76cf-4c9a-bca3-69db6d861371 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:36.200053 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36e17e70-76cf-4c9a-bca3-69db6d861371 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1672 microversion: 2.1 time: 0.429678 Feb 19 21:20:36.203497 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2665/5248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:35 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1672 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:36.786890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3daf4b3b-ccdf-4a0d-9d86-7c1d9aabc508 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:36.787572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3daf4b3b-ccdf-4a0d-9d86-7c1d9aabc508 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:36.798122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3daf4b3b-ccdf-4a0d-9d86-7c1d9aabc508 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:36.798582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3daf4b3b-ccdf-4a0d-9d86-7c1d9aabc508 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:36.801022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3daf4b3b-ccdf-4a0d-9d86-7c1d9aabc508 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:36.801515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3daf4b3b-ccdf-4a0d-9d86-7c1d9aabc508 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:37.220388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a7fb26b2-8dc1-4929-a090-9589368955dd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:37.220939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a7fb26b2-8dc1-4929-a090-9589368955dd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:37.241745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7fb26b2-8dc1-4929-a090-9589368955dd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:37.242947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7fb26b2-8dc1-4929-a090-9589368955dd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:37.243856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7fb26b2-8dc1-4929-a090-9589368955dd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:37.244372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7fb26b2-8dc1-4929-a090-9589368955dd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:37.261500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3daf4b3b-ccdf-4a0d-9d86-7c1d9aabc508 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:37.311648 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3daf4b3b-ccdf-4a0d-9d86-7c1d9aabc508 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1342 microversion: 2.1 time: 0.526753 Feb 19 21:20:37.313318 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2584/5249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:36 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1342 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:37.727284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a7fb26b2-8dc1-4929-a090-9589368955dd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:37.739409 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a7fb26b2-8dc1-4929-a090-9589368955dd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1553 microversion: 2.1 time: 0.522954 Feb 19 21:20:37.740379 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2666/5250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:37 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1553 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:38.220097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e0007671-18c9-4d47-a579-423ff13d9e15 req-92ef8f0a-d520-46d5-a87c-54f8511d799d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6f3168-96da-4bff-b09b-954c091e9c60", "tag": "27a4f7ff-7455-4a78-addd-ea9fa4eb2dfe"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:38.227893 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:38.227893 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:20:38.260619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e0007671-18c9-4d47-a579-423ff13d9e15 req-92ef8f0a-d520-46d5-a87c-54f8511d799d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:38.263955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e0007671-18c9-4d47-a579-423ff13d9e15 req-92ef8f0a-d520-46d5-a87c-54f8511d799d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:38.298503 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e0007671-18c9-4d47-a579-423ff13d9e15 req-92ef8f0a-d520-46d5-a87c-54f8511d799d service nova] Creating event network-changed:27a4f7ff-7455-4a78-addd-ea9fa4eb2dfe for instance 5d6f3168-96da-4bff-b09b-954c091e9c60 on nch1-master-1 Feb 19 21:20:38.305356 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e0007671-18c9-4d47-a579-423ff13d9e15 req-92ef8f0a-d520-46d5-a87c-54f8511d799d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094749 Feb 19 21:20:38.308101 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2585/5251] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:20:38.339016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1e1e2158-c454-4787-8ca7-b77c340ff270 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:38.339776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1e1e2158-c454-4787-8ca7-b77c340ff270 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:38.348192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e1e2158-c454-4787-8ca7-b77c340ff270 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:38.348794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e1e2158-c454-4787-8ca7-b77c340ff270 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:38.349611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e1e2158-c454-4787-8ca7-b77c340ff270 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:38.350281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e1e2158-c454-4787-8ca7-b77c340ff270 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:38.708278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1e1e2158-c454-4787-8ca7-b77c340ff270 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:38.718574 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1e1e2158-c454-4787-8ca7-b77c340ff270 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1342 microversion: 2.1 time: 0.388749 Feb 19 21:20:38.720085 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2667/5252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:38 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1342 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:38.758248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b8040164-3b35-4767-8e2a-029af7e50c1d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:38.759313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b8040164-3b35-4767-8e2a-029af7e50c1d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:38.771593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8040164-3b35-4767-8e2a-029af7e50c1d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:38.772096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8040164-3b35-4767-8e2a-029af7e50c1d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:38.772962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8040164-3b35-4767-8e2a-029af7e50c1d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:38.773471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8040164-3b35-4767-8e2a-029af7e50c1d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:38.937856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b8040164-3b35-4767-8e2a-029af7e50c1d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:38.962892 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b8040164-3b35-4767-8e2a-029af7e50c1d tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 200 len: 1485 microversion: 2.1 time: 0.198711 Feb 19 21:20:38.965890 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2586/5253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:38 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 1485 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:39.289003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6e92b776-14ed-4fac-8d6a-f5b1045c9509 req-4922a650-3475-428c-b231-955dc30cdac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4445865a-4d52-4db4-9915-98e0de5f708a", "name": "network-vif-deleted", "tag": "9fbcb5db-1672-47dd-aee8-5c671023daed"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:39.290675 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:39.290675 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:20:39.311763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6e92b776-14ed-4fac-8d6a-f5b1045c9509 req-4922a650-3475-428c-b231-955dc30cdac9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:39.312231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6e92b776-14ed-4fac-8d6a-f5b1045c9509 req-4922a650-3475-428c-b231-955dc30cdac9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:39.366639 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6e92b776-14ed-4fac-8d6a-f5b1045c9509 req-4922a650-3475-428c-b231-955dc30cdac9 service nova] Creating event network-vif-deleted:9fbcb5db-1672-47dd-aee8-5c671023daed for instance 4445865a-4d52-4db4-9915-98e0de5f708a on nch1-master-1 Feb 19 21:20:39.378293 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6e92b776-14ed-4fac-8d6a-f5b1045c9509 req-4922a650-3475-428c-b231-955dc30cdac9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.412979 Feb 19 21:20:39.381822 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2668/5254] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:20:39.739310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb006a5c-68f5-4513-94b2-fc1340e8a345 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:39.740201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb006a5c-68f5-4513-94b2-fc1340e8a345 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:39.760921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb006a5c-68f5-4513-94b2-fc1340e8a345 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:39.761285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb006a5c-68f5-4513-94b2-fc1340e8a345 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:39.762261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb006a5c-68f5-4513-94b2-fc1340e8a345 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:39.762716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb006a5c-68f5-4513-94b2-fc1340e8a345 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:39.982620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dec48717-99a2-457a-bc36-8418aeb0096e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:39.983589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dec48717-99a2-457a-bc36-8418aeb0096e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: 4445865a-4d52-4db4-9915-98e0de5f708a] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:39.996135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dec48717-99a2-457a-bc36-8418aeb0096e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:40.000830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dec48717-99a2-457a-bc36-8418aeb0096e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:40.001792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dec48717-99a2-457a-bc36-8418aeb0096e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:40.002425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dec48717-99a2-457a-bc36-8418aeb0096e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:40.030324 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-dec48717-99a2-457a-bc36-8418aeb0096e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] HTTP exception thrown: Instance 4445865a-4d52-4db4-9915-98e0de5f708a could not be found. Feb 19 21:20:40.034644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dec48717-99a2-457a-bc36-8418aeb0096e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Returning 404 to user: Instance 4445865a-4d52-4db4-9915-98e0de5f708a could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:20:40.035538 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dec48717-99a2-457a-bc36-8418aeb0096e tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a" status: 404 len: 111 microversion: 2.1 time: 0.057637 Feb 19 21:20:40.039412 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2669/5255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:39 2022] GET /compute/v2.1/servers/4445865a-4d52-4db4-9915-98e0de5f708a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:40.149785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cb006a5c-68f5-4513-94b2-fc1340e8a345 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:40.162225 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb006a5c-68f5-4513-94b2-fc1340e8a345 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1342 microversion: 2.1 time: 0.424520 Feb 19 21:20:40.164987 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2587/5256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:39 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1342 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:40.983846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-102c733f-06dc-44ec-b810-9f64ccb36c87 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '.version_select at 0x7f64676fe040>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:41.031537 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-102c733f-06dc-44ec-b810-9f64ccb36c87 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1209497056" status: 202 len: 0 microversion: 2.1 time: 0.051041 Feb 19 21:20:41.032968 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2670/5257] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 21:20:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1209497056 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:20:41.184885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-86878a6a-19a4-424d-9f8c-77e1c3f880d4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:41.186709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-86878a6a-19a4-424d-9f8c-77e1c3f880d4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:41.197753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86878a6a-19a4-424d-9f8c-77e1c3f880d4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:41.198461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86878a6a-19a4-424d-9f8c-77e1c3f880d4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:41.199816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86878a6a-19a4-424d-9f8c-77e1c3f880d4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:41.200485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86878a6a-19a4-424d-9f8c-77e1c3f880d4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:41.472775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-86878a6a-19a4-424d-9f8c-77e1c3f880d4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:41.482232 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-86878a6a-19a4-424d-9f8c-77e1c3f880d4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1376 microversion: 2.1 time: 0.304160 Feb 19 21:20:41.494583 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2588/5258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:41 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1376 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:42.513798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-57f6a525-2078-4d51-bdaf-8394c2d3a635 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:42.516102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-57f6a525-2078-4d51-bdaf-8394c2d3a635 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:42.543018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57f6a525-2078-4d51-bdaf-8394c2d3a635 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:42.544484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57f6a525-2078-4d51-bdaf-8394c2d3a635 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:42.547225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57f6a525-2078-4d51-bdaf-8394c2d3a635 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:42.548503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-57f6a525-2078-4d51-bdaf-8394c2d3a635 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:42.967729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-57f6a525-2078-4d51-bdaf-8394c2d3a635 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:42.982406 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-57f6a525-2078-4d51-bdaf-8394c2d3a635 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1376 microversion: 2.1 time: 0.484223 Feb 19 21:20:42.983551 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2671/5259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:42 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1376 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:44.004176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c497ffe2-8631-45f1-a6d7-07d94cb8de7b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:44.012749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c497ffe2-8631-45f1-a6d7-07d94cb8de7b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:44.037806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c497ffe2-8631-45f1-a6d7-07d94cb8de7b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:44.038307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c497ffe2-8631-45f1-a6d7-07d94cb8de7b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:44.039133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c497ffe2-8631-45f1-a6d7-07d94cb8de7b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:44.039577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c497ffe2-8631-45f1-a6d7-07d94cb8de7b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:44.423316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c497ffe2-8631-45f1-a6d7-07d94cb8de7b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:44.437281 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c497ffe2-8631-45f1-a6d7-07d94cb8de7b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1376 microversion: 2.1 time: 0.440610 Feb 19 21:20:44.448758 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2589/5260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:43 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1376 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:44.465933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1096152927", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "329f24bf-548d-4726-9c90-6ec6901e5e7e"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:44.539229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] validate_networks() for [('329f24bf-548d-4726-9c90-6ec6901e5e7e', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:20:45.057237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:20:45.057878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:20:45.059557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:20:45.060505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:20:45.061085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:20:45.072993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:45.073800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:45.074794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:45.075419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:45.116920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Getting quotas for project f355422bbc4a402597f285f02ca85a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:20:45.123403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Getting quotas for user 75acfc9921fc44bb8b307616ae5da163 and project f355422bbc4a402597f285f02ca85a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:20:45.138199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:20:45.142512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:20:45.207009 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-efdcda4d-2a0f-429c-89f9-dd3e7d0c478f tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929466 Feb 19 21:20:45.211725 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2672/5261] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:20:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:20:45.225673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f27f58d8-3571-4800-8d42-390e095b18c8 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:45.226371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f27f58d8-3571-4800-8d42-390e095b18c8 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:45.304126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f27f58d8-3571-4800-8d42-390e095b18c8 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:45.318585 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f27f58d8-3571-4800-8d42-390e095b18c8 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1215 microversion: 2.1 time: 0.101930 Feb 19 21:20:45.320106 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2590/5262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:45 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:45.458411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a021356b-90ea-46b7-88b2-fe838406131e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:45.459416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a021356b-90ea-46b7-88b2-fe838406131e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:45.469132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a021356b-90ea-46b7-88b2-fe838406131e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:45.470641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a021356b-90ea-46b7-88b2-fe838406131e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:45.471970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a021356b-90ea-46b7-88b2-fe838406131e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:45.472780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a021356b-90ea-46b7-88b2-fe838406131e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:45.826292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a021356b-90ea-46b7-88b2-fe838406131e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:45.834530 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a021356b-90ea-46b7-88b2-fe838406131e tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1376 microversion: 2.1 time: 0.381558 Feb 19 21:20:45.845238 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2673/5263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:45 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1376 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:46.348213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98acff91-4d43-4ece-b2fe-32c1a6a5e4f5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:46.348860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-98acff91-4d43-4ece-b2fe-32c1a6a5e4f5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:46.359246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98acff91-4d43-4ece-b2fe-32c1a6a5e4f5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:46.359979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98acff91-4d43-4ece-b2fe-32c1a6a5e4f5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:46.365921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98acff91-4d43-4ece-b2fe-32c1a6a5e4f5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:46.366723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98acff91-4d43-4ece-b2fe-32c1a6a5e4f5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:46.825248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98acff91-4d43-4ece-b2fe-32c1a6a5e4f5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:46.842530 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98acff91-4d43-4ece-b2fe-32c1a6a5e4f5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1267 microversion: 2.1 time: 0.507134 Feb 19 21:20:46.844291 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2591/5264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:46 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1267 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:46.853128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a629d171-2435-40d5-a238-eb8424762726 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:46.855305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a629d171-2435-40d5-a238-eb8424762726 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:46.868495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a629d171-2435-40d5-a238-eb8424762726 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:46.870799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a629d171-2435-40d5-a238-eb8424762726 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:46.871678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a629d171-2435-40d5-a238-eb8424762726 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:46.872132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a629d171-2435-40d5-a238-eb8424762726 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:47.255422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a629d171-2435-40d5-a238-eb8424762726 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:47.270523 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a629d171-2435-40d5-a238-eb8424762726 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1376 microversion: 2.1 time: 0.421818 Feb 19 21:20:47.272636 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2674/5265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:46 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1376 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:47.869933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad9ee3c0-be68-4ae8-abdc-ac6ab92b1871 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:47.870765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ad9ee3c0-be68-4ae8-abdc-ac6ab92b1871 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:47.877997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad9ee3c0-be68-4ae8-abdc-ac6ab92b1871 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:47.878846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad9ee3c0-be68-4ae8-abdc-ac6ab92b1871 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:47.879716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad9ee3c0-be68-4ae8-abdc-ac6ab92b1871 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:47.880433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad9ee3c0-be68-4ae8-abdc-ac6ab92b1871 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:48.003600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ad9ee3c0-be68-4ae8-abdc-ac6ab92b1871 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:48.014791 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad9ee3c0-be68-4ae8-abdc-ac6ab92b1871 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1273 microversion: 2.1 time: 0.151407 Feb 19 21:20:48.017518 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2592/5266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:47 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:48.288760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f6e6f5f-1551-4de2-8407-56f5bdecfeda tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:48.290569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9f6e6f5f-1551-4de2-8407-56f5bdecfeda tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:48.303845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6e6f5f-1551-4de2-8407-56f5bdecfeda tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:48.304708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6e6f5f-1551-4de2-8407-56f5bdecfeda tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:48.305744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6e6f5f-1551-4de2-8407-56f5bdecfeda tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:48.306484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f6e6f5f-1551-4de2-8407-56f5bdecfeda tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:48.655290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9f6e6f5f-1551-4de2-8407-56f5bdecfeda tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:48.667671 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f6e6f5f-1551-4de2-8407-56f5bdecfeda tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1376 microversion: 2.1 time: 0.382956 Feb 19 21:20:48.677404 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2675/5267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:48 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1376 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:48.768274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-9046d226-179b-484a-a3c5-c423448bf17f req-12621d41-0927-400f-8f0b-b0a395481bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6f3168-96da-4bff-b09b-954c091e9c60", "name": "network-vif-plugged", "status": "completed", "tag": "27a4f7ff-7455-4a78-addd-ea9fa4eb2dfe"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:48.771021 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:48.771021 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:20:48.779609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9046d226-179b-484a-a3c5-c423448bf17f req-12621d41-0927-400f-8f0b-b0a395481bd1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:48.780489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9046d226-179b-484a-a3c5-c423448bf17f req-12621d41-0927-400f-8f0b-b0a395481bd1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:48.795953 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-9046d226-179b-484a-a3c5-c423448bf17f req-12621d41-0927-400f-8f0b-b0a395481bd1 service nova] Creating event network-vif-plugged:27a4f7ff-7455-4a78-addd-ea9fa4eb2dfe for instance 5d6f3168-96da-4bff-b09b-954c091e9c60 on nch1-master-1 Feb 19 21:20:48.802262 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-9046d226-179b-484a-a3c5-c423448bf17f req-12621d41-0927-400f-8f0b-b0a395481bd1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037978 Feb 19 21:20:48.804385 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2593/5268] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:20:49.040890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dc5a7ccd-e7cd-4ab5-a786-0bdbab50db47 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:49.044977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dc5a7ccd-e7cd-4ab5-a786-0bdbab50db47 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:49.058267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc5a7ccd-e7cd-4ab5-a786-0bdbab50db47 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:49.059248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc5a7ccd-e7cd-4ab5-a786-0bdbab50db47 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:49.067447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc5a7ccd-e7cd-4ab5-a786-0bdbab50db47 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:49.068895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc5a7ccd-e7cd-4ab5-a786-0bdbab50db47 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:49.411340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dc5a7ccd-e7cd-4ab5-a786-0bdbab50db47 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:49.423988 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dc5a7ccd-e7cd-4ab5-a786-0bdbab50db47 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1315 microversion: 2.1 time: 0.389346 Feb 19 21:20:49.425362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2676/5269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:49 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:49.685276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f69b1cde-153a-464e-9fc2-273d78f95b13 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:49.686159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f69b1cde-153a-464e-9fc2-273d78f95b13 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:49.694665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f69b1cde-153a-464e-9fc2-273d78f95b13 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:49.695495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f69b1cde-153a-464e-9fc2-273d78f95b13 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:49.696515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f69b1cde-153a-464e-9fc2-273d78f95b13 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:49.697196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f69b1cde-153a-464e-9fc2-273d78f95b13 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:49.969398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f69b1cde-153a-464e-9fc2-273d78f95b13 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:49.980645 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f69b1cde-153a-464e-9fc2-273d78f95b13 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1376 microversion: 2.1 time: 0.299430 Feb 19 21:20:49.981721 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2594/5270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:49 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1376 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:50.298758 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4aa39653-6297-4702-8f1b-5d67f47906db req-dca9bae2-b8c7-40d8-8654-ea9b55f4c929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8abc5b5f-df17-43c4-af14-e9f47a9f9234", "tag": "177dcc51-f1b3-422d-be43-aa6cfc1b0319"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:50.300321 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:50.300321 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:20:50.308935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4aa39653-6297-4702-8f1b-5d67f47906db req-dca9bae2-b8c7-40d8-8654-ea9b55f4c929 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:50.309686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4aa39653-6297-4702-8f1b-5d67f47906db req-dca9bae2-b8c7-40d8-8654-ea9b55f4c929 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:50.333351 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4aa39653-6297-4702-8f1b-5d67f47906db req-dca9bae2-b8c7-40d8-8654-ea9b55f4c929 service nova] Creating event network-changed:177dcc51-f1b3-422d-be43-aa6cfc1b0319 for instance 8abc5b5f-df17-43c4-af14-e9f47a9f9234 on nch2-master-1 Feb 19 21:20:50.340066 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4aa39653-6297-4702-8f1b-5d67f47906db req-dca9bae2-b8c7-40d8-8654-ea9b55f4c929 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050803 Feb 19 21:20:50.341399 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2677/5271] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:20:50.445076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-667a2a77-59e5-4596-8f62-e872f6a4c7b7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:50.446125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-667a2a77-59e5-4596-8f62-e872f6a4c7b7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:50.463225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667a2a77-59e5-4596-8f62-e872f6a4c7b7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:50.464385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667a2a77-59e5-4596-8f62-e872f6a4c7b7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:50.466094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667a2a77-59e5-4596-8f62-e872f6a4c7b7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:50.466991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-667a2a77-59e5-4596-8f62-e872f6a4c7b7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:51.008416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5ea0d321-3fd7-404c-b8dd-2c4b103ffb10 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:51.009233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5ea0d321-3fd7-404c-b8dd-2c4b103ffb10 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:51.023276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ea0d321-3fd7-404c-b8dd-2c4b103ffb10 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:51.026365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ea0d321-3fd7-404c-b8dd-2c4b103ffb10 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:51.028457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ea0d321-3fd7-404c-b8dd-2c4b103ffb10 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:51.029311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ea0d321-3fd7-404c-b8dd-2c4b103ffb10 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:51.226027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-667a2a77-59e5-4596-8f62-e872f6a4c7b7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:51.239551 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-667a2a77-59e5-4596-8f62-e872f6a4c7b7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1315 microversion: 2.1 time: 0.799371 Feb 19 21:20:51.241220 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2595/5272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:50 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:51.527630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5ea0d321-3fd7-404c-b8dd-2c4b103ffb10 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:51.537562 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5ea0d321-3fd7-404c-b8dd-2c4b103ffb10 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1563 microversion: 2.1 time: 0.534055 Feb 19 21:20:51.549342 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2678/5273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:51 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1563 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:51.560996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fb08eb54-1ee3-4fdc-bae8-dc9326a97553 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:51.562106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fb08eb54-1ee3-4fdc-bae8-dc9326a97553 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:51.574407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb08eb54-1ee3-4fdc-bae8-dc9326a97553 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:51.576790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb08eb54-1ee3-4fdc-bae8-dc9326a97553 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:51.579383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb08eb54-1ee3-4fdc-bae8-dc9326a97553 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:51.580925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb08eb54-1ee3-4fdc-bae8-dc9326a97553 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:52.028929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb08eb54-1ee3-4fdc-bae8-dc9326a97553 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:52.052283 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fb08eb54-1ee3-4fdc-bae8-dc9326a97553 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1563 microversion: 2.1 time: 0.499285 Feb 19 21:20:52.054327 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2596/5274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:51 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1563 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:52.156637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fa596e53-23b5-4710-8d95-637add643d08 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:52.158607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa596e53-23b5-4710-8d95-637add643d08 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:52.168700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa596e53-23b5-4710-8d95-637add643d08 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:52.169221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa596e53-23b5-4710-8d95-637add643d08 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:52.170115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa596e53-23b5-4710-8d95-637add643d08 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:52.170904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa596e53-23b5-4710-8d95-637add643d08 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:52.231766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa596e53-23b5-4710-8d95-637add643d08 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:20:52.257668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0686c83d-512d-41b1-a7c5-e1e664b02cad tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:52.258278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0686c83d-512d-41b1-a7c5-e1e664b02cad tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:52.268409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0686c83d-512d-41b1-a7c5-e1e664b02cad tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:52.268780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0686c83d-512d-41b1-a7c5-e1e664b02cad tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:52.269595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0686c83d-512d-41b1-a7c5-e1e664b02cad tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:52.270043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0686c83d-512d-41b1-a7c5-e1e664b02cad tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:52.370897 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fa596e53-23b5-4710-8d95-637add643d08 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 204 len: 0 microversion: 2.1 time: 0.216201 Feb 19 21:20:52.373387 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2679/5275] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:20:52 2022] DELETE /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:20:52.393315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-16deec45-3316-4b56-ab10-675530a31b42 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:52.394435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-16deec45-3316-4b56-ab10-675530a31b42 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:52.409938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16deec45-3316-4b56-ab10-675530a31b42 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:52.412021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16deec45-3316-4b56-ab10-675530a31b42 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:52.414804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16deec45-3316-4b56-ab10-675530a31b42 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:52.416493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16deec45-3316-4b56-ab10-675530a31b42 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:52.611609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0686c83d-512d-41b1-a7c5-e1e664b02cad tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:52.620176 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0686c83d-512d-41b1-a7c5-e1e664b02cad tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1315 microversion: 2.1 time: 0.366043 Feb 19 21:20:52.620831 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2597/5276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:52 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:52.765934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-16deec45-3316-4b56-ab10-675530a31b42 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:52.777640 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-16deec45-3316-4b56-ab10-675530a31b42 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1569 microversion: 2.1 time: 0.397015 Feb 19 21:20:52.778835 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2680/5277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:52 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1569 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:53.651182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2a3d7c55-77e6-4942-b558-246b234179e3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:53.651818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2a3d7c55-77e6-4942-b558-246b234179e3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:53.661924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a3d7c55-77e6-4942-b558-246b234179e3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:53.662634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a3d7c55-77e6-4942-b558-246b234179e3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:53.663666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a3d7c55-77e6-4942-b558-246b234179e3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:53.664170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a3d7c55-77e6-4942-b558-246b234179e3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:53.797374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-32c93184-7a7e-44eb-baa5-24abb10a327f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:53.798131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-32c93184-7a7e-44eb-baa5-24abb10a327f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:53.818446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32c93184-7a7e-44eb-baa5-24abb10a327f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:53.819188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32c93184-7a7e-44eb-baa5-24abb10a327f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:53.820154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32c93184-7a7e-44eb-baa5-24abb10a327f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:53.821257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32c93184-7a7e-44eb-baa5-24abb10a327f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:54.437589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2a3d7c55-77e6-4942-b558-246b234179e3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:54.455452 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2a3d7c55-77e6-4942-b558-246b234179e3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1315 microversion: 2.1 time: 0.808851 Feb 19 21:20:54.456993 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2598/5278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:53 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:20:54.481357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-32c93184-7a7e-44eb-baa5-24abb10a327f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:54.495621 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-32c93184-7a7e-44eb-baa5-24abb10a327f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1569 microversion: 2.1 time: 0.703589 Feb 19 21:20:54.497112 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2681/5279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:53 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1569 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:55.191259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b9e1b98c-19e0-4794-89d2-1561bb40a1ca req-ffafda50-07a7-4fdd-94de-bdbce21c1039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6f3168-96da-4bff-b09b-954c091e9c60", "name": "network-vif-deleted", "tag": "27a4f7ff-7455-4a78-addd-ea9fa4eb2dfe"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:55.201799 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:55.201799 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:20:55.224977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b9e1b98c-19e0-4794-89d2-1561bb40a1ca req-ffafda50-07a7-4fdd-94de-bdbce21c1039 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:55.225434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b9e1b98c-19e0-4794-89d2-1561bb40a1ca req-ffafda50-07a7-4fdd-94de-bdbce21c1039 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:55.258698 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b9e1b98c-19e0-4794-89d2-1561bb40a1ca req-ffafda50-07a7-4fdd-94de-bdbce21c1039 service nova] Creating event network-vif-deleted:27a4f7ff-7455-4a78-addd-ea9fa4eb2dfe for instance 5d6f3168-96da-4bff-b09b-954c091e9c60 on nch1-master-1 Feb 19 21:20:55.273467 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b9e1b98c-19e0-4794-89d2-1561bb40a1ca req-ffafda50-07a7-4fdd-94de-bdbce21c1039 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098143 Feb 19 21:20:55.276378 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2599/5280] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:20:55.475536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cfbcfa02-b0a0-411a-ad8a-38122db25605 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:55.476162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cfbcfa02-b0a0-411a-ad8a-38122db25605 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:55.503416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfbcfa02-b0a0-411a-ad8a-38122db25605 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:55.503916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfbcfa02-b0a0-411a-ad8a-38122db25605 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:55.504824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfbcfa02-b0a0-411a-ad8a-38122db25605 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:55.505277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfbcfa02-b0a0-411a-ad8a-38122db25605 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:55.514855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7c1d8669-4bcf-45a4-b908-ddfe5803ace8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:55.515589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7c1d8669-4bcf-45a4-b908-ddfe5803ace8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:55.538027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c1d8669-4bcf-45a4-b908-ddfe5803ace8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:55.538482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c1d8669-4bcf-45a4-b908-ddfe5803ace8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:55.539304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c1d8669-4bcf-45a4-b908-ddfe5803ace8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:55.539834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c1d8669-4bcf-45a4-b908-ddfe5803ace8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:55.805969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7c1d8669-4bcf-45a4-b908-ddfe5803ace8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:55.830626 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7c1d8669-4bcf-45a4-b908-ddfe5803ace8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 200 len: 1361 microversion: 2.1 time: 0.320439 Feb 19 21:20:55.839549 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2600/5281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:55 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:56.150699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cfbcfa02-b0a0-411a-ad8a-38122db25605 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:56.172870 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cfbcfa02-b0a0-411a-ad8a-38122db25605 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1315 microversion: 2.1 time: 0.700721 Feb 19 21:20:56.177153 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2682/5282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:55 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:56.859693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3267d738-3f8f-4032-9dab-b816e4e1e414 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:56.860623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3267d738-3f8f-4032-9dab-b816e4e1e414 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:56.881405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3267d738-3f8f-4032-9dab-b816e4e1e414 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:56.896801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3267d738-3f8f-4032-9dab-b816e4e1e414 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:56.897800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3267d738-3f8f-4032-9dab-b816e4e1e414 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:56.901525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3267d738-3f8f-4032-9dab-b816e4e1e414 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:56.924807 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-3267d738-3f8f-4032-9dab-b816e4e1e414 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 5d6f3168-96da-4bff-b09b-954c091e9c60 could not be found. Feb 19 21:20:56.934106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3267d738-3f8f-4032-9dab-b816e4e1e414 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 5d6f3168-96da-4bff-b09b-954c091e9c60 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:20:56.943100 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3267d738-3f8f-4032-9dab-b816e4e1e414 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 404 len: 111 microversion: 2.1 time: 0.088353 Feb 19 21:20:56.944235 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2601/5283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:56 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:20:57.196173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c322ae44-2e74-48f0-92fa-c382251a99ec tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:57.198773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c322ae44-2e74-48f0-92fa-c382251a99ec tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:57.215222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c322ae44-2e74-48f0-92fa-c382251a99ec tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:57.216681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c322ae44-2e74-48f0-92fa-c382251a99ec tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:57.217777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c322ae44-2e74-48f0-92fa-c382251a99ec tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:57.218408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c322ae44-2e74-48f0-92fa-c382251a99ec tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:57.565154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c322ae44-2e74-48f0-92fa-c382251a99ec tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:57.578906 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c322ae44-2e74-48f0-92fa-c382251a99ec tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1315 microversion: 2.1 time: 0.386763 Feb 19 21:20:57.579393 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2683/5284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:57 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:57.794682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-92ed02a4-73e3-492d-81b2-5e7578e98a62 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Action: 'create', calling method: .version_select at 0x7f6466b34040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1062926922"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:57.811649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-92ed02a4-73e3-492d-81b2-5e7578e98a62 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:20:57.818814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-92ed02a4-73e3-492d-81b2-5e7578e98a62 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for user e1fde410660b47939139960a9420179a and project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:20:58.227592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-92ed02a4-73e3-492d-81b2-5e7578e98a62 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:20:58.236086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-92ed02a4-73e3-492d-81b2-5e7578e98a62 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for user e1fde410660b47939139960a9420179a and project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:20:58.269765 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-92ed02a4-73e3-492d-81b2-5e7578e98a62 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.479225 Feb 19 21:20:58.292086 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2602/5285] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:20:57 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:58.597027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-04f7ea41-edfc-45dc-9046-60d47db175bf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:58.598275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-04f7ea41-edfc-45dc-9046-60d47db175bf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:58.611536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04f7ea41-edfc-45dc-9046-60d47db175bf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:58.614112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04f7ea41-edfc-45dc-9046-60d47db175bf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:58.615755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04f7ea41-edfc-45dc-9046-60d47db175bf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:58.616784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04f7ea41-edfc-45dc-9046-60d47db175bf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:58.912661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-04f7ea41-edfc-45dc-9046-60d47db175bf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:20:58.925744 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-04f7ea41-edfc-45dc-9046-60d47db175bf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1315 microversion: 2.1 time: 0.332843 Feb 19 21:20:58.930475 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2684/5286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:58 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:20:59.848807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4a5ec347-9ca9-48f9-8c01-62a6e10496ec req-c10d21e9-9b6b-497f-9d42-d3ab2a6ac91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8abc5b5f-df17-43c4-af14-e9f47a9f9234", "name": "network-vif-plugged", "status": "completed", "tag": "177dcc51-f1b3-422d-be43-aa6cfc1b0319"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:20:59.854331 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:20:59.854331 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:20:59.870788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4a5ec347-9ca9-48f9-8c01-62a6e10496ec req-c10d21e9-9b6b-497f-9d42-d3ab2a6ac91a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:59.877593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4a5ec347-9ca9-48f9-8c01-62a6e10496ec req-c10d21e9-9b6b-497f-9d42-d3ab2a6ac91a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:59.899415 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4a5ec347-9ca9-48f9-8c01-62a6e10496ec req-c10d21e9-9b6b-497f-9d42-d3ab2a6ac91a service nova] Creating event network-vif-plugged:177dcc51-f1b3-422d-be43-aa6cfc1b0319 for instance 8abc5b5f-df17-43c4-af14-e9f47a9f9234 on nch2-master-1 Feb 19 21:20:59.911876 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4a5ec347-9ca9-48f9-8c01-62a6e10496ec req-c10d21e9-9b6b-497f-9d42-d3ab2a6ac91a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065653 Feb 19 21:20:59.913169 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2603/5287] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:20:59.951511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1c1e599-3929-4d18-82ac-f4cfcff1b293 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:20:59.952381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b1c1e599-3929-4d18-82ac-f4cfcff1b293 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:20:59.966324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1c1e599-3929-4d18-82ac-f4cfcff1b293 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:59.966789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1c1e599-3929-4d18-82ac-f4cfcff1b293 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:20:59.967616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1c1e599-3929-4d18-82ac-f4cfcff1b293 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:20:59.968064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1c1e599-3929-4d18-82ac-f4cfcff1b293 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:00.203427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b1c1e599-3929-4d18-82ac-f4cfcff1b293 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:00.214499 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b1c1e599-3929-4d18-82ac-f4cfcff1b293 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1315 microversion: 2.1 time: 0.267025 Feb 19 21:21:00.215542 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2685/5288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:20:59 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:00.475929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-791704529", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "c4ebd81e-1d57-4556-849f-49c1f55e520a"}], "key_name": "tempest-TestNetworkBasicOps-1062926922", "security_groups": [{"name": "tempest-secgroup-smoke-1653556862"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:00.651561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] validate_networks() for [('c4ebd81e-1d57-4556-849f-49c1f55e520a', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:21:01.238104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5c7f862-1144-4f80-af51-2f63482b3e00 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:01.239137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a5c7f862-1144-4f80-af51-2f63482b3e00 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:01.251401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5c7f862-1144-4f80-af51-2f63482b3e00 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:01.252129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5c7f862-1144-4f80-af51-2f63482b3e00 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:01.253302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5c7f862-1144-4f80-af51-2f63482b3e00 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:01.260512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5c7f862-1144-4f80-af51-2f63482b3e00 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:01.357936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:21:01.358427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:21:01.358986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:21:01.359600 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:21:01.360018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:21:01.371039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:01.371601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:01.372440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:01.372879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:01.399152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:21:01.410784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Getting quotas for user e1fde410660b47939139960a9420179a and project e2dcdf87966c4cc5899afcfb6f2b6b1f. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:21:01.432494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:21:01.435981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:21:01.477979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a5c7f862-1144-4f80-af51-2f63482b3e00 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:01.489834 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a5c7f862-1144-4f80-af51-2f63482b3e00 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1315 microversion: 2.1 time: 0.258103 Feb 19 21:21:01.490912 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2686/5289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:01 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:01.504578 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3125f4b4-80d7-4743-bedb-ea13b50fcc9a tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.034316 Feb 19 21:21:01.505665 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2604/5290] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:21:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:21:01.518695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7242416d-921f-4d33-8a32-480c749d3d20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:01.519668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7242416d-921f-4d33-8a32-480c749d3d20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:01.598244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7242416d-921f-4d33-8a32-480c749d3d20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:01.609425 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7242416d-921f-4d33-8a32-480c749d3d20 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1248 microversion: 2.1 time: 0.095657 Feb 19 21:21:01.619730 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2687/5291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:01 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1248 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:02.510377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-700669f7-0542-4506-b9c0-3ffe42c06913 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:02.511296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-700669f7-0542-4506-b9c0-3ffe42c06913 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:02.518214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-700669f7-0542-4506-b9c0-3ffe42c06913 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:02.518748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-700669f7-0542-4506-b9c0-3ffe42c06913 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:02.519632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-700669f7-0542-4506-b9c0-3ffe42c06913 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:02.520070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-700669f7-0542-4506-b9c0-3ffe42c06913 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:02.628145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-141facfd-71ea-4662-9e0f-3b9b6c5405e9 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:02.628957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-141facfd-71ea-4662-9e0f-3b9b6c5405e9 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:02.638410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-141facfd-71ea-4662-9e0f-3b9b6c5405e9 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:02.639489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-141facfd-71ea-4662-9e0f-3b9b6c5405e9 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:02.640320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-141facfd-71ea-4662-9e0f-3b9b6c5405e9 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:02.641021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-141facfd-71ea-4662-9e0f-3b9b6c5405e9 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:02.737119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-141facfd-71ea-4662-9e0f-3b9b6c5405e9 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:02.748974 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-141facfd-71ea-4662-9e0f-3b9b6c5405e9 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1300 microversion: 2.1 time: 0.125129 Feb 19 21:21:02.759883 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2688/5292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:02 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:02.778423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-700669f7-0542-4506-b9c0-3ffe42c06913 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:02.788205 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-700669f7-0542-4506-b9c0-3ffe42c06913 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1500 microversion: 2.1 time: 0.282794 Feb 19 21:21:02.801177 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2605/5293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:02 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1500 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:02.816890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e1f692b4-4ead-4029-b9a0-04e6e63efbc5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:02.818062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e1f692b4-4ead-4029-b9a0-04e6e63efbc5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:02.827661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1f692b4-4ead-4029-b9a0-04e6e63efbc5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:02.828212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1f692b4-4ead-4029-b9a0-04e6e63efbc5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:02.829089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1f692b4-4ead-4029-b9a0-04e6e63efbc5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:02.829687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e1f692b4-4ead-4029-b9a0-04e6e63efbc5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:03.408467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e1f692b4-4ead-4029-b9a0-04e6e63efbc5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:03.426407 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e1f692b4-4ead-4029-b9a0-04e6e63efbc5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1500 microversion: 2.1 time: 0.613055 Feb 19 21:21:03.437103 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2689/5294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:02 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1500 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:03.446099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-36611754-0b52-4978-8a51-962f30a66b68 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:03.446317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-36611754-0b52-4978-8a51-962f30a66b68 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:03.454395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36611754-0b52-4978-8a51-962f30a66b68 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:03.455058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36611754-0b52-4978-8a51-962f30a66b68 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:03.457363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36611754-0b52-4978-8a51-962f30a66b68 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:03.457848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-36611754-0b52-4978-8a51-962f30a66b68 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:03.485512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-36611754-0b52-4978-8a51-962f30a66b68 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lazy-loading 'flavor' on Instance uuid 8abc5b5f-df17-43c4-af14-e9f47a9f9234 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:21:03.597795 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-36611754-0b52-4978-8a51-962f30a66b68 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "POST /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234/action" status: 202 len: 0 microversion: 2.1 time: 0.155675 Feb 19 21:21:03.598890 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2606/5295] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:21:03 2022] POST /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:21:03.607366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4e9a93aa-96e3-4f42-851b-5df65b847ee5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:03.608144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4e9a93aa-96e3-4f42-851b-5df65b847ee5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:03.618043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e9a93aa-96e3-4f42-851b-5df65b847ee5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:03.618485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e9a93aa-96e3-4f42-851b-5df65b847ee5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:03.619926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e9a93aa-96e3-4f42-851b-5df65b847ee5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:03.620514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e9a93aa-96e3-4f42-851b-5df65b847ee5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:03.767317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1fb4f7af-d766-41cc-aadb-c14d6e0ddeb1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:03.768427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1fb4f7af-d766-41cc-aadb-c14d6e0ddeb1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:03.776698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fb4f7af-d766-41cc-aadb-c14d6e0ddeb1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:03.777267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fb4f7af-d766-41cc-aadb-c14d6e0ddeb1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:03.778287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fb4f7af-d766-41cc-aadb-c14d6e0ddeb1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:03.778838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fb4f7af-d766-41cc-aadb-c14d6e0ddeb1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:03.891157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1fb4f7af-d766-41cc-aadb-c14d6e0ddeb1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:03.900975 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1fb4f7af-d766-41cc-aadb-c14d6e0ddeb1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1306 microversion: 2.1 time: 0.138547 Feb 19 21:21:03.901895 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2607/5296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:03 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:03.930217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4e9a93aa-96e3-4f42-851b-5df65b847ee5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:03.936108 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4e9a93aa-96e3-4f42-851b-5df65b847ee5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1508 microversion: 2.1 time: 0.333298 Feb 19 21:21:03.940388 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2690/5297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:03 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1508 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:04.919260 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c5197a5e-05ab-4df3-a632-6fec078eda95 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:04.919885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c5197a5e-05ab-4df3-a632-6fec078eda95 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:04.936073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5197a5e-05ab-4df3-a632-6fec078eda95 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:04.936637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5197a5e-05ab-4df3-a632-6fec078eda95 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:04.940577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5197a5e-05ab-4df3-a632-6fec078eda95 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:04.940577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5197a5e-05ab-4df3-a632-6fec078eda95 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:04.956312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a0a47478-a17c-48ca-ba38-c8c7023c7ccf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:04.956965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a0a47478-a17c-48ca-ba38-c8c7023c7ccf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:04.974521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0a47478-a17c-48ca-ba38-c8c7023c7ccf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:04.974521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0a47478-a17c-48ca-ba38-c8c7023c7ccf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:04.974521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0a47478-a17c-48ca-ba38-c8c7023c7ccf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:04.974521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a0a47478-a17c-48ca-ba38-c8c7023c7ccf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:05.379110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a0a47478-a17c-48ca-ba38-c8c7023c7ccf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:05.387286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c5197a5e-05ab-4df3-a632-6fec078eda95 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:05.391157 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a0a47478-a17c-48ca-ba38-c8c7023c7ccf tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1491 microversion: 2.1 time: 0.438532 Feb 19 21:21:05.392312 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2691/5298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:04 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1491 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:05.399248 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c5197a5e-05ab-4df3-a632-6fec078eda95 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1374 microversion: 2.1 time: 0.482763 Feb 19 21:21:05.400472 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2608/5299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:04 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1374 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:05.413684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83e7b753-a85b-447f-916a-d812a123d872 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:05.414631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83e7b753-a85b-447f-916a-d812a123d872 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:05.422080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83e7b753-a85b-447f-916a-d812a123d872 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:05.423310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83e7b753-a85b-447f-916a-d812a123d872 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:05.424385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83e7b753-a85b-447f-916a-d812a123d872 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:05.425249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83e7b753-a85b-447f-916a-d812a123d872 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:05.601336 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83e7b753-a85b-447f-916a-d812a123d872 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "POST /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234/action" status: 202 len: 0 microversion: 2.1 time: 0.190074 Feb 19 21:21:05.608818 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2692/5300] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:21:05 2022] POST /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:21:05.623877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41d14e25-29ce-4b48-b875-50bda91802a4 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:05.625375 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41d14e25-29ce-4b48-b875-50bda91802a4 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:05.661193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41d14e25-29ce-4b48-b875-50bda91802a4 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:05.663893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41d14e25-29ce-4b48-b875-50bda91802a4 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:05.666152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41d14e25-29ce-4b48-b875-50bda91802a4 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:05.666870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41d14e25-29ce-4b48-b875-50bda91802a4 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:05.862766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c4639903-b1e5-449f-91d5-40d804c817f3 req-47ce24db-b2dd-4284-b0e0-48f1082f676f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7133b5f-c87f-411f-918a-7ac1c6634212", "tag": "63009b88-0f8a-4c79-8889-d2d3c647b428"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:05.864953 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:05.864953 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:21:05.877377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c4639903-b1e5-449f-91d5-40d804c817f3 req-47ce24db-b2dd-4284-b0e0-48f1082f676f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:05.878010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c4639903-b1e5-449f-91d5-40d804c817f3 req-47ce24db-b2dd-4284-b0e0-48f1082f676f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:05.892627 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c4639903-b1e5-449f-91d5-40d804c817f3 req-47ce24db-b2dd-4284-b0e0-48f1082f676f service nova] Creating event network-changed:63009b88-0f8a-4c79-8889-d2d3c647b428 for instance e7133b5f-c87f-411f-918a-7ac1c6634212 on nch1-master-1 Feb 19 21:21:05.900426 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c4639903-b1e5-449f-91d5-40d804c817f3 req-47ce24db-b2dd-4284-b0e0-48f1082f676f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413058 Feb 19 21:21:05.901736 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2609/5301] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:21:06.073333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-41d14e25-29ce-4b48-b875-50bda91802a4 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:06.084594 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41d14e25-29ce-4b48-b875-50bda91802a4 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1497 microversion: 2.1 time: 0.472846 Feb 19 21:21:06.085664 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2693/5302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:05 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1497 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:06.421533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-74124760-6059-477c-9582-15f1a7115b52 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:06.422635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-74124760-6059-477c-9582-15f1a7115b52 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:06.435084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74124760-6059-477c-9582-15f1a7115b52 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:06.436200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74124760-6059-477c-9582-15f1a7115b52 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:06.437415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74124760-6059-477c-9582-15f1a7115b52 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:06.437898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-74124760-6059-477c-9582-15f1a7115b52 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:06.870268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-74124760-6059-477c-9582-15f1a7115b52 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:06.881890 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-74124760-6059-477c-9582-15f1a7115b52 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1374 microversion: 2.1 time: 0.466646 Feb 19 21:21:06.882851 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2610/5303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:06 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1374 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:07.108689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0bc0d91c-4c7e-4531-aa86-4e21c4841815 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:07.110043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0bc0d91c-4c7e-4531-aa86-4e21c4841815 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:07.116526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0bc0d91c-4c7e-4531-aa86-4e21c4841815 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:07.116993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0bc0d91c-4c7e-4531-aa86-4e21c4841815 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:07.117803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0bc0d91c-4c7e-4531-aa86-4e21c4841815 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:07.118277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0bc0d91c-4c7e-4531-aa86-4e21c4841815 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:07.291695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0bc0d91c-4c7e-4531-aa86-4e21c4841815 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:07.301168 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0bc0d91c-4c7e-4531-aa86-4e21c4841815 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1497 microversion: 2.1 time: 0.195986 Feb 19 21:21:07.301969 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2694/5304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:07 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:07.900362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d767f018-84e3-471c-93c9-76b62da18565 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:07.901252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d767f018-84e3-471c-93c9-76b62da18565 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:07.909805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d767f018-84e3-471c-93c9-76b62da18565 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:07.910333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d767f018-84e3-471c-93c9-76b62da18565 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:07.911470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d767f018-84e3-471c-93c9-76b62da18565 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:07.912130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d767f018-84e3-471c-93c9-76b62da18565 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:08.112655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d767f018-84e3-471c-93c9-76b62da18565 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:08.123000 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d767f018-84e3-471c-93c9-76b62da18565 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1374 microversion: 2.1 time: 0.226972 Feb 19 21:21:08.123868 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2611/5305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:07 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1374 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:08.322780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-db0602ae-e40b-47af-8e57-f8150e828336 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:08.324579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-db0602ae-e40b-47af-8e57-f8150e828336 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:08.333103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db0602ae-e40b-47af-8e57-f8150e828336 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:08.333628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db0602ae-e40b-47af-8e57-f8150e828336 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:08.334514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db0602ae-e40b-47af-8e57-f8150e828336 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:08.335018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-db0602ae-e40b-47af-8e57-f8150e828336 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:08.509670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-db0602ae-e40b-47af-8e57-f8150e828336 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:08.521126 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-db0602ae-e40b-47af-8e57-f8150e828336 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1500 microversion: 2.1 time: 0.202650 Feb 19 21:21:08.521871 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2695/5306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:08 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1500 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:08.541918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9cae9963-d235-48be-b7da-84e22f287dc3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:08.542663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9cae9963-d235-48be-b7da-84e22f287dc3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:08.548987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cae9963-d235-48be-b7da-84e22f287dc3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:08.549646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cae9963-d235-48be-b7da-84e22f287dc3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:08.550864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cae9963-d235-48be-b7da-84e22f287dc3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:08.551410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cae9963-d235-48be-b7da-84e22f287dc3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:08.590967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-9cae9963-d235-48be-b7da-84e22f287dc3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lazy-loading 'flavor' on Instance uuid 8abc5b5f-df17-43c4-af14-e9f47a9f9234 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:21:08.691994 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9cae9963-d235-48be-b7da-84e22f287dc3 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "POST /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234/action" status: 202 len: 0 microversion: 2.1 time: 0.154506 Feb 19 21:21:08.693596 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2612/5307] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:21:08 2022] POST /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:21:08.707681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6cb2b612-634f-4b3d-a3a6-5c705ff0c3ef tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:08.709218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6cb2b612-634f-4b3d-a3a6-5c705ff0c3ef tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:08.725900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cb2b612-634f-4b3d-a3a6-5c705ff0c3ef tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:08.726720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cb2b612-634f-4b3d-a3a6-5c705ff0c3ef tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:08.729095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cb2b612-634f-4b3d-a3a6-5c705ff0c3ef tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:08.730055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cb2b612-634f-4b3d-a3a6-5c705ff0c3ef tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:08.929244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6cb2b612-634f-4b3d-a3a6-5c705ff0c3ef tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:08.937107 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6cb2b612-634f-4b3d-a3a6-5c705ff0c3ef tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1508 microversion: 2.1 time: 0.237851 Feb 19 21:21:08.937789 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2696/5308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:08 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:09.143244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f7ae74c1-9e7d-4684-9173-5a7ad8363ddf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:09.144083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f7ae74c1-9e7d-4684-9173-5a7ad8363ddf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:09.151086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7ae74c1-9e7d-4684-9173-5a7ad8363ddf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:09.151683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7ae74c1-9e7d-4684-9173-5a7ad8363ddf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:09.152603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7ae74c1-9e7d-4684-9173-5a7ad8363ddf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:09.153093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7ae74c1-9e7d-4684-9173-5a7ad8363ddf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:09.341429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f7ae74c1-9e7d-4684-9173-5a7ad8363ddf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:09.350526 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f7ae74c1-9e7d-4684-9173-5a7ad8363ddf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1374 microversion: 2.1 time: 0.212633 Feb 19 21:21:09.351192 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2613/5309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:09 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:09.957196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fc28f648-124d-43f3-a791-bec44931c847 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:09.957763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fc28f648-124d-43f3-a791-bec44931c847 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:09.966845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc28f648-124d-43f3-a791-bec44931c847 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:09.967260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc28f648-124d-43f3-a791-bec44931c847 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:09.968077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc28f648-124d-43f3-a791-bec44931c847 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:09.968835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc28f648-124d-43f3-a791-bec44931c847 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:10.148180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fc28f648-124d-43f3-a791-bec44931c847 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:10.157433 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fc28f648-124d-43f3-a791-bec44931c847 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1491 microversion: 2.1 time: 0.205782 Feb 19 21:21:10.159168 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2697/5310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:09 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1491 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:10.180752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11bf89cb-69c1-4998-8eec-363f55436335 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:10.182751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11bf89cb-69c1-4998-8eec-363f55436335 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:10.189062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11bf89cb-69c1-4998-8eec-363f55436335 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:10.189554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11bf89cb-69c1-4998-8eec-363f55436335 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:10.190325 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11bf89cb-69c1-4998-8eec-363f55436335 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:10.190860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11bf89cb-69c1-4998-8eec-363f55436335 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:10.278535 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11bf89cb-69c1-4998-8eec-363f55436335 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "POST /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234/action" status: 202 len: 0 microversion: 2.1 time: 0.101455 Feb 19 21:21:10.282862 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2614/5311] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:21:10 2022] POST /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:21:10.289318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2355f6d0-83f6-4727-8087-2f42b6eb26f1 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:10.291069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2355f6d0-83f6-4727-8087-2f42b6eb26f1 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:10.299000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2355f6d0-83f6-4727-8087-2f42b6eb26f1 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:10.299462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2355f6d0-83f6-4727-8087-2f42b6eb26f1 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:10.300461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2355f6d0-83f6-4727-8087-2f42b6eb26f1 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:10.300917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2355f6d0-83f6-4727-8087-2f42b6eb26f1 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:10.370859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9d1c7229-0426-4e0a-9dd0-77c4a73124dc tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:10.371654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9d1c7229-0426-4e0a-9dd0-77c4a73124dc tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:10.385371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d1c7229-0426-4e0a-9dd0-77c4a73124dc tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:10.385835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d1c7229-0426-4e0a-9dd0-77c4a73124dc tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:10.386844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d1c7229-0426-4e0a-9dd0-77c4a73124dc tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:10.387462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d1c7229-0426-4e0a-9dd0-77c4a73124dc tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:10.520872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2355f6d0-83f6-4727-8087-2f42b6eb26f1 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:10.532967 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2355f6d0-83f6-4727-8087-2f42b6eb26f1 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1497 microversion: 2.1 time: 0.247868 Feb 19 21:21:10.535445 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2698/5312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:10 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:10.632925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9d1c7229-0426-4e0a-9dd0-77c4a73124dc tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:10.644505 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9d1c7229-0426-4e0a-9dd0-77c4a73124dc tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1374 microversion: 2.1 time: 0.278818 Feb 19 21:21:10.645491 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2615/5313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:10 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1374 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:11.553860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d1f8f247-c5c7-48c5-a193-7a3584b83e18 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:11.554740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d1f8f247-c5c7-48c5-a193-7a3584b83e18 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:11.567315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1f8f247-c5c7-48c5-a193-7a3584b83e18 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:11.568130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1f8f247-c5c7-48c5-a193-7a3584b83e18 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:11.569643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1f8f247-c5c7-48c5-a193-7a3584b83e18 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:11.570335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1f8f247-c5c7-48c5-a193-7a3584b83e18 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:11.666231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-646ed69d-6ed7-4da7-9e1f-7fd298663d35 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:11.667581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-646ed69d-6ed7-4da7-9e1f-7fd298663d35 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:11.674605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-646ed69d-6ed7-4da7-9e1f-7fd298663d35 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:11.675453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-646ed69d-6ed7-4da7-9e1f-7fd298663d35 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:11.676594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-646ed69d-6ed7-4da7-9e1f-7fd298663d35 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:11.677328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-646ed69d-6ed7-4da7-9e1f-7fd298663d35 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:11.816959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d1f8f247-c5c7-48c5-a193-7a3584b83e18 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:11.826462 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d1f8f247-c5c7-48c5-a193-7a3584b83e18 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1497 microversion: 2.1 time: 0.276039 Feb 19 21:21:11.827228 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2699/5314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:11 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:11.899598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-646ed69d-6ed7-4da7-9e1f-7fd298663d35 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:11.909054 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-646ed69d-6ed7-4da7-9e1f-7fd298663d35 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1374 microversion: 2.1 time: 0.248353 Feb 19 21:21:11.909698 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2616/5315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:11 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1374 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:12.853652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e34b8748-50b4-49ce-93e8-df24f97f55d7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:12.855054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e34b8748-50b4-49ce-93e8-df24f97f55d7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:12.870819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e34b8748-50b4-49ce-93e8-df24f97f55d7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:12.872128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e34b8748-50b4-49ce-93e8-df24f97f55d7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:12.873588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e34b8748-50b4-49ce-93e8-df24f97f55d7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:12.874307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e34b8748-50b4-49ce-93e8-df24f97f55d7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:12.914427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f440ea69-bbdb-400e-a2aa-b07f4fc699f9 req-190724be-3ddf-4495-aff4-c7d420fccb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7133b5f-c87f-411f-918a-7ac1c6634212", "name": "network-vif-plugged", "status": "completed", "tag": "63009b88-0f8a-4c79-8889-d2d3c647b428"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:12.916120 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:12.916120 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:21:12.933241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f440ea69-bbdb-400e-a2aa-b07f4fc699f9 req-190724be-3ddf-4495-aff4-c7d420fccb80 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:12.935728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f440ea69-bbdb-400e-a2aa-b07f4fc699f9 req-190724be-3ddf-4495-aff4-c7d420fccb80 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:12.955624 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f440ea69-bbdb-400e-a2aa-b07f4fc699f9 req-190724be-3ddf-4495-aff4-c7d420fccb80 service nova] Creating event network-vif-plugged:63009b88-0f8a-4c79-8889-d2d3c647b428 for instance e7133b5f-c87f-411f-918a-7ac1c6634212 on nch1-master-1 Feb 19 21:21:12.961162 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f440ea69-bbdb-400e-a2aa-b07f4fc699f9 req-190724be-3ddf-4495-aff4-c7d420fccb80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050712 Feb 19 21:21:12.962086 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2617/5316] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:21:12.973231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cf947d1a-fd32-4977-903d-d3ebd4252b1f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:12.974455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cf947d1a-fd32-4977-903d-d3ebd4252b1f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:12.985785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf947d1a-fd32-4977-903d-d3ebd4252b1f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:12.986399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf947d1a-fd32-4977-903d-d3ebd4252b1f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:12.988900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf947d1a-fd32-4977-903d-d3ebd4252b1f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:12.989620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cf947d1a-fd32-4977-903d-d3ebd4252b1f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:13.222948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e34b8748-50b4-49ce-93e8-df24f97f55d7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:13.232675 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e34b8748-50b4-49ce-93e8-df24f97f55d7 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1500 microversion: 2.1 time: 0.389776 Feb 19 21:21:13.233359 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2700/5317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:12 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1500 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:13.251615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a4e19fdf-8a69-4d23-9608-9c51bb2d17c5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:13.252265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a4e19fdf-8a69-4d23-9608-9c51bb2d17c5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:13.260220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4e19fdf-8a69-4d23-9608-9c51bb2d17c5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:13.260912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4e19fdf-8a69-4d23-9608-9c51bb2d17c5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:13.261812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4e19fdf-8a69-4d23-9608-9c51bb2d17c5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:13.262288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a4e19fdf-8a69-4d23-9608-9c51bb2d17c5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:13.294684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a4e19fdf-8a69-4d23-9608-9c51bb2d17c5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:21:13.322176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cf947d1a-fd32-4977-903d-d3ebd4252b1f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:13.335187 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cf947d1a-fd32-4977-903d-d3ebd4252b1f tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1374 microversion: 2.1 time: 0.370866 Feb 19 21:21:13.335796 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2618/5318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:12 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1374 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:13.410237 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a4e19fdf-8a69-4d23-9608-9c51bb2d17c5 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 204 len: 0 microversion: 2.1 time: 0.161884 Feb 19 21:21:13.411614 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2701/5319] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:21:13 2022] DELETE /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:21:13.421179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f35976ca-7eec-4c25-8bcf-c310675c21b9 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:13.421879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f35976ca-7eec-4c25-8bcf-c310675c21b9 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:13.429342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f35976ca-7eec-4c25-8bcf-c310675c21b9 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:13.429812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f35976ca-7eec-4c25-8bcf-c310675c21b9 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:13.430856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f35976ca-7eec-4c25-8bcf-c310675c21b9 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:13.432081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f35976ca-7eec-4c25-8bcf-c310675c21b9 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:13.587560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f35976ca-7eec-4c25-8bcf-c310675c21b9 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:13.599374 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f35976ca-7eec-4c25-8bcf-c310675c21b9 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1506 microversion: 2.1 time: 0.182217 Feb 19 21:21:13.600118 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2619/5320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:13 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:14.353437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-75c6b2d8-7084-4a4c-96cd-580b55a41577 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:14.354458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-75c6b2d8-7084-4a4c-96cd-580b55a41577 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:14.362653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75c6b2d8-7084-4a4c-96cd-580b55a41577 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:14.363115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75c6b2d8-7084-4a4c-96cd-580b55a41577 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:14.364017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75c6b2d8-7084-4a4c-96cd-580b55a41577 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:14.364503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75c6b2d8-7084-4a4c-96cd-580b55a41577 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:14.528897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-75c6b2d8-7084-4a4c-96cd-580b55a41577 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:14.539401 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-75c6b2d8-7084-4a4c-96cd-580b55a41577 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1546 microversion: 2.1 time: 0.190213 Feb 19 21:21:14.540065 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2702/5321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:14 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:14.557011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e10bbee3-daff-4be8-84b3-408548856d93 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:14.557624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e10bbee3-daff-4be8-84b3-408548856d93 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:14.564793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e10bbee3-daff-4be8-84b3-408548856d93 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:14.565248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e10bbee3-daff-4be8-84b3-408548856d93 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:14.566122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e10bbee3-daff-4be8-84b3-408548856d93 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:14.566640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e10bbee3-daff-4be8-84b3-408548856d93 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:14.620813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7d710ed5-9397-4e86-b1ff-b119c2d3821c tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:14.621436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7d710ed5-9397-4e86-b1ff-b119c2d3821c tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:14.628708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d710ed5-9397-4e86-b1ff-b119c2d3821c tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:14.629513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d710ed5-9397-4e86-b1ff-b119c2d3821c tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:14.631042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d710ed5-9397-4e86-b1ff-b119c2d3821c tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:14.631042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d710ed5-9397-4e86-b1ff-b119c2d3821c tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:14.751745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e10bbee3-daff-4be8-84b3-408548856d93 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:14.766988 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e10bbee3-daff-4be8-84b3-408548856d93 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1546 microversion: 2.1 time: 0.213786 Feb 19 21:21:14.768122 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2620/5322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:14 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1546 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:14.874999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7d710ed5-9397-4e86-b1ff-b119c2d3821c tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:14.888635 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7d710ed5-9397-4e86-b1ff-b119c2d3821c tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1506 microversion: 2.1 time: 0.268681 Feb 19 21:21:14.888635 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2703/5323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:14 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:15.908015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9fa5c424-beea-4985-a073-b6cf808b5c36 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:15.909043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9fa5c424-beea-4985-a073-b6cf808b5c36 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:15.916477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fa5c424-beea-4985-a073-b6cf808b5c36 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:15.916931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fa5c424-beea-4985-a073-b6cf808b5c36 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:15.917908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fa5c424-beea-4985-a073-b6cf808b5c36 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:15.918508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9fa5c424-beea-4985-a073-b6cf808b5c36 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:16.167396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ab3cb9e8-8808-4c01-9bc9-c9602e143cc4 req-ceabfa63-232d-4638-a94f-e727bf185320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8abc5b5f-df17-43c4-af14-e9f47a9f9234", "name": "network-vif-deleted", "tag": "177dcc51-f1b3-422d-be43-aa6cfc1b0319"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:16.175199 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:16.175199 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:21:16.191652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ab3cb9e8-8808-4c01-9bc9-c9602e143cc4 req-ceabfa63-232d-4638-a94f-e727bf185320 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:16.192104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ab3cb9e8-8808-4c01-9bc9-c9602e143cc4 req-ceabfa63-232d-4638-a94f-e727bf185320 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:16.205050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9fa5c424-beea-4985-a073-b6cf808b5c36 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75acfc9921fc44bb8b307616ae5da163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f355422bbc4a402597f285f02ca85a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:16.209069 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ab3cb9e8-8808-4c01-9bc9-c9602e143cc4 req-ceabfa63-232d-4638-a94f-e727bf185320 service nova] Creating event network-vif-deleted:177dcc51-f1b3-422d-be43-aa6cfc1b0319 for instance 8abc5b5f-df17-43c4-af14-e9f47a9f9234 on nch2-master-1 Feb 19 21:21:16.227583 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ab3cb9e8-8808-4c01-9bc9-c9602e143cc4 req-ceabfa63-232d-4638-a94f-e727bf185320 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063665 Feb 19 21:21:16.235782 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2704/5324] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:21:16.236699 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9fa5c424-beea-4985-a073-b6cf808b5c36 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 200 len: 1506 microversion: 2.1 time: 0.332295 Feb 19 21:21:16.237455 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2621/5325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:15 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:17.255789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ca53107d-df7e-4fd9-a15e-6bc453bddc11 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:17.256911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ca53107d-df7e-4fd9-a15e-6bc453bddc11 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] [instance: 8abc5b5f-df17-43c4-af14-e9f47a9f9234] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:17.264960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca53107d-df7e-4fd9-a15e-6bc453bddc11 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:17.265496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca53107d-df7e-4fd9-a15e-6bc453bddc11 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:17.266317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca53107d-df7e-4fd9-a15e-6bc453bddc11 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:17.266952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca53107d-df7e-4fd9-a15e-6bc453bddc11 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:17.286808 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ca53107d-df7e-4fd9-a15e-6bc453bddc11 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] HTTP exception thrown: Instance 8abc5b5f-df17-43c4-af14-e9f47a9f9234 could not be found. Feb 19 21:21:17.287723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ca53107d-df7e-4fd9-a15e-6bc453bddc11 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] Returning 404 to user: Instance 8abc5b5f-df17-43c4-af14-e9f47a9f9234 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:21:17.288883 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ca53107d-df7e-4fd9-a15e-6bc453bddc11 tempest-TestServerAdvancedOps-2071055032 tempest-TestServerAdvancedOps-2071055032-project] 10.222.0.30 "GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234" status: 404 len: 111 microversion: 2.1 time: 0.038159 Feb 19 21:21:17.289650 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2705/5326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:17 2022] GET /compute/v2.1/servers/8abc5b5f-df17-43c4-af14-e9f47a9f9234 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:21:17.426911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8320bc88-6944-4018-8996-5eaf95255e1b req-99e2d494-b61b-44b1-9694-2d12a6af0ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7133b5f-c87f-411f-918a-7ac1c6634212", "tag": "63009b88-0f8a-4c79-8889-d2d3c647b428"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:17.428669 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:17.428669 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:21:17.447676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8320bc88-6944-4018-8996-5eaf95255e1b req-99e2d494-b61b-44b1-9694-2d12a6af0ef1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:17.448145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8320bc88-6944-4018-8996-5eaf95255e1b req-99e2d494-b61b-44b1-9694-2d12a6af0ef1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:17.486002 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8320bc88-6944-4018-8996-5eaf95255e1b req-99e2d494-b61b-44b1-9694-2d12a6af0ef1 service nova] Creating event network-changed:63009b88-0f8a-4c79-8889-d2d3c647b428 for instance e7133b5f-c87f-411f-918a-7ac1c6634212 on nch1-master-1 Feb 19 21:21:17.496115 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8320bc88-6944-4018-8996-5eaf95255e1b req-99e2d494-b61b-44b1-9694-2d12a6af0ef1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072805 Feb 19 21:21:17.497901 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2622/5327] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:21:28.296609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7612b054-2988-481f-9d7f-3757c1c995e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:28.297236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7612b054-2988-481f-9d7f-3757c1c995e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:28.304234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7612b054-2988-481f-9d7f-3757c1c995e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:28.304753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7612b054-2988-481f-9d7f-3757c1c995e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:28.305651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7612b054-2988-481f-9d7f-3757c1c995e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:28.306741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7612b054-2988-481f-9d7f-3757c1c995e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:28.341890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7612b054-2988-481f-9d7f-3757c1c995e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:21:28.461917 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7612b054-2988-481f-9d7f-3757c1c995e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 204 len: 0 microversion: 2.1 time: 0.168201 Feb 19 21:21:28.462918 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2706/5328] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:21:28 2022] DELETE /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:21:28.473349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c5926799-3163-453d-afaf-93f95bc51037 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:28.473999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c5926799-3163-453d-afaf-93f95bc51037 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:28.482217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5926799-3163-453d-afaf-93f95bc51037 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:28.483528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5926799-3163-453d-afaf-93f95bc51037 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:28.484618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5926799-3163-453d-afaf-93f95bc51037 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:28.485273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5926799-3163-453d-afaf-93f95bc51037 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:28.674852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c5926799-3163-453d-afaf-93f95bc51037 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:28.683977 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c5926799-3163-453d-afaf-93f95bc51037 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1410 microversion: 2.1 time: 0.215869 Feb 19 21:21:28.685190 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2623/5329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:28 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1410 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:29.705440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-94c13fde-6a07-443a-8bfa-a940801130ab tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:29.706307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-94c13fde-6a07-443a-8bfa-a940801130ab tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:29.714117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94c13fde-6a07-443a-8bfa-a940801130ab tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:29.714572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94c13fde-6a07-443a-8bfa-a940801130ab tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:29.715483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94c13fde-6a07-443a-8bfa-a940801130ab tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:29.716013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94c13fde-6a07-443a-8bfa-a940801130ab tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:29.886520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-94c13fde-6a07-443a-8bfa-a940801130ab tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:29.896320 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-94c13fde-6a07-443a-8bfa-a940801130ab tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1410 microversion: 2.1 time: 0.196388 Feb 19 21:21:29.897311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2707/5330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:29 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1410 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:30.893512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c2607496-4280-43c1-a82a-6506a1b27b44 req-6e003d90-7211-43a5-baf1-cd0a816886bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e04ff43-f955-4862-8ef9-abc8fd3d42f1", "name": "network-vif-deleted", "tag": "ba67d66f-db64-4254-bc12-c3652b12e977"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:30.898117 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:30.898117 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:21:30.912583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c2607496-4280-43c1-a82a-6506a1b27b44 req-6e003d90-7211-43a5-baf1-cd0a816886bf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:30.914079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c2607496-4280-43c1-a82a-6506a1b27b44 req-6e003d90-7211-43a5-baf1-cd0a816886bf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:30.930817 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c2607496-4280-43c1-a82a-6506a1b27b44 req-6e003d90-7211-43a5-baf1-cd0a816886bf service nova] Creating event network-vif-deleted:ba67d66f-db64-4254-bc12-c3652b12e977 for instance 6e04ff43-f955-4862-8ef9-abc8fd3d42f1 on nch2-master-1 Feb 19 21:21:30.936303 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c2607496-4280-43c1-a82a-6506a1b27b44 req-6e003d90-7211-43a5-baf1-cd0a816886bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051919 Feb 19 21:21:30.937554 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2708/5331] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:21:30.947796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-583044c3-d7dd-499e-a06b-1ac6c0700ccf tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:30.948846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-583044c3-d7dd-499e-a06b-1ac6c0700ccf tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:30.955968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-583044c3-d7dd-499e-a06b-1ac6c0700ccf tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:30.956740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-583044c3-d7dd-499e-a06b-1ac6c0700ccf tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:30.958031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-583044c3-d7dd-499e-a06b-1ac6c0700ccf tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:30.958644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-583044c3-d7dd-499e-a06b-1ac6c0700ccf tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:31.036902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-583044c3-d7dd-499e-a06b-1ac6c0700ccf tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:31.048130 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-583044c3-d7dd-499e-a06b-1ac6c0700ccf tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 200 len: 1202 microversion: 2.1 time: 0.104777 Feb 19 21:21:31.048860 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2709/5332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:30 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:31.101849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a822d77-7c2b-4423-b769-77f35cd7c104 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'create', calling method: .version_select at 0x7f6466aa2940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1696605057"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:31.116939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5a822d77-7c2b-4423-b769-77f35cd7c104 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:21:31.123352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5a822d77-7c2b-4423-b769-77f35cd7c104 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:21:31.521572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5a822d77-7c2b-4423-b769-77f35cd7c104 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:21:31.528522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-5a822d77-7c2b-4423-b769-77f35cd7c104 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:21:31.548456 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5a822d77-7c2b-4423-b769-77f35cd7c104 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.684856 Feb 19 21:21:31.549388 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2624/5333] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:21:30 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:32.071953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-444a6d4f-1920-4e3c-85e5-99593e5a6cde tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:32.072638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-444a6d4f-1920-4e3c-85e5-99593e5a6cde tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:32.079779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-444a6d4f-1920-4e3c-85e5-99593e5a6cde tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:32.080249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-444a6d4f-1920-4e3c-85e5-99593e5a6cde tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:32.081108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-444a6d4f-1920-4e3c-85e5-99593e5a6cde tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:32.081563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-444a6d4f-1920-4e3c-85e5-99593e5a6cde tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:32.099559 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-444a6d4f-1920-4e3c-85e5-99593e5a6cde tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 6e04ff43-f955-4862-8ef9-abc8fd3d42f1 could not be found. Feb 19 21:21:32.100181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-444a6d4f-1920-4e3c-85e5-99593e5a6cde tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 6e04ff43-f955-4862-8ef9-abc8fd3d42f1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:21:32.101075 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-444a6d4f-1920-4e3c-85e5-99593e5a6cde tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 404 len: 111 microversion: 2.1 time: 0.033161 Feb 19 21:21:32.101682 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2710/5334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:32 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:21:33.194346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb5a3fd7-412c-4d58-bbf6-1f980325aa5c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:33.195148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb5a3fd7-412c-4d58-bbf6-1f980325aa5c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:33.203371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5a3fd7-412c-4d58-bbf6-1f980325aa5c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:33.204051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5a3fd7-412c-4d58-bbf6-1f980325aa5c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:33.204903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5a3fd7-412c-4d58-bbf6-1f980325aa5c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:33.205565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb5a3fd7-412c-4d58-bbf6-1f980325aa5c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:33.220015 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-cb5a3fd7-412c-4d58-bbf6-1f980325aa5c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 5d6f3168-96da-4bff-b09b-954c091e9c60 could not be found. Feb 19 21:21:33.220718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb5a3fd7-412c-4d58-bbf6-1f980325aa5c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 5d6f3168-96da-4bff-b09b-954c091e9c60 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:21:33.221564 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb5a3fd7-412c-4d58-bbf6-1f980325aa5c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 404 len: 111 microversion: 2.1 time: 0.032162 Feb 19 21:21:33.222146 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2625/5335] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:21:33 2022] DELETE /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:21:33.230867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-63b4c9b3-8ad6-4b94-a758-d3ab99e06c43 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:33.231499 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-63b4c9b3-8ad6-4b94-a758-d3ab99e06c43 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 5d6f3168-96da-4bff-b09b-954c091e9c60] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:33.238845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63b4c9b3-8ad6-4b94-a758-d3ab99e06c43 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:33.239421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63b4c9b3-8ad6-4b94-a758-d3ab99e06c43 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:33.240245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63b4c9b3-8ad6-4b94-a758-d3ab99e06c43 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:33.240724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-63b4c9b3-8ad6-4b94-a758-d3ab99e06c43 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:33.256469 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-63b4c9b3-8ad6-4b94-a758-d3ab99e06c43 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 5d6f3168-96da-4bff-b09b-954c091e9c60 could not be found. Feb 19 21:21:33.257162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-63b4c9b3-8ad6-4b94-a758-d3ab99e06c43 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 5d6f3168-96da-4bff-b09b-954c091e9c60 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:21:33.258012 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-63b4c9b3-8ad6-4b94-a758-d3ab99e06c43 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60" status: 404 len: 111 microversion: 2.1 time: 0.031390 Feb 19 21:21:33.258595 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2711/5336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:33 2022] GET /compute/v2.1/servers/5d6f3168-96da-4bff-b09b-954c091e9c60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:21:33.858091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc344e08-1780-4b3a-b7f4-1648b5751002 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:33.858754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc344e08-1780-4b3a-b7f4-1648b5751002 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:33.865119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc344e08-1780-4b3a-b7f4-1648b5751002 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:33.865735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc344e08-1780-4b3a-b7f4-1648b5751002 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:33.866762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc344e08-1780-4b3a-b7f4-1648b5751002 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:33.867336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc344e08-1780-4b3a-b7f4-1648b5751002 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:33.882317 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-fc344e08-1780-4b3a-b7f4-1648b5751002 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 6e04ff43-f955-4862-8ef9-abc8fd3d42f1 could not be found. Feb 19 21:21:33.883029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc344e08-1780-4b3a-b7f4-1648b5751002 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 6e04ff43-f955-4862-8ef9-abc8fd3d42f1 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:21:33.884026 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc344e08-1780-4b3a-b7f4-1648b5751002 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 404 len: 111 microversion: 2.1 time: 0.029806 Feb 19 21:21:33.884700 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2626/5337] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:21:33 2022] DELETE /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:21:33.892937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b0cd2ea8-f915-4395-bad9-60bc50bec081 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:33.893660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b0cd2ea8-f915-4395-bad9-60bc50bec081 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 6e04ff43-f955-4862-8ef9-abc8fd3d42f1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:33.900916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0cd2ea8-f915-4395-bad9-60bc50bec081 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:33.901478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0cd2ea8-f915-4395-bad9-60bc50bec081 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:33.902354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0cd2ea8-f915-4395-bad9-60bc50bec081 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:33.902895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0cd2ea8-f915-4395-bad9-60bc50bec081 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:33.918600 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-b0cd2ea8-f915-4395-bad9-60bc50bec081 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 6e04ff43-f955-4862-8ef9-abc8fd3d42f1 could not be found. Feb 19 21:21:33.919213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b0cd2ea8-f915-4395-bad9-60bc50bec081 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 6e04ff43-f955-4862-8ef9-abc8fd3d42f1 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:21:33.920140 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b0cd2ea8-f915-4395-bad9-60bc50bec081 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1" status: 404 len: 111 microversion: 2.1 time: 0.030946 Feb 19 21:21:33.920677 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2712/5338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:33 2022] GET /compute/v2.1/servers/6e04ff43-f955-4862-8ef9-abc8fd3d42f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:21:33.992195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-49b5b2b4-c63b-4964-8b23-65a4fced80a4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Action: 'create', calling method: .version_select at 0x7f6466b304c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1930550294"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:34.006996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-49b5b2b4-c63b-4964-8b23-65a4fced80a4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for project c88a055c429b4b9e8e86a370c8571785. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:21:34.017376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-49b5b2b4-c63b-4964-8b23-65a4fced80a4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for user 2af13ad54ab048d495e5ff0c0453abb2 and project c88a055c429b4b9e8e86a370c8571785. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:21:34.202279 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-49b5b2b4-c63b-4964-8b23-65a4fced80a4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for project c88a055c429b4b9e8e86a370c8571785. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:21:34.208006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-49b5b2b4-c63b-4964-8b23-65a4fced80a4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for user 2af13ad54ab048d495e5ff0c0453abb2 and project c88a055c429b4b9e8e86a370c8571785. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:21:34.224490 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-49b5b2b4-c63b-4964-8b23-65a4fced80a4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.240791 Feb 19 21:21:34.225420 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2627/5339] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:21:33 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:38.483264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-914932951", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "478f03e6-ce0b-4708-a33c-7f6449556dee"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1696605057", "security_groups": [{"name": "tempest-secgroup-smoke-1598191253"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:38.534297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-929973358", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1930550294", "security_groups": [{"name": "tempest-secgroup-smoke-124469932"}], "block_device_mapping_v2": [{"uuid": "f7b8b771-4b05-452c-b7b9-907ea4593f17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aea80e2c-9b0e-4c05-b6af-09dfa51c0b19"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:38.656479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] validate_networks() for [('478f03e6-ce0b-4708-a33c-7f6449556dee', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:21:38.766526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] validate_networks() for [('aea80e2c-9b0e-4c05-b6af-09dfa51c0b19', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:21:39.458291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:21:39.458918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:21:39.459591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:21:39.460166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:21:39.460938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:21:39.491529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:39.492749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:39.493840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:39.494454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:39.514857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:21:39.520965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:21:39.536123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:21:39.538896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:21:39.570130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:21:39.570747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:21:39.571977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:21:39.572578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:21:39.573410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:21:39.592293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:39.593259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:39.594813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:39.595641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:39.625398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:21:39.632292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for user 2af13ad54ab048d495e5ff0c0453abb2 and project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:21:39.641684 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0d716289-9ee0-45dd-949d-49185fb1314d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.164994 Feb 19 21:21:39.642698 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2713/5340] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:21:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:21:39.656742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f84d424-9033-4bba-a715-9560fcb20633 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:39.657474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f84d424-9033-4bba-a715-9560fcb20633 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:39.742363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f84d424-9033-4bba-a715-9560fcb20633 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:39.754920 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f84d424-9033-4bba-a715-9560fcb20633 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1266 microversion: 2.1 time: 0.105367 Feb 19 21:21:39.756027 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2714/5341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:39 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:39.759428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:21:39.763970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7b8b771-4b05-452c-b7b9-907ea4593f17',volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:21:39.890673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-42721b43-5157-4bc3-8095-2f7b38789998 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:39.891721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-42721b43-5157-4bc3-8095-2f7b38789998 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:39.917560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42721b43-5157-4bc3-8095-2f7b38789998 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:39.918035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42721b43-5157-4bc3-8095-2f7b38789998 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:39.919048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42721b43-5157-4bc3-8095-2f7b38789998 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:39.919660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42721b43-5157-4bc3-8095-2f7b38789998 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:39.991438 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-42721b43-5157-4bc3-8095-2f7b38789998 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "POST /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212/action" status: 200 len: 24575 microversion: 2.1 time: 0.102760 Feb 19 21:21:39.992209 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2715/5342] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:21:39 2022] POST /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212/action => generated 24575 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 21:21:40.030074 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4b2ae6fa-aabb-492b-8767-71e0843c5fc3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.500504 Feb 19 21:21:40.036854 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2628/5343] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:21:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:21:40.048607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad54e10e-e274-424f-a240-82d0d3a6214f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:40.049545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ad54e10e-e274-424f-a240-82d0d3a6214f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:40.170172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ad54e10e-e274-424f-a240-82d0d3a6214f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:40.185347 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ad54e10e-e274-424f-a240-82d0d3a6214f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1094 microversion: 2.1 time: 0.140655 Feb 19 21:21:40.196986 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2716/5344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:40 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1094 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:40.791840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c48da604-db01-4d16-8ba6-ea450d5a36ef tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:40.794047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c48da604-db01-4d16-8ba6-ea450d5a36ef tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:40.806276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c48da604-db01-4d16-8ba6-ea450d5a36ef tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:40.807165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c48da604-db01-4d16-8ba6-ea450d5a36ef tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:40.808295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c48da604-db01-4d16-8ba6-ea450d5a36ef tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:40.809003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c48da604-db01-4d16-8ba6-ea450d5a36ef tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:40.903556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c48da604-db01-4d16-8ba6-ea450d5a36ef tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:40.916561 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c48da604-db01-4d16-8ba6-ea450d5a36ef tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1318 microversion: 2.1 time: 0.131523 Feb 19 21:21:40.917220 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2629/5345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:40 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1318 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:41.209679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8bb28307-dff6-421c-88c6-c58b14cbaee0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:41.210988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8bb28307-dff6-421c-88c6-c58b14cbaee0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:41.220864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8bb28307-dff6-421c-88c6-c58b14cbaee0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:41.221412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8bb28307-dff6-421c-88c6-c58b14cbaee0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:41.223055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8bb28307-dff6-421c-88c6-c58b14cbaee0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:41.224121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8bb28307-dff6-421c-88c6-c58b14cbaee0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:41.423093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8bb28307-dff6-421c-88c6-c58b14cbaee0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:41.432446 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8bb28307-dff6-421c-88c6-c58b14cbaee0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1192 microversion: 2.1 time: 0.226734 Feb 19 21:21:41.436686 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2717/5346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:41 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1192 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:41.934511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-81ca0256-74ff-4456-8177-ffc998d07cf8 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:41.935136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-81ca0256-74ff-4456-8177-ffc998d07cf8 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:41.953184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81ca0256-74ff-4456-8177-ffc998d07cf8 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:41.953184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81ca0256-74ff-4456-8177-ffc998d07cf8 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:41.955002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81ca0256-74ff-4456-8177-ffc998d07cf8 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:41.955468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81ca0256-74ff-4456-8177-ffc998d07cf8 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:42.453478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e5d04ca-7aa7-4e58-9254-e14c6ff4062d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:42.454156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e5d04ca-7aa7-4e58-9254-e14c6ff4062d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:42.462531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e5d04ca-7aa7-4e58-9254-e14c6ff4062d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:42.463296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e5d04ca-7aa7-4e58-9254-e14c6ff4062d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:42.464358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e5d04ca-7aa7-4e58-9254-e14c6ff4062d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:42.465011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e5d04ca-7aa7-4e58-9254-e14c6ff4062d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:43.089486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-81ca0256-74ff-4456-8177-ffc998d07cf8 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:43.114372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-81ca0256-74ff-4456-8177-ffc998d07cf8 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1392 microversion: 2.1 time: 1.183858 Feb 19 21:21:43.119172 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2630/5347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:41 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1392 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:43.320042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b0d75fde-3a71-4983-9840-95435b9d1c6a req-856d23f8-ba4e-478c-b1c2-1e88626e664b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f722d37-ab51-4db4-a5da-1ad2d04becbf", "tag": "0f97ceaa-4db4-492f-b491-b1dca8bd9c03"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:43.323753 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:43.323753 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:21:43.337509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6e5d04ca-7aa7-4e58-9254-e14c6ff4062d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:43.352169 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6e5d04ca-7aa7-4e58-9254-e14c6ff4062d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1277 microversion: 2.1 time: 0.901249 Feb 19 21:21:43.380403 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2718/5348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:42 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1277 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:43.381277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b0d75fde-3a71-4983-9840-95435b9d1c6a req-856d23f8-ba4e-478c-b1c2-1e88626e664b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:43.383336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b0d75fde-3a71-4983-9840-95435b9d1c6a req-856d23f8-ba4e-478c-b1c2-1e88626e664b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:43.404312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b0d75fde-3a71-4983-9840-95435b9d1c6a req-856d23f8-ba4e-478c-b1c2-1e88626e664b service nova] Creating event network-changed:0f97ceaa-4db4-492f-b491-b1dca8bd9c03 for instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf on nch2-master-1 Feb 19 21:21:43.420257 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b0d75fde-3a71-4983-9840-95435b9d1c6a req-856d23f8-ba4e-478c-b1c2-1e88626e664b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105682 Feb 19 21:21:43.421429 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2631/5349] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:21:44.128097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5834bbfb-d261-4249-b227-bdd0fe73e6ee req-c8d05959-a5da-45df-955f-84304ee65f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8ac7e3-7628-4c31-a6c8-f5a5d3438541", "tag": "7bb3e653-b309-4de0-b00d-b7f703e3c0b9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:44.130022 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:44.130022 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:21:44.140989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c841b8c-1fab-495a-82fe-e9d7a1aa7b12 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:44.143102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8c841b8c-1fab-495a-82fe-e9d7a1aa7b12 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:44.149304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5834bbfb-d261-4249-b227-bdd0fe73e6ee req-c8d05959-a5da-45df-955f-84304ee65f15 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:44.150287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5834bbfb-d261-4249-b227-bdd0fe73e6ee req-c8d05959-a5da-45df-955f-84304ee65f15 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:44.170040 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5834bbfb-d261-4249-b227-bdd0fe73e6ee req-c8d05959-a5da-45df-955f-84304ee65f15 service nova] Creating event network-changed:7bb3e653-b309-4de0-b00d-b7f703e3c0b9 for instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 on nch2-master-1 Feb 19 21:21:44.175125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c841b8c-1fab-495a-82fe-e9d7a1aa7b12 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:44.175749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c841b8c-1fab-495a-82fe-e9d7a1aa7b12 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:44.176658 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5834bbfb-d261-4249-b227-bdd0fe73e6ee req-c8d05959-a5da-45df-955f-84304ee65f15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052505 Feb 19 21:21:44.177793 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2719/5350] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:21:44.178548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c841b8c-1fab-495a-82fe-e9d7a1aa7b12 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:44.179800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c841b8c-1fab-495a-82fe-e9d7a1aa7b12 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:44.371883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-738108d9-a5f8-4b13-82dc-1f293c63493b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:44.377824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-738108d9-a5f8-4b13-82dc-1f293c63493b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:44.388297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-738108d9-a5f8-4b13-82dc-1f293c63493b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:44.388793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-738108d9-a5f8-4b13-82dc-1f293c63493b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:44.389812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-738108d9-a5f8-4b13-82dc-1f293c63493b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:44.390336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-738108d9-a5f8-4b13-82dc-1f293c63493b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:44.507516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8c841b8c-1fab-495a-82fe-e9d7a1aa7b12 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:44.528119 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c841b8c-1fab-495a-82fe-e9d7a1aa7b12 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1392 microversion: 2.1 time: 0.395525 Feb 19 21:21:44.538160 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2632/5351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:44 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1392 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:44.640399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-738108d9-a5f8-4b13-82dc-1f293c63493b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:44.651013 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-738108d9-a5f8-4b13-82dc-1f293c63493b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1265 microversion: 2.1 time: 0.284499 Feb 19 21:21:44.651891 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2720/5352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:44 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:45.545640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0cc3e017-037f-479a-870b-fc71b1600980 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:45.546252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0cc3e017-037f-479a-870b-fc71b1600980 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:45.552986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cc3e017-037f-479a-870b-fc71b1600980 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:45.553440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cc3e017-037f-479a-870b-fc71b1600980 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:45.554227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cc3e017-037f-479a-870b-fc71b1600980 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:45.554665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0cc3e017-037f-479a-870b-fc71b1600980 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:45.668856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6076380d-1e1f-47e5-8c2f-8754e0aa6fc8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:45.669481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6076380d-1e1f-47e5-8c2f-8754e0aa6fc8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:45.677419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6076380d-1e1f-47e5-8c2f-8754e0aa6fc8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:45.677889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6076380d-1e1f-47e5-8c2f-8754e0aa6fc8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:45.678705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6076380d-1e1f-47e5-8c2f-8754e0aa6fc8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:45.679158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6076380d-1e1f-47e5-8c2f-8754e0aa6fc8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:45.693742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0cc3e017-037f-479a-870b-fc71b1600980 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:45.701446 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0cc3e017-037f-479a-870b-fc71b1600980 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1392 microversion: 2.1 time: 0.159363 Feb 19 21:21:45.702424 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2633/5353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:45 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:45.820214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6076380d-1e1f-47e5-8c2f-8754e0aa6fc8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:45.827772 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6076380d-1e1f-47e5-8c2f-8754e0aa6fc8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1265 microversion: 2.1 time: 0.163112 Feb 19 21:21:45.828417 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2721/5354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:45 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:46.479322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-958bba72-fb76-4f3a-9736-c4b3b9f726c3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:46.480242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-958bba72-fb76-4f3a-9736-c4b3b9f726c3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:46.486688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-958bba72-fb76-4f3a-9736-c4b3b9f726c3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:46.487163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-958bba72-fb76-4f3a-9736-c4b3b9f726c3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:46.487963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-958bba72-fb76-4f3a-9736-c4b3b9f726c3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:46.488417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-958bba72-fb76-4f3a-9736-c4b3b9f726c3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:46.539501 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-958bba72-fb76-4f3a-9736-c4b3b9f726c3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "POST /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212/action" status: 200 len: 32645 microversion: 2.1 time: 0.064345 Feb 19 21:21:46.540742 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2634/5355] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:21:46 2022] POST /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212/action => generated 32645 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:21:46.718706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c1a85893-e9f8-47a4-a4d1-acd6f47b65e7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:46.719318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c1a85893-e9f8-47a4-a4d1-acd6f47b65e7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:46.725965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1a85893-e9f8-47a4-a4d1-acd6f47b65e7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:46.726425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1a85893-e9f8-47a4-a4d1-acd6f47b65e7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:46.727221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1a85893-e9f8-47a4-a4d1-acd6f47b65e7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:46.728409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1a85893-e9f8-47a4-a4d1-acd6f47b65e7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:46.844180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31f0ebf9-3eb2-4ef3-a520-7ce105f266b7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:46.845042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-31f0ebf9-3eb2-4ef3-a520-7ce105f266b7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:46.853163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31f0ebf9-3eb2-4ef3-a520-7ce105f266b7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:46.853630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31f0ebf9-3eb2-4ef3-a520-7ce105f266b7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:46.854430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31f0ebf9-3eb2-4ef3-a520-7ce105f266b7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:46.854877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31f0ebf9-3eb2-4ef3-a520-7ce105f266b7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:47.000043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c1a85893-e9f8-47a4-a4d1-acd6f47b65e7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:47.011000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c1a85893-e9f8-47a4-a4d1-acd6f47b65e7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1392 microversion: 2.1 time: 0.295878 Feb 19 21:21:47.011674 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2722/5356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:46 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:47.113937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-31f0ebf9-3eb2-4ef3-a520-7ce105f266b7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:47.121955 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-31f0ebf9-3eb2-4ef3-a520-7ce105f266b7 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1265 microversion: 2.1 time: 0.281865 Feb 19 21:21:47.122542 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2635/5357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:46 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:47.783176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f6d4128f-e62c-4cc5-b7e6-4155a22de806 req-0c67644e-d3cf-4a2e-9270-7458be4ad32a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7133b5f-c87f-411f-918a-7ac1c6634212", "tag": "63009b88-0f8a-4c79-8889-d2d3c647b428"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:47.784701 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:47.784701 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:21:47.789105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b8f1e00c-c448-4667-b05b-1c6e8721d9d3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:47.789622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b8f1e00c-c448-4667-b05b-1c6e8721d9d3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:47.796082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8f1e00c-c448-4667-b05b-1c6e8721d9d3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:47.796576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8f1e00c-c448-4667-b05b-1c6e8721d9d3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:47.797373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8f1e00c-c448-4667-b05b-1c6e8721d9d3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:47.797820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b8f1e00c-c448-4667-b05b-1c6e8721d9d3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:47.808061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f6d4128f-e62c-4cc5-b7e6-4155a22de806 req-0c67644e-d3cf-4a2e-9270-7458be4ad32a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:47.808542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f6d4128f-e62c-4cc5-b7e6-4155a22de806 req-0c67644e-d3cf-4a2e-9270-7458be4ad32a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:47.819485 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f6d4128f-e62c-4cc5-b7e6-4155a22de806 req-0c67644e-d3cf-4a2e-9270-7458be4ad32a service nova] Creating event network-changed:63009b88-0f8a-4c79-8889-d2d3c647b428 for instance e7133b5f-c87f-411f-918a-7ac1c6634212 on nch1-master-1 Feb 19 21:21:47.824221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b8f1e00c-c448-4667-b05b-1c6e8721d9d3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:21:47.825345 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f6d4128f-e62c-4cc5-b7e6-4155a22de806 req-0c67644e-d3cf-4a2e-9270-7458be4ad32a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045649 Feb 19 21:21:47.828730 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2636/5358] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:21:47.918671 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b8f1e00c-c448-4667-b05b-1c6e8721d9d3 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 204 len: 0 microversion: 2.1 time: 0.141583 Feb 19 21:21:47.919468 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2723/5359] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:21:47 2022] DELETE /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:21:47.928533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aaa47d9a-5ede-4e17-ad96-70a648e32342 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:47.929349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aaa47d9a-5ede-4e17-ad96-70a648e32342 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:47.937082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aaa47d9a-5ede-4e17-ad96-70a648e32342 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:47.937706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aaa47d9a-5ede-4e17-ad96-70a648e32342 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:47.938609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aaa47d9a-5ede-4e17-ad96-70a648e32342 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:47.939156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aaa47d9a-5ede-4e17-ad96-70a648e32342 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:48.029230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-61b96799-9b32-4b33-80e0-f9d8cc4d59b5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:48.030063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-61b96799-9b32-4b33-80e0-f9d8cc4d59b5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:48.036611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61b96799-9b32-4b33-80e0-f9d8cc4d59b5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:48.037563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61b96799-9b32-4b33-80e0-f9d8cc4d59b5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:48.038550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61b96799-9b32-4b33-80e0-f9d8cc4d59b5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:48.038860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61b96799-9b32-4b33-80e0-f9d8cc4d59b5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:48.240370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aaa47d9a-5ede-4e17-ad96-70a648e32342 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:48.250937 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aaa47d9a-5ede-4e17-ad96-70a648e32342 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1671 microversion: 2.1 time: 0.326526 Feb 19 21:21:48.252421 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2637/5360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:47 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1671 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:48.257308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8bab003f-1de8-4ffc-ad9b-9c6b4fbc9f5a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:48.257918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8bab003f-1de8-4ffc-ad9b-9c6b4fbc9f5a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:48.264998 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bab003f-1de8-4ffc-ad9b-9c6b4fbc9f5a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:48.265436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bab003f-1de8-4ffc-ad9b-9c6b4fbc9f5a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:48.266388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bab003f-1de8-4ffc-ad9b-9c6b4fbc9f5a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:48.266979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bab003f-1de8-4ffc-ad9b-9c6b4fbc9f5a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:48.382821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-61b96799-9b32-4b33-80e0-f9d8cc4d59b5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:48.391132 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-61b96799-9b32-4b33-80e0-f9d8cc4d59b5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1392 microversion: 2.1 time: 0.366290 Feb 19 21:21:48.391859 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2724/5361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:48 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1392 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:48.519811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8bab003f-1de8-4ffc-ad9b-9c6b4fbc9f5a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:48.527895 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8bab003f-1de8-4ffc-ad9b-9c6b4fbc9f5a tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1265 microversion: 2.1 time: 0.274083 Feb 19 21:21:48.528746 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2638/5362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:48 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:49.269067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0827884c-238c-42e9-adc2-425925f87215 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:49.269923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0827884c-238c-42e9-adc2-425925f87215 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:49.277580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0827884c-238c-42e9-adc2-425925f87215 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:49.278052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0827884c-238c-42e9-adc2-425925f87215 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:49.278862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0827884c-238c-42e9-adc2-425925f87215 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:49.279334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0827884c-238c-42e9-adc2-425925f87215 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:49.409019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-816a2600-e571-4563-a98d-17ee13ba3924 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:49.410237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-816a2600-e571-4563-a98d-17ee13ba3924 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:49.418572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-816a2600-e571-4563-a98d-17ee13ba3924 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:49.419105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-816a2600-e571-4563-a98d-17ee13ba3924 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:49.419971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-816a2600-e571-4563-a98d-17ee13ba3924 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:49.420513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-816a2600-e571-4563-a98d-17ee13ba3924 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:49.558874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0827884c-238c-42e9-adc2-425925f87215 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:49.567040 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0827884c-238c-42e9-adc2-425925f87215 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1552 microversion: 2.1 time: 0.301644 Feb 19 21:21:49.568205 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2725/5363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:49 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1552 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:49.573648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d4e6aaf-7dd9-4966-8d89-3222330a931c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:49.574663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2d4e6aaf-7dd9-4966-8d89-3222330a931c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:49.584703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d4e6aaf-7dd9-4966-8d89-3222330a931c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:49.585418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d4e6aaf-7dd9-4966-8d89-3222330a931c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:49.586392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d4e6aaf-7dd9-4966-8d89-3222330a931c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:49.587436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d4e6aaf-7dd9-4966-8d89-3222330a931c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:49.745396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-816a2600-e571-4563-a98d-17ee13ba3924 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:49.753823 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-816a2600-e571-4563-a98d-17ee13ba3924 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1392 microversion: 2.1 time: 0.348974 Feb 19 21:21:49.764171 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2639/5364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:49 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1392 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:21:49.765419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-45056cfe-1d49-46dd-b593-975f6b22593a req-0f657ab4-84e4-43a6-b4a6-5e0271d7d292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f722d37-ab51-4db4-a5da-1ad2d04becbf", "name": "network-vif-plugged", "status": "completed", "tag": "0f97ceaa-4db4-492f-b491-b1dca8bd9c03"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:49.766994 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:49.766994 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:21:49.776239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-45056cfe-1d49-46dd-b593-975f6b22593a req-0f657ab4-84e4-43a6-b4a6-5e0271d7d292 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:49.776721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-45056cfe-1d49-46dd-b593-975f6b22593a req-0f657ab4-84e4-43a6-b4a6-5e0271d7d292 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:49.788185 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-45056cfe-1d49-46dd-b593-975f6b22593a req-0f657ab4-84e4-43a6-b4a6-5e0271d7d292 service nova] Creating event network-vif-plugged:0f97ceaa-4db4-492f-b491-b1dca8bd9c03 for instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf on nch2-master-1 Feb 19 21:21:49.793853 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-45056cfe-1d49-46dd-b593-975f6b22593a req-0f657ab4-84e4-43a6-b4a6-5e0271d7d292 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031903 Feb 19 21:21:49.794774 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2640/5365] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:21:49.948130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2d4e6aaf-7dd9-4966-8d89-3222330a931c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:49.956968 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d4e6aaf-7dd9-4966-8d89-3222330a931c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1265 microversion: 2.1 time: 0.387542 Feb 19 21:21:49.957691 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2726/5366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:49 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1265 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:50.172814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-052e25a8-2fde-4610-ace9-3cdcd2bb68a1 req-f468a083-64eb-4f41-b44c-23b46c879b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7133b5f-c87f-411f-918a-7ac1c6634212", "name": "network-vif-deleted", "tag": "63009b88-0f8a-4c79-8889-d2d3c647b428"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:50.174665 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:50.174665 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:21:50.183243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-052e25a8-2fde-4610-ace9-3cdcd2bb68a1 req-f468a083-64eb-4f41-b44c-23b46c879b5f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:50.184009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-052e25a8-2fde-4610-ace9-3cdcd2bb68a1 req-f468a083-64eb-4f41-b44c-23b46c879b5f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:50.203183 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-052e25a8-2fde-4610-ace9-3cdcd2bb68a1 req-f468a083-64eb-4f41-b44c-23b46c879b5f service nova] Creating event network-vif-deleted:63009b88-0f8a-4c79-8889-d2d3c647b428 for instance e7133b5f-c87f-411f-918a-7ac1c6634212 on nch1-master-1 Feb 19 21:21:50.211168 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-052e25a8-2fde-4610-ace9-3cdcd2bb68a1 req-f468a083-64eb-4f41-b44c-23b46c879b5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042150 Feb 19 21:21:50.212304 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2641/5367] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:21:50.586344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:50.587533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:50.595292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:50.596001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:50.596914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:50.597533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:50.634384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:50.634841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:50.635881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lazy-loading 'fault' on Instance uuid e7133b5f-c87f-411f-918a-7ac1c6634212 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:21:50.679357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fde410660b47939139960a9420179a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2dcdf87966c4cc5899afcfb6f2b6b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:50.686011 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-82db927d-fffd-4ea1-b3e4-4d9b13ef50e1 tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 200 len: 1338 microversion: 2.1 time: 0.103987 Feb 19 21:21:50.686582 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2727/5368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:50 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:50.772865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4e712980-6d3b-4327-9b40-542cae1f5db5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:50.773568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4e712980-6d3b-4327-9b40-542cae1f5db5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:50.780492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e712980-6d3b-4327-9b40-542cae1f5db5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:50.780952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e712980-6d3b-4327-9b40-542cae1f5db5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:50.781743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e712980-6d3b-4327-9b40-542cae1f5db5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:50.782188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4e712980-6d3b-4327-9b40-542cae1f5db5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:50.926612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4e712980-6d3b-4327-9b40-542cae1f5db5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:50.934141 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4e712980-6d3b-4327-9b40-542cae1f5db5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1392 microversion: 2.1 time: 0.166123 Feb 19 21:21:50.934712 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2642/5369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:50 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:50.973755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-91f0d16b-74a9-4a00-a5f2-28525746ca04 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:50.974295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-91f0d16b-74a9-4a00-a5f2-28525746ca04 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:50.980726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91f0d16b-74a9-4a00-a5f2-28525746ca04 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:50.981229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91f0d16b-74a9-4a00-a5f2-28525746ca04 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:50.982045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91f0d16b-74a9-4a00-a5f2-28525746ca04 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:50.982501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91f0d16b-74a9-4a00-a5f2-28525746ca04 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:51.117304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-91f0d16b-74a9-4a00-a5f2-28525746ca04 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:51.124774 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-91f0d16b-74a9-4a00-a5f2-28525746ca04 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1265 microversion: 2.1 time: 0.154708 Feb 19 21:21:51.125342 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2728/5370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:50 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:51.706910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7fcc4e49-a16f-4c33-b4ed-ce0f63f207cf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:51.706910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7fcc4e49-a16f-4c33-b4ed-ce0f63f207cf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] [instance: e7133b5f-c87f-411f-918a-7ac1c6634212] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:51.711664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fcc4e49-a16f-4c33-b4ed-ce0f63f207cf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:51.712110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fcc4e49-a16f-4c33-b4ed-ce0f63f207cf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:51.713044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fcc4e49-a16f-4c33-b4ed-ce0f63f207cf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:51.713486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fcc4e49-a16f-4c33-b4ed-ce0f63f207cf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:51.726694 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-7fcc4e49-a16f-4c33-b4ed-ce0f63f207cf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] HTTP exception thrown: Instance e7133b5f-c87f-411f-918a-7ac1c6634212 could not be found. Feb 19 21:21:51.727771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7fcc4e49-a16f-4c33-b4ed-ce0f63f207cf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Returning 404 to user: Instance e7133b5f-c87f-411f-918a-7ac1c6634212 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:21:51.728721 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7fcc4e49-a16f-4c33-b4ed-ce0f63f207cf tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212" status: 404 len: 111 microversion: 2.1 time: 0.028608 Feb 19 21:21:51.729268 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2643/5371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:51 2022] GET /compute/v2.1/servers/e7133b5f-c87f-411f-918a-7ac1c6634212 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:21:51.809632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3e5d595d-2955-4f92-b4c8-678c1005aa80 req-2ddc03f7-0f9f-4ab8-adfe-eb94b4ebbebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8ac7e3-7628-4c31-a6c8-f5a5d3438541", "name": "network-vif-plugged", "status": "completed", "tag": "7bb3e653-b309-4de0-b00d-b7f703e3c0b9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:51.811190 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:51.811190 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:21:51.818741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3e5d595d-2955-4f92-b4c8-678c1005aa80 req-2ddc03f7-0f9f-4ab8-adfe-eb94b4ebbebf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:51.819277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3e5d595d-2955-4f92-b4c8-678c1005aa80 req-2ddc03f7-0f9f-4ab8-adfe-eb94b4ebbebf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:51.830668 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3e5d595d-2955-4f92-b4c8-678c1005aa80 req-2ddc03f7-0f9f-4ab8-adfe-eb94b4ebbebf service nova] Creating event network-vif-plugged:7bb3e653-b309-4de0-b00d-b7f703e3c0b9 for instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 on nch2-master-1 Feb 19 21:21:51.835512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3e5d595d-2955-4f92-b4c8-678c1005aa80 req-2ddc03f7-0f9f-4ab8-adfe-eb94b4ebbebf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030330 Feb 19 21:21:51.836104 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2729/5372] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:21:51.896897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dd250fa3-c88b-45dd-bc35-0b79684cd1cd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] Calling method '.version_select at 0x7f6466a46670>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:51.917866 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dd250fa3-c88b-45dd-bc35-0b79684cd1cd tempest-TestNetworkBasicOps-1288826623 tempest-TestNetworkBasicOps-1288826623-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1062926922" status: 202 len: 0 microversion: 2.1 time: 0.024778 Feb 19 21:21:51.918807 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2644/5373] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 21:21:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1062926922 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:21:51.951363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0d031b55-fd1b-470d-baf8-74ca6c799478 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:51.952735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0d031b55-fd1b-470d-baf8-74ca6c799478 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:51.962764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d031b55-fd1b-470d-baf8-74ca6c799478 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:51.963835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d031b55-fd1b-470d-baf8-74ca6c799478 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:51.965286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d031b55-fd1b-470d-baf8-74ca6c799478 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:51.966185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d031b55-fd1b-470d-baf8-74ca6c799478 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:52.119938 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0d031b55-fd1b-470d-baf8-74ca6c799478 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:52.127561 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0d031b55-fd1b-470d-baf8-74ca6c799478 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1564 microversion: 2.1 time: 0.181190 Feb 19 21:21:52.128240 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2730/5374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:51 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:52.141728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c721e83-3d94-43e1-a246-17cfb9a909fc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:52.142824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8c721e83-3d94-43e1-a246-17cfb9a909fc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:52.145003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a16d67f-2c1d-4336-afda-10256a3427f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:52.145964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a16d67f-2c1d-4336-afda-10256a3427f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:52.149807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c721e83-3d94-43e1-a246-17cfb9a909fc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:52.150404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c721e83-3d94-43e1-a246-17cfb9a909fc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:52.151485 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c721e83-3d94-43e1-a246-17cfb9a909fc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:52.152005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c721e83-3d94-43e1-a246-17cfb9a909fc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:52.152743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a16d67f-2c1d-4336-afda-10256a3427f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:52.153210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a16d67f-2c1d-4336-afda-10256a3427f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:52.154011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a16d67f-2c1d-4336-afda-10256a3427f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:52.154475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a16d67f-2c1d-4336-afda-10256a3427f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:52.367058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8c721e83-3d94-43e1-a246-17cfb9a909fc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:52.371787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0a16d67f-2c1d-4336-afda-10256a3427f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:52.375656 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c721e83-3d94-43e1-a246-17cfb9a909fc tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1265 microversion: 2.1 time: 0.237575 Feb 19 21:21:52.376238 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2645/5375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:52 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:52.379550 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a16d67f-2c1d-4336-afda-10256a3427f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1564 microversion: 2.1 time: 0.238055 Feb 19 21:21:52.380238 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2731/5376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:52 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1564 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:53.392677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a3032563-4e39-4a46-b523-ef3b81fd41f3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:53.393917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a3032563-4e39-4a46-b523-ef3b81fd41f3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:53.403993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3032563-4e39-4a46-b523-ef3b81fd41f3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:53.404473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3032563-4e39-4a46-b523-ef3b81fd41f3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:53.405277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3032563-4e39-4a46-b523-ef3b81fd41f3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:53.405719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3032563-4e39-4a46-b523-ef3b81fd41f3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:53.737395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a3032563-4e39-4a46-b523-ef3b81fd41f3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:53.749249 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a3032563-4e39-4a46-b523-ef3b81fd41f3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1452 microversion: 2.1 time: 0.360491 Feb 19 21:21:53.750347 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2646/5377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:53 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1452 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:53.766558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5712b629-2ee6-494b-88b5-d49d9492c883 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:53.767180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5712b629-2ee6-494b-88b5-d49d9492c883 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:53.775182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5712b629-2ee6-494b-88b5-d49d9492c883 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:53.775649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5712b629-2ee6-494b-88b5-d49d9492c883 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:53.776493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5712b629-2ee6-494b-88b5-d49d9492c883 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:53.776948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5712b629-2ee6-494b-88b5-d49d9492c883 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:54.062293 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5712b629-2ee6-494b-88b5-d49d9492c883 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:54.069839 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5712b629-2ee6-494b-88b5-d49d9492c883 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1452 microversion: 2.1 time: 0.306896 Feb 19 21:21:54.071182 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2732/5378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:53 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1452 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:55.129547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ff9a1829-cc61-4100-a120-bf977ce3ffa5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:21:55.130298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ff9a1829-cc61-4100-a120-bf977ce3ffa5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:21:55.143839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff9a1829-cc61-4100-a120-bf977ce3ffa5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:55.146387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff9a1829-cc61-4100-a120-bf977ce3ffa5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:55.147665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff9a1829-cc61-4100-a120-bf977ce3ffa5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:55.151982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ff9a1829-cc61-4100-a120-bf977ce3ffa5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:55.152742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f4195ac5-9cf8-47d0-9274-8bcded0224df req-1b6b16e8-1ede-462a-9d66-0c4ccbf70d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f722d37-ab51-4db4-a5da-1ad2d04becbf", "tag": "0f97ceaa-4db4-492f-b491-b1dca8bd9c03"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:55.154342 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:55.154342 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:21:55.172028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f4195ac5-9cf8-47d0-9274-8bcded0224df req-1b6b16e8-1ede-462a-9d66-0c4ccbf70d29 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:55.172518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f4195ac5-9cf8-47d0-9274-8bcded0224df req-1b6b16e8-1ede-462a-9d66-0c4ccbf70d29 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:55.194289 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f4195ac5-9cf8-47d0-9274-8bcded0224df req-1b6b16e8-1ede-462a-9d66-0c4ccbf70d29 service nova] Creating event network-changed:0f97ceaa-4db4-492f-b491-b1dca8bd9c03 for instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf on nch2-master-1 Feb 19 21:21:55.203377 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f4195ac5-9cf8-47d0-9274-8bcded0224df req-1b6b16e8-1ede-462a-9d66-0c4ccbf70d29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054902 Feb 19 21:21:55.206420 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2733/5379] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:21:55.743455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ff9a1829-cc61-4100-a120-bf977ce3ffa5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:21:55.761249 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ff9a1829-cc61-4100-a120-bf977ce3ffa5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1564 microversion: 2.1 time: 0.635268 Feb 19 21:21:55.776944 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2647/5380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:21:55 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1564 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:21:57.670089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-81dea3fe-229c-4d74-8a78-69a5a3955b03 req-f81bfa5b-4ca6-4c56-8e3a-875035949ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8ac7e3-7628-4c31-a6c8-f5a5d3438541", "tag": "7bb3e653-b309-4de0-b00d-b7f703e3c0b9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:21:57.672801 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:21:57.672801 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:21:57.685242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-81dea3fe-229c-4d74-8a78-69a5a3955b03 req-f81bfa5b-4ca6-4c56-8e3a-875035949ace service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:21:57.685917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-81dea3fe-229c-4d74-8a78-69a5a3955b03 req-f81bfa5b-4ca6-4c56-8e3a-875035949ace service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:21:57.703972 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-81dea3fe-229c-4d74-8a78-69a5a3955b03 req-f81bfa5b-4ca6-4c56-8e3a-875035949ace service nova] Creating event network-changed:7bb3e653-b309-4de0-b00d-b7f703e3c0b9 for instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 on nch2-master-1 Feb 19 21:21:57.711239 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-81dea3fe-229c-4d74-8a78-69a5a3955b03 req-f81bfa5b-4ca6-4c56-8e3a-875035949ace service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046724 Feb 19 21:21:57.713236 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2734/5381] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:22:29.083180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-df2da301-34df-478b-9961-0fe517b0d881 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:22:29.084096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-df2da301-34df-478b-9961-0fe517b0d881 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:22:29.092091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df2da301-34df-478b-9961-0fe517b0d881 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:22:29.092592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df2da301-34df-478b-9961-0fe517b0d881 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:22:29.093409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df2da301-34df-478b-9961-0fe517b0d881 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:22:29.093849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df2da301-34df-478b-9961-0fe517b0d881 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:22:29.147469 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-df2da301-34df-478b-9961-0fe517b0d881 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action" status: 200 len: 24572 microversion: 2.1 time: 0.069077 Feb 19 21:22:29.148222 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2648/5382] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:22:29 2022] POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action => generated 24572 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:23:08.004625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8521d070-8661-486b-8d27-9d20294048d4 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:08.005496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8521d070-8661-486b-8d27-9d20294048d4 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:08.012047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8521d070-8661-486b-8d27-9d20294048d4 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:08.012541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8521d070-8661-486b-8d27-9d20294048d4 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:08.013342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8521d070-8661-486b-8d27-9d20294048d4 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:08.013790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8521d070-8661-486b-8d27-9d20294048d4 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:08.275175 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8521d070-8661-486b-8d27-9d20294048d4 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1834 microversion: 2.1 time: 0.276738 Feb 19 21:23:08.275772 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2735/5383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:07 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1834 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:08.293092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b342253-728f-43e4-a775-477fe0bb1e0b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:08.294235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b342253-728f-43e4-a775-477fe0bb1e0b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:08.302578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b342253-728f-43e4-a775-477fe0bb1e0b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:08.303036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b342253-728f-43e4-a775-477fe0bb1e0b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:08.303842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b342253-728f-43e4-a775-477fe0bb1e0b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:08.304319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b342253-728f-43e4-a775-477fe0bb1e0b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:08.454210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9b342253-728f-43e4-a775-477fe0bb1e0b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:08.462421 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b342253-728f-43e4-a775-477fe0bb1e0b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1683 microversion: 2.1 time: 0.174218 Feb 19 21:23:08.463003 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2649/5384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:08 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:08.562243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-17703a23-ce10-44e7-bf28-3d93491e796f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:23:08.563199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17703a23-ce10-44e7-bf28-3d93491e796f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:08.569398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17703a23-ce10-44e7-bf28-3d93491e796f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:08.569867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17703a23-ce10-44e7-bf28-3d93491e796f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:08.571196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17703a23-ce10-44e7-bf28-3d93491e796f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:08.571699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17703a23-ce10-44e7-bf28-3d93491e796f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:08.632674 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-17703a23-ce10-44e7-bf28-3d93491e796f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action" status: 200 len: 32647 microversion: 2.1 time: 0.073920 Feb 19 21:23:08.633860 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2736/5385] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:23:08 2022] POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action => generated 32647 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:23:08.791914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:23:08.792444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:08.799073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:08.799532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:08.800394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:08.800841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:08.846450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '29d56ddcc91e4058a79c475296502045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f18c17dc34e7aab590042dec72705', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:08.847097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] flavor_id is None. Assuming migration. {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4073}} Feb 19 21:23:08.847549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:23:09.085357 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4f424b40-36f4-4b2c-8b8a-9b2d9d868b03 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action" status: 202 len: 0 microversion: 2.1 time: 0.297211 Feb 19 21:23:09.089352 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2650/5386] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:23:08 2022] POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:23:09.099259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6eb0240b-3183-48b8-ae36-a0ff741f7bd4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:09.100586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6eb0240b-3183-48b8-ae36-a0ff741f7bd4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:09.111215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb0240b-3183-48b8-ae36-a0ff741f7bd4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:09.112101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb0240b-3183-48b8-ae36-a0ff741f7bd4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:09.113632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb0240b-3183-48b8-ae36-a0ff741f7bd4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:09.114446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb0240b-3183-48b8-ae36-a0ff741f7bd4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:09.285772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6eb0240b-3183-48b8-ae36-a0ff741f7bd4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:09.293986 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6eb0240b-3183-48b8-ae36-a0ff741f7bd4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1692 microversion: 2.1 time: 0.202562 Feb 19 21:23:09.294568 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2737/5387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:09 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1692 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:10.313882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c58c6ed-8417-495e-b387-eeb64f31959f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:10.314693 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8c58c6ed-8417-495e-b387-eeb64f31959f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:10.322548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c58c6ed-8417-495e-b387-eeb64f31959f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:10.322997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c58c6ed-8417-495e-b387-eeb64f31959f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:10.323791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c58c6ed-8417-495e-b387-eeb64f31959f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:10.324225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c58c6ed-8417-495e-b387-eeb64f31959f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:10.471226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8c58c6ed-8417-495e-b387-eeb64f31959f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:10.479879 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c58c6ed-8417-495e-b387-eeb64f31959f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1692 microversion: 2.1 time: 0.171025 Feb 19 21:23:10.480498 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2651/5388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:10 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:11.498913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-779c11ce-a66d-4da4-97c5-78cfd20e6c65 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:11.499532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-779c11ce-a66d-4da4-97c5-78cfd20e6c65 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:11.506468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-779c11ce-a66d-4da4-97c5-78cfd20e6c65 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:11.506925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-779c11ce-a66d-4da4-97c5-78cfd20e6c65 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:11.507754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-779c11ce-a66d-4da4-97c5-78cfd20e6c65 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:11.508717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-779c11ce-a66d-4da4-97c5-78cfd20e6c65 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:11.661498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-779c11ce-a66d-4da4-97c5-78cfd20e6c65 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:11.669352 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-779c11ce-a66d-4da4-97c5-78cfd20e6c65 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.174712 Feb 19 21:23:11.669940 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2738/5389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:11 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:12.687165 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a88207d5-fd6f-4ea7-8d9e-d9724615b07c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:12.687689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a88207d5-fd6f-4ea7-8d9e-d9724615b07c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:12.694676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a88207d5-fd6f-4ea7-8d9e-d9724615b07c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:12.695124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a88207d5-fd6f-4ea7-8d9e-d9724615b07c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:12.695912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a88207d5-fd6f-4ea7-8d9e-d9724615b07c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:12.696360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a88207d5-fd6f-4ea7-8d9e-d9724615b07c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:12.848387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a88207d5-fd6f-4ea7-8d9e-d9724615b07c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:12.856742 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a88207d5-fd6f-4ea7-8d9e-d9724615b07c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.173384 Feb 19 21:23:12.857331 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2652/5390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:12 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:13.874164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a760850e-4f35-4bf1-880a-2731b8d36151 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:13.874792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a760850e-4f35-4bf1-880a-2731b8d36151 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:13.881874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a760850e-4f35-4bf1-880a-2731b8d36151 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:13.882347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a760850e-4f35-4bf1-880a-2731b8d36151 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:13.883679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a760850e-4f35-4bf1-880a-2731b8d36151 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:13.884138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a760850e-4f35-4bf1-880a-2731b8d36151 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:14.027247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a760850e-4f35-4bf1-880a-2731b8d36151 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:14.035161 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a760850e-4f35-4bf1-880a-2731b8d36151 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.164690 Feb 19 21:23:14.035750 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2739/5391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:13 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:23:15.052702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dd87784b-4ed8-4451-8e44-d45fa7b739cb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:15.053344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dd87784b-4ed8-4451-8e44-d45fa7b739cb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:15.061172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd87784b-4ed8-4451-8e44-d45fa7b739cb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:15.061623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd87784b-4ed8-4451-8e44-d45fa7b739cb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:15.062409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd87784b-4ed8-4451-8e44-d45fa7b739cb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:15.062847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dd87784b-4ed8-4451-8e44-d45fa7b739cb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:15.208918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dd87784b-4ed8-4451-8e44-d45fa7b739cb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:15.216494 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dd87784b-4ed8-4451-8e44-d45fa7b739cb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.167404 Feb 19 21:23:15.217085 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2653/5392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:15 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:16.233597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3852729e-ab12-4282-a662-98e3f186c836 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:16.234234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3852729e-ab12-4282-a662-98e3f186c836 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:16.241208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3852729e-ab12-4282-a662-98e3f186c836 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:16.241670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3852729e-ab12-4282-a662-98e3f186c836 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:16.242478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3852729e-ab12-4282-a662-98e3f186c836 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:16.242925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3852729e-ab12-4282-a662-98e3f186c836 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:16.403009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3852729e-ab12-4282-a662-98e3f186c836 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:16.412993 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3852729e-ab12-4282-a662-98e3f186c836 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.182956 Feb 19 21:23:16.413589 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2740/5393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:16 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:17.431062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c65a054a-f82f-4d72-856c-17cc7b3be95a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:17.431606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c65a054a-f82f-4d72-856c-17cc7b3be95a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:17.438630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c65a054a-f82f-4d72-856c-17cc7b3be95a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:17.439078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c65a054a-f82f-4d72-856c-17cc7b3be95a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:17.439896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c65a054a-f82f-4d72-856c-17cc7b3be95a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:17.440360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c65a054a-f82f-4d72-856c-17cc7b3be95a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:17.585473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c65a054a-f82f-4d72-856c-17cc7b3be95a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:17.594108 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c65a054a-f82f-4d72-856c-17cc7b3be95a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.166851 Feb 19 21:23:17.594693 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2654/5394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:17 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:18.610552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8b981538-2d5e-49e9-9cae-764c95dcfe6b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:18.611075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8b981538-2d5e-49e9-9cae-764c95dcfe6b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:18.618770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b981538-2d5e-49e9-9cae-764c95dcfe6b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:18.619240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b981538-2d5e-49e9-9cae-764c95dcfe6b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:18.620044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b981538-2d5e-49e9-9cae-764c95dcfe6b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:18.620527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b981538-2d5e-49e9-9cae-764c95dcfe6b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:18.770690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8b981538-2d5e-49e9-9cae-764c95dcfe6b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:18.778987 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8b981538-2d5e-49e9-9cae-764c95dcfe6b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.172154 Feb 19 21:23:18.779583 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2741/5395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:18 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:19.796361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b6971881-7a8a-465c-979f-11049343191b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:19.797039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b6971881-7a8a-465c-979f-11049343191b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:19.804066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6971881-7a8a-465c-979f-11049343191b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:19.804557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6971881-7a8a-465c-979f-11049343191b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:19.805330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6971881-7a8a-465c-979f-11049343191b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:19.805774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6971881-7a8a-465c-979f-11049343191b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:19.953497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b6971881-7a8a-465c-979f-11049343191b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:19.961868 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b6971881-7a8a-465c-979f-11049343191b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.168540 Feb 19 21:23:19.962455 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2655/5396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:19 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:20.979123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-996eb80b-1bfd-4659-8816-b4f74ce0bb88 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:20.979702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-996eb80b-1bfd-4659-8816-b4f74ce0bb88 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:20.986857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-996eb80b-1bfd-4659-8816-b4f74ce0bb88 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:20.987322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-996eb80b-1bfd-4659-8816-b4f74ce0bb88 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:20.988123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-996eb80b-1bfd-4659-8816-b4f74ce0bb88 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:20.988602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-996eb80b-1bfd-4659-8816-b4f74ce0bb88 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:21.131532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-996eb80b-1bfd-4659-8816-b4f74ce0bb88 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:21.139870 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-996eb80b-1bfd-4659-8816-b4f74ce0bb88 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.164537 Feb 19 21:23:21.140481 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2742/5397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:20 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:22.157473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2bc86772-bdc8-4435-a78c-59a811d9db8c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:22.158109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2bc86772-bdc8-4435-a78c-59a811d9db8c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:22.165348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2bc86772-bdc8-4435-a78c-59a811d9db8c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:22.165804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2bc86772-bdc8-4435-a78c-59a811d9db8c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:22.166598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2bc86772-bdc8-4435-a78c-59a811d9db8c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:22.167037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2bc86772-bdc8-4435-a78c-59a811d9db8c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:22.336023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2bc86772-bdc8-4435-a78c-59a811d9db8c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:22.344125 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2bc86772-bdc8-4435-a78c-59a811d9db8c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.190327 Feb 19 21:23:22.344745 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2656/5398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:22 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:23.361465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f505077-db84-44e0-9bd5-400687f44b7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:23.362091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f505077-db84-44e0-9bd5-400687f44b7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:23.369489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f505077-db84-44e0-9bd5-400687f44b7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:23.369971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f505077-db84-44e0-9bd5-400687f44b7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:23.370768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f505077-db84-44e0-9bd5-400687f44b7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:23.371222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f505077-db84-44e0-9bd5-400687f44b7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:23.510346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1f505077-db84-44e0-9bd5-400687f44b7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:23.517989 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f505077-db84-44e0-9bd5-400687f44b7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.160211 Feb 19 21:23:23.518573 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2743/5399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:23 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:24.536182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9ed3d00d-f208-4808-8e8d-6ec70c185863 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:24.536809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9ed3d00d-f208-4808-8e8d-6ec70c185863 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:24.545684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ed3d00d-f208-4808-8e8d-6ec70c185863 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:24.546332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ed3d00d-f208-4808-8e8d-6ec70c185863 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:24.547242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ed3d00d-f208-4808-8e8d-6ec70c185863 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:24.547846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9ed3d00d-f208-4808-8e8d-6ec70c185863 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:24.691544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9ed3d00d-f208-4808-8e8d-6ec70c185863 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:24.699827 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9ed3d00d-f208-4808-8e8d-6ec70c185863 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.167325 Feb 19 21:23:24.700732 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2657/5400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:24 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:25.716894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3b398c9c-e864-4fbe-87ba-a9eaf956fd02 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:25.717508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3b398c9c-e864-4fbe-87ba-a9eaf956fd02 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:25.724175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b398c9c-e864-4fbe-87ba-a9eaf956fd02 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:25.724668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b398c9c-e864-4fbe-87ba-a9eaf956fd02 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:25.725459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b398c9c-e864-4fbe-87ba-a9eaf956fd02 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:25.725909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b398c9c-e864-4fbe-87ba-a9eaf956fd02 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:25.866350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3b398c9c-e864-4fbe-87ba-a9eaf956fd02 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:25.873814 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3b398c9c-e864-4fbe-87ba-a9eaf956fd02 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.160588 Feb 19 21:23:25.874383 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2744/5401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:25 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:26.890692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-46283521-5f82-4aba-8474-5bbeaa4a1cd7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:26.891294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-46283521-5f82-4aba-8474-5bbeaa4a1cd7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:26.898029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-46283521-5f82-4aba-8474-5bbeaa4a1cd7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:26.898959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-46283521-5f82-4aba-8474-5bbeaa4a1cd7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:26.899737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-46283521-5f82-4aba-8474-5bbeaa4a1cd7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:26.900228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-46283521-5f82-4aba-8474-5bbeaa4a1cd7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:27.046688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-46283521-5f82-4aba-8474-5bbeaa4a1cd7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:27.054020 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-46283521-5f82-4aba-8474-5bbeaa4a1cd7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.166968 Feb 19 21:23:27.054594 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2658/5402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:26 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:28.071273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-61f2914b-64fe-45da-ab0d-c3324e9a04f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:28.071913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-61f2914b-64fe-45da-ab0d-c3324e9a04f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:28.078921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61f2914b-64fe-45da-ab0d-c3324e9a04f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:28.079382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61f2914b-64fe-45da-ab0d-c3324e9a04f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:28.080167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61f2914b-64fe-45da-ab0d-c3324e9a04f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:28.081383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61f2914b-64fe-45da-ab0d-c3324e9a04f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:28.231149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-61f2914b-64fe-45da-ab0d-c3324e9a04f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:28.238934 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-61f2914b-64fe-45da-ab0d-c3324e9a04f2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1697 microversion: 2.1 time: 0.171852 Feb 19 21:23:28.239748 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2745/5403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:28 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:28.683920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-20647857-865b-46cc-b7bb-8ea38b05c00f req-40009795-8e5f-4c0e-8c78-1ac571b0866d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f722d37-ab51-4db4-a5da-1ad2d04becbf", "name": "network-vif-unplugged", "status": "completed", "tag": "0f97ceaa-4db4-492f-b491-b1dca8bd9c03"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:23:28.685749 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:23:28.685749 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:23:28.694508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-20647857-865b-46cc-b7bb-8ea38b05c00f req-40009795-8e5f-4c0e-8c78-1ac571b0866d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:28.694952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-20647857-865b-46cc-b7bb-8ea38b05c00f req-40009795-8e5f-4c0e-8c78-1ac571b0866d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:28.710094 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-20647857-865b-46cc-b7bb-8ea38b05c00f req-40009795-8e5f-4c0e-8c78-1ac571b0866d service nova] Creating event network-vif-unplugged:0f97ceaa-4db4-492f-b491-b1dca8bd9c03 for instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf on nch1-master-1 Feb 19 21:23:28.716630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-20647857-865b-46cc-b7bb-8ea38b05c00f req-40009795-8e5f-4c0e-8c78-1ac571b0866d service nova] Instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:23:28.729644 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-20647857-865b-46cc-b7bb-8ea38b05c00f req-40009795-8e5f-4c0e-8c78-1ac571b0866d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049232 Feb 19 21:23:28.730280 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2659/5404] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:23:29.255964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cfa3252d-8b92-4b1e-ac69-1adea53b494e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:29.256613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cfa3252d-8b92-4b1e-ac69-1adea53b494e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:29.264866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfa3252d-8b92-4b1e-ac69-1adea53b494e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:29.265325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfa3252d-8b92-4b1e-ac69-1adea53b494e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:29.266121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfa3252d-8b92-4b1e-ac69-1adea53b494e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:29.266566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfa3252d-8b92-4b1e-ac69-1adea53b494e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:29.555902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cfa3252d-8b92-4b1e-ac69-1adea53b494e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:29.564546 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cfa3252d-8b92-4b1e-ac69-1adea53b494e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1696 microversion: 2.1 time: 0.312178 Feb 19 21:23:29.565498 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2746/5405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:29 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1696 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:30.582863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0b2ebd76-f680-496f-9ff4-430cca26fc8b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:30.583462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0b2ebd76-f680-496f-9ff4-430cca26fc8b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:30.591352 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b2ebd76-f680-496f-9ff4-430cca26fc8b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:30.591812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b2ebd76-f680-496f-9ff4-430cca26fc8b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:30.592635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b2ebd76-f680-496f-9ff4-430cca26fc8b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:30.593092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0b2ebd76-f680-496f-9ff4-430cca26fc8b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:30.735020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0b2ebd76-f680-496f-9ff4-430cca26fc8b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:30.743119 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0b2ebd76-f680-496f-9ff4-430cca26fc8b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1694 microversion: 2.1 time: 0.163888 Feb 19 21:23:30.743711 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2660/5406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:30 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:30.743932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-56eb55ee-0215-4dfb-9f4d-2260559845b7 req-3b7ae708-f66b-4c27-a5fd-174e1f3413cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f722d37-ab51-4db4-a5da-1ad2d04becbf", "tag": "0f97ceaa-4db4-492f-b491-b1dca8bd9c03"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:23:30.745460 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:23:30.745460 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:23:30.753088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-56eb55ee-0215-4dfb-9f4d-2260559845b7 req-3b7ae708-f66b-4c27-a5fd-174e1f3413cb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:30.753530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-56eb55ee-0215-4dfb-9f4d-2260559845b7 req-3b7ae708-f66b-4c27-a5fd-174e1f3413cb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:30.767906 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-56eb55ee-0215-4dfb-9f4d-2260559845b7 req-3b7ae708-f66b-4c27-a5fd-174e1f3413cb service nova] Creating event network-changed:0f97ceaa-4db4-492f-b491-b1dca8bd9c03 for instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf on nch1-master-1 Feb 19 21:23:30.773165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-56eb55ee-0215-4dfb-9f4d-2260559845b7 req-3b7ae708-f66b-4c27-a5fd-174e1f3413cb service nova] Instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:23:30.784128 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-56eb55ee-0215-4dfb-9f4d-2260559845b7 req-3b7ae708-f66b-4c27-a5fd-174e1f3413cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044501 Feb 19 21:23:30.784767 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2747/5407] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:23:31.761056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d30dfff8-488d-4b0b-b50c-98f96db0b141 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:31.762870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d30dfff8-488d-4b0b-b50c-98f96db0b141 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:31.770393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d30dfff8-488d-4b0b-b50c-98f96db0b141 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:31.770845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d30dfff8-488d-4b0b-b50c-98f96db0b141 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:31.771630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d30dfff8-488d-4b0b-b50c-98f96db0b141 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:31.772089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d30dfff8-488d-4b0b-b50c-98f96db0b141 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:31.933622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d30dfff8-488d-4b0b-b50c-98f96db0b141 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:31.941995 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d30dfff8-488d-4b0b-b50c-98f96db0b141 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1691 microversion: 2.1 time: 0.185308 Feb 19 21:23:31.942593 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2661/5408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:31 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1691 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:31.959734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-782938d5-a7fc-4e1e-824b-75e0382798ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:23:31.960516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-782938d5-a7fc-4e1e-824b-75e0382798ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:31.968411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-782938d5-a7fc-4e1e-824b-75e0382798ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:31.968853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-782938d5-a7fc-4e1e-824b-75e0382798ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:31.970324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-782938d5-a7fc-4e1e-824b-75e0382798ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:31.970811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-782938d5-a7fc-4e1e-824b-75e0382798ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:32.032536 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-782938d5-a7fc-4e1e-824b-75e0382798ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action" status: 204 len: 0 microversion: 2.1 time: 0.076550 Feb 19 21:23:32.033077 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2748/5409] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:23:31 2022] POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:23:32.041982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7c994999-46dc-4097-bbf4-fa0059427fe6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:32.043072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7c994999-46dc-4097-bbf4-fa0059427fe6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:32.049821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c994999-46dc-4097-bbf4-fa0059427fe6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:32.050819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c994999-46dc-4097-bbf4-fa0059427fe6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:32.052110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c994999-46dc-4097-bbf4-fa0059427fe6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:32.052649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c994999-46dc-4097-bbf4-fa0059427fe6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:32.332480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7c994999-46dc-4097-bbf4-fa0059427fe6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:32.341925 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7c994999-46dc-4097-bbf4-fa0059427fe6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1691 microversion: 2.1 time: 0.304204 Feb 19 21:23:32.352354 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2662/5410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:32 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:33.360533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d657fb6e-32cc-4ffc-97bf-7aa07703083c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:23:33.361251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d657fb6e-32cc-4ffc-97bf-7aa07703083c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:33.369367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d657fb6e-32cc-4ffc-97bf-7aa07703083c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:33.370124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d657fb6e-32cc-4ffc-97bf-7aa07703083c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:33.370923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d657fb6e-32cc-4ffc-97bf-7aa07703083c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:33.371364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d657fb6e-32cc-4ffc-97bf-7aa07703083c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:33.567630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d657fb6e-32cc-4ffc-97bf-7aa07703083c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:23:33.575543 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d657fb6e-32cc-4ffc-97bf-7aa07703083c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1683 microversion: 2.1 time: 0.218994 Feb 19 21:23:33.576157 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2749/5411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:23:33 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1683 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:23:35.533064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8fd0f181-f68f-40be-98c8-eadc73678e0f req-1fb0c4ee-78aa-40c8-ade2-222c15af2d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f722d37-ab51-4db4-a5da-1ad2d04becbf", "name": "network-vif-plugged", "status": "completed", "tag": "0f97ceaa-4db4-492f-b491-b1dca8bd9c03"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:23:35.534949 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:23:35.534949 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:23:35.544519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8fd0f181-f68f-40be-98c8-eadc73678e0f req-1fb0c4ee-78aa-40c8-ade2-222c15af2d7d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:35.545130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8fd0f181-f68f-40be-98c8-eadc73678e0f req-1fb0c4ee-78aa-40c8-ade2-222c15af2d7d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:35.556831 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8fd0f181-f68f-40be-98c8-eadc73678e0f req-1fb0c4ee-78aa-40c8-ade2-222c15af2d7d service nova] Creating event network-vif-plugged:0f97ceaa-4db4-492f-b491-b1dca8bd9c03 for instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf on nch1-master-1 Feb 19 21:23:35.562397 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8fd0f181-f68f-40be-98c8-eadc73678e0f req-1fb0c4ee-78aa-40c8-ade2-222c15af2d7d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033108 Feb 19 21:23:35.563463 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2663/5412] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:23:37.712011 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:23:37.712541 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 21:23:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:23:57.781701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b4f7ee7-ed09-405d-b086-32fb0f0e8641 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:23:57.782666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7b4f7ee7-ed09-405d-b086-32fb0f0e8641 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:23:57.790064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b4f7ee7-ed09-405d-b086-32fb0f0e8641 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:57.790575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b4f7ee7-ed09-405d-b086-32fb0f0e8641 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:57.791372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b4f7ee7-ed09-405d-b086-32fb0f0e8641 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:23:57.791826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b4f7ee7-ed09-405d-b086-32fb0f0e8641 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:23:57.844600 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b4f7ee7-ed09-405d-b086-32fb0f0e8641 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action" status: 200 len: 24577 microversion: 2.1 time: 0.066503 Feb 19 21:23:57.850576 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2750/5413] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:23:57 2022] POST /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf/action => generated 24577 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:24:03.063303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:03.064024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:03.071239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:03.071691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:03.072497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:03.072940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:03.097409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:24:03.174948 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ef05994d-ffe7-4fd1-a61d-e6a109db1509 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 204 len: 0 microversion: 2.1 time: 0.115520 Feb 19 21:24:03.175646 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2664/5414] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:24:03 2022] DELETE /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:24:03.185303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6cc2517a-c409-4b8a-8823-5fec0d23b4a2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:03.186207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6cc2517a-c409-4b8a-8823-5fec0d23b4a2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:03.193633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cc2517a-c409-4b8a-8823-5fec0d23b4a2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:03.195705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cc2517a-c409-4b8a-8823-5fec0d23b4a2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:03.196461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cc2517a-c409-4b8a-8823-5fec0d23b4a2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:03.196910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6cc2517a-c409-4b8a-8823-5fec0d23b4a2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:03.344407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6cc2517a-c409-4b8a-8823-5fec0d23b4a2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:03.352954 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6cc2517a-c409-4b8a-8823-5fec0d23b4a2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1577 microversion: 2.1 time: 0.171920 Feb 19 21:24:03.353532 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2751/5415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:03 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:04.291925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a3e30766-723a-4a0e-addb-ead690c86d15 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:04.292646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a3e30766-723a-4a0e-addb-ead690c86d15 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:04.299306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3e30766-723a-4a0e-addb-ead690c86d15 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:04.299751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3e30766-723a-4a0e-addb-ead690c86d15 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:04.300553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3e30766-723a-4a0e-addb-ead690c86d15 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:04.300987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3e30766-723a-4a0e-addb-ead690c86d15 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:04.370440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44f42ed8-1c22-4e37-9197-92c24587eb64 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:04.371687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-44f42ed8-1c22-4e37-9197-92c24587eb64 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:04.379370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44f42ed8-1c22-4e37-9197-92c24587eb64 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:04.379843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44f42ed8-1c22-4e37-9197-92c24587eb64 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:04.380672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44f42ed8-1c22-4e37-9197-92c24587eb64 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:04.381131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-44f42ed8-1c22-4e37-9197-92c24587eb64 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:04.444958 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a3e30766-723a-4a0e-addb-ead690c86d15 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1834 microversion: 2.1 time: 0.157028 Feb 19 21:24:04.446027 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2665/5416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:04 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1834 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:04.539604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44f42ed8-1c22-4e37-9197-92c24587eb64 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:04.547562 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44f42ed8-1c22-4e37-9197-92c24587eb64 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1577 microversion: 2.1 time: 0.181284 Feb 19 21:24:04.548063 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2752/5417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:04 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:24:05.370820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57029c9f-6bfb-40fd-b96a-96bb0855dc78 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:05.376698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4d84c2a7-2f2c-4270-be5d-34eb111e05d9 req-12b11314-6442-4946-be73-97784f9ce202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f722d37-ab51-4db4-a5da-1ad2d04becbf", "tag": "0f97ceaa-4db4-492f-b491-b1dca8bd9c03"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:05.377894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57029c9f-6bfb-40fd-b96a-96bb0855dc78 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:05.379090 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:24:05.379090 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:24:05.387032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57029c9f-6bfb-40fd-b96a-96bb0855dc78 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:05.387489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57029c9f-6bfb-40fd-b96a-96bb0855dc78 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:05.388285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57029c9f-6bfb-40fd-b96a-96bb0855dc78 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:05.388751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57029c9f-6bfb-40fd-b96a-96bb0855dc78 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:05.399947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4d84c2a7-2f2c-4270-be5d-34eb111e05d9 req-12b11314-6442-4946-be73-97784f9ce202 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:05.400430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4d84c2a7-2f2c-4270-be5d-34eb111e05d9 req-12b11314-6442-4946-be73-97784f9ce202 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:05.422444 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4d84c2a7-2f2c-4270-be5d-34eb111e05d9 req-12b11314-6442-4946-be73-97784f9ce202 service nova] Creating event network-changed:0f97ceaa-4db4-492f-b491-b1dca8bd9c03 for instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf on nch1-master-1 Feb 19 21:24:05.428060 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4d84c2a7-2f2c-4270-be5d-34eb111e05d9 req-12b11314-6442-4946-be73-97784f9ce202 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054852 Feb 19 21:24:05.429418 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2753/5418] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:24:05.440547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57029c9f-6bfb-40fd-b96a-96bb0855dc78 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:24:05.538246 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57029c9f-6bfb-40fd-b96a-96bb0855dc78 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 204 len: 0 microversion: 2.1 time: 0.169363 Feb 19 21:24:05.541993 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2666/5419] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:24:05 2022] DELETE /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:24:05.547822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3409190c-bf1b-4161-96c6-b96e6914f64f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:05.548937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3409190c-bf1b-4161-96c6-b96e6914f64f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:05.556645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3409190c-bf1b-4161-96c6-b96e6914f64f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:05.557260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3409190c-bf1b-4161-96c6-b96e6914f64f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:05.558144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3409190c-bf1b-4161-96c6-b96e6914f64f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:05.558864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3409190c-bf1b-4161-96c6-b96e6914f64f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:05.567619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-897d284c-0a4f-488c-8ad0-4344ef49a4fd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:05.568828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-897d284c-0a4f-488c-8ad0-4344ef49a4fd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:05.586330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-897d284c-0a4f-488c-8ad0-4344ef49a4fd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:05.586870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-897d284c-0a4f-488c-8ad0-4344ef49a4fd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:05.588249 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-897d284c-0a4f-488c-8ad0-4344ef49a4fd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:05.588742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-897d284c-0a4f-488c-8ad0-4344ef49a4fd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:06.407292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3409190c-bf1b-4161-96c6-b96e6914f64f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:06.417451 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3409190c-bf1b-4161-96c6-b96e6914f64f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1689 microversion: 2.1 time: 0.873934 Feb 19 21:24:06.418404 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2754/5420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:05 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1689 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:24:06.440293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-897d284c-0a4f-488c-8ad0-4344ef49a4fd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:06.449195 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-897d284c-0a4f-488c-8ad0-4344ef49a4fd tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 200 len: 1577 microversion: 2.1 time: 0.887553 Feb 19 21:24:06.449909 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2667/5421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:05 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 1577 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:06.786841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-fd66a2b9-c8a0-40b4-a200-0b066b38418e req-b84d68e7-7c26-47f3-b380-25dc94feca75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8ac7e3-7628-4c31-a6c8-f5a5d3438541", "name": "network-vif-deleted", "tag": "7bb3e653-b309-4de0-b00d-b7f703e3c0b9"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:06.789777 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:24:06.789777 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:24:06.797565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fd66a2b9-c8a0-40b4-a200-0b066b38418e req-b84d68e7-7c26-47f3-b380-25dc94feca75 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:06.798637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fd66a2b9-c8a0-40b4-a200-0b066b38418e req-b84d68e7-7c26-47f3-b380-25dc94feca75 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:06.810472 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-fd66a2b9-c8a0-40b4-a200-0b066b38418e req-b84d68e7-7c26-47f3-b380-25dc94feca75 service nova] Creating event network-vif-deleted:7bb3e653-b309-4de0-b00d-b7f703e3c0b9 for instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 on nch2-master-1 Feb 19 21:24:06.816369 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-fd66a2b9-c8a0-40b4-a200-0b066b38418e req-b84d68e7-7c26-47f3-b380-25dc94feca75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033631 Feb 19 21:24:06.817298 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2755/5422] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:24:07.435992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc69f791-761d-4daf-8920-dcf81ce795e4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:07.437350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc69f791-761d-4daf-8920-dcf81ce795e4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:07.452463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc69f791-761d-4daf-8920-dcf81ce795e4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:07.455814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc69f791-761d-4daf-8920-dcf81ce795e4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:07.456185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e7722e28-b954-4022-ad61-2ae1362930c6 req-c81bb5ea-ad69-41e5-9d33-2beaaa4fcd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f722d37-ab51-4db4-a5da-1ad2d04becbf", "name": "network-vif-deleted", "tag": "0f97ceaa-4db4-492f-b491-b1dca8bd9c03"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:07.457112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc69f791-761d-4daf-8920-dcf81ce795e4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:07.457338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc69f791-761d-4daf-8920-dcf81ce795e4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:07.459529 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:24:07.459529 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:24:07.468833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e7722e28-b954-4022-ad61-2ae1362930c6 req-c81bb5ea-ad69-41e5-9d33-2beaaa4fcd60 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:07.469754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e7722e28-b954-4022-ad61-2ae1362930c6 req-c81bb5ea-ad69-41e5-9d33-2beaaa4fcd60 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:07.483037 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e7722e28-b954-4022-ad61-2ae1362930c6 req-c81bb5ea-ad69-41e5-9d33-2beaaa4fcd60 service nova] Creating event network-vif-deleted:0f97ceaa-4db4-492f-b491-b1dca8bd9c03 for instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf on nch1-master-1 Feb 19 21:24:07.488236 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e7722e28-b954-4022-ad61-2ae1362930c6 req-c81bb5ea-ad69-41e5-9d33-2beaaa4fcd60 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037546 Feb 19 21:24:07.493040 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2756/5423] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:24:07.499622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-16cceee0-3a84-4ea6-9723-5617a86a64e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:07.500944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-16cceee0-3a84-4ea6-9723-5617a86a64e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:07.508087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16cceee0-3a84-4ea6-9723-5617a86a64e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:07.508616 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16cceee0-3a84-4ea6-9723-5617a86a64e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:07.509439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16cceee0-3a84-4ea6-9723-5617a86a64e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:07.509896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16cceee0-3a84-4ea6-9723-5617a86a64e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:07.526137 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-16cceee0-3a84-4ea6-9723-5617a86a64e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 could not be found. Feb 19 21:24:07.526754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-16cceee0-3a84-4ea6-9723-5617a86a64e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:24:07.527785 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-16cceee0-3a84-4ea6-9723-5617a86a64e9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 404 len: 111 microversion: 2.1 time: 0.033395 Feb 19 21:24:07.528557 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2757/5424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:07 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:24:07.576635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc69f791-761d-4daf-8920-dcf81ce795e4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:07.584627 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc69f791-761d-4daf-8920-dcf81ce795e4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 200 len: 1351 microversion: 2.1 time: 0.152828 Feb 19 21:24:07.586291 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2668/5425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:07 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 1351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:07.641633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1004616323", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1930550294", "security_groups": [{"name": "tempest-secgroup-smoke-124469932"}], "block_device_mapping_v2": [{"uuid": "f7b8b771-4b05-452c-b7b9-907ea4593f17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aea80e2c-9b0e-4c05-b6af-09dfa51c0b19"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:07.773612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] validate_networks() for [('aea80e2c-9b0e-4c05-b6af-09dfa51c0b19', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:24:08.263547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:24:08.263983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:24:08.264518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:24:08.264946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:24:08.265399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:24:08.274405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:08.274882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:08.275712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:08.276163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:08.292443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:24:08.297569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for user 2af13ad54ab048d495e5ff0c0453abb2 and project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:24:08.353116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:24:08.355253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7b8b771-4b05-452c-b7b9-907ea4593f17',volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:24:08.478004 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4831e924-c266-4203-99fe-22f6cb7cd53b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.840111 Feb 19 21:24:08.478996 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2758/5426] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:24:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:24:08.488437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f070f23d-1229-42d1-a6b2-ab37507c3ad2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:08.489081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f070f23d-1229-42d1-a6b2-ab37507c3ad2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:08.544022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f070f23d-1229-42d1-a6b2-ab37507c3ad2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:08.551606 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f070f23d-1229-42d1-a6b2-ab37507c3ad2 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1095 microversion: 2.1 time: 0.066841 Feb 19 21:24:08.552300 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2669/5427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:08 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:08.603261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14aa39cd-2c08-4216-aaa2-c05d496def05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:08.603880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-14aa39cd-2c08-4216-aaa2-c05d496def05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 3f722d37-ab51-4db4-a5da-1ad2d04becbf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:08.609971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14aa39cd-2c08-4216-aaa2-c05d496def05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:08.610432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14aa39cd-2c08-4216-aaa2-c05d496def05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:08.611210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14aa39cd-2c08-4216-aaa2-c05d496def05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:08.611654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-14aa39cd-2c08-4216-aaa2-c05d496def05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:08.625425 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-14aa39cd-2c08-4216-aaa2-c05d496def05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] HTTP exception thrown: Instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf could not be found. Feb 19 21:24:08.626016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-14aa39cd-2c08-4216-aaa2-c05d496def05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Returning 404 to user: Instance 3f722d37-ab51-4db4-a5da-1ad2d04becbf could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:24:08.626832 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-14aa39cd-2c08-4216-aaa2-c05d496def05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf" status: 404 len: 111 microversion: 2.1 time: 0.027907 Feb 19 21:24:08.627369 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2759/5428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:08 2022] GET /compute/v2.1/servers/3f722d37-ab51-4db4-a5da-1ad2d04becbf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:24:09.569025 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-678a6f28-6433-456c-a910-39fe8c7a2142 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:09.570221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-678a6f28-6433-456c-a910-39fe8c7a2142 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:09.682455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-678a6f28-6433-456c-a910-39fe8c7a2142 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:09.693732 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-678a6f28-6433-456c-a910-39fe8c7a2142 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1095 microversion: 2.1 time: 0.128096 Feb 19 21:24:09.704421 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2670/5429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:09 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1095 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:10.714608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-986b42f0-ca23-410e-b57a-72205dbf7da6 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:10.716310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-986b42f0-ca23-410e-b57a-72205dbf7da6 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:10.841402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-986b42f0-ca23-410e-b57a-72205dbf7da6 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:10.849247 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-986b42f0-ca23-410e-b57a-72205dbf7da6 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1095 microversion: 2.1 time: 0.140171 Feb 19 21:24:10.853633 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2760/5430] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:10 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1095 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:11.868999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d44c00a-508d-4768-88f0-e6397779d0fb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:11.869631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2d44c00a-508d-4768-88f0-e6397779d0fb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:11.877654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d44c00a-508d-4768-88f0-e6397779d0fb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:11.878436 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d44c00a-508d-4768-88f0-e6397779d0fb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:11.879803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d44c00a-508d-4768-88f0-e6397779d0fb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:11.880254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d44c00a-508d-4768-88f0-e6397779d0fb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:11.963916 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d44c00a-508d-4768-88f0-e6397779d0fb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:11.971864 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2d44c00a-508d-4768-88f0-e6397779d0fb tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1211 microversion: 2.1 time: 0.108625 Feb 19 21:24:11.972732 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2671/5431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:11 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:12.167712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9d9c6842-6b4b-4185-a9ad-e70a41b1d5d4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '.version_select at 0x7f6479020dc0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:12.208807 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9d9c6842-6b4b-4185-a9ad-e70a41b1d5d4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1696605057" status: 202 len: 0 microversion: 2.1 time: 0.044319 Feb 19 21:24:12.209437 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2761/5432] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Feb 19 21:24:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1696605057 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:24:12.238412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e7fe9fe6-3a16-492d-9a59-2095c3d9ebe7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'create', calling method: .version_select at 0x7f6466af8160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-970664868"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:12.253520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e7fe9fe6-3a16-492d-9a59-2095c3d9ebe7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:24:12.260467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e7fe9fe6-3a16-492d-9a59-2095c3d9ebe7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:24:12.518833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e7fe9fe6-3a16-492d-9a59-2095c3d9ebe7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:24:12.525557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-e7fe9fe6-3a16-492d-9a59-2095c3d9ebe7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:24:12.542900 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e7fe9fe6-3a16-492d-9a59-2095c3d9ebe7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.308302 Feb 19 21:24:12.549276 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2672/5433] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:24:12 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:12.992188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b88eaeb-fd2c-4c48-8f76-367134d522c5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:12.993392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7b88eaeb-fd2c-4c48-8f76-367134d522c5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:13.002229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b88eaeb-fd2c-4c48-8f76-367134d522c5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:13.002698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b88eaeb-fd2c-4c48-8f76-367134d522c5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:13.003540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b88eaeb-fd2c-4c48-8f76-367134d522c5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:13.003992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b88eaeb-fd2c-4c48-8f76-367134d522c5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:13.291182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7b88eaeb-fd2c-4c48-8f76-367134d522c5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:13.302457 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b88eaeb-fd2c-4c48-8f76-367134d522c5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1266 microversion: 2.1 time: 0.315509 Feb 19 21:24:13.304860 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2762/5434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:12 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:13.544267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-9fef9779-af52-4a3a-af75-de80ac79fa25 req-4432ef55-6c0f-480c-9c07-83f5befce1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e", "tag": "b2d024a0-a38a-478b-9cd7-1ffacfb2e493"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:13.550065 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:24:13.550065 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:24:13.565218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9fef9779-af52-4a3a-af75-de80ac79fa25 req-4432ef55-6c0f-480c-9c07-83f5befce1bf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:13.566639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9fef9779-af52-4a3a-af75-de80ac79fa25 req-4432ef55-6c0f-480c-9c07-83f5befce1bf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:13.601859 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-9fef9779-af52-4a3a-af75-de80ac79fa25 req-4432ef55-6c0f-480c-9c07-83f5befce1bf service nova] Creating event network-changed:b2d024a0-a38a-478b-9cd7-1ffacfb2e493 for instance 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e on nch2-master-1 Feb 19 21:24:13.613214 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-9fef9779-af52-4a3a-af75-de80ac79fa25 req-4432ef55-6c0f-480c-9c07-83f5befce1bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072685 Feb 19 21:24:13.623351 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2673/5435] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:24:14.323370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fc68007b-e430-4249-ae31-44b54f11ba90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:14.324009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fc68007b-e430-4249-ae31-44b54f11ba90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:14.331727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc68007b-e430-4249-ae31-44b54f11ba90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:14.332344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc68007b-e430-4249-ae31-44b54f11ba90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:14.333176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc68007b-e430-4249-ae31-44b54f11ba90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:14.333629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fc68007b-e430-4249-ae31-44b54f11ba90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:14.791395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fc68007b-e430-4249-ae31-44b54f11ba90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:14.799246 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fc68007b-e430-4249-ae31-44b54f11ba90 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1266 microversion: 2.1 time: 0.479831 Feb 19 21:24:14.800656 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2763/5436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:14 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1266 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:15.818162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2b59543-bc13-4251-b786-c1eb9cddaca3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:15.819041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2b59543-bc13-4251-b786-c1eb9cddaca3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:15.825405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2b59543-bc13-4251-b786-c1eb9cddaca3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:15.825938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2b59543-bc13-4251-b786-c1eb9cddaca3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:15.826805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2b59543-bc13-4251-b786-c1eb9cddaca3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:15.827332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2b59543-bc13-4251-b786-c1eb9cddaca3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:15.974632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2b59543-bc13-4251-b786-c1eb9cddaca3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:15.984727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2b59543-bc13-4251-b786-c1eb9cddaca3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1266 microversion: 2.1 time: 0.171243 Feb 19 21:24:15.985322 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2674/5437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:15 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:24:17.001324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-be48781c-e4a6-4642-8845-894763c4dd36 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:17.002394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-be48781c-e4a6-4642-8845-894763c4dd36 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:17.010849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be48781c-e4a6-4642-8845-894763c4dd36 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:17.011409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be48781c-e4a6-4642-8845-894763c4dd36 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:17.012383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be48781c-e4a6-4642-8845-894763c4dd36 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:17.013152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be48781c-e4a6-4642-8845-894763c4dd36 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:17.197781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-be48781c-e4a6-4642-8845-894763c4dd36 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:17.211229 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-be48781c-e4a6-4642-8845-894763c4dd36 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1266 microversion: 2.1 time: 0.213096 Feb 19 21:24:17.224394 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2764/5438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:16 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:18.233024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aff76b5a-e4ac-4b08-9f12-65dd001cbc58 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:18.233634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aff76b5a-e4ac-4b08-9f12-65dd001cbc58 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:18.240407 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aff76b5a-e4ac-4b08-9f12-65dd001cbc58 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:18.241097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aff76b5a-e4ac-4b08-9f12-65dd001cbc58 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:18.242383 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aff76b5a-e4ac-4b08-9f12-65dd001cbc58 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:18.242821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aff76b5a-e4ac-4b08-9f12-65dd001cbc58 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:18.455484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aff76b5a-e4ac-4b08-9f12-65dd001cbc58 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:18.467823 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aff76b5a-e4ac-4b08-9f12-65dd001cbc58 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1266 microversion: 2.1 time: 0.238957 Feb 19 21:24:18.469170 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2675/5439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:18 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:19.485600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4c63733b-843e-47f8-ba49-fcf5d8a981b5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:19.487776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4c63733b-843e-47f8-ba49-fcf5d8a981b5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:19.501292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4c63733b-843e-47f8-ba49-fcf5d8a981b5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:19.502029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4c63733b-843e-47f8-ba49-fcf5d8a981b5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:19.503577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4c63733b-843e-47f8-ba49-fcf5d8a981b5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:19.504276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4c63733b-843e-47f8-ba49-fcf5d8a981b5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:19.737577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4c63733b-843e-47f8-ba49-fcf5d8a981b5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:19.746966 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4c63733b-843e-47f8-ba49-fcf5d8a981b5 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1266 microversion: 2.1 time: 0.264989 Feb 19 21:24:19.748806 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2765/5440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:19 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:19.899042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1648218114", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "c93eef5b-a4a6-42d4-a46f-4046e4c6aedd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-970664868", "security_groups": [{"name": "tempest-secgroup-smoke-74274089"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:20.275622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] validate_networks() for [('c93eef5b-a4a6-42d4-a46f-4046e4c6aedd', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:24:20.715214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d808b5a0-74bb-42f7-802e-85ee28b217fc req-db233f1e-4a5c-49cc-bd00-48ed88c713bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e", "name": "network-vif-plugged", "status": "completed", "tag": "b2d024a0-a38a-478b-9cd7-1ffacfb2e493"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:20.716937 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:24:20.716937 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:24:20.745361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d808b5a0-74bb-42f7-802e-85ee28b217fc req-db233f1e-4a5c-49cc-bd00-48ed88c713bd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:20.745813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d808b5a0-74bb-42f7-802e-85ee28b217fc req-db233f1e-4a5c-49cc-bd00-48ed88c713bd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:20.762248 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d808b5a0-74bb-42f7-802e-85ee28b217fc req-db233f1e-4a5c-49cc-bd00-48ed88c713bd service nova] Creating event network-vif-plugged:b2d024a0-a38a-478b-9cd7-1ffacfb2e493 for instance 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e on nch2-master-1 Feb 19 21:24:20.767491 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d808b5a0-74bb-42f7-802e-85ee28b217fc req-db233f1e-4a5c-49cc-bd00-48ed88c713bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190718 Feb 19 21:24:20.768093 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2766/5441] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:24:20.776001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3edf2dac-130e-43fa-bf9a-c437aff92aa0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:20.777051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3edf2dac-130e-43fa-bf9a-c437aff92aa0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:20.785371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3edf2dac-130e-43fa-bf9a-c437aff92aa0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:20.786204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3edf2dac-130e-43fa-bf9a-c437aff92aa0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:20.787192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3edf2dac-130e-43fa-bf9a-c437aff92aa0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:20.787802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3edf2dac-130e-43fa-bf9a-c437aff92aa0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:20.899768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:24:20.900363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:24:20.907730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:24:20.908201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:24:20.908702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:24:20.929624 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:20.929911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:20.934756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:20.935713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:20.967363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:24:20.973486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:24:20.988621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:24:20.991633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:24:21.065837 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ca83029-c51a-4e29-a2b3-391a07ad8219 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.174632 Feb 19 21:24:21.074093 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2676/5442] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:24:19 2022] POST /compute/v2.1/servers => generated 404 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:24:21.097384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb688120-52bd-4ce3-880b-2c1f35d97229 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:21.098901 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb688120-52bd-4ce3-880b-2c1f35d97229 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:21.139271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3edf2dac-130e-43fa-bf9a-c437aff92aa0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:21.155032 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3edf2dac-130e-43fa-bf9a-c437aff92aa0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1266 microversion: 2.1 time: 0.385256 Feb 19 21:24:21.158381 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2767/5443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:20 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:21.208147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cb688120-52bd-4ce3-880b-2c1f35d97229 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:21.216968 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb688120-52bd-4ce3-880b-2c1f35d97229 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1266 microversion: 2.1 time: 0.132593 Feb 19 21:24:21.221950 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2677/5444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:21 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:22.183581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d8b90bab-f756-4e5e-9af1-742e79c90f5b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:22.185019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d8b90bab-f756-4e5e-9af1-742e79c90f5b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:22.204358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8b90bab-f756-4e5e-9af1-742e79c90f5b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:22.205236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8b90bab-f756-4e5e-9af1-742e79c90f5b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:22.206961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8b90bab-f756-4e5e-9af1-742e79c90f5b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:22.211483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d8b90bab-f756-4e5e-9af1-742e79c90f5b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:22.235550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c0c406fa-e6d4-42c9-923c-bd02422146ee tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:22.237009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c0c406fa-e6d4-42c9-923c-bd02422146ee tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:22.252061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0c406fa-e6d4-42c9-923c-bd02422146ee tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:22.252613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0c406fa-e6d4-42c9-923c-bd02422146ee tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:22.253518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0c406fa-e6d4-42c9-923c-bd02422146ee tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:22.253967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c0c406fa-e6d4-42c9-923c-bd02422146ee tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:22.466775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c0c406fa-e6d4-42c9-923c-bd02422146ee tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:22.475773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c0c406fa-e6d4-42c9-923c-bd02422146ee tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1336 microversion: 2.1 time: 0.244053 Feb 19 21:24:22.477196 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2678/5445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:22 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1336 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:22.590760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d8b90bab-f756-4e5e-9af1-742e79c90f5b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:22.606485 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d8b90bab-f756-4e5e-9af1-742e79c90f5b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1266 microversion: 2.1 time: 0.427188 Feb 19 21:24:22.607623 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2768/5446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:22 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1266 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:23.496544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6bd61366-3aea-4f31-bab0-6b4fe393e373 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:23.498356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6bd61366-3aea-4f31-bab0-6b4fe393e373 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:23.505772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6bd61366-3aea-4f31-bab0-6b4fe393e373 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:23.506591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6bd61366-3aea-4f31-bab0-6b4fe393e373 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:23.508159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6bd61366-3aea-4f31-bab0-6b4fe393e373 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:23.508867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6bd61366-3aea-4f31-bab0-6b4fe393e373 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:23.628787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-48dde886-5217-4146-98b0-0842b4c7da99 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:23.632643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-48dde886-5217-4146-98b0-0842b4c7da99 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:23.649986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48dde886-5217-4146-98b0-0842b4c7da99 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:23.650699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48dde886-5217-4146-98b0-0842b4c7da99 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:23.653579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48dde886-5217-4146-98b0-0842b4c7da99 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:23.654230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48dde886-5217-4146-98b0-0842b4c7da99 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:23.728669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6bd61366-3aea-4f31-bab0-6b4fe393e373 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:23.744513 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6bd61366-3aea-4f31-bab0-6b4fe393e373 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1390 microversion: 2.1 time: 0.251470 Feb 19 21:24:23.756866 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2679/5447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:23 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1390 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:23.840575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-48dde886-5217-4146-98b0-0842b4c7da99 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:23.848652 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-48dde886-5217-4146-98b0-0842b4c7da99 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1453 microversion: 2.1 time: 0.227533 Feb 19 21:24:23.855427 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2769/5448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:23 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1453 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:23.865820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d2c212c7-e2e0-4d64-be86-887c4cfa5e9d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:23.867307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d2c212c7-e2e0-4d64-be86-887c4cfa5e9d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:23.877321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2c212c7-e2e0-4d64-be86-887c4cfa5e9d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:23.877778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2c212c7-e2e0-4d64-be86-887c4cfa5e9d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:23.878609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2c212c7-e2e0-4d64-be86-887c4cfa5e9d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:23.879047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d2c212c7-e2e0-4d64-be86-887c4cfa5e9d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:24.047496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8c6dd14b-65e0-4b69-bf47-6f79bc05ca54 req-cf98a60d-332f-4543-afa5-0254047470a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:24.049167 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:24:24.049167 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:24:24.061995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8c6dd14b-65e0-4b69-bf47-6f79bc05ca54 req-cf98a60d-332f-4543-afa5-0254047470a4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:24.062461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8c6dd14b-65e0-4b69-bf47-6f79bc05ca54 req-cf98a60d-332f-4543-afa5-0254047470a4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:24.088970 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8c6dd14b-65e0-4b69-bf47-6f79bc05ca54 req-cf98a60d-332f-4543-afa5-0254047470a4 service nova] Creating event network-changed:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch1-master-1 Feb 19 21:24:24.095119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d2c212c7-e2e0-4d64-be86-887c4cfa5e9d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:24.096635 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8c6dd14b-65e0-4b69-bf47-6f79bc05ca54 req-cf98a60d-332f-4543-afa5-0254047470a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055363 Feb 19 21:24:24.097810 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2770/5449] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:24:24.107628 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d2c212c7-e2e0-4d64-be86-887c4cfa5e9d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1453 microversion: 2.1 time: 0.244324 Feb 19 21:24:24.109076 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2680/5450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:23 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1453 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:24.763784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f239b42-021d-4518-b29a-b1a7fd766d77 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:24.765192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f239b42-021d-4518-b29a-b1a7fd766d77 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:24.772659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f239b42-021d-4518-b29a-b1a7fd766d77 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:24.773421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f239b42-021d-4518-b29a-b1a7fd766d77 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:24.774406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f239b42-021d-4518-b29a-b1a7fd766d77 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:24.774859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f239b42-021d-4518-b29a-b1a7fd766d77 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:25.038043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f239b42-021d-4518-b29a-b1a7fd766d77 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:25.046857 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f239b42-021d-4518-b29a-b1a7fd766d77 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1390 microversion: 2.1 time: 0.287061 Feb 19 21:24:25.048436 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2771/5451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:24 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1390 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:25.896028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-9ce7cd44-1d66-4d8c-8aab-8f555ce1662f req-b31c0efd-5747-4128-bc7f-a49819e44ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e", "tag": "b2d024a0-a38a-478b-9cd7-1ffacfb2e493"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:25.898375 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:24:25.898375 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:24:25.906398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9ce7cd44-1d66-4d8c-8aab-8f555ce1662f req-b31c0efd-5747-4128-bc7f-a49819e44ebe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:25.907101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9ce7cd44-1d66-4d8c-8aab-8f555ce1662f req-b31c0efd-5747-4128-bc7f-a49819e44ebe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:25.918840 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-9ce7cd44-1d66-4d8c-8aab-8f555ce1662f req-b31c0efd-5747-4128-bc7f-a49819e44ebe service nova] Creating event network-changed:b2d024a0-a38a-478b-9cd7-1ffacfb2e493 for instance 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e on nch2-master-1 Feb 19 21:24:25.923842 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-9ce7cd44-1d66-4d8c-8aab-8f555ce1662f req-b31c0efd-5747-4128-bc7f-a49819e44ebe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032192 Feb 19 21:24:25.924682 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2681/5452] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:24:26.065041 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-612146db-6b6b-4945-a18a-f0824f05ccfa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:26.066924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-612146db-6b6b-4945-a18a-f0824f05ccfa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:26.074645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-612146db-6b6b-4945-a18a-f0824f05ccfa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:26.075208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-612146db-6b6b-4945-a18a-f0824f05ccfa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:26.076229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-612146db-6b6b-4945-a18a-f0824f05ccfa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:26.076903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-612146db-6b6b-4945-a18a-f0824f05ccfa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:26.658055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-612146db-6b6b-4945-a18a-f0824f05ccfa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:26.666915 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-612146db-6b6b-4945-a18a-f0824f05ccfa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1390 microversion: 2.1 time: 0.605651 Feb 19 21:24:26.668028 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2772/5453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:26 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1390 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:27.685511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-adc31739-e5e5-4686-8cbc-372dee0fab18 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:27.686205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-adc31739-e5e5-4686-8cbc-372dee0fab18 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:27.692589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adc31739-e5e5-4686-8cbc-372dee0fab18 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:27.693052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adc31739-e5e5-4686-8cbc-372dee0fab18 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:27.693849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adc31739-e5e5-4686-8cbc-372dee0fab18 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:27.694284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-adc31739-e5e5-4686-8cbc-372dee0fab18 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:27.856243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-adc31739-e5e5-4686-8cbc-372dee0fab18 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:27.863925 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-adc31739-e5e5-4686-8cbc-372dee0fab18 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1390 microversion: 2.1 time: 0.184336 Feb 19 21:24:27.864910 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2682/5454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:27 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1390 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:28.881279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f1cd811-07fc-43e9-bf9d-18389d9ad136 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:28.881877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f1cd811-07fc-43e9-bf9d-18389d9ad136 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:28.888642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f1cd811-07fc-43e9-bf9d-18389d9ad136 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:28.889099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f1cd811-07fc-43e9-bf9d-18389d9ad136 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:28.889888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f1cd811-07fc-43e9-bf9d-18389d9ad136 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:28.890333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f1cd811-07fc-43e9-bf9d-18389d9ad136 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:29.028630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1f1cd811-07fc-43e9-bf9d-18389d9ad136 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:29.036056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f1cd811-07fc-43e9-bf9d-18389d9ad136 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1390 microversion: 2.1 time: 0.158470 Feb 19 21:24:29.036906 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2773/5455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:28 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:29.717992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-07e59735-c099-4cd5-b00d-2db3f4a5f23e req-d7808cd9-c818-495b-9054-29a8bbd45cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "name": "network-vif-plugged", "status": "completed", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:29.719573 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:24:29.719573 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:24:29.727450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-07e59735-c099-4cd5-b00d-2db3f4a5f23e req-d7808cd9-c818-495b-9054-29a8bbd45cf2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:29.727956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-07e59735-c099-4cd5-b00d-2db3f4a5f23e req-d7808cd9-c818-495b-9054-29a8bbd45cf2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:29.741639 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-07e59735-c099-4cd5-b00d-2db3f4a5f23e req-d7808cd9-c818-495b-9054-29a8bbd45cf2 service nova] Creating event network-vif-plugged:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch1-master-1 Feb 19 21:24:29.746802 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-07e59735-c099-4cd5-b00d-2db3f4a5f23e req-d7808cd9-c818-495b-9054-29a8bbd45cf2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032508 Feb 19 21:24:29.747511 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2683/5456] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:24:30.053382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e55ba35a-e2e9-4a65-8473-66570deb6f0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:30.054001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e55ba35a-e2e9-4a65-8473-66570deb6f0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:30.061624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e55ba35a-e2e9-4a65-8473-66570deb6f0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:30.062078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e55ba35a-e2e9-4a65-8473-66570deb6f0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:30.062874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e55ba35a-e2e9-4a65-8473-66570deb6f0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:30.063322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e55ba35a-e2e9-4a65-8473-66570deb6f0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:30.201396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e55ba35a-e2e9-4a65-8473-66570deb6f0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:30.209009 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e55ba35a-e2e9-4a65-8473-66570deb6f0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1390 microversion: 2.1 time: 0.159309 Feb 19 21:24:30.209590 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2774/5457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:30 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:31.227270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-24983887-fef1-4a6a-a69c-319ae7d4452e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:31.227997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-24983887-fef1-4a6a-a69c-319ae7d4452e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:31.234290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24983887-fef1-4a6a-a69c-319ae7d4452e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:31.234742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24983887-fef1-4a6a-a69c-319ae7d4452e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:31.235525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24983887-fef1-4a6a-a69c-319ae7d4452e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:31.235964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-24983887-fef1-4a6a-a69c-319ae7d4452e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:31.376981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-24983887-fef1-4a6a-a69c-319ae7d4452e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:31.385009 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-24983887-fef1-4a6a-a69c-319ae7d4452e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1563 microversion: 2.1 time: 0.162597 Feb 19 21:24:31.385609 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2684/5458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:31 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:31.400844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-65a34971-1fe9-43fc-8914-b9478aac56ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:31.401477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-65a34971-1fe9-43fc-8914-b9478aac56ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:31.408194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65a34971-1fe9-43fc-8914-b9478aac56ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:31.408677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65a34971-1fe9-43fc-8914-b9478aac56ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:31.409478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65a34971-1fe9-43fc-8914-b9478aac56ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:31.409932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-65a34971-1fe9-43fc-8914-b9478aac56ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:31.551017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-65a34971-1fe9-43fc-8914-b9478aac56ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:31.559904 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-65a34971-1fe9-43fc-8914-b9478aac56ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1563 microversion: 2.1 time: 0.162656 Feb 19 21:24:31.560542 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2775/5459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:31 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:33.710469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b3617d4-f82e-47ce-8b76-cafc10e98eaa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:24:33.711622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b3617d4-f82e-47ce-8b76-cafc10e98eaa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:33.719601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b3617d4-f82e-47ce-8b76-cafc10e98eaa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:33.720078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b3617d4-f82e-47ce-8b76-cafc10e98eaa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:33.721153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b3617d4-f82e-47ce-8b76-cafc10e98eaa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:33.721801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b3617d4-f82e-47ce-8b76-cafc10e98eaa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:33.745655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6dba4f21-5173-4a79-b58d-308a7e31b3f8 req-c2a2225e-9506-4fc0-aca7-39c43df1c5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:33.747381 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:24:33.747381 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:24:33.756993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6dba4f21-5173-4a79-b58d-308a7e31b3f8 req-c2a2225e-9506-4fc0-aca7-39c43df1c5a5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:33.757807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6dba4f21-5173-4a79-b58d-308a7e31b3f8 req-c2a2225e-9506-4fc0-aca7-39c43df1c5a5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:33.772554 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6dba4f21-5173-4a79-b58d-308a7e31b3f8 req-c2a2225e-9506-4fc0-aca7-39c43df1c5a5 service nova] Creating event network-changed:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch1-master-1 Feb 19 21:24:33.778989 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6dba4f21-5173-4a79-b58d-308a7e31b3f8 req-c2a2225e-9506-4fc0-aca7-39c43df1c5a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037677 Feb 19 21:24:33.779952 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2776/5460] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:24:33.903237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b3617d4-f82e-47ce-8b76-cafc10e98eaa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:24:33.912060 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b3617d4-f82e-47ce-8b76-cafc10e98eaa tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1563 microversion: 2.1 time: 0.205348 Feb 19 21:24:33.912978 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2685/5461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:24:33 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:24:55.182487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dcaf1a2b-17a5-442f-afd0-d79658422a0d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:24:55.183497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dcaf1a2b-17a5-442f-afd0-d79658422a0d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:24:55.189923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a2b-17a5-442f-afd0-d79658422a0d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:55.190387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a2b-17a5-442f-afd0-d79658422a0d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:55.191183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a2b-17a5-442f-afd0-d79658422a0d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:24:55.191629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcaf1a2b-17a5-442f-afd0-d79658422a0d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:24:55.249045 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dcaf1a2b-17a5-442f-afd0-d79658422a0d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action" status: 200 len: 24573 microversion: 2.1 time: 0.071383 Feb 19 21:24:55.249740 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2777/5462] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:24:55 2022] POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:25:06.250839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-77a1bef8-405b-42c1-9b9d-fb6a1b784fe8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:06.251455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-77a1bef8-405b-42c1-9b9d-fb6a1b784fe8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:06.257357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77a1bef8-405b-42c1-9b9d-fb6a1b784fe8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:06.257800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77a1bef8-405b-42c1-9b9d-fb6a1b784fe8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:06.258603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77a1bef8-405b-42c1-9b9d-fb6a1b784fe8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:06.259037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77a1bef8-405b-42c1-9b9d-fb6a1b784fe8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:06.392290 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-77a1bef8-405b-42c1-9b9d-fb6a1b784fe8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1833 microversion: 2.1 time: 0.145322 Feb 19 21:25:06.392905 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2686/5463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:06 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1833 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:06.409114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d3b5c2cb-3368-43c6-9546-c0681614ce73 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:06.409827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d3b5c2cb-3368-43c6-9546-c0681614ce73 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:06.417586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d3b5c2cb-3368-43c6-9546-c0681614ce73 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:06.418054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d3b5c2cb-3368-43c6-9546-c0681614ce73 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:06.418837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d3b5c2cb-3368-43c6-9546-c0681614ce73 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:06.419286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d3b5c2cb-3368-43c6-9546-c0681614ce73 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:06.560356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d3b5c2cb-3368-43c6-9546-c0681614ce73 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:06.567724 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d3b5c2cb-3368-43c6-9546-c0681614ce73 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1682 microversion: 2.1 time: 0.162594 Feb 19 21:25:06.568293 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2778/5464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:06 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:06.662597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c1b8b6e-f002-4619-a6e7-7dfe0b5043e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:25:06.664257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8c1b8b6e-f002-4619-a6e7-7dfe0b5043e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:06.674613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c1b8b6e-f002-4619-a6e7-7dfe0b5043e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:06.675074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c1b8b6e-f002-4619-a6e7-7dfe0b5043e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:06.675875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c1b8b6e-f002-4619-a6e7-7dfe0b5043e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:06.676322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c1b8b6e-f002-4619-a6e7-7dfe0b5043e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:06.725883 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c1b8b6e-f002-4619-a6e7-7dfe0b5043e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action" status: 200 len: 32648 microversion: 2.1 time: 0.070288 Feb 19 21:25:06.729901 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2687/5465] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:25:06 2022] POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action => generated 32648 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:25:06.893850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:25:06.894429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:06.901416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:06.901878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:06.902653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:06.903097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:06.940896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '29d56ddcc91e4058a79c475296502045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79f18c17dc34e7aab590042dec72705', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:06.941505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] flavor_id is None. Assuming migration. {{(pid=136094) resize /opt/stack/nova/nova/compute/api.py:4073}} Feb 19 21:25:06.941959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136094) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:25:07.228223 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fa1a2920-1458-4e66-8c70-8b3e9b249fb8 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action" status: 202 len: 0 microversion: 2.1 time: 0.337768 Feb 19 21:25:07.228930 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2779/5466] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:25:06 2022] POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:25:07.237452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e6d23950-ea80-4abb-bec3-704a422e5533 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:07.238175 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e6d23950-ea80-4abb-bec3-704a422e5533 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:07.245113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d23950-ea80-4abb-bec3-704a422e5533 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:07.245689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d23950-ea80-4abb-bec3-704a422e5533 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:07.246490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d23950-ea80-4abb-bec3-704a422e5533 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:07.246943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e6d23950-ea80-4abb-bec3-704a422e5533 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:07.431543 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e6d23950-ea80-4abb-bec3-704a422e5533 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:07.439081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e6d23950-ea80-4abb-bec3-704a422e5533 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1691 microversion: 2.1 time: 0.205712 Feb 19 21:25:07.439775 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2688/5467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:07 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:08.459546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-32d51a75-c409-4ca9-83b4-29b50d489a83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:08.460296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-32d51a75-c409-4ca9-83b4-29b50d489a83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:08.468154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32d51a75-c409-4ca9-83b4-29b50d489a83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:08.468645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32d51a75-c409-4ca9-83b4-29b50d489a83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:08.469441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32d51a75-c409-4ca9-83b4-29b50d489a83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:08.469891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32d51a75-c409-4ca9-83b4-29b50d489a83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:08.613264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-32d51a75-c409-4ca9-83b4-29b50d489a83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:08.620870 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-32d51a75-c409-4ca9-83b4-29b50d489a83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1691 microversion: 2.1 time: 0.166505 Feb 19 21:25:08.621440 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2780/5468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:08 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:09.638010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f62e3eb-1c6a-46f1-9f1d-0509fa788e83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:09.638537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f62e3eb-1c6a-46f1-9f1d-0509fa788e83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:09.645217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f62e3eb-1c6a-46f1-9f1d-0509fa788e83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:09.645674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f62e3eb-1c6a-46f1-9f1d-0509fa788e83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:09.646469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f62e3eb-1c6a-46f1-9f1d-0509fa788e83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:09.646911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f62e3eb-1c6a-46f1-9f1d-0509fa788e83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:09.785664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f62e3eb-1c6a-46f1-9f1d-0509fa788e83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:09.795412 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f62e3eb-1c6a-46f1-9f1d-0509fa788e83 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.161276 Feb 19 21:25:09.795998 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2689/5469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:09 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:10.814552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c0db68d-97c3-481e-bd0c-ffc773b9c8ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:10.815266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3c0db68d-97c3-481e-bd0c-ffc773b9c8ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:10.822505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c0db68d-97c3-481e-bd0c-ffc773b9c8ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:10.822974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c0db68d-97c3-481e-bd0c-ffc773b9c8ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:10.823760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c0db68d-97c3-481e-bd0c-ffc773b9c8ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:10.824208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c0db68d-97c3-481e-bd0c-ffc773b9c8ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:10.967845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3c0db68d-97c3-481e-bd0c-ffc773b9c8ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:10.975968 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3c0db68d-97c3-481e-bd0c-ffc773b9c8ec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.166118 Feb 19 21:25:10.976625 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2781/5470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:10 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:11.995926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4f53232-a8c4-40b9-9503-c1df1687a566 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:11.996731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c4f53232-a8c4-40b9-9503-c1df1687a566 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:12.005589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4f53232-a8c4-40b9-9503-c1df1687a566 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:12.006119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4f53232-a8c4-40b9-9503-c1df1687a566 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:12.007516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4f53232-a8c4-40b9-9503-c1df1687a566 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:12.007960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4f53232-a8c4-40b9-9503-c1df1687a566 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:12.522197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4f53232-a8c4-40b9-9503-c1df1687a566 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:12.531163 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c4f53232-a8c4-40b9-9503-c1df1687a566 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.540997 Feb 19 21:25:12.531918 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2690/5471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:11 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:13.551233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d26d03d0-7324-4bbb-a026-557b9adac72e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:13.551899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d26d03d0-7324-4bbb-a026-557b9adac72e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:13.559886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d26d03d0-7324-4bbb-a026-557b9adac72e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:13.560354 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d26d03d0-7324-4bbb-a026-557b9adac72e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:13.561175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d26d03d0-7324-4bbb-a026-557b9adac72e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:13.561635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d26d03d0-7324-4bbb-a026-557b9adac72e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:13.710008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d26d03d0-7324-4bbb-a026-557b9adac72e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:13.718531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d26d03d0-7324-4bbb-a026-557b9adac72e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.171623 Feb 19 21:25:13.719176 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2782/5472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:13 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:14.737863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d9e4d567-20a9-4a31-aa73-347371167725 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:14.738521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d9e4d567-20a9-4a31-aa73-347371167725 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:14.746719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9e4d567-20a9-4a31-aa73-347371167725 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:14.747168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9e4d567-20a9-4a31-aa73-347371167725 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:14.747968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9e4d567-20a9-4a31-aa73-347371167725 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:14.748433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d9e4d567-20a9-4a31-aa73-347371167725 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:14.899080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d9e4d567-20a9-4a31-aa73-347371167725 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:14.908862 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d9e4d567-20a9-4a31-aa73-347371167725 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.175276 Feb 19 21:25:14.909606 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2691/5473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:14 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:25:15.928290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-794e1245-f761-4b0e-b27e-46005bf1f985 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:15.928925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-794e1245-f761-4b0e-b27e-46005bf1f985 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:15.937226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-794e1245-f761-4b0e-b27e-46005bf1f985 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:15.937815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-794e1245-f761-4b0e-b27e-46005bf1f985 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:15.938747 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-794e1245-f761-4b0e-b27e-46005bf1f985 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:15.939399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-794e1245-f761-4b0e-b27e-46005bf1f985 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:16.109615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-794e1245-f761-4b0e-b27e-46005bf1f985 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:16.120216 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-794e1245-f761-4b0e-b27e-46005bf1f985 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.195307 Feb 19 21:25:16.121125 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2783/5474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:15 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:17.139210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bed38808-ee60-43dc-ac56-7d04fdd34b0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:17.139818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bed38808-ee60-43dc-ac56-7d04fdd34b0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:17.147101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bed38808-ee60-43dc-ac56-7d04fdd34b0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:17.147658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bed38808-ee60-43dc-ac56-7d04fdd34b0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:17.148472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bed38808-ee60-43dc-ac56-7d04fdd34b0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:17.148954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bed38808-ee60-43dc-ac56-7d04fdd34b0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:17.293981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bed38808-ee60-43dc-ac56-7d04fdd34b0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:17.302128 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bed38808-ee60-43dc-ac56-7d04fdd34b0a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.167186 Feb 19 21:25:17.302714 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2692/5475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:17 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:18.320830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5b9955ce-c5d3-428e-8488-ec85cb2f606e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:18.321458 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5b9955ce-c5d3-428e-8488-ec85cb2f606e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:18.328147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b9955ce-c5d3-428e-8488-ec85cb2f606e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:18.328639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b9955ce-c5d3-428e-8488-ec85cb2f606e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:18.329687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b9955ce-c5d3-428e-8488-ec85cb2f606e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:18.330142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5b9955ce-c5d3-428e-8488-ec85cb2f606e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:18.478537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5b9955ce-c5d3-428e-8488-ec85cb2f606e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:18.487799 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5b9955ce-c5d3-428e-8488-ec85cb2f606e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.170641 Feb 19 21:25:18.488408 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2784/5476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:18 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:19.505822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a31a0570-0f16-4699-8877-26d85b225ef2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:19.506652 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a31a0570-0f16-4699-8877-26d85b225ef2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:19.514451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a31a0570-0f16-4699-8877-26d85b225ef2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:19.514900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a31a0570-0f16-4699-8877-26d85b225ef2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:19.515677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a31a0570-0f16-4699-8877-26d85b225ef2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:19.516111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a31a0570-0f16-4699-8877-26d85b225ef2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:19.651388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a31a0570-0f16-4699-8877-26d85b225ef2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:19.658690 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a31a0570-0f16-4699-8877-26d85b225ef2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.156646 Feb 19 21:25:19.659262 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2693/5477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:19 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:20.676074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7dded044-bf72-4f98-b2e3-cab98ede9259 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:20.676728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7dded044-bf72-4f98-b2e3-cab98ede9259 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:20.683438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7dded044-bf72-4f98-b2e3-cab98ede9259 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:20.683901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7dded044-bf72-4f98-b2e3-cab98ede9259 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:20.684721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7dded044-bf72-4f98-b2e3-cab98ede9259 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:20.685171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7dded044-bf72-4f98-b2e3-cab98ede9259 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:20.826048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7dded044-bf72-4f98-b2e3-cab98ede9259 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:20.833847 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7dded044-bf72-4f98-b2e3-cab98ede9259 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.161441 Feb 19 21:25:20.834580 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2785/5478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:20 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:21.850807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-75e39902-aeaa-42c5-80db-457b4b89ce05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:21.851416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-75e39902-aeaa-42c5-80db-457b4b89ce05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:21.859015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e39902-aeaa-42c5-80db-457b4b89ce05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:21.859472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e39902-aeaa-42c5-80db-457b4b89ce05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:21.860719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e39902-aeaa-42c5-80db-457b4b89ce05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:21.861448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e39902-aeaa-42c5-80db-457b4b89ce05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:21.995628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-75e39902-aeaa-42c5-80db-457b4b89ce05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:22.003028 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-75e39902-aeaa-42c5-80db-457b4b89ce05 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.155956 Feb 19 21:25:22.003628 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2694/5479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:21 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:23.020833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f699a937-b656-4841-89ff-ab6194a4eeb9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:23.021455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f699a937-b656-4841-89ff-ab6194a4eeb9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:23.029346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f699a937-b656-4841-89ff-ab6194a4eeb9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:23.029844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f699a937-b656-4841-89ff-ab6194a4eeb9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:23.030734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f699a937-b656-4841-89ff-ab6194a4eeb9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:23.031246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f699a937-b656-4841-89ff-ab6194a4eeb9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:23.182664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f699a937-b656-4841-89ff-ab6194a4eeb9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:23.194584 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f699a937-b656-4841-89ff-ab6194a4eeb9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.177497 Feb 19 21:25:23.195158 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2786/5480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:23 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:24.213029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d4feaeee-dd18-48f1-a435-a65c4328cec3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:24.213670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d4feaeee-dd18-48f1-a435-a65c4328cec3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:24.220903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4feaeee-dd18-48f1-a435-a65c4328cec3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:24.221356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4feaeee-dd18-48f1-a435-a65c4328cec3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:24.222144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4feaeee-dd18-48f1-a435-a65c4328cec3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:24.222583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d4feaeee-dd18-48f1-a435-a65c4328cec3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:24.369778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d4feaeee-dd18-48f1-a435-a65c4328cec3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:24.378560 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d4feaeee-dd18-48f1-a435-a65c4328cec3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.169343 Feb 19 21:25:24.379140 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2695/5481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:24 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:25.396636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4bc02df2-4eb7-4724-af88-079796cd3364 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:25.397262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4bc02df2-4eb7-4724-af88-079796cd3364 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:25.404020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4bc02df2-4eb7-4724-af88-079796cd3364 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:25.404528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4bc02df2-4eb7-4724-af88-079796cd3364 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:25.405319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4bc02df2-4eb7-4724-af88-079796cd3364 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:25.405768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4bc02df2-4eb7-4724-af88-079796cd3364 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:25.543657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4bc02df2-4eb7-4724-af88-079796cd3364 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:25.551477 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4bc02df2-4eb7-4724-af88-079796cd3364 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1696 microversion: 2.1 time: 0.158623 Feb 19 21:25:25.552061 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2787/5482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:25 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:26.534665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-25d932c3-8828-4552-a6d9-e99a8c6b6aaa req-3730feb5-54c0-4d66-9733-d8c7e56c15a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "name": "network-vif-unplugged", "status": "completed", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:25:26.536231 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:25:26.536231 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:25:26.544361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-25d932c3-8828-4552-a6d9-e99a8c6b6aaa req-3730feb5-54c0-4d66-9733-d8c7e56c15a1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:26.544906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-25d932c3-8828-4552-a6d9-e99a8c6b6aaa req-3730feb5-54c0-4d66-9733-d8c7e56c15a1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:26.557182 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-25d932c3-8828-4552-a6d9-e99a8c6b6aaa req-3730feb5-54c0-4d66-9733-d8c7e56c15a1 service nova] Creating event network-vif-unplugged:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch2-master-1 Feb 19 21:25:26.564265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-25d932c3-8828-4552-a6d9-e99a8c6b6aaa req-3730feb5-54c0-4d66-9733-d8c7e56c15a1 service nova] Instance e9ab3096-5aa0-4585-a188-685cb7322fb6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:25:26.569649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab8c41ef-44f4-4113-8f43-f62f89752f49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:26.570438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ab8c41ef-44f4-4113-8f43-f62f89752f49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:26.579290 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-25d932c3-8828-4552-a6d9-e99a8c6b6aaa req-3730feb5-54c0-4d66-9733-d8c7e56c15a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048146 Feb 19 21:25:26.579993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab8c41ef-44f4-4113-8f43-f62f89752f49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:26.580517 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2696/5483] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:25:26.580663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab8c41ef-44f4-4113-8f43-f62f89752f49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:26.581310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab8c41ef-44f4-4113-8f43-f62f89752f49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:26.581764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab8c41ef-44f4-4113-8f43-f62f89752f49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:26.918430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ab8c41ef-44f4-4113-8f43-f62f89752f49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:26.927112 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab8c41ef-44f4-4113-8f43-f62f89752f49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1695 microversion: 2.1 time: 0.361110 Feb 19 21:25:26.927957 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2788/5484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:26 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1695 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:25:27.946648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71b1ffa6-278f-43c4-b188-bbd06f7bb751 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:27.947231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-71b1ffa6-278f-43c4-b188-bbd06f7bb751 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:27.955181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71b1ffa6-278f-43c4-b188-bbd06f7bb751 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:27.955632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71b1ffa6-278f-43c4-b188-bbd06f7bb751 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:27.956465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71b1ffa6-278f-43c4-b188-bbd06f7bb751 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:27.956947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71b1ffa6-278f-43c4-b188-bbd06f7bb751 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:28.109012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-71b1ffa6-278f-43c4-b188-bbd06f7bb751 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:28.117865 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71b1ffa6-278f-43c4-b188-bbd06f7bb751 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1693 microversion: 2.1 time: 0.175855 Feb 19 21:25:28.118597 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2697/5485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:27 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:28.597641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-87679b16-3115-4756-a89f-057b4bc4cc34 req-185e92f0-542d-476f-9bec-3596d141a392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:25:28.599189 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:25:28.599189 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:25:28.607852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-87679b16-3115-4756-a89f-057b4bc4cc34 req-185e92f0-542d-476f-9bec-3596d141a392 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:28.608389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-87679b16-3115-4756-a89f-057b4bc4cc34 req-185e92f0-542d-476f-9bec-3596d141a392 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:28.620801 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-87679b16-3115-4756-a89f-057b4bc4cc34 req-185e92f0-542d-476f-9bec-3596d141a392 service nova] Creating event network-changed:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch2-master-1 Feb 19 21:25:28.626993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-87679b16-3115-4756-a89f-057b4bc4cc34 req-185e92f0-542d-476f-9bec-3596d141a392 service nova] Instance e9ab3096-5aa0-4585-a188-685cb7322fb6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:25:28.639155 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-87679b16-3115-4756-a89f-057b4bc4cc34 req-185e92f0-542d-476f-9bec-3596d141a392 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045161 Feb 19 21:25:28.640016 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2789/5486] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:25:29.137042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-23f62a4f-8d85-4507-b1e1-1eac068fd6af tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:29.138016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-23f62a4f-8d85-4507-b1e1-1eac068fd6af tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:29.145430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23f62a4f-8d85-4507-b1e1-1eac068fd6af tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:29.145896 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23f62a4f-8d85-4507-b1e1-1eac068fd6af tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:29.146966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23f62a4f-8d85-4507-b1e1-1eac068fd6af tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:29.147851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-23f62a4f-8d85-4507-b1e1-1eac068fd6af tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:29.373945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-23f62a4f-8d85-4507-b1e1-1eac068fd6af tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:29.383662 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-23f62a4f-8d85-4507-b1e1-1eac068fd6af tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1693 microversion: 2.1 time: 0.250435 Feb 19 21:25:29.384010 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2698/5487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:29 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1693 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:30.403468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a00d4f2a-de47-49e5-8e19-28c3c0c49c2e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:30.404174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a00d4f2a-de47-49e5-8e19-28c3c0c49c2e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:30.410444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a00d4f2a-de47-49e5-8e19-28c3c0c49c2e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:30.410901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a00d4f2a-de47-49e5-8e19-28c3c0c49c2e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:30.411681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a00d4f2a-de47-49e5-8e19-28c3c0c49c2e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:30.412128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a00d4f2a-de47-49e5-8e19-28c3c0c49c2e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:30.608708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a00d4f2a-de47-49e5-8e19-28c3c0c49c2e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:30.616181 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a00d4f2a-de47-49e5-8e19-28c3c0c49c2e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1693 microversion: 2.1 time: 0.217552 Feb 19 21:25:30.616721 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2790/5488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:30 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1693 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:31.634675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e9ec2add-534f-4e1c-a49d-9506ec2e94c4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:31.635225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e9ec2add-534f-4e1c-a49d-9506ec2e94c4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:31.642569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9ec2add-534f-4e1c-a49d-9506ec2e94c4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:31.643017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9ec2add-534f-4e1c-a49d-9506ec2e94c4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:31.643789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9ec2add-534f-4e1c-a49d-9506ec2e94c4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:31.644227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e9ec2add-534f-4e1c-a49d-9506ec2e94c4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:31.795117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e9ec2add-534f-4e1c-a49d-9506ec2e94c4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:31.802892 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e9ec2add-534f-4e1c-a49d-9506ec2e94c4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1690 microversion: 2.1 time: 0.172478 Feb 19 21:25:31.803566 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2699/5489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:31 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:31.820596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0a76ad44-7ae2-45a1-9dd7-83da226d57dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:25:31.821154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0a76ad44-7ae2-45a1-9dd7-83da226d57dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:31.829520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a76ad44-7ae2-45a1-9dd7-83da226d57dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:31.830114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a76ad44-7ae2-45a1-9dd7-83da226d57dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:31.830916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a76ad44-7ae2-45a1-9dd7-83da226d57dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:31.831371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0a76ad44-7ae2-45a1-9dd7-83da226d57dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:31.940150 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0a76ad44-7ae2-45a1-9dd7-83da226d57dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action" status: 202 len: 0 microversion: 2.1 time: 0.123936 Feb 19 21:25:31.940844 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2791/5490] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:25:31 2022] POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:25:31.948913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a47dc451-d956-435a-b111-dbff7d6c0fbc tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:31.949520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a47dc451-d956-435a-b111-dbff7d6c0fbc tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:31.956820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a47dc451-d956-435a-b111-dbff7d6c0fbc tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:31.957336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a47dc451-d956-435a-b111-dbff7d6c0fbc tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:31.958052 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a47dc451-d956-435a-b111-dbff7d6c0fbc tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:31.958522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a47dc451-d956-435a-b111-dbff7d6c0fbc tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:32.165207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a47dc451-d956-435a-b111-dbff7d6c0fbc tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:32.173372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a47dc451-d956-435a-b111-dbff7d6c0fbc tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1689 microversion: 2.1 time: 0.228132 Feb 19 21:25:32.173969 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2700/5491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:31 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:33.196928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7283f4f5-ee1e-41b3-b890-ae96fd716754 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:33.197814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7283f4f5-ee1e-41b3-b890-ae96fd716754 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:33.205014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7283f4f5-ee1e-41b3-b890-ae96fd716754 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:33.205483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7283f4f5-ee1e-41b3-b890-ae96fd716754 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:33.206292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7283f4f5-ee1e-41b3-b890-ae96fd716754 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:33.206740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7283f4f5-ee1e-41b3-b890-ae96fd716754 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:33.350281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7283f4f5-ee1e-41b3-b890-ae96fd716754 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:33.357712 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7283f4f5-ee1e-41b3-b890-ae96fd716754 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1689 microversion: 2.1 time: 0.170369 Feb 19 21:25:33.358325 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2792/5492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:33 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:34.374578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9c6540f7-3900-4972-a025-c24b7646ed72 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:34.375827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9c6540f7-3900-4972-a025-c24b7646ed72 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:34.382781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c6540f7-3900-4972-a025-c24b7646ed72 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:34.383242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c6540f7-3900-4972-a025-c24b7646ed72 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:34.384597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c6540f7-3900-4972-a025-c24b7646ed72 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:34.385039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c6540f7-3900-4972-a025-c24b7646ed72 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:34.507273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9f1eb169-a2f4-4be4-aca9-8bf4ed26be67 req-6fec5e27-e3af-405e-bda4-357a4fc5bb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "name": "network-vif-plugged", "status": "completed", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:25:34.508989 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:25:34.508989 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:25:34.517315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9f1eb169-a2f4-4be4-aca9-8bf4ed26be67 req-6fec5e27-e3af-405e-bda4-357a4fc5bb9a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:34.518496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9f1eb169-a2f4-4be4-aca9-8bf4ed26be67 req-6fec5e27-e3af-405e-bda4-357a4fc5bb9a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:34.528045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9c6540f7-3900-4972-a025-c24b7646ed72 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:34.537004 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9c6540f7-3900-4972-a025-c24b7646ed72 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1689 microversion: 2.1 time: 0.165961 Feb 19 21:25:34.540098 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2701/5493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:34 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:34.545297 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9f1eb169-a2f4-4be4-aca9-8bf4ed26be67 req-6fec5e27-e3af-405e-bda4-357a4fc5bb9a service nova] Creating event network-vif-plugged:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch2-master-1 Feb 19 21:25:34.551111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-9f1eb169-a2f4-4be4-aca9-8bf4ed26be67 req-6fec5e27-e3af-405e-bda4-357a4fc5bb9a service nova] Instance e9ab3096-5aa0-4585-a188-685cb7322fb6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:25:34.562886 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9f1eb169-a2f4-4be4-aca9-8bf4ed26be67 req-6fec5e27-e3af-405e-bda4-357a4fc5bb9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059813 Feb 19 21:25:34.563497 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2793/5494] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:25:35.283399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-7d80d0e5-520b-4f45-b04e-4b2aa1400973 req-c255af2d-6ce5-4f27-9cfa-c216b0fbf6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "name": "network-vif-unplugged", "status": "completed", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:25:35.284981 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:25:35.284981 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:25:35.292069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7d80d0e5-520b-4f45-b04e-4b2aa1400973 req-c255af2d-6ce5-4f27-9cfa-c216b0fbf6d5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:35.292546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7d80d0e5-520b-4f45-b04e-4b2aa1400973 req-c255af2d-6ce5-4f27-9cfa-c216b0fbf6d5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:35.305295 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-7d80d0e5-520b-4f45-b04e-4b2aa1400973 req-c255af2d-6ce5-4f27-9cfa-c216b0fbf6d5 service nova] Creating event network-vif-unplugged:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch1-master-1 Feb 19 21:25:35.311500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-7d80d0e5-520b-4f45-b04e-4b2aa1400973 req-c255af2d-6ce5-4f27-9cfa-c216b0fbf6d5 service nova] Instance e9ab3096-5aa0-4585-a188-685cb7322fb6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:25:35.323155 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-7d80d0e5-520b-4f45-b04e-4b2aa1400973 req-c255af2d-6ce5-4f27-9cfa-c216b0fbf6d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043479 Feb 19 21:25:35.323801 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2702/5495] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:25:35.558395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e408a999-46dc-4442-8618-9c28fd409aca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:35.559062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e408a999-46dc-4442-8618-9c28fd409aca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:35.565084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e408a999-46dc-4442-8618-9c28fd409aca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:35.565549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e408a999-46dc-4442-8618-9c28fd409aca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:35.566344 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e408a999-46dc-4442-8618-9c28fd409aca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:35.566792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e408a999-46dc-4442-8618-9c28fd409aca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:35.719158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e408a999-46dc-4442-8618-9c28fd409aca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:35.727771 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e408a999-46dc-4442-8618-9c28fd409aca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1689 microversion: 2.1 time: 0.174209 Feb 19 21:25:35.728895 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2794/5496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:35 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:36.746804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a6ec42c6-e39a-4d57-b404-09f3c9305106 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:36.748073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a6ec42c6-e39a-4d57-b404-09f3c9305106 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:36.754489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6ec42c6-e39a-4d57-b404-09f3c9305106 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:36.754943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6ec42c6-e39a-4d57-b404-09f3c9305106 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:36.755771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6ec42c6-e39a-4d57-b404-09f3c9305106 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:36.756358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a6ec42c6-e39a-4d57-b404-09f3c9305106 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:36.889982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a6ec42c6-e39a-4d57-b404-09f3c9305106 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:36.897379 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a6ec42c6-e39a-4d57-b404-09f3c9305106 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1689 microversion: 2.1 time: 0.155525 Feb 19 21:25:36.897962 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2703/5497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:36 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:37.349186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9150464d-64b0-461f-b3cd-ae2db4982c2a req-b1ea169d-1c30-4629-96d4-70fb0fe92153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:25:37.351101 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:25:37.351101 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:25:37.358796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9150464d-64b0-461f-b3cd-ae2db4982c2a req-b1ea169d-1c30-4629-96d4-70fb0fe92153 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:37.359247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9150464d-64b0-461f-b3cd-ae2db4982c2a req-b1ea169d-1c30-4629-96d4-70fb0fe92153 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:37.370652 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9150464d-64b0-461f-b3cd-ae2db4982c2a req-b1ea169d-1c30-4629-96d4-70fb0fe92153 service nova] Creating event network-changed:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch1-master-1 Feb 19 21:25:37.375744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-9150464d-64b0-461f-b3cd-ae2db4982c2a req-b1ea169d-1c30-4629-96d4-70fb0fe92153 service nova] Instance e9ab3096-5aa0-4585-a188-685cb7322fb6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:25:37.386768 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9150464d-64b0-461f-b3cd-ae2db4982c2a req-b1ea169d-1c30-4629-96d4-70fb0fe92153 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041378 Feb 19 21:25:37.387361 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2795/5498] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:25:37.916967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a7e69916-3e19-42fa-b8b0-2dcd337ae4dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:25:37.917579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a7e69916-3e19-42fa-b8b0-2dcd337ae4dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:25:37.925058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7e69916-3e19-42fa-b8b0-2dcd337ae4dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:37.925784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7e69916-3e19-42fa-b8b0-2dcd337ae4dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:37.926661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7e69916-3e19-42fa-b8b0-2dcd337ae4dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:37.927184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a7e69916-3e19-42fa-b8b0-2dcd337ae4dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:38.071280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a7e69916-3e19-42fa-b8b0-2dcd337ae4dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:25:38.078721 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a7e69916-3e19-42fa-b8b0-2dcd337ae4dd tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1682 microversion: 2.1 time: 0.167309 Feb 19 21:25:38.079316 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2704/5499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:25:37 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:25:41.991080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e4f25510-9ab8-40eb-8f37-204f994f60a2 req-edfd12f7-b6b6-4e12-9aa1-9be33568248f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "name": "network-vif-plugged", "status": "completed", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:25:41.992582 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:25:41.992582 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:25:42.000852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e4f25510-9ab8-40eb-8f37-204f994f60a2 req-edfd12f7-b6b6-4e12-9aa1-9be33568248f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:25:42.001325 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e4f25510-9ab8-40eb-8f37-204f994f60a2 req-edfd12f7-b6b6-4e12-9aa1-9be33568248f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:25:42.012322 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e4f25510-9ab8-40eb-8f37-204f994f60a2 req-edfd12f7-b6b6-4e12-9aa1-9be33568248f service nova] Creating event network-vif-plugged:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch1-master-1 Feb 19 21:25:42.017397 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e4f25510-9ab8-40eb-8f37-204f994f60a2 req-edfd12f7-b6b6-4e12-9aa1-9be33568248f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031198 Feb 19 21:25:42.017999 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2796/5500] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:26:02.270930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca10542f-ce13-4978-85f5-737699f8bd33 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:02.271835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ca10542f-ce13-4978-85f5-737699f8bd33 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:02.278269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca10542f-ce13-4978-85f5-737699f8bd33 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:02.278710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca10542f-ce13-4978-85f5-737699f8bd33 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:02.279478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca10542f-ce13-4978-85f5-737699f8bd33 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:02.279910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca10542f-ce13-4978-85f5-737699f8bd33 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:02.332966 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ca10542f-ce13-4978-85f5-737699f8bd33 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action" status: 200 len: 63236 microversion: 2.1 time: 0.065705 Feb 19 21:26:02.333623 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2705/5501] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:26:02 2022] POST /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6/action => generated 63236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:26:08.670144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-34ec44d0-15f0-43d6-a09b-78366fee6641 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:08.671123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-34ec44d0-15f0-43d6-a09b-78366fee6641 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:08.677407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34ec44d0-15f0-43d6-a09b-78366fee6641 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:08.677874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34ec44d0-15f0-43d6-a09b-78366fee6641 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:08.678672 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34ec44d0-15f0-43d6-a09b-78366fee6641 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:08.679118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34ec44d0-15f0-43d6-a09b-78366fee6641 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:08.820931 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-34ec44d0-15f0-43d6-a09b-78366fee6641 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1833 microversion: 2.1 time: 0.156706 Feb 19 21:26:08.821519 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2797/5502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:08 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1833 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:10.010937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-289134602", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1930550294", "security_groups": [{"name": "tempest-secgroup-smoke-124469932"}], "block_device_mapping_v2": [{"uuid": "2fb22bc4-5b5a-4c49-8ee0-26772c8d7020", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aea80e2c-9b0e-4c05-b6af-09dfa51c0b19"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:10.035242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-590ca1ff-7060-41e3-a9c7-972288fe5561 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:10.035795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-590ca1ff-7060-41e3-a9c7-972288fe5561 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:10.043948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-590ca1ff-7060-41e3-a9c7-972288fe5561 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:10.045362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-590ca1ff-7060-41e3-a9c7-972288fe5561 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:10.046734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-590ca1ff-7060-41e3-a9c7-972288fe5561 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:10.047193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-590ca1ff-7060-41e3-a9c7-972288fe5561 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:10.072482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-590ca1ff-7060-41e3-a9c7-972288fe5561 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:26:10.140475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] validate_networks() for [('aea80e2c-9b0e-4c05-b6af-09dfa51c0b19', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:26:10.153544 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-590ca1ff-7060-41e3-a9c7-972288fe5561 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 204 len: 0 microversion: 2.1 time: 0.121464 Feb 19 21:26:10.159146 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2798/5503] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:26:10 2022] DELETE /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:26:10.234246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-59ff4a45-8fe6-410b-8a17-38a681c9116e req-d3976cac-9f57-4e92-b21e-80e707307ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:10.235811 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:26:10.235811 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:26:10.243187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-59ff4a45-8fe6-410b-8a17-38a681c9116e req-d3976cac-9f57-4e92-b21e-80e707307ce9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:10.243644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-59ff4a45-8fe6-410b-8a17-38a681c9116e req-d3976cac-9f57-4e92-b21e-80e707307ce9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:10.255463 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-59ff4a45-8fe6-410b-8a17-38a681c9116e req-d3976cac-9f57-4e92-b21e-80e707307ce9 service nova] Creating event network-changed:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch1-master-1 Feb 19 21:26:10.260704 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-59ff4a45-8fe6-410b-8a17-38a681c9116e req-d3976cac-9f57-4e92-b21e-80e707307ce9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099830 Feb 19 21:26:10.261694 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2799/5504] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:26:10.267185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-51cd8ab9-ce97-4d6a-89d2-e7c18c0cb70b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:10.268690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-51cd8ab9-ce97-4d6a-89d2-e7c18c0cb70b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:10.275641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-51cd8ab9-ce97-4d6a-89d2-e7c18c0cb70b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:10.276449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-51cd8ab9-ce97-4d6a-89d2-e7c18c0cb70b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:10.277416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-51cd8ab9-ce97-4d6a-89d2-e7c18c0cb70b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:10.279422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-51cd8ab9-ce97-4d6a-89d2-e7c18c0cb70b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:10.478457 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-51cd8ab9-ce97-4d6a-89d2-e7c18c0cb70b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:10.489019 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-51cd8ab9-ce97-4d6a-89d2-e7c18c0cb70b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1688 microversion: 2.1 time: 0.226113 Feb 19 21:26:10.490471 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2800/5505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:10 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:10.679640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:26:10.680067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:26:10.681127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:26:10.681553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:26:10.681970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:26:10.691989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:10.692806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:10.693897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:10.694526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:10.714423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:26:10.719578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Getting quotas for user 2af13ad54ab048d495e5ff0c0453abb2 and project c88a055c429b4b9e8e86a370c8571785. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:26:10.778246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:26:10.780825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fb22bc4-5b5a-4c49-8ee0-26772c8d7020',volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:26:10.904518 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a43b3b36-42eb-4ab4-b593-96d3ac5f5da3 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.897538 Feb 19 21:26:10.905331 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2706/5506] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:26:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:26:10.920284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fa061812-8848-4849-a1fe-24f5378a62b8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:10.920975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fa061812-8848-4849-a1fe-24f5378a62b8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:10.976177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fa061812-8848-4849-a1fe-24f5378a62b8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:10.985367 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fa061812-8848-4849-a1fe-24f5378a62b8 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1094 microversion: 2.1 time: 0.073303 Feb 19 21:26:10.985563 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2801/5507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:10 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:26:11.509732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-208dfa08-51b9-4792-bf27-84a6a9594bec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:11.511030 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-208dfa08-51b9-4792-bf27-84a6a9594bec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:11.518798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208dfa08-51b9-4792-bf27-84a6a9594bec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:11.519656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208dfa08-51b9-4792-bf27-84a6a9594bec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:11.520666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208dfa08-51b9-4792-bf27-84a6a9594bec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:11.521121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208dfa08-51b9-4792-bf27-84a6a9594bec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:11.667928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-208dfa08-51b9-4792-bf27-84a6a9594bec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:11.675521 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-208dfa08-51b9-4792-bf27-84a6a9594bec tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 200 len: 1569 microversion: 2.1 time: 0.170970 Feb 19 21:26:11.676194 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2707/5508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:11 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:12.004193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8b15072-dac9-40fe-9b0c-4d7ccebf2b2c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:12.005417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e8b15072-dac9-40fe-9b0c-4d7ccebf2b2c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:12.019768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8b15072-dac9-40fe-9b0c-4d7ccebf2b2c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:12.020222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8b15072-dac9-40fe-9b0c-4d7ccebf2b2c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:12.021060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8b15072-dac9-40fe-9b0c-4d7ccebf2b2c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:12.021504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8b15072-dac9-40fe-9b0c-4d7ccebf2b2c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:12.082365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-5448ddae-47ad-47fb-a637-6adb1d6ee240 req-4d96821e-ebab-452d-a1fe-04d070e1d182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab3096-5aa0-4585-a188-685cb7322fb6", "name": "network-vif-deleted", "tag": "15cc356c-3163-4eb8-ac97-f21ca45f9a33"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:12.083931 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:26:12.083931 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:26:12.095109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5448ddae-47ad-47fb-a637-6adb1d6ee240 req-4d96821e-ebab-452d-a1fe-04d070e1d182 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:12.095862 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-5448ddae-47ad-47fb-a637-6adb1d6ee240 req-4d96821e-ebab-452d-a1fe-04d070e1d182 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:12.107549 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-5448ddae-47ad-47fb-a637-6adb1d6ee240 req-4d96821e-ebab-452d-a1fe-04d070e1d182 service nova] Creating event network-vif-deleted:15cc356c-3163-4eb8-ac97-f21ca45f9a33 for instance e9ab3096-5aa0-4585-a188-685cb7322fb6 on nch1-master-1 Feb 19 21:26:12.112629 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-5448ddae-47ad-47fb-a637-6adb1d6ee240 req-4d96821e-ebab-452d-a1fe-04d070e1d182 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124080 Feb 19 21:26:12.113243 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2802/5509] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:26:12.161980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e8b15072-dac9-40fe-9b0c-4d7ccebf2b2c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:12.170546 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e8b15072-dac9-40fe-9b0c-4d7ccebf2b2c tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1210 microversion: 2.1 time: 0.170119 Feb 19 21:26:12.171375 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2708/5510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:11 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:26:12.693622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b3a2a565-6a24-4cd9-a855-546ffb6fcd46 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:12.694609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b3a2a565-6a24-4cd9-a855-546ffb6fcd46 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: e9ab3096-5aa0-4585-a188-685cb7322fb6] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:12.710517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3a2a565-6a24-4cd9-a855-546ffb6fcd46 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:12.711168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3a2a565-6a24-4cd9-a855-546ffb6fcd46 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:12.712147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3a2a565-6a24-4cd9-a855-546ffb6fcd46 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:12.712789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3a2a565-6a24-4cd9-a855-546ffb6fcd46 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:12.727793 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-b3a2a565-6a24-4cd9-a855-546ffb6fcd46 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] HTTP exception thrown: Instance e9ab3096-5aa0-4585-a188-685cb7322fb6 could not be found. Feb 19 21:26:12.732861 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b3a2a565-6a24-4cd9-a855-546ffb6fcd46 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Returning 404 to user: Instance e9ab3096-5aa0-4585-a188-685cb7322fb6 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:26:12.733924 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b3a2a565-6a24-4cd9-a855-546ffb6fcd46 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6" status: 404 len: 111 microversion: 2.1 time: 0.044367 Feb 19 21:26:12.734994 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2803/5511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:12 2022] GET /compute/v2.1/servers/e9ab3096-5aa0-4585-a188-685cb7322fb6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:26:13.188101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f24ad15-27be-4953-818e-08a4294b0b5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:13.188765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f24ad15-27be-4953-818e-08a4294b0b5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:13.195791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f24ad15-27be-4953-818e-08a4294b0b5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:13.196257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f24ad15-27be-4953-818e-08a4294b0b5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:13.197082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f24ad15-27be-4953-818e-08a4294b0b5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:13.197531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f24ad15-27be-4953-818e-08a4294b0b5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:13.509079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9f24ad15-27be-4953-818e-08a4294b0b5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:13.517459 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f24ad15-27be-4953-818e-08a4294b0b5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1265 microversion: 2.1 time: 0.332938 Feb 19 21:26:13.518398 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2709/5512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:13 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:13.936121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-2969ee56-1f23-4f09-9cdc-e68b86ea06ea req-ace4dad9-c2f1-4332-ba65-387d87537519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1695f956-3d9f-4acb-9c5c-0cf825ec7bc7", "tag": "4f4bd7f1-40bc-48c5-b9a1-1695752292d5"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:13.937851 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:26:13.937851 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:26:13.952096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2969ee56-1f23-4f09-9cdc-e68b86ea06ea req-ace4dad9-c2f1-4332-ba65-387d87537519 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:13.952662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2969ee56-1f23-4f09-9cdc-e68b86ea06ea req-ace4dad9-c2f1-4332-ba65-387d87537519 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:13.967436 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-2969ee56-1f23-4f09-9cdc-e68b86ea06ea req-ace4dad9-c2f1-4332-ba65-387d87537519 service nova] Creating event network-changed:4f4bd7f1-40bc-48c5-b9a1-1695752292d5 for instance 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 on nch1-master-1 Feb 19 21:26:13.975474 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-2969ee56-1f23-4f09-9cdc-e68b86ea06ea req-ace4dad9-c2f1-4332-ba65-387d87537519 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043074 Feb 19 21:26:13.976706 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2804/5513] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:26:14.534612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c8069f77-6f77-47d6-82cb-61d3409b8a29 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:14.535329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c8069f77-6f77-47d6-82cb-61d3409b8a29 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:14.542110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8069f77-6f77-47d6-82cb-61d3409b8a29 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:14.542563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8069f77-6f77-47d6-82cb-61d3409b8a29 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:14.543388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8069f77-6f77-47d6-82cb-61d3409b8a29 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:14.543828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8069f77-6f77-47d6-82cb-61d3409b8a29 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:15.267782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c8069f77-6f77-47d6-82cb-61d3409b8a29 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:15.276044 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c8069f77-6f77-47d6-82cb-61d3409b8a29 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1265 microversion: 2.1 time: 0.744992 Feb 19 21:26:15.276889 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2710/5514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:14 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1265 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:16.298235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3b067e28-15aa-4b91-9974-ddcb62519786 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:16.303121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3b067e28-15aa-4b91-9974-ddcb62519786 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:16.314087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b067e28-15aa-4b91-9974-ddcb62519786 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:16.314807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b067e28-15aa-4b91-9974-ddcb62519786 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:16.315854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b067e28-15aa-4b91-9974-ddcb62519786 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:16.316537 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3b067e28-15aa-4b91-9974-ddcb62519786 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:16.501503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3b067e28-15aa-4b91-9974-ddcb62519786 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:16.509394 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3b067e28-15aa-4b91-9974-ddcb62519786 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1265 microversion: 2.1 time: 0.219828 Feb 19 21:26:16.510697 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2805/5515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:16 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:17.523149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bf697480-547d-45b8-85ac-75199b7f7baf tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '.version_select at 0x7f6466b5d430>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:17.527001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6ffe04f2-7fd2-45f7-ab6b-93abe6b45a5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:17.527638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6ffe04f2-7fd2-45f7-ab6b-93abe6b45a5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:17.535702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ffe04f2-7fd2-45f7-ab6b-93abe6b45a5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:17.536163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ffe04f2-7fd2-45f7-ab6b-93abe6b45a5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:17.539102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ffe04f2-7fd2-45f7-ab6b-93abe6b45a5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:17.539840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6ffe04f2-7fd2-45f7-ab6b-93abe6b45a5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:17.566607 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bf697480-547d-45b8-85ac-75199b7f7baf tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-970664868" status: 202 len: 0 microversion: 2.1 time: 0.050534 Feb 19 21:26:17.576680 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2711/5516] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Feb 19 21:26:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-970664868 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:26:17.613777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-700c62e5-55c5-4f69-b158-4df4b72129a3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'create', calling method: .version_select at 0x7f6467c6b700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-992680675"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:17.644650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-700c62e5-55c5-4f69-b158-4df4b72129a3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:26:17.650009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-700c62e5-55c5-4f69-b158-4df4b72129a3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:26:17.708059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6ffe04f2-7fd2-45f7-ab6b-93abe6b45a5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:17.715521 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6ffe04f2-7fd2-45f7-ab6b-93abe6b45a5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1265 microversion: 2.1 time: 0.192500 Feb 19 21:26:17.716209 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2806/5517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:17 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:18.052748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-700c62e5-55c5-4f69-b158-4df4b72129a3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:26:18.057525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-700c62e5-55c5-4f69-b158-4df4b72129a3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:26:18.073716 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-700c62e5-55c5-4f69-b158-4df4b72129a3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.470383 Feb 19 21:26:18.074336 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2712/5518] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:26:17 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:18.731554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0ce8de5c-6a89-479a-aa2c-fc144bea171d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:18.732629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0ce8de5c-6a89-479a-aa2c-fc144bea171d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:18.738907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ce8de5c-6a89-479a-aa2c-fc144bea171d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:18.739370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ce8de5c-6a89-479a-aa2c-fc144bea171d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:18.740173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ce8de5c-6a89-479a-aa2c-fc144bea171d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:18.740656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ce8de5c-6a89-479a-aa2c-fc144bea171d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:18.906774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0ce8de5c-6a89-479a-aa2c-fc144bea171d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:18.914314 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0ce8de5c-6a89-479a-aa2c-fc144bea171d tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1265 microversion: 2.1 time: 0.186437 Feb 19 21:26:18.914979 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2807/5519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:18 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:19.932162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0f74662f-b40d-4ba4-ad18-32bb25c20d48 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:19.932951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0f74662f-b40d-4ba4-ad18-32bb25c20d48 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:19.939430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f74662f-b40d-4ba4-ad18-32bb25c20d48 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:19.939876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f74662f-b40d-4ba4-ad18-32bb25c20d48 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:19.940683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f74662f-b40d-4ba4-ad18-32bb25c20d48 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:19.941122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0f74662f-b40d-4ba4-ad18-32bb25c20d48 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:20.095859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0f74662f-b40d-4ba4-ad18-32bb25c20d48 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:20.104696 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0f74662f-b40d-4ba4-ad18-32bb25c20d48 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1265 microversion: 2.1 time: 0.177303 Feb 19 21:26:20.105570 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2713/5520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:19 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:20.158915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-2e76445c-4c3c-4ca0-b659-19c52ae0087f req-c58dbf44-f394-4120-a0aa-ac1fe08ba388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1695f956-3d9f-4acb-9c5c-0cf825ec7bc7", "name": "network-vif-plugged", "status": "completed", "tag": "4f4bd7f1-40bc-48c5-b9a1-1695752292d5"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:20.161499 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:26:20.161499 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:26:20.170474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2e76445c-4c3c-4ca0-b659-19c52ae0087f req-c58dbf44-f394-4120-a0aa-ac1fe08ba388 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:20.171011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2e76445c-4c3c-4ca0-b659-19c52ae0087f req-c58dbf44-f394-4120-a0aa-ac1fe08ba388 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:20.182777 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-2e76445c-4c3c-4ca0-b659-19c52ae0087f req-c58dbf44-f394-4120-a0aa-ac1fe08ba388 service nova] Creating event network-vif-plugged:4f4bd7f1-40bc-48c5-b9a1-1695752292d5 for instance 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 on nch1-master-1 Feb 19 21:26:20.189965 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-2e76445c-4c3c-4ca0-b659-19c52ae0087f req-c58dbf44-f394-4120-a0aa-ac1fe08ba388 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034993 Feb 19 21:26:20.190976 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2808/5521] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:26:21.121867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2012e13c-752e-494c-a8e7-2a557e489329 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:21.123047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2012e13c-752e-494c-a8e7-2a557e489329 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:21.130245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2012e13c-752e-494c-a8e7-2a557e489329 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:21.130821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2012e13c-752e-494c-a8e7-2a557e489329 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:21.131795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2012e13c-752e-494c-a8e7-2a557e489329 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:21.132384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2012e13c-752e-494c-a8e7-2a557e489329 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:21.322316 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2012e13c-752e-494c-a8e7-2a557e489329 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:21.337112 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2012e13c-752e-494c-a8e7-2a557e489329 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1265 microversion: 2.1 time: 0.218381 Feb 19 21:26:21.345941 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2714/5522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:21 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:22.356865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f8b1fbe-e63e-4303-b53b-dab9821e81af tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:22.357745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3f8b1fbe-e63e-4303-b53b-dab9821e81af tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:22.365935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f8b1fbe-e63e-4303-b53b-dab9821e81af tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:22.366855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f8b1fbe-e63e-4303-b53b-dab9821e81af tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:22.368010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f8b1fbe-e63e-4303-b53b-dab9821e81af tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:22.368697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f8b1fbe-e63e-4303-b53b-dab9821e81af tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:22.567703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3f8b1fbe-e63e-4303-b53b-dab9821e81af tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:22.577433 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f8b1fbe-e63e-4303-b53b-dab9821e81af tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1452 microversion: 2.1 time: 0.225583 Feb 19 21:26:22.578384 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2809/5523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:22 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1452 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:22.600722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-409637ab-9d6f-479f-8bc3-ab09f2f0c65f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:22.601461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-409637ab-9d6f-479f-8bc3-ab09f2f0c65f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:22.609135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-409637ab-9d6f-479f-8bc3-ab09f2f0c65f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:22.609767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-409637ab-9d6f-479f-8bc3-ab09f2f0c65f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:22.610741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-409637ab-9d6f-479f-8bc3-ab09f2f0c65f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:22.611297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-409637ab-9d6f-479f-8bc3-ab09f2f0c65f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:22.771613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-409637ab-9d6f-479f-8bc3-ab09f2f0c65f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:22.780739 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-409637ab-9d6f-479f-8bc3-ab09f2f0c65f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1452 microversion: 2.1 time: 0.187055 Feb 19 21:26:22.781359 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2715/5524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:22 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:23.852154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1287357599", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "243b999b-e916-404a-8038-10ba42937fec"}], "key_name": "tempest-TestNetworkAdvancedServerOps-992680675", "security_groups": [{"name": "tempest-secgroup-smoke-2009078968"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:24.025453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] validate_networks() for [('243b999b-e916-404a-8038-10ba42937fec', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:26:24.751644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:26:24.752492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:26:24.753173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:26:24.754252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:26:24.754836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:26:24.771634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:24.772118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:24.773002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:24.773455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:24.790911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:26:24.796749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:26:24.809129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:26:24.812074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:26:24.866632 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7cddbd16-1cc8-4ec0-8ca4-72b7ff0fc57e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.018121 Feb 19 21:26:24.876933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad7e1c10-0672-44ce-bd74-a827b5262e7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:24.877551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ad7e1c10-0672-44ce-bd74-a827b5262e7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:24.881221 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2810/5525] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:26:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:26:24.944648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ad7e1c10-0672-44ce-bd74-a827b5262e7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:24.955954 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad7e1c10-0672-44ce-bd74-a827b5262e7e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1266 microversion: 2.1 time: 0.082359 Feb 19 21:26:24.966585 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2716/5526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:24 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:26:25.151578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-31c0efcc-6e24-4d17-8ddc-a7a609cb0a8b req-31982d50-2487-447f-b283-02d7a2b0b244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1695f956-3d9f-4acb-9c5c-0cf825ec7bc7", "tag": "4f4bd7f1-40bc-48c5-b9a1-1695752292d5"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:25.153105 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:26:25.153105 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:26:25.165648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-31c0efcc-6e24-4d17-8ddc-a7a609cb0a8b req-31982d50-2487-447f-b283-02d7a2b0b244 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:25.166313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-31c0efcc-6e24-4d17-8ddc-a7a609cb0a8b req-31982d50-2487-447f-b283-02d7a2b0b244 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:25.196946 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-31c0efcc-6e24-4d17-8ddc-a7a609cb0a8b req-31982d50-2487-447f-b283-02d7a2b0b244 service nova] Creating event network-changed:4f4bd7f1-40bc-48c5-b9a1-1695752292d5 for instance 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 on nch1-master-1 Feb 19 21:26:25.213614 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-31c0efcc-6e24-4d17-8ddc-a7a609cb0a8b req-31982d50-2487-447f-b283-02d7a2b0b244 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064903 Feb 19 21:26:25.216909 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2811/5527] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:26:25.978186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1fb05c2-19ac-4bae-8f38-bf9268af425c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:25.979713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1fb05c2-19ac-4bae-8f38-bf9268af425c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:25.988823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1fb05c2-19ac-4bae-8f38-bf9268af425c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:25.989775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1fb05c2-19ac-4bae-8f38-bf9268af425c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:25.990827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1fb05c2-19ac-4bae-8f38-bf9268af425c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:25.991746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1fb05c2-19ac-4bae-8f38-bf9268af425c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:26.255321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e1fb05c2-19ac-4bae-8f38-bf9268af425c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:26.272886 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1fb05c2-19ac-4bae-8f38-bf9268af425c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1318 microversion: 2.1 time: 0.298562 Feb 19 21:26:26.282594 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2717/5528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:25 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:27.292035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-466aca48-d113-42ac-abf7-a5ce7b78ec40 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:27.293024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-466aca48-d113-42ac-abf7-a5ce7b78ec40 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:27.303760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-466aca48-d113-42ac-abf7-a5ce7b78ec40 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:27.304840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-466aca48-d113-42ac-abf7-a5ce7b78ec40 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:27.305968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-466aca48-d113-42ac-abf7-a5ce7b78ec40 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:27.306804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-466aca48-d113-42ac-abf7-a5ce7b78ec40 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:27.638597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-466aca48-d113-42ac-abf7-a5ce7b78ec40 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:27.647807 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-466aca48-d113-42ac-abf7-a5ce7b78ec40 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1392 microversion: 2.1 time: 0.360645 Feb 19 21:26:27.661005 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2812/5529] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:27 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1392 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:28.024376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f1ef2726-bda9-4b0f-809e-cda9110f07de req-b1500568-bd89-4ab1-8161-7409b27d078b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e4c19f-82b1-4659-8369-472e042ef9a2", "tag": "a48bdca1-a574-49ba-b5ab-0409e41e9026"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:28.025991 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:26:28.025991 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:26:28.038116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f1ef2726-bda9-4b0f-809e-cda9110f07de req-b1500568-bd89-4ab1-8161-7409b27d078b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:28.039158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f1ef2726-bda9-4b0f-809e-cda9110f07de req-b1500568-bd89-4ab1-8161-7409b27d078b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:28.056878 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f1ef2726-bda9-4b0f-809e-cda9110f07de req-b1500568-bd89-4ab1-8161-7409b27d078b service nova] Creating event network-changed:a48bdca1-a574-49ba-b5ab-0409e41e9026 for instance f3e4c19f-82b1-4659-8369-472e042ef9a2 on nch2-master-1 Feb 19 21:26:28.063414 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f1ef2726-bda9-4b0f-809e-cda9110f07de req-b1500568-bd89-4ab1-8161-7409b27d078b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042558 Feb 19 21:26:28.064057 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2718/5530] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:26:28.668739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-697f3431-a8d3-4aea-94fb-0eb78179c11d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:28.669957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-697f3431-a8d3-4aea-94fb-0eb78179c11d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:28.676781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-697f3431-a8d3-4aea-94fb-0eb78179c11d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:28.677243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-697f3431-a8d3-4aea-94fb-0eb78179c11d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:28.678034 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-697f3431-a8d3-4aea-94fb-0eb78179c11d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:28.678765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-697f3431-a8d3-4aea-94fb-0eb78179c11d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:28.911415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-697f3431-a8d3-4aea-94fb-0eb78179c11d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:28.918730 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-697f3431-a8d3-4aea-94fb-0eb78179c11d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1392 microversion: 2.1 time: 0.253628 Feb 19 21:26:28.919924 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2813/5531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:28 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:29.937533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-98ed6943-47c1-43cd-8477-04b9b04fd7d2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:29.938235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-98ed6943-47c1-43cd-8477-04b9b04fd7d2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:29.944378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98ed6943-47c1-43cd-8477-04b9b04fd7d2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:29.944840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98ed6943-47c1-43cd-8477-04b9b04fd7d2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:29.945622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98ed6943-47c1-43cd-8477-04b9b04fd7d2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:29.946066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-98ed6943-47c1-43cd-8477-04b9b04fd7d2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:30.088714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-98ed6943-47c1-43cd-8477-04b9b04fd7d2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:30.096732 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-98ed6943-47c1-43cd-8477-04b9b04fd7d2 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1392 microversion: 2.1 time: 0.164886 Feb 19 21:26:30.097310 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2719/5532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:29 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:31.173309 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-602aead3-dbaf-4fd1-840d-c23d5bd15270 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:31.174101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-602aead3-dbaf-4fd1-840d-c23d5bd15270 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:31.180902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-602aead3-dbaf-4fd1-840d-c23d5bd15270 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:31.181734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-602aead3-dbaf-4fd1-840d-c23d5bd15270 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:31.182614 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-602aead3-dbaf-4fd1-840d-c23d5bd15270 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:31.183195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-602aead3-dbaf-4fd1-840d-c23d5bd15270 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:31.341620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-602aead3-dbaf-4fd1-840d-c23d5bd15270 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:31.350299 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-602aead3-dbaf-4fd1-840d-c23d5bd15270 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1392 microversion: 2.1 time: 0.239985 Feb 19 21:26:31.351052 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2814/5533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:31 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:32.369112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-241a6341-8ff0-4837-96fa-89cb81e7059f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:32.369757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-241a6341-8ff0-4837-96fa-89cb81e7059f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:32.376933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-241a6341-8ff0-4837-96fa-89cb81e7059f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:32.377403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-241a6341-8ff0-4837-96fa-89cb81e7059f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:32.378198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-241a6341-8ff0-4837-96fa-89cb81e7059f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:32.379257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-241a6341-8ff0-4837-96fa-89cb81e7059f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:32.590254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-241a6341-8ff0-4837-96fa-89cb81e7059f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:32.601251 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-241a6341-8ff0-4837-96fa-89cb81e7059f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1392 microversion: 2.1 time: 0.235863 Feb 19 21:26:32.602291 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2720/5534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:32 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:33.621631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d103e475-a2e4-4f9a-a503-a9d7fcd7c538 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:33.622311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d103e475-a2e4-4f9a-a503-a9d7fcd7c538 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:33.630991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d103e475-a2e4-4f9a-a503-a9d7fcd7c538 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:33.631518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d103e475-a2e4-4f9a-a503-a9d7fcd7c538 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:33.632380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d103e475-a2e4-4f9a-a503-a9d7fcd7c538 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:33.632890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d103e475-a2e4-4f9a-a503-a9d7fcd7c538 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:33.782705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d103e475-a2e4-4f9a-a503-a9d7fcd7c538 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:33.790270 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d103e475-a2e4-4f9a-a503-a9d7fcd7c538 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1392 microversion: 2.1 time: 0.172968 Feb 19 21:26:33.790837 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2815/5535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:33 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:26:34.764595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-041c6216-c680-4b4a-bd94-9c4c1bbf058d req-96508ec7-8c53-4c68-86fb-18c54a560439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e4c19f-82b1-4659-8369-472e042ef9a2", "name": "network-vif-plugged", "status": "completed", "tag": "a48bdca1-a574-49ba-b5ab-0409e41e9026"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:34.766779 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:26:34.766779 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:26:34.775615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-041c6216-c680-4b4a-bd94-9c4c1bbf058d req-96508ec7-8c53-4c68-86fb-18c54a560439 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:34.776060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-041c6216-c680-4b4a-bd94-9c4c1bbf058d req-96508ec7-8c53-4c68-86fb-18c54a560439 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:34.787999 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-041c6216-c680-4b4a-bd94-9c4c1bbf058d req-96508ec7-8c53-4c68-86fb-18c54a560439 service nova] Creating event network-vif-plugged:a48bdca1-a574-49ba-b5ab-0409e41e9026 for instance f3e4c19f-82b1-4659-8369-472e042ef9a2 on nch2-master-1 Feb 19 21:26:34.792862 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-041c6216-c680-4b4a-bd94-9c4c1bbf058d req-96508ec7-8c53-4c68-86fb-18c54a560439 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032451 Feb 19 21:26:34.793627 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2721/5536] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:26:34.807519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d2b6042-4dc6-419f-ba4a-aeef61d2088c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:34.808135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2d2b6042-4dc6-419f-ba4a-aeef61d2088c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:34.815787 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d2b6042-4dc6-419f-ba4a-aeef61d2088c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:34.816507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d2b6042-4dc6-419f-ba4a-aeef61d2088c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:34.817299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d2b6042-4dc6-419f-ba4a-aeef61d2088c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:34.817917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d2b6042-4dc6-419f-ba4a-aeef61d2088c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:35.016827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2d2b6042-4dc6-419f-ba4a-aeef61d2088c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:35.024090 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d2b6042-4dc6-419f-ba4a-aeef61d2088c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1392 microversion: 2.1 time: 0.220248 Feb 19 21:26:35.024696 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2816/5537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:34 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1392 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:36.042812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d35fba9f-57b0-43e5-a330-7ad156e26a92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:36.043520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d35fba9f-57b0-43e5-a330-7ad156e26a92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:36.049777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d35fba9f-57b0-43e5-a330-7ad156e26a92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:36.050235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d35fba9f-57b0-43e5-a330-7ad156e26a92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:36.051023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d35fba9f-57b0-43e5-a330-7ad156e26a92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:36.051468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d35fba9f-57b0-43e5-a330-7ad156e26a92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:36.190849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d35fba9f-57b0-43e5-a330-7ad156e26a92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:36.198747 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d35fba9f-57b0-43e5-a330-7ad156e26a92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1392 microversion: 2.1 time: 0.160885 Feb 19 21:26:36.199543 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2722/5538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:36 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:37.216803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96e4fd3c-95cd-4cc3-b896-26bbff5f7584 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:37.217422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-96e4fd3c-95cd-4cc3-b896-26bbff5f7584 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:37.223767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96e4fd3c-95cd-4cc3-b896-26bbff5f7584 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:37.224230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96e4fd3c-95cd-4cc3-b896-26bbff5f7584 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:37.225043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96e4fd3c-95cd-4cc3-b896-26bbff5f7584 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:37.225491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96e4fd3c-95cd-4cc3-b896-26bbff5f7584 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:37.363542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-96e4fd3c-95cd-4cc3-b896-26bbff5f7584 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:37.373009 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96e4fd3c-95cd-4cc3-b896-26bbff5f7584 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1565 microversion: 2.1 time: 0.160033 Feb 19 21:26:37.373813 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2817/5539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:37 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:37.389404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58c1ba8c-bcf3-41e4-8de4-c4d97a2f08de tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:37.390048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-58c1ba8c-bcf3-41e4-8de4-c4d97a2f08de tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:37.396769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58c1ba8c-bcf3-41e4-8de4-c4d97a2f08de tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:37.397230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58c1ba8c-bcf3-41e4-8de4-c4d97a2f08de tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:37.398012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58c1ba8c-bcf3-41e4-8de4-c4d97a2f08de tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:37.398461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58c1ba8c-bcf3-41e4-8de4-c4d97a2f08de tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:37.539295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-58c1ba8c-bcf3-41e4-8de4-c4d97a2f08de tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:37.547590 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-58c1ba8c-bcf3-41e4-8de4-c4d97a2f08de tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1565 microversion: 2.1 time: 0.161985 Feb 19 21:26:37.548173 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2723/5540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:37 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:26:39.299028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dab22395-a86f-452a-b2f5-918bfc531edb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:26:39.299926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5c1250d6-b8b7-4716-ba17-9e34f84cbd94 req-1de01d06-29e6-4e35-ba1e-77f2fc36c0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e4c19f-82b1-4659-8369-472e042ef9a2", "tag": "a48bdca1-a574-49ba-b5ab-0409e41e9026"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:26:39.302010 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:26:39.302010 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:26:39.302753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dab22395-a86f-452a-b2f5-918bfc531edb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:26:39.315327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dab22395-a86f-452a-b2f5-918bfc531edb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:39.317420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dab22395-a86f-452a-b2f5-918bfc531edb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:39.318453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dab22395-a86f-452a-b2f5-918bfc531edb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:39.319414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5c1250d6-b8b7-4716-ba17-9e34f84cbd94 req-1de01d06-29e6-4e35-ba1e-77f2fc36c0fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:26:39.319856 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5c1250d6-b8b7-4716-ba17-9e34f84cbd94 req-1de01d06-29e6-4e35-ba1e-77f2fc36c0fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:39.322958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dab22395-a86f-452a-b2f5-918bfc531edb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:26:39.346592 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5c1250d6-b8b7-4716-ba17-9e34f84cbd94 req-1de01d06-29e6-4e35-ba1e-77f2fc36c0fe service nova] Creating event network-changed:a48bdca1-a574-49ba-b5ab-0409e41e9026 for instance f3e4c19f-82b1-4659-8369-472e042ef9a2 on nch2-master-1 Feb 19 21:26:39.354256 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5c1250d6-b8b7-4716-ba17-9e34f84cbd94 req-1de01d06-29e6-4e35-ba1e-77f2fc36c0fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060481 Feb 19 21:26:39.354893 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2724/5541] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:26:40.009002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dab22395-a86f-452a-b2f5-918bfc531edb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:26:40.017035 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dab22395-a86f-452a-b2f5-918bfc531edb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1565 microversion: 2.1 time: 0.728294 Feb 19 21:26:40.017842 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2818/5542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:26:39 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1565 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:26:57.720705 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:26:57.721247 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 21:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:27:13.318152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4358e28d-f3d0-42df-89e7-d1b8335e7e2d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:13.319171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4358e28d-f3d0-42df-89e7-d1b8335e7e2d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:13.326692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4358e28d-f3d0-42df-89e7-d1b8335e7e2d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:13.327197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4358e28d-f3d0-42df-89e7-d1b8335e7e2d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:13.328076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4358e28d-f3d0-42df-89e7-d1b8335e7e2d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:13.328628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4358e28d-f3d0-42df-89e7-d1b8335e7e2d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:13.386098 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4358e28d-f3d0-42df-89e7-d1b8335e7e2d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2/action" status: 200 len: 24552 microversion: 2.1 time: 0.073528 Feb 19 21:27:13.386780 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2725/5543] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:27:13 2022] POST /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2/action => generated 24552 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:27:43.783280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f8b76784-fd2e-4ca0-acdc-e67e634d42ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:43.783879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f8b76784-fd2e-4ca0-acdc-e67e634d42ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:43.789831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8b76784-fd2e-4ca0-acdc-e67e634d42ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:43.790292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8b76784-fd2e-4ca0-acdc-e67e634d42ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:43.791151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8b76784-fd2e-4ca0-acdc-e67e634d42ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:43.791742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f8b76784-fd2e-4ca0-acdc-e67e634d42ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:43.931991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f8b76784-fd2e-4ca0-acdc-e67e634d42ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:43.939958 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f8b76784-fd2e-4ca0-acdc-e67e634d42ad tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1684 microversion: 2.1 time: 0.161481 Feb 19 21:27:43.940678 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2819/5544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:43 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:44.038821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-50d3b7f3-1d30-4dcb-82ec-f520ad2084ac tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:44.039759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-50d3b7f3-1d30-4dcb-82ec-f520ad2084ac tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:44.047215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50d3b7f3-1d30-4dcb-82ec-f520ad2084ac tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:44.047668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50d3b7f3-1d30-4dcb-82ec-f520ad2084ac tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:44.048490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50d3b7f3-1d30-4dcb-82ec-f520ad2084ac tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:44.048935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50d3b7f3-1d30-4dcb-82ec-f520ad2084ac tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:44.104463 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-50d3b7f3-1d30-4dcb-82ec-f520ad2084ac tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2/action" status: 200 len: 32628 microversion: 2.1 time: 0.069812 Feb 19 21:27:44.105080 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2726/5545] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:27:44 2022] POST /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2/action => generated 32628 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:27:44.323348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-edbf4c18-10a7-479d-b1a4-9d7fc2541a52 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:44.323893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-edbf4c18-10a7-479d-b1a4-9d7fc2541a52 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:44.329986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-edbf4c18-10a7-479d-b1a4-9d7fc2541a52 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:44.330454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-edbf4c18-10a7-479d-b1a4-9d7fc2541a52 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:44.331244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-edbf4c18-10a7-479d-b1a4-9d7fc2541a52 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:44.332009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-edbf4c18-10a7-479d-b1a4-9d7fc2541a52 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:44.461080 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-edbf4c18-10a7-479d-b1a4-9d7fc2541a52 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1835 microversion: 2.1 time: 0.141424 Feb 19 21:27:44.461738 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2820/5546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:44 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1835 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:44.478567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-44cf04bc-db8a-4ec6-a9fa-0b372b5c1655 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:44.479804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-44cf04bc-db8a-4ec6-a9fa-0b372b5c1655 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:44.487300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44cf04bc-db8a-4ec6-a9fa-0b372b5c1655 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:44.487752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44cf04bc-db8a-4ec6-a9fa-0b372b5c1655 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:44.488602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44cf04bc-db8a-4ec6-a9fa-0b372b5c1655 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:44.489047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44cf04bc-db8a-4ec6-a9fa-0b372b5c1655 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:44.513891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-44cf04bc-db8a-4ec6-a9fa-0b372b5c1655 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lazy-loading 'flavor' on Instance uuid f3e4c19f-82b1-4659-8369-472e042ef9a2 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:27:44.525632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-44cf04bc-db8a-4ec6-a9fa-0b372b5c1655 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Going to try to live migrate instance to another host {{(pid=136095) live_migrate /opt/stack/nova/nova/compute/api.py:5273}} Feb 19 21:27:45.745311 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-44cf04bc-db8a-4ec6-a9fa-0b372b5c1655 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2/action" status: 202 len: 0 microversion: 2.1 time: 1.270667 Feb 19 21:27:45.746346 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2727/5547] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:27:44 2022] POST /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2/action => generated 0 bytes in 1273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:27:45.755295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-56355e33-1612-488e-97ea-d3c50d14960b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:45.756008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-56355e33-1612-488e-97ea-d3c50d14960b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:45.763681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-56355e33-1612-488e-97ea-d3c50d14960b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:45.764155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-56355e33-1612-488e-97ea-d3c50d14960b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:45.764993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-56355e33-1612-488e-97ea-d3c50d14960b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:45.765434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-56355e33-1612-488e-97ea-d3c50d14960b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:45.942501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-56355e33-1612-488e-97ea-d3c50d14960b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:45.949928 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-56355e33-1612-488e-97ea-d3c50d14960b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1694 microversion: 2.1 time: 0.198689 Feb 19 21:27:45.950513 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2821/5548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:45 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:46.816907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8601557e-87b8-4715-b38f-13afde080318 req-66ec047a-49fc-4fa1-a0b8-3a76e2fe0725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e4c19f-82b1-4659-8369-472e042ef9a2", "name": "network-vif-unplugged", "status": "completed", "tag": "a48bdca1-a574-49ba-b5ab-0409e41e9026"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:46.819452 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:27:46.819452 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:27:46.828557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8601557e-87b8-4715-b38f-13afde080318 req-66ec047a-49fc-4fa1-a0b8-3a76e2fe0725 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:46.829015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8601557e-87b8-4715-b38f-13afde080318 req-66ec047a-49fc-4fa1-a0b8-3a76e2fe0725 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:46.840163 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8601557e-87b8-4715-b38f-13afde080318 req-66ec047a-49fc-4fa1-a0b8-3a76e2fe0725 service nova] Creating event network-vif-unplugged:a48bdca1-a574-49ba-b5ab-0409e41e9026 for instance f3e4c19f-82b1-4659-8369-472e042ef9a2 on nch2-master-1 Feb 19 21:27:46.845384 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8601557e-87b8-4715-b38f-13afde080318 req-66ec047a-49fc-4fa1-a0b8-3a76e2fe0725 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032583 Feb 19 21:27:46.845994 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2728/5549] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:27:46.967401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4e937c3f-258b-4ad3-a916-510b0e366e5f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:46.968163 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4e937c3f-258b-4ad3-a916-510b0e366e5f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:46.975820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e937c3f-258b-4ad3-a916-510b0e366e5f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:46.976488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e937c3f-258b-4ad3-a916-510b0e366e5f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:46.977393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e937c3f-258b-4ad3-a916-510b0e366e5f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:46.978086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4e937c3f-258b-4ad3-a916-510b0e366e5f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:47.238372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a1a53059-41f5-4ef1-90be-c2b05911df42 req-cbd9c6c9-f14a-48e6-9415-79acf507c687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e4c19f-82b1-4659-8369-472e042ef9a2", "name": "network-vif-plugged", "status": "completed", "tag": "a48bdca1-a574-49ba-b5ab-0409e41e9026"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:47.240428 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:27:47.240428 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:27:47.249450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a1a53059-41f5-4ef1-90be-c2b05911df42 req-cbd9c6c9-f14a-48e6-9415-79acf507c687 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:47.250066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a1a53059-41f5-4ef1-90be-c2b05911df42 req-cbd9c6c9-f14a-48e6-9415-79acf507c687 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:47.262825 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a1a53059-41f5-4ef1-90be-c2b05911df42 req-cbd9c6c9-f14a-48e6-9415-79acf507c687 service nova] Creating event network-vif-plugged:a48bdca1-a574-49ba-b5ab-0409e41e9026 for instance f3e4c19f-82b1-4659-8369-472e042ef9a2 on nch2-master-1 Feb 19 21:27:47.268072 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a1a53059-41f5-4ef1-90be-c2b05911df42 req-cbd9c6c9-f14a-48e6-9415-79acf507c687 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033750 Feb 19 21:27:47.269263 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2729/5550] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:27:47.270488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4e937c3f-258b-4ad3-a916-510b0e366e5f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:47.280626 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4e937c3f-258b-4ad3-a916-510b0e366e5f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1694 microversion: 2.1 time: 0.317297 Feb 19 21:27:47.281629 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2822/5551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:46 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1694 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:48.299221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-90f0bbd9-c9f9-4caa-ba9e-5915e51de736 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:48.299923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-90f0bbd9-c9f9-4caa-ba9e-5915e51de736 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:48.306163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90f0bbd9-c9f9-4caa-ba9e-5915e51de736 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:48.306613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90f0bbd9-c9f9-4caa-ba9e-5915e51de736 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:48.307393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90f0bbd9-c9f9-4caa-ba9e-5915e51de736 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:48.307835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90f0bbd9-c9f9-4caa-ba9e-5915e51de736 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:48.448780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-90f0bbd9-c9f9-4caa-ba9e-5915e51de736 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:48.456221 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-90f0bbd9-c9f9-4caa-ba9e-5915e51de736 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1694 microversion: 2.1 time: 0.161809 Feb 19 21:27:48.457089 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2730/5552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:48 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:48.862816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-2ae8644a-4b6d-440d-a91a-359e63ab9c4a req-3613119c-22d9-4b44-88fe-0e169ca3f0df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e4c19f-82b1-4659-8369-472e042ef9a2", "tag": "a48bdca1-a574-49ba-b5ab-0409e41e9026"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:48.864424 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:27:48.864424 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:27:48.872134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2ae8644a-4b6d-440d-a91a-359e63ab9c4a req-3613119c-22d9-4b44-88fe-0e169ca3f0df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:48.872641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2ae8644a-4b6d-440d-a91a-359e63ab9c4a req-3613119c-22d9-4b44-88fe-0e169ca3f0df service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:48.883355 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-2ae8644a-4b6d-440d-a91a-359e63ab9c4a req-3613119c-22d9-4b44-88fe-0e169ca3f0df service nova] Creating event network-changed:a48bdca1-a574-49ba-b5ab-0409e41e9026 for instance f3e4c19f-82b1-4659-8369-472e042ef9a2 on nch2-master-1 Feb 19 21:27:48.888508 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-2ae8644a-4b6d-440d-a91a-359e63ab9c4a req-3613119c-22d9-4b44-88fe-0e169ca3f0df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030124 Feb 19 21:27:48.889254 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2823/5553] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:27:49.473852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-324f4903-ce1f-4c2b-b4d4-ae69433b1fa9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:49.474468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-324f4903-ce1f-4c2b-b4d4-ae69433b1fa9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:49.481366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-324f4903-ce1f-4c2b-b4d4-ae69433b1fa9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:49.481820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-324f4903-ce1f-4c2b-b4d4-ae69433b1fa9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:49.482669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-324f4903-ce1f-4c2b-b4d4-ae69433b1fa9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:49.483242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-324f4903-ce1f-4c2b-b4d4-ae69433b1fa9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:49.626241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-324f4903-ce1f-4c2b-b4d4-ae69433b1fa9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:49.633622 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-324f4903-ce1f-4c2b-b4d4-ae69433b1fa9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1694 microversion: 2.1 time: 0.163551 Feb 19 21:27:49.634196 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2731/5554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:49 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:50.652264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d54413c2-f681-450a-ae1e-852b21380a09 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:50.653002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d54413c2-f681-450a-ae1e-852b21380a09 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:50.659621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d54413c2-f681-450a-ae1e-852b21380a09 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:50.660186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d54413c2-f681-450a-ae1e-852b21380a09 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:50.661052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d54413c2-f681-450a-ae1e-852b21380a09 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:50.661500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d54413c2-f681-450a-ae1e-852b21380a09 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:50.798762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d54413c2-f681-450a-ae1e-852b21380a09 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:50.806176 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d54413c2-f681-450a-ae1e-852b21380a09 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1694 microversion: 2.1 time: 0.158851 Feb 19 21:27:50.806765 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2824/5555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:50 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:51.823204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-16e9372d-b885-43a0-8dd2-807be11bbac4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:51.824145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-16e9372d-b885-43a0-8dd2-807be11bbac4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:51.830939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16e9372d-b885-43a0-8dd2-807be11bbac4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:51.831397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16e9372d-b885-43a0-8dd2-807be11bbac4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:51.832478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16e9372d-b885-43a0-8dd2-807be11bbac4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:51.832927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-16e9372d-b885-43a0-8dd2-807be11bbac4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:51.972074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-16e9372d-b885-43a0-8dd2-807be11bbac4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:51.979406 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-16e9372d-b885-43a0-8dd2-807be11bbac4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1694 microversion: 2.1 time: 0.159968 Feb 19 21:27:51.979978 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2732/5556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:51 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:52.927116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-62b1dfa3-cfe0-4ccc-9123-02fb10e9d6da req-0eb8a7e1-752e-485e-ba1a-a68bdeacba64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e4c19f-82b1-4659-8369-472e042ef9a2", "name": "network-vif-unplugged", "status": "completed", "tag": "a48bdca1-a574-49ba-b5ab-0409e41e9026"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:52.928655 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:27:52.928655 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:27:52.936674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-62b1dfa3-cfe0-4ccc-9123-02fb10e9d6da req-0eb8a7e1-752e-485e-ba1a-a68bdeacba64 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:52.937042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-62b1dfa3-cfe0-4ccc-9123-02fb10e9d6da req-0eb8a7e1-752e-485e-ba1a-a68bdeacba64 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:52.948651 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-62b1dfa3-cfe0-4ccc-9123-02fb10e9d6da req-0eb8a7e1-752e-485e-ba1a-a68bdeacba64 service nova] Creating event network-vif-unplugged:a48bdca1-a574-49ba-b5ab-0409e41e9026 for instance f3e4c19f-82b1-4659-8369-472e042ef9a2 on nch2-master-1 Feb 19 21:27:52.953981 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-62b1dfa3-cfe0-4ccc-9123-02fb10e9d6da req-0eb8a7e1-752e-485e-ba1a-a68bdeacba64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030458 Feb 19 21:27:52.954624 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2825/5557] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:27:52.997818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b739682b-82b7-47ec-8641-b20b06998614 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:52.998989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b739682b-82b7-47ec-8641-b20b06998614 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:53.006057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b739682b-82b7-47ec-8641-b20b06998614 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:53.006515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b739682b-82b7-47ec-8641-b20b06998614 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:53.007317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b739682b-82b7-47ec-8641-b20b06998614 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:53.007795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b739682b-82b7-47ec-8641-b20b06998614 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:53.327196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b739682b-82b7-47ec-8641-b20b06998614 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:53.335394 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b739682b-82b7-47ec-8641-b20b06998614 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1694 microversion: 2.1 time: 0.341027 Feb 19 21:27:53.336013 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2733/5558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:52 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1694 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:54.354545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-22e69b88-edf4-4da2-b02d-85f187eb6ee7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:54.355248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-22e69b88-edf4-4da2-b02d-85f187eb6ee7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:54.361281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22e69b88-edf4-4da2-b02d-85f187eb6ee7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:54.361745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22e69b88-edf4-4da2-b02d-85f187eb6ee7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:54.362527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22e69b88-edf4-4da2-b02d-85f187eb6ee7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:54.362974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22e69b88-edf4-4da2-b02d-85f187eb6ee7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:54.851407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-22e69b88-edf4-4da2-b02d-85f187eb6ee7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:54.861921 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-22e69b88-edf4-4da2-b02d-85f187eb6ee7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1684 microversion: 2.1 time: 0.512228 Feb 19 21:27:54.862806 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2826/5559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:54 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1684 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:54.880287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9eb4afb6-5f37-4a2a-9b75-927f859db670 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:54.880924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9eb4afb6-5f37-4a2a-9b75-927f859db670 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:54.887688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9eb4afb6-5f37-4a2a-9b75-927f859db670 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:54.888140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9eb4afb6-5f37-4a2a-9b75-927f859db670 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:54.889567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9eb4afb6-5f37-4a2a-9b75-927f859db670 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:54.890003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9eb4afb6-5f37-4a2a-9b75-927f859db670 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:55.016691 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9eb4afb6-5f37-4a2a-9b75-927f859db670 tempest-TestNetworkAdvancedServerOps-781477207 tempest-TestNetworkAdvancedServerOps-781477207-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1835 microversion: 2.1 time: 0.139995 Feb 19 21:27:55.017262 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2734/5560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:54 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1835 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:55.032798 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-df54c194-f144-4ea3-948f-35c86cdacf08 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:55.033542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-df54c194-f144-4ea3-948f-35c86cdacf08 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:55.039485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df54c194-f144-4ea3-948f-35c86cdacf08 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:55.040006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df54c194-f144-4ea3-948f-35c86cdacf08 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:55.040831 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df54c194-f144-4ea3-948f-35c86cdacf08 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:55.041285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-df54c194-f144-4ea3-948f-35c86cdacf08 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:55.192152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-df54c194-f144-4ea3-948f-35c86cdacf08 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:55.199395 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-df54c194-f144-4ea3-948f-35c86cdacf08 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1684 microversion: 2.1 time: 0.170875 Feb 19 21:27:55.199968 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2827/5561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:55 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:27:55.288659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-65e90931-bfcc-4425-8bc6-d2a097114369 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:55.289609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-65e90931-bfcc-4425-8bc6-d2a097114369 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:55.295535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65e90931-bfcc-4425-8bc6-d2a097114369 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:55.295987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65e90931-bfcc-4425-8bc6-d2a097114369 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:55.296807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65e90931-bfcc-4425-8bc6-d2a097114369 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:55.297250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65e90931-bfcc-4425-8bc6-d2a097114369 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:55.346132 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-65e90931-bfcc-4425-8bc6-d2a097114369 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2/action" status: 200 len: 38496 microversion: 2.1 time: 0.061017 Feb 19 21:27:55.346778 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2735/5562] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:27:55 2022] POST /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2/action => generated 38496 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:27:56.338773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d9cff9f1-a3bc-4431-a4cd-0816ccd272ca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:56.339278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d9cff9f1-a3bc-4431-a4cd-0816ccd272ca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:56.342348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ce1e68a4-b964-41df-83d8-8d3add41b6b1 req-666a40c9-08bf-4306-b936-f3855b377c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e4c19f-82b1-4659-8369-472e042ef9a2", "tag": "a48bdca1-a574-49ba-b5ab-0409e41e9026"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:56.345013 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:27:56.345013 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:27:56.346750 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9cff9f1-a3bc-4431-a4cd-0816ccd272ca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:56.347219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9cff9f1-a3bc-4431-a4cd-0816ccd272ca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:56.348234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9cff9f1-a3bc-4431-a4cd-0816ccd272ca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:56.348913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d9cff9f1-a3bc-4431-a4cd-0816ccd272ca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:56.354498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ce1e68a4-b964-41df-83d8-8d3add41b6b1 req-666a40c9-08bf-4306-b936-f3855b377c9e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:56.355349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ce1e68a4-b964-41df-83d8-8d3add41b6b1 req-666a40c9-08bf-4306-b936-f3855b377c9e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:56.368709 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ce1e68a4-b964-41df-83d8-8d3add41b6b1 req-666a40c9-08bf-4306-b936-f3855b377c9e service nova] Creating event network-changed:a48bdca1-a574-49ba-b5ab-0409e41e9026 for instance f3e4c19f-82b1-4659-8369-472e042ef9a2 on nch1-master-1 Feb 19 21:27:56.374087 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ce1e68a4-b964-41df-83d8-8d3add41b6b1 req-666a40c9-08bf-4306-b936-f3855b377c9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036376 Feb 19 21:27:56.374694 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2736/5563] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:27:56.381705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d9cff9f1-a3bc-4431-a4cd-0816ccd272ca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:27:56.470422 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d9cff9f1-a3bc-4431-a4cd-0816ccd272ca tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 204 len: 0 microversion: 2.1 time: 0.135086 Feb 19 21:27:56.471579 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2828/5564] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:27:56 2022] DELETE /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:27:56.480745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-341d4b49-92a7-44d1-a67f-0f542a068e48 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:56.481558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-341d4b49-92a7-44d1-a67f-0f542a068e48 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:56.489668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-341d4b49-92a7-44d1-a67f-0f542a068e48 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:56.490211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-341d4b49-92a7-44d1-a67f-0f542a068e48 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:56.491081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-341d4b49-92a7-44d1-a67f-0f542a068e48 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:56.491599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-341d4b49-92a7-44d1-a67f-0f542a068e48 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:56.738111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-341d4b49-92a7-44d1-a67f-0f542a068e48 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:27:56.749039 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-341d4b49-92a7-44d1-a67f-0f542a068e48 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 200 len: 1690 microversion: 2.1 time: 0.271845 Feb 19 21:27:56.749778 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2737/5565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:56 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 1690 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:27:57.767386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8b315b37-d2df-43ca-a351-ac2b6a046e1e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:27:57.768759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8b315b37-d2df-43ca-a351-ac2b6a046e1e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: f3e4c19f-82b1-4659-8369-472e042ef9a2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:27:57.775661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b315b37-d2df-43ca-a351-ac2b6a046e1e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:57.776123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b315b37-d2df-43ca-a351-ac2b6a046e1e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:57.776953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b315b37-d2df-43ca-a351-ac2b6a046e1e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:57.777404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b315b37-d2df-43ca-a351-ac2b6a046e1e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:57.791468 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-8b315b37-d2df-43ca-a351-ac2b6a046e1e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] HTTP exception thrown: Instance f3e4c19f-82b1-4659-8369-472e042ef9a2 could not be found. Feb 19 21:27:57.792226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8b315b37-d2df-43ca-a351-ac2b6a046e1e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Returning 404 to user: Instance f3e4c19f-82b1-4659-8369-472e042ef9a2 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:27:57.793118 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8b315b37-d2df-43ca-a351-ac2b6a046e1e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2" status: 404 len: 111 microversion: 2.1 time: 0.029984 Feb 19 21:27:57.793684 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2829/5566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:27:57 2022] GET /compute/v2.1/servers/f3e4c19f-82b1-4659-8369-472e042ef9a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:27:58.390011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-82780fa4-a97d-45f0-b9b4-e2a9e6148a37 req-7b6fedda-4fbe-4266-92fb-25316c13ade6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e4c19f-82b1-4659-8369-472e042ef9a2", "name": "network-vif-deleted", "tag": "a48bdca1-a574-49ba-b5ab-0409e41e9026"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:27:58.391849 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:27:58.391849 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:27:58.400602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-82780fa4-a97d-45f0-b9b4-e2a9e6148a37 req-7b6fedda-4fbe-4266-92fb-25316c13ade6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:27:58.401044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-82780fa4-a97d-45f0-b9b4-e2a9e6148a37 req-7b6fedda-4fbe-4266-92fb-25316c13ade6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:27:58.412485 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-82780fa4-a97d-45f0-b9b4-e2a9e6148a37 req-7b6fedda-4fbe-4266-92fb-25316c13ade6 service nova] Creating event network-vif-deleted:a48bdca1-a574-49ba-b5ab-0409e41e9026 for instance f3e4c19f-82b1-4659-8369-472e042ef9a2 on nch1-master-1 Feb 19 21:27:58.417605 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-82780fa4-a97d-45f0-b9b4-e2a9e6148a37 req-7b6fedda-4fbe-4266-92fb-25316c13ade6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031856 Feb 19 21:27:58.418144 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2738/5567] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:28:00.908063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-02645f07-ed1d-41df-a4c1-08b1258fc26f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '.version_select at 0x7f6467a09a60>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:00.935737 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-02645f07-ed1d-41df-a4c1-08b1258fc26f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-992680675" status: 202 len: 0 microversion: 2.1 time: 0.032230 Feb 19 21:28:00.936515 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2830/5568] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Feb 19 21:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-992680675 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:28:00.965434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b7e57d86-1d54-4dd9-a7bb-2ddf379ccc1f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'create', calling method: .version_select at 0x7f6467555820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1417056924"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:00.979780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b7e57d86-1d54-4dd9-a7bb-2ddf379ccc1f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:28:00.984775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b7e57d86-1d54-4dd9-a7bb-2ddf379ccc1f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:28:01.252158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b7e57d86-1d54-4dd9-a7bb-2ddf379ccc1f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:28:01.257540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b7e57d86-1d54-4dd9-a7bb-2ddf379ccc1f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:28:01.272131 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b7e57d86-1d54-4dd9-a7bb-2ddf379ccc1f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.312088 Feb 19 21:28:01.272764 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2739/5569] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:28:00 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:07.777081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d65e7135-4c8d-4bb8-bdee-368491e503ac tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:07.778291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d65e7135-4c8d-4bb8-bdee-368491e503ac tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:07.778432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-e7d5f266-9cb5-46b6-8d19-ccf1dfef876e req-12bae4cf-a09b-4854-81fa-684218389ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1695f956-3d9f-4acb-9c5c-0cf825ec7bc7", "tag": "4f4bd7f1-40bc-48c5-b9a1-1695752292d5"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:07.779864 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:28:07.779864 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:28:07.789811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e7d5f266-9cb5-46b6-8d19-ccf1dfef876e req-12bae4cf-a09b-4854-81fa-684218389ce6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:07.790266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-e7d5f266-9cb5-46b6-8d19-ccf1dfef876e req-12bae4cf-a09b-4854-81fa-684218389ce6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:07.804646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d65e7135-4c8d-4bb8-bdee-368491e503ac tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:07.805645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d65e7135-4c8d-4bb8-bdee-368491e503ac tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:07.809507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d65e7135-4c8d-4bb8-bdee-368491e503ac tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:07.812470 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-e7d5f266-9cb5-46b6-8d19-ccf1dfef876e req-12bae4cf-a09b-4854-81fa-684218389ce6 service nova] Creating event network-changed:4f4bd7f1-40bc-48c5-b9a1-1695752292d5 for instance 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 on nch1-master-1 Feb 19 21:28:07.813191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d65e7135-4c8d-4bb8-bdee-368491e503ac tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:07.825464 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-e7d5f266-9cb5-46b6-8d19-ccf1dfef876e req-12bae4cf-a09b-4854-81fa-684218389ce6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051359 Feb 19 21:28:07.832235 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2740/5570] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:28:07.854971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d65e7135-4c8d-4bb8-bdee-368491e503ac tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:28:08.015622 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d65e7135-4c8d-4bb8-bdee-368491e503ac tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 204 len: 0 microversion: 2.1 time: 0.245440 Feb 19 21:28:08.016188 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2831/5571] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:28:07 2022] DELETE /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:28:08.028234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e01d3203-10c7-4f34-b794-df8b7b10c0da tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:08.032885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e01d3203-10c7-4f34-b794-df8b7b10c0da tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:08.051969 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e01d3203-10c7-4f34-b794-df8b7b10c0da tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:08.052450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e01d3203-10c7-4f34-b794-df8b7b10c0da tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:08.058143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e01d3203-10c7-4f34-b794-df8b7b10c0da tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:08.058852 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e01d3203-10c7-4f34-b794-df8b7b10c0da tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:08.238869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1041185804", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "5d270d38-e63b-45e8-b253-0c56bf4eff89"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1417056924", "security_groups": [{"name": "tempest-secgroup-smoke-1780993889"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:08.279156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e01d3203-10c7-4f34-b794-df8b7b10c0da tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:08.287953 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e01d3203-10c7-4f34-b794-df8b7b10c0da tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1577 microversion: 2.1 time: 0.266724 Feb 19 21:28:08.301144 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2741/5572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:08 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1577 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:08.383904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] validate_networks() for [('5d270d38-e63b-45e8-b253-0c56bf4eff89', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:28:09.182466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:28:09.183116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:28:09.183717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:28:09.184136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:28:09.184588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:28:09.194166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:09.194655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:09.195512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:09.195941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:09.213881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for project 4cf8d04b22744889a736817e2226b3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:28:09.219561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Getting quotas for user 17132069f0e64e5a8647e5712f8e6533 and project 4cf8d04b22744889a736817e2226b3d0. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:28:09.231664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:28:09.234250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:28:09.291608 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7e0ea5af-8122-4cbe-95fd-a940a6052b95 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.057676 Feb 19 21:28:09.292893 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2832/5573] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:28:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:28:09.305007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-52deebf0-b0c9-4498-baf4-3671784682ae tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:09.305670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-52deebf0-b0c9-4498-baf4-3671784682ae tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:09.312401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec56ba8b-e41e-4a92-a8e2-873cbe076652 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:09.313043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ec56ba8b-e41e-4a92-a8e2-873cbe076652 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:09.321492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec56ba8b-e41e-4a92-a8e2-873cbe076652 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:09.322024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec56ba8b-e41e-4a92-a8e2-873cbe076652 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:09.322824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec56ba8b-e41e-4a92-a8e2-873cbe076652 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:09.323328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec56ba8b-e41e-4a92-a8e2-873cbe076652 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:09.424362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-52deebf0-b0c9-4498-baf4-3671784682ae tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:09.435549 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-52deebf0-b0c9-4498-baf4-3671784682ae tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1267 microversion: 2.1 time: 0.136454 Feb 19 21:28:09.436145 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2742/5574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:09 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:09.517283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec56ba8b-e41e-4a92-a8e2-873cbe076652 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:09.528897 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec56ba8b-e41e-4a92-a8e2-873cbe076652 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1458 microversion: 2.1 time: 0.220641 Feb 19 21:28:09.540694 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2833/5575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:09 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1458 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:10.160964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-9aada4b6-e783-4da4-8e73-6c096d7ad180 req-d4a85f68-3b96-4dde-80c5-407dfcbda547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1695f956-3d9f-4acb-9c5c-0cf825ec7bc7", "name": "network-vif-deleted", "tag": "4f4bd7f1-40bc-48c5-b9a1-1695752292d5"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:10.163283 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:28:10.163283 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:28:10.175288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9aada4b6-e783-4da4-8e73-6c096d7ad180 req-d4a85f68-3b96-4dde-80c5-407dfcbda547 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:10.176240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9aada4b6-e783-4da4-8e73-6c096d7ad180 req-d4a85f68-3b96-4dde-80c5-407dfcbda547 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:10.191387 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-9aada4b6-e783-4da4-8e73-6c096d7ad180 req-d4a85f68-3b96-4dde-80c5-407dfcbda547 service nova] Creating event network-vif-deleted:4f4bd7f1-40bc-48c5-b9a1-1695752292d5 for instance 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 on nch1-master-1 Feb 19 21:28:10.196592 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-9aada4b6-e783-4da4-8e73-6c096d7ad180 req-d4a85f68-3b96-4dde-80c5-407dfcbda547 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041309 Feb 19 21:28:10.198153 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2743/5576] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:28:10.453666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd4df226-d9af-41ba-b811-a3354bbf960c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:10.454465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dd4df226-d9af-41ba-b811-a3354bbf960c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:10.462224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd4df226-d9af-41ba-b811-a3354bbf960c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:10.462959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd4df226-d9af-41ba-b811-a3354bbf960c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:10.464260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd4df226-d9af-41ba-b811-a3354bbf960c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:10.465086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd4df226-d9af-41ba-b811-a3354bbf960c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:10.547169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:10.548800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:10.562493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:10.568972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:10.570192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:10.570804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:10.580386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dd4df226-d9af-41ba-b811-a3354bbf960c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:10.591819 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dd4df226-d9af-41ba-b811-a3354bbf960c tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1327 microversion: 2.1 time: 0.142221 Feb 19 21:28:10.603838 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2834/5577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:10 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1327 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:10.633645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:10.634518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:10.635272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lazy-loading 'fault' on Instance uuid 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:28:10.714956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:10.733332 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fd032448-10c3-43bb-b6ab-a231b0bb3f05 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 200 len: 1230 microversion: 2.1 time: 0.190255 Feb 19 21:28:10.734432 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2744/5578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:10 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 1230 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:28:11.612084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ffe41216-1fd2-4082-abbe-ae44bdfc2a04 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:11.613451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ffe41216-1fd2-4082-abbe-ae44bdfc2a04 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:11.624470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ffe41216-1fd2-4082-abbe-ae44bdfc2a04 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:11.626521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ffe41216-1fd2-4082-abbe-ae44bdfc2a04 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:11.627942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ffe41216-1fd2-4082-abbe-ae44bdfc2a04 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:11.628679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ffe41216-1fd2-4082-abbe-ae44bdfc2a04 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:11.757384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-642b3401-cec6-43d2-831e-7efc1827a0f4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:11.758646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-642b3401-cec6-43d2-831e-7efc1827a0f4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:11.767515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-642b3401-cec6-43d2-831e-7efc1827a0f4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:11.767985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-642b3401-cec6-43d2-831e-7efc1827a0f4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:11.769329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-642b3401-cec6-43d2-831e-7efc1827a0f4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:11.769996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-642b3401-cec6-43d2-831e-7efc1827a0f4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:11.792698 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-642b3401-cec6-43d2-831e-7efc1827a0f4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 could not be found. Feb 19 21:28:11.793301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-642b3401-cec6-43d2-831e-7efc1827a0f4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:28:11.794265 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-642b3401-cec6-43d2-831e-7efc1827a0f4 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7" status: 404 len: 111 microversion: 2.1 time: 0.042054 Feb 19 21:28:11.794828 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2745/5579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:11 2022] GET /compute/v2.1/servers/1695f956-3d9f-4acb-9c5c-0cf825ec7bc7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:28:11.880242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ffe41216-1fd2-4082-abbe-ae44bdfc2a04 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:11.892026 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ffe41216-1fd2-4082-abbe-ae44bdfc2a04 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1393 microversion: 2.1 time: 0.284234 Feb 19 21:28:11.904682 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2835/5580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:11 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1393 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:12.247540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8d3081bc-d489-4a71-b896-0a84a6093b0a req-428eb922-08a5-4f4e-84a2-2501faa779b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6c99d2-242e-4cea-b2f7-447e207fc9c1", "tag": "687dd4dc-f63b-43dd-bcfe-b546f231478b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:12.249914 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:28:12.249914 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:28:12.258450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8d3081bc-d489-4a71-b896-0a84a6093b0a req-428eb922-08a5-4f4e-84a2-2501faa779b4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:12.259592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8d3081bc-d489-4a71-b896-0a84a6093b0a req-428eb922-08a5-4f4e-84a2-2501faa779b4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:12.288640 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8d3081bc-d489-4a71-b896-0a84a6093b0a req-428eb922-08a5-4f4e-84a2-2501faa779b4 service nova] Creating event network-changed:687dd4dc-f63b-43dd-bcfe-b546f231478b for instance 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 on nch2-master-1 Feb 19 21:28:12.294036 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8d3081bc-d489-4a71-b896-0a84a6093b0a req-428eb922-08a5-4f4e-84a2-2501faa779b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052786 Feb 19 21:28:12.297614 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2746/5581] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:28:12.909202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6b5c889c-3659-4111-9714-fe6d76e3204b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:12.909839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6b5c889c-3659-4111-9714-fe6d76e3204b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:12.916905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b5c889c-3659-4111-9714-fe6d76e3204b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:12.917474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b5c889c-3659-4111-9714-fe6d76e3204b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:12.918280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b5c889c-3659-4111-9714-fe6d76e3204b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:12.918896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6b5c889c-3659-4111-9714-fe6d76e3204b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:13.158112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6b5c889c-3659-4111-9714-fe6d76e3204b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:13.165725 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6b5c889c-3659-4111-9714-fe6d76e3204b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1393 microversion: 2.1 time: 0.260430 Feb 19 21:28:13.166242 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2836/5582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:12 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1393 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:14.183568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0d50548e-5dc8-4cb5-a0ad-004eaa5f2b1d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:14.184258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0d50548e-5dc8-4cb5-a0ad-004eaa5f2b1d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:14.190962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d50548e-5dc8-4cb5-a0ad-004eaa5f2b1d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:14.191410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d50548e-5dc8-4cb5-a0ad-004eaa5f2b1d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:14.192179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d50548e-5dc8-4cb5-a0ad-004eaa5f2b1d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:14.192653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d50548e-5dc8-4cb5-a0ad-004eaa5f2b1d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:14.328806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0d50548e-5dc8-4cb5-a0ad-004eaa5f2b1d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:14.337624 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0d50548e-5dc8-4cb5-a0ad-004eaa5f2b1d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1393 microversion: 2.1 time: 0.158877 Feb 19 21:28:14.338481 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2747/5583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:14 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:15.354872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-326d6fd4-e32e-4306-945b-a3bf17e8898d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:15.355412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-326d6fd4-e32e-4306-945b-a3bf17e8898d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:15.362196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-326d6fd4-e32e-4306-945b-a3bf17e8898d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:15.362659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-326d6fd4-e32e-4306-945b-a3bf17e8898d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:15.363445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-326d6fd4-e32e-4306-945b-a3bf17e8898d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:15.363923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-326d6fd4-e32e-4306-945b-a3bf17e8898d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:15.503322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-326d6fd4-e32e-4306-945b-a3bf17e8898d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:15.510603 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-326d6fd4-e32e-4306-945b-a3bf17e8898d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1393 microversion: 2.1 time: 0.159561 Feb 19 21:28:15.511174 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2837/5584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:15 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:16.527819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2fd5539f-48fb-403f-9663-3412854e47d9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:16.528454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2fd5539f-48fb-403f-9663-3412854e47d9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:16.535833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fd5539f-48fb-403f-9663-3412854e47d9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:16.536284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fd5539f-48fb-403f-9663-3412854e47d9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:16.537087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fd5539f-48fb-403f-9663-3412854e47d9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:16.537523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fd5539f-48fb-403f-9663-3412854e47d9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:16.674173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2fd5539f-48fb-403f-9663-3412854e47d9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:16.682120 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2fd5539f-48fb-403f-9663-3412854e47d9 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1393 microversion: 2.1 time: 0.157908 Feb 19 21:28:16.682731 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2748/5585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:16 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:17.698998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68f0cbf6-1348-4eb0-a818-1b529814263d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:17.699894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-68f0cbf6-1348-4eb0-a818-1b529814263d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:17.706657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68f0cbf6-1348-4eb0-a818-1b529814263d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:17.707381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68f0cbf6-1348-4eb0-a818-1b529814263d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:17.708207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68f0cbf6-1348-4eb0-a818-1b529814263d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:17.708681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68f0cbf6-1348-4eb0-a818-1b529814263d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:17.845182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-68f0cbf6-1348-4eb0-a818-1b529814263d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:17.852492 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-68f0cbf6-1348-4eb0-a818-1b529814263d tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1393 microversion: 2.1 time: 0.157235 Feb 19 21:28:17.853076 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2838/5586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:17 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:18.869785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c47cbd25-6a4a-4e2a-9c8a-e4c0b14cf802 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:18.870398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c47cbd25-6a4a-4e2a-9c8a-e4c0b14cf802 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:18.877791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c47cbd25-6a4a-4e2a-9c8a-e4c0b14cf802 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:18.878250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c47cbd25-6a4a-4e2a-9c8a-e4c0b14cf802 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:18.879033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c47cbd25-6a4a-4e2a-9c8a-e4c0b14cf802 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:18.879482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c47cbd25-6a4a-4e2a-9c8a-e4c0b14cf802 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:19.017929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c47cbd25-6a4a-4e2a-9c8a-e4c0b14cf802 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:19.025366 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c47cbd25-6a4a-4e2a-9c8a-e4c0b14cf802 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1393 microversion: 2.1 time: 0.159242 Feb 19 21:28:19.025948 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2749/5587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:18 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:19.168813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-97a90f25-98ff-43e8-8233-9779f49a95b7 req-c114ec95-ea35-4b91-b3cd-bf6a50da68fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6c99d2-242e-4cea-b2f7-447e207fc9c1", "name": "network-vif-plugged", "status": "completed", "tag": "687dd4dc-f63b-43dd-bcfe-b546f231478b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:19.170635 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:28:19.170635 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:28:19.179978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-97a90f25-98ff-43e8-8233-9779f49a95b7 req-c114ec95-ea35-4b91-b3cd-bf6a50da68fd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:19.181972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-97a90f25-98ff-43e8-8233-9779f49a95b7 req-c114ec95-ea35-4b91-b3cd-bf6a50da68fd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:19.192180 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-97a90f25-98ff-43e8-8233-9779f49a95b7 req-c114ec95-ea35-4b91-b3cd-bf6a50da68fd service nova] Creating event network-vif-plugged:687dd4dc-f63b-43dd-bcfe-b546f231478b for instance 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 on nch2-master-1 Feb 19 21:28:19.197447 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-97a90f25-98ff-43e8-8233-9779f49a95b7 req-c114ec95-ea35-4b91-b3cd-bf6a50da68fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032215 Feb 19 21:28:19.198059 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2839/5588] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:28:20.043014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-808a3588-b267-4d6b-b07a-f34b711498ed tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:20.043648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-808a3588-b267-4d6b-b07a-f34b711498ed tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:20.051213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-808a3588-b267-4d6b-b07a-f34b711498ed tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:20.051661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-808a3588-b267-4d6b-b07a-f34b711498ed tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:20.052468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-808a3588-b267-4d6b-b07a-f34b711498ed tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:20.052910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-808a3588-b267-4d6b-b07a-f34b711498ed tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:20.196838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-808a3588-b267-4d6b-b07a-f34b711498ed tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:20.204823 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-808a3588-b267-4d6b-b07a-f34b711498ed tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1393 microversion: 2.1 time: 0.165736 Feb 19 21:28:20.205419 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2750/5589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:20 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:21.225543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-22f4ace8-ab2c-4f32-8ac5-31dadb5a9b45 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:21.226256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-22f4ace8-ab2c-4f32-8ac5-31dadb5a9b45 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:21.232424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22f4ace8-ab2c-4f32-8ac5-31dadb5a9b45 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:21.232920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22f4ace8-ab2c-4f32-8ac5-31dadb5a9b45 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:21.233704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22f4ace8-ab2c-4f32-8ac5-31dadb5a9b45 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:21.234147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-22f4ace8-ab2c-4f32-8ac5-31dadb5a9b45 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:21.371272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-22f4ace8-ab2c-4f32-8ac5-31dadb5a9b45 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:21.379018 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-22f4ace8-ab2c-4f32-8ac5-31dadb5a9b45 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1565 microversion: 2.1 time: 0.160150 Feb 19 21:28:21.379582 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2840/5590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:21 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:21.395360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5f23c585-1a4e-4af7-ad9d-22818af96d63 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:21.395975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5f23c585-1a4e-4af7-ad9d-22818af96d63 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:21.402716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f23c585-1a4e-4af7-ad9d-22818af96d63 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:21.403170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f23c585-1a4e-4af7-ad9d-22818af96d63 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:21.403954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f23c585-1a4e-4af7-ad9d-22818af96d63 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:21.404447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f23c585-1a4e-4af7-ad9d-22818af96d63 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:21.542182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5f23c585-1a4e-4af7-ad9d-22818af96d63 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:21.549495 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5f23c585-1a4e-4af7-ad9d-22818af96d63 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1565 microversion: 2.1 time: 0.157786 Feb 19 21:28:21.550071 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2751/5591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:21 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:23.171340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-5c68d729-a5a0-4b1d-9257-11b4aaae6c1d req-8d97ae21-ffc1-4f0c-8838-0be3cbf305e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6c99d2-242e-4cea-b2f7-447e207fc9c1", "tag": "687dd4dc-f63b-43dd-bcfe-b546f231478b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:23.172980 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:28:23.172980 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:28:23.177582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1be88b49-0a3a-4211-b858-0ae81f573447 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:23.178241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1be88b49-0a3a-4211-b858-0ae81f573447 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:23.181099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5c68d729-a5a0-4b1d-9257-11b4aaae6c1d req-8d97ae21-ffc1-4f0c-8838-0be3cbf305e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:23.181497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-5c68d729-a5a0-4b1d-9257-11b4aaae6c1d req-8d97ae21-ffc1-4f0c-8838-0be3cbf305e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:23.184989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1be88b49-0a3a-4211-b858-0ae81f573447 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:23.186769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1be88b49-0a3a-4211-b858-0ae81f573447 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:23.187594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1be88b49-0a3a-4211-b858-0ae81f573447 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:23.188217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1be88b49-0a3a-4211-b858-0ae81f573447 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:23.194170 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-5c68d729-a5a0-4b1d-9257-11b4aaae6c1d req-8d97ae21-ffc1-4f0c-8838-0be3cbf305e6 service nova] Creating event network-changed:687dd4dc-f63b-43dd-bcfe-b546f231478b for instance 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 on nch2-master-1 Feb 19 21:28:23.199353 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-5c68d729-a5a0-4b1d-9257-11b4aaae6c1d req-8d97ae21-ffc1-4f0c-8838-0be3cbf305e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032789 Feb 19 21:28:23.199976 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2752/5592] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:28:23.420632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1be88b49-0a3a-4211-b858-0ae81f573447 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:23.428593 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1be88b49-0a3a-4211-b858-0ae81f573447 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1565 microversion: 2.1 time: 0.266582 Feb 19 21:28:23.429277 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2841/5593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:23 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1565 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:44.942401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:44.943120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:44.943234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ad1bca3f-67e5-4376-a48d-4e3afc40e85a req-2b6d8ef1-3594-42fd-a78a-8468f31f16b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e", "tag": "b2d024a0-a38a-478b-9cd7-1ffacfb2e493"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:44.944745 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:28:44.944745 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:28:44.949621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:44.950148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:44.951010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:44.951537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:44.952373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ad1bca3f-67e5-4376-a48d-4e3afc40e85a req-2b6d8ef1-3594-42fd-a78a-8468f31f16b5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:44.952838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ad1bca3f-67e5-4376-a48d-4e3afc40e85a req-2b6d8ef1-3594-42fd-a78a-8468f31f16b5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:44.964656 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ad1bca3f-67e5-4376-a48d-4e3afc40e85a req-2b6d8ef1-3594-42fd-a78a-8468f31f16b5 service nova] Creating event network-changed:b2d024a0-a38a-478b-9cd7-1ffacfb2e493 for instance 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e on nch2-master-1 Feb 19 21:28:44.971542 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ad1bca3f-67e5-4376-a48d-4e3afc40e85a req-2b6d8ef1-3594-42fd-a78a-8468f31f16b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031935 Feb 19 21:28:44.972649 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2842/5594] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:28:44.978199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:28:45.065956 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1596cd40-3e3e-4fe9-a518-9a90c67b9075 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 204 len: 0 microversion: 2.1 time: 0.128305 Feb 19 21:28:45.066885 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2753/5595] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:28:44 2022] DELETE /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:28:45.075346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cb1927be-9b45-4898-a2d0-6d750baace1b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:45.076289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cb1927be-9b45-4898-a2d0-6d750baace1b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:45.083219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb1927be-9b45-4898-a2d0-6d750baace1b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:45.084013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb1927be-9b45-4898-a2d0-6d750baace1b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:45.084956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb1927be-9b45-4898-a2d0-6d750baace1b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:45.085482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb1927be-9b45-4898-a2d0-6d750baace1b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:45.323640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cb1927be-9b45-4898-a2d0-6d750baace1b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:45.331783 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cb1927be-9b45-4898-a2d0-6d750baace1b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1578 microversion: 2.1 time: 0.260456 Feb 19 21:28:45.332864 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2843/5596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:45 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1578 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:46.349914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-95e65ab2-a9a8-4aa7-8af0-b028ba58373b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:46.350618 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-95e65ab2-a9a8-4aa7-8af0-b028ba58373b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:46.357425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95e65ab2-a9a8-4aa7-8af0-b028ba58373b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:46.358846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95e65ab2-a9a8-4aa7-8af0-b028ba58373b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:46.359648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95e65ab2-a9a8-4aa7-8af0-b028ba58373b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:46.360088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95e65ab2-a9a8-4aa7-8af0-b028ba58373b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:46.499553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-95e65ab2-a9a8-4aa7-8af0-b028ba58373b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:46.507062 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-95e65ab2-a9a8-4aa7-8af0-b028ba58373b tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1459 microversion: 2.1 time: 0.161213 Feb 19 21:28:46.507634 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2754/5597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:46 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1459 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:47.215581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0c9e6200-5603-4028-be6f-74b85c9bfdaa req-e8fc8e75-711a-4492-a65b-fab8827b679e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e", "name": "network-vif-deleted", "tag": "b2d024a0-a38a-478b-9cd7-1ffacfb2e493"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:47.217132 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:28:47.217132 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:28:47.225870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0c9e6200-5603-4028-be6f-74b85c9bfdaa req-e8fc8e75-711a-4492-a65b-fab8827b679e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:47.226331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0c9e6200-5603-4028-be6f-74b85c9bfdaa req-e8fc8e75-711a-4492-a65b-fab8827b679e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:47.239067 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0c9e6200-5603-4028-be6f-74b85c9bfdaa req-e8fc8e75-711a-4492-a65b-fab8827b679e service nova] Creating event network-vif-deleted:b2d024a0-a38a-478b-9cd7-1ffacfb2e493 for instance 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e on nch2-master-1 Feb 19 21:28:47.245331 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0c9e6200-5603-4028-be6f-74b85c9bfdaa req-e8fc8e75-711a-4492-a65b-fab8827b679e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Feb 19 21:28:47.245982 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2844/5598] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:28:47.524207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:47.524867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:47.531978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:47.532522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:47.533318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:47.533762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:47.566929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:47.567384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:47.567847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lazy-loading 'fault' on Instance uuid 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:28:47.609160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af13ad54ab048d495e5ff0c0453abb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88a055c429b4b9e8e86a370c8571785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:28:47.617189 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-25db6b09-b5b7-48d3-b850-3fc42ca4cd5f tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 200 len: 1231 microversion: 2.1 time: 0.096475 Feb 19 21:28:47.617663 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2755/5599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:47 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:28:48.635741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2a6af16b-a0cd-4510-9f0f-2c51c81ed2ad tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:48.636479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2a6af16b-a0cd-4510-9f0f-2c51c81ed2ad tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:48.643434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a6af16b-a0cd-4510-9f0f-2c51c81ed2ad tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:48.643905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a6af16b-a0cd-4510-9f0f-2c51c81ed2ad tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:48.644921 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a6af16b-a0cd-4510-9f0f-2c51c81ed2ad tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:48.645270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a6af16b-a0cd-4510-9f0f-2c51c81ed2ad tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:48.658307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-2a6af16b-a0cd-4510-9f0f-2c51c81ed2ad tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e could not be found. Feb 19 21:28:48.658911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2a6af16b-a0cd-4510-9f0f-2c51c81ed2ad tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:28:48.659741 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2a6af16b-a0cd-4510-9f0f-2c51c81ed2ad tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e" status: 404 len: 111 microversion: 2.1 time: 0.028904 Feb 19 21:28:48.660285 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2845/5600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:48 2022] GET /compute/v2.1/servers/00ced7d5-ddb1-4efc-a8b0-f82ffd146a3e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:28:49.107490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-265ecdf7-2ae6-41ff-b531-c3ea697504c9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:49.108020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-265ecdf7-2ae6-41ff-b531-c3ea697504c9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:49.115307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-265ecdf7-2ae6-41ff-b531-c3ea697504c9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:49.115754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-265ecdf7-2ae6-41ff-b531-c3ea697504c9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:49.116556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-265ecdf7-2ae6-41ff-b531-c3ea697504c9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:49.116992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-265ecdf7-2ae6-41ff-b531-c3ea697504c9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:49.132209 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-265ecdf7-2ae6-41ff-b531-c3ea697504c9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 could not be found. Feb 19 21:28:49.132824 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-265ecdf7-2ae6-41ff-b531-c3ea697504c9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:28:49.133637 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-265ecdf7-2ae6-41ff-b531-c3ea697504c9 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 404 len: 111 microversion: 2.1 time: 0.029890 Feb 19 21:28:49.134167 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2756/5601] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:28:49 2022] DELETE /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:28:49.142028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d900083f-bc3c-485c-8996-468e3a27d3d0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:49.142686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d900083f-bc3c-485c-8996-468e3a27d3d0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] [instance: 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:49.148584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d900083f-bc3c-485c-8996-468e3a27d3d0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:49.149057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d900083f-bc3c-485c-8996-468e3a27d3d0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:49.149864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d900083f-bc3c-485c-8996-468e3a27d3d0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:49.150296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d900083f-bc3c-485c-8996-468e3a27d3d0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:49.163881 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-d900083f-bc3c-485c-8996-468e3a27d3d0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] HTTP exception thrown: Instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 could not be found. Feb 19 21:28:49.164503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d900083f-bc3c-485c-8996-468e3a27d3d0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Returning 404 to user: Instance 4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:28:49.165347 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d900083f-bc3c-485c-8996-468e3a27d3d0 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541" status: 404 len: 111 microversion: 2.1 time: 0.027020 Feb 19 21:28:49.165861 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2846/5602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:28:49 2022] GET /compute/v2.1/servers/4b8ac7e3-7628-4c31-a6c8-f5a5d3438541 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:28:51.489527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ddc9d2c4-baa0-4773-be14-01582c2340f1 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] Calling method '.version_select at 0x7f64792269d0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:28:51.511020 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ddc9d2c4-baa0-4773-be14-01582c2340f1 tempest-TestVolumeBootPattern-1165351049 tempest-TestVolumeBootPattern-1165351049-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1930550294" status: 202 len: 0 microversion: 2.1 time: 0.025499 Feb 19 21:28:51.511615 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2757/5603] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Feb 19 21:28:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1930550294 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:28:56.726427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-49424e6a-9988-41a7-8aef-fd65a096db87 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:28:56.728211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-49424e6a-9988-41a7-8aef-fd65a096db87 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:28:56.735808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49424e6a-9988-41a7-8aef-fd65a096db87 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:56.736569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49424e6a-9988-41a7-8aef-fd65a096db87 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:56.737605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49424e6a-9988-41a7-8aef-fd65a096db87 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:28:56.738131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49424e6a-9988-41a7-8aef-fd65a096db87 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:28:56.796235 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-49424e6a-9988-41a7-8aef-fd65a096db87 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1/action" status: 200 len: 24566 microversion: 2.1 time: 0.073228 Feb 19 21:28:56.797785 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2847/5604] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:28:56 2022] POST /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1/action => generated 24566 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:29:35.642829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f75529b9-2911-475e-b974-4af06053c17c"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:29:35.644235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:35.651450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:35.651892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:35.652717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:35.653164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:35.729343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:29:35.729768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:29:35.730247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:29:35.730648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:29:35.731061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:29:35.788580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:35.794216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:35.794674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:35.795499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:35.795952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:35.821991 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1f391322-1e07-43d1-81db-f97ce95181b4 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1/action" status: 202 len: 1138 microversion: 2.1 time: 0.182965 Feb 19 21:29:35.832103 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2758/5605] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:29:35 2022] POST /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1/action => generated 1138 bytes in 194 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 19 21:29:35.838361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8ea212e5-292f-4ee3-812e-3e24e2722e92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:35.839174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8ea212e5-292f-4ee3-812e-3e24e2722e92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:35.847071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ea212e5-292f-4ee3-812e-3e24e2722e92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:35.854335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ea212e5-292f-4ee3-812e-3e24e2722e92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:35.855210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ea212e5-292f-4ee3-812e-3e24e2722e92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:35.855668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ea212e5-292f-4ee3-812e-3e24e2722e92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:35.998752 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8ea212e5-292f-4ee3-812e-3e24e2722e92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:36.006948 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8ea212e5-292f-4ee3-812e-3e24e2722e92 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.173129 Feb 19 21:29:36.007533 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2848/5606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:35 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:37.024096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-de26add6-3651-4bfc-858b-275eec2746c7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:37.024735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-de26add6-3651-4bfc-858b-275eec2746c7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:37.031607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de26add6-3651-4bfc-858b-275eec2746c7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:37.032057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de26add6-3651-4bfc-858b-275eec2746c7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:37.032874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de26add6-3651-4bfc-858b-275eec2746c7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:37.033308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-de26add6-3651-4bfc-858b-275eec2746c7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:37.166233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-de26add6-3651-4bfc-858b-275eec2746c7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:37.173578 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-de26add6-3651-4bfc-858b-275eec2746c7 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.153232 Feb 19 21:29:37.174150 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2759/5607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:37 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:38.191007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a8b869b6-f520-49a2-aa10-693ff2de72d5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:38.191634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a8b869b6-f520-49a2-aa10-693ff2de72d5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:38.198179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b869b6-f520-49a2-aa10-693ff2de72d5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:38.198649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b869b6-f520-49a2-aa10-693ff2de72d5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:38.199449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b869b6-f520-49a2-aa10-693ff2de72d5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:38.199907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8b869b6-f520-49a2-aa10-693ff2de72d5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:38.342744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a8b869b6-f520-49a2-aa10-693ff2de72d5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:38.352505 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a8b869b6-f520-49a2-aa10-693ff2de72d5 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.165152 Feb 19 21:29:38.353280 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2849/5608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:38 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:39.369853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a3d4821b-9aef-422a-97b1-dd3188ad9ccb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:39.370483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a3d4821b-9aef-422a-97b1-dd3188ad9ccb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:39.377089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3d4821b-9aef-422a-97b1-dd3188ad9ccb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:39.378047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3d4821b-9aef-422a-97b1-dd3188ad9ccb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:39.378827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3d4821b-9aef-422a-97b1-dd3188ad9ccb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:39.379270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a3d4821b-9aef-422a-97b1-dd3188ad9ccb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:39.513730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a3d4821b-9aef-422a-97b1-dd3188ad9ccb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:39.521963 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a3d4821b-9aef-422a-97b1-dd3188ad9ccb tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.155795 Feb 19 21:29:39.522531 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2760/5609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:39 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:40.539420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f6c7d1d5-3ea8-485d-a9da-342a3bb9b516 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:40.540051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f6c7d1d5-3ea8-485d-a9da-342a3bb9b516 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:40.546728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6c7d1d5-3ea8-485d-a9da-342a3bb9b516 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:40.547188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6c7d1d5-3ea8-485d-a9da-342a3bb9b516 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:40.547964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6c7d1d5-3ea8-485d-a9da-342a3bb9b516 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:40.548439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6c7d1d5-3ea8-485d-a9da-342a3bb9b516 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:40.687216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f6c7d1d5-3ea8-485d-a9da-342a3bb9b516 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:40.695339 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f6c7d1d5-3ea8-485d-a9da-342a3bb9b516 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.159550 Feb 19 21:29:40.696757 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2850/5610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:40 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:41.712455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bcf46faa-4830-4394-95cc-bd8cd0997bc3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:41.713078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bcf46faa-4830-4394-95cc-bd8cd0997bc3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:41.719772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf46faa-4830-4394-95cc-bd8cd0997bc3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:41.720226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf46faa-4830-4394-95cc-bd8cd0997bc3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:41.721066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf46faa-4830-4394-95cc-bd8cd0997bc3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:41.721511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcf46faa-4830-4394-95cc-bd8cd0997bc3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:41.859685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bcf46faa-4830-4394-95cc-bd8cd0997bc3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:41.867631 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bcf46faa-4830-4394-95cc-bd8cd0997bc3 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.158899 Feb 19 21:29:41.868197 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2761/5611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:41 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:42.885427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-05e72318-301b-422b-a0f3-63847b9f1176 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:42.886149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-05e72318-301b-422b-a0f3-63847b9f1176 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:42.893252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-05e72318-301b-422b-a0f3-63847b9f1176 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:42.893712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-05e72318-301b-422b-a0f3-63847b9f1176 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:42.894495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-05e72318-301b-422b-a0f3-63847b9f1176 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:42.894946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-05e72318-301b-422b-a0f3-63847b9f1176 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:43.032620 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-05e72318-301b-422b-a0f3-63847b9f1176 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:43.039894 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-05e72318-301b-422b-a0f3-63847b9f1176 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.158252 Feb 19 21:29:43.040486 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2851/5612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:42 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:44.056014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e7eda450-15fd-45d2-b452-2bfb4adb97e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:44.056675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e7eda450-15fd-45d2-b452-2bfb4adb97e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:44.063544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eda450-15fd-45d2-b452-2bfb4adb97e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:44.064001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eda450-15fd-45d2-b452-2bfb4adb97e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:44.065307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eda450-15fd-45d2-b452-2bfb4adb97e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:44.065758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e7eda450-15fd-45d2-b452-2bfb4adb97e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:44.204435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e7eda450-15fd-45d2-b452-2bfb4adb97e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:44.212396 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e7eda450-15fd-45d2-b452-2bfb4adb97e6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.160058 Feb 19 21:29:44.212968 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2762/5613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:44 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:45.230774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-42df413f-1d4c-47fa-8c1c-5bd1b6f28b9e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:45.231391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-42df413f-1d4c-47fa-8c1c-5bd1b6f28b9e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:45.238898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42df413f-1d4c-47fa-8c1c-5bd1b6f28b9e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:45.239359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42df413f-1d4c-47fa-8c1c-5bd1b6f28b9e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:45.240141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42df413f-1d4c-47fa-8c1c-5bd1b6f28b9e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:45.240610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42df413f-1d4c-47fa-8c1c-5bd1b6f28b9e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:45.374195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-42df413f-1d4c-47fa-8c1c-5bd1b6f28b9e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:45.381509 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-42df413f-1d4c-47fa-8c1c-5bd1b6f28b9e tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.154440 Feb 19 21:29:45.382200 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2852/5614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:45 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:46.399073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-86437756-3229-4a1f-9ecb-5f020a708593 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:46.399677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-86437756-3229-4a1f-9ecb-5f020a708593 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:46.406511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86437756-3229-4a1f-9ecb-5f020a708593 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:46.406958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86437756-3229-4a1f-9ecb-5f020a708593 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:46.407732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86437756-3229-4a1f-9ecb-5f020a708593 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:46.408837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-86437756-3229-4a1f-9ecb-5f020a708593 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:46.545282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-86437756-3229-4a1f-9ecb-5f020a708593 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:46.552627 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-86437756-3229-4a1f-9ecb-5f020a708593 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1693 microversion: 2.1 time: 0.157268 Feb 19 21:29:46.553195 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2763/5615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:46 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:47.569838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-317188fa-2086-4519-894b-ba67dd4e5227 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:47.570553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-317188fa-2086-4519-894b-ba67dd4e5227 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:47.577261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-317188fa-2086-4519-894b-ba67dd4e5227 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:47.577725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-317188fa-2086-4519-894b-ba67dd4e5227 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:47.578619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-317188fa-2086-4519-894b-ba67dd4e5227 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:47.579064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-317188fa-2086-4519-894b-ba67dd4e5227 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:47.718023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-317188fa-2086-4519-894b-ba67dd4e5227 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:47.725417 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-317188fa-2086-4519-894b-ba67dd4e5227 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1711 microversion: 2.1 time: 0.159334 Feb 19 21:29:47.726017 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2853/5616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:47 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:48.742733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b632607-ee96-4079-b792-7116890b8859 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:48.743340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b632607-ee96-4079-b792-7116890b8859 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:48.750997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b632607-ee96-4079-b792-7116890b8859 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:48.751445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b632607-ee96-4079-b792-7116890b8859 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:48.752920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b632607-ee96-4079-b792-7116890b8859 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:48.753355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b632607-ee96-4079-b792-7116890b8859 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:48.891622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9b632607-ee96-4079-b792-7116890b8859 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:48.898952 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b632607-ee96-4079-b792-7116890b8859 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1699 microversion: 2.1 time: 0.159883 Feb 19 21:29:48.899526 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2764/5617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:48 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:49.916140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f65cf72f-1c03-42e1-93a3-89fcc103e427 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:49.916716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f65cf72f-1c03-42e1-93a3-89fcc103e427 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:49.923986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f65cf72f-1c03-42e1-93a3-89fcc103e427 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:49.924496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f65cf72f-1c03-42e1-93a3-89fcc103e427 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:49.925277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f65cf72f-1c03-42e1-93a3-89fcc103e427 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:49.925721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f65cf72f-1c03-42e1-93a3-89fcc103e427 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:50.059390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f65cf72f-1c03-42e1-93a3-89fcc103e427 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:50.066899 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f65cf72f-1c03-42e1-93a3-89fcc103e427 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1699 microversion: 2.1 time: 0.154522 Feb 19 21:29:50.067466 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2854/5618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:49 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:51.084518 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9c9a481f-d434-4d07-a6c5-0facfbd83c3a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:51.085131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9c9a481f-d434-4d07-a6c5-0facfbd83c3a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:51.091845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c9a481f-d434-4d07-a6c5-0facfbd83c3a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:51.092293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c9a481f-d434-4d07-a6c5-0facfbd83c3a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:51.093098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c9a481f-d434-4d07-a6c5-0facfbd83c3a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:51.093625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9c9a481f-d434-4d07-a6c5-0facfbd83c3a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:51.232349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9c9a481f-d434-4d07-a6c5-0facfbd83c3a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:51.239619 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9c9a481f-d434-4d07-a6c5-0facfbd83c3a tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1699 microversion: 2.1 time: 0.159066 Feb 19 21:29:51.240195 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2765/5619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:51 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:51.871478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4bc7cc66-bebd-47d3-936c-658236b8c844 req-9f21c1b1-5cf7-4aed-932a-b57805f5b484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6c99d2-242e-4cea-b2f7-447e207fc9c1", "name": "network-vif-unplugged", "status": "completed", "tag": "687dd4dc-f63b-43dd-bcfe-b546f231478b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:29:51.873125 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:29:51.873125 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:29:51.880816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4bc7cc66-bebd-47d3-936c-658236b8c844 req-9f21c1b1-5cf7-4aed-932a-b57805f5b484 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:51.881285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4bc7cc66-bebd-47d3-936c-658236b8c844 req-9f21c1b1-5cf7-4aed-932a-b57805f5b484 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:51.892108 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4bc7cc66-bebd-47d3-936c-658236b8c844 req-9f21c1b1-5cf7-4aed-932a-b57805f5b484 service nova] Creating event network-vif-unplugged:687dd4dc-f63b-43dd-bcfe-b546f231478b for instance 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 on nch2-master-1 Feb 19 21:29:51.897820 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4bc7cc66-bebd-47d3-936c-658236b8c844 req-9f21c1b1-5cf7-4aed-932a-b57805f5b484 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.245327 Feb 19 21:29:51.897978 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2855/5620] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:29:52.255851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-07e76464-2408-4acd-b7fa-43898b8aa6a0 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:29:52.256491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-07e76464-2408-4acd-b7fa-43898b8aa6a0 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:29:52.263187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07e76464-2408-4acd-b7fa-43898b8aa6a0 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:52.263636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07e76464-2408-4acd-b7fa-43898b8aa6a0 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:52.264468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07e76464-2408-4acd-b7fa-43898b8aa6a0 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:52.264937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-07e76464-2408-4acd-b7fa-43898b8aa6a0 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:52.401432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-07e76464-2408-4acd-b7fa-43898b8aa6a0 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:29:52.409424 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-07e76464-2408-4acd-b7fa-43898b8aa6a0 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1684 microversion: 2.1 time: 0.157209 Feb 19 21:29:52.410008 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2766/5621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:29:52 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:29:55.627257 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9d1c65b8-fe89-47e5-8b0a-083aa250c6a3 req-72e19b2a-f685-4ca8-a511-1221f16bd7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6c99d2-242e-4cea-b2f7-447e207fc9c1", "name": "network-vif-plugged", "status": "completed", "tag": "687dd4dc-f63b-43dd-bcfe-b546f231478b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:29:55.629257 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:29:55.629257 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:29:55.636849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9d1c65b8-fe89-47e5-8b0a-083aa250c6a3 req-72e19b2a-f685-4ca8-a511-1221f16bd7d8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:29:55.637300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9d1c65b8-fe89-47e5-8b0a-083aa250c6a3 req-72e19b2a-f685-4ca8-a511-1221f16bd7d8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:29:55.649061 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9d1c65b8-fe89-47e5-8b0a-083aa250c6a3 req-72e19b2a-f685-4ca8-a511-1221f16bd7d8 service nova] Creating event network-vif-plugged:687dd4dc-f63b-43dd-bcfe-b546f231478b for instance 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 on nch2-master-1 Feb 19 21:29:55.654101 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9d1c65b8-fe89-47e5-8b0a-083aa250c6a3 req-72e19b2a-f685-4ca8-a511-1221f16bd7d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Feb 19 21:29:55.654758 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2856/5622] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:30:17.750673 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:30:17.751771 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 21:30:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:30:28.646504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bcdb09a3-12f4-4d7c-a8a8-2cca88d4d07b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:30:28.647492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bcdb09a3-12f4-4d7c-a8a8-2cca88d4d07b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:30:28.653731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcdb09a3-12f4-4d7c-a8a8-2cca88d4d07b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:30:28.654224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcdb09a3-12f4-4d7c-a8a8-2cca88d4d07b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:30:28.655001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcdb09a3-12f4-4d7c-a8a8-2cca88d4d07b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:30:28.655442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcdb09a3-12f4-4d7c-a8a8-2cca88d4d07b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:30:28.709252 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bcdb09a3-12f4-4d7c-a8a8-2cca88d4d07b tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "POST /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1/action" status: 200 len: 24561 microversion: 2.1 time: 0.066890 Feb 19 21:30:28.709924 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2767/5623] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:30:28 2022] POST /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1/action => generated 24561 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:31:00.042970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f620f3c2-4630-41d3-9d60-3cf3e96600f1 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:00.043805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-850d2905-26a6-4cad-badd-3956e7317879 req-49985b17-9bdd-4552-97eb-547686f30935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6c99d2-242e-4cea-b2f7-447e207fc9c1", "tag": "687dd4dc-f63b-43dd-bcfe-b546f231478b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:00.044709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f620f3c2-4630-41d3-9d60-3cf3e96600f1 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:00.045654 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:31:00.045654 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:31:00.052384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f620f3c2-4630-41d3-9d60-3cf3e96600f1 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:00.053152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f620f3c2-4630-41d3-9d60-3cf3e96600f1 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:00.054170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f620f3c2-4630-41d3-9d60-3cf3e96600f1 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:00.054836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f620f3c2-4630-41d3-9d60-3cf3e96600f1 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:00.054955 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-850d2905-26a6-4cad-badd-3956e7317879 req-49985b17-9bdd-4552-97eb-547686f30935 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:00.055487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-850d2905-26a6-4cad-badd-3956e7317879 req-49985b17-9bdd-4552-97eb-547686f30935 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:00.072710 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-850d2905-26a6-4cad-badd-3956e7317879 req-49985b17-9bdd-4552-97eb-547686f30935 service nova] Creating event network-changed:687dd4dc-f63b-43dd-bcfe-b546f231478b for instance 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 on nch2-master-1 Feb 19 21:31:00.081990 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-850d2905-26a6-4cad-badd-3956e7317879 req-49985b17-9bdd-4552-97eb-547686f30935 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042256 Feb 19 21:31:00.083319 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2768/5624] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:31:00.093874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f620f3c2-4630-41d3-9d60-3cf3e96600f1 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:31:00.173702 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f620f3c2-4630-41d3-9d60-3cf3e96600f1 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 204 len: 0 microversion: 2.1 time: 0.137186 Feb 19 21:31:00.178077 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2857/5625] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:31:00 2022] DELETE /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:31:00.184558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-907df442-2d9a-49a5-85d3-6f3709bead15 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:00.185537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-907df442-2d9a-49a5-85d3-6f3709bead15 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:00.192885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-907df442-2d9a-49a5-85d3-6f3709bead15 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:00.193333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-907df442-2d9a-49a5-85d3-6f3709bead15 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:00.194395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-907df442-2d9a-49a5-85d3-6f3709bead15 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:00.194834 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-907df442-2d9a-49a5-85d3-6f3709bead15 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:00.593688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-907df442-2d9a-49a5-85d3-6f3709bead15 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:31:00.601348 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-907df442-2d9a-49a5-85d3-6f3709bead15 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1690 microversion: 2.1 time: 0.421462 Feb 19 21:31:00.602247 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2769/5626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:00 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1690 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:01.619274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f26eb9ed-4b75-4f43-9d09-91ad789f15c6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:01.619979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f26eb9ed-4b75-4f43-9d09-91ad789f15c6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:01.626534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f26eb9ed-4b75-4f43-9d09-91ad789f15c6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:01.627639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f26eb9ed-4b75-4f43-9d09-91ad789f15c6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:01.628604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f26eb9ed-4b75-4f43-9d09-91ad789f15c6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:01.629090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f26eb9ed-4b75-4f43-9d09-91ad789f15c6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:01.839471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f26eb9ed-4b75-4f43-9d09-91ad789f15c6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:31:01.847612 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f26eb9ed-4b75-4f43-9d09-91ad789f15c6 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1571 microversion: 2.1 time: 0.232364 Feb 19 21:31:01.848179 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2858/5627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:01 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1571 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:02.653176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-177aceb2-3aa2-44c7-a87e-2ed2555586c7 req-a0aaac7b-55b4-48d7-8fcd-1fa58e9528db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6c99d2-242e-4cea-b2f7-447e207fc9c1", "name": "network-vif-deleted", "tag": "687dd4dc-f63b-43dd-bcfe-b546f231478b"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:02.654825 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:31:02.654825 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:31:02.665112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-177aceb2-3aa2-44c7-a87e-2ed2555586c7 req-a0aaac7b-55b4-48d7-8fcd-1fa58e9528db service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:02.665562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-177aceb2-3aa2-44c7-a87e-2ed2555586c7 req-a0aaac7b-55b4-48d7-8fcd-1fa58e9528db service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:02.676865 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-177aceb2-3aa2-44c7-a87e-2ed2555586c7 req-a0aaac7b-55b4-48d7-8fcd-1fa58e9528db service nova] Creating event network-vif-deleted:687dd4dc-f63b-43dd-bcfe-b546f231478b for instance 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 on nch2-master-1 Feb 19 21:31:02.681712 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-177aceb2-3aa2-44c7-a87e-2ed2555586c7 req-a0aaac7b-55b4-48d7-8fcd-1fa58e9528db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032514 Feb 19 21:31:02.682307 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2770/5628] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:31:02.865317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:02.865841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:02.872681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:02.873138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:02.873916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:02.874553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:02.906304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:02.906766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:02.907225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lazy-loading 'fault' on Instance uuid 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:31:02.955776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17132069f0e64e5a8647e5712f8e6533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf8d04b22744889a736817e2226b3d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:31:02.964026 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4566a3ec-d289-4d17-8644-a88c8a149d49 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 200 len: 1357 microversion: 2.1 time: 0.102866 Feb 19 21:31:02.964844 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2859/5629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:02 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:03.982170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4f00acf5-bd51-45ba-9e58-54ef22633c23 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:03.982791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4f00acf5-bd51-45ba-9e58-54ef22633c23 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] [instance: 1c6c99d2-242e-4cea-b2f7-447e207fc9c1] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:03.989727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f00acf5-bd51-45ba-9e58-54ef22633c23 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:03.990185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f00acf5-bd51-45ba-9e58-54ef22633c23 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:03.990972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f00acf5-bd51-45ba-9e58-54ef22633c23 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:03.991421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4f00acf5-bd51-45ba-9e58-54ef22633c23 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:04.004403 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-4f00acf5-bd51-45ba-9e58-54ef22633c23 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] HTTP exception thrown: Instance 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 could not be found. Feb 19 21:31:04.004995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4f00acf5-bd51-45ba-9e58-54ef22633c23 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Returning 404 to user: Instance 1c6c99d2-242e-4cea-b2f7-447e207fc9c1 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:31:04.005808 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4f00acf5-bd51-45ba-9e58-54ef22633c23 tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1" status: 404 len: 111 microversion: 2.1 time: 0.028629 Feb 19 21:31:04.006330 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2771/5630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:03 2022] GET /compute/v2.1/servers/1c6c99d2-242e-4cea-b2f7-447e207fc9c1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:31:07.337071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fb222742-cd71-4397-be62-d988e058de8f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] Calling method '.version_select at 0x7f64645434c0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:07.364961 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fb222742-cd71-4397-be62-d988e058de8f tempest-TestNetworkAdvancedServerOps-190520844 tempest-TestNetworkAdvancedServerOps-190520844-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1417056924" status: 202 len: 0 microversion: 2.1 time: 0.031575 Feb 19 21:31:07.365955 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2860/5631] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Feb 19 21:31:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1417056924 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:31:21.571461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8917e282-8aa0-43fa-99b7-ec1642c7eda0 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:21.572366 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:31:21.572366 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:31:21.575027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8917e282-8aa0-43fa-99b7-ec1642c7eda0 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:21.575836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8917e282-8aa0-43fa-99b7-ec1642c7eda0 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:21.577394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8917e282-8aa0-43fa-99b7-ec1642c7eda0 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:21.578614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8917e282-8aa0-43fa-99b7-ec1642c7eda0 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:21.611930 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8917e282-8aa0-43fa-99b7-ec1642c7eda0 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.176825 Feb 19 21:31:21.613296 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2772/5632] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Feb 19 21:31:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:31:21.728794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1702749112", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "04bb4b61-e3a3-4f30-bf33-c6f2464c1e2a"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:21.808842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] validate_networks() for [('04bb4b61-e3a3-4f30-bf33-c6f2464c1e2a', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:31:22.311166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:31:22.311594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:31:22.312101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:31:22.312546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:31:22.313511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:31:22.322176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:22.322629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:22.323436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:22.323884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:22.340521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Getting quotas for project 743163568cef44aeaa073c0f5273e82f. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:31:22.345454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Getting quotas for user d1fa3059049c46909ec90740b64ea359 and project 743163568cef44aeaa073c0f5273e82f. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:31:22.357332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:31:22.359645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:31:22.403985 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-279afe92-11b5-4b2d-9c62-9aa0d7b9c200 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684839 Feb 19 21:31:22.404684 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2861/5633] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:31:22.414212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-051af5a0-d1d9-4c61-9f71-3827dc569d74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:22.414826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-051af5a0-d1d9-4c61-9f71-3827dc569d74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:22.477571 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-051af5a0-d1d9-4c61-9f71-3827dc569d74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1329 microversion: 2.1 time: 0.066921 Feb 19 21:31:22.478153 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2773/5634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:22 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1329 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:23.495843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-368a34a9-8a02-4b8c-9723-b82971c4470f tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:23.496569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-368a34a9-8a02-4b8c-9723-b82971c4470f tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:23.512924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-368a34a9-8a02-4b8c-9723-b82971c4470f tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:23.517088 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-368a34a9-8a02-4b8c-9723-b82971c4470f tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:23.518206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-368a34a9-8a02-4b8c-9723-b82971c4470f tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:23.519181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-368a34a9-8a02-4b8c-9723-b82971c4470f tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:23.621303 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-368a34a9-8a02-4b8c-9723-b82971c4470f tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1424 microversion: 2.1 time: 0.117605 Feb 19 21:31:23.622943 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2862/5635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:23 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:24.643207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ead63cbe-023f-4ef1-93ed-932dbcf4d642 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:24.647571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ead63cbe-023f-4ef1-93ed-932dbcf4d642 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:24.658315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ead63cbe-023f-4ef1-93ed-932dbcf4d642 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:24.659338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ead63cbe-023f-4ef1-93ed-932dbcf4d642 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:24.660405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ead63cbe-023f-4ef1-93ed-932dbcf4d642 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:24.661075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ead63cbe-023f-4ef1-93ed-932dbcf4d642 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:24.874118 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ead63cbe-023f-4ef1-93ed-932dbcf4d642 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1464 microversion: 2.1 time: 0.237233 Feb 19 21:31:24.874715 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2774/5636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:24 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1464 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:25.082599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-85198e1e-c509-48cc-9dc2-4f8f0f92ee7b req-02103a08-8bb7-4167-9349-4503ffa5fe30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300ecc00-4e72-4d1f-b9d3-5e7524a38a13", "tag": "383b03cf-8a8e-449b-a744-52771cbe00ba"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:25.093788 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:31:25.093788 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:31:25.105249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-85198e1e-c509-48cc-9dc2-4f8f0f92ee7b req-02103a08-8bb7-4167-9349-4503ffa5fe30 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:25.105720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-85198e1e-c509-48cc-9dc2-4f8f0f92ee7b req-02103a08-8bb7-4167-9349-4503ffa5fe30 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:25.130262 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-85198e1e-c509-48cc-9dc2-4f8f0f92ee7b req-02103a08-8bb7-4167-9349-4503ffa5fe30 service nova] Creating event network-changed:383b03cf-8a8e-449b-a744-52771cbe00ba for instance 300ecc00-4e72-4d1f-b9d3-5e7524a38a13 on nch2-master-1 Feb 19 21:31:25.139068 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-85198e1e-c509-48cc-9dc2-4f8f0f92ee7b req-02103a08-8bb7-4167-9349-4503ffa5fe30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179905 Feb 19 21:31:25.144180 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2863/5637] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:31:25.891928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6ff2d287-6926-4fe3-a8b6-40f5e454ce5e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:25.892669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6ff2d287-6926-4fe3-a8b6-40f5e454ce5e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:25.899697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ff2d287-6926-4fe3-a8b6-40f5e454ce5e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:25.900145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ff2d287-6926-4fe3-a8b6-40f5e454ce5e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:25.900963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ff2d287-6926-4fe3-a8b6-40f5e454ce5e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:25.901402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ff2d287-6926-4fe3-a8b6-40f5e454ce5e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:26.133852 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6ff2d287-6926-4fe3-a8b6-40f5e454ce5e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1464 microversion: 2.1 time: 0.246551 Feb 19 21:31:26.134454 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2775/5638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:25 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1464 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:27.151840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-708d30c4-af2f-4feb-a8bc-42aff0f6c6d7 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:27.152613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-708d30c4-af2f-4feb-a8bc-42aff0f6c6d7 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:27.159204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-708d30c4-af2f-4feb-a8bc-42aff0f6c6d7 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:27.159669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-708d30c4-af2f-4feb-a8bc-42aff0f6c6d7 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:27.160496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-708d30c4-af2f-4feb-a8bc-42aff0f6c6d7 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:27.160948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-708d30c4-af2f-4feb-a8bc-42aff0f6c6d7 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:27.287840 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-708d30c4-af2f-4feb-a8bc-42aff0f6c6d7 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1464 microversion: 2.1 time: 0.140797 Feb 19 21:31:27.288425 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2864/5639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:27 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1464 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:28.303750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-674fd1e4-897c-456a-80ce-8455dd352185 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:28.304389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-674fd1e4-897c-456a-80ce-8455dd352185 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:28.311178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-674fd1e4-897c-456a-80ce-8455dd352185 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:28.311635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-674fd1e4-897c-456a-80ce-8455dd352185 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:28.312452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-674fd1e4-897c-456a-80ce-8455dd352185 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:28.312898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-674fd1e4-897c-456a-80ce-8455dd352185 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:28.443894 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-674fd1e4-897c-456a-80ce-8455dd352185 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1464 microversion: 2.1 time: 0.143764 Feb 19 21:31:28.444476 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2776/5640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:28 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:29.460263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-96c5ab14-7e17-4a69-a9bf-384d921909ef tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:29.460829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-96c5ab14-7e17-4a69-a9bf-384d921909ef tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:29.467730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c5ab14-7e17-4a69-a9bf-384d921909ef tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:29.468197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c5ab14-7e17-4a69-a9bf-384d921909ef tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:29.469009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c5ab14-7e17-4a69-a9bf-384d921909ef tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:29.469455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-96c5ab14-7e17-4a69-a9bf-384d921909ef tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:29.606541 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-96c5ab14-7e17-4a69-a9bf-384d921909ef tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1464 microversion: 2.1 time: 0.149927 Feb 19 21:31:29.607108 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2865/5641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:29 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:30.622865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-218e8b6d-2c14-4e0b-b4f9-9116d9269a37 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:30.623464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-218e8b6d-2c14-4e0b-b4f9-9116d9269a37 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:30.631053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-218e8b6d-2c14-4e0b-b4f9-9116d9269a37 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:30.631506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-218e8b6d-2c14-4e0b-b4f9-9116d9269a37 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:30.632292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-218e8b6d-2c14-4e0b-b4f9-9116d9269a37 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:30.632772 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-218e8b6d-2c14-4e0b-b4f9-9116d9269a37 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:30.767316 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-218e8b6d-2c14-4e0b-b4f9-9116d9269a37 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1464 microversion: 2.1 time: 0.148086 Feb 19 21:31:30.767929 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2777/5642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:30 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:31.782905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a2c2c6cf-b219-4797-a1ed-f9f02577497c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:31.783678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a2c2c6cf-b219-4797-a1ed-f9f02577497c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:31.790392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2c2c6cf-b219-4797-a1ed-f9f02577497c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:31.790849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2c2c6cf-b219-4797-a1ed-f9f02577497c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:31.791628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2c2c6cf-b219-4797-a1ed-f9f02577497c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:31.792074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a2c2c6cf-b219-4797-a1ed-f9f02577497c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:31.919765 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a2c2c6cf-b219-4797-a1ed-f9f02577497c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1464 microversion: 2.1 time: 0.140444 Feb 19 21:31:31.920346 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2866/5643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:31 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1464 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:32.173217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-dc27c6a9-faf7-48b7-acfd-9b0975ecfdeb req-467f1889-4d8e-4486-a94b-1c7eca80f598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300ecc00-4e72-4d1f-b9d3-5e7524a38a13", "name": "network-vif-plugged", "status": "completed", "tag": "383b03cf-8a8e-449b-a744-52771cbe00ba"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:32.174695 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:31:32.174695 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:31:32.182634 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-dc27c6a9-faf7-48b7-acfd-9b0975ecfdeb req-467f1889-4d8e-4486-a94b-1c7eca80f598 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:32.183131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-dc27c6a9-faf7-48b7-acfd-9b0975ecfdeb req-467f1889-4d8e-4486-a94b-1c7eca80f598 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:32.194707 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-dc27c6a9-faf7-48b7-acfd-9b0975ecfdeb req-467f1889-4d8e-4486-a94b-1c7eca80f598 service nova] Creating event network-vif-plugged:383b03cf-8a8e-449b-a744-52771cbe00ba for instance 300ecc00-4e72-4d1f-b9d3-5e7524a38a13 on nch2-master-1 Feb 19 21:31:32.199650 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-dc27c6a9-faf7-48b7-acfd-9b0975ecfdeb req-467f1889-4d8e-4486-a94b-1c7eca80f598 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Feb 19 21:31:32.200254 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2778/5644] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:31:32.935613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-87a24761-1043-424e-bb5c-f06ddd7f91de tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:32.936242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-87a24761-1043-424e-bb5c-f06ddd7f91de tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:32.943633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87a24761-1043-424e-bb5c-f06ddd7f91de tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:32.944095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87a24761-1043-424e-bb5c-f06ddd7f91de tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:32.944914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87a24761-1043-424e-bb5c-f06ddd7f91de tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:32.945365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-87a24761-1043-424e-bb5c-f06ddd7f91de tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:33.072287 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-87a24761-1043-424e-bb5c-f06ddd7f91de tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1464 microversion: 2.1 time: 0.140265 Feb 19 21:31:33.072889 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2867/5645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:32 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1464 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:34.090595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8f1cf72d-5aa0-48fb-859f-9d420c60475a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:34.091297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8f1cf72d-5aa0-48fb-859f-9d420c60475a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:34.097508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f1cf72d-5aa0-48fb-859f-9d420c60475a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:34.097958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f1cf72d-5aa0-48fb-859f-9d420c60475a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:34.098737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f1cf72d-5aa0-48fb-859f-9d420c60475a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:34.099179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8f1cf72d-5aa0-48fb-859f-9d420c60475a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:34.235798 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8f1cf72d-5aa0-48fb-859f-9d420c60475a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1649 microversion: 2.1 time: 0.149529 Feb 19 21:31:34.236385 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2779/5646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:34 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1649 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:34.252381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ee623c2a-0b2b-4b5c-b25c-462572e38089 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:34.253005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ee623c2a-0b2b-4b5c-b25c-462572e38089 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:34.259638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee623c2a-0b2b-4b5c-b25c-462572e38089 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:34.260100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee623c2a-0b2b-4b5c-b25c-462572e38089 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:34.260918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee623c2a-0b2b-4b5c-b25c-462572e38089 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:34.261366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ee623c2a-0b2b-4b5c-b25c-462572e38089 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:34.391288 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ee623c2a-0b2b-4b5c-b25c-462572e38089 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1649 microversion: 2.1 time: 0.143115 Feb 19 21:31:34.392378 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2868/5647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:34 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1649 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:34.408608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-90dc07bf-58d6-4c45-aae7-406d692ebe94 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:34.409218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-90dc07bf-58d6-4c45-aae7-406d692ebe94 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:34.415776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90dc07bf-58d6-4c45-aae7-406d692ebe94 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:34.416223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90dc07bf-58d6-4c45-aae7-406d692ebe94 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:34.417023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90dc07bf-58d6-4c45-aae7-406d692ebe94 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:34.417460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-90dc07bf-58d6-4c45-aae7-406d692ebe94 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:34.544294 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-90dc07bf-58d6-4c45-aae7-406d692ebe94 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1649 microversion: 2.1 time: 0.140698 Feb 19 21:31:34.544888 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2780/5648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:34 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1649 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:34.597688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1504900082", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "04bb4b61-e3a3-4f30-bf33-c6f2464c1e2a"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:34.651225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] validate_networks() for [('04bb4b61-e3a3-4f30-bf33-c6f2464c1e2a', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:31:34.996055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:31:34.996528 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:31:34.997018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:31:34.997442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:31:34.997868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:31:35.007607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:35.008071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:35.008933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:35.009388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:35.025387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Getting quotas for project 743163568cef44aeaa073c0f5273e82f. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:31:35.030618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Getting quotas for user d1fa3059049c46909ec90740b64ea359 and project 743163568cef44aeaa073c0f5273e82f. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:31:35.042886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:31:35.045586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:31:35.090285 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-814d7797-f034-49b7-896f-dad21373f77e tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496975 Feb 19 21:31:35.090961 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2869/5649] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:31:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:31:35.100750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c64a533-64b1-45fe-845f-0dcd8d01a8bc tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:35.101375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4c64a533-64b1-45fe-845f-0dcd8d01a8bc tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:35.159789 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c64a533-64b1-45fe-845f-0dcd8d01a8bc tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1329 microversion: 2.1 time: 0.062542 Feb 19 21:31:35.160301 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2781/5650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:35 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1329 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:36.176681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1ae24996-ed11-4e7e-afaf-50efcebb42f5 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:36.177315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1ae24996-ed11-4e7e-afaf-50efcebb42f5 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:36.184689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ae24996-ed11-4e7e-afaf-50efcebb42f5 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:36.185368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ae24996-ed11-4e7e-afaf-50efcebb42f5 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:36.186436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ae24996-ed11-4e7e-afaf-50efcebb42f5 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:36.187112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ae24996-ed11-4e7e-afaf-50efcebb42f5 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:36.262339 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1ae24996-ed11-4e7e-afaf-50efcebb42f5 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1422 microversion: 2.1 time: 0.089058 Feb 19 21:31:36.262954 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2870/5651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:36 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:37.280247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2b46b631-0ce0-4b5b-b9ec-8349db3a2ea4 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:37.282845 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2b46b631-0ce0-4b5b-b9ec-8349db3a2ea4 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:37.292714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b46b631-0ce0-4b5b-b9ec-8349db3a2ea4 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:37.293516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b46b631-0ce0-4b5b-b9ec-8349db3a2ea4 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:37.294524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b46b631-0ce0-4b5b-b9ec-8349db3a2ea4 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:37.295133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b46b631-0ce0-4b5b-b9ec-8349db3a2ea4 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:37.296197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a2ed5aa0-fa9c-42ec-a3b6-255b8ecd55ea req-fbb710d6-800a-48ff-b19e-5a6118b123b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df10248b-103e-433f-9ba9-e751bb04fe8f", "tag": "d839dd07-67ff-451a-8264-4275f86f6f5f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:37.297857 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:31:37.297857 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:31:37.308074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a2ed5aa0-fa9c-42ec-a3b6-255b8ecd55ea req-fbb710d6-800a-48ff-b19e-5a6118b123b9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:37.308967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a2ed5aa0-fa9c-42ec-a3b6-255b8ecd55ea req-fbb710d6-800a-48ff-b19e-5a6118b123b9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:37.320114 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a2ed5aa0-fa9c-42ec-a3b6-255b8ecd55ea req-fbb710d6-800a-48ff-b19e-5a6118b123b9 service nova] Creating event network-changed:d839dd07-67ff-451a-8264-4275f86f6f5f for instance df10248b-103e-433f-9ba9-e751bb04fe8f on nch1-master-1 Feb 19 21:31:37.325213 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a2ed5aa0-fa9c-42ec-a3b6-255b8ecd55ea req-fbb710d6-800a-48ff-b19e-5a6118b123b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145611 Feb 19 21:31:37.326356 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2782/5652] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:31:37.447970 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2b46b631-0ce0-4b5b-b9ec-8349db3a2ea4 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1464 microversion: 2.1 time: 0.171212 Feb 19 21:31:37.450133 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2871/5653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:37 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:31:38.468535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-349f5fdc-80f9-428a-aa4c-4e2c738a98ab tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:38.469162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-349f5fdc-80f9-428a-aa4c-4e2c738a98ab tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:38.475370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-349f5fdc-80f9-428a-aa4c-4e2c738a98ab tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:38.475831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-349f5fdc-80f9-428a-aa4c-4e2c738a98ab tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:38.476638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-349f5fdc-80f9-428a-aa4c-4e2c738a98ab tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:38.477082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-349f5fdc-80f9-428a-aa4c-4e2c738a98ab tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:38.604043 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-349f5fdc-80f9-428a-aa4c-4e2c738a98ab tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1464 microversion: 2.1 time: 0.140536 Feb 19 21:31:38.604648 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2783/5654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:38 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1464 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:31:39.620709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-abdeb767-9ffa-4123-9c07-e7a357ce1dd6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:39.621328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-abdeb767-9ffa-4123-9c07-e7a357ce1dd6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:39.628602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abdeb767-9ffa-4123-9c07-e7a357ce1dd6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:39.629139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abdeb767-9ffa-4123-9c07-e7a357ce1dd6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:39.629973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abdeb767-9ffa-4123-9c07-e7a357ce1dd6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:39.630509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-abdeb767-9ffa-4123-9c07-e7a357ce1dd6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:39.760939 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-abdeb767-9ffa-4123-9c07-e7a357ce1dd6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1464 microversion: 2.1 time: 0.143907 Feb 19 21:31:39.761502 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2872/5655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:39 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:40.777364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4a711375-9040-4a6e-8bc0-98753e914153 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:40.777985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4a711375-9040-4a6e-8bc0-98753e914153 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:40.784645 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a711375-9040-4a6e-8bc0-98753e914153 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:40.785100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a711375-9040-4a6e-8bc0-98753e914153 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:40.785886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a711375-9040-4a6e-8bc0-98753e914153 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:40.786330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a711375-9040-4a6e-8bc0-98753e914153 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:40.917046 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4a711375-9040-4a6e-8bc0-98753e914153 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1464 microversion: 2.1 time: 0.143270 Feb 19 21:31:40.917637 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2784/5656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:40 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:41.657127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-38d7c358-3282-473d-b38d-937c11dd6c8c req-495a6af8-d7b1-4ecc-a82c-faeb752a6bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df10248b-103e-433f-9ba9-e751bb04fe8f", "name": "network-vif-plugged", "status": "completed", "tag": "d839dd07-67ff-451a-8264-4275f86f6f5f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:41.658711 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:31:41.658711 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:31:41.666322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-38d7c358-3282-473d-b38d-937c11dd6c8c req-495a6af8-d7b1-4ecc-a82c-faeb752a6bb1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:41.666857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-38d7c358-3282-473d-b38d-937c11dd6c8c req-495a6af8-d7b1-4ecc-a82c-faeb752a6bb1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:41.679107 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-38d7c358-3282-473d-b38d-937c11dd6c8c req-495a6af8-d7b1-4ecc-a82c-faeb752a6bb1 service nova] Creating event network-vif-plugged:d839dd07-67ff-451a-8264-4275f86f6f5f for instance df10248b-103e-433f-9ba9-e751bb04fe8f on nch1-master-1 Feb 19 21:31:41.684026 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-38d7c358-3282-473d-b38d-937c11dd6c8c req-495a6af8-d7b1-4ecc-a82c-faeb752a6bb1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031059 Feb 19 21:31:41.684852 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2873/5657] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:31:41.932893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cd314aed-2181-4616-b5a1-81f539d8f391 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:41.933501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cd314aed-2181-4616-b5a1-81f539d8f391 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:41.940140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd314aed-2181-4616-b5a1-81f539d8f391 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:41.940615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd314aed-2181-4616-b5a1-81f539d8f391 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:41.941392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd314aed-2181-4616-b5a1-81f539d8f391 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:41.941827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd314aed-2181-4616-b5a1-81f539d8f391 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:42.070404 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cd314aed-2181-4616-b5a1-81f539d8f391 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1464 microversion: 2.1 time: 0.141150 Feb 19 21:31:42.070986 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2785/5658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:41 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:43.089176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f3c60403-bc9e-4fba-963e-b68fd041093b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:43.089893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f3c60403-bc9e-4fba-963e-b68fd041093b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:43.095952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3c60403-bc9e-4fba-963e-b68fd041093b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.096462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3c60403-bc9e-4fba-963e-b68fd041093b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.097248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3c60403-bc9e-4fba-963e-b68fd041093b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.097704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3c60403-bc9e-4fba-963e-b68fd041093b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.231534 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f3c60403-bc9e-4fba-963e-b68fd041093b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1649 microversion: 2.1 time: 0.147277 Feb 19 21:31:43.232106 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2874/5659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:43 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1649 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:43.247617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b3a6546-7b31-4e5a-8d39-3f8c2a5aeae6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:43.248232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b3a6546-7b31-4e5a-8d39-3f8c2a5aeae6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:43.255501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b3a6546-7b31-4e5a-8d39-3f8c2a5aeae6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.255950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b3a6546-7b31-4e5a-8d39-3f8c2a5aeae6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.256766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b3a6546-7b31-4e5a-8d39-3f8c2a5aeae6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.257239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b3a6546-7b31-4e5a-8d39-3f8c2a5aeae6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.386894 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b3a6546-7b31-4e5a-8d39-3f8c2a5aeae6 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1649 microversion: 2.1 time: 0.142795 Feb 19 21:31:43.387478 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2786/5660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:43 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1649 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:43.402426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a258436-3c9f-4aab-83b7-d382b500b69a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:43.403040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a258436-3c9f-4aab-83b7-d382b500b69a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:43.408913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a258436-3c9f-4aab-83b7-d382b500b69a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.409370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a258436-3c9f-4aab-83b7-d382b500b69a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.410147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a258436-3c9f-4aab-83b7-d382b500b69a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.410587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a258436-3c9f-4aab-83b7-d382b500b69a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.539206 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a258436-3c9f-4aab-83b7-d382b500b69a tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1649 microversion: 2.1 time: 0.140315 Feb 19 21:31:43.539790 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2875/5661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:43 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1649 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:43.555229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-47d1f87f-fffd-4e87-973b-62d29f6bdd3c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:43.555723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-47d1f87f-fffd-4e87-973b-62d29f6bdd3c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:43.561577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-47d1f87f-fffd-4e87-973b-62d29f6bdd3c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.562023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-47d1f87f-fffd-4e87-973b-62d29f6bdd3c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.563426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-47d1f87f-fffd-4e87-973b-62d29f6bdd3c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.563862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-47d1f87f-fffd-4e87-973b-62d29f6bdd3c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.587068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-47d1f87f-fffd-4e87-973b-62d29f6bdd3c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:31:43.670575 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-47d1f87f-fffd-4e87-973b-62d29f6bdd3c tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 204 len: 0 microversion: 2.1 time: 0.118421 Feb 19 21:31:43.671089 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2787/5662] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:31:43 2022] DELETE /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:31:43.679455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0b8bd841-abc3-45fe-9d04-c9e0377b8788 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:43.680076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0b8bd841-abc3-45fe-9d04-c9e0377b8788 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:43.686610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b8bd841-abc3-45fe-9d04-c9e0377b8788 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.687128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b8bd841-abc3-45fe-9d04-c9e0377b8788 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.687907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b8bd841-abc3-45fe-9d04-c9e0377b8788 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:43.688370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0b8bd841-abc3-45fe-9d04-c9e0377b8788 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:43.817103 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0b8bd841-abc3-45fe-9d04-c9e0377b8788 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1655 microversion: 2.1 time: 0.141140 Feb 19 21:31:43.817673 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2876/5663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:43 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:44.834043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4b545be4-1d30-425d-8b3d-74c38c8ab271 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:44.834748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4b545be4-1d30-425d-8b3d-74c38c8ab271 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:44.841529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b545be4-1d30-425d-8b3d-74c38c8ab271 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:44.841984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b545be4-1d30-425d-8b3d-74c38c8ab271 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:44.842763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b545be4-1d30-425d-8b3d-74c38c8ab271 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:44.843204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b545be4-1d30-425d-8b3d-74c38c8ab271 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:44.970362 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4b545be4-1d30-425d-8b3d-74c38c8ab271 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 200 len: 1655 microversion: 2.1 time: 0.140258 Feb 19 21:31:44.970929 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2788/5664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:44 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:45.455268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9e2ccb13-6c8d-4fdb-b11c-704ee39f2f68 req-25d25dc8-39ea-4a33-b32a-618d49df93bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df10248b-103e-433f-9ba9-e751bb04fe8f", "name": "network-vif-deleted", "tag": "d839dd07-67ff-451a-8264-4275f86f6f5f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:45.464134 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:31:45.464134 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:31:45.480881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9e2ccb13-6c8d-4fdb-b11c-704ee39f2f68 req-25d25dc8-39ea-4a33-b32a-618d49df93bb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:45.481416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9e2ccb13-6c8d-4fdb-b11c-704ee39f2f68 req-25d25dc8-39ea-4a33-b32a-618d49df93bb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:45.497266 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9e2ccb13-6c8d-4fdb-b11c-704ee39f2f68 req-25d25dc8-39ea-4a33-b32a-618d49df93bb service nova] Creating event network-vif-deleted:d839dd07-67ff-451a-8264-4275f86f6f5f for instance df10248b-103e-433f-9ba9-e751bb04fe8f on nch1-master-1 Feb 19 21:31:45.503576 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9e2ccb13-6c8d-4fdb-b11c-704ee39f2f68 req-25d25dc8-39ea-4a33-b32a-618d49df93bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057467 Feb 19 21:31:45.504537 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2877/5665] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:31:45.986658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4792f9ef-9386-487f-b7eb-c7affc653884 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:45.987281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4792f9ef-9386-487f-b7eb-c7affc653884 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: df10248b-103e-433f-9ba9-e751bb04fe8f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:45.994150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4792f9ef-9386-487f-b7eb-c7affc653884 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:45.994630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4792f9ef-9386-487f-b7eb-c7affc653884 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:45.995455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4792f9ef-9386-487f-b7eb-c7affc653884 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:45.995897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4792f9ef-9386-487f-b7eb-c7affc653884 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:46.010248 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-4792f9ef-9386-487f-b7eb-c7affc653884 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] HTTP exception thrown: Instance df10248b-103e-433f-9ba9-e751bb04fe8f could not be found. Feb 19 21:31:46.010849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4792f9ef-9386-487f-b7eb-c7affc653884 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Returning 404 to user: Instance df10248b-103e-433f-9ba9-e751bb04fe8f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:31:46.011679 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4792f9ef-9386-487f-b7eb-c7affc653884 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f" status: 404 len: 111 microversion: 2.1 time: 0.028758 Feb 19 21:31:46.012237 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2789/5666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:45 2022] GET /compute/v2.1/servers/df10248b-103e-433f-9ba9-e751bb04fe8f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:31:46.021400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ca79f050-b027-4325-b068-7dcc04466c99 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:46.021996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ca79f050-b027-4325-b068-7dcc04466c99 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:46.027979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca79f050-b027-4325-b068-7dcc04466c99 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:46.028503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca79f050-b027-4325-b068-7dcc04466c99 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:46.029319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca79f050-b027-4325-b068-7dcc04466c99 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:46.029759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca79f050-b027-4325-b068-7dcc04466c99 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:46.055042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ca79f050-b027-4325-b068-7dcc04466c99 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:31:46.126785 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ca79f050-b027-4325-b068-7dcc04466c99 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 204 len: 0 microversion: 2.1 time: 0.109089 Feb 19 21:31:46.127738 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2878/5667] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:31:46 2022] DELETE /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:31:46.136552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-48a71c6a-1816-4fe9-9878-dd805511658b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:46.137141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-48a71c6a-1816-4fe9-9878-dd805511658b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:46.143223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48a71c6a-1816-4fe9-9878-dd805511658b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:46.143681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48a71c6a-1816-4fe9-9878-dd805511658b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:46.144522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48a71c6a-1816-4fe9-9878-dd805511658b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:46.144968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-48a71c6a-1816-4fe9-9878-dd805511658b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:46.286191 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-48a71c6a-1816-4fe9-9878-dd805511658b tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1655 microversion: 2.1 time: 0.154017 Feb 19 21:31:46.286761 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2790/5668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:46 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:47.304411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-38d03f75-3195-45b9-8416-de9af577fc74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:47.305130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-38d03f75-3195-45b9-8416-de9af577fc74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:47.311832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38d03f75-3195-45b9-8416-de9af577fc74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:47.312305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38d03f75-3195-45b9-8416-de9af577fc74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:47.313795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38d03f75-3195-45b9-8416-de9af577fc74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:47.314251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38d03f75-3195-45b9-8416-de9af577fc74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:47.440392 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-38d03f75-3195-45b9-8416-de9af577fc74 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1655 microversion: 2.1 time: 0.140015 Feb 19 21:31:47.440996 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2879/5669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:47 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:48.168805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-90227a5f-28fc-4b5f-9418-9fe292aa8687 req-0dd91fdc-2e8e-4f3f-b6be-e89bc28fd9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300ecc00-4e72-4d1f-b9d3-5e7524a38a13", "name": "network-vif-deleted", "tag": "383b03cf-8a8e-449b-a744-52771cbe00ba"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:31:48.171455 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:31:48.171455 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:31:48.180140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-90227a5f-28fc-4b5f-9418-9fe292aa8687 req-0dd91fdc-2e8e-4f3f-b6be-e89bc28fd9bb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:48.180942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-90227a5f-28fc-4b5f-9418-9fe292aa8687 req-0dd91fdc-2e8e-4f3f-b6be-e89bc28fd9bb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:48.193867 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-90227a5f-28fc-4b5f-9418-9fe292aa8687 req-0dd91fdc-2e8e-4f3f-b6be-e89bc28fd9bb service nova] Creating event network-vif-deleted:383b03cf-8a8e-449b-a744-52771cbe00ba for instance 300ecc00-4e72-4d1f-b9d3-5e7524a38a13 on nch2-master-1 Feb 19 21:31:48.199401 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-90227a5f-28fc-4b5f-9418-9fe292aa8687 req-0dd91fdc-2e8e-4f3f-b6be-e89bc28fd9bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034548 Feb 19 21:31:48.200272 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2791/5670] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:31:48.458547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:48.459082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:48.465790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:48.466249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:48.467027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:48.467579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:48.497792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:48.498252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:48.498713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lazy-loading 'fault' on Instance uuid 300ecc00-4e72-4d1f-b9d3-5e7524a38a13 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:31:48.546412 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-70494f08-6455-4166-a962-2279442b1166 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 200 len: 1454 microversion: 2.1 time: 0.091513 Feb 19 21:31:48.547695 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2880/5671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:48 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:31:49.566608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9525ec26-feab-4fc1-b883-23bd788d0352 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:31:49.567299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9525ec26-feab-4fc1-b883-23bd788d0352 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] [instance: 300ecc00-4e72-4d1f-b9d3-5e7524a38a13] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:31:49.573445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9525ec26-feab-4fc1-b883-23bd788d0352 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:49.573895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9525ec26-feab-4fc1-b883-23bd788d0352 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:49.574672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9525ec26-feab-4fc1-b883-23bd788d0352 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:31:49.575109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9525ec26-feab-4fc1-b883-23bd788d0352 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:31:49.588194 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9525ec26-feab-4fc1-b883-23bd788d0352 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] HTTP exception thrown: Instance 300ecc00-4e72-4d1f-b9d3-5e7524a38a13 could not be found. Feb 19 21:31:49.588797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9525ec26-feab-4fc1-b883-23bd788d0352 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] Returning 404 to user: Instance 300ecc00-4e72-4d1f-b9d3-5e7524a38a13 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:31:49.589633 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9525ec26-feab-4fc1-b883-23bd788d0352 tempest-TestServerMultinode-2043113948 tempest-TestServerMultinode-2043113948-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13" status: 404 len: 111 microversion: 2.1 time: 0.028620 Feb 19 21:31:49.590165 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2792/5672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:31:49 2022] GET /compute/v2.1/servers/300ecc00-4e72-4d1f-b9d3-5e7524a38a13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:31:59.571499 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:31:59.572184 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 21:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:32:00.604424 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:32:00.605423 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 21:32:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:32:24.000506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c2918acb-f281-452b-b769-c368b6251f84 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Action: 'create', calling method: .version_select at 0x7f6464540b80>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1980720770"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:32:24.014420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c2918acb-f281-452b-b769-c368b6251f84 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Getting quotas for project 72f5105ec09c4f3c82c087633532c76a. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:32:24.019521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c2918acb-f281-452b-b769-c368b6251f84 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Getting quotas for user f489d295f12b43719f3ba84f7d2dc683 and project 72f5105ec09c4f3c82c087633532c76a. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:32:24.175654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c2918acb-f281-452b-b769-c368b6251f84 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Getting quotas for project 72f5105ec09c4f3c82c087633532c76a. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:32:24.180271 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c2918acb-f281-452b-b769-c368b6251f84 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Getting quotas for user f489d295f12b43719f3ba84f7d2dc683 and project 72f5105ec09c4f3c82c087633532c76a. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:32:24.194581 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c2918acb-f281-452b-b769-c368b6251f84 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.198012 Feb 19 21:32:24.195172 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2881/5673] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:32:23 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:25.100584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1962884735", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "78bcad5a-4a24-4ba3-af4e-0ce1c804279c", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1980720770", "security_groups": [{"name": "tempest-secgroup-smoke-1318523731"}], "networks": [{"uuid": "e501790d-f9f0-494b-b073-39b69c12b88b"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:32:25.209090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] validate_networks() for [('e501790d-f9f0-494b-b073-39b69c12b88b', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:32:25.670410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:32:25.670838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:32:25.671345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:32:25.671759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:32:25.672704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:32:25.681453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:25.681903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:25.682720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:25.683158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:25.699978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Getting quotas for project 72f5105ec09c4f3c82c087633532c76a. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:32:25.705680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Getting quotas for user f489d295f12b43719f3ba84f7d2dc683 and project 72f5105ec09c4f3c82c087633532c76a. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:32:25.761434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:32:25.764765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78bcad5a-4a24-4ba3-af4e-0ce1c804279c',volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:32:25.889675 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dcc14f3a-f071-4571-bbda-ee018ee39156 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.793109 Feb 19 21:32:25.890463 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2793/5674] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:32:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:32:25.901872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd84a92a-272f-4ba1-912d-c186de1b0d6a tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:25.902603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fd84a92a-272f-4ba1-912d-c186de1b0d6a tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:25.957881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fd84a92a-272f-4ba1-912d-c186de1b0d6a tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:25.964429 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fd84a92a-272f-4ba1-912d-c186de1b0d6a tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1099 microversion: 2.1 time: 0.067777 Feb 19 21:32:25.964998 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2882/5675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:25 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1099 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:26.982765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f369cc1d-b131-4478-99d7-3ee163f64818 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:26.984085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f369cc1d-b131-4478-99d7-3ee163f64818 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:26.990799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f369cc1d-b131-4478-99d7-3ee163f64818 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:26.991266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f369cc1d-b131-4478-99d7-3ee163f64818 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:26.992062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f369cc1d-b131-4478-99d7-3ee163f64818 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:26.992529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f369cc1d-b131-4478-99d7-3ee163f64818 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:27.392300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f369cc1d-b131-4478-99d7-3ee163f64818 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:27.399955 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f369cc1d-b131-4478-99d7-3ee163f64818 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1215 microversion: 2.1 time: 0.421994 Feb 19 21:32:27.400978 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2794/5676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:26 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1215 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:28.417793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8b79568f-9aef-4943-8085-bfff5925ad58 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:28.419009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8b79568f-9aef-4943-8085-bfff5925ad58 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:28.426340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b79568f-9aef-4943-8085-bfff5925ad58 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:28.426833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b79568f-9aef-4943-8085-bfff5925ad58 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:28.429777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b79568f-9aef-4943-8085-bfff5925ad58 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:28.430463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8b79568f-9aef-4943-8085-bfff5925ad58 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:28.542054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-cd4c9242-702b-4742-97b2-8b1870a306c5 req-64ca3cd4-4a5a-44c7-a03a-145c7b715047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f113925-120d-40cc-b839-02454f963b02", "tag": "4743adec-2ebd-4c1f-9f90-1ce85d2304c5"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:32:28.543959 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:32:28.543959 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:32:28.554942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cd4c9242-702b-4742-97b2-8b1870a306c5 req-64ca3cd4-4a5a-44c7-a03a-145c7b715047 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:28.555699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-cd4c9242-702b-4742-97b2-8b1870a306c5 req-64ca3cd4-4a5a-44c7-a03a-145c7b715047 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:28.575658 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-cd4c9242-702b-4742-97b2-8b1870a306c5 req-64ca3cd4-4a5a-44c7-a03a-145c7b715047 service nova] Creating event network-changed:4743adec-2ebd-4c1f-9f90-1ce85d2304c5 for instance 2f113925-120d-40cc-b839-02454f963b02 on nch2-master-1 Feb 19 21:32:28.581357 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-cd4c9242-702b-4742-97b2-8b1870a306c5 req-64ca3cd4-4a5a-44c7-a03a-145c7b715047 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043148 Feb 19 21:32:28.582609 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2795/5677] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:32:28.679165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8b79568f-9aef-4943-8085-bfff5925ad58 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:28.686797 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8b79568f-9aef-4943-8085-bfff5925ad58 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1271 microversion: 2.1 time: 0.273476 Feb 19 21:32:28.687404 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2883/5678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:28 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:29.705801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7ddb76a9-b494-41d9-a6e2-4b72e7992690 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:29.706507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7ddb76a9-b494-41d9-a6e2-4b72e7992690 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:29.713646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ddb76a9-b494-41d9-a6e2-4b72e7992690 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:29.714143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ddb76a9-b494-41d9-a6e2-4b72e7992690 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:29.715069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ddb76a9-b494-41d9-a6e2-4b72e7992690 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:29.715541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7ddb76a9-b494-41d9-a6e2-4b72e7992690 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:29.867609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7ddb76a9-b494-41d9-a6e2-4b72e7992690 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:29.875555 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7ddb76a9-b494-41d9-a6e2-4b72e7992690 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1271 microversion: 2.1 time: 0.174428 Feb 19 21:32:29.876141 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2796/5679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:29 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:30.892809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8a1f5388-345a-4149-af85-68b3cd0d8ea3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:30.893431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8a1f5388-345a-4149-af85-68b3cd0d8ea3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:30.900135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a1f5388-345a-4149-af85-68b3cd0d8ea3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:30.900642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a1f5388-345a-4149-af85-68b3cd0d8ea3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:30.901435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a1f5388-345a-4149-af85-68b3cd0d8ea3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:30.901888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8a1f5388-345a-4149-af85-68b3cd0d8ea3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:31.036399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8a1f5388-345a-4149-af85-68b3cd0d8ea3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:31.043622 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8a1f5388-345a-4149-af85-68b3cd0d8ea3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1271 microversion: 2.1 time: 0.155081 Feb 19 21:32:31.044180 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2884/5680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:30 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:32.060204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d8ddd5d6-badb-40e7-aa88-a44ecd17d9c3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:32.060844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d8ddd5d6-badb-40e7-aa88-a44ecd17d9c3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:32.070512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8ddd5d6-badb-40e7-aa88-a44ecd17d9c3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:32.071117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8ddd5d6-badb-40e7-aa88-a44ecd17d9c3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:32.071919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8ddd5d6-badb-40e7-aa88-a44ecd17d9c3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:32.072377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d8ddd5d6-badb-40e7-aa88-a44ecd17d9c3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:32.225071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d8ddd5d6-badb-40e7-aa88-a44ecd17d9c3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:32.232625 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d8ddd5d6-badb-40e7-aa88-a44ecd17d9c3 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1271 microversion: 2.1 time: 0.176153 Feb 19 21:32:32.233199 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2797/5681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:32 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:33.248996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8904c992-f61a-407b-96b5-716d3d092c89 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:33.249960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8904c992-f61a-407b-96b5-716d3d092c89 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:33.256642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8904c992-f61a-407b-96b5-716d3d092c89 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:33.257102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8904c992-f61a-407b-96b5-716d3d092c89 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:33.257878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8904c992-f61a-407b-96b5-716d3d092c89 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:33.258321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8904c992-f61a-407b-96b5-716d3d092c89 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:33.392496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8904c992-f61a-407b-96b5-716d3d092c89 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:33.399725 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8904c992-f61a-407b-96b5-716d3d092c89 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1271 microversion: 2.1 time: 0.154425 Feb 19 21:32:33.400289 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2885/5682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:33 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:34.419806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1c0d8037-71af-4144-979c-3127585a9289 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:34.420785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1c0d8037-71af-4144-979c-3127585a9289 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:34.431497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c0d8037-71af-4144-979c-3127585a9289 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:34.432028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c0d8037-71af-4144-979c-3127585a9289 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:34.432872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c0d8037-71af-4144-979c-3127585a9289 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:34.433319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c0d8037-71af-4144-979c-3127585a9289 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:34.573540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1c0d8037-71af-4144-979c-3127585a9289 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:34.581243 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1c0d8037-71af-4144-979c-3127585a9289 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1271 microversion: 2.1 time: 0.167175 Feb 19 21:32:34.581815 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2798/5683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:34 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:35.600300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-78075732-c997-45f2-a8f3-43050caf40e5 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:35.601061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-78075732-c997-45f2-a8f3-43050caf40e5 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:35.607912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78075732-c997-45f2-a8f3-43050caf40e5 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:35.608411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78075732-c997-45f2-a8f3-43050caf40e5 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:35.609208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78075732-c997-45f2-a8f3-43050caf40e5 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:35.609661 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-78075732-c997-45f2-a8f3-43050caf40e5 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:35.749043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-78075732-c997-45f2-a8f3-43050caf40e5 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:35.756908 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-78075732-c997-45f2-a8f3-43050caf40e5 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1271 microversion: 2.1 time: 0.161503 Feb 19 21:32:35.757476 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2886/5684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:35 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:36.398438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-35d8e7e1-dd82-444c-aaae-a8f69f1a97d7 req-3625938e-0dc5-4411-938f-5fccdc410b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f113925-120d-40cc-b839-02454f963b02", "name": "network-vif-plugged", "status": "completed", "tag": "4743adec-2ebd-4c1f-9f90-1ce85d2304c5"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:32:36.400445 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:32:36.400445 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:32:36.408714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-35d8e7e1-dd82-444c-aaae-a8f69f1a97d7 req-3625938e-0dc5-4411-938f-5fccdc410b80 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:36.409348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-35d8e7e1-dd82-444c-aaae-a8f69f1a97d7 req-3625938e-0dc5-4411-938f-5fccdc410b80 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:36.420472 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-35d8e7e1-dd82-444c-aaae-a8f69f1a97d7 req-3625938e-0dc5-4411-938f-5fccdc410b80 service nova] Creating event network-vif-plugged:4743adec-2ebd-4c1f-9f90-1ce85d2304c5 for instance 2f113925-120d-40cc-b839-02454f963b02 on nch2-master-1 Feb 19 21:32:36.426010 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-35d8e7e1-dd82-444c-aaae-a8f69f1a97d7 req-3625938e-0dc5-4411-938f-5fccdc410b80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031406 Feb 19 21:32:36.426613 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2799/5685] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:32:36.773732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bd280885-02a5-4d20-862c-d3f8156b990e tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:36.774351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bd280885-02a5-4d20-862c-d3f8156b990e tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:36.780658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd280885-02a5-4d20-862c-d3f8156b990e tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:36.781121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd280885-02a5-4d20-862c-d3f8156b990e tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:36.781898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd280885-02a5-4d20-862c-d3f8156b990e tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:36.782341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bd280885-02a5-4d20-862c-d3f8156b990e tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:36.919096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bd280885-02a5-4d20-862c-d3f8156b990e tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:36.926363 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bd280885-02a5-4d20-862c-d3f8156b990e tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1271 microversion: 2.1 time: 0.156424 Feb 19 21:32:36.926921 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2887/5686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:36 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:37.944439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2eee8e7d-880c-4475-ac08-21e325f97389 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:37.945073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2eee8e7d-880c-4475-ac08-21e325f97389 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:37.951793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2eee8e7d-880c-4475-ac08-21e325f97389 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:37.952300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2eee8e7d-880c-4475-ac08-21e325f97389 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:37.953114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2eee8e7d-880c-4475-ac08-21e325f97389 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:37.953556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2eee8e7d-880c-4475-ac08-21e325f97389 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:38.089680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2eee8e7d-880c-4475-ac08-21e325f97389 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:38.097618 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2eee8e7d-880c-4475-ac08-21e325f97389 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1460 microversion: 2.1 time: 0.158208 Feb 19 21:32:38.098186 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2800/5687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:37 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:38.114175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d54695cc-ff93-4fdc-9b26-6fd7b87e6703 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:32:38.114797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d54695cc-ff93-4fdc-9b26-6fd7b87e6703 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:32:38.121366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d54695cc-ff93-4fdc-9b26-6fd7b87e6703 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:38.121819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d54695cc-ff93-4fdc-9b26-6fd7b87e6703 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:38.122602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d54695cc-ff93-4fdc-9b26-6fd7b87e6703 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:38.123045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d54695cc-ff93-4fdc-9b26-6fd7b87e6703 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:38.260748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d54695cc-ff93-4fdc-9b26-6fd7b87e6703 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:32:38.268700 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d54695cc-ff93-4fdc-9b26-6fd7b87e6703 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1460 microversion: 2.1 time: 0.159068 Feb 19 21:32:38.269266 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2888/5688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:32:38 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:32:39.910965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2673d655-6119-4aa0-8b16-d95936626f1b req-d2d9dcc4-2875-4f45-a5b3-9f37d2ea64db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f113925-120d-40cc-b839-02454f963b02", "tag": "4743adec-2ebd-4c1f-9f90-1ce85d2304c5"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:32:39.912614 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:32:39.912614 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:32:39.920250 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2673d655-6119-4aa0-8b16-d95936626f1b req-d2d9dcc4-2875-4f45-a5b3-9f37d2ea64db service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:39.920749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2673d655-6119-4aa0-8b16-d95936626f1b req-d2d9dcc4-2875-4f45-a5b3-9f37d2ea64db service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:39.934198 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2673d655-6119-4aa0-8b16-d95936626f1b req-d2d9dcc4-2875-4f45-a5b3-9f37d2ea64db service nova] Creating event network-changed:4743adec-2ebd-4c1f-9f90-1ce85d2304c5 for instance 2f113925-120d-40cc-b839-02454f963b02 on nch2-master-1 Feb 19 21:32:39.939365 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2673d655-6119-4aa0-8b16-d95936626f1b req-d2d9dcc4-2875-4f45-a5b3-9f37d2ea64db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032872 Feb 19 21:32:39.940394 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2801/5689] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:32:40.896562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0543516d-61d9-4982-a69e-fff31c6c39c6 req-5239c231-a3ea-41bd-bfc1-f3265c7a544d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f113925-120d-40cc-b839-02454f963b02", "tag": "4743adec-2ebd-4c1f-9f90-1ce85d2304c5"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:32:40.898694 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:32:40.898694 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:32:40.906430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0543516d-61d9-4982-a69e-fff31c6c39c6 req-5239c231-a3ea-41bd-bfc1-f3265c7a544d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:40.906877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0543516d-61d9-4982-a69e-fff31c6c39c6 req-5239c231-a3ea-41bd-bfc1-f3265c7a544d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:40.926152 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0543516d-61d9-4982-a69e-fff31c6c39c6 req-5239c231-a3ea-41bd-bfc1-f3265c7a544d service nova] Creating event network-changed:4743adec-2ebd-4c1f-9f90-1ce85d2304c5 for instance 2f113925-120d-40cc-b839-02454f963b02 on nch2-master-1 Feb 19 21:32:40.931658 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0543516d-61d9-4982-a69e-fff31c6c39c6 req-5239c231-a3ea-41bd-bfc1-f3265c7a544d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038796 Feb 19 21:32:40.932271 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2889/5690] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:32:42.947581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2f9c76b7-058e-4211-bf9b-d8832aac8222 req-446a43b4-4046-454b-a3fc-fcfdc8bb3da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f113925-120d-40cc-b839-02454f963b02", "tag": "4743adec-2ebd-4c1f-9f90-1ce85d2304c5"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:32:42.949132 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:32:42.949132 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:32:42.956571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2f9c76b7-058e-4211-bf9b-d8832aac8222 req-446a43b4-4046-454b-a3fc-fcfdc8bb3da9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:32:42.956960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2f9c76b7-058e-4211-bf9b-d8832aac8222 req-446a43b4-4046-454b-a3fc-fcfdc8bb3da9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:32:42.967312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2f9c76b7-058e-4211-bf9b-d8832aac8222 req-446a43b4-4046-454b-a3fc-fcfdc8bb3da9 service nova] Creating event network-changed:4743adec-2ebd-4c1f-9f90-1ce85d2304c5 for instance 2f113925-120d-40cc-b839-02454f963b02 on nch2-master-1 Feb 19 21:32:42.971986 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2f9c76b7-058e-4211-bf9b-d8832aac8222 req-446a43b4-4046-454b-a3fc-fcfdc8bb3da9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029225 Feb 19 21:32:42.972599 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2802/5691] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:33:18.860207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:18.861184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:18.864282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-23435142-d05a-4379-8da1-a248d153b104 req-4f80b497-56d9-4e8d-a65b-32745d58266a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f113925-120d-40cc-b839-02454f963b02", "tag": "4743adec-2ebd-4c1f-9f90-1ce85d2304c5"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:18.866959 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:33:18.866959 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:33:18.870411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:18.871099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:18.872011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:18.872663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:18.878749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-23435142-d05a-4379-8da1-a248d153b104 req-4f80b497-56d9-4e8d-a65b-32745d58266a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:18.879942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-23435142-d05a-4379-8da1-a248d153b104 req-4f80b497-56d9-4e8d-a65b-32745d58266a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:18.895141 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-23435142-d05a-4379-8da1-a248d153b104 req-4f80b497-56d9-4e8d-a65b-32745d58266a service nova] Creating event network-changed:4743adec-2ebd-4c1f-9f90-1ce85d2304c5 for instance 2f113925-120d-40cc-b839-02454f963b02 on nch2-master-1 Feb 19 21:33:18.899547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:33:18.903196 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-23435142-d05a-4379-8da1-a248d153b104 req-4f80b497-56d9-4e8d-a65b-32745d58266a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043514 Feb 19 21:33:18.904559 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2803/5692] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:33:18.995998 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5372d310-c256-43f8-9b73-8f1c01a7b3c6 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 204 len: 0 microversion: 2.1 time: 0.141879 Feb 19 21:33:18.997186 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2890/5693] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:33:18 2022] DELETE /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:33:19.007009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-09d0c925-2080-40bc-9f63-0a449371e069 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:19.007722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-09d0c925-2080-40bc-9f63-0a449371e069 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:19.015500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09d0c925-2080-40bc-9f63-0a449371e069 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:19.016479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09d0c925-2080-40bc-9f63-0a449371e069 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:19.017314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09d0c925-2080-40bc-9f63-0a449371e069 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:19.017863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09d0c925-2080-40bc-9f63-0a449371e069 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:19.279417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-09d0c925-2080-40bc-9f63-0a449371e069 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:19.288302 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-09d0c925-2080-40bc-9f63-0a449371e069 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1583 microversion: 2.1 time: 0.286029 Feb 19 21:33:19.288940 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2804/5694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:19 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1583 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:20.307419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dbc1deca-73a1-46ea-b4dd-7d1c32aaa3a8 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:20.308132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dbc1deca-73a1-46ea-b4dd-7d1c32aaa3a8 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:20.314828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbc1deca-73a1-46ea-b4dd-7d1c32aaa3a8 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:20.315291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbc1deca-73a1-46ea-b4dd-7d1c32aaa3a8 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:20.316076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbc1deca-73a1-46ea-b4dd-7d1c32aaa3a8 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:20.316559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dbc1deca-73a1-46ea-b4dd-7d1c32aaa3a8 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:20.460006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dbc1deca-73a1-46ea-b4dd-7d1c32aaa3a8 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:20.468019 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dbc1deca-73a1-46ea-b4dd-7d1c32aaa3a8 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1466 microversion: 2.1 time: 0.164787 Feb 19 21:33:20.468611 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2891/5695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:20 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1466 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:21.391365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4f4602b8-251f-4c8a-8b7d-fcc1cd3afe24 req-4e12b3b4-fd59-46dd-96c4-9f69a8a73c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f113925-120d-40cc-b839-02454f963b02", "name": "network-vif-deleted", "tag": "4743adec-2ebd-4c1f-9f90-1ce85d2304c5"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:21.392988 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:33:21.392988 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:33:21.400951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4f4602b8-251f-4c8a-8b7d-fcc1cd3afe24 req-4e12b3b4-fd59-46dd-96c4-9f69a8a73c9d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:21.401401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4f4602b8-251f-4c8a-8b7d-fcc1cd3afe24 req-4e12b3b4-fd59-46dd-96c4-9f69a8a73c9d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:21.414253 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4f4602b8-251f-4c8a-8b7d-fcc1cd3afe24 req-4e12b3b4-fd59-46dd-96c4-9f69a8a73c9d service nova] Creating event network-vif-deleted:4743adec-2ebd-4c1f-9f90-1ce85d2304c5 for instance 2f113925-120d-40cc-b839-02454f963b02 on nch2-master-1 Feb 19 21:33:21.420209 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4f4602b8-251f-4c8a-8b7d-fcc1cd3afe24 req-4e12b3b4-fd59-46dd-96c4-9f69a8a73c9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Feb 19 21:33:21.420994 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2805/5696] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:33:21.485384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-043e0634-1cc1-4acf-a2d5-58f2e659bf8d tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:21.486011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-043e0634-1cc1-4acf-a2d5-58f2e659bf8d tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:21.492650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-043e0634-1cc1-4acf-a2d5-58f2e659bf8d tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:21.493556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-043e0634-1cc1-4acf-a2d5-58f2e659bf8d tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:21.495378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-043e0634-1cc1-4acf-a2d5-58f2e659bf8d tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:21.496077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-043e0634-1cc1-4acf-a2d5-58f2e659bf8d tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:21.563853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-043e0634-1cc1-4acf-a2d5-58f2e659bf8d tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489d295f12b43719f3ba84f7d2dc683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f5105ec09c4f3c82c087633532c76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:21.571411 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-043e0634-1cc1-4acf-a2d5-58f2e659bf8d tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 200 len: 1230 microversion: 2.1 time: 0.089741 Feb 19 21:33:21.571996 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2892/5697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:21 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:22.589551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-123dad3f-937d-4546-af29-86bb86f17c13 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:22.590252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-123dad3f-937d-4546-af29-86bb86f17c13 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] [instance: 2f113925-120d-40cc-b839-02454f963b02] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:22.596505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-123dad3f-937d-4546-af29-86bb86f17c13 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:22.596958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-123dad3f-937d-4546-af29-86bb86f17c13 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:22.597739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-123dad3f-937d-4546-af29-86bb86f17c13 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:22.598173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-123dad3f-937d-4546-af29-86bb86f17c13 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:22.612478 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-123dad3f-937d-4546-af29-86bb86f17c13 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] HTTP exception thrown: Instance 2f113925-120d-40cc-b839-02454f963b02 could not be found. Feb 19 21:33:22.613073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-123dad3f-937d-4546-af29-86bb86f17c13 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Returning 404 to user: Instance 2f113925-120d-40cc-b839-02454f963b02 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:33:22.613901 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-123dad3f-937d-4546-af29-86bb86f17c13 tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02" status: 404 len: 111 microversion: 2.1 time: 0.029245 Feb 19 21:33:22.614451 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2806/5698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:22 2022] GET /compute/v2.1/servers/2f113925-120d-40cc-b839-02454f963b02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:33:22.774463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4391d82a-8c92-4a77-ac8c-9324d7b58f5b tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] Calling method '.version_select at 0x7f64645bdc10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:22.797145 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4391d82a-8c92-4a77-ac8c-9324d7b58f5b tempest-TestVolumeBackupRestore-808817250 tempest-TestVolumeBackupRestore-808817250-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1980720770" status: 202 len: 0 microversion: 2.1 time: 0.026257 Feb 19 21:33:22.797741 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2893/5699] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Feb 19 21:33:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1980720770 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:33:44.613527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1682919592", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:44.664655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] validate_networks() for None {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:33:44.852001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:33:44.852464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:33:44.852944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:33:44.853356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:33:44.853771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:33:44.862494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:44.862947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:44.863758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:44.864198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:44.881134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Getting quotas for project f8a13e8c6ae549eba718354fd84a93bf. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:33:44.886874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Getting quotas for user d62343fbfc5f410da668e6547ce9b57e and project f8a13e8c6ae549eba718354fd84a93bf. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:33:44.898679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:33:44.901069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:33:44.943368 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3b7e85a6-9b6f-4b23-9ee6-e6c9447dc354 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.441195 Feb 19 21:33:44.943947 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2807/5700] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:33:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:33:44.955360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-37d19704-ccc1-450f-a61c-55c124f8818e tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:44.955978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-37d19704-ccc1-450f-a61c-55c124f8818e tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:45.009555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-37d19704-ccc1-450f-a61c-55c124f8818e tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:45.016197 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-37d19704-ccc1-450f-a61c-55c124f8818e tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1222 microversion: 2.1 time: 0.064928 Feb 19 21:33:45.016802 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2894/5701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:44 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1222 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:46.034944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7fb8f00a-42c1-48f4-9cd3-77e907ad69dc tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:46.035667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7fb8f00a-42c1-48f4-9cd3-77e907ad69dc tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:46.042142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fb8f00a-42c1-48f4-9cd3-77e907ad69dc tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:46.042610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fb8f00a-42c1-48f4-9cd3-77e907ad69dc tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:46.043399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fb8f00a-42c1-48f4-9cd3-77e907ad69dc tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:46.043842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7fb8f00a-42c1-48f4-9cd3-77e907ad69dc tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:46.113051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7fb8f00a-42c1-48f4-9cd3-77e907ad69dc tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:46.122199 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7fb8f00a-42c1-48f4-9cd3-77e907ad69dc tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1282 microversion: 2.1 time: 0.092682 Feb 19 21:33:46.122989 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2808/5702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:46 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:47.139565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9be6da04-bc7b-422f-9d33-fa061d930cc3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:47.140191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9be6da04-bc7b-422f-9d33-fa061d930cc3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:47.147122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9be6da04-bc7b-422f-9d33-fa061d930cc3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:47.147841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9be6da04-bc7b-422f-9d33-fa061d930cc3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:47.148714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9be6da04-bc7b-422f-9d33-fa061d930cc3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:47.149876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9be6da04-bc7b-422f-9d33-fa061d930cc3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:47.287954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9be6da04-bc7b-422f-9d33-fa061d930cc3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:47.296916 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9be6da04-bc7b-422f-9d33-fa061d930cc3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1322 microversion: 2.1 time: 0.160940 Feb 19 21:33:47.297502 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2895/5703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:47 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:47.576511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6f9e4491-e173-410f-b53b-2ab958334bc0 req-a1250414-b598-473f-9814-3f3978f781c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b46345d-8faf-402b-ba46-70a0d1791bc5", "tag": "2c3ca0e3-fecb-4d1f-9927-63f2d028ec86"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:47.579111 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:33:47.579111 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:33:47.589504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6f9e4491-e173-410f-b53b-2ab958334bc0 req-a1250414-b598-473f-9814-3f3978f781c2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:47.590224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6f9e4491-e173-410f-b53b-2ab958334bc0 req-a1250414-b598-473f-9814-3f3978f781c2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:47.603548 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6f9e4491-e173-410f-b53b-2ab958334bc0 req-a1250414-b598-473f-9814-3f3978f781c2 service nova] Creating event network-changed:2c3ca0e3-fecb-4d1f-9927-63f2d028ec86 for instance 9b46345d-8faf-402b-ba46-70a0d1791bc5 on nch1-master-1 Feb 19 21:33:47.608593 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6f9e4491-e173-410f-b53b-2ab958334bc0 req-a1250414-b598-473f-9814-3f3978f781c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036134 Feb 19 21:33:47.609601 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2809/5704] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:33:48.314393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e07b631b-3e3e-4f24-a4f0-893cc894f50d tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:48.315175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e07b631b-3e3e-4f24-a4f0-893cc894f50d tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:48.322637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e07b631b-3e3e-4f24-a4f0-893cc894f50d tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:48.323095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e07b631b-3e3e-4f24-a4f0-893cc894f50d tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:48.323890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e07b631b-3e3e-4f24-a4f0-893cc894f50d tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:48.324432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e07b631b-3e3e-4f24-a4f0-893cc894f50d tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:48.473050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e07b631b-3e3e-4f24-a4f0-893cc894f50d tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:48.480795 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e07b631b-3e3e-4f24-a4f0-893cc894f50d tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1322 microversion: 2.1 time: 0.169955 Feb 19 21:33:48.481394 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2896/5705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:48 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:49.499363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0fbcfbbe-3a35-491b-8500-94fde26b14c1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:49.500056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0fbcfbbe-3a35-491b-8500-94fde26b14c1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:49.506302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0fbcfbbe-3a35-491b-8500-94fde26b14c1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:49.506754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0fbcfbbe-3a35-491b-8500-94fde26b14c1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:49.507533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0fbcfbbe-3a35-491b-8500-94fde26b14c1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:49.507975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0fbcfbbe-3a35-491b-8500-94fde26b14c1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:49.649720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0fbcfbbe-3a35-491b-8500-94fde26b14c1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:49.657291 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0fbcfbbe-3a35-491b-8500-94fde26b14c1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1322 microversion: 2.1 time: 0.162799 Feb 19 21:33:49.657866 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2810/5706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:49 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:50.673909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0ae7e3f6-86b2-4168-b526-9bc6be3bbe5f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:50.674522 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0ae7e3f6-86b2-4168-b526-9bc6be3bbe5f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:50.682057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ae7e3f6-86b2-4168-b526-9bc6be3bbe5f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:50.682519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ae7e3f6-86b2-4168-b526-9bc6be3bbe5f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:50.683307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ae7e3f6-86b2-4168-b526-9bc6be3bbe5f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:50.683749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0ae7e3f6-86b2-4168-b526-9bc6be3bbe5f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:50.817745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0ae7e3f6-86b2-4168-b526-9bc6be3bbe5f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:50.825381 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0ae7e3f6-86b2-4168-b526-9bc6be3bbe5f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1322 microversion: 2.1 time: 0.155332 Feb 19 21:33:50.825924 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2897/5707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:50 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:51.842290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-141b1ce5-30d9-4b61-80d8-7c4ce1cc81f3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:51.842895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-141b1ce5-30d9-4b61-80d8-7c4ce1cc81f3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:51.849708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-141b1ce5-30d9-4b61-80d8-7c4ce1cc81f3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:51.850158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-141b1ce5-30d9-4b61-80d8-7c4ce1cc81f3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:51.850928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-141b1ce5-30d9-4b61-80d8-7c4ce1cc81f3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:51.851361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-141b1ce5-30d9-4b61-80d8-7c4ce1cc81f3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:51.989848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-141b1ce5-30d9-4b61-80d8-7c4ce1cc81f3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:51.997191 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-141b1ce5-30d9-4b61-80d8-7c4ce1cc81f3 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1322 microversion: 2.1 time: 0.158583 Feb 19 21:33:51.997769 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2811/5708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:51 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:52.238860 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-02a7a75d-515c-4a9a-bc4a-d9c1f573da15 req-c291b160-5865-459e-88bd-1eea923b12bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b46345d-8faf-402b-ba46-70a0d1791bc5", "name": "network-vif-plugged", "status": "completed", "tag": "2c3ca0e3-fecb-4d1f-9927-63f2d028ec86"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:52.240457 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:33:52.240457 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:33:52.248118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-02a7a75d-515c-4a9a-bc4a-d9c1f573da15 req-c291b160-5865-459e-88bd-1eea923b12bd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:52.248601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-02a7a75d-515c-4a9a-bc4a-d9c1f573da15 req-c291b160-5865-459e-88bd-1eea923b12bd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:52.260702 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-02a7a75d-515c-4a9a-bc4a-d9c1f573da15 req-c291b160-5865-459e-88bd-1eea923b12bd service nova] Creating event network-vif-plugged:2c3ca0e3-fecb-4d1f-9927-63f2d028ec86 for instance 9b46345d-8faf-402b-ba46-70a0d1791bc5 on nch1-master-1 Feb 19 21:33:52.265573 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-02a7a75d-515c-4a9a-bc4a-d9c1f573da15 req-c291b160-5865-459e-88bd-1eea923b12bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030397 Feb 19 21:33:52.266174 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2898/5709] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:33:53.014379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-82945198-50ff-4c5c-817b-b77e7abc84d1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:53.014996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-82945198-50ff-4c5c-817b-b77e7abc84d1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:53.021775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82945198-50ff-4c5c-817b-b77e7abc84d1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:53.022232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82945198-50ff-4c5c-817b-b77e7abc84d1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:53.023010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82945198-50ff-4c5c-817b-b77e7abc84d1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:53.023453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82945198-50ff-4c5c-817b-b77e7abc84d1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:53.159348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-82945198-50ff-4c5c-817b-b77e7abc84d1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:53.166688 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-82945198-50ff-4c5c-817b-b77e7abc84d1 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1322 microversion: 2.1 time: 0.156023 Feb 19 21:33:53.167291 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2812/5710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:53 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:54.185696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bebf8c5f-594d-4f71-95a8-1ed8bb7ee65f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:54.186397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bebf8c5f-594d-4f71-95a8-1ed8bb7ee65f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:54.192583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bebf8c5f-594d-4f71-95a8-1ed8bb7ee65f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.193045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bebf8c5f-594d-4f71-95a8-1ed8bb7ee65f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.193820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bebf8c5f-594d-4f71-95a8-1ed8bb7ee65f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.194265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bebf8c5f-594d-4f71-95a8-1ed8bb7ee65f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.326558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bebf8c5f-594d-4f71-95a8-1ed8bb7ee65f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:54.333906 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bebf8c5f-594d-4f71-95a8-1ed8bb7ee65f tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1472 microversion: 2.1 time: 0.153092 Feb 19 21:33:54.334473 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2899/5711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:54 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:54.401584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fbaa5a9c-9c83-4db8-8ad5-efb87b1e79fa tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Calling method '.version_select at 0x7f6467dc45e0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:54.468683 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fbaa5a9c-9c83-4db8-8ad5-efb87b1e79fa tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/94ba2437855d4d92b40557b165483e95" status: 200 len: 371 microversion: 2.1 time: 0.119799 Feb 19 21:33:54.469270 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2813/5712] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:33:54 2022] GET /compute/v2.1/os-quota-sets/94ba2437855d4d92b40557b165483e95 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:33:54.479475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0e525bf5-19d3-4289-b379-554f92491af8 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1805887685", "id": 543725028, "os-flavor-access:is_public": "True"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:54.481083 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:33:54.481083 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:33:54.496508 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0e525bf5-19d3-4289-b379-554f92491af8 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.020645 Feb 19 21:33:54.497082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2900/5713] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:33:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:33:54.507416 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "543725028"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:54.509053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:54.515034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.515491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.516274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.516765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.599444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3e10a99da55a450593fb7bcd4f66ef78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba2437855d4d92b40557b165483e95', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:54.605881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1805887685 {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:33:54.606937 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.607379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.608182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.608637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.628777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Getting quotas for project f8a13e8c6ae549eba718354fd84a93bf. Resources: {'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:33:54.634138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Getting quotas for user d62343fbfc5f410da668e6547ce9b57e and project f8a13e8c6ae549eba718354fd84a93bf. Resources: {'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:33:54.645567 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.compute.api [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] ram quota exceeded for 94ba2437855d4d92b40557b165483e95, tried to resize instance. Feb 19 21:33:54.646101 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Feb 19 21:33:54.646712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:33:54.647547 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9da9dbc0-9c13-4eab-a7fd-37d0206045c9 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5/action" status: 403 len: 118 microversion: 2.1 time: 0.143947 Feb 19 21:33:54.648206 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2814/5714] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:33:54 2022] POST /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5/action => generated 118 bytes in 145 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:33:54.656374 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-775fa3f2-6cdc-4795-8e70-421d83c81315 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:54.657125 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:33:54.657125 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:33:54.673356 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-775fa3f2-6cdc-4795-8e70-421d83c81315 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/543725028" status: 202 len: 0 microversion: 2.1 time: 0.020509 Feb 19 21:33:54.673922 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2901/5715] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Feb 19 21:33:54 2022] DELETE /compute/v2.1/flavors/543725028 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:33:54.682156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8a0e75ee-ca70-4aaf-9e12-a77177f365f3 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:54.701794 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8a0e75ee-ca70-4aaf-9e12-a77177f365f3 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023562 Feb 19 21:33:54.702308 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2815/5716] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 21:33:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:54.718989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec7c51ab-7e94-4726-a283-7efd5458ffda tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Calling method '.version_select at 0x7f6464540c10>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:54.791274 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec7c51ab-7e94-4726-a283-7efd5458ffda tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/94ba2437855d4d92b40557b165483e95" status: 200 len: 371 microversion: 2.1 time: 0.075846 Feb 19 21:33:54.791849 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2902/5717] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Feb 19 21:33:54 2022] GET /compute/v2.1/os-quota-sets/94ba2437855d4d92b40557b165483e95 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:33:54.801814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57fab8a1-09b3-4dc6-924c-0b3dd7f408bd tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1462591796", "id": 1083272012, "os-flavor-access:is_public": "True"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:54.803394 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:33:54.803394 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:33:54.819023 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57fab8a1-09b3-4dc6-924c-0b3dd7f408bd tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.020909 Feb 19 21:33:54.819593 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2816/5718] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:33:54 2022] POST /compute/v2.1/flavors => generated 437 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:33:54.830748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1083272012"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:54.831699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:54.837610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.838068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.838844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.839287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.920893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3e10a99da55a450593fb7bcd4f66ef78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ba2437855d4d92b40557b165483e95', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:54.926970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1462591796 {{(pid=136094) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:33:54.928046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.928521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.929326 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:54.929766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:54.949817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Getting quotas for project f8a13e8c6ae549eba718354fd84a93bf. Resources: {'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:33:54.954869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Getting quotas for user d62343fbfc5f410da668e6547ce9b57e and project f8a13e8c6ae549eba718354fd84a93bf. Resources: {'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:33:54.966822 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.compute.api [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] cores quota exceeded for 94ba2437855d4d92b40557b165483e95, tried to resize instance. Feb 19 21:33:54.967406 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Feb 19 21:33:54.968016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:33:54.968905 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ad2c6db8-b798-4f4a-9591-cc090c158476 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5/action" status: 403 len: 113 microversion: 2.1 time: 0.142101 Feb 19 21:33:54.969516 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2903/5719] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:33:54 2022] POST /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5/action => generated 113 bytes in 143 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 19 21:33:54.977986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-096df63a-9792-4334-ae7a-61ed12fb010b tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:54.978743 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:33:54.978743 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:33:54.995459 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-096df63a-9792-4334-ae7a-61ed12fb010b tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1083272012" status: 202 len: 0 microversion: 2.1 time: 0.021620 Feb 19 21:33:54.996017 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2817/5720] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Feb 19 21:33:54 2022] DELETE /compute/v2.1/flavors/1083272012 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:33:55.003720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0f590ed0-483c-4239-9bb2-3200c95b3950 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:55.022629 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0f590ed0-483c-4239-9bb2-3200c95b3950 tempest-ServersAdminNegativeTestJSON-1016285490 tempest-ServersAdminNegativeTestJSON-1016285490-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022367 Feb 19 21:33:55.023212 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2904/5721] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Feb 19 21:33:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:33:55.039104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9f9e4071-b799-4da6-b2f2-05373cd99789 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:55.040120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f9e4071-b799-4da6-b2f2-05373cd99789 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:55.046002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f9e4071-b799-4da6-b2f2-05373cd99789 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:55.046456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f9e4071-b799-4da6-b2f2-05373cd99789 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:55.047235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f9e4071-b799-4da6-b2f2-05373cd99789 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:55.047674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9f9e4071-b799-4da6-b2f2-05373cd99789 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:55.072619 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9f9e4071-b799-4da6-b2f2-05373cd99789 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:33:55.150029 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9f9e4071-b799-4da6-b2f2-05373cd99789 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 204 len: 0 microversion: 2.1 time: 0.114178 Feb 19 21:33:55.150773 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2818/5722] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:33:55 2022] DELETE /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:33:55.158877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-33711372-0b99-4c1f-a37a-515e1587dd57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:55.159490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-33711372-0b99-4c1f-a37a-515e1587dd57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:55.166017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33711372-0b99-4c1f-a37a-515e1587dd57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:55.166470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33711372-0b99-4c1f-a37a-515e1587dd57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:55.167250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33711372-0b99-4c1f-a37a-515e1587dd57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:55.167700 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33711372-0b99-4c1f-a37a-515e1587dd57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:55.555480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-33711372-0b99-4c1f-a37a-515e1587dd57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:55.562882 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-33711372-0b99-4c1f-a37a-515e1587dd57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1478 microversion: 2.1 time: 0.407856 Feb 19 21:33:55.563436 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2905/5723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:55 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1478 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:56.580465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-33c56610-763d-4c49-a971-9b6ca1a3bfe9 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:56.581168 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-33c56610-763d-4c49-a971-9b6ca1a3bfe9 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:56.588601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33c56610-763d-4c49-a971-9b6ca1a3bfe9 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:56.589057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33c56610-763d-4c49-a971-9b6ca1a3bfe9 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:56.589841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33c56610-763d-4c49-a971-9b6ca1a3bfe9 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:56.590286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-33c56610-763d-4c49-a971-9b6ca1a3bfe9 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:56.727315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-33c56610-763d-4c49-a971-9b6ca1a3bfe9 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62343fbfc5f410da668e6547ce9b57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a13e8c6ae549eba718354fd84a93bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:33:56.736364 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-33c56610-763d-4c49-a971-9b6ca1a3bfe9 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 200 len: 1478 microversion: 2.1 time: 0.159946 Feb 19 21:33:56.737330 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2819/5724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:56 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:33:56.900934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6aebcbb7-59b2-47ef-9dae-5e46c5707c52 req-27ed482a-bd95-4d06-bcb6-e6d14293d61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b46345d-8faf-402b-ba46-70a0d1791bc5", "name": "network-vif-deleted", "tag": "2c3ca0e3-fecb-4d1f-9927-63f2d028ec86"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:33:56.902398 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:33:56.902398 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:33:56.912695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6aebcbb7-59b2-47ef-9dae-5e46c5707c52 req-27ed482a-bd95-4d06-bcb6-e6d14293d61b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:56.913158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6aebcbb7-59b2-47ef-9dae-5e46c5707c52 req-27ed482a-bd95-4d06-bcb6-e6d14293d61b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:56.928841 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6aebcbb7-59b2-47ef-9dae-5e46c5707c52 req-27ed482a-bd95-4d06-bcb6-e6d14293d61b service nova] Creating event network-vif-deleted:2c3ca0e3-fecb-4d1f-9927-63f2d028ec86 for instance 9b46345d-8faf-402b-ba46-70a0d1791bc5 on nch1-master-1 Feb 19 21:33:56.935415 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6aebcbb7-59b2-47ef-9dae-5e46c5707c52 req-27ed482a-bd95-4d06-bcb6-e6d14293d61b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038276 Feb 19 21:33:56.936362 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2906/5725] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:33:57.753729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-add71a54-0269-447f-b192-57e696330f57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:33:57.754343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-add71a54-0269-447f-b192-57e696330f57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] [instance: 9b46345d-8faf-402b-ba46-70a0d1791bc5] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:33:57.761891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-add71a54-0269-447f-b192-57e696330f57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:57.762344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-add71a54-0269-447f-b192-57e696330f57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:57.763159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-add71a54-0269-447f-b192-57e696330f57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:33:57.763598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-add71a54-0269-447f-b192-57e696330f57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:33:57.776786 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-add71a54-0269-447f-b192-57e696330f57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] HTTP exception thrown: Instance 9b46345d-8faf-402b-ba46-70a0d1791bc5 could not be found. Feb 19 21:33:57.777479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-add71a54-0269-447f-b192-57e696330f57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] Returning 404 to user: Instance 9b46345d-8faf-402b-ba46-70a0d1791bc5 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:33:57.778374 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-add71a54-0269-447f-b192-57e696330f57 tempest-ServersAdminNegativeTestJSON-406644464 tempest-ServersAdminNegativeTestJSON-406644464-project] 10.222.0.30 "GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5" status: 404 len: 111 microversion: 2.1 time: 0.028365 Feb 19 21:33:57.779029 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2820/5726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:33:57 2022] GET /compute/v2.1/servers/9b46345d-8faf-402b-ba46-70a0d1791bc5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:34:00.397704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2034111119", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "68bd2ede-716d-44d9-ba4f-e4b5174f6736"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:00.446466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] validate_networks() for [('68bd2ede-716d-44d9-ba4f-e4b5174f6736', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:34:00.809204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:34:00.809641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:34:00.810126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:34:00.810547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:34:00.810972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:34:00.819880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:00.820358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:00.821815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:00.822258 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:00.838683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Getting quotas for project 456ee08e460d4b61a0db66627b1aaa91. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:34:00.843579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Getting quotas for user 526c1165def845fbb5d29610983f6da2 and project 456ee08e460d4b61a0db66627b1aaa91. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:34:00.855577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:34:00.858166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:34:00.904611 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-55d8f6cc-1596-40f8-883d-14727112db35 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621710 Feb 19 21:34:00.905414 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2907/5727] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:34:00.915695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4a36d9ed-87c1-4c1f-bb3e-3747b63e18e4 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:00.916305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4a36d9ed-87c1-4c1f-bb3e-3747b63e18e4 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:00.973935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4a36d9ed-87c1-4c1f-bb3e-3747b63e18e4 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:00.982129 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4a36d9ed-87c1-4c1f-bb3e-3747b63e18e4 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1215 microversion: 2.1 time: 0.070619 Feb 19 21:34:00.982748 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2821/5728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:00 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:02.000960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a41a0752-fb5f-441f-9945-5460d7cd06b3 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:02.001573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a41a0752-fb5f-441f-9945-5460d7cd06b3 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:02.008859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a41a0752-fb5f-441f-9945-5460d7cd06b3 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:02.009322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a41a0752-fb5f-441f-9945-5460d7cd06b3 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:02.010118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a41a0752-fb5f-441f-9945-5460d7cd06b3 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:02.010645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a41a0752-fb5f-441f-9945-5460d7cd06b3 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:02.097386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a41a0752-fb5f-441f-9945-5460d7cd06b3 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:02.105211 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a41a0752-fb5f-441f-9945-5460d7cd06b3 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1273 microversion: 2.1 time: 0.109357 Feb 19 21:34:02.114742 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2908/5729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:01 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:34:03.122727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-df4ae64e-010a-4d86-9b20-5c607d9dfc81 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:03.123341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-df4ae64e-010a-4d86-9b20-5c607d9dfc81 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:03.129952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df4ae64e-010a-4d86-9b20-5c607d9dfc81 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:03.130405 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df4ae64e-010a-4d86-9b20-5c607d9dfc81 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:03.131183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df4ae64e-010a-4d86-9b20-5c607d9dfc81 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:03.131620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-df4ae64e-010a-4d86-9b20-5c607d9dfc81 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:03.349627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-df4ae64e-010a-4d86-9b20-5c607d9dfc81 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:03.357405 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-df4ae64e-010a-4d86-9b20-5c607d9dfc81 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1315 microversion: 2.1 time: 0.238297 Feb 19 21:34:03.358151 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2822/5730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:03 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:03.474149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a910753c-1525-4277-89d2-391ea55b0e99 req-bc1894d4-41b3-44c9-904d-2148ea4eef7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "885be350-96d3-430f-9c2b-0a1e58b7355d", "tag": "79d8b2c2-debb-4778-88c8-2a1d4793d447"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:03.475777 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:34:03.475777 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:34:03.486736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a910753c-1525-4277-89d2-391ea55b0e99 req-bc1894d4-41b3-44c9-904d-2148ea4eef7c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:03.487711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a910753c-1525-4277-89d2-391ea55b0e99 req-bc1894d4-41b3-44c9-904d-2148ea4eef7c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:03.500252 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a910753c-1525-4277-89d2-391ea55b0e99 req-bc1894d4-41b3-44c9-904d-2148ea4eef7c service nova] Creating event network-changed:79d8b2c2-debb-4778-88c8-2a1d4793d447 for instance 885be350-96d3-430f-9c2b-0a1e58b7355d on nch2-master-1 Feb 19 21:34:03.505357 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a910753c-1525-4277-89d2-391ea55b0e99 req-bc1894d4-41b3-44c9-904d-2148ea4eef7c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034866 Feb 19 21:34:03.505951 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2909/5731] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:34:04.374111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-651834b8-5aa0-43e2-a3b9-3804932a1762 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:04.374741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-651834b8-5aa0-43e2-a3b9-3804932a1762 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:04.381486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-651834b8-5aa0-43e2-a3b9-3804932a1762 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:04.381945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-651834b8-5aa0-43e2-a3b9-3804932a1762 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:04.382733 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-651834b8-5aa0-43e2-a3b9-3804932a1762 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:04.383745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-651834b8-5aa0-43e2-a3b9-3804932a1762 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:04.522601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-651834b8-5aa0-43e2-a3b9-3804932a1762 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:04.529902 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-651834b8-5aa0-43e2-a3b9-3804932a1762 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1315 microversion: 2.1 time: 0.159554 Feb 19 21:34:04.530490 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2823/5732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:04 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:05.547922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4d4d1bec-ff8f-4d2f-8912-be0dc38c4ff1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:05.548686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4d4d1bec-ff8f-4d2f-8912-be0dc38c4ff1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:05.555575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d4d1bec-ff8f-4d2f-8912-be0dc38c4ff1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:05.556076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d4d1bec-ff8f-4d2f-8912-be0dc38c4ff1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:05.556902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d4d1bec-ff8f-4d2f-8912-be0dc38c4ff1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:05.557361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4d4d1bec-ff8f-4d2f-8912-be0dc38c4ff1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:05.691415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4d4d1bec-ff8f-4d2f-8912-be0dc38c4ff1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:05.698809 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4d4d1bec-ff8f-4d2f-8912-be0dc38c4ff1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1315 microversion: 2.1 time: 0.155804 Feb 19 21:34:05.699831 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2910/5733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:05 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:06.715567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bcd5df10-2610-4c28-be3b-d14b02068d78 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:06.716189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bcd5df10-2610-4c28-be3b-d14b02068d78 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:06.722692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcd5df10-2610-4c28-be3b-d14b02068d78 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:06.723144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcd5df10-2610-4c28-be3b-d14b02068d78 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:06.723929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcd5df10-2610-4c28-be3b-d14b02068d78 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:06.724452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bcd5df10-2610-4c28-be3b-d14b02068d78 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:06.860770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bcd5df10-2610-4c28-be3b-d14b02068d78 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:06.868096 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bcd5df10-2610-4c28-be3b-d14b02068d78 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1315 microversion: 2.1 time: 0.157005 Feb 19 21:34:06.868705 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2824/5734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:06 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:07.885623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3f5c6814-b27f-4401-a1e5-d4309185b428 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:07.886238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3f5c6814-b27f-4401-a1e5-d4309185b428 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:07.893044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f5c6814-b27f-4401-a1e5-d4309185b428 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:07.893641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f5c6814-b27f-4401-a1e5-d4309185b428 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:07.894476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f5c6814-b27f-4401-a1e5-d4309185b428 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:07.894926 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3f5c6814-b27f-4401-a1e5-d4309185b428 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:08.033997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3f5c6814-b27f-4401-a1e5-d4309185b428 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:08.041963 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3f5c6814-b27f-4401-a1e5-d4309185b428 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1315 microversion: 2.1 time: 0.160791 Feb 19 21:34:08.042537 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2911/5735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:07 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:08.877270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-2dad9203-f179-4907-a8f9-b6e5bddef76f req-50757242-403e-4da1-ae13-1123c45233c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885be350-96d3-430f-9c2b-0a1e58b7355d", "name": "network-vif-plugged", "status": "completed", "tag": "79d8b2c2-debb-4778-88c8-2a1d4793d447"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:08.878910 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:34:08.878910 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:34:08.887255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2dad9203-f179-4907-a8f9-b6e5bddef76f req-50757242-403e-4da1-ae13-1123c45233c6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:08.887706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-2dad9203-f179-4907-a8f9-b6e5bddef76f req-50757242-403e-4da1-ae13-1123c45233c6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:08.899708 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-2dad9203-f179-4907-a8f9-b6e5bddef76f req-50757242-403e-4da1-ae13-1123c45233c6 service nova] Creating event network-vif-plugged:79d8b2c2-debb-4778-88c8-2a1d4793d447 for instance 885be350-96d3-430f-9c2b-0a1e58b7355d on nch2-master-1 Feb 19 21:34:08.904768 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-2dad9203-f179-4907-a8f9-b6e5bddef76f req-50757242-403e-4da1-ae13-1123c45233c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031217 Feb 19 21:34:08.905367 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2825/5736] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:34:09.059143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b3c9e543-8fe2-4f92-90ba-9ead73ce99f2 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:09.059768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b3c9e543-8fe2-4f92-90ba-9ead73ce99f2 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:09.066464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3c9e543-8fe2-4f92-90ba-9ead73ce99f2 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:09.066929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3c9e543-8fe2-4f92-90ba-9ead73ce99f2 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:09.067718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3c9e543-8fe2-4f92-90ba-9ead73ce99f2 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:09.068165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b3c9e543-8fe2-4f92-90ba-9ead73ce99f2 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:09.205987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b3c9e543-8fe2-4f92-90ba-9ead73ce99f2 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:09.213197 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b3c9e543-8fe2-4f92-90ba-9ead73ce99f2 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1315 microversion: 2.1 time: 0.157783 Feb 19 21:34:09.213780 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2912/5737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:09 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:10.236314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b4397584-3861-44d6-ac04-b3a124ebf75e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:10.237620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b4397584-3861-44d6-ac04-b3a124ebf75e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:10.247816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4397584-3861-44d6-ac04-b3a124ebf75e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:10.248457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4397584-3861-44d6-ac04-b3a124ebf75e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:10.249358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4397584-3861-44d6-ac04-b3a124ebf75e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:10.249895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4397584-3861-44d6-ac04-b3a124ebf75e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:10.390866 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4397584-3861-44d6-ac04-b3a124ebf75e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:10.398259 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b4397584-3861-44d6-ac04-b3a124ebf75e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1315 microversion: 2.1 time: 0.171183 Feb 19 21:34:10.399118 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2826/5738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:10 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:11.414948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-463a9830-0114-4f01-9f2f-a744798683a9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:11.415565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-463a9830-0114-4f01-9f2f-a744798683a9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:11.422539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-463a9830-0114-4f01-9f2f-a744798683a9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:11.423051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-463a9830-0114-4f01-9f2f-a744798683a9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:11.423780 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-463a9830-0114-4f01-9f2f-a744798683a9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:11.424226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-463a9830-0114-4f01-9f2f-a744798683a9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:11.556602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-463a9830-0114-4f01-9f2f-a744798683a9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:11.563986 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-463a9830-0114-4f01-9f2f-a744798683a9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1501 microversion: 2.1 time: 0.152764 Feb 19 21:34:11.564571 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2913/5739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:11 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:11.580789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:11.581740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:11.588984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:11.589431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:11.590209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:11.590642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:11.619592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:11.626098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Old instance type m1.heat2, new instance type m1.heat {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:34:11.632217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:34:11.632667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:34:11.633792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:34:11.634068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:34:11.634477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:34:11.700034 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b35a6fe7-7fb7-453e-afcb-609cb5de90ab tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "POST /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d/action" status: 202 len: 0 microversion: 2.1 time: 0.122505 Feb 19 21:34:11.700926 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2827/5740] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:34:11 2022] POST /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:34:11.708877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0940aa6b-d33c-4a74-8b85-fa8a1fd1f114 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:11.709504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0940aa6b-d33c-4a74-8b85-fa8a1fd1f114 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:11.715965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0940aa6b-d33c-4a74-8b85-fa8a1fd1f114 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:11.716521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0940aa6b-d33c-4a74-8b85-fa8a1fd1f114 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:11.717488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0940aa6b-d33c-4a74-8b85-fa8a1fd1f114 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:11.717933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0940aa6b-d33c-4a74-8b85-fa8a1fd1f114 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:11.869359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0940aa6b-d33c-4a74-8b85-fa8a1fd1f114 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:11.876912 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0940aa6b-d33c-4a74-8b85-fa8a1fd1f114 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1510 microversion: 2.1 time: 0.171646 Feb 19 21:34:11.878117 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2914/5741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:11 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:12.895865 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0d5d692d-9c3f-48e6-85c9-e803944624f7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:12.896413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0d5d692d-9c3f-48e6-85c9-e803944624f7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:12.902431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d5d692d-9c3f-48e6-85c9-e803944624f7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:12.902889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d5d692d-9c3f-48e6-85c9-e803944624f7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:12.903672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d5d692d-9c3f-48e6-85c9-e803944624f7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:12.904112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0d5d692d-9c3f-48e6-85c9-e803944624f7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:13.047747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0d5d692d-9c3f-48e6-85c9-e803944624f7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:13.055960 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0d5d692d-9c3f-48e6-85c9-e803944624f7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1510 microversion: 2.1 time: 0.164121 Feb 19 21:34:13.056595 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2828/5742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:12 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:14.073642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-20a34546-1342-423d-8180-e132dc448115 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:14.074536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-20a34546-1342-423d-8180-e132dc448115 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:14.081256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20a34546-1342-423d-8180-e132dc448115 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:14.081726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20a34546-1342-423d-8180-e132dc448115 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:14.082525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20a34546-1342-423d-8180-e132dc448115 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:14.082982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20a34546-1342-423d-8180-e132dc448115 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:14.215668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-20a34546-1342-423d-8180-e132dc448115 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:14.223064 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-20a34546-1342-423d-8180-e132dc448115 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.153731 Feb 19 21:34:14.223637 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2915/5743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:14 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:15.239236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0e4c5686-1f70-45e2-b4a4-4cf56e0cac62 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:15.239802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0e4c5686-1f70-45e2-b4a4-4cf56e0cac62 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:15.246643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e4c5686-1f70-45e2-b4a4-4cf56e0cac62 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:15.247097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e4c5686-1f70-45e2-b4a4-4cf56e0cac62 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:15.247881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e4c5686-1f70-45e2-b4a4-4cf56e0cac62 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:15.248322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0e4c5686-1f70-45e2-b4a4-4cf56e0cac62 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:15.389003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0e4c5686-1f70-45e2-b4a4-4cf56e0cac62 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:15.396658 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0e4c5686-1f70-45e2-b4a4-4cf56e0cac62 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.161109 Feb 19 21:34:15.397253 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2829/5744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:15 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:16.413910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ac2e860b-dda9-4c97-9e86-351308c25405 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:16.414561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ac2e860b-dda9-4c97-9e86-351308c25405 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:16.421057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac2e860b-dda9-4c97-9e86-351308c25405 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:16.421638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac2e860b-dda9-4c97-9e86-351308c25405 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:16.422543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac2e860b-dda9-4c97-9e86-351308c25405 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:16.423266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ac2e860b-dda9-4c97-9e86-351308c25405 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:16.556911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ac2e860b-dda9-4c97-9e86-351308c25405 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:16.564307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ac2e860b-dda9-4c97-9e86-351308c25405 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.154219 Feb 19 21:34:16.564895 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2916/5745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:16 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:17.581232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-94fba03c-9414-491e-8c9c-f08f30582579 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:17.581851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-94fba03c-9414-491e-8c9c-f08f30582579 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:17.588608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94fba03c-9414-491e-8c9c-f08f30582579 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:17.589068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94fba03c-9414-491e-8c9c-f08f30582579 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:17.589878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94fba03c-9414-491e-8c9c-f08f30582579 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:17.590322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-94fba03c-9414-491e-8c9c-f08f30582579 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:17.734267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-94fba03c-9414-491e-8c9c-f08f30582579 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:17.741758 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-94fba03c-9414-491e-8c9c-f08f30582579 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.164294 Feb 19 21:34:17.742333 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2830/5746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:17 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:18.758460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7e29f617-926c-4c72-ae87-80a20a549bdb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:18.759090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7e29f617-926c-4c72-ae87-80a20a549bdb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:18.766001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e29f617-926c-4c72-ae87-80a20a549bdb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:18.766467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e29f617-926c-4c72-ae87-80a20a549bdb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:18.767286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e29f617-926c-4c72-ae87-80a20a549bdb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:18.767778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7e29f617-926c-4c72-ae87-80a20a549bdb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:18.901590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7e29f617-926c-4c72-ae87-80a20a549bdb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:18.908965 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7e29f617-926c-4c72-ae87-80a20a549bdb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.154273 Feb 19 21:34:18.909734 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2917/5747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:18 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:19.925868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-be7e4c47-ac1f-4b73-aafe-5a4c8b8cc9e0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:19.926379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-be7e4c47-ac1f-4b73-aafe-5a4c8b8cc9e0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:19.933109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be7e4c47-ac1f-4b73-aafe-5a4c8b8cc9e0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:19.933556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be7e4c47-ac1f-4b73-aafe-5a4c8b8cc9e0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:19.934330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be7e4c47-ac1f-4b73-aafe-5a4c8b8cc9e0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:19.934767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-be7e4c47-ac1f-4b73-aafe-5a4c8b8cc9e0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:20.081136 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-be7e4c47-ac1f-4b73-aafe-5a4c8b8cc9e0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:20.088478 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-be7e4c47-ac1f-4b73-aafe-5a4c8b8cc9e0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.166333 Feb 19 21:34:20.089059 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2831/5748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:19 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:21.105988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7cbfa42c-3a3d-4f93-8042-0468cf0fd16d tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:21.106611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7cbfa42c-3a3d-4f93-8042-0468cf0fd16d tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:21.113347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cbfa42c-3a3d-4f93-8042-0468cf0fd16d tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:21.113807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cbfa42c-3a3d-4f93-8042-0468cf0fd16d tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:21.114595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cbfa42c-3a3d-4f93-8042-0468cf0fd16d tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:21.115043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7cbfa42c-3a3d-4f93-8042-0468cf0fd16d tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:21.252943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7cbfa42c-3a3d-4f93-8042-0468cf0fd16d tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:21.260818 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7cbfa42c-3a3d-4f93-8042-0468cf0fd16d tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.159174 Feb 19 21:34:21.261392 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2918/5749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:21 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:22.277229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6a16130f-f48a-4dbd-923d-9f2bfb878476 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:22.277847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6a16130f-f48a-4dbd-923d-9f2bfb878476 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:22.284654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a16130f-f48a-4dbd-923d-9f2bfb878476 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:22.285114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a16130f-f48a-4dbd-923d-9f2bfb878476 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:22.285898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a16130f-f48a-4dbd-923d-9f2bfb878476 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:22.286344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6a16130f-f48a-4dbd-923d-9f2bfb878476 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:22.419377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6a16130f-f48a-4dbd-923d-9f2bfb878476 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:22.426830 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6a16130f-f48a-4dbd-923d-9f2bfb878476 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.153820 Feb 19 21:34:22.427410 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2832/5750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:22 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:23.442898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e63547a3-568a-48d3-b896-3a37aebf7ba9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:23.443523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e63547a3-568a-48d3-b896-3a37aebf7ba9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:23.450518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e63547a3-568a-48d3-b896-3a37aebf7ba9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:23.450986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e63547a3-568a-48d3-b896-3a37aebf7ba9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:23.451775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e63547a3-568a-48d3-b896-3a37aebf7ba9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:23.452229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e63547a3-568a-48d3-b896-3a37aebf7ba9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:23.590172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e63547a3-568a-48d3-b896-3a37aebf7ba9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:23.597462 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e63547a3-568a-48d3-b896-3a37aebf7ba9 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.158352 Feb 19 21:34:23.598035 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2919/5751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:23 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:24.614546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7082f92a-e8b4-4e50-a5cb-d62f3b181bb0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:24.615184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7082f92a-e8b4-4e50-a5cb-d62f3b181bb0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:24.621936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7082f92a-e8b4-4e50-a5cb-d62f3b181bb0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:24.622386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7082f92a-e8b4-4e50-a5cb-d62f3b181bb0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:24.623160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7082f92a-e8b4-4e50-a5cb-d62f3b181bb0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:24.623599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7082f92a-e8b4-4e50-a5cb-d62f3b181bb0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:24.758753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7082f92a-e8b4-4e50-a5cb-d62f3b181bb0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:24.766220 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7082f92a-e8b4-4e50-a5cb-d62f3b181bb0 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.155389 Feb 19 21:34:24.766791 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2833/5752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:24 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:25.782807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-72459143-e77e-4d45-9907-f8576f191fdf tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:25.783431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-72459143-e77e-4d45-9907-f8576f191fdf tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:25.790973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72459143-e77e-4d45-9907-f8576f191fdf tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:25.791443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72459143-e77e-4d45-9907-f8576f191fdf tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:25.792254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72459143-e77e-4d45-9907-f8576f191fdf tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:25.792741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-72459143-e77e-4d45-9907-f8576f191fdf tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:25.928824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-72459143-e77e-4d45-9907-f8576f191fdf tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:25.936652 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-72459143-e77e-4d45-9907-f8576f191fdf tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.157573 Feb 19 21:34:25.937233 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2920/5753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:25 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:26.953893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7cac3b0e-45a5-4ac5-94a7-1b61bb5ca334 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:26.954546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7cac3b0e-45a5-4ac5-94a7-1b61bb5ca334 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:26.961378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7cac3b0e-45a5-4ac5-94a7-1b61bb5ca334 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:26.961822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7cac3b0e-45a5-4ac5-94a7-1b61bb5ca334 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:26.962604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7cac3b0e-45a5-4ac5-94a7-1b61bb5ca334 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:26.963044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7cac3b0e-45a5-4ac5-94a7-1b61bb5ca334 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:27.095360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7cac3b0e-45a5-4ac5-94a7-1b61bb5ca334 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:27.103125 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7cac3b0e-45a5-4ac5-94a7-1b61bb5ca334 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.153025 Feb 19 21:34:27.103692 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2834/5754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:26 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:28.119365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d8540df-72e2-44ca-84a0-edc1a75d4650 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:28.119986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2d8540df-72e2-44ca-84a0-edc1a75d4650 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:28.126665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d8540df-72e2-44ca-84a0-edc1a75d4650 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:28.127130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d8540df-72e2-44ca-84a0-edc1a75d4650 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:28.127908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d8540df-72e2-44ca-84a0-edc1a75d4650 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:28.128382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d8540df-72e2-44ca-84a0-edc1a75d4650 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:28.260397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2d8540df-72e2-44ca-84a0-edc1a75d4650 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:28.267707 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d8540df-72e2-44ca-84a0-edc1a75d4650 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.152623 Feb 19 21:34:28.268277 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2921/5755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:28 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:29.284476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9d794839-923f-4c8d-8df1-5c315ca1f974 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:29.285083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9d794839-923f-4c8d-8df1-5c315ca1f974 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:29.291747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d794839-923f-4c8d-8df1-5c315ca1f974 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:29.292197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d794839-923f-4c8d-8df1-5c315ca1f974 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:29.293014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d794839-923f-4c8d-8df1-5c315ca1f974 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:29.293448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9d794839-923f-4c8d-8df1-5c315ca1f974 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:29.430481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9d794839-923f-4c8d-8df1-5c315ca1f974 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:29.437852 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9d794839-923f-4c8d-8df1-5c315ca1f974 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.157236 Feb 19 21:34:29.438421 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2835/5756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:29 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:30.455356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46731846-71ff-4bb3-b5e3-a4f13a33fa18 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:30.455991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-46731846-71ff-4bb3-b5e3-a4f13a33fa18 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:30.463486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46731846-71ff-4bb3-b5e3-a4f13a33fa18 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:30.463955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46731846-71ff-4bb3-b5e3-a4f13a33fa18 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:30.464781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46731846-71ff-4bb3-b5e3-a4f13a33fa18 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:30.465240 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46731846-71ff-4bb3-b5e3-a4f13a33fa18 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:30.596952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-46731846-71ff-4bb3-b5e3-a4f13a33fa18 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:30.604202 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-46731846-71ff-4bb3-b5e3-a4f13a33fa18 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.152788 Feb 19 21:34:30.604797 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2922/5757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:30 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:31.621610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae37371b-96d4-482a-95e0-a4cfcb7910e1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:31.622216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae37371b-96d4-482a-95e0-a4cfcb7910e1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:31.629293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae37371b-96d4-482a-95e0-a4cfcb7910e1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:31.629739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae37371b-96d4-482a-95e0-a4cfcb7910e1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:31.630521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae37371b-96d4-482a-95e0-a4cfcb7910e1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:31.630951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae37371b-96d4-482a-95e0-a4cfcb7910e1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:31.775302 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ae37371b-96d4-482a-95e0-a4cfcb7910e1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:31.782705 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae37371b-96d4-482a-95e0-a4cfcb7910e1 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.165379 Feb 19 21:34:31.783251 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2836/5758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:31 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:32.799925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9b111584-a3cf-420b-a671-d477a4034a54 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:32.800574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9b111584-a3cf-420b-a671-d477a4034a54 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:32.807740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b111584-a3cf-420b-a671-d477a4034a54 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:32.808206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b111584-a3cf-420b-a671-d477a4034a54 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:32.809021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b111584-a3cf-420b-a671-d477a4034a54 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:32.809471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9b111584-a3cf-420b-a671-d477a4034a54 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:32.941058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9b111584-a3cf-420b-a671-d477a4034a54 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:32.949554 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9b111584-a3cf-420b-a671-d477a4034a54 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.153126 Feb 19 21:34:32.950123 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2923/5759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:32 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:33.967133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ba07615c-8765-4994-8b6b-6420771f2ac7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:33.967680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ba07615c-8765-4994-8b6b-6420771f2ac7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:33.974434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba07615c-8765-4994-8b6b-6420771f2ac7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:33.974895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba07615c-8765-4994-8b6b-6420771f2ac7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:33.975682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba07615c-8765-4994-8b6b-6420771f2ac7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:33.976139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ba07615c-8765-4994-8b6b-6420771f2ac7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:34.112651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ba07615c-8765-4994-8b6b-6420771f2ac7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:34.119944 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ba07615c-8765-4994-8b6b-6420771f2ac7 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.156675 Feb 19 21:34:34.120555 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2837/5760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:33 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:35.137577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-42e0d5b9-5fda-40b2-89d1-1f7b29067ebb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:35.140089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-42e0d5b9-5fda-40b2-89d1-1f7b29067ebb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:35.144997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42e0d5b9-5fda-40b2-89d1-1f7b29067ebb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:35.145468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42e0d5b9-5fda-40b2-89d1-1f7b29067ebb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:35.146264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42e0d5b9-5fda-40b2-89d1-1f7b29067ebb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:35.148142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-42e0d5b9-5fda-40b2-89d1-1f7b29067ebb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:35.280934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-42e0d5b9-5fda-40b2-89d1-1f7b29067ebb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:35.289242 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-42e0d5b9-5fda-40b2-89d1-1f7b29067ebb tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.155978 Feb 19 21:34:35.289925 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2924/5761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:35 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:36.308848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cec669b5-a4e6-4afa-be5c-33aa20451a88 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:36.309460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cec669b5-a4e6-4afa-be5c-33aa20451a88 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:36.316221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cec669b5-a4e6-4afa-be5c-33aa20451a88 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:36.316709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cec669b5-a4e6-4afa-be5c-33aa20451a88 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:36.317491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cec669b5-a4e6-4afa-be5c-33aa20451a88 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:36.317928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cec669b5-a4e6-4afa-be5c-33aa20451a88 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:36.458868 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cec669b5-a4e6-4afa-be5c-33aa20451a88 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:36.466670 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cec669b5-a4e6-4afa-be5c-33aa20451a88 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.164416 Feb 19 21:34:36.467244 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2838/5762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:36 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:37.483455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2a16d81-64f3-439e-b4b3-038922bcb044 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:37.484076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b2a16d81-64f3-439e-b4b3-038922bcb044 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:37.490543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a16d81-64f3-439e-b4b3-038922bcb044 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:37.491007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a16d81-64f3-439e-b4b3-038922bcb044 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:37.491793 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a16d81-64f3-439e-b4b3-038922bcb044 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:37.492241 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2a16d81-64f3-439e-b4b3-038922bcb044 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:37.629650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b2a16d81-64f3-439e-b4b3-038922bcb044 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:37.637614 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2a16d81-64f3-439e-b4b3-038922bcb044 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.157852 Feb 19 21:34:37.638183 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2925/5763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:37 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:38.654438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0ec1f79b-5ffb-4333-8cf3-25deb376478c tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:38.655159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0ec1f79b-5ffb-4333-8cf3-25deb376478c tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:38.662380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ec1f79b-5ffb-4333-8cf3-25deb376478c tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:38.662748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ec1f79b-5ffb-4333-8cf3-25deb376478c tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:38.663550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ec1f79b-5ffb-4333-8cf3-25deb376478c tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:38.664533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0ec1f79b-5ffb-4333-8cf3-25deb376478c tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:38.810678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0ec1f79b-5ffb-4333-8cf3-25deb376478c tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:38.818229 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0ec1f79b-5ffb-4333-8cf3-25deb376478c tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.167531 Feb 19 21:34:38.818814 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2839/5764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:38 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:39.835004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-04cba07e-925c-4a71-a46b-ae554e0d8eb8 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:39.835728 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-04cba07e-925c-4a71-a46b-ae554e0d8eb8 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:39.843059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04cba07e-925c-4a71-a46b-ae554e0d8eb8 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:39.843518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04cba07e-925c-4a71-a46b-ae554e0d8eb8 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:39.844304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04cba07e-925c-4a71-a46b-ae554e0d8eb8 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:39.844802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-04cba07e-925c-4a71-a46b-ae554e0d8eb8 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:39.979438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-04cba07e-925c-4a71-a46b-ae554e0d8eb8 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:39.986903 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-04cba07e-925c-4a71-a46b-ae554e0d8eb8 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1515 microversion: 2.1 time: 0.155597 Feb 19 21:34:39.987474 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2926/5765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:39 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:41.005873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4cc2d3b5-dac5-4085-a62e-d620488a273a tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:41.006906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4cc2d3b5-dac5-4085-a62e-d620488a273a tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:41.014433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4cc2d3b5-dac5-4085-a62e-d620488a273a tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:41.014886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4cc2d3b5-dac5-4085-a62e-d620488a273a tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:41.015703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4cc2d3b5-dac5-4085-a62e-d620488a273a tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:41.016109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4cc2d3b5-dac5-4085-a62e-d620488a273a tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:41.051353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-2b16dd55-30a5-428c-8d1a-d45bcf231e13 req-c007e345-6a0b-4b4a-9b68-d5b16af0e351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885be350-96d3-430f-9c2b-0a1e58b7355d", "name": "network-vif-unplugged", "status": "completed", "tag": "79d8b2c2-debb-4778-88c8-2a1d4793d447"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:41.053666 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:34:41.053666 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:34:41.062408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2b16dd55-30a5-428c-8d1a-d45bcf231e13 req-c007e345-6a0b-4b4a-9b68-d5b16af0e351 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:41.062846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-2b16dd55-30a5-428c-8d1a-d45bcf231e13 req-c007e345-6a0b-4b4a-9b68-d5b16af0e351 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:41.075587 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-2b16dd55-30a5-428c-8d1a-d45bcf231e13 req-c007e345-6a0b-4b4a-9b68-d5b16af0e351 service nova] Creating event network-vif-unplugged:79d8b2c2-debb-4778-88c8-2a1d4793d447 for instance 885be350-96d3-430f-9c2b-0a1e58b7355d on nch1-master-1 Feb 19 21:34:41.082316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-2b16dd55-30a5-428c-8d1a-d45bcf231e13 req-c007e345-6a0b-4b4a-9b68-d5b16af0e351 service nova] Instance 885be350-96d3-430f-9c2b-0a1e58b7355d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:34:41.094378 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-2b16dd55-30a5-428c-8d1a-d45bcf231e13 req-c007e345-6a0b-4b4a-9b68-d5b16af0e351 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047342 Feb 19 21:34:41.095128 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2927/5766] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:34:41.268584 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4cc2d3b5-dac5-4085-a62e-d620488a273a tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:41.276699 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4cc2d3b5-dac5-4085-a62e-d620488a273a tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1514 microversion: 2.1 time: 0.276166 Feb 19 21:34:41.277737 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2840/5767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:40 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:34:42.295503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a5973486-8d32-490c-826c-26f606f6ab26 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:42.296226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a5973486-8d32-490c-826c-26f606f6ab26 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:42.302431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5973486-8d32-490c-826c-26f606f6ab26 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:42.302904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5973486-8d32-490c-826c-26f606f6ab26 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:42.303703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5973486-8d32-490c-826c-26f606f6ab26 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:42.304159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a5973486-8d32-490c-826c-26f606f6ab26 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:42.442393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a5973486-8d32-490c-826c-26f606f6ab26 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:42.450654 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a5973486-8d32-490c-826c-26f606f6ab26 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1512 microversion: 2.1 time: 0.160131 Feb 19 21:34:42.451221 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2928/5768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:42 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:43.110394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6532b0f3-fda6-4cd9-b686-65f6907a283b req-0f5fac61-2efa-4407-9d03-18cef7b68723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "885be350-96d3-430f-9c2b-0a1e58b7355d", "tag": "79d8b2c2-debb-4778-88c8-2a1d4793d447"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:43.111890 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:34:43.111890 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:34:43.119651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6532b0f3-fda6-4cd9-b686-65f6907a283b req-0f5fac61-2efa-4407-9d03-18cef7b68723 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:43.120099 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6532b0f3-fda6-4cd9-b686-65f6907a283b req-0f5fac61-2efa-4407-9d03-18cef7b68723 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:43.131193 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6532b0f3-fda6-4cd9-b686-65f6907a283b req-0f5fac61-2efa-4407-9d03-18cef7b68723 service nova] Creating event network-changed:79d8b2c2-debb-4778-88c8-2a1d4793d447 for instance 885be350-96d3-430f-9c2b-0a1e58b7355d on nch1-master-1 Feb 19 21:34:43.136873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-6532b0f3-fda6-4cd9-b686-65f6907a283b req-0f5fac61-2efa-4407-9d03-18cef7b68723 service nova] Instance 885be350-96d3-430f-9c2b-0a1e58b7355d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:34:43.147362 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6532b0f3-fda6-4cd9-b686-65f6907a283b req-0f5fac61-2efa-4407-9d03-18cef7b68723 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040658 Feb 19 21:34:43.147946 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2841/5769] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:34:43.466932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fe5cf9b6-665a-4dad-81b0-68db52de352e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:43.467556 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fe5cf9b6-665a-4dad-81b0-68db52de352e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:43.474345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe5cf9b6-665a-4dad-81b0-68db52de352e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:43.474818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe5cf9b6-665a-4dad-81b0-68db52de352e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:43.475612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe5cf9b6-665a-4dad-81b0-68db52de352e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:43.476071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fe5cf9b6-665a-4dad-81b0-68db52de352e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:44.167380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fe5cf9b6-665a-4dad-81b0-68db52de352e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:44.174915 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fe5cf9b6-665a-4dad-81b0-68db52de352e tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1509 microversion: 2.1 time: 0.711688 Feb 19 21:34:44.175504 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2929/5770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:43 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1509 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:44.192376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a25444c-6209-4b49-8248-989e011bc683 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:44.193073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a25444c-6209-4b49-8248-989e011bc683 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:44.199667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a25444c-6209-4b49-8248-989e011bc683 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:44.200116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a25444c-6209-4b49-8248-989e011bc683 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:44.200925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a25444c-6209-4b49-8248-989e011bc683 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:44.201363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a25444c-6209-4b49-8248-989e011bc683 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:44.228318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a25444c-6209-4b49-8248-989e011bc683 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:34:44.278816 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.compute.api [None req-9a25444c-6209-4b49-8248-989e011bc683 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Found an unconfirmed migration during delete, id: 16, status: finished Feb 19 21:34:45.581609 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a25444c-6209-4b49-8248-989e011bc683 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "DELETE /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 204 len: 0 microversion: 2.1 time: 1.393867 Feb 19 21:34:45.582261 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2842/5771] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:34:44 2022] DELETE /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 0 bytes in 1396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:34:45.590769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1828b297-f995-4365-bd51-763901bf9756 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:45.591937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1828b297-f995-4365-bd51-763901bf9756 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:45.598589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1828b297-f995-4365-bd51-763901bf9756 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:45.599048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1828b297-f995-4365-bd51-763901bf9756 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:45.599833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1828b297-f995-4365-bd51-763901bf9756 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:45.600283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1828b297-f995-4365-bd51-763901bf9756 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:45.737246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1828b297-f995-4365-bd51-763901bf9756 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:45.749124 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1828b297-f995-4365-bd51-763901bf9756 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1501 microversion: 2.1 time: 0.162089 Feb 19 21:34:45.749924 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2930/5772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:45 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:46.476647 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-0facf637-c76c-4a45-8e3f-17355a197df4 req-a4504789-e77d-4925-a8ff-4516e1d601e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885be350-96d3-430f-9c2b-0a1e58b7355d", "name": "network-vif-plugged", "status": "completed", "tag": "79d8b2c2-debb-4778-88c8-2a1d4793d447"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:46.478310 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:34:46.478310 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:34:46.486548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0facf637-c76c-4a45-8e3f-17355a197df4 req-a4504789-e77d-4925-a8ff-4516e1d601e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:46.487007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0facf637-c76c-4a45-8e3f-17355a197df4 req-a4504789-e77d-4925-a8ff-4516e1d601e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:46.498543 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-0facf637-c76c-4a45-8e3f-17355a197df4 req-a4504789-e77d-4925-a8ff-4516e1d601e6 service nova] Creating event network-vif-plugged:79d8b2c2-debb-4778-88c8-2a1d4793d447 for instance 885be350-96d3-430f-9c2b-0a1e58b7355d on nch1-master-1 Feb 19 21:34:46.503328 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-0facf637-c76c-4a45-8e3f-17355a197df4 req-a4504789-e77d-4925-a8ff-4516e1d601e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030776 Feb 19 21:34:46.503972 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2843/5773] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:34:46.766162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad5c8aeb-1ed5-4db9-aed2-5fa28995f3c6 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:46.766786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ad5c8aeb-1ed5-4db9-aed2-5fa28995f3c6 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:46.773495 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad5c8aeb-1ed5-4db9-aed2-5fa28995f3c6 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:46.773966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad5c8aeb-1ed5-4db9-aed2-5fa28995f3c6 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:46.774761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad5c8aeb-1ed5-4db9-aed2-5fa28995f3c6 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:46.775214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad5c8aeb-1ed5-4db9-aed2-5fa28995f3c6 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:46.942699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ad5c8aeb-1ed5-4db9-aed2-5fa28995f3c6 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526c1165def845fbb5d29610983f6da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ee08e460d4b61a0db66627b1aaa91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:46.950935 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ad5c8aeb-1ed5-4db9-aed2-5fa28995f3c6 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 200 len: 1501 microversion: 2.1 time: 0.188526 Feb 19 21:34:46.951518 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2931/5774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:46 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:47.380107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-0074e67b-aa0c-400b-b717-fbd323ea0b23 req-e51d6708-dc11-4231-8915-80146b66933b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "885be350-96d3-430f-9c2b-0a1e58b7355d", "name": "network-vif-deleted", "tag": "79d8b2c2-debb-4778-88c8-2a1d4793d447"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:47.381642 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:34:47.381642 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:34:47.389623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0074e67b-aa0c-400b-b717-fbd323ea0b23 req-e51d6708-dc11-4231-8915-80146b66933b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:47.390074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0074e67b-aa0c-400b-b717-fbd323ea0b23 req-e51d6708-dc11-4231-8915-80146b66933b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:47.405335 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-0074e67b-aa0c-400b-b717-fbd323ea0b23 req-e51d6708-dc11-4231-8915-80146b66933b service nova] Creating event network-vif-deleted:79d8b2c2-debb-4778-88c8-2a1d4793d447 for instance 885be350-96d3-430f-9c2b-0a1e58b7355d on nch1-master-1 Feb 19 21:34:47.411382 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-0074e67b-aa0c-400b-b717-fbd323ea0b23 req-e51d6708-dc11-4231-8915-80146b66933b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035764 Feb 19 21:34:47.412029 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2844/5775] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:34:47.967876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f529a065-ac95-476f-937e-b9291d1ba674 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:47.968633 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f529a065-ac95-476f-937e-b9291d1ba674 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:47.975705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f529a065-ac95-476f-937e-b9291d1ba674 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:47.976284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f529a065-ac95-476f-937e-b9291d1ba674 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:47.977133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f529a065-ac95-476f-937e-b9291d1ba674 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:47.977581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f529a065-ac95-476f-937e-b9291d1ba674 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:47.993016 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-f529a065-ac95-476f-937e-b9291d1ba674 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] HTTP exception thrown: Instance 885be350-96d3-430f-9c2b-0a1e58b7355d could not be found. Feb 19 21:34:47.993613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f529a065-ac95-476f-937e-b9291d1ba674 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Returning 404 to user: Instance 885be350-96d3-430f-9c2b-0a1e58b7355d could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:34:47.994931 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f529a065-ac95-476f-937e-b9291d1ba674 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 404 len: 111 microversion: 2.1 time: 0.030432 Feb 19 21:34:47.995463 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2932/5776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:47 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:34:48.011292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c317388a-686f-4fa0-acd9-78f6b732fa21 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:48.011874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c317388a-686f-4fa0-acd9-78f6b732fa21 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:48.018861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c317388a-686f-4fa0-acd9-78f6b732fa21 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:48.019313 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c317388a-686f-4fa0-acd9-78f6b732fa21 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:48.020084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c317388a-686f-4fa0-acd9-78f6b732fa21 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:48.020553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c317388a-686f-4fa0-acd9-78f6b732fa21 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:48.033279 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c317388a-686f-4fa0-acd9-78f6b732fa21 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] HTTP exception thrown: Instance 885be350-96d3-430f-9c2b-0a1e58b7355d could not be found. Feb 19 21:34:48.033861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c317388a-686f-4fa0-acd9-78f6b732fa21 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Returning 404 to user: Instance 885be350-96d3-430f-9c2b-0a1e58b7355d could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:34:48.034664 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c317388a-686f-4fa0-acd9-78f6b732fa21 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "DELETE /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 404 len: 111 microversion: 2.1 time: 0.028067 Feb 19 21:34:48.035186 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2845/5777] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:34:48 2022] DELETE /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:34:48.043355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-127d5dd5-e96c-496a-b47e-9000d092dd15 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:48.043973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-127d5dd5-e96c-496a-b47e-9000d092dd15 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] [instance: 885be350-96d3-430f-9c2b-0a1e58b7355d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:48.049768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-127d5dd5-e96c-496a-b47e-9000d092dd15 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:48.050225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-127d5dd5-e96c-496a-b47e-9000d092dd15 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:48.051007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-127d5dd5-e96c-496a-b47e-9000d092dd15 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:48.051453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-127d5dd5-e96c-496a-b47e-9000d092dd15 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:48.065698 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-127d5dd5-e96c-496a-b47e-9000d092dd15 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] HTTP exception thrown: Instance 885be350-96d3-430f-9c2b-0a1e58b7355d could not be found. Feb 19 21:34:48.066291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-127d5dd5-e96c-496a-b47e-9000d092dd15 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] Returning 404 to user: Instance 885be350-96d3-430f-9c2b-0a1e58b7355d could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:34:48.067121 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-127d5dd5-e96c-496a-b47e-9000d092dd15 tempest-DeleteServersTestJSON-612359802 tempest-DeleteServersTestJSON-612359802-project] 10.222.0.30 "GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d" status: 404 len: 111 microversion: 2.1 time: 0.027901 Feb 19 21:34:48.067668 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2933/5778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:48 2022] GET /compute/v2.1/servers/885be350-96d3-430f-9c2b-0a1e58b7355d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:34:50.457259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1886167610", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "8a8d6a03-fa02-431b-a0af-4411327a65d3"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:50.511196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] validate_networks() for [('8a8d6a03-fa02-431b-a0af-4411327a65d3', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:34:50.871013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:34:50.871444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:34:50.871930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:34:50.872368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:34:50.872796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:34:50.881620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:50.882079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:50.882903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:50.883349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:50.900309 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Getting quotas for project 6d4e54e969224337acfc6a178ca33422. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:34:50.905779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Getting quotas for user dcbdf20935dc41a79864b7520ebc72cb and project 6d4e54e969224337acfc6a178ca33422. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:34:50.918122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:34:50.920459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:34:50.964524 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-548e3d29-a9ee-4012-a347-0874a55a4aa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625360 Feb 19 21:34:50.965405 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2846/5779] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:34:50.975896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9ec41198-76d4-42d7-83c9-acfd50aac60e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:50.976555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9ec41198-76d4-42d7-83c9-acfd50aac60e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:51.030886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9ec41198-76d4-42d7-83c9-acfd50aac60e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:51.037425 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9ec41198-76d4-42d7-83c9-acfd50aac60e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1218 microversion: 2.1 time: 0.066189 Feb 19 21:34:51.037981 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2934/5780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:50 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:52.056570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f28cd34e-ed50-407e-adb7-7b2fba857771 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:52.057201 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f28cd34e-ed50-407e-adb7-7b2fba857771 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:52.064789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f28cd34e-ed50-407e-adb7-7b2fba857771 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:52.065243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f28cd34e-ed50-407e-adb7-7b2fba857771 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:52.066036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f28cd34e-ed50-407e-adb7-7b2fba857771 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:52.066474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f28cd34e-ed50-407e-adb7-7b2fba857771 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:52.161160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f28cd34e-ed50-407e-adb7-7b2fba857771 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:52.168482 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f28cd34e-ed50-407e-adb7-7b2fba857771 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1276 microversion: 2.1 time: 0.117442 Feb 19 21:34:52.169069 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2847/5781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:52 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:53.136172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8a7604f3-b449-4914-9154-6518b748017d req-61d67683-94a2-4a0c-8ffd-f12c1fd2ac8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5219b9-b43c-4a44-8422-6a60157b2b4e", "tag": "e8b1811d-ffc4-480b-902b-9df5045ba896"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:53.138002 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:34:53.138002 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:34:53.155387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8a7604f3-b449-4914-9154-6518b748017d req-61d67683-94a2-4a0c-8ffd-f12c1fd2ac8f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:53.156720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8a7604f3-b449-4914-9154-6518b748017d req-61d67683-94a2-4a0c-8ffd-f12c1fd2ac8f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:53.169056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8a7604f3-b449-4914-9154-6518b748017d req-61d67683-94a2-4a0c-8ffd-f12c1fd2ac8f service nova] Creating event network-changed:e8b1811d-ffc4-480b-902b-9df5045ba896 for instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e on nch2-master-1 Feb 19 21:34:53.174232 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8a7604f3-b449-4914-9154-6518b748017d req-61d67683-94a2-4a0c-8ffd-f12c1fd2ac8f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042813 Feb 19 21:34:53.174843 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2935/5782] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:34:53.185399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a60e2ded-e784-4f9c-9084-a6486e843f7e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:53.186072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a60e2ded-e784-4f9c-9084-a6486e843f7e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:53.192895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a60e2ded-e784-4f9c-9084-a6486e843f7e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:53.193357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a60e2ded-e784-4f9c-9084-a6486e843f7e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:53.194184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a60e2ded-e784-4f9c-9084-a6486e843f7e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:53.194632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a60e2ded-e784-4f9c-9084-a6486e843f7e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:53.462482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a60e2ded-e784-4f9c-9084-a6486e843f7e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:53.470895 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a60e2ded-e784-4f9c-9084-a6486e843f7e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1318 microversion: 2.1 time: 0.289221 Feb 19 21:34:53.471478 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2848/5783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:53 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:54.488624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f3d8d39f-133b-48c6-9323-52c7467782c1 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:54.489342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f3d8d39f-133b-48c6-9323-52c7467782c1 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:54.496706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3d8d39f-133b-48c6-9323-52c7467782c1 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:54.497173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3d8d39f-133b-48c6-9323-52c7467782c1 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:54.497967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3d8d39f-133b-48c6-9323-52c7467782c1 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:54.498443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f3d8d39f-133b-48c6-9323-52c7467782c1 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:54.637039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f3d8d39f-133b-48c6-9323-52c7467782c1 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:54.644455 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f3d8d39f-133b-48c6-9323-52c7467782c1 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1318 microversion: 2.1 time: 0.160025 Feb 19 21:34:54.645050 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2936/5784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:54 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:55.662341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-498e8f5a-1aed-4285-8351-52d3550b3cd7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:55.662876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-498e8f5a-1aed-4285-8351-52d3550b3cd7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:55.670211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-498e8f5a-1aed-4285-8351-52d3550b3cd7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:55.670685 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-498e8f5a-1aed-4285-8351-52d3550b3cd7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:55.671451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-498e8f5a-1aed-4285-8351-52d3550b3cd7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:55.671891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-498e8f5a-1aed-4285-8351-52d3550b3cd7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:55.805788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-498e8f5a-1aed-4285-8351-52d3550b3cd7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:55.813900 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-498e8f5a-1aed-4285-8351-52d3550b3cd7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1318 microversion: 2.1 time: 0.155380 Feb 19 21:34:55.814478 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2849/5785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:55 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:56.830028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0e97d45-5e60-45d1-b96f-ab5854b86ef9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:56.830651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d0e97d45-5e60-45d1-b96f-ab5854b86ef9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:56.837368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0e97d45-5e60-45d1-b96f-ab5854b86ef9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:56.837834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0e97d45-5e60-45d1-b96f-ab5854b86ef9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:56.838632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0e97d45-5e60-45d1-b96f-ab5854b86ef9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:56.839091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0e97d45-5e60-45d1-b96f-ab5854b86ef9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:56.976361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d0e97d45-5e60-45d1-b96f-ab5854b86ef9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:56.983749 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d0e97d45-5e60-45d1-b96f-ab5854b86ef9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1318 microversion: 2.1 time: 0.157362 Feb 19 21:34:56.984356 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2937/5786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:56 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:58.000139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ccc3837c-3aa4-46fd-8c72-f6a572f5256d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:58.000703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ccc3837c-3aa4-46fd-8c72-f6a572f5256d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:58.007399 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccc3837c-3aa4-46fd-8c72-f6a572f5256d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:58.007844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccc3837c-3aa4-46fd-8c72-f6a572f5256d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:58.008654 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccc3837c-3aa4-46fd-8c72-f6a572f5256d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:58.009085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccc3837c-3aa4-46fd-8c72-f6a572f5256d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:58.141520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ccc3837c-3aa4-46fd-8c72-f6a572f5256d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:58.148736 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ccc3837c-3aa4-46fd-8c72-f6a572f5256d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1318 microversion: 2.1 time: 0.152389 Feb 19 21:34:58.149316 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2850/5787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:57 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:34:59.113856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-78e361ba-067a-4bd1-9e7c-fe725a4c6e4f req-235fd3c7-97b8-4150-9e2c-6f37e5a594ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5219b9-b43c-4a44-8422-6a60157b2b4e", "name": "network-vif-plugged", "status": "completed", "tag": "e8b1811d-ffc4-480b-902b-9df5045ba896"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:34:59.115423 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:34:59.115423 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:34:59.122418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-78e361ba-067a-4bd1-9e7c-fe725a4c6e4f req-235fd3c7-97b8-4150-9e2c-6f37e5a594ad service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:59.122874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-78e361ba-067a-4bd1-9e7c-fe725a4c6e4f req-235fd3c7-97b8-4150-9e2c-6f37e5a594ad service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:59.133442 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-78e361ba-067a-4bd1-9e7c-fe725a4c6e4f req-235fd3c7-97b8-4150-9e2c-6f37e5a594ad service nova] Creating event network-vif-plugged:e8b1811d-ffc4-480b-902b-9df5045ba896 for instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e on nch2-master-1 Feb 19 21:34:59.138227 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-78e361ba-067a-4bd1-9e7c-fe725a4c6e4f req-235fd3c7-97b8-4150-9e2c-6f37e5a594ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097624 Feb 19 21:34:59.138797 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2938/5788] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:34:59.166477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7cce621f-a297-47ef-97d0-fb818e05f63f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:34:59.167172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7cce621f-a297-47ef-97d0-fb818e05f63f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:34:59.176490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7cce621f-a297-47ef-97d0-fb818e05f63f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:59.176986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7cce621f-a297-47ef-97d0-fb818e05f63f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:59.177802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7cce621f-a297-47ef-97d0-fb818e05f63f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:34:59.178259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7cce621f-a297-47ef-97d0-fb818e05f63f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:34:59.363364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7cce621f-a297-47ef-97d0-fb818e05f63f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:34:59.370689 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7cce621f-a297-47ef-97d0-fb818e05f63f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1318 microversion: 2.1 time: 0.208784 Feb 19 21:34:59.371282 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2851/5789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:34:59 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:00.388538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c907ac01-adf8-4ef8-b25b-0f5127255898 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:00.389254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c907ac01-adf8-4ef8-b25b-0f5127255898 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:00.395416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c907ac01-adf8-4ef8-b25b-0f5127255898 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:00.395880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c907ac01-adf8-4ef8-b25b-0f5127255898 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:00.396701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c907ac01-adf8-4ef8-b25b-0f5127255898 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:00.397157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c907ac01-adf8-4ef8-b25b-0f5127255898 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:00.533942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c907ac01-adf8-4ef8-b25b-0f5127255898 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:00.541960 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c907ac01-adf8-4ef8-b25b-0f5127255898 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1318 microversion: 2.1 time: 0.158289 Feb 19 21:35:00.542525 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2939/5790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:00 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:01.559272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-88b79a65-f15a-417d-a3f4-e14b0eaf4064 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:01.559885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-88b79a65-f15a-417d-a3f4-e14b0eaf4064 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:01.566724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88b79a65-f15a-417d-a3f4-e14b0eaf4064 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:01.567176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88b79a65-f15a-417d-a3f4-e14b0eaf4064 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:01.567956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88b79a65-f15a-417d-a3f4-e14b0eaf4064 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:01.568426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-88b79a65-f15a-417d-a3f4-e14b0eaf4064 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:01.706625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-88b79a65-f15a-417d-a3f4-e14b0eaf4064 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:01.713931 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-88b79a65-f15a-417d-a3f4-e14b0eaf4064 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1509 microversion: 2.1 time: 0.158960 Feb 19 21:35:01.714496 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2852/5791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:01 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:01.730358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-da62c8c1-6e8f-468c-be7b-e6c6876baaa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:01.730990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-da62c8c1-6e8f-468c-be7b-e6c6876baaa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:01.737799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da62c8c1-6e8f-468c-be7b-e6c6876baaa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:01.738272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da62c8c1-6e8f-468c-be7b-e6c6876baaa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:01.739070 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da62c8c1-6e8f-468c-be7b-e6c6876baaa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:01.739532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-da62c8c1-6e8f-468c-be7b-e6c6876baaa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:01.873553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-da62c8c1-6e8f-468c-be7b-e6c6876baaa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:01.880985 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-da62c8c1-6e8f-468c-be7b-e6c6876baaa6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1509 microversion: 2.1 time: 0.154888 Feb 19 21:35:01.881553 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2940/5792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:01 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:01.896572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-593b08b4-76aa-4207-ae9e-6eb2bdd3fb26 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:01.897727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-593b08b4-76aa-4207-ae9e-6eb2bdd3fb26 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:01.904171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-593b08b4-76aa-4207-ae9e-6eb2bdd3fb26 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:01.904651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-593b08b4-76aa-4207-ae9e-6eb2bdd3fb26 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:01.905453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-593b08b4-76aa-4207-ae9e-6eb2bdd3fb26 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:01.905886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-593b08b4-76aa-4207-ae9e-6eb2bdd3fb26 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:01.966117 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-593b08b4-76aa-4207-ae9e-6eb2bdd3fb26 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "PUT /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1081 microversion: 2.1 time: 0.073287 Feb 19 21:35:01.966750 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2853/5793] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Feb 19 21:35:01 2022] PUT /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1081 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:01.980694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54d398fa-c693-4e21-a6b2-ba43769f29af tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:01.981314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54d398fa-c693-4e21-a6b2-ba43769f29af tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:01.987272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54d398fa-c693-4e21-a6b2-ba43769f29af tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:01.987729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54d398fa-c693-4e21-a6b2-ba43769f29af tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:01.988554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54d398fa-c693-4e21-a6b2-ba43769f29af tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:01.989005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54d398fa-c693-4e21-a6b2-ba43769f29af tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:02.124716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54d398fa-c693-4e21-a6b2-ba43769f29af tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:02.132037 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54d398fa-c693-4e21-a6b2-ba43769f29af tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1507 microversion: 2.1 time: 0.155578 Feb 19 21:35:02.132979 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2941/5794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:01 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:02.148002 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc6f1fc4-4e33-47c7-8f33-23b8be0377aa tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:02.148711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc6f1fc4-4e33-47c7-8f33-23b8be0377aa tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:02.155074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc6f1fc4-4e33-47c7-8f33-23b8be0377aa tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:02.155554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc6f1fc4-4e33-47c7-8f33-23b8be0377aa tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:02.156350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc6f1fc4-4e33-47c7-8f33-23b8be0377aa tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:02.156789 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc6f1fc4-4e33-47c7-8f33-23b8be0377aa tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:02.292027 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc6f1fc4-4e33-47c7-8f33-23b8be0377aa tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:02.298312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc6f1fc4-4e33-47c7-8f33-23b8be0377aa tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1507 microversion: 2.1 time: 0.153954 Feb 19 21:35:02.298890 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2854/5795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:02 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:02.314549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:02.315558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:02.321442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:02.322440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:02.323230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:02.323948 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:02.396090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:02.402225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Old instance type m1.heat2, new instance type m1.heat {{(pid=136094) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:35:02.408430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:35:02.408864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:35:02.409347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:35:02.409765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:35:02.410183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:35:02.513921 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c1a05551-b49b-44e1-bcf8-670eac321949 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "POST /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e/action" status: 202 len: 0 microversion: 2.1 time: 0.203048 Feb 19 21:35:02.514609 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2942/5796] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:35:02 2022] POST /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:35:02.522424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2ea54cf-7640-4341-b8f7-765b581f55e8 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:02.523110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c2ea54cf-7640-4341-b8f7-765b581f55e8 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:02.533311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2ea54cf-7640-4341-b8f7-765b581f55e8 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:02.533764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2ea54cf-7640-4341-b8f7-765b581f55e8 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:02.534555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2ea54cf-7640-4341-b8f7-765b581f55e8 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:02.534995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2ea54cf-7640-4341-b8f7-765b581f55e8 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:02.682703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c2ea54cf-7640-4341-b8f7-765b581f55e8 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:02.690283 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c2ea54cf-7640-4341-b8f7-765b581f55e8 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1518 microversion: 2.1 time: 0.171491 Feb 19 21:35:02.690865 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2855/5797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:02 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:03.709542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1ea44ad9-17ec-4c38-91e4-17da37f40033 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:03.710166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1ea44ad9-17ec-4c38-91e4-17da37f40033 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:03.717322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ea44ad9-17ec-4c38-91e4-17da37f40033 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:03.717979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ea44ad9-17ec-4c38-91e4-17da37f40033 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:03.718493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ea44ad9-17ec-4c38-91e4-17da37f40033 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:03.718940 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1ea44ad9-17ec-4c38-91e4-17da37f40033 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:03.945837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1ea44ad9-17ec-4c38-91e4-17da37f40033 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:03.954186 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1ea44ad9-17ec-4c38-91e4-17da37f40033 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1518 microversion: 2.1 time: 0.249222 Feb 19 21:35:03.954775 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2943/5798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:03 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1518 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:04.971804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-71a2e66f-1ad2-4cd4-bc0b-291c1693967d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:04.972378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-71a2e66f-1ad2-4cd4-bc0b-291c1693967d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:04.979708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71a2e66f-1ad2-4cd4-bc0b-291c1693967d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:04.980164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71a2e66f-1ad2-4cd4-bc0b-291c1693967d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:04.980978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71a2e66f-1ad2-4cd4-bc0b-291c1693967d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:04.981422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-71a2e66f-1ad2-4cd4-bc0b-291c1693967d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:05.114083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-71a2e66f-1ad2-4cd4-bc0b-291c1693967d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:05.123797 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-71a2e66f-1ad2-4cd4-bc0b-291c1693967d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.155779 Feb 19 21:35:05.124409 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2856/5799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:04 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:06.141027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9d8585a7-2b62-4950-a09d-fa4b6fdddd6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:06.141651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9d8585a7-2b62-4950-a09d-fa4b6fdddd6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:06.148491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d8585a7-2b62-4950-a09d-fa4b6fdddd6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:06.148956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d8585a7-2b62-4950-a09d-fa4b6fdddd6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:06.149737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d8585a7-2b62-4950-a09d-fa4b6fdddd6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:06.150745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d8585a7-2b62-4950-a09d-fa4b6fdddd6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:06.299483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9d8585a7-2b62-4950-a09d-fa4b6fdddd6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:06.306871 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9d8585a7-2b62-4950-a09d-fa4b6fdddd6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.169543 Feb 19 21:35:06.307447 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2944/5800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:06 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:07.323844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-68efecde-a362-4994-9d0c-b60de078ffb5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:07.324539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-68efecde-a362-4994-9d0c-b60de078ffb5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:07.331403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-68efecde-a362-4994-9d0c-b60de078ffb5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:07.331858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-68efecde-a362-4994-9d0c-b60de078ffb5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:07.332677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-68efecde-a362-4994-9d0c-b60de078ffb5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:07.333119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-68efecde-a362-4994-9d0c-b60de078ffb5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:07.473066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-68efecde-a362-4994-9d0c-b60de078ffb5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:07.481109 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-68efecde-a362-4994-9d0c-b60de078ffb5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.161182 Feb 19 21:35:07.481687 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2857/5801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:07 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:08.502511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0026b006-2d9e-481d-8e2e-436abd9ecf6d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:08.503165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0026b006-2d9e-481d-8e2e-436abd9ecf6d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:08.509707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0026b006-2d9e-481d-8e2e-436abd9ecf6d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:08.510173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0026b006-2d9e-481d-8e2e-436abd9ecf6d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:08.510966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0026b006-2d9e-481d-8e2e-436abd9ecf6d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:08.511419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0026b006-2d9e-481d-8e2e-436abd9ecf6d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:08.641467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0026b006-2d9e-481d-8e2e-436abd9ecf6d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:08.648782 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0026b006-2d9e-481d-8e2e-436abd9ecf6d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.149995 Feb 19 21:35:08.649353 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2945/5802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:08 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:09.666566 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11668994-bdd9-450f-82ef-5b0ee938ebc0 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:09.667174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-11668994-bdd9-450f-82ef-5b0ee938ebc0 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:09.673752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11668994-bdd9-450f-82ef-5b0ee938ebc0 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:09.674200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11668994-bdd9-450f-82ef-5b0ee938ebc0 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:09.674975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11668994-bdd9-450f-82ef-5b0ee938ebc0 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:09.675425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-11668994-bdd9-450f-82ef-5b0ee938ebc0 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:09.816579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-11668994-bdd9-450f-82ef-5b0ee938ebc0 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:09.825665 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11668994-bdd9-450f-82ef-5b0ee938ebc0 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.162442 Feb 19 21:35:09.826752 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2858/5803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:09 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:10.843244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-99a10096-98ee-491b-af55-b21e4176c5dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:10.843878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-99a10096-98ee-491b-af55-b21e4176c5dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:10.850653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99a10096-98ee-491b-af55-b21e4176c5dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:10.851118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99a10096-98ee-491b-af55-b21e4176c5dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:10.851910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99a10096-98ee-491b-af55-b21e4176c5dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:10.852385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-99a10096-98ee-491b-af55-b21e4176c5dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:10.984387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-99a10096-98ee-491b-af55-b21e4176c5dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:10.991699 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-99a10096-98ee-491b-af55-b21e4176c5dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.152134 Feb 19 21:35:10.992273 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2946/5804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:10 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:12.009328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-85f3d51c-7eab-40c8-b985-37a65162ca3f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:12.009946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-85f3d51c-7eab-40c8-b985-37a65162ca3f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:12.016729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85f3d51c-7eab-40c8-b985-37a65162ca3f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:12.017173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85f3d51c-7eab-40c8-b985-37a65162ca3f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:12.017944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85f3d51c-7eab-40c8-b985-37a65162ca3f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:12.018381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-85f3d51c-7eab-40c8-b985-37a65162ca3f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:12.153774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-85f3d51c-7eab-40c8-b985-37a65162ca3f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:12.161297 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-85f3d51c-7eab-40c8-b985-37a65162ca3f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.156141 Feb 19 21:35:12.161871 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2859/5805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:12 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:13.178171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a805b62c-e734-444a-b198-430049f637c5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:13.178790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a805b62c-e734-444a-b198-430049f637c5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:13.185662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a805b62c-e734-444a-b198-430049f637c5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:13.186122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a805b62c-e734-444a-b198-430049f637c5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:13.186910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a805b62c-e734-444a-b198-430049f637c5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:13.187358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a805b62c-e734-444a-b198-430049f637c5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:13.320218 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a805b62c-e734-444a-b198-430049f637c5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:13.327808 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a805b62c-e734-444a-b198-430049f637c5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.153418 Feb 19 21:35:13.328396 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2947/5806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:13 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:14.345069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f51c5c14-384f-46d0-864b-522820823d5f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:14.345690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f51c5c14-384f-46d0-864b-522820823d5f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:14.353086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f51c5c14-384f-46d0-864b-522820823d5f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:14.353538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f51c5c14-384f-46d0-864b-522820823d5f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:14.354349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f51c5c14-384f-46d0-864b-522820823d5f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:14.354785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f51c5c14-384f-46d0-864b-522820823d5f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:14.486758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f51c5c14-384f-46d0-864b-522820823d5f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:14.494953 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f51c5c14-384f-46d0-864b-522820823d5f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.153643 Feb 19 21:35:14.495539 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2860/5807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:14 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:15.512418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-839efa7d-a8e2-4530-8cca-b429caba8307 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:15.513094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-839efa7d-a8e2-4530-8cca-b429caba8307 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:15.519816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-839efa7d-a8e2-4530-8cca-b429caba8307 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:15.520292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-839efa7d-a8e2-4530-8cca-b429caba8307 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:15.521117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-839efa7d-a8e2-4530-8cca-b429caba8307 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:15.521578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-839efa7d-a8e2-4530-8cca-b429caba8307 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:15.658586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-839efa7d-a8e2-4530-8cca-b429caba8307 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:15.666002 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-839efa7d-a8e2-4530-8cca-b429caba8307 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.157979 Feb 19 21:35:15.666575 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2948/5808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:15 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:35:16.682139 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a28bc8cb-9a91-4cf6-9fbf-322068e22c9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:16.682758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a28bc8cb-9a91-4cf6-9fbf-322068e22c9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:16.689674 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a28bc8cb-9a91-4cf6-9fbf-322068e22c9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:16.690134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a28bc8cb-9a91-4cf6-9fbf-322068e22c9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:16.690949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a28bc8cb-9a91-4cf6-9fbf-322068e22c9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:16.691395 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a28bc8cb-9a91-4cf6-9fbf-322068e22c9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:16.825245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a28bc8cb-9a91-4cf6-9fbf-322068e22c9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:16.832598 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a28bc8cb-9a91-4cf6-9fbf-322068e22c9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.154145 Feb 19 21:35:16.833174 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2861/5809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:16 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:17.850574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-faf19b5e-2bdb-4449-a1cf-1e346fbb23c7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:17.851413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-faf19b5e-2bdb-4449-a1cf-1e346fbb23c7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:17.858681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faf19b5e-2bdb-4449-a1cf-1e346fbb23c7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:17.859141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faf19b5e-2bdb-4449-a1cf-1e346fbb23c7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:17.859924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faf19b5e-2bdb-4449-a1cf-1e346fbb23c7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:17.860398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-faf19b5e-2bdb-4449-a1cf-1e346fbb23c7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:17.998075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-faf19b5e-2bdb-4449-a1cf-1e346fbb23c7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:18.005512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-faf19b5e-2bdb-4449-a1cf-1e346fbb23c7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.159547 Feb 19 21:35:18.006083 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2949/5810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:17 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:35:19.022767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7a0a9086-4ba1-47aa-91a5-3912dae075ea tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:19.023373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7a0a9086-4ba1-47aa-91a5-3912dae075ea tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:19.030103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a0a9086-4ba1-47aa-91a5-3912dae075ea tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:19.030552 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a0a9086-4ba1-47aa-91a5-3912dae075ea tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:19.031329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a0a9086-4ba1-47aa-91a5-3912dae075ea tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:19.031766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a0a9086-4ba1-47aa-91a5-3912dae075ea tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:19.163636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7a0a9086-4ba1-47aa-91a5-3912dae075ea tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:19.171603 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7a0a9086-4ba1-47aa-91a5-3912dae075ea tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.152548 Feb 19 21:35:19.172176 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2862/5811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:19 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:19.580830 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:35:19.581063 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 21:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:35:20.188478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-614c4a2b-16f8-441a-a330-eb031bd1e925 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:20.189137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-614c4a2b-16f8-441a-a330-eb031bd1e925 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:20.195863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-614c4a2b-16f8-441a-a330-eb031bd1e925 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:20.196934 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-614c4a2b-16f8-441a-a330-eb031bd1e925 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:20.197735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-614c4a2b-16f8-441a-a330-eb031bd1e925 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:20.198461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-614c4a2b-16f8-441a-a330-eb031bd1e925 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:20.335427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-614c4a2b-16f8-441a-a330-eb031bd1e925 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:20.342785 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-614c4a2b-16f8-441a-a330-eb031bd1e925 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.158068 Feb 19 21:35:20.343358 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2950/5812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:20 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:21.359818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-91b98b44-283d-453e-9b83-fa0f5e2a5cb7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:21.360499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-91b98b44-283d-453e-9b83-fa0f5e2a5cb7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:21.367364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91b98b44-283d-453e-9b83-fa0f5e2a5cb7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:21.368301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91b98b44-283d-453e-9b83-fa0f5e2a5cb7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:21.369118 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91b98b44-283d-453e-9b83-fa0f5e2a5cb7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:21.369562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91b98b44-283d-453e-9b83-fa0f5e2a5cb7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:21.501234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91b98b44-283d-453e-9b83-fa0f5e2a5cb7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:21.509372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-91b98b44-283d-453e-9b83-fa0f5e2a5cb7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.152645 Feb 19 21:35:21.509954 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2863/5813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:21 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:22.526513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b7d7b20-a43c-482b-ab88-cf6f59b51387 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:22.527204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7b7d7b20-a43c-482b-ab88-cf6f59b51387 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:22.533593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b7d7b20-a43c-482b-ab88-cf6f59b51387 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:22.534055 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b7d7b20-a43c-482b-ab88-cf6f59b51387 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:22.535136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b7d7b20-a43c-482b-ab88-cf6f59b51387 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:22.535586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b7d7b20-a43c-482b-ab88-cf6f59b51387 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:22.669204 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7b7d7b20-a43c-482b-ab88-cf6f59b51387 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:22.676420 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b7d7b20-a43c-482b-ab88-cf6f59b51387 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.153754 Feb 19 21:35:22.676985 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2951/5814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:22 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:23.693832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c3652566-d606-4ca5-86e8-0ba54dccb844 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:23.694446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c3652566-d606-4ca5-86e8-0ba54dccb844 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:23.702413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c3652566-d606-4ca5-86e8-0ba54dccb844 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:23.702898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c3652566-d606-4ca5-86e8-0ba54dccb844 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:23.703689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c3652566-d606-4ca5-86e8-0ba54dccb844 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:23.704125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c3652566-d606-4ca5-86e8-0ba54dccb844 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:23.842355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c3652566-d606-4ca5-86e8-0ba54dccb844 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:23.849829 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c3652566-d606-4ca5-86e8-0ba54dccb844 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.159684 Feb 19 21:35:23.850415 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2864/5815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:23 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:24.867238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9cd32c02-db02-4ae3-a8c4-53bc7289299c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:24.867871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9cd32c02-db02-4ae3-a8c4-53bc7289299c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:24.874991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cd32c02-db02-4ae3-a8c4-53bc7289299c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:24.875459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cd32c02-db02-4ae3-a8c4-53bc7289299c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:24.876285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cd32c02-db02-4ae3-a8c4-53bc7289299c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:24.876773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cd32c02-db02-4ae3-a8c4-53bc7289299c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:25.012351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9cd32c02-db02-4ae3-a8c4-53bc7289299c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:25.019729 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9cd32c02-db02-4ae3-a8c4-53bc7289299c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.156301 Feb 19 21:35:25.020295 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2952/5816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:24 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:26.037218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c8d4c189-c30d-47fe-9ed8-d612cad3cd1a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:26.037861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c8d4c189-c30d-47fe-9ed8-d612cad3cd1a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:26.045255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8d4c189-c30d-47fe-9ed8-d612cad3cd1a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:26.045713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8d4c189-c30d-47fe-9ed8-d612cad3cd1a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:26.046494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8d4c189-c30d-47fe-9ed8-d612cad3cd1a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:26.046945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c8d4c189-c30d-47fe-9ed8-d612cad3cd1a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:26.181667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c8d4c189-c30d-47fe-9ed8-d612cad3cd1a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:26.189427 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c8d4c189-c30d-47fe-9ed8-d612cad3cd1a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.155881 Feb 19 21:35:26.190024 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2865/5817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:26 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:27.206381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-94e71be8-891e-429c-8ded-c77168d6d721 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:27.207007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-94e71be8-891e-429c-8ded-c77168d6d721 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:27.213813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94e71be8-891e-429c-8ded-c77168d6d721 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:27.214280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94e71be8-891e-429c-8ded-c77168d6d721 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:27.215074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94e71be8-891e-429c-8ded-c77168d6d721 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:27.215543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-94e71be8-891e-429c-8ded-c77168d6d721 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:27.355618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-94e71be8-891e-429c-8ded-c77168d6d721 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:27.363263 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-94e71be8-891e-429c-8ded-c77168d6d721 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.160551 Feb 19 21:35:27.363866 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2953/5818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:27 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:28.380753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1f981b6-5875-4acf-9b75-4575e388823a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:28.381374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1f981b6-5875-4acf-9b75-4575e388823a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:28.388908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1f981b6-5875-4acf-9b75-4575e388823a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:28.389372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1f981b6-5875-4acf-9b75-4575e388823a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:28.390164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1f981b6-5875-4acf-9b75-4575e388823a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:28.390612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1f981b6-5875-4acf-9b75-4575e388823a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:28.521935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e1f981b6-5875-4acf-9b75-4575e388823a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:28.529344 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1f981b6-5875-4acf-9b75-4575e388823a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.152295 Feb 19 21:35:28.529920 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2866/5819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:28 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:29.546057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dc9af305-ccdb-4260-8ef9-b41b8e7e208c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:29.546687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dc9af305-ccdb-4260-8ef9-b41b8e7e208c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:29.553507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc9af305-ccdb-4260-8ef9-b41b8e7e208c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:29.553977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc9af305-ccdb-4260-8ef9-b41b8e7e208c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:29.554767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc9af305-ccdb-4260-8ef9-b41b8e7e208c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:29.555219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dc9af305-ccdb-4260-8ef9-b41b8e7e208c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:29.690594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dc9af305-ccdb-4260-8ef9-b41b8e7e208c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:29.698922 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dc9af305-ccdb-4260-8ef9-b41b8e7e208c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.156523 Feb 19 21:35:29.699487 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2954/5820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:29 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:30.714841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad3bc82d-44ab-479a-9fa9-0a05f0dc6aff tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:30.715481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ad3bc82d-44ab-479a-9fa9-0a05f0dc6aff tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:30.722406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad3bc82d-44ab-479a-9fa9-0a05f0dc6aff tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:30.722855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad3bc82d-44ab-479a-9fa9-0a05f0dc6aff tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:30.723629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad3bc82d-44ab-479a-9fa9-0a05f0dc6aff tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:30.724066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad3bc82d-44ab-479a-9fa9-0a05f0dc6aff tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:30.858093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ad3bc82d-44ab-479a-9fa9-0a05f0dc6aff tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:30.865787 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad3bc82d-44ab-479a-9fa9-0a05f0dc6aff tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1523 microversion: 2.1 time: 0.154709 Feb 19 21:35:30.866366 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2867/5821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:30 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:31.883215 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1436ba91-edea-4eb8-87a4-d750d1a04f9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:31.884450 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1436ba91-edea-4eb8-87a4-d750d1a04f9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:31.891221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1436ba91-edea-4eb8-87a4-d750d1a04f9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:31.891688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1436ba91-edea-4eb8-87a4-d750d1a04f9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:31.892523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1436ba91-edea-4eb8-87a4-d750d1a04f9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:31.892982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1436ba91-edea-4eb8-87a4-d750d1a04f9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:32.117810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-22603883-b2de-460c-b76c-63ea9825c379 req-da6dc345-d910-4419-a2d5-aa1713983ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5219b9-b43c-4a44-8422-6a60157b2b4e", "name": "network-vif-unplugged", "status": "completed", "tag": "e8b1811d-ffc4-480b-902b-9df5045ba896"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:32.120251 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:35:32.120251 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:35:32.120880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1436ba91-edea-4eb8-87a4-d750d1a04f9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:32.128496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-22603883-b2de-460c-b76c-63ea9825c379 req-da6dc345-d910-4419-a2d5-aa1713983ded service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:32.128983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-22603883-b2de-460c-b76c-63ea9825c379 req-da6dc345-d910-4419-a2d5-aa1713983ded service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:32.130887 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1436ba91-edea-4eb8-87a4-d750d1a04f9b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1522 microversion: 2.1 time: 0.251190 Feb 19 21:35:32.131800 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2955/5822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:31 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:32.151371 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-22603883-b2de-460c-b76c-63ea9825c379 req-da6dc345-d910-4419-a2d5-aa1713983ded service nova] Creating event network-vif-unplugged:e8b1811d-ffc4-480b-902b-9df5045ba896 for instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e on nch1-master-1 Feb 19 21:35:32.156917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-22603883-b2de-460c-b76c-63ea9825c379 req-da6dc345-d910-4419-a2d5-aa1713983ded service nova] Instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:35:32.170925 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-22603883-b2de-460c-b76c-63ea9825c379 req-da6dc345-d910-4419-a2d5-aa1713983ded service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056865 Feb 19 21:35:32.171698 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2868/5823] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:35:33.148922 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1cb5b9e4-87e8-4784-a851-37929b669f8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:33.150083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1cb5b9e4-87e8-4784-a851-37929b669f8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:33.156751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cb5b9e4-87e8-4784-a851-37929b669f8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:33.157319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cb5b9e4-87e8-4784-a851-37929b669f8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:33.158118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cb5b9e4-87e8-4784-a851-37929b669f8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:33.158601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1cb5b9e4-87e8-4784-a851-37929b669f8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:33.298866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1cb5b9e4-87e8-4784-a851-37929b669f8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:33.306193 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1cb5b9e4-87e8-4784-a851-37929b669f8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1520 microversion: 2.1 time: 0.161088 Feb 19 21:35:33.306766 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2956/5824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:33 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:34.188712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4cad403a-7acb-47c0-aac0-62d9bdd76914 req-be2ef3fa-69e4-4fb5-aecd-2578d605b7da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5219b9-b43c-4a44-8422-6a60157b2b4e", "tag": "e8b1811d-ffc4-480b-902b-9df5045ba896"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:34.190203 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:35:34.190203 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:35:34.197456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4cad403a-7acb-47c0-aac0-62d9bdd76914 req-be2ef3fa-69e4-4fb5-aecd-2578d605b7da service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:34.198166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4cad403a-7acb-47c0-aac0-62d9bdd76914 req-be2ef3fa-69e4-4fb5-aecd-2578d605b7da service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:34.209414 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4cad403a-7acb-47c0-aac0-62d9bdd76914 req-be2ef3fa-69e4-4fb5-aecd-2578d605b7da service nova] Creating event network-changed:e8b1811d-ffc4-480b-902b-9df5045ba896 for instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e on nch1-master-1 Feb 19 21:35:34.215101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-4cad403a-7acb-47c0-aac0-62d9bdd76914 req-be2ef3fa-69e4-4fb5-aecd-2578d605b7da service nova] Instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:35:34.225976 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4cad403a-7acb-47c0-aac0-62d9bdd76914 req-be2ef3fa-69e4-4fb5-aecd-2578d605b7da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042204 Feb 19 21:35:34.226555 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2869/5825] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:35:34.323886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-248c61be-0b77-4a53-a55b-6942ff63de21 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:34.324563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-248c61be-0b77-4a53-a55b-6942ff63de21 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:34.331433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-248c61be-0b77-4a53-a55b-6942ff63de21 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:34.332123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-248c61be-0b77-4a53-a55b-6942ff63de21 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:34.333184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-248c61be-0b77-4a53-a55b-6942ff63de21 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:34.333597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-248c61be-0b77-4a53-a55b-6942ff63de21 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:34.742776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-248c61be-0b77-4a53-a55b-6942ff63de21 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:34.751289 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-248c61be-0b77-4a53-a55b-6942ff63de21 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1517 microversion: 2.1 time: 0.431916 Feb 19 21:35:34.756592 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2957/5826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:34 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1517 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:34.770486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca47c690-7d6d-4675-a140-28f1b386bdc5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:34.771275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ca47c690-7d6d-4675-a140-28f1b386bdc5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:34.780238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca47c690-7d6d-4675-a140-28f1b386bdc5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:34.780863 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca47c690-7d6d-4675-a140-28f1b386bdc5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:34.781854 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca47c690-7d6d-4675-a140-28f1b386bdc5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:34.782548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca47c690-7d6d-4675-a140-28f1b386bdc5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:34.844499 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ca47c690-7d6d-4675-a140-28f1b386bdc5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "POST /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e/action" status: 204 len: 0 microversion: 2.1 time: 0.079154 Feb 19 21:35:34.845401 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2870/5827] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:35:34 2022] POST /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:35:34.854501 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bc7e9f23-2002-4a40-9cd6-95820db6f2bb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:34.855541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bc7e9f23-2002-4a40-9cd6-95820db6f2bb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:34.862524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc7e9f23-2002-4a40-9cd6-95820db6f2bb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:34.863289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc7e9f23-2002-4a40-9cd6-95820db6f2bb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:34.864243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc7e9f23-2002-4a40-9cd6-95820db6f2bb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:34.865104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc7e9f23-2002-4a40-9cd6-95820db6f2bb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:35.186444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bc7e9f23-2002-4a40-9cd6-95820db6f2bb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:35.194235 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bc7e9f23-2002-4a40-9cd6-95820db6f2bb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1517 microversion: 2.1 time: 0.344609 Feb 19 21:35:35.194910 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2958/5828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:34 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1517 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:35:36.212469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2487af85-d141-490a-9a3f-94c13d0cdbbc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:36.213205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2487af85-d141-490a-9a3f-94c13d0cdbbc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:36.219951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2487af85-d141-490a-9a3f-94c13d0cdbbc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:36.220434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2487af85-d141-490a-9a3f-94c13d0cdbbc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:36.221245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2487af85-d141-490a-9a3f-94c13d0cdbbc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:36.221757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2487af85-d141-490a-9a3f-94c13d0cdbbc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:36.359408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2487af85-d141-490a-9a3f-94c13d0cdbbc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:36.366807 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2487af85-d141-490a-9a3f-94c13d0cdbbc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1509 microversion: 2.1 time: 0.158728 Feb 19 21:35:36.367387 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2871/5829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:36 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:36.383707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7a47466-9ca9-4476-8796-92a3975c3937 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:36.384358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f7a47466-9ca9-4476-8796-92a3975c3937 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:36.391043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7a47466-9ca9-4476-8796-92a3975c3937 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:36.391517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7a47466-9ca9-4476-8796-92a3975c3937 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:36.392321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7a47466-9ca9-4476-8796-92a3975c3937 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:36.392807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7a47466-9ca9-4476-8796-92a3975c3937 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:36.531423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7a47466-9ca9-4476-8796-92a3975c3937 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:36.538819 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7a47466-9ca9-4476-8796-92a3975c3937 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1509 microversion: 2.1 time: 0.158823 Feb 19 21:35:36.539390 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2959/5830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:36 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:36.554718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce574d19-92dd-4338-835c-628b8515113d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:36.555340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ce574d19-92dd-4338-835c-628b8515113d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:36.561318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce574d19-92dd-4338-835c-628b8515113d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:36.561779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce574d19-92dd-4338-835c-628b8515113d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:36.562568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce574d19-92dd-4338-835c-628b8515113d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:36.563014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce574d19-92dd-4338-835c-628b8515113d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:36.705653 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ce574d19-92dd-4338-835c-628b8515113d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:36.716541 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ce574d19-92dd-4338-835c-628b8515113d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 200 len: 1509 microversion: 2.1 time: 0.162602 Feb 19 21:35:36.716541 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2872/5831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:36 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:36.730324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-036b5680-9149-47be-91d2-74ea5bfd0c5c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:36.730843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-036b5680-9149-47be-91d2-74ea5bfd0c5c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:36.736966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-036b5680-9149-47be-91d2-74ea5bfd0c5c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:36.737439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-036b5680-9149-47be-91d2-74ea5bfd0c5c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:36.738250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-036b5680-9149-47be-91d2-74ea5bfd0c5c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:36.738896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-036b5680-9149-47be-91d2-74ea5bfd0c5c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:36.760048 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-84bc254d-c35b-4f82-8ad0-2b64cd2cf35c req-6e44741a-60a1-4901-a512-0270e2403194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5219b9-b43c-4a44-8422-6a60157b2b4e", "name": "network-vif-plugged", "status": "completed", "tag": "e8b1811d-ffc4-480b-902b-9df5045ba896"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:36.761931 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:35:36.761931 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:35:36.767836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-036b5680-9149-47be-91d2-74ea5bfd0c5c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:35:36.772368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-84bc254d-c35b-4f82-8ad0-2b64cd2cf35c req-6e44741a-60a1-4901-a512-0270e2403194 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:36.772796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-84bc254d-c35b-4f82-8ad0-2b64cd2cf35c req-6e44741a-60a1-4901-a512-0270e2403194 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:36.785731 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-84bc254d-c35b-4f82-8ad0-2b64cd2cf35c req-6e44741a-60a1-4901-a512-0270e2403194 service nova] Creating event network-vif-plugged:e8b1811d-ffc4-480b-902b-9df5045ba896 for instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e on nch1-master-1 Feb 19 21:35:36.790917 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-84bc254d-c35b-4f82-8ad0-2b64cd2cf35c req-6e44741a-60a1-4901-a512-0270e2403194 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038063 Feb 19 21:35:36.791957 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2873/5832] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:35:36.851755 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-036b5680-9149-47be-91d2-74ea5bfd0c5c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 204 len: 0 microversion: 2.1 time: 0.125725 Feb 19 21:35:36.853071 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2960/5833] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:35:36 2022] DELETE /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:35:36.908861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-986291631", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "8a8d6a03-fa02-431b-a0af-4411327a65d3"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:36.957994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] validate_networks() for [('8a8d6a03-fa02-431b-a0af-4411327a65d3', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:35:37.325715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:35:37.326288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:35:37.326611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:35:37.327024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:35:37.327438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:35:37.336282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:37.336808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:37.337636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:37.338082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:37.354678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Getting quotas for project 6d4e54e969224337acfc6a178ca33422. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:35:37.359782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Getting quotas for user dcbdf20935dc41a79864b7520ebc72cb and project 6d4e54e969224337acfc6a178ca33422. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:35:37.372310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:35:37.374790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:35:37.418988 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bc4138f8-3add-42af-adff-69068568b09c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514094 Feb 19 21:35:37.419578 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2874/5834] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:35:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:35:37.430346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2e3540bd-ee29-4f18-8e56-f79d19cd5eb3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:37.431622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2e3540bd-ee29-4f18-8e56-f79d19cd5eb3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:37.491781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2e3540bd-ee29-4f18-8e56-f79d19cd5eb3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:37.499628 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2e3540bd-ee29-4f18-8e56-f79d19cd5eb3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1217 microversion: 2.1 time: 0.073350 Feb 19 21:35:37.500200 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2961/5835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:37 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:38.518371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-21dbc900-ff9f-44be-baaa-1e6d8a9e4a28 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:38.518996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-21dbc900-ff9f-44be-baaa-1e6d8a9e4a28 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:38.526304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-21dbc900-ff9f-44be-baaa-1e6d8a9e4a28 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:38.526766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-21dbc900-ff9f-44be-baaa-1e6d8a9e4a28 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:38.527567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-21dbc900-ff9f-44be-baaa-1e6d8a9e4a28 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:38.528014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-21dbc900-ff9f-44be-baaa-1e6d8a9e4a28 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:38.599516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-21dbc900-ff9f-44be-baaa-1e6d8a9e4a28 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:38.608772 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-21dbc900-ff9f-44be-baaa-1e6d8a9e4a28 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1275 microversion: 2.1 time: 0.094931 Feb 19 21:35:38.609371 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2875/5836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:38 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:38.720741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-84eea8c7-68be-4e2c-a582-456f4cec22c7 req-416c0157-fa1c-4953-9061-254d3b0c3893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5219b9-b43c-4a44-8422-6a60157b2b4e", "name": "network-vif-deleted", "tag": "e8b1811d-ffc4-480b-902b-9df5045ba896"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:38.722897 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:35:38.722897 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:35:38.739343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-84eea8c7-68be-4e2c-a582-456f4cec22c7 req-416c0157-fa1c-4953-9061-254d3b0c3893 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:38.739800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-84eea8c7-68be-4e2c-a582-456f4cec22c7 req-416c0157-fa1c-4953-9061-254d3b0c3893 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:38.753397 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-84eea8c7-68be-4e2c-a582-456f4cec22c7 req-416c0157-fa1c-4953-9061-254d3b0c3893 service nova] Creating event network-vif-deleted:e8b1811d-ffc4-480b-902b-9df5045ba896 for instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e on nch1-master-1 Feb 19 21:35:38.760374 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-84eea8c7-68be-4e2c-a582-456f4cec22c7 req-416c0157-fa1c-4953-9061-254d3b0c3893 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044680 Feb 19 21:35:38.761145 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2962/5837] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:35:39.626434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6e14d01f-af14-43bb-a4f2-2d593c52ab40 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:39.627186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6e14d01f-af14-43bb-a4f2-2d593c52ab40 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:39.633675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e14d01f-af14-43bb-a4f2-2d593c52ab40 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:39.634173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e14d01f-af14-43bb-a4f2-2d593c52ab40 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:39.634985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e14d01f-af14-43bb-a4f2-2d593c52ab40 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:39.635438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e14d01f-af14-43bb-a4f2-2d593c52ab40 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:39.654952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-af040ee5-fd22-4ec6-8d5e-e3268c2d8179 req-63bce0f1-cfea-4324-9cd6-92ec7d70e2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e783e9-ecdf-4695-917f-402632ffb0f8", "tag": "fc322404-c72f-4aaf-9917-1f0605d920a4"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:39.657112 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:35:39.657112 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:35:39.669518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-af040ee5-fd22-4ec6-8d5e-e3268c2d8179 req-63bce0f1-cfea-4324-9cd6-92ec7d70e2c1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:39.670007 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-af040ee5-fd22-4ec6-8d5e-e3268c2d8179 req-63bce0f1-cfea-4324-9cd6-92ec7d70e2c1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:39.683663 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-af040ee5-fd22-4ec6-8d5e-e3268c2d8179 req-63bce0f1-cfea-4324-9cd6-92ec7d70e2c1 service nova] Creating event network-changed:fc322404-c72f-4aaf-9917-1f0605d920a4 for instance 38e783e9-ecdf-4695-917f-402632ffb0f8 on nch1-master-1 Feb 19 21:35:39.688404 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-af040ee5-fd22-4ec6-8d5e-e3268c2d8179 req-63bce0f1-cfea-4324-9cd6-92ec7d70e2c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037823 Feb 19 21:35:39.689183 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2963/5838] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:35:39.793515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6e14d01f-af14-43bb-a4f2-2d593c52ab40 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:39.801452 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6e14d01f-af14-43bb-a4f2-2d593c52ab40 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1317 microversion: 2.1 time: 0.179083 Feb 19 21:35:39.802394 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2876/5839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:39 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:40.819985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5aa7f2a2-de41-472a-81b6-8cdf948f967c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:40.820685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5aa7f2a2-de41-472a-81b6-8cdf948f967c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:40.827247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5aa7f2a2-de41-472a-81b6-8cdf948f967c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:40.827718 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5aa7f2a2-de41-472a-81b6-8cdf948f967c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:40.828562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5aa7f2a2-de41-472a-81b6-8cdf948f967c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:40.829021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5aa7f2a2-de41-472a-81b6-8cdf948f967c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:40.967423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5aa7f2a2-de41-472a-81b6-8cdf948f967c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:40.974729 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5aa7f2a2-de41-472a-81b6-8cdf948f967c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1317 microversion: 2.1 time: 0.159782 Feb 19 21:35:40.975308 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2964/5840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:40 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:41.992003 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-af55c667-9677-4b2c-9683-88d7d6d2be2f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:41.992570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-af55c667-9677-4b2c-9683-88d7d6d2be2f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:41.999967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af55c667-9677-4b2c-9683-88d7d6d2be2f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:42.000451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af55c667-9677-4b2c-9683-88d7d6d2be2f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:42.001229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af55c667-9677-4b2c-9683-88d7d6d2be2f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:42.001667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af55c667-9677-4b2c-9683-88d7d6d2be2f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:42.132304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-af55c667-9677-4b2c-9683-88d7d6d2be2f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:42.139808 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-af55c667-9677-4b2c-9683-88d7d6d2be2f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1317 microversion: 2.1 time: 0.151593 Feb 19 21:35:42.140428 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2877/5841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:41 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:43.156645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c8a7cd3-c626-466f-8cf5-34c1555a26ed tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:43.157223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c8a7cd3-c626-466f-8cf5-34c1555a26ed tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:43.163838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cd3-c626-466f-8cf5-34c1555a26ed tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:43.164303 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cd3-c626-466f-8cf5-34c1555a26ed tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:43.165174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cd3-c626-466f-8cf5-34c1555a26ed tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:43.165601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c8a7cd3-c626-466f-8cf5-34c1555a26ed tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:43.299960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8c8a7cd3-c626-466f-8cf5-34c1555a26ed tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:43.307802 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c8a7cd3-c626-466f-8cf5-34c1555a26ed tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1317 microversion: 2.1 time: 0.155052 Feb 19 21:35:43.308438 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2965/5842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:43 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:44.325290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-18f30aff-e20e-47d8-9d60-41d21c17f3ef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:44.325909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-18f30aff-e20e-47d8-9d60-41d21c17f3ef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:44.332687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18f30aff-e20e-47d8-9d60-41d21c17f3ef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:44.333146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18f30aff-e20e-47d8-9d60-41d21c17f3ef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:44.333933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18f30aff-e20e-47d8-9d60-41d21c17f3ef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:44.334376 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-18f30aff-e20e-47d8-9d60-41d21c17f3ef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:44.465922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-18f30aff-e20e-47d8-9d60-41d21c17f3ef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:44.473245 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-18f30aff-e20e-47d8-9d60-41d21c17f3ef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1317 microversion: 2.1 time: 0.152554 Feb 19 21:35:44.473849 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2878/5843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:44 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:44.764035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-4337d7da-77c0-4535-8c44-038919be1c42 req-00ca50d8-a42c-4dcb-92be-ba1daa1a3658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e783e9-ecdf-4695-917f-402632ffb0f8", "name": "network-vif-plugged", "status": "completed", "tag": "fc322404-c72f-4aaf-9917-1f0605d920a4"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:44.765690 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:35:44.765690 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:35:44.773983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4337d7da-77c0-4535-8c44-038919be1c42 req-00ca50d8-a42c-4dcb-92be-ba1daa1a3658 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:44.774471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-4337d7da-77c0-4535-8c44-038919be1c42 req-00ca50d8-a42c-4dcb-92be-ba1daa1a3658 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:44.785957 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-4337d7da-77c0-4535-8c44-038919be1c42 req-00ca50d8-a42c-4dcb-92be-ba1daa1a3658 service nova] Creating event network-vif-plugged:fc322404-c72f-4aaf-9917-1f0605d920a4 for instance 38e783e9-ecdf-4695-917f-402632ffb0f8 on nch1-master-1 Feb 19 21:35:44.791346 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-4337d7da-77c0-4535-8c44-038919be1c42 req-00ca50d8-a42c-4dcb-92be-ba1daa1a3658 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030946 Feb 19 21:35:44.792066 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2966/5844] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:35:45.490189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e73fcee9-7495-4f48-b5bf-95b269ec6e8f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:45.490804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e73fcee9-7495-4f48-b5bf-95b269ec6e8f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:45.497595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e73fcee9-7495-4f48-b5bf-95b269ec6e8f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:45.498072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e73fcee9-7495-4f48-b5bf-95b269ec6e8f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:45.498849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e73fcee9-7495-4f48-b5bf-95b269ec6e8f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:45.499284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e73fcee9-7495-4f48-b5bf-95b269ec6e8f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:45.637818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e73fcee9-7495-4f48-b5bf-95b269ec6e8f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:45.645133 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e73fcee9-7495-4f48-b5bf-95b269ec6e8f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1317 microversion: 2.1 time: 0.158644 Feb 19 21:35:45.645708 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2879/5845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:45 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:46.663947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2e53eb0f-154d-4128-b7c9-9e75a50409d7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:46.665212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2e53eb0f-154d-4128-b7c9-9e75a50409d7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:46.671377 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e53eb0f-154d-4128-b7c9-9e75a50409d7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:46.671843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e53eb0f-154d-4128-b7c9-9e75a50409d7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:46.672675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e53eb0f-154d-4128-b7c9-9e75a50409d7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:46.673132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2e53eb0f-154d-4128-b7c9-9e75a50409d7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:46.808153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2e53eb0f-154d-4128-b7c9-9e75a50409d7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:46.815527 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2e53eb0f-154d-4128-b7c9-9e75a50409d7 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1507 microversion: 2.1 time: 0.156570 Feb 19 21:35:46.816097 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2967/5846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:46 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:46.831809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f7558448-a0f5-48b6-92ab-0646864bec0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:46.832481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f7558448-a0f5-48b6-92ab-0646864bec0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:46.839475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7558448-a0f5-48b6-92ab-0646864bec0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:46.839927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7558448-a0f5-48b6-92ab-0646864bec0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:46.840906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7558448-a0f5-48b6-92ab-0646864bec0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:46.841346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7558448-a0f5-48b6-92ab-0646864bec0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:46.972172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f7558448-a0f5-48b6-92ab-0646864bec0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:46.980066 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f7558448-a0f5-48b6-92ab-0646864bec0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1507 microversion: 2.1 time: 0.151892 Feb 19 21:35:46.980696 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2880/5847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:46 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:46.995685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:35:46.996709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:47.002563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:47.003032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:47.003822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:47.004275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:47.031387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:47.036970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Old instance type m1.heat2, new instance type m1.heat {{(pid=136094) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:35:47.043417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:35:47.043852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:35:47.044353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:35:47.044782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:35:47.045206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:35:47.105813 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-17a40e6d-650f-4776-915e-ad2a597691e6 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "POST /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8/action" status: 202 len: 0 microversion: 2.1 time: 0.113747 Feb 19 21:35:47.106606 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2968/5848] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:35:46 2022] POST /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:35:47.114392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aea5faf0-978c-4ede-9208-a05d6c4a9a75 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:47.115018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aea5faf0-978c-4ede-9208-a05d6c4a9a75 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:47.120878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aea5faf0-978c-4ede-9208-a05d6c4a9a75 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:47.121328 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aea5faf0-978c-4ede-9208-a05d6c4a9a75 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:47.122113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aea5faf0-978c-4ede-9208-a05d6c4a9a75 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:47.122551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aea5faf0-978c-4ede-9208-a05d6c4a9a75 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:47.264496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aea5faf0-978c-4ede-9208-a05d6c4a9a75 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:47.271986 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aea5faf0-978c-4ede-9208-a05d6c4a9a75 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1514 microversion: 2.1 time: 0.161221 Feb 19 21:35:47.272603 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2881/5849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:47 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:48.288740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4183439d-5cc4-40a1-8d24-dd64c0a6d55d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:48.289866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4183439d-5cc4-40a1-8d24-dd64c0a6d55d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:48.297153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4183439d-5cc4-40a1-8d24-dd64c0a6d55d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:48.297685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4183439d-5cc4-40a1-8d24-dd64c0a6d55d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:48.298679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4183439d-5cc4-40a1-8d24-dd64c0a6d55d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:48.299129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4183439d-5cc4-40a1-8d24-dd64c0a6d55d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:48.438278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4183439d-5cc4-40a1-8d24-dd64c0a6d55d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:48.445918 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4183439d-5cc4-40a1-8d24-dd64c0a6d55d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1514 microversion: 2.1 time: 0.160923 Feb 19 21:35:48.455566 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2969/5850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:48 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:49.462749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fb05ba7a-c43f-469c-b2f5-698cd41c6111 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:49.463398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fb05ba7a-c43f-469c-b2f5-698cd41c6111 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:49.470206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb05ba7a-c43f-469c-b2f5-698cd41c6111 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:49.470663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb05ba7a-c43f-469c-b2f5-698cd41c6111 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:49.471444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb05ba7a-c43f-469c-b2f5-698cd41c6111 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:49.471886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fb05ba7a-c43f-469c-b2f5-698cd41c6111 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:49.610224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fb05ba7a-c43f-469c-b2f5-698cd41c6111 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:49.617679 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fb05ba7a-c43f-469c-b2f5-698cd41c6111 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.158648 Feb 19 21:35:49.618256 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2882/5851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:49 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:50.634904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f2cb67d-2412-409d-94c6-3dd4e83e6942 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:50.635598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9f2cb67d-2412-409d-94c6-3dd4e83e6942 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:50.643181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f2cb67d-2412-409d-94c6-3dd4e83e6942 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:50.643654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f2cb67d-2412-409d-94c6-3dd4e83e6942 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:50.644487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f2cb67d-2412-409d-94c6-3dd4e83e6942 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:50.644947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f2cb67d-2412-409d-94c6-3dd4e83e6942 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:50.782459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9f2cb67d-2412-409d-94c6-3dd4e83e6942 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:50.789842 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f2cb67d-2412-409d-94c6-3dd4e83e6942 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.158683 Feb 19 21:35:50.790410 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2970/5852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:50 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:51.806774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2fa3683d-c13f-4e33-b8d3-4d25749d9143 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:51.807966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2fa3683d-c13f-4e33-b8d3-4d25749d9143 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:51.815145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fa3683d-c13f-4e33-b8d3-4d25749d9143 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:51.815717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fa3683d-c13f-4e33-b8d3-4d25749d9143 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:51.816539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fa3683d-c13f-4e33-b8d3-4d25749d9143 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:51.816982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fa3683d-c13f-4e33-b8d3-4d25749d9143 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:51.959016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2fa3683d-c13f-4e33-b8d3-4d25749d9143 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:51.966453 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2fa3683d-c13f-4e33-b8d3-4d25749d9143 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.163375 Feb 19 21:35:51.967026 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2883/5853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:51 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:52.983092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dd12da3b-65b8-4dac-bb74-9e739b6a2d0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:52.983677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dd12da3b-65b8-4dac-bb74-9e739b6a2d0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:52.989975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd12da3b-65b8-4dac-bb74-9e739b6a2d0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:52.990447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd12da3b-65b8-4dac-bb74-9e739b6a2d0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:52.991237 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd12da3b-65b8-4dac-bb74-9e739b6a2d0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:52.991694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dd12da3b-65b8-4dac-bb74-9e739b6a2d0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:53.123459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dd12da3b-65b8-4dac-bb74-9e739b6a2d0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:53.131088 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dd12da3b-65b8-4dac-bb74-9e739b6a2d0b tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.151996 Feb 19 21:35:53.131660 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2971/5854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:52 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:54.148621 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f79267c4-4b57-4941-8994-69abe4c10e07 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:54.149231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f79267c4-4b57-4941-8994-69abe4c10e07 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:54.156704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f79267c4-4b57-4941-8994-69abe4c10e07 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:54.157157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f79267c4-4b57-4941-8994-69abe4c10e07 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:54.157933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f79267c4-4b57-4941-8994-69abe4c10e07 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:54.158370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f79267c4-4b57-4941-8994-69abe4c10e07 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:54.293012 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f79267c4-4b57-4941-8994-69abe4c10e07 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:54.300382 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f79267c4-4b57-4941-8994-69abe4c10e07 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.155552 Feb 19 21:35:54.300967 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2884/5855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:54 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:55.317391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-afe49fe3-8cb5-4698-a908-2494bdc21acc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:55.318039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-afe49fe3-8cb5-4698-a908-2494bdc21acc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:55.325874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afe49fe3-8cb5-4698-a908-2494bdc21acc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:55.326341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afe49fe3-8cb5-4698-a908-2494bdc21acc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:55.327178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afe49fe3-8cb5-4698-a908-2494bdc21acc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:55.327636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-afe49fe3-8cb5-4698-a908-2494bdc21acc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:55.468719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-afe49fe3-8cb5-4698-a908-2494bdc21acc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:55.476016 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-afe49fe3-8cb5-4698-a908-2494bdc21acc tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.162367 Feb 19 21:35:55.476609 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2972/5856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:55 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:56.493293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-12876aef-406c-4d7e-8c1a-6bf13d458056 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:56.493927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-12876aef-406c-4d7e-8c1a-6bf13d458056 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:56.500842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12876aef-406c-4d7e-8c1a-6bf13d458056 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:56.501290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12876aef-406c-4d7e-8c1a-6bf13d458056 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:56.502069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12876aef-406c-4d7e-8c1a-6bf13d458056 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:56.502505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12876aef-406c-4d7e-8c1a-6bf13d458056 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:56.636494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-12876aef-406c-4d7e-8c1a-6bf13d458056 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:56.643779 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-12876aef-406c-4d7e-8c1a-6bf13d458056 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.154305 Feb 19 21:35:56.644374 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2885/5857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:56 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:57.659929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a58e8bb9-2a92-4986-a6ae-801b00b0c1dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:57.660608 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a58e8bb9-2a92-4986-a6ae-801b00b0c1dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:57.668017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a58e8bb9-2a92-4986-a6ae-801b00b0c1dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:57.668593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a58e8bb9-2a92-4986-a6ae-801b00b0c1dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:57.669412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a58e8bb9-2a92-4986-a6ae-801b00b0c1dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:57.669869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a58e8bb9-2a92-4986-a6ae-801b00b0c1dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:57.806647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a58e8bb9-2a92-4986-a6ae-801b00b0c1dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:57.814018 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a58e8bb9-2a92-4986-a6ae-801b00b0c1dd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.158037 Feb 19 21:35:57.814596 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2973/5858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:57 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:35:58.830778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1f90a8c0-7b54-4a76-9b28-2bd99e73dda5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:35:58.831415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1f90a8c0-7b54-4a76-9b28-2bd99e73dda5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:35:58.838606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f90a8c0-7b54-4a76-9b28-2bd99e73dda5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:58.839061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f90a8c0-7b54-4a76-9b28-2bd99e73dda5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:58.839853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f90a8c0-7b54-4a76-9b28-2bd99e73dda5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:35:58.840370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1f90a8c0-7b54-4a76-9b28-2bd99e73dda5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:35:58.976551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1f90a8c0-7b54-4a76-9b28-2bd99e73dda5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:35:58.984176 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1f90a8c0-7b54-4a76-9b28-2bd99e73dda5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.157110 Feb 19 21:35:58.984788 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2886/5859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:58 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:00.000419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0850dd02-1c26-4978-b637-a92c8e007a11 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:00.000946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0850dd02-1c26-4978-b637-a92c8e007a11 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:00.007649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0850dd02-1c26-4978-b637-a92c8e007a11 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:00.008116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0850dd02-1c26-4978-b637-a92c8e007a11 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:00.008930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0850dd02-1c26-4978-b637-a92c8e007a11 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:00.009387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0850dd02-1c26-4978-b637-a92c8e007a11 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:00.148054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0850dd02-1c26-4978-b637-a92c8e007a11 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:00.156489 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0850dd02-1c26-4978-b637-a92c8e007a11 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.159762 Feb 19 21:36:00.157126 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2974/5860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:35:59 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:01.173831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-56ac7f9b-300c-40e2-a999-f495792e4ea3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:01.174447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-56ac7f9b-300c-40e2-a999-f495792e4ea3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:01.181392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56ac7f9b-300c-40e2-a999-f495792e4ea3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:01.181853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56ac7f9b-300c-40e2-a999-f495792e4ea3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:01.182643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56ac7f9b-300c-40e2-a999-f495792e4ea3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:01.183093 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-56ac7f9b-300c-40e2-a999-f495792e4ea3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:01.375748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-56ac7f9b-300c-40e2-a999-f495792e4ea3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:01.383083 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-56ac7f9b-300c-40e2-a999-f495792e4ea3 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.213066 Feb 19 21:36:01.383673 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2887/5861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:01 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:02.400105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-18049590-0036-49ec-85c3-71d407bc9d94 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:02.400767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-18049590-0036-49ec-85c3-71d407bc9d94 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:02.407476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-18049590-0036-49ec-85c3-71d407bc9d94 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:02.408035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-18049590-0036-49ec-85c3-71d407bc9d94 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:02.408834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-18049590-0036-49ec-85c3-71d407bc9d94 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:02.409285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-18049590-0036-49ec-85c3-71d407bc9d94 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:02.596906 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-18049590-0036-49ec-85c3-71d407bc9d94 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:02.604963 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-18049590-0036-49ec-85c3-71d407bc9d94 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.208564 Feb 19 21:36:02.605602 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2975/5862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:02 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:03.621656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-526cba10-a54c-480a-b494-b38e7cbe127f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:03.622274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-526cba10-a54c-480a-b494-b38e7cbe127f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:03.629116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-526cba10-a54c-480a-b494-b38e7cbe127f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:03.629570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-526cba10-a54c-480a-b494-b38e7cbe127f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:03.630355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-526cba10-a54c-480a-b494-b38e7cbe127f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:03.630796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-526cba10-a54c-480a-b494-b38e7cbe127f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:03.769008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-526cba10-a54c-480a-b494-b38e7cbe127f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:03.776475 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-526cba10-a54c-480a-b494-b38e7cbe127f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.158967 Feb 19 21:36:03.777124 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2888/5863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:03 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:04.794770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3ba43bbf-0326-46ff-bda5-7cee27eef02a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:04.795390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3ba43bbf-0326-46ff-bda5-7cee27eef02a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:04.802102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ba43bbf-0326-46ff-bda5-7cee27eef02a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:04.802566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ba43bbf-0326-46ff-bda5-7cee27eef02a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:04.803360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ba43bbf-0326-46ff-bda5-7cee27eef02a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:04.803809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3ba43bbf-0326-46ff-bda5-7cee27eef02a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:04.936313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3ba43bbf-0326-46ff-bda5-7cee27eef02a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:04.943698 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3ba43bbf-0326-46ff-bda5-7cee27eef02a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.152726 Feb 19 21:36:04.944270 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2976/5864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:04 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:05.961565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7621969c-a100-4719-9bff-2a5e1dfdf3c4 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:05.962130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7621969c-a100-4719-9bff-2a5e1dfdf3c4 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:05.969245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7621969c-a100-4719-9bff-2a5e1dfdf3c4 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:05.969706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7621969c-a100-4719-9bff-2a5e1dfdf3c4 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:05.970501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7621969c-a100-4719-9bff-2a5e1dfdf3c4 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:05.970949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7621969c-a100-4719-9bff-2a5e1dfdf3c4 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:06.105043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7621969c-a100-4719-9bff-2a5e1dfdf3c4 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:06.112559 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7621969c-a100-4719-9bff-2a5e1dfdf3c4 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.154932 Feb 19 21:36:06.113139 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2889/5865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:05 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:07.129353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0afc92d5-9903-4b7f-aa85-2832a3c98637 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:07.130023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0afc92d5-9903-4b7f-aa85-2832a3c98637 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:07.136657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0afc92d5-9903-4b7f-aa85-2832a3c98637 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:07.137130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0afc92d5-9903-4b7f-aa85-2832a3c98637 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:07.137932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0afc92d5-9903-4b7f-aa85-2832a3c98637 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:07.138389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0afc92d5-9903-4b7f-aa85-2832a3c98637 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:07.272485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0afc92d5-9903-4b7f-aa85-2832a3c98637 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:07.280319 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0afc92d5-9903-4b7f-aa85-2832a3c98637 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.154734 Feb 19 21:36:07.280932 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2977/5866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:07 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:08.297793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b9b4401f-a884-47f0-a795-00a837e2690f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:08.298384 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b9b4401f-a884-47f0-a795-00a837e2690f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:08.305193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9b4401f-a884-47f0-a795-00a837e2690f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:08.305649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9b4401f-a884-47f0-a795-00a837e2690f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:08.306432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9b4401f-a884-47f0-a795-00a837e2690f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:08.307427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b9b4401f-a884-47f0-a795-00a837e2690f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:08.442294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b9b4401f-a884-47f0-a795-00a837e2690f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:08.450452 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b9b4401f-a884-47f0-a795-00a837e2690f tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.156387 Feb 19 21:36:08.451025 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2890/5867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:08 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:09.467285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f6eae128-dc2b-4200-9006-b8669dca1d79 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:09.467898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f6eae128-dc2b-4200-9006-b8669dca1d79 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:09.474560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6eae128-dc2b-4200-9006-b8669dca1d79 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:09.475023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6eae128-dc2b-4200-9006-b8669dca1d79 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:09.475806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6eae128-dc2b-4200-9006-b8669dca1d79 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:09.476255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f6eae128-dc2b-4200-9006-b8669dca1d79 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:09.608649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f6eae128-dc2b-4200-9006-b8669dca1d79 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:09.616204 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f6eae128-dc2b-4200-9006-b8669dca1d79 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.153088 Feb 19 21:36:09.616801 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2978/5868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:09 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:10.633662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f7be0a9f-b2cd-4522-af9a-36e3d4d2d16a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:10.634276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f7be0a9f-b2cd-4522-af9a-36e3d4d2d16a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:10.640642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7be0a9f-b2cd-4522-af9a-36e3d4d2d16a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:10.641089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7be0a9f-b2cd-4522-af9a-36e3d4d2d16a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:10.641860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7be0a9f-b2cd-4522-af9a-36e3d4d2d16a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:10.642298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f7be0a9f-b2cd-4522-af9a-36e3d4d2d16a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:10.777567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f7be0a9f-b2cd-4522-af9a-36e3d4d2d16a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:10.786094 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f7be0a9f-b2cd-4522-af9a-36e3d4d2d16a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.156288 Feb 19 21:36:10.786682 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2891/5869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:10 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:11.803958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-283b999d-8d30-4bea-bf74-edddb43edbf2 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:11.804701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-283b999d-8d30-4bea-bf74-edddb43edbf2 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:11.812299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-283b999d-8d30-4bea-bf74-edddb43edbf2 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:11.812814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-283b999d-8d30-4bea-bf74-edddb43edbf2 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:11.813622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-283b999d-8d30-4bea-bf74-edddb43edbf2 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:11.814080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-283b999d-8d30-4bea-bf74-edddb43edbf2 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:11.950272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-283b999d-8d30-4bea-bf74-edddb43edbf2 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:11.957705 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-283b999d-8d30-4bea-bf74-edddb43edbf2 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.157541 Feb 19 21:36:11.958216 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2979/5870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:11 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:12.974486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a5cc6f75-c1f1-4c48-8abf-0ec492ffda2d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:12.975045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a5cc6f75-c1f1-4c48-8abf-0ec492ffda2d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:12.981796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5cc6f75-c1f1-4c48-8abf-0ec492ffda2d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:12.982245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5cc6f75-c1f1-4c48-8abf-0ec492ffda2d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:12.983016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5cc6f75-c1f1-4c48-8abf-0ec492ffda2d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:12.983452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a5cc6f75-c1f1-4c48-8abf-0ec492ffda2d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:13.113537 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a5cc6f75-c1f1-4c48-8abf-0ec492ffda2d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:13.121394 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a5cc6f75-c1f1-4c48-8abf-0ec492ffda2d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.150659 Feb 19 21:36:13.121977 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2892/5871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:12 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:14.138187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab3b84ab-8256-4eb6-9861-690c723780eb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:14.138817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ab3b84ab-8256-4eb6-9861-690c723780eb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:14.145615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3b84ab-8256-4eb6-9861-690c723780eb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:14.146082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3b84ab-8256-4eb6-9861-690c723780eb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:14.146879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3b84ab-8256-4eb6-9861-690c723780eb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:14.147331 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab3b84ab-8256-4eb6-9861-690c723780eb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:14.608209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ab3b84ab-8256-4eb6-9861-690c723780eb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:14.615506 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab3b84ab-8256-4eb6-9861-690c723780eb tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.481085 Feb 19 21:36:14.616079 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2980/5872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:14 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:15.633116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c5f5749b-04bf-49aa-acf6-7e0376778e8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:15.633763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c5f5749b-04bf-49aa-acf6-7e0376778e8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:15.640586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5f5749b-04bf-49aa-acf6-7e0376778e8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:15.641050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5f5749b-04bf-49aa-acf6-7e0376778e8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:15.641850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5f5749b-04bf-49aa-acf6-7e0376778e8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:15.642295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c5f5749b-04bf-49aa-acf6-7e0376778e8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:15.789568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c5f5749b-04bf-49aa-acf6-7e0376778e8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:15.797916 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c5f5749b-04bf-49aa-acf6-7e0376778e8e tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1519 microversion: 2.1 time: 0.168551 Feb 19 21:36:15.798500 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2893/5873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:15 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:16.191937 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7cb9b9e2-fad7-4246-b931-1dc440539c17 req-ad004ed7-5e39-4b81-a1f4-75f68d834050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e783e9-ecdf-4695-917f-402632ffb0f8", "name": "network-vif-unplugged", "status": "completed", "tag": "fc322404-c72f-4aaf-9917-1f0605d920a4"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:16.193378 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:36:16.193378 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:36:16.201732 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7cb9b9e2-fad7-4246-b931-1dc440539c17 req-ad004ed7-5e39-4b81-a1f4-75f68d834050 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:16.202168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7cb9b9e2-fad7-4246-b931-1dc440539c17 req-ad004ed7-5e39-4b81-a1f4-75f68d834050 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:16.213820 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7cb9b9e2-fad7-4246-b931-1dc440539c17 req-ad004ed7-5e39-4b81-a1f4-75f68d834050 service nova] Creating event network-vif-unplugged:fc322404-c72f-4aaf-9917-1f0605d920a4 for instance 38e783e9-ecdf-4695-917f-402632ffb0f8 on nch2-master-1 Feb 19 21:36:16.219276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-7cb9b9e2-fad7-4246-b931-1dc440539c17 req-ad004ed7-5e39-4b81-a1f4-75f68d834050 service nova] Instance 38e783e9-ecdf-4695-917f-402632ffb0f8 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:36:16.230096 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7cb9b9e2-fad7-4246-b931-1dc440539c17 req-ad004ed7-5e39-4b81-a1f4-75f68d834050 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041805 Feb 19 21:36:16.230707 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2981/5874] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:36:16.816595 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6e457fe4-8d2d-4747-9aa2-367cbc516bef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:16.817212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6e457fe4-8d2d-4747-9aa2-367cbc516bef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:16.825843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e457fe4-8d2d-4747-9aa2-367cbc516bef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:16.826561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e457fe4-8d2d-4747-9aa2-367cbc516bef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:16.827723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e457fe4-8d2d-4747-9aa2-367cbc516bef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:16.827723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e457fe4-8d2d-4747-9aa2-367cbc516bef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:17.006157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6e457fe4-8d2d-4747-9aa2-367cbc516bef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:17.013690 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6e457fe4-8d2d-4747-9aa2-367cbc516bef tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1518 microversion: 2.1 time: 0.202439 Feb 19 21:36:17.014492 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2894/5875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:16 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1518 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:18.032235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ae5a976e-e8f8-4c8c-9dc3-9d17ed7e5695 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:18.033001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae5a976e-e8f8-4c8c-9dc3-9d17ed7e5695 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:18.039130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae5a976e-e8f8-4c8c-9dc3-9d17ed7e5695 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:18.039594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae5a976e-e8f8-4c8c-9dc3-9d17ed7e5695 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:18.040403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae5a976e-e8f8-4c8c-9dc3-9d17ed7e5695 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:18.040859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae5a976e-e8f8-4c8c-9dc3-9d17ed7e5695 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:18.175595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ae5a976e-e8f8-4c8c-9dc3-9d17ed7e5695 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:18.183543 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ae5a976e-e8f8-4c8c-9dc3-9d17ed7e5695 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1516 microversion: 2.1 time: 0.156264 Feb 19 21:36:18.184111 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2982/5876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:18 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:18.249091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8e585ee2-8756-4940-8727-e2e1e613f367 req-a86fb984-915d-4013-9fab-1f56a71938be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e783e9-ecdf-4695-917f-402632ffb0f8", "tag": "fc322404-c72f-4aaf-9917-1f0605d920a4"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:18.250712 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:36:18.250712 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:36:18.258446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8e585ee2-8756-4940-8727-e2e1e613f367 req-a86fb984-915d-4013-9fab-1f56a71938be service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:18.258893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8e585ee2-8756-4940-8727-e2e1e613f367 req-a86fb984-915d-4013-9fab-1f56a71938be service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:18.269983 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8e585ee2-8756-4940-8727-e2e1e613f367 req-a86fb984-915d-4013-9fab-1f56a71938be service nova] Creating event network-changed:fc322404-c72f-4aaf-9917-1f0605d920a4 for instance 38e783e9-ecdf-4695-917f-402632ffb0f8 on nch2-master-1 Feb 19 21:36:18.275127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-8e585ee2-8756-4940-8727-e2e1e613f367 req-a86fb984-915d-4013-9fab-1f56a71938be service nova] Instance 38e783e9-ecdf-4695-917f-402632ffb0f8 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:36:18.286527 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8e585ee2-8756-4940-8727-e2e1e613f367 req-a86fb984-915d-4013-9fab-1f56a71938be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041752 Feb 19 21:36:18.287104 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2895/5877] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:36:19.200775 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-35a7a4d3-16cf-464a-a9e7-0c730f395a6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:19.201401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-35a7a4d3-16cf-464a-a9e7-0c730f395a6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:19.208143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35a7a4d3-16cf-464a-a9e7-0c730f395a6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:19.208642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35a7a4d3-16cf-464a-a9e7-0c730f395a6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:19.209448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35a7a4d3-16cf-464a-a9e7-0c730f395a6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:19.209904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-35a7a4d3-16cf-464a-a9e7-0c730f395a6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:19.344447 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-35a7a4d3-16cf-464a-a9e7-0c730f395a6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:19.351913 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-35a7a4d3-16cf-464a-a9e7-0c730f395a6c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1516 microversion: 2.1 time: 0.155817 Feb 19 21:36:19.352511 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2983/5878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:19 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:20.369951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7c6c6111-578f-4cb4-a507-1198076fc0c9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:20.370822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7c6c6111-578f-4cb4-a507-1198076fc0c9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:20.377035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c6c6111-578f-4cb4-a507-1198076fc0c9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:20.377491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c6c6111-578f-4cb4-a507-1198076fc0c9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:20.378278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c6c6111-578f-4cb4-a507-1198076fc0c9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:20.378721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7c6c6111-578f-4cb4-a507-1198076fc0c9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:20.517336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7c6c6111-578f-4cb4-a507-1198076fc0c9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:20.524764 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7c6c6111-578f-4cb4-a507-1198076fc0c9 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1513 microversion: 2.1 time: 0.159693 Feb 19 21:36:20.525339 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2896/5879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:20 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:20.541360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d0bbf360-a4e9-489b-a763-6d46246fbc02 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:20.541975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d0bbf360-a4e9-489b-a763-6d46246fbc02 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:20.548703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0bbf360-a4e9-489b-a763-6d46246fbc02 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:20.549176 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0bbf360-a4e9-489b-a763-6d46246fbc02 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:20.549977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0bbf360-a4e9-489b-a763-6d46246fbc02 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:20.550443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d0bbf360-a4e9-489b-a763-6d46246fbc02 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:20.609770 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d0bbf360-a4e9-489b-a763-6d46246fbc02 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "POST /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8/action" status: 204 len: 0 microversion: 2.1 time: 0.072001 Feb 19 21:36:20.611111 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2984/5880] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:36:20 2022] POST /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:36:20.625000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-87dad478-285d-4835-81b1-a98e3a0fd070 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:20.625548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-87dad478-285d-4835-81b1-a98e3a0fd070 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:20.637007 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87dad478-285d-4835-81b1-a98e3a0fd070 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:20.642017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87dad478-285d-4835-81b1-a98e3a0fd070 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:20.642883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87dad478-285d-4835-81b1-a98e3a0fd070 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:20.643344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-87dad478-285d-4835-81b1-a98e3a0fd070 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:20.781443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-87dad478-285d-4835-81b1-a98e3a0fd070 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:20.788987 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-87dad478-285d-4835-81b1-a98e3a0fd070 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1513 microversion: 2.1 time: 0.167751 Feb 19 21:36:20.789583 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2897/5881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:20 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:21.808118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9c409522-5d28-4520-87f2-bda354afaf27 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:21.809061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9c409522-5d28-4520-87f2-bda354afaf27 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:21.817279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c409522-5d28-4520-87f2-bda354afaf27 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:21.817825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c409522-5d28-4520-87f2-bda354afaf27 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:21.818767 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c409522-5d28-4520-87f2-bda354afaf27 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:21.819287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9c409522-5d28-4520-87f2-bda354afaf27 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:21.960646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9c409522-5d28-4520-87f2-bda354afaf27 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:21.968712 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9c409522-5d28-4520-87f2-bda354afaf27 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1505 microversion: 2.1 time: 0.166366 Feb 19 21:36:21.969282 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2985/5882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:21 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:21.984296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cdb9f918-74a2-46ee-9440-8b9752d305cd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:21.984930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cdb9f918-74a2-46ee-9440-8b9752d305cd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:21.991660 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdb9f918-74a2-46ee-9440-8b9752d305cd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:21.992109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdb9f918-74a2-46ee-9440-8b9752d305cd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:21.992907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdb9f918-74a2-46ee-9440-8b9752d305cd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:21.993340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cdb9f918-74a2-46ee-9440-8b9752d305cd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:22.127659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cdb9f918-74a2-46ee-9440-8b9752d305cd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:22.135091 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cdb9f918-74a2-46ee-9440-8b9752d305cd tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1505 microversion: 2.1 time: 0.154370 Feb 19 21:36:22.136485 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2898/5883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:21 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:22.151297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0404bf1c-2177-45ea-85e7-761647c78df5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:22.151919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0404bf1c-2177-45ea-85e7-761647c78df5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:22.157723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0404bf1c-2177-45ea-85e7-761647c78df5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:22.158186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0404bf1c-2177-45ea-85e7-761647c78df5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:22.158970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0404bf1c-2177-45ea-85e7-761647c78df5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:22.159415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0404bf1c-2177-45ea-85e7-761647c78df5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:22.296256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0404bf1c-2177-45ea-85e7-761647c78df5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:22.303592 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0404bf1c-2177-45ea-85e7-761647c78df5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1505 microversion: 2.1 time: 0.156075 Feb 19 21:36:22.304158 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2986/5884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:22 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:22.319494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-544b7b56-cc51-4167-9cc5-bb90e037f73d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:22.319996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-544b7b56-cc51-4167-9cc5-bb90e037f73d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:22.326970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-544b7b56-cc51-4167-9cc5-bb90e037f73d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:22.327427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-544b7b56-cc51-4167-9cc5-bb90e037f73d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:22.328215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-544b7b56-cc51-4167-9cc5-bb90e037f73d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:22.328688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-544b7b56-cc51-4167-9cc5-bb90e037f73d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:22.353055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-544b7b56-cc51-4167-9cc5-bb90e037f73d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:36:22.425772 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-544b7b56-cc51-4167-9cc5-bb90e037f73d tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 204 len: 0 microversion: 2.1 time: 0.109569 Feb 19 21:36:22.426525 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2899/5885] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:36:22 2022] DELETE /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:36:22.443429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-687a68d4-dcf6-44d6-b021-8e8bbf289b4c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:22.444058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-687a68d4-dcf6-44d6-b021-8e8bbf289b4c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:22.450407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-687a68d4-dcf6-44d6-b021-8e8bbf289b4c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:22.450876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-687a68d4-dcf6-44d6-b021-8e8bbf289b4c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:22.451668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-687a68d4-dcf6-44d6-b021-8e8bbf289b4c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:22.452129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-687a68d4-dcf6-44d6-b021-8e8bbf289b4c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:22.476427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-687a68d4-dcf6-44d6-b021-8e8bbf289b4c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:36:22.522511 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.compute.api [None req-687a68d4-dcf6-44d6-b021-8e8bbf289b4c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Instance is already in deleting state, ignoring this request Feb 19 21:36:22.523348 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-687a68d4-dcf6-44d6-b021-8e8bbf289b4c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 204 len: 0 microversion: 2.1 time: 0.083647 Feb 19 21:36:22.523920 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2987/5886] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:36:22 2022] DELETE /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:36:22.532412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1046a131-2a96-4a8b-8365-15f18e76080c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:22.533143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1046a131-2a96-4a8b-8365-15f18e76080c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:22.539051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1046a131-2a96-4a8b-8365-15f18e76080c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:22.539500 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1046a131-2a96-4a8b-8365-15f18e76080c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:22.540277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1046a131-2a96-4a8b-8365-15f18e76080c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:22.540738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1046a131-2a96-4a8b-8365-15f18e76080c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:22.677490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1046a131-2a96-4a8b-8365-15f18e76080c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:22.685566 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1046a131-2a96-4a8b-8365-15f18e76080c tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1511 microversion: 2.1 time: 0.157190 Feb 19 21:36:22.686154 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2900/5887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:22 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:23.390403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-121bcfe1-6ba7-4b37-a156-afb88870d83f req-620f7ad3-52bf-45c3-8f6d-49c0a80359f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e783e9-ecdf-4695-917f-402632ffb0f8", "name": "network-vif-plugged", "status": "completed", "tag": "fc322404-c72f-4aaf-9917-1f0605d920a4"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:23.391951 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:36:23.391951 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:36:23.400016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-121bcfe1-6ba7-4b37-a156-afb88870d83f req-620f7ad3-52bf-45c3-8f6d-49c0a80359f9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:23.400589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-121bcfe1-6ba7-4b37-a156-afb88870d83f req-620f7ad3-52bf-45c3-8f6d-49c0a80359f9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:23.412269 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-121bcfe1-6ba7-4b37-a156-afb88870d83f req-620f7ad3-52bf-45c3-8f6d-49c0a80359f9 service nova] Creating event network-vif-plugged:fc322404-c72f-4aaf-9917-1f0605d920a4 for instance 38e783e9-ecdf-4695-917f-402632ffb0f8 on nch2-master-1 Feb 19 21:36:23.417140 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-121bcfe1-6ba7-4b37-a156-afb88870d83f req-620f7ad3-52bf-45c3-8f6d-49c0a80359f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030366 Feb 19 21:36:23.417736 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2988/5888] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:36:23.702707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b731af7-b720-47a7-8029-2a94f54f6182 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:23.703340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b731af7-b720-47a7-8029-2a94f54f6182 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:23.710126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b731af7-b720-47a7-8029-2a94f54f6182 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:23.710569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b731af7-b720-47a7-8029-2a94f54f6182 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:23.711338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b731af7-b720-47a7-8029-2a94f54f6182 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:23.711775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b731af7-b720-47a7-8029-2a94f54f6182 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:23.852131 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9b731af7-b720-47a7-8029-2a94f54f6182 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbdf20935dc41a79864b7520ebc72cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4e54e969224337acfc6a178ca33422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:23.859774 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b731af7-b720-47a7-8029-2a94f54f6182 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 200 len: 1511 microversion: 2.1 time: 0.160836 Feb 19 21:36:23.860988 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2901/5889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:23 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:24.319965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3aa67d3c-ea71-4d18-a0b1-bb25a2a7ce78 req-8c825fad-f11f-4b4f-8694-5c11f93bbb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e783e9-ecdf-4695-917f-402632ffb0f8", "name": "network-vif-deleted", "tag": "fc322404-c72f-4aaf-9917-1f0605d920a4"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:24.321503 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:36:24.321503 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:36:24.329812 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3aa67d3c-ea71-4d18-a0b1-bb25a2a7ce78 req-8c825fad-f11f-4b4f-8694-5c11f93bbb05 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:24.330275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3aa67d3c-ea71-4d18-a0b1-bb25a2a7ce78 req-8c825fad-f11f-4b4f-8694-5c11f93bbb05 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:24.342189 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3aa67d3c-ea71-4d18-a0b1-bb25a2a7ce78 req-8c825fad-f11f-4b4f-8694-5c11f93bbb05 service nova] Creating event network-vif-deleted:fc322404-c72f-4aaf-9917-1f0605d920a4 for instance 38e783e9-ecdf-4695-917f-402632ffb0f8 on nch2-master-1 Feb 19 21:36:24.346870 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3aa67d3c-ea71-4d18-a0b1-bb25a2a7ce78 req-8c825fad-f11f-4b4f-8694-5c11f93bbb05 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031086 Feb 19 21:36:24.347465 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2989/5890] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:36:24.876864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b26ad45b-1f91-4e58-8052-fec2b7ff12b5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:24.877454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b26ad45b-1f91-4e58-8052-fec2b7ff12b5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 38e783e9-ecdf-4695-917f-402632ffb0f8] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:24.884375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b26ad45b-1f91-4e58-8052-fec2b7ff12b5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:24.884822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b26ad45b-1f91-4e58-8052-fec2b7ff12b5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:24.886091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b26ad45b-1f91-4e58-8052-fec2b7ff12b5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:24.886525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b26ad45b-1f91-4e58-8052-fec2b7ff12b5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:24.899451 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-b26ad45b-1f91-4e58-8052-fec2b7ff12b5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] HTTP exception thrown: Instance 38e783e9-ecdf-4695-917f-402632ffb0f8 could not be found. Feb 19 21:36:24.900036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b26ad45b-1f91-4e58-8052-fec2b7ff12b5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Returning 404 to user: Instance 38e783e9-ecdf-4695-917f-402632ffb0f8 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:36:24.901569 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b26ad45b-1f91-4e58-8052-fec2b7ff12b5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8" status: 404 len: 111 microversion: 2.1 time: 0.027864 Feb 19 21:36:24.902108 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2902/5891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:24 2022] GET /compute/v2.1/servers/38e783e9-ecdf-4695-917f-402632ffb0f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:36:24.912650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5ff92df7-7e2d-491d-bba7-0019bbdedaf5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:24.913598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5ff92df7-7e2d-491d-bba7-0019bbdedaf5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:24.921584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ff92df7-7e2d-491d-bba7-0019bbdedaf5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:24.922045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ff92df7-7e2d-491d-bba7-0019bbdedaf5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:24.922835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ff92df7-7e2d-491d-bba7-0019bbdedaf5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:24.923279 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5ff92df7-7e2d-491d-bba7-0019bbdedaf5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:24.938155 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-5ff92df7-7e2d-491d-bba7-0019bbdedaf5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] HTTP exception thrown: Instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e could not be found. Feb 19 21:36:24.938745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5ff92df7-7e2d-491d-bba7-0019bbdedaf5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Returning 404 to user: Instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:36:24.939569 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5ff92df7-7e2d-491d-bba7-0019bbdedaf5 tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 404 len: 111 microversion: 2.1 time: 0.032893 Feb 19 21:36:24.940127 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2990/5892] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:36:24 2022] DELETE /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:36:24.948649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7d0f7e93-6e72-41ba-910d-4b9326fa5d8a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:24.949266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7d0f7e93-6e72-41ba-910d-4b9326fa5d8a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] [instance: 3d5219b9-b43c-4a44-8422-6a60157b2b4e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:24.955216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d0f7e93-6e72-41ba-910d-4b9326fa5d8a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:24.955680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d0f7e93-6e72-41ba-910d-4b9326fa5d8a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:24.956496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d0f7e93-6e72-41ba-910d-4b9326fa5d8a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:24.956941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7d0f7e93-6e72-41ba-910d-4b9326fa5d8a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:24.970924 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-7d0f7e93-6e72-41ba-910d-4b9326fa5d8a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] HTTP exception thrown: Instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e could not be found. Feb 19 21:36:24.971505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7d0f7e93-6e72-41ba-910d-4b9326fa5d8a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] Returning 404 to user: Instance 3d5219b9-b43c-4a44-8422-6a60157b2b4e could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:36:24.972323 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7d0f7e93-6e72-41ba-910d-4b9326fa5d8a tempest-ServerDiskConfigTestJSON-1676354052 tempest-ServerDiskConfigTestJSON-1676354052-project] 10.222.0.30 "GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e" status: 404 len: 111 microversion: 2.1 time: 0.028178 Feb 19 21:36:24.972878 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2903/5893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:24 2022] GET /compute/v2.1/servers/3d5219b9-b43c-4a44-8422-6a60157b2b4e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:36:30.760849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-572e2ff9-3567-4598-a4aa-ceac4aa0c9f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'create', calling method: .version_select at 0x7f6467a2adc0>, body: {"keypair": {"name": "tempest-keypair-129249094"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:30.775877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-572e2ff9-3567-4598-a4aa-ceac4aa0c9f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:36:30.782158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-572e2ff9-3567-4598-a4aa-ceac4aa0c9f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for user f14d8011b7c241f7b5ecdee4c3f44ae4 and project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:36:30.900119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-572e2ff9-3567-4598-a4aa-ceac4aa0c9f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:36:30.905312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-572e2ff9-3567-4598-a4aa-ceac4aa0c9f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for user f14d8011b7c241f7b5ecdee4c3f44ae4 and project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:36:30.920618 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-572e2ff9-3567-4598-a4aa-ceac4aa0c9f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.304980 Feb 19 21:36:30.921221 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2991/5894] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:36:30 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:32.266449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-568997802", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f342daca-48e4-4cbe-b7ce-0803d4de7cbe"}], "security_groups": [{"name": "tempest-securitygroup--129379875"}], "key_name": "tempest-keypair-129249094", "user_data": "}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:32.379598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] validate_networks() for [('f342daca-48e4-4cbe-b7ce-0803d4de7cbe', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:36:32.769773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:36:32.770192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:36:32.770673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:36:32.771078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:36:32.771701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:36:32.781472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:32.782060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:32.783018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:32.783462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:32.800148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:36:32.805560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for user f14d8011b7c241f7b5ecdee4c3f44ae4 and project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:36:32.818442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:36:32.820958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:36:32.868172 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1610f044-6dd5-4c37-a353-5efee4a9a775 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.605760 Feb 19 21:36:32.869644 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2904/5895] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:36:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:36:32.880106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec8c6177-d396-4085-ad6e-7d4c2850c167 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:32.881370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ec8c6177-d396-4085-ad6e-7d4c2850c167 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:32.937969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec8c6177-d396-4085-ad6e-7d4c2850c167 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:32.944776 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec8c6177-d396-4085-ad6e-7d4c2850c167 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1237 microversion: 2.1 time: 0.069187 Feb 19 21:36:32.945517 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2992/5896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:32 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:33.965238 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c010512-3405-4bec-9734-853148b99071 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:33.965872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c010512-3405-4bec-9734-853148b99071 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:33.976257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c010512-3405-4bec-9734-853148b99071 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:33.976766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c010512-3405-4bec-9734-853148b99071 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:33.977614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c010512-3405-4bec-9734-853148b99071 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:33.978060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c010512-3405-4bec-9734-853148b99071 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:34.097181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c010512-3405-4bec-9734-853148b99071 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:34.105381 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c010512-3405-4bec-9734-853148b99071 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1289 microversion: 2.1 time: 0.146934 Feb 19 21:36:34.107110 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2905/5897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:33 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1289 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:35.123385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a70423ed-925b-4566-a873-88bc7f0e1f7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:35.124020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a70423ed-925b-4566-a873-88bc7f0e1f7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:35.131433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a70423ed-925b-4566-a873-88bc7f0e1f7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:35.131905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a70423ed-925b-4566-a873-88bc7f0e1f7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:35.132773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a70423ed-925b-4566-a873-88bc7f0e1f7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:35.133234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a70423ed-925b-4566-a873-88bc7f0e1f7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:35.390220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a70423ed-925b-4566-a873-88bc7f0e1f7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:35.400092 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a70423ed-925b-4566-a873-88bc7f0e1f7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1362 microversion: 2.1 time: 0.280850 Feb 19 21:36:35.401308 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2993/5898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:35 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:35.635475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-1f65385f-ff34-4d34-b408-af47e8ead798 req-76d53be7-da5a-43c1-87d2-e2f583b20f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1756cbb-ab59-416e-b79f-6b6462b3d8b7", "tag": "7e8cf85a-6f08-4620-be45-ac3b11aff22f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:35.637086 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:36:35.637086 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:36:35.644476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1f65385f-ff34-4d34-b408-af47e8ead798 req-76d53be7-da5a-43c1-87d2-e2f583b20f50 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:35.645145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-1f65385f-ff34-4d34-b408-af47e8ead798 req-76d53be7-da5a-43c1-87d2-e2f583b20f50 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:35.657400 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-1f65385f-ff34-4d34-b408-af47e8ead798 req-76d53be7-da5a-43c1-87d2-e2f583b20f50 service nova] Creating event network-changed:7e8cf85a-6f08-4620-be45-ac3b11aff22f for instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 on nch2-master-1 Feb 19 21:36:35.662690 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-1f65385f-ff34-4d34-b408-af47e8ead798 req-76d53be7-da5a-43c1-87d2-e2f583b20f50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118167 Feb 19 21:36:35.663886 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2906/5899] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:36:36.417367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36705603-e83d-461f-ab41-40b0dcf6a273 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:36.417983 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-36705603-e83d-461f-ab41-40b0dcf6a273 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:36.425073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36705603-e83d-461f-ab41-40b0dcf6a273 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:36.425541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36705603-e83d-461f-ab41-40b0dcf6a273 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:36.426353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36705603-e83d-461f-ab41-40b0dcf6a273 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:36.426801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36705603-e83d-461f-ab41-40b0dcf6a273 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:36.845837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-36705603-e83d-461f-ab41-40b0dcf6a273 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:36.853956 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36705603-e83d-461f-ab41-40b0dcf6a273 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1362 microversion: 2.1 time: 0.439872 Feb 19 21:36:36.854540 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2994/5900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:36 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:37.872397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-12448020-a36f-47e7-be5c-b7d9a11d99a2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:37.873106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-12448020-a36f-47e7-be5c-b7d9a11d99a2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:37.879232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12448020-a36f-47e7-be5c-b7d9a11d99a2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:37.879690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12448020-a36f-47e7-be5c-b7d9a11d99a2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:37.880496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12448020-a36f-47e7-be5c-b7d9a11d99a2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:37.880940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12448020-a36f-47e7-be5c-b7d9a11d99a2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:38.023017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-12448020-a36f-47e7-be5c-b7d9a11d99a2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:38.030353 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-12448020-a36f-47e7-be5c-b7d9a11d99a2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1362 microversion: 2.1 time: 0.163397 Feb 19 21:36:38.030935 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2907/5901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:37 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:39.049538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cdb65069-53dd-46f7-8318-3f3106d3334a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:39.050175 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cdb65069-53dd-46f7-8318-3f3106d3334a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:39.059009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cdb65069-53dd-46f7-8318-3f3106d3334a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:39.059476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cdb65069-53dd-46f7-8318-3f3106d3334a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:39.060270 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cdb65069-53dd-46f7-8318-3f3106d3334a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:39.060749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cdb65069-53dd-46f7-8318-3f3106d3334a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:39.192682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cdb65069-53dd-46f7-8318-3f3106d3334a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:39.200998 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cdb65069-53dd-46f7-8318-3f3106d3334a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1362 microversion: 2.1 time: 0.157898 Feb 19 21:36:39.201572 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2995/5902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:39 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:40.218509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d1b0f3c6-b4cb-4276-9be3-6fc078f7574e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:40.219133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d1b0f3c6-b4cb-4276-9be3-6fc078f7574e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:40.225720 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1b0f3c6-b4cb-4276-9be3-6fc078f7574e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:40.226183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1b0f3c6-b4cb-4276-9be3-6fc078f7574e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:40.226977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1b0f3c6-b4cb-4276-9be3-6fc078f7574e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:40.227425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1b0f3c6-b4cb-4276-9be3-6fc078f7574e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:40.380612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d1b0f3c6-b4cb-4276-9be3-6fc078f7574e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:40.388624 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d1b0f3c6-b4cb-4276-9be3-6fc078f7574e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1362 microversion: 2.1 time: 0.174352 Feb 19 21:36:40.389209 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2908/5903] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:40 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:41.405786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2c85fe68-591c-4c9e-9c8a-dd59d9dae09b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:41.406565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2c85fe68-591c-4c9e-9c8a-dd59d9dae09b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:41.413571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c85fe68-591c-4c9e-9c8a-dd59d9dae09b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:41.414046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c85fe68-591c-4c9e-9c8a-dd59d9dae09b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:41.414848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c85fe68-591c-4c9e-9c8a-dd59d9dae09b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:41.415302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2c85fe68-591c-4c9e-9c8a-dd59d9dae09b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:41.420213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6baca2f7-3f69-4314-8483-0d2999cf67ca req-9edd709e-8f81-49ef-8f6c-5b7983b0819d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1756cbb-ab59-416e-b79f-6b6462b3d8b7", "name": "network-vif-plugged", "status": "completed", "tag": "7e8cf85a-6f08-4620-be45-ac3b11aff22f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:41.420745 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:36:41.420745 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:36:41.430452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6baca2f7-3f69-4314-8483-0d2999cf67ca req-9edd709e-8f81-49ef-8f6c-5b7983b0819d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:41.430452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6baca2f7-3f69-4314-8483-0d2999cf67ca req-9edd709e-8f81-49ef-8f6c-5b7983b0819d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:41.441729 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6baca2f7-3f69-4314-8483-0d2999cf67ca req-9edd709e-8f81-49ef-8f6c-5b7983b0819d service nova] Creating event network-vif-plugged:7e8cf85a-6f08-4620-be45-ac3b11aff22f for instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 on nch2-master-1 Feb 19 21:36:41.447623 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6baca2f7-3f69-4314-8483-0d2999cf67ca req-9edd709e-8f81-49ef-8f6c-5b7983b0819d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033106 Feb 19 21:36:41.448355 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2909/5904] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:36:41.590653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2c85fe68-591c-4c9e-9c8a-dd59d9dae09b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:41.598680 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2c85fe68-591c-4c9e-9c8a-dd59d9dae09b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1362 microversion: 2.1 time: 0.196634 Feb 19 21:36:41.599515 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2996/5905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:41 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:42.615444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e40e9226-3ca3-48b3-b737-0d1dcd140003 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:42.616148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e40e9226-3ca3-48b3-b737-0d1dcd140003 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:42.623735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e40e9226-3ca3-48b3-b737-0d1dcd140003 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:42.624192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e40e9226-3ca3-48b3-b737-0d1dcd140003 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:42.625009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e40e9226-3ca3-48b3-b737-0d1dcd140003 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:42.625452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e40e9226-3ca3-48b3-b737-0d1dcd140003 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:42.764439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e40e9226-3ca3-48b3-b737-0d1dcd140003 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:42.771744 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e40e9226-3ca3-48b3-b737-0d1dcd140003 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1362 microversion: 2.1 time: 0.160378 Feb 19 21:36:42.772350 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2910/5906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:42 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:43.788211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2526013f-9c82-405a-8753-f3abe54cf440 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:43.788869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2526013f-9c82-405a-8753-f3abe54cf440 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:43.796492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2526013f-9c82-405a-8753-f3abe54cf440 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:43.796955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2526013f-9c82-405a-8753-f3abe54cf440 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:43.797772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2526013f-9c82-405a-8753-f3abe54cf440 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:43.798222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2526013f-9c82-405a-8753-f3abe54cf440 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:43.938428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2526013f-9c82-405a-8753-f3abe54cf440 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:43.945956 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2526013f-9c82-405a-8753-f3abe54cf440 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1549 microversion: 2.1 time: 0.161512 Feb 19 21:36:43.946528 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2997/5907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:43 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:43.962242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ccaa5490-14a1-4e1d-b514-7271fec66b39 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:43.963235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ccaa5490-14a1-4e1d-b514-7271fec66b39 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:43.969978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccaa5490-14a1-4e1d-b514-7271fec66b39 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:43.970431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccaa5490-14a1-4e1d-b514-7271fec66b39 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:43.971215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccaa5490-14a1-4e1d-b514-7271fec66b39 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:43.971657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ccaa5490-14a1-4e1d-b514-7271fec66b39 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:44.057410 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ccaa5490-14a1-4e1d-b514-7271fec66b39 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098806 Feb 19 21:36:44.058024 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2911/5908] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:36:43 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:36:44.989982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c747f7c-513e-45d6-8776-31d2b63a913b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:44.991189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3c747f7c-513e-45d6-8776-31d2b63a913b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:44.995062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-14dcf43f-64b6-4e97-8668-5de946fb3660 req-c026e662-0a57-4ada-a632-4a394ff32841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1756cbb-ab59-416e-b79f-6b6462b3d8b7", "tag": "7e8cf85a-6f08-4620-be45-ac3b11aff22f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:44.996812 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:36:44.996812 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:36:44.998914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c747f7c-513e-45d6-8776-31d2b63a913b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:44.999595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c747f7c-513e-45d6-8776-31d2b63a913b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:45.000626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c747f7c-513e-45d6-8776-31d2b63a913b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:45.001277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c747f7c-513e-45d6-8776-31d2b63a913b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:45.003999 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-14dcf43f-64b6-4e97-8668-5de946fb3660 req-c026e662-0a57-4ada-a632-4a394ff32841 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:45.004480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-14dcf43f-64b6-4e97-8668-5de946fb3660 req-c026e662-0a57-4ada-a632-4a394ff32841 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:45.015795 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-14dcf43f-64b6-4e97-8668-5de946fb3660 req-c026e662-0a57-4ada-a632-4a394ff32841 service nova] Creating event network-changed:7e8cf85a-6f08-4620-be45-ac3b11aff22f for instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 on nch2-master-1 Feb 19 21:36:45.021485 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-14dcf43f-64b6-4e97-8668-5de946fb3660 req-c026e662-0a57-4ada-a632-4a394ff32841 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031475 Feb 19 21:36:45.022615 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2912/5909] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:36:45.226891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3c747f7c-513e-45d6-8776-31d2b63a913b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:45.236990 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3c747f7c-513e-45d6-8776-31d2b63a913b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1549 microversion: 2.1 time: 0.249962 Feb 19 21:36:45.236990 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2998/5910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:44 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1549 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:45.253368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f95ca332-c8b7-4ff7-ac0f-1849aa0a14df tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:45.254446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f95ca332-c8b7-4ff7-ac0f-1849aa0a14df tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:45.261705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f95ca332-c8b7-4ff7-ac0f-1849aa0a14df tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:45.262223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f95ca332-c8b7-4ff7-ac0f-1849aa0a14df tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:45.263059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f95ca332-c8b7-4ff7-ac0f-1849aa0a14df tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:45.263497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f95ca332-c8b7-4ff7-ac0f-1849aa0a14df tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:45.492234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f95ca332-c8b7-4ff7-ac0f-1849aa0a14df tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:45.503033 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f95ca332-c8b7-4ff7-ac0f-1849aa0a14df tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1549 microversion: 2.1 time: 0.253505 Feb 19 21:36:45.503833 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2913/5911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:45 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:46.519977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46c2e803-3837-4f8e-a96b-45e2f38520cd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:46.520740 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-46c2e803-3837-4f8e-a96b-45e2f38520cd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:46.528745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46c2e803-3837-4f8e-a96b-45e2f38520cd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:46.529211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46c2e803-3837-4f8e-a96b-45e2f38520cd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:46.530003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46c2e803-3837-4f8e-a96b-45e2f38520cd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:46.530449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46c2e803-3837-4f8e-a96b-45e2f38520cd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:46.664964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-46c2e803-3837-4f8e-a96b-45e2f38520cd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:46.672856 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-46c2e803-3837-4f8e-a96b-45e2f38520cd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1668 microversion: 2.1 time: 0.156615 Feb 19 21:36:46.673429 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 2999/5912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:46 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:46.689111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6653a906-3755-4318-9532-dea2321174f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:46.689728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6653a906-3755-4318-9532-dea2321174f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:46.696486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6653a906-3755-4318-9532-dea2321174f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:46.697191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6653a906-3755-4318-9532-dea2321174f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:46.698005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6653a906-3755-4318-9532-dea2321174f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:46.698448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6653a906-3755-4318-9532-dea2321174f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:46.836707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6653a906-3755-4318-9532-dea2321174f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:46.844596 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6653a906-3755-4318-9532-dea2321174f0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1668 microversion: 2.1 time: 0.159111 Feb 19 21:36:46.845188 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2914/5913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:46 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:46.861024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:36:46.862043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:46.867889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:46.868305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:46.869155 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:46.869606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:46.896610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:46.903034 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Old instance type m1.heat2, new instance type m1.heat {{(pid=136094) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:36:46.909281 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:36:46.909736 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:36:46.910217 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:36:46.910630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:36:46.911075 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:36:46.974027 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1e7d75d9-f061-4dab-acad-388ea9c85052 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7/action" status: 202 len: 0 microversion: 2.1 time: 0.116649 Feb 19 21:36:46.974980 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3000/5914] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:36:46 2022] POST /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:36:46.983676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-298efb8c-a8ba-4f56-b21f-4c6e72cd8fa2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:46.984490 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-298efb8c-a8ba-4f56-b21f-4c6e72cd8fa2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:46.990332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-298efb8c-a8ba-4f56-b21f-4c6e72cd8fa2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:46.990788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-298efb8c-a8ba-4f56-b21f-4c6e72cd8fa2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:46.991578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-298efb8c-a8ba-4f56-b21f-4c6e72cd8fa2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:46.992028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-298efb8c-a8ba-4f56-b21f-4c6e72cd8fa2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:47.126976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-298efb8c-a8ba-4f56-b21f-4c6e72cd8fa2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:47.135108 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-298efb8c-a8ba-4f56-b21f-4c6e72cd8fa2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1677 microversion: 2.1 time: 0.154794 Feb 19 21:36:47.135851 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2915/5915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:46 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:36:48.152540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a006b9a7-e14d-41b1-867d-beaf2a922922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:48.153334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a006b9a7-e14d-41b1-867d-beaf2a922922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:48.159288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a006b9a7-e14d-41b1-867d-beaf2a922922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:48.159759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a006b9a7-e14d-41b1-867d-beaf2a922922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:48.160591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a006b9a7-e14d-41b1-867d-beaf2a922922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:48.161052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a006b9a7-e14d-41b1-867d-beaf2a922922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:48.408167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a006b9a7-e14d-41b1-867d-beaf2a922922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:48.416312 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a006b9a7-e14d-41b1-867d-beaf2a922922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1677 microversion: 2.1 time: 0.267804 Feb 19 21:36:48.416927 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3001/5916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:48 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:49.434461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b9d38cd-4832-450f-82e6-a4f7e74c6209 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:49.435009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b9d38cd-4832-450f-82e6-a4f7e74c6209 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:49.441687 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b9d38cd-4832-450f-82e6-a4f7e74c6209 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:49.442147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b9d38cd-4832-450f-82e6-a4f7e74c6209 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:49.442938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b9d38cd-4832-450f-82e6-a4f7e74c6209 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:49.443386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b9d38cd-4832-450f-82e6-a4f7e74c6209 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:49.577067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b9d38cd-4832-450f-82e6-a4f7e74c6209 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:49.584502 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b9d38cd-4832-450f-82e6-a4f7e74c6209 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.154538 Feb 19 21:36:49.585098 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2916/5917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:49 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:50.601550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-de645055-ff66-401e-9c3f-4647e348fb5f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:50.602214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-de645055-ff66-401e-9c3f-4647e348fb5f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:50.608958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de645055-ff66-401e-9c3f-4647e348fb5f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:50.609427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de645055-ff66-401e-9c3f-4647e348fb5f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:50.610221 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de645055-ff66-401e-9c3f-4647e348fb5f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:50.610669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de645055-ff66-401e-9c3f-4647e348fb5f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:50.751455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-de645055-ff66-401e-9c3f-4647e348fb5f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:50.758916 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-de645055-ff66-401e-9c3f-4647e348fb5f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.161054 Feb 19 21:36:50.760036 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3002/5918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:50 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:51.776561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc36325d-4f04-4fe4-b08d-980d7739de63 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:51.777191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc36325d-4f04-4fe4-b08d-980d7739de63 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:51.783972 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc36325d-4f04-4fe4-b08d-980d7739de63 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:51.784468 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc36325d-4f04-4fe4-b08d-980d7739de63 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:51.785255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc36325d-4f04-4fe4-b08d-980d7739de63 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:51.785698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc36325d-4f04-4fe4-b08d-980d7739de63 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:51.917814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc36325d-4f04-4fe4-b08d-980d7739de63 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:51.925284 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc36325d-4f04-4fe4-b08d-980d7739de63 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.153135 Feb 19 21:36:51.925869 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2917/5919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:51 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:52.942323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4a93c31a-7b77-470a-88b0-ef13db68bb0e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:52.942947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4a93c31a-7b77-470a-88b0-ef13db68bb0e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:52.950110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a93c31a-7b77-470a-88b0-ef13db68bb0e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:52.950600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a93c31a-7b77-470a-88b0-ef13db68bb0e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:52.951453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a93c31a-7b77-470a-88b0-ef13db68bb0e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:52.951959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4a93c31a-7b77-470a-88b0-ef13db68bb0e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:53.088156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a93c31a-7b77-470a-88b0-ef13db68bb0e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:53.095673 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4a93c31a-7b77-470a-88b0-ef13db68bb0e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.157269 Feb 19 21:36:53.096249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3003/5920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:52 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:54.113113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c2a0997f-27e5-4ecc-b5b6-0caba051d99b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:54.113756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c2a0997f-27e5-4ecc-b5b6-0caba051d99b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:54.121214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2a0997f-27e5-4ecc-b5b6-0caba051d99b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:54.121666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2a0997f-27e5-4ecc-b5b6-0caba051d99b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:54.122449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2a0997f-27e5-4ecc-b5b6-0caba051d99b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:54.122892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c2a0997f-27e5-4ecc-b5b6-0caba051d99b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:54.260184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c2a0997f-27e5-4ecc-b5b6-0caba051d99b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:54.267593 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c2a0997f-27e5-4ecc-b5b6-0caba051d99b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.158224 Feb 19 21:36:54.268172 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2918/5921] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:54 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:55.285305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-00bdcfcf-b611-41fd-844d-402ca9fd8751 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:55.285924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-00bdcfcf-b611-41fd-844d-402ca9fd8751 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:55.292625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00bdcfcf-b611-41fd-844d-402ca9fd8751 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:55.293089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00bdcfcf-b611-41fd-844d-402ca9fd8751 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:55.293874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00bdcfcf-b611-41fd-844d-402ca9fd8751 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:55.294327 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-00bdcfcf-b611-41fd-844d-402ca9fd8751 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:55.438440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-00bdcfcf-b611-41fd-844d-402ca9fd8751 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:55.445995 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-00bdcfcf-b611-41fd-844d-402ca9fd8751 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.164392 Feb 19 21:36:55.446561 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3004/5922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:55 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:56.463623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-763891ad-ce10-4cb7-9987-d2688e912098 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:56.464164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-763891ad-ce10-4cb7-9987-d2688e912098 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:56.471031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-763891ad-ce10-4cb7-9987-d2688e912098 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:56.471487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-763891ad-ce10-4cb7-9987-d2688e912098 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:56.472273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-763891ad-ce10-4cb7-9987-d2688e912098 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:56.472747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-763891ad-ce10-4cb7-9987-d2688e912098 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:56.607878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-763891ad-ce10-4cb7-9987-d2688e912098 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:56.615420 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-763891ad-ce10-4cb7-9987-d2688e912098 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.156292 Feb 19 21:36:56.616017 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2919/5923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:56 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:57.632610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b6527b61-7524-450b-8128-d09339c62369 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:57.633209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b6527b61-7524-450b-8128-d09339c62369 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:57.640396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6527b61-7524-450b-8128-d09339c62369 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:57.640864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6527b61-7524-450b-8128-d09339c62369 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:57.641645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6527b61-7524-450b-8128-d09339c62369 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:57.642091 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b6527b61-7524-450b-8128-d09339c62369 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:57.779799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b6527b61-7524-450b-8128-d09339c62369 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:57.787122 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b6527b61-7524-450b-8128-d09339c62369 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.158214 Feb 19 21:36:57.787688 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3005/5924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:57 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:58.804827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bf8d1560-5119-46a8-ba0b-94c8395f4117 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:58.805439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bf8d1560-5119-46a8-ba0b-94c8395f4117 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:58.812208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf8d1560-5119-46a8-ba0b-94c8395f4117 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:58.812689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf8d1560-5119-46a8-ba0b-94c8395f4117 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:58.813464 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf8d1560-5119-46a8-ba0b-94c8395f4117 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:58.813900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bf8d1560-5119-46a8-ba0b-94c8395f4117 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:58.950699 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bf8d1560-5119-46a8-ba0b-94c8395f4117 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:36:58.958171 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bf8d1560-5119-46a8-ba0b-94c8395f4117 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.157352 Feb 19 21:36:58.958682 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2920/5925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:58 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:36:59.975139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-627f5634-b19e-4e12-af7c-cd7fdebc16a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:36:59.975677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-627f5634-b19e-4e12-af7c-cd7fdebc16a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:36:59.983122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-627f5634-b19e-4e12-af7c-cd7fdebc16a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:59.983583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-627f5634-b19e-4e12-af7c-cd7fdebc16a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:36:59.984385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-627f5634-b19e-4e12-af7c-cd7fdebc16a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:36:59.984833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-627f5634-b19e-4e12-af7c-cd7fdebc16a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:00.121062 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-627f5634-b19e-4e12-af7c-cd7fdebc16a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:00.128390 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-627f5634-b19e-4e12-af7c-cd7fdebc16a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.157049 Feb 19 21:37:00.128976 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3006/5926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:36:59 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:01.145109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c850ce16-3301-4bcd-ba5f-222a32c15b0a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:01.145743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c850ce16-3301-4bcd-ba5f-222a32c15b0a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:01.152681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c850ce16-3301-4bcd-ba5f-222a32c15b0a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:01.153132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c850ce16-3301-4bcd-ba5f-222a32c15b0a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:01.153903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c850ce16-3301-4bcd-ba5f-222a32c15b0a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:01.154338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c850ce16-3301-4bcd-ba5f-222a32c15b0a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:01.292605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c850ce16-3301-4bcd-ba5f-222a32c15b0a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:01.300541 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c850ce16-3301-4bcd-ba5f-222a32c15b0a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.159071 Feb 19 21:37:01.301340 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2921/5927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:01 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:02.318022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b4be5841-4731-4ced-9f96-8ffcc940b50b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:02.318650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b4be5841-4731-4ced-9f96-8ffcc940b50b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:02.326230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4be5841-4731-4ced-9f96-8ffcc940b50b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:02.326702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4be5841-4731-4ced-9f96-8ffcc940b50b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:02.327500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4be5841-4731-4ced-9f96-8ffcc940b50b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:02.327959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b4be5841-4731-4ced-9f96-8ffcc940b50b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:02.463720 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b4be5841-4731-4ced-9f96-8ffcc940b50b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:02.471132 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b4be5841-4731-4ced-9f96-8ffcc940b50b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.156851 Feb 19 21:37:02.471708 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3007/5928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:02 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:03.488045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-12ed610b-6fd9-4ed6-95aa-cc91fe8b7f8d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:03.488750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-12ed610b-6fd9-4ed6-95aa-cc91fe8b7f8d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:03.496257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12ed610b-6fd9-4ed6-95aa-cc91fe8b7f8d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:03.496741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12ed610b-6fd9-4ed6-95aa-cc91fe8b7f8d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:03.497529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12ed610b-6fd9-4ed6-95aa-cc91fe8b7f8d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:03.497966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12ed610b-6fd9-4ed6-95aa-cc91fe8b7f8d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:03.632174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-12ed610b-6fd9-4ed6-95aa-cc91fe8b7f8d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:03.640315 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-12ed610b-6fd9-4ed6-95aa-cc91fe8b7f8d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.156026 Feb 19 21:37:03.640928 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2922/5929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:03 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:04.657492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-20bb8e57-3632-455c-99ef-50cbd2320518 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:04.658116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-20bb8e57-3632-455c-99ef-50cbd2320518 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:04.665908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20bb8e57-3632-455c-99ef-50cbd2320518 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:04.666372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20bb8e57-3632-455c-99ef-50cbd2320518 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:04.667179 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20bb8e57-3632-455c-99ef-50cbd2320518 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:04.667630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20bb8e57-3632-455c-99ef-50cbd2320518 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:04.803158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-20bb8e57-3632-455c-99ef-50cbd2320518 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:04.811234 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-20bb8e57-3632-455c-99ef-50cbd2320518 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1682 microversion: 2.1 time: 0.157471 Feb 19 21:37:04.811816 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3008/5930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:04 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:37:05.828627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a68a755d-4a37-405f-b520-f31742f98af0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:05.829332 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a68a755d-4a37-405f-b520-f31742f98af0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:05.835939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a68a755d-4a37-405f-b520-f31742f98af0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:05.836427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a68a755d-4a37-405f-b520-f31742f98af0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:05.837749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a68a755d-4a37-405f-b520-f31742f98af0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:05.838189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a68a755d-4a37-405f-b520-f31742f98af0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:05.973941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a68a755d-4a37-405f-b520-f31742f98af0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:05.982108 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a68a755d-4a37-405f-b520-f31742f98af0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1681 microversion: 2.1 time: 0.157255 Feb 19 21:37:05.982722 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2923/5931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:05 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:06.140233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7c3f6a53-0dad-45b0-a46c-b6de6f3972f7 req-4419ef7b-bad3-46a4-9cd6-9deb015f8f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1756cbb-ab59-416e-b79f-6b6462b3d8b7", "name": "network-vif-unplugged", "status": "completed", "tag": "7e8cf85a-6f08-4620-be45-ac3b11aff22f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:06.141833 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:06.141833 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:37:06.150212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7c3f6a53-0dad-45b0-a46c-b6de6f3972f7 req-4419ef7b-bad3-46a4-9cd6-9deb015f8f62 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:06.150682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7c3f6a53-0dad-45b0-a46c-b6de6f3972f7 req-4419ef7b-bad3-46a4-9cd6-9deb015f8f62 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:06.164222 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7c3f6a53-0dad-45b0-a46c-b6de6f3972f7 req-4419ef7b-bad3-46a4-9cd6-9deb015f8f62 service nova] Creating event network-vif-unplugged:7e8cf85a-6f08-4620-be45-ac3b11aff22f for instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 on nch1-master-1 Feb 19 21:37:06.170808 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-7c3f6a53-0dad-45b0-a46c-b6de6f3972f7 req-4419ef7b-bad3-46a4-9cd6-9deb015f8f62 service nova] Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:37:06.184163 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7c3f6a53-0dad-45b0-a46c-b6de6f3972f7 req-4419ef7b-bad3-46a4-9cd6-9deb015f8f62 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121629 Feb 19 21:37:06.184824 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3009/5932] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:37:07.000493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c28ad9ca-a164-4f13-a7cf-680c39852ff8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:07.001127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c28ad9ca-a164-4f13-a7cf-680c39852ff8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:07.007827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c28ad9ca-a164-4f13-a7cf-680c39852ff8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:07.008297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c28ad9ca-a164-4f13-a7cf-680c39852ff8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:07.009115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c28ad9ca-a164-4f13-a7cf-680c39852ff8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:07.009565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c28ad9ca-a164-4f13-a7cf-680c39852ff8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:07.151092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c28ad9ca-a164-4f13-a7cf-680c39852ff8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:07.158501 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c28ad9ca-a164-4f13-a7cf-680c39852ff8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1681 microversion: 2.1 time: 0.162039 Feb 19 21:37:07.159093 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2924/5933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:06 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:08.177425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-913e3af2-f4a1-452a-ad7e-945145133d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:08.178142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-913e3af2-f4a1-452a-ad7e-945145133d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:08.184950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-913e3af2-f4a1-452a-ad7e-945145133d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:08.185410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-913e3af2-f4a1-452a-ad7e-945145133d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:08.186196 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-913e3af2-f4a1-452a-ad7e-945145133d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:08.186640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-913e3af2-f4a1-452a-ad7e-945145133d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:08.209336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-607eaaed-7653-4a65-b7de-0ed73b405f31 req-7b26afc4-eeeb-47e0-82b0-265840062fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1756cbb-ab59-416e-b79f-6b6462b3d8b7", "tag": "7e8cf85a-6f08-4620-be45-ac3b11aff22f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:08.210839 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:08.210839 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:37:08.218671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-607eaaed-7653-4a65-b7de-0ed73b405f31 req-7b26afc4-eeeb-47e0-82b0-265840062fff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:08.219125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-607eaaed-7653-4a65-b7de-0ed73b405f31 req-7b26afc4-eeeb-47e0-82b0-265840062fff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:08.231633 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-607eaaed-7653-4a65-b7de-0ed73b405f31 req-7b26afc4-eeeb-47e0-82b0-265840062fff service nova] Creating event network-changed:7e8cf85a-6f08-4620-be45-ac3b11aff22f for instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 on nch1-master-1 Feb 19 21:37:08.237191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-607eaaed-7653-4a65-b7de-0ed73b405f31 req-7b26afc4-eeeb-47e0-82b0-265840062fff service nova] Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:37:08.248696 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-607eaaed-7653-4a65-b7de-0ed73b405f31 req-7b26afc4-eeeb-47e0-82b0-265840062fff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042985 Feb 19 21:37:08.249493 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2925/5934] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:37:08.362028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-913e3af2-f4a1-452a-ad7e-945145133d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:08.370263 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-913e3af2-f4a1-452a-ad7e-945145133d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1679 microversion: 2.1 time: 0.197789 Feb 19 21:37:08.370847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3010/5935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:08 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:09.389982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ac658f6-5736-4f2f-8dfa-f762dabf5392 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:09.390690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8ac658f6-5736-4f2f-8dfa-f762dabf5392 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:09.397020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ac658f6-5736-4f2f-8dfa-f762dabf5392 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:09.397479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ac658f6-5736-4f2f-8dfa-f762dabf5392 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:09.398290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ac658f6-5736-4f2f-8dfa-f762dabf5392 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:09.398737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8ac658f6-5736-4f2f-8dfa-f762dabf5392 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:09.546560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8ac658f6-5736-4f2f-8dfa-f762dabf5392 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:09.554452 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ac658f6-5736-4f2f-8dfa-f762dabf5392 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1676 microversion: 2.1 time: 0.169407 Feb 19 21:37:09.555785 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2926/5936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:09 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:09.572104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-03c4c65e-499d-4250-b852-6313312c2612 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:09.572681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-03c4c65e-499d-4250-b852-6313312c2612 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:09.579320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03c4c65e-499d-4250-b852-6313312c2612 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:09.579781 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03c4c65e-499d-4250-b852-6313312c2612 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:09.580597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03c4c65e-499d-4250-b852-6313312c2612 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:09.581067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-03c4c65e-499d-4250-b852-6313312c2612 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:09.642413 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-03c4c65e-499d-4250-b852-6313312c2612 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7/action" status: 204 len: 0 microversion: 2.1 time: 0.074906 Feb 19 21:37:09.643081 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3011/5937] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:37:09 2022] POST /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:37:09.651132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-22909910-141e-4ee5-be06-91cbba91d83e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:09.651741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-22909910-141e-4ee5-be06-91cbba91d83e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:09.657662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22909910-141e-4ee5-be06-91cbba91d83e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:09.658117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22909910-141e-4ee5-be06-91cbba91d83e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:09.658920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22909910-141e-4ee5-be06-91cbba91d83e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:09.659343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-22909910-141e-4ee5-be06-91cbba91d83e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:09.892463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-22909910-141e-4ee5-be06-91cbba91d83e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:09.899868 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-22909910-141e-4ee5-be06-91cbba91d83e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1676 microversion: 2.1 time: 0.252550 Feb 19 21:37:09.900510 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2927/5938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:09 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:10.918083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-382b8bff-91a3-4c35-aaa5-33c6ab201397 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:10.918929 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-382b8bff-91a3-4c35-aaa5-33c6ab201397 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:10.927517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-382b8bff-91a3-4c35-aaa5-33c6ab201397 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:10.928010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-382b8bff-91a3-4c35-aaa5-33c6ab201397 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:10.928857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-382b8bff-91a3-4c35-aaa5-33c6ab201397 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:10.929316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-382b8bff-91a3-4c35-aaa5-33c6ab201397 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.072239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-382b8bff-91a3-4c35-aaa5-33c6ab201397 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:11.080160 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-382b8bff-91a3-4c35-aaa5-33c6ab201397 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1668 microversion: 2.1 time: 0.166410 Feb 19 21:37:11.080799 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3012/5939] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:10 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:11.096809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-657344af-6a8f-4912-9092-5ee6e18065ff tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:11.097434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-657344af-6a8f-4912-9092-5ee6e18065ff tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:11.105811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-657344af-6a8f-4912-9092-5ee6e18065ff tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:11.106284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-657344af-6a8f-4912-9092-5ee6e18065ff tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.107088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-657344af-6a8f-4912-9092-5ee6e18065ff tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:11.107534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-657344af-6a8f-4912-9092-5ee6e18065ff tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.225049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c2f0fe5c-c883-4869-bc69-6ec42aa96a3f req-265d0d97-ae9f-47bb-a632-d3c51df75399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1756cbb-ab59-416e-b79f-6b6462b3d8b7", "name": "network-vif-plugged", "status": "completed", "tag": "7e8cf85a-6f08-4620-be45-ac3b11aff22f"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:11.226846 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:11.226846 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:37:11.235009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c2f0fe5c-c883-4869-bc69-6ec42aa96a3f req-265d0d97-ae9f-47bb-a632-d3c51df75399 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:11.235726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c2f0fe5c-c883-4869-bc69-6ec42aa96a3f req-265d0d97-ae9f-47bb-a632-d3c51df75399 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.246087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-657344af-6a8f-4912-9092-5ee6e18065ff tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:11.254815 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c2f0fe5c-c883-4869-bc69-6ec42aa96a3f req-265d0d97-ae9f-47bb-a632-d3c51df75399 service nova] Creating event network-vif-plugged:7e8cf85a-6f08-4620-be45-ac3b11aff22f for instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 on nch1-master-1 Feb 19 21:37:11.260868 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-657344af-6a8f-4912-9092-5ee6e18065ff tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1668 microversion: 2.1 time: 0.167692 Feb 19 21:37:11.261811 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2928/5940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:11 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:11.267208 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c2f0fe5c-c883-4869-bc69-6ec42aa96a3f req-265d0d97-ae9f-47bb-a632-d3c51df75399 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040672 Feb 19 21:37:11.267915 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3013/5941] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:37:11.276761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dcf8d49a-3430-475e-ab8f-1539a41aba0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:11.277370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dcf8d49a-3430-475e-ab8f-1539a41aba0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:11.283219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcf8d49a-3430-475e-ab8f-1539a41aba0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:11.283668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcf8d49a-3430-475e-ab8f-1539a41aba0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.284473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcf8d49a-3430-475e-ab8f-1539a41aba0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:11.284913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcf8d49a-3430-475e-ab8f-1539a41aba0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.419533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dcf8d49a-3430-475e-ab8f-1539a41aba0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:11.426989 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dcf8d49a-3430-475e-ab8f-1539a41aba0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1668 microversion: 2.1 time: 0.153854 Feb 19 21:37:11.427596 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2929/5942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:11 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:37:11.444475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3da76a4b-810a-4cf2-82ad-30a7e77e949d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:11.445082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3da76a4b-810a-4cf2-82ad-30a7e77e949d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:11.451913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3da76a4b-810a-4cf2-82ad-30a7e77e949d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:11.452421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3da76a4b-810a-4cf2-82ad-30a7e77e949d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.453227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3da76a4b-810a-4cf2-82ad-30a7e77e949d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:11.453734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3da76a4b-810a-4cf2-82ad-30a7e77e949d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.479266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3da76a4b-810a-4cf2-82ad-30a7e77e949d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:37:11.555264 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3da76a4b-810a-4cf2-82ad-30a7e77e949d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 204 len: 0 microversion: 2.1 time: 0.114556 Feb 19 21:37:11.555989 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3014/5943] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:37:11 2022] DELETE /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:37:11.564040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-82dccbc1-d1f5-49ed-a993-363eb34616fd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:11.564664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-82dccbc1-d1f5-49ed-a993-363eb34616fd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:11.570567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82dccbc1-d1f5-49ed-a993-363eb34616fd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:11.571040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82dccbc1-d1f5-49ed-a993-363eb34616fd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.572083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82dccbc1-d1f5-49ed-a993-363eb34616fd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:11.572588 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-82dccbc1-d1f5-49ed-a993-363eb34616fd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:11.706828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-82dccbc1-d1f5-49ed-a993-363eb34616fd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:11.714644 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-82dccbc1-d1f5-49ed-a993-363eb34616fd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1674 microversion: 2.1 time: 0.154352 Feb 19 21:37:11.715222 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2930/5944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:11 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:12.733340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-24a30bb4-a5c2-4a36-8ac3-19b9dbc3d8b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:12.734064 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-24a30bb4-a5c2-4a36-8ac3-19b9dbc3d8b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:12.740878 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24a30bb4-a5c2-4a36-8ac3-19b9dbc3d8b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:12.741466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24a30bb4-a5c2-4a36-8ac3-19b9dbc3d8b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:12.742273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24a30bb4-a5c2-4a36-8ac3-19b9dbc3d8b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:12.743410 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-24a30bb4-a5c2-4a36-8ac3-19b9dbc3d8b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:12.881729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-24a30bb4-a5c2-4a36-8ac3-19b9dbc3d8b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:12.889998 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-24a30bb4-a5c2-4a36-8ac3-19b9dbc3d8b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 200 len: 1674 microversion: 2.1 time: 0.160825 Feb 19 21:37:12.890588 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3015/5945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:12 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:13.698869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-961c309d-f3b1-41b1-b0a6-6daebf9d48eb req-4747810f-6657-460c-b7b9-17b574a202e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1756cbb-ab59-416e-b79f-6b6462b3d8b7", "name": "network-vif-deleted", "tag": "7e8cf85a-6f08-4620-be45-ac3b11aff22f"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:13.700861 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:13.700861 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:37:13.712274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-961c309d-f3b1-41b1-b0a6-6daebf9d48eb req-4747810f-6657-460c-b7b9-17b574a202e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:13.713080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-961c309d-f3b1-41b1-b0a6-6daebf9d48eb req-4747810f-6657-460c-b7b9-17b574a202e6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:13.727599 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-961c309d-f3b1-41b1-b0a6-6daebf9d48eb req-4747810f-6657-460c-b7b9-17b574a202e6 service nova] Creating event network-vif-deleted:7e8cf85a-6f08-4620-be45-ac3b11aff22f for instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 on nch1-master-1 Feb 19 21:37:13.734189 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-961c309d-f3b1-41b1-b0a6-6daebf9d48eb req-4747810f-6657-460c-b7b9-17b574a202e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040045 Feb 19 21:37:13.735301 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2931/5946] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:37:13.906874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e08833b4-922c-4bfb-8311-6d3ffd57bf98 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:13.907500 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e08833b4-922c-4bfb-8311-6d3ffd57bf98 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:13.914760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e08833b4-922c-4bfb-8311-6d3ffd57bf98 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:13.915789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e08833b4-922c-4bfb-8311-6d3ffd57bf98 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:13.917001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e08833b4-922c-4bfb-8311-6d3ffd57bf98 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:13.917587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e08833b4-922c-4bfb-8311-6d3ffd57bf98 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:13.932412 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e08833b4-922c-4bfb-8311-6d3ffd57bf98 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 could not be found. Feb 19 21:37:13.933027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e08833b4-922c-4bfb-8311-6d3ffd57bf98 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:37:13.933873 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e08833b4-922c-4bfb-8311-6d3ffd57bf98 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 404 len: 111 microversion: 2.1 time: 0.030800 Feb 19 21:37:13.934440 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3016/5947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:13 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:37:13.950967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3aed2c8a-3c90-4f45-9007-0c40d5109be6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:13.951677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3aed2c8a-3c90-4f45-9007-0c40d5109be6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:13.957811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aed2c8a-3c90-4f45-9007-0c40d5109be6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:13.958272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aed2c8a-3c90-4f45-9007-0c40d5109be6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:13.959065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aed2c8a-3c90-4f45-9007-0c40d5109be6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:13.959609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3aed2c8a-3c90-4f45-9007-0c40d5109be6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:13.972881 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-3aed2c8a-3c90-4f45-9007-0c40d5109be6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 could not be found. Feb 19 21:37:13.973475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3aed2c8a-3c90-4f45-9007-0c40d5109be6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:37:13.974318 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3aed2c8a-3c90-4f45-9007-0c40d5109be6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 404 len: 111 microversion: 2.1 time: 0.028201 Feb 19 21:37:13.974880 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2932/5948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:13 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:37:14.024615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1950622747", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "f342daca-48e4-4cbe-b7ce-0803d4de7cbe"}], "security_groups": [{"name": "tempest-securitygroup--129379875"}], "key_name": "tempest-keypair-129249094", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:14.124702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] validate_networks() for [('f342daca-48e4-4cbe-b7ce-0803d4de7cbe', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:37:14.564008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:37:14.564419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:37:14.564978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:37:14.565432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:37:14.565898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:37:14.575998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:14.576515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:14.577362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:14.577821 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:14.594662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:37:14.599882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for user f14d8011b7c241f7b5ecdee4c3f44ae4 and project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:37:14.612621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:37:14.615009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:37:14.662737 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7aa3d022-c4d9-4c5d-be81-aa4d33dd9206 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.642356 Feb 19 21:37:14.663750 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3017/5949] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:37:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:37:14.673754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0fc187e4-ca81-4702-9631-d12c5c59566d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:14.674372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0fc187e4-ca81-4702-9631-d12c5c59566d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:14.735011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0fc187e4-ca81-4702-9631-d12c5c59566d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:14.743329 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0fc187e4-ca81-4702-9631-d12c5c59566d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1238 microversion: 2.1 time: 0.072769 Feb 19 21:37:14.744202 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2933/5950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:14 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:15.762514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-93f8e705-3717-461d-94f1-cfe654e3f553 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:15.763184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-93f8e705-3717-461d-94f1-cfe654e3f553 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:15.770264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93f8e705-3717-461d-94f1-cfe654e3f553 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:15.770729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93f8e705-3717-461d-94f1-cfe654e3f553 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:15.771523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93f8e705-3717-461d-94f1-cfe654e3f553 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:15.771969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93f8e705-3717-461d-94f1-cfe654e3f553 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:15.841429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-93f8e705-3717-461d-94f1-cfe654e3f553 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:15.852117 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-93f8e705-3717-461d-94f1-cfe654e3f553 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1296 microversion: 2.1 time: 0.093443 Feb 19 21:37:15.852117 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3018/5951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:15 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:16.869786 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-da6beb8d-0bb5-4837-bfc6-e7ae04647724 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:16.871162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-da6beb8d-0bb5-4837-bfc6-e7ae04647724 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:16.878450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6beb8d-0bb5-4837-bfc6-e7ae04647724 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:16.879032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6beb8d-0bb5-4837-bfc6-e7ae04647724 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:16.879941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6beb8d-0bb5-4837-bfc6-e7ae04647724 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:16.880689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da6beb8d-0bb5-4837-bfc6-e7ae04647724 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:16.898101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-13ec9737-1d11-42be-87cf-b18663eb4eaf req-81053e06-675a-4565-bf66-d6d0de985ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52408e4-2619-4325-872c-04c09ce81c4f", "tag": "d549be54-4573-4687-a7da-4e85e4c8333c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:16.901346 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:16.901346 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:37:16.913683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-13ec9737-1d11-42be-87cf-b18663eb4eaf req-81053e06-675a-4565-bf66-d6d0de985ee6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:16.917753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-13ec9737-1d11-42be-87cf-b18663eb4eaf req-81053e06-675a-4565-bf66-d6d0de985ee6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:16.930402 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-13ec9737-1d11-42be-87cf-b18663eb4eaf req-81053e06-675a-4565-bf66-d6d0de985ee6 service nova] Creating event network-changed:d549be54-4573-4687-a7da-4e85e4c8333c for instance a52408e4-2619-4325-872c-04c09ce81c4f on nch1-master-1 Feb 19 21:37:16.935695 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-13ec9737-1d11-42be-87cf-b18663eb4eaf req-81053e06-675a-4565-bf66-d6d0de985ee6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042394 Feb 19 21:37:16.936458 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3019/5952] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:37:17.058701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-da6beb8d-0bb5-4837-bfc6-e7ae04647724 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:17.067707 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-da6beb8d-0bb5-4837-bfc6-e7ae04647724 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1363 microversion: 2.1 time: 0.201622 Feb 19 21:37:17.068617 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2934/5953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:16 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:18.086814 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2d292672-9f81-4dbf-ac92-c7f42ae0685a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:18.087444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2d292672-9f81-4dbf-ac92-c7f42ae0685a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:18.093675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d292672-9f81-4dbf-ac92-c7f42ae0685a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:18.094142 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d292672-9f81-4dbf-ac92-c7f42ae0685a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:18.094935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d292672-9f81-4dbf-ac92-c7f42ae0685a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:18.095393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2d292672-9f81-4dbf-ac92-c7f42ae0685a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:18.236639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2d292672-9f81-4dbf-ac92-c7f42ae0685a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:18.244791 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2d292672-9f81-4dbf-ac92-c7f42ae0685a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1363 microversion: 2.1 time: 0.163021 Feb 19 21:37:18.245368 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3020/5954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:18 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:19.262062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e8ecb359-e5ee-4865-89f3-eb45b3d911d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:19.262682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e8ecb359-e5ee-4865-89f3-eb45b3d911d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:19.269356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8ecb359-e5ee-4865-89f3-eb45b3d911d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:19.269840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8ecb359-e5ee-4865-89f3-eb45b3d911d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:19.270749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8ecb359-e5ee-4865-89f3-eb45b3d911d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:19.271190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e8ecb359-e5ee-4865-89f3-eb45b3d911d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:19.413021 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e8ecb359-e5ee-4865-89f3-eb45b3d911d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:19.420948 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e8ecb359-e5ee-4865-89f3-eb45b3d911d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1363 microversion: 2.1 time: 0.163513 Feb 19 21:37:19.421519 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2935/5955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:19 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:20.438554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7843d28c-2b2e-4cb3-8363-7591e59a5311 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:20.439190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7843d28c-2b2e-4cb3-8363-7591e59a5311 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:20.446525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7843d28c-2b2e-4cb3-8363-7591e59a5311 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:20.447245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7843d28c-2b2e-4cb3-8363-7591e59a5311 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:20.448045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7843d28c-2b2e-4cb3-8363-7591e59a5311 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:20.448535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7843d28c-2b2e-4cb3-8363-7591e59a5311 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:20.581160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7843d28c-2b2e-4cb3-8363-7591e59a5311 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:20.588660 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7843d28c-2b2e-4cb3-8363-7591e59a5311 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1363 microversion: 2.1 time: 0.153750 Feb 19 21:37:20.589226 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3021/5956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:20 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:21.264712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-73558705-b583-4de8-b7dc-eb422d4aac7e req-063d4b21-d7f8-4646-8b41-1367c1650cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52408e4-2619-4325-872c-04c09ce81c4f", "name": "network-vif-plugged", "status": "completed", "tag": "d549be54-4573-4687-a7da-4e85e4c8333c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:21.266336 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:21.266336 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:37:21.275063 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-73558705-b583-4de8-b7dc-eb422d4aac7e req-063d4b21-d7f8-4646-8b41-1367c1650cd5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:21.275560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-73558705-b583-4de8-b7dc-eb422d4aac7e req-063d4b21-d7f8-4646-8b41-1367c1650cd5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:21.289947 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-73558705-b583-4de8-b7dc-eb422d4aac7e req-063d4b21-d7f8-4646-8b41-1367c1650cd5 service nova] Creating event network-vif-plugged:d549be54-4573-4687-a7da-4e85e4c8333c for instance a52408e4-2619-4325-872c-04c09ce81c4f on nch1-master-1 Feb 19 21:37:21.295249 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-73558705-b583-4de8-b7dc-eb422d4aac7e req-063d4b21-d7f8-4646-8b41-1367c1650cd5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034216 Feb 19 21:37:21.296215 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2936/5957] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:37:21.606585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-70955491-8c8d-4a2c-a65c-5faf28e94469 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:21.607209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-70955491-8c8d-4a2c-a65c-5faf28e94469 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:21.613823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70955491-8c8d-4a2c-a65c-5faf28e94469 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:21.614284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70955491-8c8d-4a2c-a65c-5faf28e94469 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:21.615066 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70955491-8c8d-4a2c-a65c-5faf28e94469 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:21.615517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-70955491-8c8d-4a2c-a65c-5faf28e94469 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:21.753411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-70955491-8c8d-4a2c-a65c-5faf28e94469 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:21.762263 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-70955491-8c8d-4a2c-a65c-5faf28e94469 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1363 microversion: 2.1 time: 0.159342 Feb 19 21:37:21.762869 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3022/5958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:21 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:22.780084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-206dc9e0-2fc2-425a-95cf-cd46dccc3662 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:22.780813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-206dc9e0-2fc2-425a-95cf-cd46dccc3662 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:22.788081 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-206dc9e0-2fc2-425a-95cf-cd46dccc3662 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:22.788583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-206dc9e0-2fc2-425a-95cf-cd46dccc3662 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:22.790041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-206dc9e0-2fc2-425a-95cf-cd46dccc3662 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:22.790484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-206dc9e0-2fc2-425a-95cf-cd46dccc3662 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:22.924272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-206dc9e0-2fc2-425a-95cf-cd46dccc3662 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:22.931668 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-206dc9e0-2fc2-425a-95cf-cd46dccc3662 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1550 microversion: 2.1 time: 0.155700 Feb 19 21:37:22.932241 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2937/5959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:22 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:22.948302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-58343990-f196-4683-b714-077c72ab39b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:22.948913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-58343990-f196-4683-b714-077c72ab39b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:22.955669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58343990-f196-4683-b714-077c72ab39b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:22.956072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58343990-f196-4683-b714-077c72ab39b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:22.956889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58343990-f196-4683-b714-077c72ab39b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:22.957341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58343990-f196-4683-b714-077c72ab39b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:23.038764 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-58343990-f196-4683-b714-077c72ab39b7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094516 Feb 19 21:37:23.040012 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3023/5960] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:37:22 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:37:23.996408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c823bf5b-129c-4eb7-89d9-cd89d1081531 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:24.003417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c823bf5b-129c-4eb7-89d9-cd89d1081531 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:24.003880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c823bf5b-129c-4eb7-89d9-cd89d1081531 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:24.005578 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1d342f40-9ef7-4575-b034-b61763510939 req-10094b24-5dff-4d75-9fd9-5f6d489033ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52408e4-2619-4325-872c-04c09ce81c4f", "tag": "d549be54-4573-4687-a7da-4e85e4c8333c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:24.007101 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:24.007101 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:37:24.014466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1d342f40-9ef7-4575-b034-b61763510939 req-10094b24-5dff-4d75-9fd9-5f6d489033ff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:24.014924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1d342f40-9ef7-4575-b034-b61763510939 req-10094b24-5dff-4d75-9fd9-5f6d489033ff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:24.026325 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1d342f40-9ef7-4575-b034-b61763510939 req-10094b24-5dff-4d75-9fd9-5f6d489033ff service nova] Creating event network-changed:d549be54-4573-4687-a7da-4e85e4c8333c for instance a52408e4-2619-4325-872c-04c09ce81c4f on nch1-master-1 Feb 19 21:37:24.026646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c823bf5b-129c-4eb7-89d9-cd89d1081531 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Going to try to stop instance {{(pid=136095) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:37:24.031542 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1d342f40-9ef7-4575-b034-b61763510939 req-10094b24-5dff-4d75-9fd9-5f6d489033ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030480 Feb 19 21:37:24.032578 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3024/5961] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:37:24.075614 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c823bf5b-129c-4eb7-89d9-cd89d1081531 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.083762 Feb 19 21:37:24.079391 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2938/5962] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:37:23 2022] POST /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:37:24.087307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2910fb19-4dad-45fa-b89c-31baf17025b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:24.088382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2910fb19-4dad-45fa-b89c-31baf17025b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:24.097407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2910fb19-4dad-45fa-b89c-31baf17025b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:24.098195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2910fb19-4dad-45fa-b89c-31baf17025b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:24.099242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2910fb19-4dad-45fa-b89c-31baf17025b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:24.099685 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2910fb19-4dad-45fa-b89c-31baf17025b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:24.252134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2910fb19-4dad-45fa-b89c-31baf17025b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:24.260792 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2910fb19-4dad-45fa-b89c-31baf17025b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1560 microversion: 2.1 time: 0.178730 Feb 19 21:37:24.261314 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3025/5963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:24 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:25.279372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-30e29d75-9813-46e3-a0e4-155cc5315f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:25.280075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-30e29d75-9813-46e3-a0e4-155cc5315f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:25.287394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30e29d75-9813-46e3-a0e4-155cc5315f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:25.287844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30e29d75-9813-46e3-a0e4-155cc5315f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:25.288669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30e29d75-9813-46e3-a0e4-155cc5315f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:25.289289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-30e29d75-9813-46e3-a0e4-155cc5315f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:25.431572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-30e29d75-9813-46e3-a0e4-155cc5315f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:25.439082 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-30e29d75-9813-46e3-a0e4-155cc5315f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.164464 Feb 19 21:37:25.439674 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2939/5964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:25 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:26.456560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-594e5d52-950e-4df0-99c7-3db6597c6da9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:26.457140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-594e5d52-950e-4df0-99c7-3db6597c6da9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:26.465455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-594e5d52-950e-4df0-99c7-3db6597c6da9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:26.465942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-594e5d52-950e-4df0-99c7-3db6597c6da9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:26.466749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-594e5d52-950e-4df0-99c7-3db6597c6da9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:26.467206 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-594e5d52-950e-4df0-99c7-3db6597c6da9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:26.607640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-594e5d52-950e-4df0-99c7-3db6597c6da9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:26.615031 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-594e5d52-950e-4df0-99c7-3db6597c6da9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.162312 Feb 19 21:37:26.615631 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3026/5965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:26 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:27.633013 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-524c3e5e-5b2a-41b8-88b2-6bd4c5191d15 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:27.633688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-524c3e5e-5b2a-41b8-88b2-6bd4c5191d15 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:27.640270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-524c3e5e-5b2a-41b8-88b2-6bd4c5191d15 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:27.640749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-524c3e5e-5b2a-41b8-88b2-6bd4c5191d15 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:27.641521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-524c3e5e-5b2a-41b8-88b2-6bd4c5191d15 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:27.641962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-524c3e5e-5b2a-41b8-88b2-6bd4c5191d15 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:27.780417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-524c3e5e-5b2a-41b8-88b2-6bd4c5191d15 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:27.787777 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-524c3e5e-5b2a-41b8-88b2-6bd4c5191d15 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.158934 Feb 19 21:37:27.788375 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2940/5966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:27 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:28.804875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ad6595c4-1c03-403b-9603-bce08ff075de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:28.805806 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ad6595c4-1c03-403b-9603-bce08ff075de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:28.812850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad6595c4-1c03-403b-9603-bce08ff075de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:28.813310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad6595c4-1c03-403b-9603-bce08ff075de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:28.814095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad6595c4-1c03-403b-9603-bce08ff075de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:28.814542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ad6595c4-1c03-403b-9603-bce08ff075de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:28.948391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ad6595c4-1c03-403b-9603-bce08ff075de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:28.956059 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ad6595c4-1c03-403b-9603-bce08ff075de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.155089 Feb 19 21:37:28.956608 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3027/5967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:28 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:29.973526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8b337286-6259-4694-bf8f-35c61b0d822a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:29.974049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8b337286-6259-4694-bf8f-35c61b0d822a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:29.981419 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b337286-6259-4694-bf8f-35c61b0d822a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:29.981876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b337286-6259-4694-bf8f-35c61b0d822a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:29.982656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b337286-6259-4694-bf8f-35c61b0d822a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:29.983124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8b337286-6259-4694-bf8f-35c61b0d822a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:30.118283 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8b337286-6259-4694-bf8f-35c61b0d822a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:30.125695 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8b337286-6259-4694-bf8f-35c61b0d822a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.155973 Feb 19 21:37:30.126281 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2941/5968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:29 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:31.142613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c50f64ae-2291-48b7-8f1f-62523a14e45c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:31.143231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c50f64ae-2291-48b7-8f1f-62523a14e45c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:31.150069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c50f64ae-2291-48b7-8f1f-62523a14e45c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:31.150546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c50f64ae-2291-48b7-8f1f-62523a14e45c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:31.151318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c50f64ae-2291-48b7-8f1f-62523a14e45c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:31.151766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c50f64ae-2291-48b7-8f1f-62523a14e45c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:31.285456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c50f64ae-2291-48b7-8f1f-62523a14e45c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:31.292812 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c50f64ae-2291-48b7-8f1f-62523a14e45c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.153974 Feb 19 21:37:31.293407 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3028/5969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:31 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:32.309725 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fbca6ebd-0504-4881-af93-6bed63759187 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:32.310324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fbca6ebd-0504-4881-af93-6bed63759187 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:32.317126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbca6ebd-0504-4881-af93-6bed63759187 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:32.317578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbca6ebd-0504-4881-af93-6bed63759187 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:32.318355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbca6ebd-0504-4881-af93-6bed63759187 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:32.318797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbca6ebd-0504-4881-af93-6bed63759187 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:32.454481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fbca6ebd-0504-4881-af93-6bed63759187 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:32.462708 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fbca6ebd-0504-4881-af93-6bed63759187 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.156651 Feb 19 21:37:32.463309 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2942/5970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:32 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:33.480149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b5060055-7c49-4214-a986-87bcbbf32673 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:33.480801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b5060055-7c49-4214-a986-87bcbbf32673 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:33.487651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5060055-7c49-4214-a986-87bcbbf32673 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:33.488123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5060055-7c49-4214-a986-87bcbbf32673 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:33.488950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5060055-7c49-4214-a986-87bcbbf32673 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:33.489404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b5060055-7c49-4214-a986-87bcbbf32673 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:33.625691 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b5060055-7c49-4214-a986-87bcbbf32673 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:33.633407 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b5060055-7c49-4214-a986-87bcbbf32673 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.157650 Feb 19 21:37:33.633979 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3029/5971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:33 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:34.650578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7add84a7-b79b-4959-b4b9-4e7b5b4d8e0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:34.651094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7add84a7-b79b-4959-b4b9-4e7b5b4d8e0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:34.657913 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7add84a7-b79b-4959-b4b9-4e7b5b4d8e0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:34.658379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7add84a7-b79b-4959-b4b9-4e7b5b4d8e0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:34.659140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7add84a7-b79b-4959-b4b9-4e7b5b4d8e0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:34.659575 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7add84a7-b79b-4959-b4b9-4e7b5b4d8e0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:34.793710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7add84a7-b79b-4959-b4b9-4e7b5b4d8e0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:34.800995 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7add84a7-b79b-4959-b4b9-4e7b5b4d8e0f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.154255 Feb 19 21:37:34.801572 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2943/5972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:34 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:35.817976 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7902064d-1ea2-4fcf-a72b-6624ddaa503d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:35.818596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7902064d-1ea2-4fcf-a72b-6624ddaa503d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:35.826231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7902064d-1ea2-4fcf-a72b-6624ddaa503d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:35.826694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7902064d-1ea2-4fcf-a72b-6624ddaa503d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:35.827476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7902064d-1ea2-4fcf-a72b-6624ddaa503d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:35.827923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7902064d-1ea2-4fcf-a72b-6624ddaa503d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:35.969973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7902064d-1ea2-4fcf-a72b-6624ddaa503d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:35.978275 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7902064d-1ea2-4fcf-a72b-6624ddaa503d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.164027 Feb 19 21:37:35.985164 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3030/5973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:35 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:36.995975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa2145e7-f249-46c6-9804-a494cf6f69a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:36.996606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aa2145e7-f249-46c6-9804-a494cf6f69a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:37.003121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa2145e7-f249-46c6-9804-a494cf6f69a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:37.003580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa2145e7-f249-46c6-9804-a494cf6f69a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:37.004391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa2145e7-f249-46c6-9804-a494cf6f69a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:37.004841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aa2145e7-f249-46c6-9804-a494cf6f69a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:37.136709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aa2145e7-f249-46c6-9804-a494cf6f69a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:37.143996 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa2145e7-f249-46c6-9804-a494cf6f69a8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.151819 Feb 19 21:37:37.144609 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2944/5974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:36 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:38.161658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eae98a33-aa4e-40be-9b3a-c2afc1fba8d1 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:38.162317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eae98a33-aa4e-40be-9b3a-c2afc1fba8d1 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:38.168857 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eae98a33-aa4e-40be-9b3a-c2afc1fba8d1 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:38.169319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eae98a33-aa4e-40be-9b3a-c2afc1fba8d1 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:38.170101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eae98a33-aa4e-40be-9b3a-c2afc1fba8d1 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:38.170553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eae98a33-aa4e-40be-9b3a-c2afc1fba8d1 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:38.305128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-eae98a33-aa4e-40be-9b3a-c2afc1fba8d1 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:38.312433 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eae98a33-aa4e-40be-9b3a-c2afc1fba8d1 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.155154 Feb 19 21:37:38.313039 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3031/5975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:38 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:39.330793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1c7a3436-da18-4a3a-8c6d-e92f4b7d64b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:39.331402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1c7a3436-da18-4a3a-8c6d-e92f4b7d64b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:39.337897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c7a3436-da18-4a3a-8c6d-e92f4b7d64b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:39.338345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c7a3436-da18-4a3a-8c6d-e92f4b7d64b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:39.339122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c7a3436-da18-4a3a-8c6d-e92f4b7d64b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:39.339557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1c7a3436-da18-4a3a-8c6d-e92f4b7d64b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:39.471361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1c7a3436-da18-4a3a-8c6d-e92f4b7d64b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:39.478698 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1c7a3436-da18-4a3a-8c6d-e92f4b7d64b8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.151763 Feb 19 21:37:39.479277 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2945/5976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:39 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:40.495228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27f7ea3f-424f-4593-a628-771440ef6ed4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:40.495848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-27f7ea3f-424f-4593-a628-771440ef6ed4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:40.502590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27f7ea3f-424f-4593-a628-771440ef6ed4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:40.503052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27f7ea3f-424f-4593-a628-771440ef6ed4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:40.503839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27f7ea3f-424f-4593-a628-771440ef6ed4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:40.504285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27f7ea3f-424f-4593-a628-771440ef6ed4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:40.639269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-27f7ea3f-424f-4593-a628-771440ef6ed4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:40.646645 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-27f7ea3f-424f-4593-a628-771440ef6ed4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.155286 Feb 19 21:37:40.647212 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3032/5977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:40 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:41.665449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d6342df2-72b7-4ca3-b99d-0dea2afd675e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:41.666195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d6342df2-72b7-4ca3-b99d-0dea2afd675e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:41.672836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6342df2-72b7-4ca3-b99d-0dea2afd675e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:41.673295 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6342df2-72b7-4ca3-b99d-0dea2afd675e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:41.674110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6342df2-72b7-4ca3-b99d-0dea2afd675e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:41.674550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d6342df2-72b7-4ca3-b99d-0dea2afd675e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:41.811514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d6342df2-72b7-4ca3-b99d-0dea2afd675e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:41.818911 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d6342df2-72b7-4ca3-b99d-0dea2afd675e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.158207 Feb 19 21:37:41.819595 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2946/5978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:41 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:42.836580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-508dae64-671d-4402-b0d0-f44db96a8221 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:42.837199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-508dae64-671d-4402-b0d0-f44db96a8221 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:42.843874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-508dae64-671d-4402-b0d0-f44db96a8221 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:42.844349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-508dae64-671d-4402-b0d0-f44db96a8221 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:42.845151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-508dae64-671d-4402-b0d0-f44db96a8221 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:42.845601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-508dae64-671d-4402-b0d0-f44db96a8221 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:42.977484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-508dae64-671d-4402-b0d0-f44db96a8221 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:42.984910 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-508dae64-671d-4402-b0d0-f44db96a8221 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.152047 Feb 19 21:37:42.985484 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3033/5979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:42 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:44.002578 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e80b1946-6840-478f-9afd-a43973dcaec4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:44.003124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e80b1946-6840-478f-9afd-a43973dcaec4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:44.010486 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e80b1946-6840-478f-9afd-a43973dcaec4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:44.010945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e80b1946-6840-478f-9afd-a43973dcaec4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:44.011817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e80b1946-6840-478f-9afd-a43973dcaec4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:44.012261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e80b1946-6840-478f-9afd-a43973dcaec4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:44.147751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e80b1946-6840-478f-9afd-a43973dcaec4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:44.155522 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e80b1946-6840-478f-9afd-a43973dcaec4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.156748 Feb 19 21:37:44.156106 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2947/5980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:43 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:45.172950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-16bafbc3-6fb6-42e8-8bde-f835d5793595 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:45.173566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-16bafbc3-6fb6-42e8-8bde-f835d5793595 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:45.180895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16bafbc3-6fb6-42e8-8bde-f835d5793595 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:45.181527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16bafbc3-6fb6-42e8-8bde-f835d5793595 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:45.182440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16bafbc3-6fb6-42e8-8bde-f835d5793595 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:45.182887 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-16bafbc3-6fb6-42e8-8bde-f835d5793595 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:45.315617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-16bafbc3-6fb6-42e8-8bde-f835d5793595 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:45.323757 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-16bafbc3-6fb6-42e8-8bde-f835d5793595 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.154533 Feb 19 21:37:45.324322 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3034/5981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:45 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:46.342059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6d21eeb5-c454-4cc2-a0e2-6eaaf2cac368 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:46.342637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6d21eeb5-c454-4cc2-a0e2-6eaaf2cac368 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:46.349583 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d21eeb5-c454-4cc2-a0e2-6eaaf2cac368 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:46.350037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d21eeb5-c454-4cc2-a0e2-6eaaf2cac368 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:46.351508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d21eeb5-c454-4cc2-a0e2-6eaaf2cac368 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:46.351983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6d21eeb5-c454-4cc2-a0e2-6eaaf2cac368 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:46.486409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6d21eeb5-c454-4cc2-a0e2-6eaaf2cac368 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:46.493899 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6d21eeb5-c454-4cc2-a0e2-6eaaf2cac368 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.156182 Feb 19 21:37:46.494473 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2948/5982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:46 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:47.511956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-073b0cad-046e-4fbf-8f82-103512810423 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:47.512625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-073b0cad-046e-4fbf-8f82-103512810423 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:47.519333 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-073b0cad-046e-4fbf-8f82-103512810423 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:47.519799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-073b0cad-046e-4fbf-8f82-103512810423 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:47.520618 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-073b0cad-046e-4fbf-8f82-103512810423 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:47.521071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-073b0cad-046e-4fbf-8f82-103512810423 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:47.655245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-073b0cad-046e-4fbf-8f82-103512810423 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:47.662648 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-073b0cad-046e-4fbf-8f82-103512810423 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.154447 Feb 19 21:37:47.663840 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3035/5983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:47 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:48.681370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9023cc4c-991f-447c-91dc-8c794153941b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:48.682009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9023cc4c-991f-447c-91dc-8c794153941b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:48.688692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9023cc4c-991f-447c-91dc-8c794153941b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:48.689152 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9023cc4c-991f-447c-91dc-8c794153941b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:48.689926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9023cc4c-991f-447c-91dc-8c794153941b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:48.690365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9023cc4c-991f-447c-91dc-8c794153941b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:48.822967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9023cc4c-991f-447c-91dc-8c794153941b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:48.830252 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9023cc4c-991f-447c-91dc-8c794153941b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.152716 Feb 19 21:37:48.830836 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2949/5984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:48 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:49.846703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-566be470-7865-49f0-ac54-0026c4b8ce46 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:49.847321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-566be470-7865-49f0-ac54-0026c4b8ce46 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:49.854224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-566be470-7865-49f0-ac54-0026c4b8ce46 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:49.854643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-566be470-7865-49f0-ac54-0026c4b8ce46 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:49.855448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-566be470-7865-49f0-ac54-0026c4b8ce46 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:49.855954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-566be470-7865-49f0-ac54-0026c4b8ce46 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:49.992039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-566be470-7865-49f0-ac54-0026c4b8ce46 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:49.999659 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-566be470-7865-49f0-ac54-0026c4b8ce46 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1656 microversion: 2.1 time: 0.156637 Feb 19 21:37:50.000240 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3036/5985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:49 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:50.016363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:50.017350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:50.024123 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:50.024612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:50.025396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:50.025840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:50.052298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:50.058499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Old instance type m1.heat2, new instance type m1.heat {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:37:50.064649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:37:50.065078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:37:50.065554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:37:50.065964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:37:50.066379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:37:50.128815 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b37d49a-4402-4e72-b8a5-e942620f9d37 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.116095 Feb 19 21:37:50.133249 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2950/5986] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:37:50 2022] POST /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:37:50.141124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2b3e65d0-fbb2-469e-8b36-93e3c4b65fd8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:50.141745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2b3e65d0-fbb2-469e-8b36-93e3c4b65fd8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:50.147540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b3e65d0-fbb2-469e-8b36-93e3c4b65fd8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:50.147999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b3e65d0-fbb2-469e-8b36-93e3c4b65fd8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:50.148871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b3e65d0-fbb2-469e-8b36-93e3c4b65fd8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:50.149512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2b3e65d0-fbb2-469e-8b36-93e3c4b65fd8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:50.287801 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2b3e65d0-fbb2-469e-8b36-93e3c4b65fd8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:50.296189 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2b3e65d0-fbb2-469e-8b36-93e3c4b65fd8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.158686 Feb 19 21:37:50.296952 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3037/5987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:50 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:51.314664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-64e76e28-61e2-4109-bd42-4467a0c895c3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:51.315270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-64e76e28-61e2-4109-bd42-4467a0c895c3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:51.322423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64e76e28-61e2-4109-bd42-4467a0c895c3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:51.322928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64e76e28-61e2-4109-bd42-4467a0c895c3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:51.323753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64e76e28-61e2-4109-bd42-4467a0c895c3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:51.324219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64e76e28-61e2-4109-bd42-4467a0c895c3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:51.462315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64e76e28-61e2-4109-bd42-4467a0c895c3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:51.469772 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-64e76e28-61e2-4109-bd42-4467a0c895c3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1679 microversion: 2.1 time: 0.159753 Feb 19 21:37:51.470351 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2951/5988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:51 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:52.487002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-83b2a90c-3e82-436d-9707-629e8dbeaf33 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:52.487648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-83b2a90c-3e82-436d-9707-629e8dbeaf33 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:52.494365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83b2a90c-3e82-436d-9707-629e8dbeaf33 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:52.494833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83b2a90c-3e82-436d-9707-629e8dbeaf33 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:52.495625 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83b2a90c-3e82-436d-9707-629e8dbeaf33 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:52.496071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-83b2a90c-3e82-436d-9707-629e8dbeaf33 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:52.630228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-83b2a90c-3e82-436d-9707-629e8dbeaf33 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:52.637942 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-83b2a90c-3e82-436d-9707-629e8dbeaf33 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1684 microversion: 2.1 time: 0.154893 Feb 19 21:37:52.638807 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3038/5989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:52 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:53.655521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cda4efaf-b6b0-4c4c-8834-ac4c713cfdfd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:53.656176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cda4efaf-b6b0-4c4c-8834-ac4c713cfdfd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:53.663190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cda4efaf-b6b0-4c4c-8834-ac4c713cfdfd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:53.663682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cda4efaf-b6b0-4c4c-8834-ac4c713cfdfd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:53.665186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cda4efaf-b6b0-4c4c-8834-ac4c713cfdfd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:53.665637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cda4efaf-b6b0-4c4c-8834-ac4c713cfdfd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:53.809210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cda4efaf-b6b0-4c4c-8834-ac4c713cfdfd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:53.816722 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cda4efaf-b6b0-4c4c-8834-ac4c713cfdfd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1684 microversion: 2.1 time: 0.164947 Feb 19 21:37:53.817300 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2952/5990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:53 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:54.218896 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-58311c45-1bb5-405c-98c3-6ce829f1b53b req-eb5c306f-e413-4d9b-b815-5dc39cef0d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52408e4-2619-4325-872c-04c09ce81c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "d549be54-4573-4687-a7da-4e85e4c8333c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:54.220542 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:54.220542 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:37:54.228898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-58311c45-1bb5-405c-98c3-6ce829f1b53b req-eb5c306f-e413-4d9b-b815-5dc39cef0d71 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:54.229515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-58311c45-1bb5-405c-98c3-6ce829f1b53b req-eb5c306f-e413-4d9b-b815-5dc39cef0d71 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:54.241166 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-58311c45-1bb5-405c-98c3-6ce829f1b53b req-eb5c306f-e413-4d9b-b815-5dc39cef0d71 service nova] Creating event network-vif-unplugged:d549be54-4573-4687-a7da-4e85e4c8333c for instance a52408e4-2619-4325-872c-04c09ce81c4f on nch2-master-1 Feb 19 21:37:54.247186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-58311c45-1bb5-405c-98c3-6ce829f1b53b req-eb5c306f-e413-4d9b-b815-5dc39cef0d71 service nova] Instance a52408e4-2619-4325-872c-04c09ce81c4f is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:37:54.258443 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-58311c45-1bb5-405c-98c3-6ce829f1b53b req-eb5c306f-e413-4d9b-b815-5dc39cef0d71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043155 Feb 19 21:37:54.259225 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3039/5991] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:37:54.833768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-12b0139b-f8e6-47c4-84fd-25343a03f722 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:54.834409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-12b0139b-f8e6-47c4-84fd-25343a03f722 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:54.842151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12b0139b-f8e6-47c4-84fd-25343a03f722 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:54.842606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12b0139b-f8e6-47c4-84fd-25343a03f722 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:54.843398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12b0139b-f8e6-47c4-84fd-25343a03f722 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:54.843839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-12b0139b-f8e6-47c4-84fd-25343a03f722 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:55.109191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-12b0139b-f8e6-47c4-84fd-25343a03f722 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:55.118113 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-12b0139b-f8e6-47c4-84fd-25343a03f722 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1683 microversion: 2.1 time: 0.288030 Feb 19 21:37:55.118919 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2953/5992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:54 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1683 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:56.136919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4712713d-6ac6-417e-aafd-3701c47803de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:56.137555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4712713d-6ac6-417e-aafd-3701c47803de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:56.143710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4712713d-6ac6-417e-aafd-3701c47803de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:56.144182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4712713d-6ac6-417e-aafd-3701c47803de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:56.145015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4712713d-6ac6-417e-aafd-3701c47803de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:56.145472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4712713d-6ac6-417e-aafd-3701c47803de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:56.274942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-9a79246c-405c-4136-b87f-36a07dbcae39 req-b5dbebe8-751d-411d-b453-7f3c606955e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52408e4-2619-4325-872c-04c09ce81c4f", "tag": "d549be54-4573-4687-a7da-4e85e4c8333c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:56.276591 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:56.276591 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:37:56.284272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9a79246c-405c-4136-b87f-36a07dbcae39 req-b5dbebe8-751d-411d-b453-7f3c606955e9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:56.284751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-9a79246c-405c-4136-b87f-36a07dbcae39 req-b5dbebe8-751d-411d-b453-7f3c606955e9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:56.286571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4712713d-6ac6-417e-aafd-3701c47803de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:56.294187 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4712713d-6ac6-417e-aafd-3701c47803de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1681 microversion: 2.1 time: 0.162860 Feb 19 21:37:56.294775 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3040/5993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:56 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:56.299321 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-9a79246c-405c-4136-b87f-36a07dbcae39 req-b5dbebe8-751d-411d-b453-7f3c606955e9 service nova] Creating event network-changed:d549be54-4573-4687-a7da-4e85e4c8333c for instance a52408e4-2619-4325-872c-04c09ce81c4f on nch2-master-1 Feb 19 21:37:56.304688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-9a79246c-405c-4136-b87f-36a07dbcae39 req-b5dbebe8-751d-411d-b453-7f3c606955e9 service nova] Instance a52408e4-2619-4325-872c-04c09ce81c4f is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:37:56.315470 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-9a79246c-405c-4136-b87f-36a07dbcae39 req-b5dbebe8-751d-411d-b453-7f3c606955e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044794 Feb 19 21:37:56.316079 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2954/5994] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:37:57.311436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-23776312-91df-4ec2-ba8c-9fcc103fcf0c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:57.312056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-23776312-91df-4ec2-ba8c-9fcc103fcf0c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:57.318825 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23776312-91df-4ec2-ba8c-9fcc103fcf0c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:57.319290 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23776312-91df-4ec2-ba8c-9fcc103fcf0c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:57.320115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23776312-91df-4ec2-ba8c-9fcc103fcf0c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:57.320592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23776312-91df-4ec2-ba8c-9fcc103fcf0c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:57.455249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-23776312-91df-4ec2-ba8c-9fcc103fcf0c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:57.463183 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-23776312-91df-4ec2-ba8c-9fcc103fcf0c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1681 microversion: 2.1 time: 0.155519 Feb 19 21:37:57.463757 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3041/5995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:57 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:58.482065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-532ec31a-040c-412a-9ccf-ea2bc811eda3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:58.482684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-532ec31a-040c-412a-9ccf-ea2bc811eda3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:58.488872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-532ec31a-040c-412a-9ccf-ea2bc811eda3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:58.489326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-532ec31a-040c-412a-9ccf-ea2bc811eda3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:58.490110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-532ec31a-040c-412a-9ccf-ea2bc811eda3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:58.490550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-532ec31a-040c-412a-9ccf-ea2bc811eda3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:58.631469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-532ec31a-040c-412a-9ccf-ea2bc811eda3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:58.638856 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-532ec31a-040c-412a-9ccf-ea2bc811eda3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1677 microversion: 2.1 time: 0.162341 Feb 19 21:37:58.639436 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2955/5996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:58 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:58.654835 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-45c81910-4331-4ef7-bd92-4f17c5b38c3e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:58.655386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-45c81910-4331-4ef7-bd92-4f17c5b38c3e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:58.662045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45c81910-4331-4ef7-bd92-4f17c5b38c3e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:58.662505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45c81910-4331-4ef7-bd92-4f17c5b38c3e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:58.663386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45c81910-4331-4ef7-bd92-4f17c5b38c3e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:58.664339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45c81910-4331-4ef7-bd92-4f17c5b38c3e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:58.720072 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-45c81910-4331-4ef7-bd92-4f17c5b38c3e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/action" status: 204 len: 0 microversion: 2.1 time: 0.068736 Feb 19 21:37:58.720749 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3042/5997] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:37:58 2022] POST /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:37:58.729162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-657f397a-6788-4086-abf8-c0e6eb69a85f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:58.729771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-657f397a-6788-4086-abf8-c0e6eb69a85f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:58.735933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-657f397a-6788-4086-abf8-c0e6eb69a85f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:58.736412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-657f397a-6788-4086-abf8-c0e6eb69a85f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:58.737230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-657f397a-6788-4086-abf8-c0e6eb69a85f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:58.737664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-657f397a-6788-4086-abf8-c0e6eb69a85f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:58.876010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-657f397a-6788-4086-abf8-c0e6eb69a85f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:37:58.883858 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-657f397a-6788-4086-abf8-c0e6eb69a85f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1677 microversion: 2.1 time: 0.158840 Feb 19 21:37:58.884579 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2956/5998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:58 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:37:59.707716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e2f46fac-d09b-4b0b-904f-10a82450a344 req-6ff26c45-bf7f-40f5-bcf9-9774504c14c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52408e4-2619-4325-872c-04c09ce81c4f", "name": "network-vif-plugged", "status": "completed", "tag": "d549be54-4573-4687-a7da-4e85e4c8333c"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:37:59.709248 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:37:59.709248 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:37:59.717393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e2f46fac-d09b-4b0b-904f-10a82450a344 req-6ff26c45-bf7f-40f5-bcf9-9774504c14c3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:59.718123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e2f46fac-d09b-4b0b-904f-10a82450a344 req-6ff26c45-bf7f-40f5-bcf9-9774504c14c3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:59.730594 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e2f46fac-d09b-4b0b-904f-10a82450a344 req-6ff26c45-bf7f-40f5-bcf9-9774504c14c3 service nova] Creating event network-vif-plugged:d549be54-4573-4687-a7da-4e85e4c8333c for instance a52408e4-2619-4325-872c-04c09ce81c4f on nch2-master-1 Feb 19 21:37:59.736729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-e2f46fac-d09b-4b0b-904f-10a82450a344 req-6ff26c45-bf7f-40f5-bcf9-9774504c14c3 service nova] Instance a52408e4-2619-4325-872c-04c09ce81c4f is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:37:59.748044 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e2f46fac-d09b-4b0b-904f-10a82450a344 req-6ff26c45-bf7f-40f5-bcf9-9774504c14c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044188 Feb 19 21:37:59.748700 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3043/5999] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:37:59.901358 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7650569f-74d7-4996-834a-c0e742946202 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:37:59.901968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7650569f-74d7-4996-834a-c0e742946202 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:37:59.909241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7650569f-74d7-4996-834a-c0e742946202 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:59.909797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7650569f-74d7-4996-834a-c0e742946202 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:37:59.910682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7650569f-74d7-4996-834a-c0e742946202 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:37:59.911132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7650569f-74d7-4996-834a-c0e742946202 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:00.056423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7650569f-74d7-4996-834a-c0e742946202 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:00.063702 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7650569f-74d7-4996-834a-c0e742946202 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1656 microversion: 2.1 time: 0.166275 Feb 19 21:38:00.064279 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2957/6000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:37:59 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1656 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:00.080626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5a47665c-f64b-48cf-a14d-7682873ca544 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:00.081343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5a47665c-f64b-48cf-a14d-7682873ca544 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:00.087485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a47665c-f64b-48cf-a14d-7682873ca544 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:00.087947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a47665c-f64b-48cf-a14d-7682873ca544 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:00.088769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a47665c-f64b-48cf-a14d-7682873ca544 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:00.089223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5a47665c-f64b-48cf-a14d-7682873ca544 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:00.223429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5a47665c-f64b-48cf-a14d-7682873ca544 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:00.231504 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5a47665c-f64b-48cf-a14d-7682873ca544 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1656 microversion: 2.1 time: 0.155036 Feb 19 21:38:00.232082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3044/6001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:00 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:00.248243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5ee268f7-5866-46af-9ab8-0825aab21057 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:00.254420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ee268f7-5866-46af-9ab8-0825aab21057 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:00.254878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ee268f7-5866-46af-9ab8-0825aab21057 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:00.277239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5ee268f7-5866-46af-9ab8-0825aab21057 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Going to try to start instance {{(pid=136095) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 19 21:38:00.318254 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5ee268f7-5866-46af-9ab8-0825aab21057 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.073493 Feb 19 21:38:00.318829 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2958/6002] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:38:00 2022] POST /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:38:00.327250 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-64604463-1954-4d20-bc8c-64b7d6b5040c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:00.327890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-64604463-1954-4d20-bc8c-64b7d6b5040c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:00.334786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64604463-1954-4d20-bc8c-64b7d6b5040c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:00.335272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64604463-1954-4d20-bc8c-64b7d6b5040c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:00.336909 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64604463-1954-4d20-bc8c-64b7d6b5040c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:00.337384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-64604463-1954-4d20-bc8c-64b7d6b5040c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:00.565844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-64604463-1954-4d20-bc8c-64b7d6b5040c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:00.573528 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-64604463-1954-4d20-bc8c-64b7d6b5040c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1665 microversion: 2.1 time: 0.249923 Feb 19 21:38:00.574047 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3045/6003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:00 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1665 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:01.593379 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b4f25108-e45b-4d0e-91aa-8a0494d38324 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:01.594085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b4f25108-e45b-4d0e-91aa-8a0494d38324 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:01.600307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4f25108-e45b-4d0e-91aa-8a0494d38324 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:01.600792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4f25108-e45b-4d0e-91aa-8a0494d38324 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:01.601579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4f25108-e45b-4d0e-91aa-8a0494d38324 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:01.602022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b4f25108-e45b-4d0e-91aa-8a0494d38324 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:01.745122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b4f25108-e45b-4d0e-91aa-8a0494d38324 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:01.752540 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b4f25108-e45b-4d0e-91aa-8a0494d38324 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1669 microversion: 2.1 time: 0.164234 Feb 19 21:38:01.753120 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2959/6004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:01 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:01.770054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-89e6d742-38e2-4405-876d-5963d92a41ba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:01.770655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-89e6d742-38e2-4405-876d-5963d92a41ba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:01.777341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89e6d742-38e2-4405-876d-5963d92a41ba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:01.777802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89e6d742-38e2-4405-876d-5963d92a41ba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:01.778597 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89e6d742-38e2-4405-876d-5963d92a41ba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:01.779044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89e6d742-38e2-4405-876d-5963d92a41ba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:01.806897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-89e6d742-38e2-4405-876d-5963d92a41ba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:38:01.883230 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-89e6d742-38e2-4405-876d-5963d92a41ba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 204 len: 0 microversion: 2.1 time: 0.116465 Feb 19 21:38:01.883758 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3046/6005] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:38:01 2022] DELETE /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:38:01.891838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-edda15be-0e83-4190-97ef-365f1356b9b6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:01.892511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-edda15be-0e83-4190-97ef-365f1356b9b6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:01.898706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edda15be-0e83-4190-97ef-365f1356b9b6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:01.899151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edda15be-0e83-4190-97ef-365f1356b9b6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:01.899956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edda15be-0e83-4190-97ef-365f1356b9b6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:01.900421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edda15be-0e83-4190-97ef-365f1356b9b6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:02.032650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-edda15be-0e83-4190-97ef-365f1356b9b6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:02.040089 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-edda15be-0e83-4190-97ef-365f1356b9b6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1675 microversion: 2.1 time: 0.151911 Feb 19 21:38:02.040690 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2960/6006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:01 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:03.057679 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f2ad2206-bc00-496a-a041-5e02d77d2806 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:03.058414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f2ad2206-bc00-496a-a041-5e02d77d2806 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:03.065228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2ad2206-bc00-496a-a041-5e02d77d2806 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:03.065689 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2ad2206-bc00-496a-a041-5e02d77d2806 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:03.066471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2ad2206-bc00-496a-a041-5e02d77d2806 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:03.066918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f2ad2206-bc00-496a-a041-5e02d77d2806 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:03.200848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f2ad2206-bc00-496a-a041-5e02d77d2806 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:03.208249 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f2ad2206-bc00-496a-a041-5e02d77d2806 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1675 microversion: 2.1 time: 0.154698 Feb 19 21:38:03.208859 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3047/6007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:03 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:04.150275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-45ead84d-2f71-44c0-b38a-1cf4f3caaa2d req-58fd7f45-b65a-4fd9-8057-cd214c2e09ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52408e4-2619-4325-872c-04c09ce81c4f", "name": "network-vif-deleted", "tag": "d549be54-4573-4687-a7da-4e85e4c8333c"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:04.151958 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:38:04.151958 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:38:04.159726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-45ead84d-2f71-44c0-b38a-1cf4f3caaa2d req-58fd7f45-b65a-4fd9-8057-cd214c2e09ae service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:04.160180 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-45ead84d-2f71-44c0-b38a-1cf4f3caaa2d req-58fd7f45-b65a-4fd9-8057-cd214c2e09ae service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:04.172778 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-45ead84d-2f71-44c0-b38a-1cf4f3caaa2d req-58fd7f45-b65a-4fd9-8057-cd214c2e09ae service nova] Creating event network-vif-deleted:d549be54-4573-4687-a7da-4e85e4c8333c for instance a52408e4-2619-4325-872c-04c09ce81c4f on nch2-master-1 Feb 19 21:38:04.178009 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-45ead84d-2f71-44c0-b38a-1cf4f3caaa2d req-58fd7f45-b65a-4fd9-8057-cd214c2e09ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031820 Feb 19 21:38:04.178788 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2961/6008] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:38:04.228236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:04.229023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:04.236542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:04.237359 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:04.238139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:04.238598 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:04.272751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:04.273865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:04.274404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lazy-loading 'fault' on Instance uuid a52408e4-2619-4325-872c-04c09ce81c4f {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:38:04.319286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:04.328294 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1e772a3a-dde9-4dc0-9bc3-c650e5e21ef2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 200 len: 1328 microversion: 2.1 time: 0.105982 Feb 19 21:38:04.338381 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3048/6009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:04 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:05.346691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d637c1b5-5742-4523-b7be-039a8a594df2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:05.347366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d637c1b5-5742-4523-b7be-039a8a594df2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:05.354265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d637c1b5-5742-4523-b7be-039a8a594df2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:05.354716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d637c1b5-5742-4523-b7be-039a8a594df2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:05.355493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d637c1b5-5742-4523-b7be-039a8a594df2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:05.355927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d637c1b5-5742-4523-b7be-039a8a594df2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:05.371593 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-d637c1b5-5742-4523-b7be-039a8a594df2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance a52408e4-2619-4325-872c-04c09ce81c4f could not be found. Feb 19 21:38:05.372189 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d637c1b5-5742-4523-b7be-039a8a594df2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance a52408e4-2619-4325-872c-04c09ce81c4f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:38:05.373103 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d637c1b5-5742-4523-b7be-039a8a594df2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 404 len: 111 microversion: 2.1 time: 0.031298 Feb 19 21:38:05.373596 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2962/6010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:05 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:38:05.391487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bdfddadb-4881-47cc-bcc5-790cb128eacc tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:05.392103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bdfddadb-4881-47cc-bcc5-790cb128eacc tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:05.398903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bdfddadb-4881-47cc-bcc5-790cb128eacc tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:05.399363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bdfddadb-4881-47cc-bcc5-790cb128eacc tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:05.400210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bdfddadb-4881-47cc-bcc5-790cb128eacc tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:05.400693 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bdfddadb-4881-47cc-bcc5-790cb128eacc tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:05.415018 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-bdfddadb-4881-47cc-bcc5-790cb128eacc tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance a52408e4-2619-4325-872c-04c09ce81c4f could not be found. Feb 19 21:38:05.415619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bdfddadb-4881-47cc-bcc5-790cb128eacc tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance a52408e4-2619-4325-872c-04c09ce81c4f could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:38:05.416512 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bdfddadb-4881-47cc-bcc5-790cb128eacc tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 404 len: 111 microversion: 2.1 time: 0.028792 Feb 19 21:38:05.417076 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3049/6011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:05 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:38:05.464049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-513330346", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "f342daca-48e4-4cbe-b7ce-0803d4de7cbe"}], "security_groups": [{"name": "tempest-securitygroup--129379875"}], "key_name": "tempest-keypair-129249094", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:05.565729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] validate_networks() for [('f342daca-48e4-4cbe-b7ce-0803d4de7cbe', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:38:06.027770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:38:06.028192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:38:06.028692 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:38:06.029128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:38:06.029536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:38:06.038638 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:06.039092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:06.039897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:06.040385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:06.057536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:38:06.062716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for user f14d8011b7c241f7b5ecdee4c3f44ae4 and project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:38:06.075471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:38:06.077817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:38:06.122466 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b39f220c-46be-4384-aca7-f6113aa73a8b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.662112 Feb 19 21:38:06.123123 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2963/6012] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:38:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:38:06.133650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-45157926-910d-4898-829d-de2b910cfdaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:06.134274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-45157926-910d-4898-829d-de2b910cfdaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:06.192353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-45157926-910d-4898-829d-de2b910cfdaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:06.199782 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-45157926-910d-4898-829d-de2b910cfdaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1237 microversion: 2.1 time: 0.070520 Feb 19 21:38:06.200359 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3050/6013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:06 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:07.218162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4a32c3c7-4d46-40ba-a177-bfea60013077 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:07.218950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4a32c3c7-4d46-40ba-a177-bfea60013077 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:07.225323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a32c3c7-4d46-40ba-a177-bfea60013077 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:07.225884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a32c3c7-4d46-40ba-a177-bfea60013077 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:07.227268 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a32c3c7-4d46-40ba-a177-bfea60013077 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:07.227714 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a32c3c7-4d46-40ba-a177-bfea60013077 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:07.293623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4a32c3c7-4d46-40ba-a177-bfea60013077 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:07.302087 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4a32c3c7-4d46-40ba-a177-bfea60013077 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1295 microversion: 2.1 time: 0.088438 Feb 19 21:38:07.302902 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2964/6014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:07 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:08.318968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3aaf65cf-af49-4a4f-9bea-079dd2366c31 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:08.319600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3aaf65cf-af49-4a4f-9bea-079dd2366c31 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:08.327227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aaf65cf-af49-4a4f-9bea-079dd2366c31 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:08.327694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aaf65cf-af49-4a4f-9bea-079dd2366c31 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:08.328512 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aaf65cf-af49-4a4f-9bea-079dd2366c31 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:08.328961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3aaf65cf-af49-4a4f-9bea-079dd2366c31 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:08.359047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d293815d-0ee1-4d05-b279-a9b100f660cf req-e5033b16-dc04-42b9-980f-a1d9bb0cc932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:08.363744 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:38:08.363744 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:38:08.380761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d293815d-0ee1-4d05-b279-a9b100f660cf req-e5033b16-dc04-42b9-980f-a1d9bb0cc932 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:08.381470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d293815d-0ee1-4d05-b279-a9b100f660cf req-e5033b16-dc04-42b9-980f-a1d9bb0cc932 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:08.394250 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d293815d-0ee1-4d05-b279-a9b100f660cf req-e5033b16-dc04-42b9-980f-a1d9bb0cc932 service nova] Creating event network-changed:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch2-master-1 Feb 19 21:38:08.399679 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d293815d-0ee1-4d05-b279-a9b100f660cf req-e5033b16-dc04-42b9-980f-a1d9bb0cc932 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045117 Feb 19 21:38:08.401007 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2965/6015] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:38:08.597037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3aaf65cf-af49-4a4f-9bea-079dd2366c31 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:08.605020 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3aaf65cf-af49-4a4f-9bea-079dd2366c31 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1362 microversion: 2.1 time: 0.289795 Feb 19 21:38:08.605673 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3051/6016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:08 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:09.623009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc3281bc-1415-4384-af7b-0536101b6264 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:09.623644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc3281bc-1415-4384-af7b-0536101b6264 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:09.629910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc3281bc-1415-4384-af7b-0536101b6264 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:09.630366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc3281bc-1415-4384-af7b-0536101b6264 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:09.631150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc3281bc-1415-4384-af7b-0536101b6264 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:09.631598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc3281bc-1415-4384-af7b-0536101b6264 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:09.770732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc3281bc-1415-4384-af7b-0536101b6264 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:09.778642 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc3281bc-1415-4384-af7b-0536101b6264 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1362 microversion: 2.1 time: 0.160664 Feb 19 21:38:09.779214 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2966/6017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:09 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:10.795673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-996c9258-20df-4f5f-ae4d-b326be16a60b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:10.796288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-996c9258-20df-4f5f-ae4d-b326be16a60b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:10.803228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-996c9258-20df-4f5f-ae4d-b326be16a60b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:10.803696 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-996c9258-20df-4f5f-ae4d-b326be16a60b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:10.805153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-996c9258-20df-4f5f-ae4d-b326be16a60b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:10.805600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-996c9258-20df-4f5f-ae4d-b326be16a60b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:10.938575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-996c9258-20df-4f5f-ae4d-b326be16a60b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:10.946748 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-996c9258-20df-4f5f-ae4d-b326be16a60b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1362 microversion: 2.1 time: 0.154557 Feb 19 21:38:10.947311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3052/6018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:10 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:11.964591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2d0a143d-40f2-461d-9d7c-505e6de9701e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:11.965217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2d0a143d-40f2-461d-9d7c-505e6de9701e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:11.972150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0a143d-40f2-461d-9d7c-505e6de9701e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:11.972641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0a143d-40f2-461d-9d7c-505e6de9701e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:11.973434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0a143d-40f2-461d-9d7c-505e6de9701e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:11.973880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2d0a143d-40f2-461d-9d7c-505e6de9701e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:12.109665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2d0a143d-40f2-461d-9d7c-505e6de9701e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:12.117132 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2d0a143d-40f2-461d-9d7c-505e6de9701e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1362 microversion: 2.1 time: 0.156952 Feb 19 21:38:12.117874 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2967/6019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:11 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:13.134063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0032f040-7abc-43f0-a139-3ec8fb996639 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:13.134686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0032f040-7abc-43f0-a139-3ec8fb996639 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:13.141508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0032f040-7abc-43f0-a139-3ec8fb996639 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:13.141972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0032f040-7abc-43f0-a139-3ec8fb996639 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:13.142771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0032f040-7abc-43f0-a139-3ec8fb996639 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:13.143222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0032f040-7abc-43f0-a139-3ec8fb996639 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:13.278809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0032f040-7abc-43f0-a139-3ec8fb996639 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:13.286251 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0032f040-7abc-43f0-a139-3ec8fb996639 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1362 microversion: 2.1 time: 0.156475 Feb 19 21:38:13.286829 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3053/6020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:13 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:13.783812 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-08c6fce4-751c-4602-a929-ac1840a8cbf4 req-ba219cb7-7f53-467e-b649-c6f0ff235c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "name": "network-vif-plugged", "status": "completed", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:13.785369 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:38:13.785369 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:38:13.794171 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-08c6fce4-751c-4602-a929-ac1840a8cbf4 req-ba219cb7-7f53-467e-b649-c6f0ff235c6d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:13.794979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-08c6fce4-751c-4602-a929-ac1840a8cbf4 req-ba219cb7-7f53-467e-b649-c6f0ff235c6d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:13.806410 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-08c6fce4-751c-4602-a929-ac1840a8cbf4 req-ba219cb7-7f53-467e-b649-c6f0ff235c6d service nova] Creating event network-vif-plugged:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch2-master-1 Feb 19 21:38:13.811176 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-08c6fce4-751c-4602-a929-ac1840a8cbf4 req-ba219cb7-7f53-467e-b649-c6f0ff235c6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031094 Feb 19 21:38:13.811783 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2968/6021] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:38:14.303299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f5e1dc0-06c1-44f6-af27-35b5b79e4473 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:14.306366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f5e1dc0-06c1-44f6-af27-35b5b79e4473 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:14.310659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f5e1dc0-06c1-44f6-af27-35b5b79e4473 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:14.311124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f5e1dc0-06c1-44f6-af27-35b5b79e4473 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:14.311923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f5e1dc0-06c1-44f6-af27-35b5b79e4473 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:14.312400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f5e1dc0-06c1-44f6-af27-35b5b79e4473 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:14.774868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f5e1dc0-06c1-44f6-af27-35b5b79e4473 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:14.782165 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f5e1dc0-06c1-44f6-af27-35b5b79e4473 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1362 microversion: 2.1 time: 0.482609 Feb 19 21:38:14.782738 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3054/6022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:14 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1362 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:15.800246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9a03144f-b16a-4975-a0b0-1f72b1f4a3a4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:15.800979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9a03144f-b16a-4975-a0b0-1f72b1f4a3a4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:15.807882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a03144f-b16a-4975-a0b0-1f72b1f4a3a4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:15.808367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a03144f-b16a-4975-a0b0-1f72b1f4a3a4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:15.809157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a03144f-b16a-4975-a0b0-1f72b1f4a3a4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:15.809605 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9a03144f-b16a-4975-a0b0-1f72b1f4a3a4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:15.942252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9a03144f-b16a-4975-a0b0-1f72b1f4a3a4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:15.950081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9a03144f-b16a-4975-a0b0-1f72b1f4a3a4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1549 microversion: 2.1 time: 0.154757 Feb 19 21:38:15.950664 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2969/6023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:15 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:15.966866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-23ae0c75-1507-4a3d-904b-98d4b2997ba2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:15.967341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-23ae0c75-1507-4a3d-904b-98d4b2997ba2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:15.974253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23ae0c75-1507-4a3d-904b-98d4b2997ba2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:15.974727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23ae0c75-1507-4a3d-904b-98d4b2997ba2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:15.975536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23ae0c75-1507-4a3d-904b-98d4b2997ba2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:15.975995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-23ae0c75-1507-4a3d-904b-98d4b2997ba2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:16.060432 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-23ae0c75-1507-4a3d-904b-98d4b2997ba2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097753 Feb 19 21:38:16.061043 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3055/6024] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:38:15 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:38:17.004282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:17.005274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:17.014615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-accb508e-0646-4e1a-b9c4-140ed73e0dd1 req-b7b36e1e-2a7a-41ef-a45e-520e03be7bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:17.016107 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:38:17.016107 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:38:17.023027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-accb508e-0646-4e1a-b9c4-140ed73e0dd1 req-b7b36e1e-2a7a-41ef-a45e-520e03be7bb1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:17.023489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-accb508e-0646-4e1a-b9c4-140ed73e0dd1 req-b7b36e1e-2a7a-41ef-a45e-520e03be7bb1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:17.023695 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:17.024437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:17.025342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:17.025881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:17.034951 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-accb508e-0646-4e1a-b9c4-140ed73e0dd1 req-b7b36e1e-2a7a-41ef-a45e-520e03be7bb1 service nova] Creating event network-changed:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch2-master-1 Feb 19 21:38:17.040028 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-accb508e-0646-4e1a-b9c4-140ed73e0dd1 req-b7b36e1e-2a7a-41ef-a45e-520e03be7bb1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030427 Feb 19 21:38:17.041017 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3056/6025] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:38:17.061884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:17.068020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Old instance type m1.heat2, new instance type m1.heat {{(pid=136095) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:38:17.077809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:38:17.078239 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:38:17.078716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:38:17.079546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:38:17.079546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:38:17.150955 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc382cb8-7f39-4eb2-9898-92778396041a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e/action" status: 202 len: 0 microversion: 2.1 time: 0.150635 Feb 19 21:38:17.159835 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2970/6026] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:38:16 2022] POST /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:38:17.162602 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8e81c5a3-fb37-4baf-bd1f-e05ff338c889 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:17.163444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8e81c5a3-fb37-4baf-bd1f-e05ff338c889 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:17.173363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e81c5a3-fb37-4baf-bd1f-e05ff338c889 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:17.173585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e81c5a3-fb37-4baf-bd1f-e05ff338c889 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:17.174299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e81c5a3-fb37-4baf-bd1f-e05ff338c889 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:17.174858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e81c5a3-fb37-4baf-bd1f-e05ff338c889 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:17.435171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8e81c5a3-fb37-4baf-bd1f-e05ff338c889 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:17.444150 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8e81c5a3-fb37-4baf-bd1f-e05ff338c889 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1558 microversion: 2.1 time: 0.286218 Feb 19 21:38:17.454701 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3057/6027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:17 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1558 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:18.462315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aec56707-5484-45d9-aecc-042a6187e9ae tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:18.462960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-aec56707-5484-45d9-aecc-042a6187e9ae tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:18.469259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aec56707-5484-45d9-aecc-042a6187e9ae tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:18.469710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aec56707-5484-45d9-aecc-042a6187e9ae tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:18.470523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aec56707-5484-45d9-aecc-042a6187e9ae tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:18.470959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-aec56707-5484-45d9-aecc-042a6187e9ae tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:18.733799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-aec56707-5484-45d9-aecc-042a6187e9ae tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:18.741488 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aec56707-5484-45d9-aecc-042a6187e9ae tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1677 microversion: 2.1 time: 0.283728 Feb 19 21:38:18.742084 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2971/6028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:18 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1677 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:19.759898 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5dbbbc60-1702-4a8f-9232-2682cae71d4f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:19.760565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5dbbbc60-1702-4a8f-9232-2682cae71d4f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:19.767278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5dbbbc60-1702-4a8f-9232-2682cae71d4f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:19.767738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5dbbbc60-1702-4a8f-9232-2682cae71d4f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:19.768557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5dbbbc60-1702-4a8f-9232-2682cae71d4f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:19.769005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5dbbbc60-1702-4a8f-9232-2682cae71d4f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:19.908997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5dbbbc60-1702-4a8f-9232-2682cae71d4f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:19.917184 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5dbbbc60-1702-4a8f-9232-2682cae71d4f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.161723 Feb 19 21:38:19.917758 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3058/6029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:19 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:20.935141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b6543a13-0c8b-4f63-b129-0b21685d9162 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:20.935666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b6543a13-0c8b-4f63-b129-0b21685d9162 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:20.942489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6543a13-0c8b-4f63-b129-0b21685d9162 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:20.942945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6543a13-0c8b-4f63-b129-0b21685d9162 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:20.943726 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6543a13-0c8b-4f63-b129-0b21685d9162 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:20.944169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6543a13-0c8b-4f63-b129-0b21685d9162 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:21.075745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b6543a13-0c8b-4f63-b129-0b21685d9162 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:21.083081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b6543a13-0c8b-4f63-b129-0b21685d9162 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.152430 Feb 19 21:38:21.083665 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2972/6030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:20 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:22.100484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b2cf996d-bdab-4728-aa83-acf2a858357d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:22.101104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b2cf996d-bdab-4728-aa83-acf2a858357d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:22.107557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2cf996d-bdab-4728-aa83-acf2a858357d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:22.108015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2cf996d-bdab-4728-aa83-acf2a858357d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:22.108822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2cf996d-bdab-4728-aa83-acf2a858357d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:22.109265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b2cf996d-bdab-4728-aa83-acf2a858357d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:22.247429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b2cf996d-bdab-4728-aa83-acf2a858357d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:22.255269 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b2cf996d-bdab-4728-aa83-acf2a858357d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.158407 Feb 19 21:38:22.255879 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3059/6031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:22 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:23.273184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-77297ff5-091d-4994-b8d3-f724883614ee tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:23.273799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-77297ff5-091d-4994-b8d3-f724883614ee tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:23.280604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77297ff5-091d-4994-b8d3-f724883614ee tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:23.281059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77297ff5-091d-4994-b8d3-f724883614ee tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:23.281881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77297ff5-091d-4994-b8d3-f724883614ee tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:23.282323 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-77297ff5-091d-4994-b8d3-f724883614ee tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:23.416867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-77297ff5-091d-4994-b8d3-f724883614ee tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:23.424127 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-77297ff5-091d-4994-b8d3-f724883614ee tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.154712 Feb 19 21:38:23.424729 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2973/6032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:23 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:24.441817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aa93afcd-687a-4d22-b993-7ddefdb75525 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:24.442435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aa93afcd-687a-4d22-b993-7ddefdb75525 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:24.449989 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa93afcd-687a-4d22-b993-7ddefdb75525 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:24.450628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa93afcd-687a-4d22-b993-7ddefdb75525 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:24.451419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa93afcd-687a-4d22-b993-7ddefdb75525 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:24.451873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa93afcd-687a-4d22-b993-7ddefdb75525 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:24.589313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa93afcd-687a-4d22-b993-7ddefdb75525 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:24.596823 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aa93afcd-687a-4d22-b993-7ddefdb75525 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.158638 Feb 19 21:38:24.597404 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3060/6033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:24 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:25.614527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8bb8b5b4-6d8e-456d-959f-8961df3d7fde tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:25.615127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8bb8b5b4-6d8e-456d-959f-8961df3d7fde tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:25.622713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bb8b5b4-6d8e-456d-959f-8961df3d7fde tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:25.623167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bb8b5b4-6d8e-456d-959f-8961df3d7fde tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:25.623951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bb8b5b4-6d8e-456d-959f-8961df3d7fde tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:25.624449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8bb8b5b4-6d8e-456d-959f-8961df3d7fde tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:25.760227 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8bb8b5b4-6d8e-456d-959f-8961df3d7fde tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:25.767673 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8bb8b5b4-6d8e-456d-959f-8961df3d7fde tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.157149 Feb 19 21:38:25.768255 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2974/6034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:25 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:26.785827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bc393e62-659b-4438-be8c-60c7d361d50f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:26.786446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bc393e62-659b-4438-be8c-60c7d361d50f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:26.793950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc393e62-659b-4438-be8c-60c7d361d50f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:26.794412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc393e62-659b-4438-be8c-60c7d361d50f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:26.795197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc393e62-659b-4438-be8c-60c7d361d50f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:26.795649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bc393e62-659b-4438-be8c-60c7d361d50f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:26.928027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bc393e62-659b-4438-be8c-60c7d361d50f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:26.935542 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bc393e62-659b-4438-be8c-60c7d361d50f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.154048 Feb 19 21:38:26.936116 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3061/6035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:26 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:27.952721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-02be3e98-488f-4ad8-bc31-bc02e5104a35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:27.953241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-02be3e98-488f-4ad8-bc31-bc02e5104a35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:27.959957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02be3e98-488f-4ad8-bc31-bc02e5104a35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:27.960443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02be3e98-488f-4ad8-bc31-bc02e5104a35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:27.961229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02be3e98-488f-4ad8-bc31-bc02e5104a35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:27.961673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02be3e98-488f-4ad8-bc31-bc02e5104a35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:28.104510 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-02be3e98-488f-4ad8-bc31-bc02e5104a35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:28.111878 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-02be3e98-488f-4ad8-bc31-bc02e5104a35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.162962 Feb 19 21:38:28.112487 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2975/6036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:27 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:29.128827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3a6e71f2-d2d6-41bb-9309-d9433a05e2ca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:29.129455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3a6e71f2-d2d6-41bb-9309-d9433a05e2ca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:29.136234 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a6e71f2-d2d6-41bb-9309-d9433a05e2ca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:29.136734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a6e71f2-d2d6-41bb-9309-d9433a05e2ca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:29.137524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a6e71f2-d2d6-41bb-9309-d9433a05e2ca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:29.137975 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a6e71f2-d2d6-41bb-9309-d9433a05e2ca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:29.269971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3a6e71f2-d2d6-41bb-9309-d9433a05e2ca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:29.277619 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3a6e71f2-d2d6-41bb-9309-d9433a05e2ca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.152527 Feb 19 21:38:29.278193 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3062/6037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:29 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:30.295199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-91c79aac-519a-468f-9412-405d5414d0a5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:30.295799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-91c79aac-519a-468f-9412-405d5414d0a5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:30.302509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91c79aac-519a-468f-9412-405d5414d0a5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:30.302963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91c79aac-519a-468f-9412-405d5414d0a5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:30.303746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91c79aac-519a-468f-9412-405d5414d0a5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:30.304183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91c79aac-519a-468f-9412-405d5414d0a5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:30.443988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91c79aac-519a-468f-9412-405d5414d0a5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:30.451658 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-91c79aac-519a-468f-9412-405d5414d0a5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.160175 Feb 19 21:38:30.452240 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2976/6038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:30 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:31.468681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f746d75-e6d9-41f7-b12f-f5ac8cb5f9c5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:31.469307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f746d75-e6d9-41f7-b12f-f5ac8cb5f9c5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:31.476024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f746d75-e6d9-41f7-b12f-f5ac8cb5f9c5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:31.476534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f746d75-e6d9-41f7-b12f-f5ac8cb5f9c5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:31.477322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f746d75-e6d9-41f7-b12f-f5ac8cb5f9c5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:31.477807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f746d75-e6d9-41f7-b12f-f5ac8cb5f9c5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:31.610532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f746d75-e6d9-41f7-b12f-f5ac8cb5f9c5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:31.618006 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f746d75-e6d9-41f7-b12f-f5ac8cb5f9c5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.153064 Feb 19 21:38:31.618587 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3063/6039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:31 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:32.635398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2948adb5-61fc-4879-8708-61a09d35dc97 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:32.636018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2948adb5-61fc-4879-8708-61a09d35dc97 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:32.642703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2948adb5-61fc-4879-8708-61a09d35dc97 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:32.643153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2948adb5-61fc-4879-8708-61a09d35dc97 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:32.643927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2948adb5-61fc-4879-8708-61a09d35dc97 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:32.644412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2948adb5-61fc-4879-8708-61a09d35dc97 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:32.776924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2948adb5-61fc-4879-8708-61a09d35dc97 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:32.784373 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2948adb5-61fc-4879-8708-61a09d35dc97 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.153243 Feb 19 21:38:32.784945 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2977/6040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:32 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:33.801694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7bf26c1e-533c-4a94-a25c-7186e270f701 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:33.802358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7bf26c1e-533c-4a94-a25c-7186e270f701 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:33.809111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bf26c1e-533c-4a94-a25c-7186e270f701 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:33.809574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bf26c1e-533c-4a94-a25c-7186e270f701 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:33.810365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bf26c1e-533c-4a94-a25c-7186e270f701 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:33.810813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7bf26c1e-533c-4a94-a25c-7186e270f701 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:33.949321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7bf26c1e-533c-4a94-a25c-7186e270f701 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:33.956744 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7bf26c1e-533c-4a94-a25c-7186e270f701 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.158692 Feb 19 21:38:33.957249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3064/6041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:33 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:34.973629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f5eafa9-f451-4701-b187-ff1930b5c0f4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:34.974203 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f5eafa9-f451-4701-b187-ff1930b5c0f4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:34.981040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f5eafa9-f451-4701-b187-ff1930b5c0f4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:34.981496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f5eafa9-f451-4701-b187-ff1930b5c0f4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:34.982285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f5eafa9-f451-4701-b187-ff1930b5c0f4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:34.982731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f5eafa9-f451-4701-b187-ff1930b5c0f4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:35.114814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f5eafa9-f451-4701-b187-ff1930b5c0f4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:35.122803 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f5eafa9-f451-4701-b187-ff1930b5c0f4 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.152992 Feb 19 21:38:35.123381 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2978/6042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:34 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:36.139052 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d4a29fd7-df72-4f3a-b95a-f67d909d5feb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:36.139669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d4a29fd7-df72-4f3a-b95a-f67d909d5feb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:36.146474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4a29fd7-df72-4f3a-b95a-f67d909d5feb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:36.146935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4a29fd7-df72-4f3a-b95a-f67d909d5feb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:36.147912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4a29fd7-df72-4f3a-b95a-f67d909d5feb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:36.148413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4a29fd7-df72-4f3a-b95a-f67d909d5feb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:36.284986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d4a29fd7-df72-4f3a-b95a-f67d909d5feb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:36.293128 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d4a29fd7-df72-4f3a-b95a-f67d909d5feb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.157871 Feb 19 21:38:36.293711 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3065/6043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:36 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:37.310089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-50fb61b1-4996-4695-b63e-0fbafcfb5654 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:37.310735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-50fb61b1-4996-4695-b63e-0fbafcfb5654 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:37.317054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50fb61b1-4996-4695-b63e-0fbafcfb5654 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:37.317506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50fb61b1-4996-4695-b63e-0fbafcfb5654 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:37.318292 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50fb61b1-4996-4695-b63e-0fbafcfb5654 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:37.318739 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50fb61b1-4996-4695-b63e-0fbafcfb5654 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:37.450668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-50fb61b1-4996-4695-b63e-0fbafcfb5654 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:37.458052 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-50fb61b1-4996-4695-b63e-0fbafcfb5654 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.151909 Feb 19 21:38:37.458629 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2979/6044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:37 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:38.475497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c6e058d3-db78-46e6-8a53-63cfff387500 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:38.476111 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c6e058d3-db78-46e6-8a53-63cfff387500 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:38.483245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6e058d3-db78-46e6-8a53-63cfff387500 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:38.483703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6e058d3-db78-46e6-8a53-63cfff387500 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:38.484513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6e058d3-db78-46e6-8a53-63cfff387500 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:38.484960 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c6e058d3-db78-46e6-8a53-63cfff387500 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:38.620847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c6e058d3-db78-46e6-8a53-63cfff387500 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:38.628196 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c6e058d3-db78-46e6-8a53-63cfff387500 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.156453 Feb 19 21:38:38.628796 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3066/6045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:38 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:39.589095 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:38:39.589684 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 21:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:38:39.644590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b47405ec-8802-44ac-8d93-b0b6f805a84b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:39.645228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b47405ec-8802-44ac-8d93-b0b6f805a84b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:39.651745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b47405ec-8802-44ac-8d93-b0b6f805a84b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:39.652199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b47405ec-8802-44ac-8d93-b0b6f805a84b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:39.653096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b47405ec-8802-44ac-8d93-b0b6f805a84b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:39.653539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b47405ec-8802-44ac-8d93-b0b6f805a84b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:39.788925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b47405ec-8802-44ac-8d93-b0b6f805a84b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:39.796893 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b47405ec-8802-44ac-8d93-b0b6f805a84b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.155846 Feb 19 21:38:39.797481 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2980/6046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:39 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:40.813946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7f137412-336b-4122-99e0-b462c196e3cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:40.814565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7f137412-336b-4122-99e0-b462c196e3cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:40.821531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f137412-336b-4122-99e0-b462c196e3cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:40.822658 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f137412-336b-4122-99e0-b462c196e3cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:40.823454 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f137412-336b-4122-99e0-b462c196e3cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:40.823901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7f137412-336b-4122-99e0-b462c196e3cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:40.956711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7f137412-336b-4122-99e0-b462c196e3cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:40.963953 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7f137412-336b-4122-99e0-b462c196e3cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.153727 Feb 19 21:38:40.964563 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3067/6047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:40 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:41.981120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1fd829cb-e660-4279-b416-26b0e744f922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:41.981655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1fd829cb-e660-4279-b416-26b0e744f922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:41.988555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fd829cb-e660-4279-b416-26b0e744f922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:41.989083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fd829cb-e660-4279-b416-26b0e744f922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:41.989877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fd829cb-e660-4279-b416-26b0e744f922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:41.990320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1fd829cb-e660-4279-b416-26b0e744f922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:42.128983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1fd829cb-e660-4279-b416-26b0e744f922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:42.136966 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1fd829cb-e660-4279-b416-26b0e744f922 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.159751 Feb 19 21:38:42.137548 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2981/6048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:41 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:43.154114 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d7462b7b-c702-4fa9-ab98-f880db8f6901 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:43.154742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d7462b7b-c702-4fa9-ab98-f880db8f6901 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:43.161509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7462b7b-c702-4fa9-ab98-f880db8f6901 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:43.161974 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7462b7b-c702-4fa9-ab98-f880db8f6901 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:43.162768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7462b7b-c702-4fa9-ab98-f880db8f6901 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:43.163255 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d7462b7b-c702-4fa9-ab98-f880db8f6901 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:43.296194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d7462b7b-c702-4fa9-ab98-f880db8f6901 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:43.303605 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d7462b7b-c702-4fa9-ab98-f880db8f6901 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.153774 Feb 19 21:38:43.304366 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3068/6049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:43 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:44.321377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-50c21806-2c91-40af-87e0-7e20728239e9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:44.321973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-50c21806-2c91-40af-87e0-7e20728239e9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:44.328790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50c21806-2c91-40af-87e0-7e20728239e9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:44.329240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50c21806-2c91-40af-87e0-7e20728239e9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:44.330014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50c21806-2c91-40af-87e0-7e20728239e9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:44.330454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-50c21806-2c91-40af-87e0-7e20728239e9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:44.464679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-50c21806-2c91-40af-87e0-7e20728239e9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:44.471992 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-50c21806-2c91-40af-87e0-7e20728239e9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.155164 Feb 19 21:38:44.472593 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2982/6050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:44 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:45.488873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1255a382-13d8-46db-9623-7884bb8154aa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:45.489590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1255a382-13d8-46db-9623-7884bb8154aa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:45.497161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1255a382-13d8-46db-9623-7884bb8154aa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:45.497630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1255a382-13d8-46db-9623-7884bb8154aa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:45.498431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1255a382-13d8-46db-9623-7884bb8154aa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:45.498883 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1255a382-13d8-46db-9623-7884bb8154aa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:45.634280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1255a382-13d8-46db-9623-7884bb8154aa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:45.642345 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1255a382-13d8-46db-9623-7884bb8154aa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1682 microversion: 2.1 time: 0.157264 Feb 19 21:38:45.642929 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3069/6051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:45 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:46.659200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-34173930-d469-41a9-9250-0905508dd912 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:46.659776 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-34173930-d469-41a9-9250-0905508dd912 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:46.667360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34173930-d469-41a9-9250-0905508dd912 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:46.667819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34173930-d469-41a9-9250-0905508dd912 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:46.668640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34173930-d469-41a9-9250-0905508dd912 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:46.669080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34173930-d469-41a9-9250-0905508dd912 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:46.754154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-808b9afe-b917-47c6-8a69-d8db8e9a6c01 req-6b24c659-b5e6-4325-92ba-024932a4bba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "name": "network-vif-unplugged", "status": "completed", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:46.756066 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:38:46.756066 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:38:46.765850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-808b9afe-b917-47c6-8a69-d8db8e9a6c01 req-6b24c659-b5e6-4325-92ba-024932a4bba1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:46.766311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-808b9afe-b917-47c6-8a69-d8db8e9a6c01 req-6b24c659-b5e6-4325-92ba-024932a4bba1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:46.778497 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-808b9afe-b917-47c6-8a69-d8db8e9a6c01 req-6b24c659-b5e6-4325-92ba-024932a4bba1 service nova] Creating event network-vif-unplugged:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch1-master-1 Feb 19 21:38:46.784368 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-808b9afe-b917-47c6-8a69-d8db8e9a6c01 req-6b24c659-b5e6-4325-92ba-024932a4bba1 service nova] Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:38:46.799325 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-808b9afe-b917-47c6-8a69-d8db8e9a6c01 req-6b24c659-b5e6-4325-92ba-024932a4bba1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048481 Feb 19 21:38:46.800949 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3070/6052] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:38:46.811745 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-34173930-d469-41a9-9250-0905508dd912 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:46.819927 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-34173930-d469-41a9-9250-0905508dd912 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1681 microversion: 2.1 time: 0.164692 Feb 19 21:38:46.821324 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2983/6053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:46 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:47.839891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2369d609-581f-4d92-8553-a7ab0cfbe916 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:47.840665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2369d609-581f-4d92-8553-a7ab0cfbe916 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:47.846991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2369d609-581f-4d92-8553-a7ab0cfbe916 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:47.847455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2369d609-581f-4d92-8553-a7ab0cfbe916 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:47.848278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2369d609-581f-4d92-8553-a7ab0cfbe916 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:47.848754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2369d609-581f-4d92-8553-a7ab0cfbe916 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:47.987795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2369d609-581f-4d92-8553-a7ab0cfbe916 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:47.995349 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2369d609-581f-4d92-8553-a7ab0cfbe916 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1679 microversion: 2.1 time: 0.160888 Feb 19 21:38:47.995990 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3071/6054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:47 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:48.817216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-47087fa4-3dfd-4444-889a-36a7503d1a6a req-11e6ea8f-4384-4d34-85b0-06c0fd7c7d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:48.818732 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:38:48.818732 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:38:48.826799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-47087fa4-3dfd-4444-889a-36a7503d1a6a req-11e6ea8f-4384-4d34-85b0-06c0fd7c7d84 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:48.827240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-47087fa4-3dfd-4444-889a-36a7503d1a6a req-11e6ea8f-4384-4d34-85b0-06c0fd7c7d84 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:48.838535 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-47087fa4-3dfd-4444-889a-36a7503d1a6a req-11e6ea8f-4384-4d34-85b0-06c0fd7c7d84 service nova] Creating event network-changed:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch1-master-1 Feb 19 21:38:48.843697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-47087fa4-3dfd-4444-889a-36a7503d1a6a req-11e6ea8f-4384-4d34-85b0-06c0fd7c7d84 service nova] Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:38:48.855105 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-47087fa4-3dfd-4444-889a-36a7503d1a6a req-11e6ea8f-4384-4d34-85b0-06c0fd7c7d84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041621 Feb 19 21:38:48.855749 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2984/6055] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:38:49.013228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-be1276d4-6f37-4fd6-aa0d-0f2efc6331f9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:49.013837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-be1276d4-6f37-4fd6-aa0d-0f2efc6331f9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:49.021260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be1276d4-6f37-4fd6-aa0d-0f2efc6331f9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:49.021749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be1276d4-6f37-4fd6-aa0d-0f2efc6331f9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:49.022592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be1276d4-6f37-4fd6-aa0d-0f2efc6331f9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:49.023038 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-be1276d4-6f37-4fd6-aa0d-0f2efc6331f9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:49.250617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-be1276d4-6f37-4fd6-aa0d-0f2efc6331f9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:49.266460 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-be1276d4-6f37-4fd6-aa0d-0f2efc6331f9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1679 microversion: 2.1 time: 0.256946 Feb 19 21:38:49.267079 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3072/6056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:49 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1679 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:50.285412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3ef51188-fd82-4be5-8f3b-136a6d599687 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:50.286144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3ef51188-fd82-4be5-8f3b-136a6d599687 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:50.292741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ef51188-fd82-4be5-8f3b-136a6d599687 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:50.293212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ef51188-fd82-4be5-8f3b-136a6d599687 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:50.293965 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ef51188-fd82-4be5-8f3b-136a6d599687 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:50.294396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3ef51188-fd82-4be5-8f3b-136a6d599687 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:50.427800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3ef51188-fd82-4be5-8f3b-136a6d599687 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:50.435212 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3ef51188-fd82-4be5-8f3b-136a6d599687 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1676 microversion: 2.1 time: 0.154737 Feb 19 21:38:50.435780 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2985/6057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:50 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:50.451420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:50.451965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:50.458666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:50.459131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:50.459915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:50.460396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:50.492446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:50.492902 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:50.493765 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:50.494208 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:50.513345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:38:50.518337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for user f14d8011b7c241f7b5ecdee4c3f44ae4 and project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:38:50.620716 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-41e83278-4568-4ee1-a725-11ac24bbefe7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e/action" status: 202 len: 0 microversion: 2.1 time: 0.172695 Feb 19 21:38:50.622264 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3073/6058] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:38:50 2022] POST /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:38:50.630182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8e61cd34-0962-4423-957a-91dc0c30cdd5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:50.630888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8e61cd34-0962-4423-957a-91dc0c30cdd5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:50.636784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e61cd34-0962-4423-957a-91dc0c30cdd5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:50.637231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e61cd34-0962-4423-957a-91dc0c30cdd5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:50.638144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e61cd34-0962-4423-957a-91dc0c30cdd5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:50.638577 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8e61cd34-0962-4423-957a-91dc0c30cdd5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:50.784273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8e61cd34-0962-4423-957a-91dc0c30cdd5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:50.792344 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8e61cd34-0962-4423-957a-91dc0c30cdd5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1675 microversion: 2.1 time: 0.165845 Feb 19 21:38:50.792980 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2986/6059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:50 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:51.811543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dfd5e2eb-ed11-4cc0-a220-24e7b7762786 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:51.812263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dfd5e2eb-ed11-4cc0-a220-24e7b7762786 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:51.819384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dfd5e2eb-ed11-4cc0-a220-24e7b7762786 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:51.819877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dfd5e2eb-ed11-4cc0-a220-24e7b7762786 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:51.820942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dfd5e2eb-ed11-4cc0-a220-24e7b7762786 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:51.821398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dfd5e2eb-ed11-4cc0-a220-24e7b7762786 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:51.850095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b09f25c3-6a12-4303-9ace-b86c9215f01b req-09b2c4e4-d9d3-40b1-9f44-02051598dd5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "name": "network-vif-plugged", "status": "completed", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:51.852593 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:38:51.852593 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:38:51.863113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b09f25c3-6a12-4303-9ace-b86c9215f01b req-09b2c4e4-d9d3-40b1-9f44-02051598dd5f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:51.863574 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b09f25c3-6a12-4303-9ace-b86c9215f01b req-09b2c4e4-d9d3-40b1-9f44-02051598dd5f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:51.876720 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b09f25c3-6a12-4303-9ace-b86c9215f01b req-09b2c4e4-d9d3-40b1-9f44-02051598dd5f service nova] Creating event network-vif-plugged:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch1-master-1 Feb 19 21:38:51.882723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-b09f25c3-6a12-4303-9ace-b86c9215f01b req-09b2c4e4-d9d3-40b1-9f44-02051598dd5f service nova] Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:38:51.895773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b09f25c3-6a12-4303-9ace-b86c9215f01b req-09b2c4e4-d9d3-40b1-9f44-02051598dd5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049435 Feb 19 21:38:51.896018 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2987/6060] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:38:52.303761 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dfd5e2eb-ed11-4cc0-a220-24e7b7762786 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:52.311241 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dfd5e2eb-ed11-4cc0-a220-24e7b7762786 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1675 microversion: 2.1 time: 0.505918 Feb 19 21:38:52.311804 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3074/6061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:51 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1675 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:53.330161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e425608a-9bf7-4fe5-b852-2fe30994a127 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:53.330790 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e425608a-9bf7-4fe5-b852-2fe30994a127 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:53.337089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e425608a-9bf7-4fe5-b852-2fe30994a127 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:53.337533 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e425608a-9bf7-4fe5-b852-2fe30994a127 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:53.338377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e425608a-9bf7-4fe5-b852-2fe30994a127 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:53.338832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e425608a-9bf7-4fe5-b852-2fe30994a127 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:53.601603 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e425608a-9bf7-4fe5-b852-2fe30994a127 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:53.610574 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e425608a-9bf7-4fe5-b852-2fe30994a127 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1675 microversion: 2.1 time: 0.285285 Feb 19 21:38:53.611259 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2988/6062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:53 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1675 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:53.779846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-63082294-8397-447b-b258-24e23364176e req-dbf298cc-fe54-43ed-9dbc-97f94c491406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "name": "network-vif-unplugged", "status": "completed", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:53.781474 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:38:53.781474 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:38:53.789735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-63082294-8397-447b-b258-24e23364176e req-dbf298cc-fe54-43ed-9dbc-97f94c491406 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:53.790197 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-63082294-8397-447b-b258-24e23364176e req-dbf298cc-fe54-43ed-9dbc-97f94c491406 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:53.801924 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-63082294-8397-447b-b258-24e23364176e req-dbf298cc-fe54-43ed-9dbc-97f94c491406 service nova] Creating event network-vif-unplugged:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch2-master-1 Feb 19 21:38:53.807282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-63082294-8397-447b-b258-24e23364176e req-dbf298cc-fe54-43ed-9dbc-97f94c491406 service nova] Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:38:53.818210 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-63082294-8397-447b-b258-24e23364176e req-dbf298cc-fe54-43ed-9dbc-97f94c491406 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042497 Feb 19 21:38:53.818824 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3075/6063] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:38:54.627305 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2f594276-3163-4138-8f62-9da8fdeccd7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:54.627959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2f594276-3163-4138-8f62-9da8fdeccd7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:54.634771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f594276-3163-4138-8f62-9da8fdeccd7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:54.635230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f594276-3163-4138-8f62-9da8fdeccd7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:54.636080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f594276-3163-4138-8f62-9da8fdeccd7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:54.636557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2f594276-3163-4138-8f62-9da8fdeccd7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:54.826496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2f594276-3163-4138-8f62-9da8fdeccd7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:54.833875 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2f594276-3163-4138-8f62-9da8fdeccd7b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1675 microversion: 2.1 time: 0.210297 Feb 19 21:38:54.834486 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2989/6064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:54 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1675 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:55.834366 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ec059025-d4c5-43b6-8c03-2d74d84f09bb req-6bfc1993-5eea-44a0-b5f3-ad220ae7a483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:38:55.835826 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:38:55.835826 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:38:55.843460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ec059025-d4c5-43b6-8c03-2d74d84f09bb req-6bfc1993-5eea-44a0-b5f3-ad220ae7a483 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:55.843915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ec059025-d4c5-43b6-8c03-2d74d84f09bb req-6bfc1993-5eea-44a0-b5f3-ad220ae7a483 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:55.850677 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b4fab83-5b36-43d9-8c94-25f28137a921 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:55.851301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b4fab83-5b36-43d9-8c94-25f28137a921 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:55.855982 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ec059025-d4c5-43b6-8c03-2d74d84f09bb req-6bfc1993-5eea-44a0-b5f3-ad220ae7a483 service nova] Creating event network-changed:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch2-master-1 Feb 19 21:38:55.858740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b4fab83-5b36-43d9-8c94-25f28137a921 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:55.859198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b4fab83-5b36-43d9-8c94-25f28137a921 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:55.859994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b4fab83-5b36-43d9-8c94-25f28137a921 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:55.860465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b4fab83-5b36-43d9-8c94-25f28137a921 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:55.861311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-ec059025-d4c5-43b6-8c03-2d74d84f09bb req-6bfc1993-5eea-44a0-b5f3-ad220ae7a483 service nova] Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:38:55.872243 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ec059025-d4c5-43b6-8c03-2d74d84f09bb req-6bfc1993-5eea-44a0-b5f3-ad220ae7a483 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042690 Feb 19 21:38:55.872884 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3076/6065] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:38:56.085179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9b4fab83-5b36-43d9-8c94-25f28137a921 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:56.093487 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b4fab83-5b36-43d9-8c94-25f28137a921 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1675 microversion: 2.1 time: 0.246502 Feb 19 21:38:56.094075 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2990/6066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:55 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:38:57.112463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46d5d147-3a6c-477c-95b9-8bd9da217cc7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:57.113173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-46d5d147-3a6c-477c-95b9-8bd9da217cc7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:57.119369 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46d5d147-3a6c-477c-95b9-8bd9da217cc7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:57.120520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46d5d147-3a6c-477c-95b9-8bd9da217cc7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:57.121318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46d5d147-3a6c-477c-95b9-8bd9da217cc7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:57.121763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46d5d147-3a6c-477c-95b9-8bd9da217cc7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:57.257027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-46d5d147-3a6c-477c-95b9-8bd9da217cc7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:57.264415 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-46d5d147-3a6c-477c-95b9-8bd9da217cc7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1675 microversion: 2.1 time: 0.156891 Feb 19 21:38:57.264988 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3077/6067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:57 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:58.286134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ad60c759-4831-4ec1-b30f-bee55debe0d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:58.286756 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ad60c759-4831-4ec1-b30f-bee55debe0d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:58.295047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad60c759-4831-4ec1-b30f-bee55debe0d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.295509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad60c759-4831-4ec1-b30f-bee55debe0d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:58.296300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad60c759-4831-4ec1-b30f-bee55debe0d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.296769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ad60c759-4831-4ec1-b30f-bee55debe0d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:58.435926 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ad60c759-4831-4ec1-b30f-bee55debe0d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:58.443789 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ad60c759-4831-4ec1-b30f-bee55debe0d3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1668 microversion: 2.1 time: 0.161254 Feb 19 21:38:58.444814 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2991/6068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:58 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:58.459919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5391ba1d-18e0-4948-bae7-ee0157c9f28d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:58.460564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5391ba1d-18e0-4948-bae7-ee0157c9f28d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:58.467211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5391ba1d-18e0-4948-bae7-ee0157c9f28d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.467692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5391ba1d-18e0-4948-bae7-ee0157c9f28d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:58.468488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5391ba1d-18e0-4948-bae7-ee0157c9f28d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.468936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5391ba1d-18e0-4948-bae7-ee0157c9f28d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:58.605923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5391ba1d-18e0-4948-bae7-ee0157c9f28d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:58.613360 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5391ba1d-18e0-4948-bae7-ee0157c9f28d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1668 microversion: 2.1 time: 0.157045 Feb 19 21:38:58.613926 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3078/6069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:58 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:38:58.629545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1b659bf9-6c03-42c5-bc67-1bf92b03a817 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:58.630266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1b659bf9-6c03-42c5-bc67-1bf92b03a817 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:58.638116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b659bf9-6c03-42c5-bc67-1bf92b03a817 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.638573 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b659bf9-6c03-42c5-bc67-1bf92b03a817 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:58.639365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b659bf9-6c03-42c5-bc67-1bf92b03a817 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.639804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1b659bf9-6c03-42c5-bc67-1bf92b03a817 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:58.773434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1b659bf9-6c03-42c5-bc67-1bf92b03a817 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:58.781867 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1b659bf9-6c03-42c5-bc67-1bf92b03a817 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1668 microversion: 2.1 time: 0.155583 Feb 19 21:38:58.782724 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2992/6070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:58 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:38:58.798950 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9cf12359-3c83-483c-b7bd-61dd76b1de48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:58.799465 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9cf12359-3c83-483c-b7bd-61dd76b1de48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:58.805581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cf12359-3c83-483c-b7bd-61dd76b1de48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.805997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cf12359-3c83-483c-b7bd-61dd76b1de48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:58.806797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cf12359-3c83-483c-b7bd-61dd76b1de48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.807251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cf12359-3c83-483c-b7bd-61dd76b1de48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:58.836102 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9cf12359-3c83-483c-b7bd-61dd76b1de48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:38:58.916232 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9cf12359-3c83-483c-b7bd-61dd76b1de48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 204 len: 0 microversion: 2.1 time: 0.120957 Feb 19 21:38:58.917655 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3079/6071] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:38:58 2022] DELETE /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:38:58.925602 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5b9dc56f-466e-4ff3-9f82-ee7fa187fcb9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:38:58.926218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5b9dc56f-466e-4ff3-9f82-ee7fa187fcb9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:38:58.932065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b9dc56f-466e-4ff3-9f82-ee7fa187fcb9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.932589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b9dc56f-466e-4ff3-9f82-ee7fa187fcb9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:58.933369 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b9dc56f-466e-4ff3-9f82-ee7fa187fcb9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:38:58.933809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5b9dc56f-466e-4ff3-9f82-ee7fa187fcb9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:38:59.069498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5b9dc56f-466e-4ff3-9f82-ee7fa187fcb9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:38:59.077622 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5b9dc56f-466e-4ff3-9f82-ee7fa187fcb9 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1674 microversion: 2.1 time: 0.155718 Feb 19 21:38:59.078201 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2993/6072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:38:58 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:00.081352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-892434ca-1aaa-4915-b83d-8d575c17c811 req-8974f62f-81a6-4736-b2ed-514c13af5aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "name": "network-vif-plugged", "status": "completed", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:00.082874 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:00.082874 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:39:00.091104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-892434ca-1aaa-4915-b83d-8d575c17c811 req-8974f62f-81a6-4736-b2ed-514c13af5aec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:00.091577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-892434ca-1aaa-4915-b83d-8d575c17c811 req-8974f62f-81a6-4736-b2ed-514c13af5aec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:00.095476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4758e965-4b80-41d0-9c94-d4b3af7b7216 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:00.097247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4758e965-4b80-41d0-9c94-d4b3af7b7216 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:00.103328 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-892434ca-1aaa-4915-b83d-8d575c17c811 req-8974f62f-81a6-4736-b2ed-514c13af5aec service nova] Creating event network-vif-plugged:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch2-master-1 Feb 19 21:39:00.104917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4758e965-4b80-41d0-9c94-d4b3af7b7216 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:00.105372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4758e965-4b80-41d0-9c94-d4b3af7b7216 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:00.106158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4758e965-4b80-41d0-9c94-d4b3af7b7216 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:00.107450 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4758e965-4b80-41d0-9c94-d4b3af7b7216 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:00.108770 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-892434ca-1aaa-4915-b83d-8d575c17c811 req-8974f62f-81a6-4736-b2ed-514c13af5aec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031847 Feb 19 21:39:00.109365 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3080/6073] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:00.248082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4758e965-4b80-41d0-9c94-d4b3af7b7216 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:00.255522 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4758e965-4b80-41d0-9c94-d4b3af7b7216 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1674 microversion: 2.1 time: 0.164651 Feb 19 21:39:00.256100 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2994/6074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:00 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:01.273519 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e5723984-34f9-471e-8ddb-4b1d3d181b8a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:01.274236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e5723984-34f9-471e-8ddb-4b1d3d181b8a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:01.277501 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-929e1cf4-df4e-4747-98e8-068bc98baf14 req-ae18cd42-595e-4b19-b532-e185a29c7c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d7baba-6d4e-471b-9c6a-8bd68a76911e", "name": "network-vif-deleted", "tag": "aa7ab863-85c8-4936-985e-59cae943c29d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:01.279955 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:01.279955 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:39:01.280652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5723984-34f9-471e-8ddb-4b1d3d181b8a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:01.281126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5723984-34f9-471e-8ddb-4b1d3d181b8a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:01.282137 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5723984-34f9-471e-8ddb-4b1d3d181b8a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:01.282587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e5723984-34f9-471e-8ddb-4b1d3d181b8a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:01.296299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-929e1cf4-df4e-4747-98e8-068bc98baf14 req-ae18cd42-595e-4b19-b532-e185a29c7c30 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:01.297620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-929e1cf4-df4e-4747-98e8-068bc98baf14 req-ae18cd42-595e-4b19-b532-e185a29c7c30 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:01.311949 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-929e1cf4-df4e-4747-98e8-068bc98baf14 req-ae18cd42-595e-4b19-b532-e185a29c7c30 service nova] Creating event network-vif-deleted:aa7ab863-85c8-4936-985e-59cae943c29d for instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e on nch2-master-1 Feb 19 21:39:01.320440 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-929e1cf4-df4e-4747-98e8-068bc98baf14 req-ae18cd42-595e-4b19-b532-e185a29c7c30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046727 Feb 19 21:39:01.323166 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2995/6075] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:01.367791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e5723984-34f9-471e-8ddb-4b1d3d181b8a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:01.378313 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e5723984-34f9-471e-8ddb-4b1d3d181b8a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 200 len: 1607 microversion: 2.1 time: 0.108955 Feb 19 21:39:01.379025 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3081/6076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:01 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 1607 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:02.395586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c62571a0-bf5c-4157-93b8-6fa7f6a048ec tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:02.396213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c62571a0-bf5c-4157-93b8-6fa7f6a048ec tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:02.404216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c62571a0-bf5c-4157-93b8-6fa7f6a048ec tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:02.404711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c62571a0-bf5c-4157-93b8-6fa7f6a048ec tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:02.405509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c62571a0-bf5c-4157-93b8-6fa7f6a048ec tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:02.405956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c62571a0-bf5c-4157-93b8-6fa7f6a048ec tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:02.420318 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-c62571a0-bf5c-4157-93b8-6fa7f6a048ec tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e could not be found. Feb 19 21:39:02.420952 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c62571a0-bf5c-4157-93b8-6fa7f6a048ec tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:02.421792 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c62571a0-bf5c-4157-93b8-6fa7f6a048ec tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 404 len: 111 microversion: 2.1 time: 0.030354 Feb 19 21:39:02.422355 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2996/6077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:02 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:02.441430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a7736be-d39a-48d6-ad7f-432a13323c02 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:02.442057 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a7736be-d39a-48d6-ad7f-432a13323c02 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:02.450191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a7736be-d39a-48d6-ad7f-432a13323c02 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:02.450639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a7736be-d39a-48d6-ad7f-432a13323c02 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:02.451440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a7736be-d39a-48d6-ad7f-432a13323c02 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:02.451945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a7736be-d39a-48d6-ad7f-432a13323c02 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:02.466204 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-1a7736be-d39a-48d6-ad7f-432a13323c02 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e could not be found. Feb 19 21:39:02.466816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a7736be-d39a-48d6-ad7f-432a13323c02 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:02.467667 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1a7736be-d39a-48d6-ad7f-432a13323c02 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 404 len: 111 microversion: 2.1 time: 0.030065 Feb 19 21:39:02.468712 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3082/6078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:02 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:02.516559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-571987524", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "f342daca-48e4-4cbe-b7ce-0803d4de7cbe"}], "security_groups": [{"name": "tempest-securitygroup--129379875"}], "key_name": "tempest-keypair-129249094", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:02.617961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] validate_networks() for [('f342daca-48e4-4cbe-b7ce-0803d4de7cbe', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:39:02.990568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:39:02.990992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:39:02.991472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:39:02.991880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:39:02.992291 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:39:03.001019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:03.001465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:03.002272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:03.002705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:03.019336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:39:03.024320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for user f14d8011b7c241f7b5ecdee4c3f44ae4 and project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:39:03.036799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:39:03.039103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:39:03.084221 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06bb14ca-5f29-4aad-accb-fa5f69f75c17 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.571273 Feb 19 21:39:03.085082 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2997/6079] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:39:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:39:03.094726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-263f5e62-92c6-49df-8dc0-1c86658c8f6f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:03.095471 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-263f5e62-92c6-49df-8dc0-1c86658c8f6f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:03.151587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-263f5e62-92c6-49df-8dc0-1c86658c8f6f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:03.158733 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-263f5e62-92c6-49df-8dc0-1c86658c8f6f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1237 microversion: 2.1 time: 0.067615 Feb 19 21:39:03.159341 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3083/6080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:03 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:39:04.177524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-44a6cc94-5ae0-4a7d-aaaf-f6b7a3a40f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:04.178142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-44a6cc94-5ae0-4a7d-aaaf-f6b7a3a40f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:04.184809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44a6cc94-5ae0-4a7d-aaaf-f6b7a3a40f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:04.185269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44a6cc94-5ae0-4a7d-aaaf-f6b7a3a40f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:04.186055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44a6cc94-5ae0-4a7d-aaaf-f6b7a3a40f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:04.186498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-44a6cc94-5ae0-4a7d-aaaf-f6b7a3a40f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:04.263244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-44a6cc94-5ae0-4a7d-aaaf-f6b7a3a40f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:04.270600 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-44a6cc94-5ae0-4a7d-aaaf-f6b7a3a40f0b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1295 microversion: 2.1 time: 0.097668 Feb 19 21:39:04.271183 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2998/6081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:04 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1295 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:05.288081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e6812367-7b95-4b99-a361-e9dc0964babe tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:05.288905 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e6812367-7b95-4b99-a361-e9dc0964babe tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:05.297172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6812367-7b95-4b99-a361-e9dc0964babe tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:05.297643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6812367-7b95-4b99-a361-e9dc0964babe tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:05.298488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6812367-7b95-4b99-a361-e9dc0964babe tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:05.299135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e6812367-7b95-4b99-a361-e9dc0964babe tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:05.404738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-96b34b4c-b478-4803-8309-bbe9b13fc425 req-14c161d6-39f3-4aee-8852-9f7e82de5950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:05.408473 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:05.408473 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:39:05.418995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-96b34b4c-b478-4803-8309-bbe9b13fc425 req-14c161d6-39f3-4aee-8852-9f7e82de5950 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:05.419547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-96b34b4c-b478-4803-8309-bbe9b13fc425 req-14c161d6-39f3-4aee-8852-9f7e82de5950 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:05.431608 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-96b34b4c-b478-4803-8309-bbe9b13fc425 req-14c161d6-39f3-4aee-8852-9f7e82de5950 service nova] Creating event network-changed:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch2-master-1 Feb 19 21:39:05.438479 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-96b34b4c-b478-4803-8309-bbe9b13fc425 req-14c161d6-39f3-4aee-8852-9f7e82de5950 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038738 Feb 19 21:39:05.439806 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 2999/6082] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:39:05.576817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e6812367-7b95-4b99-a361-e9dc0964babe tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:05.584414 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e6812367-7b95-4b99-a361-e9dc0964babe tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1362 microversion: 2.1 time: 0.300072 Feb 19 21:39:05.584927 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3084/6083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:05 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:06.608398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-66bf25a6-0b5d-4b6a-8f39-6fbf8e5c5d61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:06.609098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-66bf25a6-0b5d-4b6a-8f39-6fbf8e5c5d61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:06.618628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66bf25a6-0b5d-4b6a-8f39-6fbf8e5c5d61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:06.619434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66bf25a6-0b5d-4b6a-8f39-6fbf8e5c5d61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:06.620864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66bf25a6-0b5d-4b6a-8f39-6fbf8e5c5d61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:06.621629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-66bf25a6-0b5d-4b6a-8f39-6fbf8e5c5d61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:06.758278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-66bf25a6-0b5d-4b6a-8f39-6fbf8e5c5d61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:06.766204 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-66bf25a6-0b5d-4b6a-8f39-6fbf8e5c5d61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1362 microversion: 2.1 time: 0.162220 Feb 19 21:39:06.766791 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3000/6084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:06 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:39:07.783446 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d1d6d046-85c3-4894-8810-9f0cb9c2acbf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:07.784069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d1d6d046-85c3-4894-8810-9f0cb9c2acbf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:07.790610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1d6d046-85c3-4894-8810-9f0cb9c2acbf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:07.791076 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1d6d046-85c3-4894-8810-9f0cb9c2acbf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:07.791867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1d6d046-85c3-4894-8810-9f0cb9c2acbf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:07.792994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d1d6d046-85c3-4894-8810-9f0cb9c2acbf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:07.930917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d1d6d046-85c3-4894-8810-9f0cb9c2acbf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:07.938352 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d1d6d046-85c3-4894-8810-9f0cb9c2acbf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1362 microversion: 2.1 time: 0.158612 Feb 19 21:39:07.938934 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3085/6085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:07 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:08.955975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f8dd989c-b81d-4af6-b4e3-7f32b1bf29af tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:08.956563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f8dd989c-b81d-4af6-b4e3-7f32b1bf29af tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:08.962997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8dd989c-b81d-4af6-b4e3-7f32b1bf29af tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:08.963459 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8dd989c-b81d-4af6-b4e3-7f32b1bf29af tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:08.964269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8dd989c-b81d-4af6-b4e3-7f32b1bf29af tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:08.964808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8dd989c-b81d-4af6-b4e3-7f32b1bf29af tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:09.107110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f8dd989c-b81d-4af6-b4e3-7f32b1bf29af tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:09.114341 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f8dd989c-b81d-4af6-b4e3-7f32b1bf29af tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1362 microversion: 2.1 time: 0.162352 Feb 19 21:39:09.114917 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3001/6086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:08 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:10.128425 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d4a1e0cf-8e5f-41cb-bbcf-0f8c6ee94113 req-37ff758b-0a97-4aaa-b6a3-7d53c95733b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "name": "network-vif-plugged", "status": "completed", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:10.130003 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:10.130003 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:39:10.131370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ce8fa28b-25a0-4fcf-b674-fde0bdd3ab96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:10.132191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ce8fa28b-25a0-4fcf-b674-fde0bdd3ab96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:10.141104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce8fa28b-25a0-4fcf-b674-fde0bdd3ab96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:10.141306 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d4a1e0cf-8e5f-41cb-bbcf-0f8c6ee94113 req-37ff758b-0a97-4aaa-b6a3-7d53c95733b0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:10.141830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce8fa28b-25a0-4fcf-b674-fde0bdd3ab96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:10.141946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d4a1e0cf-8e5f-41cb-bbcf-0f8c6ee94113 req-37ff758b-0a97-4aaa-b6a3-7d53c95733b0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:10.142727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce8fa28b-25a0-4fcf-b674-fde0bdd3ab96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:10.143276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ce8fa28b-25a0-4fcf-b674-fde0bdd3ab96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:10.155121 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d4a1e0cf-8e5f-41cb-bbcf-0f8c6ee94113 req-37ff758b-0a97-4aaa-b6a3-7d53c95733b0 service nova] Creating event network-vif-plugged:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch2-master-1 Feb 19 21:39:10.160573 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d4a1e0cf-8e5f-41cb-bbcf-0f8c6ee94113 req-37ff758b-0a97-4aaa-b6a3-7d53c95733b0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035654 Feb 19 21:39:10.161181 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3086/6087] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:39:10.679244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ce8fa28b-25a0-4fcf-b674-fde0bdd3ab96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:10.686817 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ce8fa28b-25a0-4fcf-b674-fde0bdd3ab96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1362 microversion: 2.1 time: 0.559669 Feb 19 21:39:10.687410 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3002/6088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:10 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:11.705548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-642d5917-8961-4ad4-bf01-cfadf83c774c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:11.706413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-642d5917-8961-4ad4-bf01-cfadf83c774c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:11.714178 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-642d5917-8961-4ad4-bf01-cfadf83c774c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:11.714638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-642d5917-8961-4ad4-bf01-cfadf83c774c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:11.715436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-642d5917-8961-4ad4-bf01-cfadf83c774c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:11.715882 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-642d5917-8961-4ad4-bf01-cfadf83c774c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:11.854262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-642d5917-8961-4ad4-bf01-cfadf83c774c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:11.862174 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-642d5917-8961-4ad4-bf01-cfadf83c774c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1362 microversion: 2.1 time: 0.161507 Feb 19 21:39:11.862771 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3087/6089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:11 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:12.880009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6b1d3e89-867c-4898-95be-6d99836d8d25 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:12.880649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6b1d3e89-867c-4898-95be-6d99836d8d25 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:12.887441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b1d3e89-867c-4898-95be-6d99836d8d25 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:12.888564 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b1d3e89-867c-4898-95be-6d99836d8d25 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:12.889392 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b1d3e89-867c-4898-95be-6d99836d8d25 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:12.889931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6b1d3e89-867c-4898-95be-6d99836d8d25 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:13.024586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6b1d3e89-867c-4898-95be-6d99836d8d25 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:13.031886 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6b1d3e89-867c-4898-95be-6d99836d8d25 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1549 microversion: 2.1 time: 0.155668 Feb 19 21:39:13.032510 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3003/6090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:12 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:13.048180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9d64f95f-c1c0-41b5-9444-a1a2643e3271 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:13.048723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9d64f95f-c1c0-41b5-9444-a1a2643e3271 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:13.055394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d64f95f-c1c0-41b5-9444-a1a2643e3271 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:13.055854 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d64f95f-c1c0-41b5-9444-a1a2643e3271 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:13.056687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d64f95f-c1c0-41b5-9444-a1a2643e3271 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:13.057141 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9d64f95f-c1c0-41b5-9444-a1a2643e3271 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:13.140475 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9d64f95f-c1c0-41b5-9444-a1a2643e3271 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095997 Feb 19 21:39:13.141082 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3088/6091] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Feb 19 21:39:13 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:14.103072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4db25db8-ec3b-429c-b674-f7bdcb972877 req-6ea70b69-a59f-4a8e-87a4-77748114d000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:14.104733 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:14.104733 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:39:14.112873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4db25db8-ec3b-429c-b674-f7bdcb972877 req-6ea70b69-a59f-4a8e-87a4-77748114d000 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:14.113426 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4db25db8-ec3b-429c-b674-f7bdcb972877 req-6ea70b69-a59f-4a8e-87a4-77748114d000 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:14.127104 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4db25db8-ec3b-429c-b674-f7bdcb972877 req-6ea70b69-a59f-4a8e-87a4-77748114d000 service nova] Creating event network-changed:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch2-master-1 Feb 19 21:39:14.133143 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4db25db8-ec3b-429c-b674-f7bdcb972877 req-6ea70b69-a59f-4a8e-87a4-77748114d000 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034100 Feb 19 21:39:14.133920 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3004/6092] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:15.459029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ce36162e-9a12-4045-9a4a-2f7f36cc2895 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:15.459652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ce36162e-9a12-4045-9a4a-2f7f36cc2895 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:15.466648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce36162e-9a12-4045-9a4a-2f7f36cc2895 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:15.467115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce36162e-9a12-4045-9a4a-2f7f36cc2895 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:15.467915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce36162e-9a12-4045-9a4a-2f7f36cc2895 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:15.468407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce36162e-9a12-4045-9a4a-2f7f36cc2895 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:15.607415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ce36162e-9a12-4045-9a4a-2f7f36cc2895 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:15.614860 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ce36162e-9a12-4045-9a4a-2f7f36cc2895 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1668 microversion: 2.1 time: 0.160329 Feb 19 21:39:15.615440 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3089/6093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:15 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:15.631387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fbbd5651-c171-4799-8f6f-503dd50d2f96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6ad45be-0d7e-46fe-8519-8b43631515d7"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:15.632556 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fbbd5651-c171-4799-8f6f-503dd50d2f96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:15.640026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbbd5651-c171-4799-8f6f-503dd50d2f96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:15.640517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbbd5651-c171-4799-8f6f-503dd50d2f96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:15.641300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbbd5651-c171-4799-8f6f-503dd50d2f96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:15.641741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fbbd5651-c171-4799-8f6f-503dd50d2f96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:15.865758 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fbbd5651-c171-4799-8f6f-503dd50d2f96 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238305 Feb 19 21:39:15.866384 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3005/6094] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:39:15 2022] POST /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:39:18.077703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:18.078666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:18.085349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:18.085810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:18.086621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:18.087071 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:18.114490 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:18.120489 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Old instance type m1.heat2, new instance type m1.heat {{(pid=136094) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:39:18.127419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:39:18.127850 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:39:18.128350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:39:18.128772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:39:18.129189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:39:18.190032 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [f79b9f5e-52a0-436d-9204-7cef700a80bf] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 21:39:19.197011 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [f79b9f5e-52a0-436d-9204-7cef700a80bf] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40532. Feb 19 21:39:19.200623 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1a679b4c-c01f-450c-beb4-7d9a9cbfd5cf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/action" status: 202 len: 0 microversion: 2.1 time: 1.127219 Feb 19 21:39:19.201243 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3090/6095] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:39:18 2022] POST /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/action => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:39:19.210480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0df1ef13-ab76-4f0f-9103-e4592ba7a1d7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:19.211615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0df1ef13-ab76-4f0f-9103-e4592ba7a1d7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:19.218340 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0df1ef13-ab76-4f0f-9103-e4592ba7a1d7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:19.218832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0df1ef13-ab76-4f0f-9103-e4592ba7a1d7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:19.219689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0df1ef13-ab76-4f0f-9103-e4592ba7a1d7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:19.220185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0df1ef13-ab76-4f0f-9103-e4592ba7a1d7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:19.362222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0df1ef13-ab76-4f0f-9103-e4592ba7a1d7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:19.370445 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0df1ef13-ab76-4f0f-9103-e4592ba7a1d7 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1723 microversion: 2.1 time: 0.164758 Feb 19 21:39:19.371141 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3006/6096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:19 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:39:20.388382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c97fb8b3-7e1a-4523-9c2f-08d80a542900 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:20.389019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c97fb8b3-7e1a-4523-9c2f-08d80a542900 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:20.396603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c97fb8b3-7e1a-4523-9c2f-08d80a542900 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:20.397069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c97fb8b3-7e1a-4523-9c2f-08d80a542900 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:20.397866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c97fb8b3-7e1a-4523-9c2f-08d80a542900 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:20.398320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c97fb8b3-7e1a-4523-9c2f-08d80a542900 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:20.535498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c97fb8b3-7e1a-4523-9c2f-08d80a542900 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:20.547244 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c97fb8b3-7e1a-4523-9c2f-08d80a542900 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1723 microversion: 2.1 time: 0.163148 Feb 19 21:39:20.547868 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3091/6097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:20 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:21.564362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7f7054da-7ff1-488b-9a98-89567ba47f92 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:21.564979 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7f7054da-7ff1-488b-9a98-89567ba47f92 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:21.571919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f7054da-7ff1-488b-9a98-89567ba47f92 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:21.572391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f7054da-7ff1-488b-9a98-89567ba47f92 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:21.573172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f7054da-7ff1-488b-9a98-89567ba47f92 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:21.573614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7f7054da-7ff1-488b-9a98-89567ba47f92 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:21.719252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7f7054da-7ff1-488b-9a98-89567ba47f92 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:21.727213 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7f7054da-7ff1-488b-9a98-89567ba47f92 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.166544 Feb 19 21:39:21.727806 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3007/6098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:21 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:22.744712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-917c44b6-2767-4660-85f7-e614e8ed2f48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:22.745341 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-917c44b6-2767-4660-85f7-e614e8ed2f48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:22.752384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-917c44b6-2767-4660-85f7-e614e8ed2f48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:22.752855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-917c44b6-2767-4660-85f7-e614e8ed2f48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:22.753643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-917c44b6-2767-4660-85f7-e614e8ed2f48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:22.754090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-917c44b6-2767-4660-85f7-e614e8ed2f48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:22.892128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-917c44b6-2767-4660-85f7-e614e8ed2f48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:22.900233 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-917c44b6-2767-4660-85f7-e614e8ed2f48 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.159253 Feb 19 21:39:22.901065 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3092/6099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:22 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:23.917402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-221acf4e-948f-4579-8a29-330c26bac7fa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:23.918044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-221acf4e-948f-4579-8a29-330c26bac7fa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:23.925444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-221acf4e-948f-4579-8a29-330c26bac7fa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:23.925907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-221acf4e-948f-4579-8a29-330c26bac7fa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:23.926689 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-221acf4e-948f-4579-8a29-330c26bac7fa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:23.927132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-221acf4e-948f-4579-8a29-330c26bac7fa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:24.060471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-221acf4e-948f-4579-8a29-330c26bac7fa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:24.068264 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-221acf4e-948f-4579-8a29-330c26bac7fa tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.154601 Feb 19 21:39:24.068886 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3008/6100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:23 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:25.093648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4339aa5c-58df-4287-a87f-a939afa1cfb0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:25.094269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4339aa5c-58df-4287-a87f-a939afa1cfb0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:25.101161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4339aa5c-58df-4287-a87f-a939afa1cfb0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:25.101632 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4339aa5c-58df-4287-a87f-a939afa1cfb0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:25.102422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4339aa5c-58df-4287-a87f-a939afa1cfb0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:25.102873 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4339aa5c-58df-4287-a87f-a939afa1cfb0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:25.242282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4339aa5c-58df-4287-a87f-a939afa1cfb0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:25.250090 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4339aa5c-58df-4287-a87f-a939afa1cfb0 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.160738 Feb 19 21:39:25.250678 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3093/6101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:25 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:26.267185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8fe7b615-1ab5-4147-b804-f775ea9c1b2b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:26.267831 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8fe7b615-1ab5-4147-b804-f775ea9c1b2b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:26.274617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fe7b615-1ab5-4147-b804-f775ea9c1b2b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:26.275069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fe7b615-1ab5-4147-b804-f775ea9c1b2b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:26.275847 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fe7b615-1ab5-4147-b804-f775ea9c1b2b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:26.276286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fe7b615-1ab5-4147-b804-f775ea9c1b2b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:26.410811 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8fe7b615-1ab5-4147-b804-f775ea9c1b2b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:26.418537 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8fe7b615-1ab5-4147-b804-f775ea9c1b2b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.155014 Feb 19 21:39:26.419115 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3009/6102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:26 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:27.435143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fb661f04-fa3f-45d1-8788-215e17177e04 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:27.435792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fb661f04-fa3f-45d1-8788-215e17177e04 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:27.442502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb661f04-fa3f-45d1-8788-215e17177e04 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:27.442962 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb661f04-fa3f-45d1-8788-215e17177e04 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:27.443746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb661f04-fa3f-45d1-8788-215e17177e04 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:27.444194 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fb661f04-fa3f-45d1-8788-215e17177e04 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:27.578474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fb661f04-fa3f-45d1-8788-215e17177e04 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:27.586234 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fb661f04-fa3f-45d1-8788-215e17177e04 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.154868 Feb 19 21:39:27.586809 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3094/6103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:27 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:28.603276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-efaca463-14b8-47b4-b5f2-5a5cf53e4bfb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:28.603938 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-efaca463-14b8-47b4-b5f2-5a5cf53e4bfb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:28.611317 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efaca463-14b8-47b4-b5f2-5a5cf53e4bfb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:28.611768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efaca463-14b8-47b4-b5f2-5a5cf53e4bfb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:28.612582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efaca463-14b8-47b4-b5f2-5a5cf53e4bfb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:28.613026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-efaca463-14b8-47b4-b5f2-5a5cf53e4bfb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:28.755749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-efaca463-14b8-47b4-b5f2-5a5cf53e4bfb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:28.763652 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-efaca463-14b8-47b4-b5f2-5a5cf53e4bfb tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.164019 Feb 19 21:39:28.764247 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3010/6104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:28 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:29.781201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cfad3129-a4a3-4d89-8d60-c79ac57eaef5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:29.781829 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cfad3129-a4a3-4d89-8d60-c79ac57eaef5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:29.789641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfad3129-a4a3-4d89-8d60-c79ac57eaef5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:29.790108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfad3129-a4a3-4d89-8d60-c79ac57eaef5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:29.790897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfad3129-a4a3-4d89-8d60-c79ac57eaef5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:29.791340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cfad3129-a4a3-4d89-8d60-c79ac57eaef5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:29.924904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cfad3129-a4a3-4d89-8d60-c79ac57eaef5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:29.932717 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cfad3129-a4a3-4d89-8d60-c79ac57eaef5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.155933 Feb 19 21:39:29.933289 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3095/6105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:29 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:30.950483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4da2b9f-9f4d-49c5-8454-24232c90cca3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:30.951122 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c4da2b9f-9f4d-49c5-8454-24232c90cca3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:30.957883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4da2b9f-9f4d-49c5-8454-24232c90cca3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:30.958280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4da2b9f-9f4d-49c5-8454-24232c90cca3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:30.959057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4da2b9f-9f4d-49c5-8454-24232c90cca3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:30.959496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4da2b9f-9f4d-49c5-8454-24232c90cca3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:31.096170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4da2b9f-9f4d-49c5-8454-24232c90cca3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:31.104011 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c4da2b9f-9f4d-49c5-8454-24232c90cca3 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.157863 Feb 19 21:39:31.104623 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3011/6106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:30 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:32.120762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-54c84b79-27b0-42a0-9414-c2474dfdb1de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:32.121378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-54c84b79-27b0-42a0-9414-c2474dfdb1de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:32.128842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54c84b79-27b0-42a0-9414-c2474dfdb1de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:32.129304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54c84b79-27b0-42a0-9414-c2474dfdb1de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:32.130084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54c84b79-27b0-42a0-9414-c2474dfdb1de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:32.130527 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-54c84b79-27b0-42a0-9414-c2474dfdb1de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:32.263159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-54c84b79-27b0-42a0-9414-c2474dfdb1de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:32.271487 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-54c84b79-27b0-42a0-9414-c2474dfdb1de tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.154402 Feb 19 21:39:32.272062 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3096/6107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:32 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:33.289505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-91c9e21f-49ed-4a9d-944c-8cbd62a78e52 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:33.290128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-91c9e21f-49ed-4a9d-944c-8cbd62a78e52 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:33.296906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91c9e21f-49ed-4a9d-944c-8cbd62a78e52 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:33.297360 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91c9e21f-49ed-4a9d-944c-8cbd62a78e52 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:33.298140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91c9e21f-49ed-4a9d-944c-8cbd62a78e52 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:33.298582 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-91c9e21f-49ed-4a9d-944c-8cbd62a78e52 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:33.433691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-91c9e21f-49ed-4a9d-944c-8cbd62a78e52 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:33.442081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-91c9e21f-49ed-4a9d-944c-8cbd62a78e52 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.156306 Feb 19 21:39:33.442664 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3012/6108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:33 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:34.458802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-36acf9d8-17ef-4095-bac1-2ab9640c3188 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:34.459404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-36acf9d8-17ef-4095-bac1-2ab9640c3188 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:34.466791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36acf9d8-17ef-4095-bac1-2ab9640c3188 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:34.467256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36acf9d8-17ef-4095-bac1-2ab9640c3188 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:34.468042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36acf9d8-17ef-4095-bac1-2ab9640c3188 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:34.468520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-36acf9d8-17ef-4095-bac1-2ab9640c3188 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:34.600420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-36acf9d8-17ef-4095-bac1-2ab9640c3188 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:34.608272 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-36acf9d8-17ef-4095-bac1-2ab9640c3188 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.153246 Feb 19 21:39:34.609084 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3097/6109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:34 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:35.625448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-78ab69a4-eb34-40a7-8c9e-b638553c15e2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:35.626059 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-78ab69a4-eb34-40a7-8c9e-b638553c15e2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:35.632785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78ab69a4-eb34-40a7-8c9e-b638553c15e2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:35.633237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78ab69a4-eb34-40a7-8c9e-b638553c15e2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:35.634016 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78ab69a4-eb34-40a7-8c9e-b638553c15e2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:35.634455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-78ab69a4-eb34-40a7-8c9e-b638553c15e2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:35.767743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-78ab69a4-eb34-40a7-8c9e-b638553c15e2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:35.775983 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-78ab69a4-eb34-40a7-8c9e-b638553c15e2 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.154324 Feb 19 21:39:35.776585 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3013/6110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:35 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:36.794539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-887f4059-9629-425c-b120-393a538d2982 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:36.795156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-887f4059-9629-425c-b120-393a538d2982 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:36.801507 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-887f4059-9629-425c-b120-393a538d2982 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:36.801991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-887f4059-9629-425c-b120-393a538d2982 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:36.802778 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-887f4059-9629-425c-b120-393a538d2982 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:36.803224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-887f4059-9629-425c-b120-393a538d2982 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:36.940583 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-887f4059-9629-425c-b120-393a538d2982 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:36.948631 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-887f4059-9629-425c-b120-393a538d2982 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.158592 Feb 19 21:39:36.949214 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3098/6111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:36 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:37.966606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b37c5538-cac2-4eaf-a029-3a352f9d684e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:37.967128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b37c5538-cac2-4eaf-a029-3a352f9d684e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:37.973912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b37c5538-cac2-4eaf-a029-3a352f9d684e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:37.974365 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b37c5538-cac2-4eaf-a029-3a352f9d684e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:37.975145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b37c5538-cac2-4eaf-a029-3a352f9d684e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:37.975585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b37c5538-cac2-4eaf-a029-3a352f9d684e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:38.107182 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b37c5538-cac2-4eaf-a029-3a352f9d684e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:38.114923 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b37c5538-cac2-4eaf-a029-3a352f9d684e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1728 microversion: 2.1 time: 0.152743 Feb 19 21:39:38.115497 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3014/6112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:37 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:39.131911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ab4b0071-de3f-411b-88e9-9dbf15ef1dba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:39.132590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ab4b0071-de3f-411b-88e9-9dbf15ef1dba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:39.139310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab4b0071-de3f-411b-88e9-9dbf15ef1dba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:39.139779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab4b0071-de3f-411b-88e9-9dbf15ef1dba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:39.140879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab4b0071-de3f-411b-88e9-9dbf15ef1dba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:39.141139 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ab4b0071-de3f-411b-88e9-9dbf15ef1dba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:39.225270 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-7d1c252f-59e4-47bf-b6e0-840df529255d req-8fe1b432-1376-408b-9ca1-19bfbc59aa37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "name": "network-vif-unplugged", "status": "completed", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:39.227769 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:39.227769 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:39:39.238810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7d1c252f-59e4-47bf-b6e0-840df529255d req-8fe1b432-1376-408b-9ca1-19bfbc59aa37 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:39.239271 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-7d1c252f-59e4-47bf-b6e0-840df529255d req-8fe1b432-1376-408b-9ca1-19bfbc59aa37 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:39.253464 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-7d1c252f-59e4-47bf-b6e0-840df529255d req-8fe1b432-1376-408b-9ca1-19bfbc59aa37 service nova] Creating event network-vif-unplugged:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch1-master-1 Feb 19 21:39:39.259252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-7d1c252f-59e4-47bf-b6e0-840df529255d req-8fe1b432-1376-408b-9ca1-19bfbc59aa37 service nova] Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:39:39.273065 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-7d1c252f-59e4-47bf-b6e0-840df529255d req-8fe1b432-1376-408b-9ca1-19bfbc59aa37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051444 Feb 19 21:39:39.273878 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3015/6113] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:39:39.296059 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ab4b0071-de3f-411b-88e9-9dbf15ef1dba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:39.305130 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ab4b0071-de3f-411b-88e9-9dbf15ef1dba tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1727 microversion: 2.1 time: 0.176950 Feb 19 21:39:39.306019 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3099/6114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:39 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:40.323338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d1c03f64-88b9-417f-a692-036bbba27555 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:40.324082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d1c03f64-88b9-417f-a692-036bbba27555 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:40.331679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1c03f64-88b9-417f-a692-036bbba27555 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:40.332142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1c03f64-88b9-417f-a692-036bbba27555 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:40.332981 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1c03f64-88b9-417f-a692-036bbba27555 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:40.333430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d1c03f64-88b9-417f-a692-036bbba27555 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:40.469232 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d1c03f64-88b9-417f-a692-036bbba27555 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:40.477208 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d1c03f64-88b9-417f-a692-036bbba27555 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1725 microversion: 2.1 time: 0.158180 Feb 19 21:39:40.477799 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3016/6115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:40 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:41.290592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b0762834-970d-4fa1-9a96-af9211522f3b req-59f48a13-fb37-4155-b88e-1fe62e7ea4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:41.292095 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:41.292095 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:39:41.299843 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b0762834-970d-4fa1-9a96-af9211522f3b req-59f48a13-fb37-4155-b88e-1fe62e7ea4b6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:41.300295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b0762834-970d-4fa1-9a96-af9211522f3b req-59f48a13-fb37-4155-b88e-1fe62e7ea4b6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:41.312103 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b0762834-970d-4fa1-9a96-af9211522f3b req-59f48a13-fb37-4155-b88e-1fe62e7ea4b6 service nova] Creating event network-changed:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch1-master-1 Feb 19 21:39:41.317254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-b0762834-970d-4fa1-9a96-af9211522f3b req-59f48a13-fb37-4155-b88e-1fe62e7ea4b6 service nova] Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:39:41.329211 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b0762834-970d-4fa1-9a96-af9211522f3b req-59f48a13-fb37-4155-b88e-1fe62e7ea4b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042258 Feb 19 21:39:41.329797 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3100/6116] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:41.494760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4b793adf-7a52-485d-9125-5f8e708b3b35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:41.495374 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4b793adf-7a52-485d-9125-5f8e708b3b35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:41.502818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b793adf-7a52-485d-9125-5f8e708b3b35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:41.503278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b793adf-7a52-485d-9125-5f8e708b3b35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:41.504071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b793adf-7a52-485d-9125-5f8e708b3b35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:41.504540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4b793adf-7a52-485d-9125-5f8e708b3b35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:41.722755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4b793adf-7a52-485d-9125-5f8e708b3b35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:41.736973 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4b793adf-7a52-485d-9125-5f8e708b3b35 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1725 microversion: 2.1 time: 0.245814 Feb 19 21:39:41.737582 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3017/6117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:41 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:42.756108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c919e7cf-7da1-4e04-8ac2-f1354254368b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:42.756886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c919e7cf-7da1-4e04-8ac2-f1354254368b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:42.763280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c919e7cf-7da1-4e04-8ac2-f1354254368b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:42.763866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c919e7cf-7da1-4e04-8ac2-f1354254368b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:42.764690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c919e7cf-7da1-4e04-8ac2-f1354254368b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:42.765148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c919e7cf-7da1-4e04-8ac2-f1354254368b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:42.902846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c919e7cf-7da1-4e04-8ac2-f1354254368b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:42.911215 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c919e7cf-7da1-4e04-8ac2-f1354254368b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1725 microversion: 2.1 time: 0.160060 Feb 19 21:39:42.911798 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3101/6118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:42 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:43.928968 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-191f15e7-9f4f-4c49-a926-47a871ded19c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:43.929523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-191f15e7-9f4f-4c49-a926-47a871ded19c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:43.937070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-191f15e7-9f4f-4c49-a926-47a871ded19c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:43.937523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-191f15e7-9f4f-4c49-a926-47a871ded19c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:43.938311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-191f15e7-9f4f-4c49-a926-47a871ded19c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:43.938750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-191f15e7-9f4f-4c49-a926-47a871ded19c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:44.074914 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-191f15e7-9f4f-4c49-a926-47a871ded19c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:44.083141 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-191f15e7-9f4f-4c49-a926-47a871ded19c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1722 microversion: 2.1 time: 0.158170 Feb 19 21:39:44.083734 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3018/6119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:43 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:44.099445 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:44.100006 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:44.106754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:44.107788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:44.108628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:44.109089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:44.142319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:44.142813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:44.143671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:44.144124 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:44.163708 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:39:44.168695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Getting quotas for user f14d8011b7c241f7b5ecdee4c3f44ae4 and project 9f6be5d4ae2946bb9304ae0a31f2c325. Resources: {'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:39:44.274633 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a8527731-d244-41e8-bbf0-cbfce1dc9d40 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "POST /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/action" status: 202 len: 0 microversion: 2.1 time: 0.178738 Feb 19 21:39:44.275279 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3102/6120] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:39:44 2022] POST /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:39:44.283659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c41f4a75-7611-4b9a-82b3-7394b2065fca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:44.284400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c41f4a75-7611-4b9a-82b3-7394b2065fca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:44.290438 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c41f4a75-7611-4b9a-82b3-7394b2065fca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:44.291363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c41f4a75-7611-4b9a-82b3-7394b2065fca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:44.291988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c41f4a75-7611-4b9a-82b3-7394b2065fca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:44.292453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c41f4a75-7611-4b9a-82b3-7394b2065fca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:44.445281 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c41f4a75-7611-4b9a-82b3-7394b2065fca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:44.453711 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c41f4a75-7611-4b9a-82b3-7394b2065fca tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1721 microversion: 2.1 time: 0.173679 Feb 19 21:39:44.454305 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3019/6121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:44 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:45.472391 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-73bda072-2969-48ce-9d3b-830785e9d2d5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:45.473023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-73bda072-2969-48ce-9d3b-830785e9d2d5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:45.479289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73bda072-2969-48ce-9d3b-830785e9d2d5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:45.479783 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73bda072-2969-48ce-9d3b-830785e9d2d5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:45.480591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73bda072-2969-48ce-9d3b-830785e9d2d5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:45.481036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-73bda072-2969-48ce-9d3b-830785e9d2d5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:45.621923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-73bda072-2969-48ce-9d3b-830785e9d2d5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:45.630354 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-73bda072-2969-48ce-9d3b-830785e9d2d5 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1721 microversion: 2.1 time: 0.163092 Feb 19 21:39:45.630923 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3103/6122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:45 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:46.122800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-52a0cf72-491c-4e5b-bc73-e381e93094dc req-8bf8febe-c648-47fb-b96c-7c3e269aa671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "name": "network-vif-plugged", "status": "completed", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:46.124314 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:46.124314 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:39:46.134300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-52a0cf72-491c-4e5b-bc73-e381e93094dc req-8bf8febe-c648-47fb-b96c-7c3e269aa671 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:46.134755 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-52a0cf72-491c-4e5b-bc73-e381e93094dc req-8bf8febe-c648-47fb-b96c-7c3e269aa671 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:46.148421 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-52a0cf72-491c-4e5b-bc73-e381e93094dc req-8bf8febe-c648-47fb-b96c-7c3e269aa671 service nova] Creating event network-vif-plugged:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch1-master-1 Feb 19 21:39:46.155740 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-52a0cf72-491c-4e5b-bc73-e381e93094dc req-8bf8febe-c648-47fb-b96c-7c3e269aa671 service nova] Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:39:46.166594 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-52a0cf72-491c-4e5b-bc73-e381e93094dc req-8bf8febe-c648-47fb-b96c-7c3e269aa671 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047908 Feb 19 21:39:46.167435 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3020/6123] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:46.647032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-48c0ebd3-9304-4b57-b686-49a1d7178aaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:46.647660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-48c0ebd3-9304-4b57-b686-49a1d7178aaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:46.654429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48c0ebd3-9304-4b57-b686-49a1d7178aaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:46.654894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48c0ebd3-9304-4b57-b686-49a1d7178aaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:46.655824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48c0ebd3-9304-4b57-b686-49a1d7178aaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:46.656186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-48c0ebd3-9304-4b57-b686-49a1d7178aaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:46.818511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-48c0ebd3-9304-4b57-b686-49a1d7178aaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:46.828563 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-48c0ebd3-9304-4b57-b686-49a1d7178aaf tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1721 microversion: 2.1 time: 0.185001 Feb 19 21:39:46.829099 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3104/6124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:46 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:47.820891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a9826eb9-4c69-409c-b4dd-d70d416c1b10 req-bfebbab3-8246-4dbd-b803-4e8c9927c1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "name": "network-vif-unplugged", "status": "completed", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:47.822662 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:47.822662 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:39:47.831006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a9826eb9-4c69-409c-b4dd-d70d416c1b10 req-bfebbab3-8246-4dbd-b803-4e8c9927c1ff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:47.831550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a9826eb9-4c69-409c-b4dd-d70d416c1b10 req-bfebbab3-8246-4dbd-b803-4e8c9927c1ff service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:47.845649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-46f4f65a-9143-4568-97b6-e17fb327b1bd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:47.846276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-46f4f65a-9143-4568-97b6-e17fb327b1bd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:47.859204 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a9826eb9-4c69-409c-b4dd-d70d416c1b10 req-bfebbab3-8246-4dbd-b803-4e8c9927c1ff service nova] Creating event network-vif-unplugged:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch2-master-1 Feb 19 21:39:47.862470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46f4f65a-9143-4568-97b6-e17fb327b1bd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:47.862969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46f4f65a-9143-4568-97b6-e17fb327b1bd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:47.864168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46f4f65a-9143-4568-97b6-e17fb327b1bd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:47.864659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-46f4f65a-9143-4568-97b6-e17fb327b1bd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:47.877403 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-a9826eb9-4c69-409c-b4dd-d70d416c1b10 req-bfebbab3-8246-4dbd-b803-4e8c9927c1ff service nova] Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:39:47.891569 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a9826eb9-4c69-409c-b4dd-d70d416c1b10 req-bfebbab3-8246-4dbd-b803-4e8c9927c1ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075205 Feb 19 21:39:47.892860 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3021/6125] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:48.139402 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-46f4f65a-9143-4568-97b6-e17fb327b1bd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:48.147987 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-46f4f65a-9143-4568-97b6-e17fb327b1bd tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1721 microversion: 2.1 time: 0.306328 Feb 19 21:39:48.148616 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3105/6126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:47 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1721 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:49.166993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-40f020dc-bb35-4d9e-a5d0-510bcf41bc5e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:49.167696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-40f020dc-bb35-4d9e-a5d0-510bcf41bc5e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:49.174471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40f020dc-bb35-4d9e-a5d0-510bcf41bc5e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:49.174933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40f020dc-bb35-4d9e-a5d0-510bcf41bc5e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:49.175713 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40f020dc-bb35-4d9e-a5d0-510bcf41bc5e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:49.176150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-40f020dc-bb35-4d9e-a5d0-510bcf41bc5e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:49.315458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-40f020dc-bb35-4d9e-a5d0-510bcf41bc5e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:49.323737 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-40f020dc-bb35-4d9e-a5d0-510bcf41bc5e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1721 microversion: 2.1 time: 0.161796 Feb 19 21:39:49.324322 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3022/6127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:49 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:49.924987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c1e6d7b4-4a65-43d6-9d67-35947e7ee7e1 req-55c28899-2cef-4cd1-a654-d7a2bd5b7935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:49.926562 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:49.926562 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:39:49.934134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c1e6d7b4-4a65-43d6-9d67-35947e7ee7e1 req-55c28899-2cef-4cd1-a654-d7a2bd5b7935 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:49.934585 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c1e6d7b4-4a65-43d6-9d67-35947e7ee7e1 req-55c28899-2cef-4cd1-a654-d7a2bd5b7935 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:49.946663 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c1e6d7b4-4a65-43d6-9d67-35947e7ee7e1 req-55c28899-2cef-4cd1-a654-d7a2bd5b7935 service nova] Creating event network-changed:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch2-master-1 Feb 19 21:39:49.951784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-c1e6d7b4-4a65-43d6-9d67-35947e7ee7e1 req-55c28899-2cef-4cd1-a654-d7a2bd5b7935 service nova] Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:39:49.962678 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c1e6d7b4-4a65-43d6-9d67-35947e7ee7e1 req-55c28899-2cef-4cd1-a654-d7a2bd5b7935 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041836 Feb 19 21:39:49.963303 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3106/6128] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:50.341106 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-071c5ab0-4ee6-4cef-a030-bd688375cd7c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:50.342228 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-071c5ab0-4ee6-4cef-a030-bd688375cd7c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:50.349875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-071c5ab0-4ee6-4cef-a030-bd688375cd7c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:50.350451 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-071c5ab0-4ee6-4cef-a030-bd688375cd7c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:50.351477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-071c5ab0-4ee6-4cef-a030-bd688375cd7c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:50.351990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-071c5ab0-4ee6-4cef-a030-bd688375cd7c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:50.605167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-071c5ab0-4ee6-4cef-a030-bd688375cd7c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:50.613895 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-071c5ab0-4ee6-4cef-a030-bd688375cd7c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1721 microversion: 2.1 time: 0.276810 Feb 19 21:39:50.614474 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3023/6129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:50 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:51.632357 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dcceb1db-4461-47f9-a530-2987c2cc0e08 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:51.633003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dcceb1db-4461-47f9-a530-2987c2cc0e08 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:51.639177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcceb1db-4461-47f9-a530-2987c2cc0e08 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:51.639639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcceb1db-4461-47f9-a530-2987c2cc0e08 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:51.640448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcceb1db-4461-47f9-a530-2987c2cc0e08 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:51.640895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcceb1db-4461-47f9-a530-2987c2cc0e08 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:51.783291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dcceb1db-4461-47f9-a530-2987c2cc0e08 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:51.791291 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dcceb1db-4461-47f9-a530-2987c2cc0e08 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1721 microversion: 2.1 time: 0.163905 Feb 19 21:39:51.791866 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3107/6130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:51 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:52.807823 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0153d435-a4b2-4e0d-bef8-df986272c32f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:52.808454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0153d435-a4b2-4e0d-bef8-df986272c32f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:52.815629 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0153d435-a4b2-4e0d-bef8-df986272c32f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:52.816078 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0153d435-a4b2-4e0d-bef8-df986272c32f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:52.816897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0153d435-a4b2-4e0d-bef8-df986272c32f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:52.817334 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0153d435-a4b2-4e0d-bef8-df986272c32f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:52.956045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0153d435-a4b2-4e0d-bef8-df986272c32f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:52.963910 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0153d435-a4b2-4e0d-bef8-df986272c32f tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1721 microversion: 2.1 time: 0.159783 Feb 19 21:39:52.964538 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3024/6131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:52 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:53.980892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-796f66c5-fa2e-4bb6-bafa-ccc73866033a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:53.981423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-796f66c5-fa2e-4bb6-bafa-ccc73866033a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:53.988140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-796f66c5-fa2e-4bb6-bafa-ccc73866033a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:53.988646 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-796f66c5-fa2e-4bb6-bafa-ccc73866033a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:53.989429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-796f66c5-fa2e-4bb6-bafa-ccc73866033a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:53.989872 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-796f66c5-fa2e-4bb6-bafa-ccc73866033a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:54.125868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-796f66c5-fa2e-4bb6-bafa-ccc73866033a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:54.133867 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-796f66c5-fa2e-4bb6-bafa-ccc73866033a tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1714 microversion: 2.1 time: 0.156754 Feb 19 21:39:54.134446 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3108/6132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:53 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:54.151128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-105c72d9-a217-449e-be7f-8b8db8f27179 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:54.151741 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-105c72d9-a217-449e-be7f-8b8db8f27179 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:54.159404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-105c72d9-a217-449e-be7f-8b8db8f27179 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:54.159982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-105c72d9-a217-449e-be7f-8b8db8f27179 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:54.160832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-105c72d9-a217-449e-be7f-8b8db8f27179 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:54.161276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-105c72d9-a217-449e-be7f-8b8db8f27179 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:54.298920 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-105c72d9-a217-449e-be7f-8b8db8f27179 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:54.306703 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-105c72d9-a217-449e-be7f-8b8db8f27179 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1714 microversion: 2.1 time: 0.160680 Feb 19 21:39:54.307297 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3025/6133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:54 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:54.322634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ae82e552-ad62-4e62-99b2-2f053d3a5570 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:54.323260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ae82e552-ad62-4e62-99b2-2f053d3a5570 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:54.329143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae82e552-ad62-4e62-99b2-2f053d3a5570 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:54.329615 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae82e552-ad62-4e62-99b2-2f053d3a5570 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:54.330403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae82e552-ad62-4e62-99b2-2f053d3a5570 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:54.330856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ae82e552-ad62-4e62-99b2-2f053d3a5570 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:54.465081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ae82e552-ad62-4e62-99b2-2f053d3a5570 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:54.473734 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ae82e552-ad62-4e62-99b2-2f053d3a5570 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1714 microversion: 2.1 time: 0.155019 Feb 19 21:39:54.474311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3109/6134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:54 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:54.492084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0929b150-6478-4d4d-a3f9-370155f56f77 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:54.492646 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0929b150-6478-4d4d-a3f9-370155f56f77 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:54.498630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0929b150-6478-4d4d-a3f9-370155f56f77 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:54.499025 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0929b150-6478-4d4d-a3f9-370155f56f77 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:54.499807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0929b150-6478-4d4d-a3f9-370155f56f77 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:54.500242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0929b150-6478-4d4d-a3f9-370155f56f77 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:54.531344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0929b150-6478-4d4d-a3f9-370155f56f77 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:39:54.605294 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0929b150-6478-4d4d-a3f9-370155f56f77 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 204 len: 0 microversion: 2.1 time: 0.118907 Feb 19 21:39:54.606172 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3026/6135] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:39:54 2022] DELETE /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:39:54.614636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8dcc8c74-c65f-46ed-b262-342dc564ceed tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:54.615533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8dcc8c74-c65f-46ed-b262-342dc564ceed tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:54.621406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dcc8c74-c65f-46ed-b262-342dc564ceed tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:54.621867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dcc8c74-c65f-46ed-b262-342dc564ceed tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:54.622652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dcc8c74-c65f-46ed-b262-342dc564ceed tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:54.623094 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8dcc8c74-c65f-46ed-b262-342dc564ceed tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:54.761820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8dcc8c74-c65f-46ed-b262-342dc564ceed tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:54.770161 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8dcc8c74-c65f-46ed-b262-342dc564ceed tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1720 microversion: 2.1 time: 0.159234 Feb 19 21:39:54.770734 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3110/6136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:54 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:55.787397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6ef5ef77-baea-44f8-9b87-2f9763b71035 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:55.788231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6ef5ef77-baea-44f8-9b87-2f9763b71035 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:55.794976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ef5ef77-baea-44f8-9b87-2f9763b71035 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:55.795429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ef5ef77-baea-44f8-9b87-2f9763b71035 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:55.796211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ef5ef77-baea-44f8-9b87-2f9763b71035 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:55.796680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6ef5ef77-baea-44f8-9b87-2f9763b71035 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:55.929547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6ef5ef77-baea-44f8-9b87-2f9763b71035 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:55.938626 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6ef5ef77-baea-44f8-9b87-2f9763b71035 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1720 microversion: 2.1 time: 0.154791 Feb 19 21:39:55.939221 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3027/6137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:55 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:56.331880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-01582589-5982-4ec2-aeb9-1aedb58b0298 req-25ba5e90-16f4-4c81-b935-2aad6b0955b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "name": "network-vif-plugged", "status": "completed", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:56.333462 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:56.333462 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:39:56.342567 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-01582589-5982-4ec2-aeb9-1aedb58b0298 req-25ba5e90-16f4-4c81-b935-2aad6b0955b3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:56.343046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-01582589-5982-4ec2-aeb9-1aedb58b0298 req-25ba5e90-16f4-4c81-b935-2aad6b0955b3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:56.357326 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-01582589-5982-4ec2-aeb9-1aedb58b0298 req-25ba5e90-16f4-4c81-b935-2aad6b0955b3 service nova] Creating event network-vif-plugged:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch2-master-1 Feb 19 21:39:56.363886 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-01582589-5982-4ec2-aeb9-1aedb58b0298 req-25ba5e90-16f4-4c81-b935-2aad6b0955b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036063 Feb 19 21:39:56.364525 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3111/6138] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:56.956807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-32825700-924a-47c9-a405-626e16edfc3d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:56.957406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-32825700-924a-47c9-a405-626e16edfc3d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:56.964088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32825700-924a-47c9-a405-626e16edfc3d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:56.964609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32825700-924a-47c9-a405-626e16edfc3d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:56.965396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32825700-924a-47c9-a405-626e16edfc3d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:56.965833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-32825700-924a-47c9-a405-626e16edfc3d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:57.050210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-32825700-924a-47c9-a405-626e16edfc3d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f14d8011b7c241f7b5ecdee4c3f44ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6be5d4ae2946bb9304ae0a31f2c325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:39:57.058722 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-32825700-924a-47c9-a405-626e16edfc3d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 200 len: 1653 microversion: 2.1 time: 0.106204 Feb 19 21:39:57.059324 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3028/6139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:56 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 1653 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:39:57.352498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-899b85e1-9063-485e-8816-2a2365a13248 req-09fa8684-0533-4402-8014-2b97214bfc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3006e-910f-4eba-952b-b85ba8cda4ed", "name": "network-vif-deleted", "tag": "c3c71211-925d-4eea-ba40-4b08a563b6e3"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:39:57.354751 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:39:57.354751 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:39:57.363648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-899b85e1-9063-485e-8816-2a2365a13248 req-09fa8684-0533-4402-8014-2b97214bfc23 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:57.364678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-899b85e1-9063-485e-8816-2a2365a13248 req-09fa8684-0533-4402-8014-2b97214bfc23 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:57.376466 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-899b85e1-9063-485e-8816-2a2365a13248 req-09fa8684-0533-4402-8014-2b97214bfc23 service nova] Creating event network-vif-deleted:c3c71211-925d-4eea-ba40-4b08a563b6e3 for instance 50a3006e-910f-4eba-952b-b85ba8cda4ed on nch2-master-1 Feb 19 21:39:57.381298 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-899b85e1-9063-485e-8816-2a2365a13248 req-09fa8684-0533-4402-8014-2b97214bfc23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034183 Feb 19 21:39:57.381993 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3112/6140] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:39:58.076148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31efa856-9eb2-4d97-932a-fefa81442697 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:58.076835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-31efa856-9eb2-4d97-932a-fefa81442697 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:58.083609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31efa856-9eb2-4d97-932a-fefa81442697 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:58.084066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31efa856-9eb2-4d97-932a-fefa81442697 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:58.084891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31efa856-9eb2-4d97-932a-fefa81442697 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:58.085338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-31efa856-9eb2-4d97-932a-fefa81442697 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:58.099115 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-31efa856-9eb2-4d97-932a-fefa81442697 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed could not be found. Feb 19 21:39:58.099721 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-31efa856-9eb2-4d97-932a-fefa81442697 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:58.100589 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-31efa856-9eb2-4d97-932a-fefa81442697 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 404 len: 111 microversion: 2.1 time: 0.028169 Feb 19 21:39:58.101160 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3029/6141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:58 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:58.157285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f93ada12-86ae-4bc0-8089-0093c29627e8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:58.158531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f93ada12-86ae-4bc0-8089-0093c29627e8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:58.164890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f93ada12-86ae-4bc0-8089-0093c29627e8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:58.165356 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f93ada12-86ae-4bc0-8089-0093c29627e8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:58.166170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f93ada12-86ae-4bc0-8089-0093c29627e8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:58.166621 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f93ada12-86ae-4bc0-8089-0093c29627e8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:58.179703 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-f93ada12-86ae-4bc0-8089-0093c29627e8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed could not be found. Feb 19 21:39:58.180319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f93ada12-86ae-4bc0-8089-0093c29627e8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:58.181212 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f93ada12-86ae-4bc0-8089-0093c29627e8 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028993 Feb 19 21:39:58.181773 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3113/6142] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:39:58 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:59.377176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8225565b-d12e-4aa2-b645-17160ce3001e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:59.377686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8225565b-d12e-4aa2-b645-17160ce3001e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:59.384444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8225565b-d12e-4aa2-b645-17160ce3001e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.384903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8225565b-d12e-4aa2-b645-17160ce3001e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.385683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8225565b-d12e-4aa2-b645-17160ce3001e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.386128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8225565b-d12e-4aa2-b645-17160ce3001e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.400382 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-8225565b-d12e-4aa2-b645-17160ce3001e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed could not be found. Feb 19 21:39:59.400964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8225565b-d12e-4aa2-b645-17160ce3001e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:59.401773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8225565b-d12e-4aa2-b645-17160ce3001e tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 404 len: 111 microversion: 2.1 time: 0.028751 Feb 19 21:39:59.402303 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3030/6143] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:39:59 2022] DELETE /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:59.409954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd7e9af9-8d25-4472-a0d8-f41b67bbaf58 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:59.410611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cd7e9af9-8d25-4472-a0d8-f41b67bbaf58 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: 50a3006e-910f-4eba-952b-b85ba8cda4ed] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:59.417595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd7e9af9-8d25-4472-a0d8-f41b67bbaf58 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.418065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd7e9af9-8d25-4472-a0d8-f41b67bbaf58 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.418859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd7e9af9-8d25-4472-a0d8-f41b67bbaf58 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.419315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cd7e9af9-8d25-4472-a0d8-f41b67bbaf58 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.432833 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-cd7e9af9-8d25-4472-a0d8-f41b67bbaf58 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed could not be found. Feb 19 21:39:59.433428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cd7e9af9-8d25-4472-a0d8-f41b67bbaf58 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance 50a3006e-910f-4eba-952b-b85ba8cda4ed could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:59.434269 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cd7e9af9-8d25-4472-a0d8-f41b67bbaf58 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed" status: 404 len: 111 microversion: 2.1 time: 0.028007 Feb 19 21:39:59.434797 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3114/6144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:59 2022] GET /compute/v2.1/servers/50a3006e-910f-4eba-952b-b85ba8cda4ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:59.442925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae9d5f8c-09ee-4775-a3cf-908301054a80 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:59.443421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ae9d5f8c-09ee-4775-a3cf-908301054a80 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:59.449554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae9d5f8c-09ee-4775-a3cf-908301054a80 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.450001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae9d5f8c-09ee-4775-a3cf-908301054a80 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.450775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae9d5f8c-09ee-4775-a3cf-908301054a80 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.452023 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ae9d5f8c-09ee-4775-a3cf-908301054a80 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.465007 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-ae9d5f8c-09ee-4775-a3cf-908301054a80 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e could not be found. Feb 19 21:39:59.465585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ae9d5f8c-09ee-4775-a3cf-908301054a80 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:59.466386 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ae9d5f8c-09ee-4775-a3cf-908301054a80 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 404 len: 111 microversion: 2.1 time: 0.027239 Feb 19 21:39:59.466999 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3031/6145] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:39:59 2022] DELETE /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:59.474533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b0c85337-be55-42f9-acfc-1a807f04be61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:59.475160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b0c85337-be55-42f9-acfc-1a807f04be61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f5d7baba-6d4e-471b-9c6a-8bd68a76911e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:59.481119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0c85337-be55-42f9-acfc-1a807f04be61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.481970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0c85337-be55-42f9-acfc-1a807f04be61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.484944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0c85337-be55-42f9-acfc-1a807f04be61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.484944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b0c85337-be55-42f9-acfc-1a807f04be61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.499634 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-b0c85337-be55-42f9-acfc-1a807f04be61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e could not be found. Feb 19 21:39:59.500236 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b0c85337-be55-42f9-acfc-1a807f04be61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance f5d7baba-6d4e-471b-9c6a-8bd68a76911e could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:59.501133 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b0c85337-be55-42f9-acfc-1a807f04be61 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e" status: 404 len: 111 microversion: 2.1 time: 0.030302 Feb 19 21:39:59.501689 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3115/6146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:59 2022] GET /compute/v2.1/servers/f5d7baba-6d4e-471b-9c6a-8bd68a76911e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:59.510743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-291a1b5c-ddeb-4bd1-b672-dfc8cf4e7db6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:59.511441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-291a1b5c-ddeb-4bd1-b672-dfc8cf4e7db6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:59.518112 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-291a1b5c-ddeb-4bd1-b672-dfc8cf4e7db6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.518563 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-291a1b5c-ddeb-4bd1-b672-dfc8cf4e7db6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.519342 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-291a1b5c-ddeb-4bd1-b672-dfc8cf4e7db6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.519784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-291a1b5c-ddeb-4bd1-b672-dfc8cf4e7db6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.535062 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-291a1b5c-ddeb-4bd1-b672-dfc8cf4e7db6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance a52408e4-2619-4325-872c-04c09ce81c4f could not be found. Feb 19 21:39:59.535650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-291a1b5c-ddeb-4bd1-b672-dfc8cf4e7db6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance a52408e4-2619-4325-872c-04c09ce81c4f could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:59.536496 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-291a1b5c-ddeb-4bd1-b672-dfc8cf4e7db6 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 404 len: 111 microversion: 2.1 time: 0.029427 Feb 19 21:39:59.537035 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3032/6147] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:39:59 2022] DELETE /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:59.544738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ff614d6a-4594-4694-854f-4129230fb25c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:59.545367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ff614d6a-4594-4694-854f-4129230fb25c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: a52408e4-2619-4325-872c-04c09ce81c4f] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:59.551294 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ff614d6a-4594-4694-854f-4129230fb25c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.551759 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ff614d6a-4594-4694-854f-4129230fb25c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.552611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ff614d6a-4594-4694-854f-4129230fb25c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.553029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ff614d6a-4594-4694-854f-4129230fb25c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.567170 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-ff614d6a-4594-4694-854f-4129230fb25c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance a52408e4-2619-4325-872c-04c09ce81c4f could not be found. Feb 19 21:39:59.567785 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ff614d6a-4594-4694-854f-4129230fb25c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance a52408e4-2619-4325-872c-04c09ce81c4f could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:59.568637 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ff614d6a-4594-4694-854f-4129230fb25c tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f" status: 404 len: 111 microversion: 2.1 time: 0.027573 Feb 19 21:39:59.569174 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3116/6148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:59 2022] GET /compute/v2.1/servers/a52408e4-2619-4325-872c-04c09ce81c4f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:59.577546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca5ae3a1-158b-4f69-8b1a-c132795a324b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:59.578045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ca5ae3a1-158b-4f69-8b1a-c132795a324b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:59.583851 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca5ae3a1-158b-4f69-8b1a-c132795a324b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.584304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca5ae3a1-158b-4f69-8b1a-c132795a324b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.585115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca5ae3a1-158b-4f69-8b1a-c132795a324b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.585559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ca5ae3a1-158b-4f69-8b1a-c132795a324b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.598510 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-ca5ae3a1-158b-4f69-8b1a-c132795a324b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 could not be found. Feb 19 21:39:59.599124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ca5ae3a1-158b-4f69-8b1a-c132795a324b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:59.599931 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ca5ae3a1-158b-4f69-8b1a-c132795a324b tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 404 len: 111 microversion: 2.1 time: 0.026633 Feb 19 21:39:59.600488 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3033/6149] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:39:59 2022] DELETE /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:59.608636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-59ffae56-2017-4c7c-86c4-4e4d8209205d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:59.609200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-59ffae56-2017-4c7c-86c4-4e4d8209205d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] [instance: f1756cbb-ab59-416e-b79f-6b6462b3d8b7] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:39:59.615028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59ffae56-2017-4c7c-86c4-4e4d8209205d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.615487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59ffae56-2017-4c7c-86c4-4e4d8209205d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.616266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59ffae56-2017-4c7c-86c4-4e4d8209205d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:39:59.616738 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-59ffae56-2017-4c7c-86c4-4e4d8209205d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:39:59.630517 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-59ffae56-2017-4c7c-86c4-4e4d8209205d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] HTTP exception thrown: Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 could not be found. Feb 19 21:39:59.631127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-59ffae56-2017-4c7c-86c4-4e4d8209205d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Returning 404 to user: Instance f1756cbb-ab59-416e-b79f-6b6462b3d8b7 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:39:59.631942 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-59ffae56-2017-4c7c-86c4-4e4d8209205d tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7" status: 404 len: 111 microversion: 2.1 time: 0.027543 Feb 19 21:39:59.632487 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3117/6150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:39:59 2022] GET /compute/v2.1/servers/f1756cbb-ab59-416e-b79f-6b6462b3d8b7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:39:59.640004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-460786ad-78e7-4b89-a963-8c83ecf91a91 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] Calling method '.version_select at 0x7f6474294310>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:39:59.664122 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-460786ad-78e7-4b89-a963-8c83ecf91a91 tempest-ServerActionsTestJSON-859315114 tempest-ServerActionsTestJSON-859315114-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-129249094" status: 202 len: 0 microversion: 2.1 time: 0.027535 Feb 19 21:39:59.664742 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3034/6151] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Feb 19 21:39:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-129249094 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:40:05.236351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1766679846", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "2f9090c3-3640-45a1-8af5-3c390673c0cd"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:05.288248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] validate_networks() for [('2f9090c3-3640-45a1-8af5-3c390673c0cd', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:40:05.633207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:40:05.633643 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:40:05.634132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:40:05.634586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:40:05.635009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:40:05.643701 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:05.644164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:05.645032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:05.645482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:05.661667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Getting quotas for project 7722259605b44471bf91ed3ba30b3373. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:40:05.666770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Getting quotas for user 0166be843e8446df80616100c521aaf2 and project 7722259605b44471bf91ed3ba30b3373. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:40:05.679112 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:40:05.681724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:40:05.725722 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-079d49db-90cd-4230-920e-d10e3ff2b07b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613013 Feb 19 21:40:05.726596 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3118/6152] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:40:05.737724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c443027-a431-4806-9e92-8b9e642034ea tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:05.738335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3c443027-a431-4806-9e92-8b9e642034ea tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:05.792843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c443027-a431-4806-9e92-8b9e642034ea tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:05.800084 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c443027-a431-4806-9e92-8b9e642034ea tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1217 microversion: 2.1 time: 0.067637 Feb 19 21:40:05.800763 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3035/6153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:05 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:06.818201 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aa3f807e-a7de-491d-a177-092fd1c5f969 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:06.818890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aa3f807e-a7de-491d-a177-092fd1c5f969 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:06.826122 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa3f807e-a7de-491d-a177-092fd1c5f969 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:06.827115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa3f807e-a7de-491d-a177-092fd1c5f969 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:06.827915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa3f807e-a7de-491d-a177-092fd1c5f969 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:06.828398 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aa3f807e-a7de-491d-a177-092fd1c5f969 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:06.889794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aa3f807e-a7de-491d-a177-092fd1c5f969 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:06.897311 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aa3f807e-a7de-491d-a177-092fd1c5f969 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1275 microversion: 2.1 time: 0.083786 Feb 19 21:40:06.897899 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3119/6154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:06 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:07.838825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-c78f155b-e90b-44ba-9108-69d142997bd3 req-82e6ecf8-b659-4541-85b6-5a4289cb821f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf8912b-192b-46c7-b38b-db082ae96558", "tag": "b7858cee-794e-47af-a57f-4610eafb9d6d"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:07.841210 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:40:07.841210 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:40:07.850060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c78f155b-e90b-44ba-9108-69d142997bd3 req-82e6ecf8-b659-4541-85b6-5a4289cb821f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:07.850497 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-c78f155b-e90b-44ba-9108-69d142997bd3 req-82e6ecf8-b659-4541-85b6-5a4289cb821f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:07.864621 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-c78f155b-e90b-44ba-9108-69d142997bd3 req-82e6ecf8-b659-4541-85b6-5a4289cb821f service nova] Creating event network-changed:b7858cee-794e-47af-a57f-4610eafb9d6d for instance abf8912b-192b-46c7-b38b-db082ae96558 on nch1-master-1 Feb 19 21:40:07.870295 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-c78f155b-e90b-44ba-9108-69d142997bd3 req-82e6ecf8-b659-4541-85b6-5a4289cb821f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036103 Feb 19 21:40:07.870979 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3036/6155] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:40:07.914688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-220c82b3-ba02-4503-be8c-839dd22b60c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:07.915389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-220c82b3-ba02-4503-be8c-839dd22b60c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:07.923125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-220c82b3-ba02-4503-be8c-839dd22b60c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:07.923592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-220c82b3-ba02-4503-be8c-839dd22b60c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:07.924428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-220c82b3-ba02-4503-be8c-839dd22b60c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:07.924956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-220c82b3-ba02-4503-be8c-839dd22b60c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:08.071566 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-220c82b3-ba02-4503-be8c-839dd22b60c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:08.079119 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-220c82b3-ba02-4503-be8c-839dd22b60c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1317 microversion: 2.1 time: 0.168365 Feb 19 21:40:08.079630 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3120/6156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:07 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:09.096785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3fd59b5e-8be4-486f-9947-653e1088980c tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:09.097492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3fd59b5e-8be4-486f-9947-653e1088980c tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:09.104524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fd59b5e-8be4-486f-9947-653e1088980c tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:09.104987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fd59b5e-8be4-486f-9947-653e1088980c tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:09.105769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fd59b5e-8be4-486f-9947-653e1088980c tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:09.106214 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fd59b5e-8be4-486f-9947-653e1088980c tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:09.238265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3fd59b5e-8be4-486f-9947-653e1088980c tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:09.245577 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3fd59b5e-8be4-486f-9947-653e1088980c tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1317 microversion: 2.1 time: 0.153606 Feb 19 21:40:09.246159 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3037/6157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:09 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:10.262364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2dec3c4c-ec49-40f2-aece-192f365d45d5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:10.263104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2dec3c4c-ec49-40f2-aece-192f365d45d5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:10.270865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2dec3c4c-ec49-40f2-aece-192f365d45d5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:10.271437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2dec3c4c-ec49-40f2-aece-192f365d45d5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:10.272267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2dec3c4c-ec49-40f2-aece-192f365d45d5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:10.272842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2dec3c4c-ec49-40f2-aece-192f365d45d5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:10.419401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2dec3c4c-ec49-40f2-aece-192f365d45d5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:10.427323 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2dec3c4c-ec49-40f2-aece-192f365d45d5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1317 microversion: 2.1 time: 0.168747 Feb 19 21:40:10.428138 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3121/6158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:10 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:11.444572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d813c86b-05a3-4df9-879e-379a1d4b12fb tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:11.445444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d813c86b-05a3-4df9-879e-379a1d4b12fb tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:11.452750 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d813c86b-05a3-4df9-879e-379a1d4b12fb tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:11.453205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d813c86b-05a3-4df9-879e-379a1d4b12fb tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:11.453988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d813c86b-05a3-4df9-879e-379a1d4b12fb tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:11.454434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d813c86b-05a3-4df9-879e-379a1d4b12fb tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:11.586817 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d813c86b-05a3-4df9-879e-379a1d4b12fb tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:11.594246 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d813c86b-05a3-4df9-879e-379a1d4b12fb tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1317 microversion: 2.1 time: 0.153402 Feb 19 21:40:11.594828 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3038/6159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:11 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:40:12.319158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-fea5a51a-e251-4b46-819f-05e239e46860 req-252ee22f-d86f-4650-89b7-575c3ebc4ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf8912b-192b-46c7-b38b-db082ae96558", "name": "network-vif-plugged", "status": "completed", "tag": "b7858cee-794e-47af-a57f-4610eafb9d6d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:12.321052 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:40:12.321052 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:40:12.328043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fea5a51a-e251-4b46-819f-05e239e46860 req-252ee22f-d86f-4650-89b7-575c3ebc4ff6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:12.328531 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fea5a51a-e251-4b46-819f-05e239e46860 req-252ee22f-d86f-4650-89b7-575c3ebc4ff6 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:12.339261 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-fea5a51a-e251-4b46-819f-05e239e46860 req-252ee22f-d86f-4650-89b7-575c3ebc4ff6 service nova] Creating event network-vif-plugged:b7858cee-794e-47af-a57f-4610eafb9d6d for instance abf8912b-192b-46c7-b38b-db082ae96558 on nch1-master-1 Feb 19 21:40:12.345059 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-fea5a51a-e251-4b46-819f-05e239e46860 req-252ee22f-d86f-4650-89b7-575c3ebc4ff6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093641 Feb 19 21:40:12.345595 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3122/6160] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:40:12.610728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-84e423c5-af8a-4795-a179-9af87a24b306 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:12.611274 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-84e423c5-af8a-4795-a179-9af87a24b306 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:12.617976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84e423c5-af8a-4795-a179-9af87a24b306 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:12.618428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84e423c5-af8a-4795-a179-9af87a24b306 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:12.619204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84e423c5-af8a-4795-a179-9af87a24b306 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:12.619719 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-84e423c5-af8a-4795-a179-9af87a24b306 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:12.751475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-84e423c5-af8a-4795-a179-9af87a24b306 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:12.758670 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-84e423c5-af8a-4795-a179-9af87a24b306 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1317 microversion: 2.1 time: 0.151764 Feb 19 21:40:12.759259 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3039/6161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:12 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:13.776387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eb2bdeae-f3f5-4ef4-94cb-7deaeb012394 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:13.777109 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eb2bdeae-f3f5-4ef4-94cb-7deaeb012394 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:13.783305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb2bdeae-f3f5-4ef4-94cb-7deaeb012394 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:13.783768 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb2bdeae-f3f5-4ef4-94cb-7deaeb012394 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:13.784606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb2bdeae-f3f5-4ef4-94cb-7deaeb012394 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:13.785060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb2bdeae-f3f5-4ef4-94cb-7deaeb012394 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:13.924851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-eb2bdeae-f3f5-4ef4-94cb-7deaeb012394 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:13.932220 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eb2bdeae-f3f5-4ef4-94cb-7deaeb012394 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1506 microversion: 2.1 time: 0.160812 Feb 19 21:40:13.932876 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3123/6162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:13 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:13.988120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1514116052", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "2f9090c3-3640-45a1-8af5-3c390673c0cd"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:14.041142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] validate_networks() for [('2f9090c3-3640-45a1-8af5-3c390673c0cd', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:40:14.405830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:40:14.406261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:40:14.406753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:40:14.407170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:40:14.407615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:40:14.416524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:14.416989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:14.417845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:14.418285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:14.434503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Getting quotas for project 7722259605b44471bf91ed3ba30b3373. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:40:14.440054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Getting quotas for user 0166be843e8446df80616100c521aaf2 and project 7722259605b44471bf91ed3ba30b3373. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:40:14.452918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:40:14.455195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:40:14.498320 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eee1302f-9611-4357-b2ef-bcfa6fdfa20a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513304 Feb 19 21:40:14.498911 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3040/6163] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:40:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:40:14.508538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-836318ac-59f1-4a50-8e37-3842b99c50b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:14.509191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-836318ac-59f1-4a50-8e37-3842b99c50b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:14.561460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-836318ac-59f1-4a50-8e37-3842b99c50b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:14.567989 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-836318ac-59f1-4a50-8e37-3842b99c50b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1217 microversion: 2.1 time: 0.063133 Feb 19 21:40:14.568619 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3124/6164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:14 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:15.588019 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5f4e93e6-9689-4bd5-9296-f0765df4ae32 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:15.588904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5f4e93e6-9689-4bd5-9296-f0765df4ae32 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:15.596210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f4e93e6-9689-4bd5-9296-f0765df4ae32 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:15.596757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f4e93e6-9689-4bd5-9296-f0765df4ae32 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:15.597620 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f4e93e6-9689-4bd5-9296-f0765df4ae32 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:15.598133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f4e93e6-9689-4bd5-9296-f0765df4ae32 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:15.692222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5f4e93e6-9689-4bd5-9296-f0765df4ae32 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:15.700225 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5f4e93e6-9689-4bd5-9296-f0765df4ae32 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1275 microversion: 2.1 time: 0.117736 Feb 19 21:40:15.701731 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3041/6165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:15 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:40:16.673666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6797ccbd-571b-46a0-a3c2-69ea5ba5d857 req-f0a75ed3-e92c-41c4-af1f-30d4f51647ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f39dcc-810f-4ce5-b59e-1390ab334d67", "tag": "7abb909a-01d6-467b-ac0e-add5751b174b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:16.676048 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:40:16.676048 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:40:16.684644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6797ccbd-571b-46a0-a3c2-69ea5ba5d857 req-f0a75ed3-e92c-41c4-af1f-30d4f51647ec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:16.685256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6797ccbd-571b-46a0-a3c2-69ea5ba5d857 req-f0a75ed3-e92c-41c4-af1f-30d4f51647ec service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:16.696820 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6797ccbd-571b-46a0-a3c2-69ea5ba5d857 req-f0a75ed3-e92c-41c4-af1f-30d4f51647ec service nova] Creating event network-changed:7abb909a-01d6-467b-ac0e-add5751b174b for instance f1f39dcc-810f-4ce5-b59e-1390ab334d67 on nch2-master-1 Feb 19 21:40:16.701881 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6797ccbd-571b-46a0-a3c2-69ea5ba5d857 req-f0a75ed3-e92c-41c4-af1f-30d4f51647ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032697 Feb 19 21:40:16.702492 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3125/6166] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:40:16.717368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-373932c8-54af-4938-9558-b465d8b7423a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:16.717978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-373932c8-54af-4938-9558-b465d8b7423a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:16.725293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-373932c8-54af-4938-9558-b465d8b7423a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:16.726055 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-373932c8-54af-4938-9558-b465d8b7423a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:16.727611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-373932c8-54af-4938-9558-b465d8b7423a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:16.728184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-373932c8-54af-4938-9558-b465d8b7423a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:17.322895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-373932c8-54af-4938-9558-b465d8b7423a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:17.330911 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-373932c8-54af-4938-9558-b465d8b7423a tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1317 microversion: 2.1 time: 0.617706 Feb 19 21:40:17.331493 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3042/6167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:16 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:18.349232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2bc2800b-5172-4fd8-9351-f264afa351c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:18.349943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2bc2800b-5172-4fd8-9351-f264afa351c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:18.356092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2bc2800b-5172-4fd8-9351-f264afa351c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:18.356586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2bc2800b-5172-4fd8-9351-f264afa351c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:18.358097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2bc2800b-5172-4fd8-9351-f264afa351c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:18.358538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2bc2800b-5172-4fd8-9351-f264afa351c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:18.498285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2bc2800b-5172-4fd8-9351-f264afa351c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:18.505831 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2bc2800b-5172-4fd8-9351-f264afa351c4 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1317 microversion: 2.1 time: 0.161587 Feb 19 21:40:18.506412 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3126/6168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:18 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:19.522727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3adf6740-ef94-4741-bf70-414f96eaf6e6 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:19.523335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3adf6740-ef94-4741-bf70-414f96eaf6e6 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:19.530599 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3adf6740-ef94-4741-bf70-414f96eaf6e6 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:19.531074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3adf6740-ef94-4741-bf70-414f96eaf6e6 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:19.531848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3adf6740-ef94-4741-bf70-414f96eaf6e6 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:19.532311 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3adf6740-ef94-4741-bf70-414f96eaf6e6 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:19.663036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3adf6740-ef94-4741-bf70-414f96eaf6e6 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:19.670831 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3adf6740-ef94-4741-bf70-414f96eaf6e6 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1317 microversion: 2.1 time: 0.151760 Feb 19 21:40:19.671402 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3043/6169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:19 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:20.687695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b57b7969-2242-4434-8c9d-d871c80a7a1b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:20.688350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b57b7969-2242-4434-8c9d-d871c80a7a1b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:20.695394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b57b7969-2242-4434-8c9d-d871c80a7a1b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:20.695868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b57b7969-2242-4434-8c9d-d871c80a7a1b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:20.696681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b57b7969-2242-4434-8c9d-d871c80a7a1b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:20.697145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b57b7969-2242-4434-8c9d-d871c80a7a1b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:20.837245 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b57b7969-2242-4434-8c9d-d871c80a7a1b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:20.845379 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b57b7969-2242-4434-8c9d-d871c80a7a1b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1317 microversion: 2.1 time: 0.161783 Feb 19 21:40:20.845987 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3127/6170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:20 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:21.862156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-64646658-879c-40db-9f76-98ce4ddf8287 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:21.862799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-64646658-879c-40db-9f76-98ce4ddf8287 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:21.869483 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64646658-879c-40db-9f76-98ce4ddf8287 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:21.869933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64646658-879c-40db-9f76-98ce4ddf8287 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:21.870708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64646658-879c-40db-9f76-98ce4ddf8287 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:21.871147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-64646658-879c-40db-9f76-98ce4ddf8287 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:22.006100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-64646658-879c-40db-9f76-98ce4ddf8287 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:22.013873 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-64646658-879c-40db-9f76-98ce4ddf8287 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1317 microversion: 2.1 time: 0.155044 Feb 19 21:40:22.014451 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3044/6171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:21 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:22.449964 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-cb25fe9e-0014-4a43-a3a3-ab9b9ecf7b20 req-e802fada-35f7-4cd6-a964-2a0d8eed168c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f39dcc-810f-4ce5-b59e-1390ab334d67", "name": "network-vif-plugged", "status": "completed", "tag": "7abb909a-01d6-467b-ac0e-add5751b174b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:22.452374 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:40:22.452374 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:40:22.463582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cb25fe9e-0014-4a43-a3a3-ab9b9ecf7b20 req-e802fada-35f7-4cd6-a964-2a0d8eed168c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:22.464371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cb25fe9e-0014-4a43-a3a3-ab9b9ecf7b20 req-e802fada-35f7-4cd6-a964-2a0d8eed168c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:22.477025 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-cb25fe9e-0014-4a43-a3a3-ab9b9ecf7b20 req-e802fada-35f7-4cd6-a964-2a0d8eed168c service nova] Creating event network-vif-plugged:7abb909a-01d6-467b-ac0e-add5751b174b for instance f1f39dcc-810f-4ce5-b59e-1390ab334d67 on nch2-master-1 Feb 19 21:40:22.482700 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-cb25fe9e-0014-4a43-a3a3-ab9b9ecf7b20 req-e802fada-35f7-4cd6-a964-2a0d8eed168c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036896 Feb 19 21:40:22.482983 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3128/6172] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:40:23.031144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-babd1754-b33a-4fed-80c5-33892f9287b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:23.031759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-babd1754-b33a-4fed-80c5-33892f9287b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:23.038604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-babd1754-b33a-4fed-80c5-33892f9287b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:23.039066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-babd1754-b33a-4fed-80c5-33892f9287b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:23.039850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-babd1754-b33a-4fed-80c5-33892f9287b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:23.040294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-babd1754-b33a-4fed-80c5-33892f9287b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:23.173028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-babd1754-b33a-4fed-80c5-33892f9287b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:23.180250 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-babd1754-b33a-4fed-80c5-33892f9287b3 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1317 microversion: 2.1 time: 0.153494 Feb 19 21:40:23.180859 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3045/6173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:23 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:24.198430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-88f1ae47-7677-4f81-b5e3-68f06e698312 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:24.199260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-88f1ae47-7677-4f81-b5e3-68f06e698312 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:24.206871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-88f1ae47-7677-4f81-b5e3-68f06e698312 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:24.207334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-88f1ae47-7677-4f81-b5e3-68f06e698312 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:24.208116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-88f1ae47-7677-4f81-b5e3-68f06e698312 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:24.208586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-88f1ae47-7677-4f81-b5e3-68f06e698312 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:24.340762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-88f1ae47-7677-4f81-b5e3-68f06e698312 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:24.348170 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-88f1ae47-7677-4f81-b5e3-68f06e698312 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1506 microversion: 2.1 time: 0.154247 Feb 19 21:40:24.348776 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3129/6174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:24 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:40:24.364499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f1179dc-cf09-4746-9d3d-2197bfb18da1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:24.365008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f1179dc-cf09-4746-9d3d-2197bfb18da1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:24.371717 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f1179dc-cf09-4746-9d3d-2197bfb18da1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:24.372172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f1179dc-cf09-4746-9d3d-2197bfb18da1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:24.372992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f1179dc-cf09-4746-9d3d-2197bfb18da1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:24.373432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f1179dc-cf09-4746-9d3d-2197bfb18da1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:24.397779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f1179dc-cf09-4746-9d3d-2197bfb18da1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:40:24.469791 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f1179dc-cf09-4746-9d3d-2197bfb18da1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 204 len: 0 microversion: 2.1 time: 0.108679 Feb 19 21:40:24.470819 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3046/6175] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:40:24 2022] DELETE /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:40:24.479784 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eb2a657c-c2d1-4b17-91a0-4addd69bb004 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:24.480789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eb2a657c-c2d1-4b17-91a0-4addd69bb004 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:24.489451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb2a657c-c2d1-4b17-91a0-4addd69bb004 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:24.489913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb2a657c-c2d1-4b17-91a0-4addd69bb004 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:24.490712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb2a657c-c2d1-4b17-91a0-4addd69bb004 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:24.491154 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eb2a657c-c2d1-4b17-91a0-4addd69bb004 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:24.630470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-eb2a657c-c2d1-4b17-91a0-4addd69bb004 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:24.637754 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eb2a657c-c2d1-4b17-91a0-4addd69bb004 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1512 microversion: 2.1 time: 0.162804 Feb 19 21:40:24.638324 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3130/6176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:24 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:25.655752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a912b41-1c96-49d9-8de2-a1d0e7dea4ed tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:25.656461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a912b41-1c96-49d9-8de2-a1d0e7dea4ed tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:25.663172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a912b41-1c96-49d9-8de2-a1d0e7dea4ed tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:25.663633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a912b41-1c96-49d9-8de2-a1d0e7dea4ed tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:25.664437 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a912b41-1c96-49d9-8de2-a1d0e7dea4ed tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:25.664874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a912b41-1c96-49d9-8de2-a1d0e7dea4ed tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:25.804286 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5a912b41-1c96-49d9-8de2-a1d0e7dea4ed tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:25.812248 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5a912b41-1c96-49d9-8de2-a1d0e7dea4ed tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 200 len: 1512 microversion: 2.1 time: 0.161352 Feb 19 21:40:25.812865 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3047/6177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:25 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:26.359361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b0e61b63-0786-4d4a-a645-f7234c7aeee8 req-9a270ecf-917f-4d38-bd10-c5de4bcf87cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f39dcc-810f-4ce5-b59e-1390ab334d67", "name": "network-vif-deleted", "tag": "7abb909a-01d6-467b-ac0e-add5751b174b"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:26.360929 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:40:26.360929 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:40:26.368841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b0e61b63-0786-4d4a-a645-f7234c7aeee8 req-9a270ecf-917f-4d38-bd10-c5de4bcf87cd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:26.369302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b0e61b63-0786-4d4a-a645-f7234c7aeee8 req-9a270ecf-917f-4d38-bd10-c5de4bcf87cd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:26.381756 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b0e61b63-0786-4d4a-a645-f7234c7aeee8 req-9a270ecf-917f-4d38-bd10-c5de4bcf87cd service nova] Creating event network-vif-deleted:7abb909a-01d6-467b-ac0e-add5751b174b for instance f1f39dcc-810f-4ce5-b59e-1390ab334d67 on nch2-master-1 Feb 19 21:40:26.387081 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b0e61b63-0786-4d4a-a645-f7234c7aeee8 req-9a270ecf-917f-4d38-bd10-c5de4bcf87cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031886 Feb 19 21:40:26.387705 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3131/6178] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:40:26.829095 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-107622af-02f4-4efb-b777-554162d4fa88 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:26.829767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-107622af-02f4-4efb-b777-554162d4fa88 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:26.836535 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-107622af-02f4-4efb-b777-554162d4fa88 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:26.836991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-107622af-02f4-4efb-b777-554162d4fa88 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:26.837778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-107622af-02f4-4efb-b777-554162d4fa88 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:26.838221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-107622af-02f4-4efb-b777-554162d4fa88 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:26.851095 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-107622af-02f4-4efb-b777-554162d4fa88 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] HTTP exception thrown: Instance f1f39dcc-810f-4ce5-b59e-1390ab334d67 could not be found. Feb 19 21:40:26.851667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-107622af-02f4-4efb-b777-554162d4fa88 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Returning 404 to user: Instance f1f39dcc-810f-4ce5-b59e-1390ab334d67 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:40:26.852521 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-107622af-02f4-4efb-b777-554162d4fa88 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 404 len: 111 microversion: 2.1 time: 0.027620 Feb 19 21:40:26.853067 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3048/6179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:26 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:40:26.862498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0fe987db-b7c9-4475-8b04-c90accba7091 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:26.863207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0fe987db-b7c9-4475-8b04-c90accba7091 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:26.869431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fe987db-b7c9-4475-8b04-c90accba7091 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:26.869890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fe987db-b7c9-4475-8b04-c90accba7091 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:26.870667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fe987db-b7c9-4475-8b04-c90accba7091 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:26.871113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0fe987db-b7c9-4475-8b04-c90accba7091 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.007360 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0fe987db-b7c9-4475-8b04-c90accba7091 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:27.014812 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0fe987db-b7c9-4475-8b04-c90accba7091 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1506 microversion: 2.1 time: 0.156950 Feb 19 21:40:27.015386 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3132/6180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:26 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:27.031098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a5b85721-dadd-4b85-9713-5e358e76f895 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:27.032113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a5b85721-dadd-4b85-9713-5e358e76f895 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: b0efd73a-ed1e-4e23-b882-1330f7d2d6da] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:27.037388 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-a5b85721-dadd-4b85-9713-5e358e76f895 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] HTTP exception thrown: Instance b0efd73a-ed1e-4e23-b882-1330f7d2d6da could not be found. Feb 19 21:40:27.037956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a5b85721-dadd-4b85-9713-5e358e76f895 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Returning 404 to user: Instance b0efd73a-ed1e-4e23-b882-1330f7d2d6da could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:40:27.038770 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a5b85721-dadd-4b85-9713-5e358e76f895 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "POST /compute/v2.1/servers/b0efd73a-ed1e-4e23-b882-1330f7d2d6da/action" status: 404 len: 111 microversion: 2.1 time: 0.011901 Feb 19 21:40:27.039271 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3049/6181] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:40:27 2022] POST /compute/v2.1/servers/b0efd73a-ed1e-4e23-b882-1330f7d2d6da/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:40:27.047283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a150407a-18cc-40bc-87f9-2cdc69c7288e tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:27.047900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a150407a-18cc-40bc-87f9-2cdc69c7288e tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:27.053676 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a150407a-18cc-40bc-87f9-2cdc69c7288e tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.054133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a150407a-18cc-40bc-87f9-2cdc69c7288e tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.054918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a150407a-18cc-40bc-87f9-2cdc69c7288e tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.055367 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a150407a-18cc-40bc-87f9-2cdc69c7288e tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.190955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a150407a-18cc-40bc-87f9-2cdc69c7288e tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:27.198447 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a150407a-18cc-40bc-87f9-2cdc69c7288e tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1506 microversion: 2.1 time: 0.155366 Feb 19 21:40:27.199006 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3133/6182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:27 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:27.215639 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-15bd382e-a0ad-4f1e-9141-a6e0605b1b17 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:27.216178 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-15bd382e-a0ad-4f1e-9141-a6e0605b1b17 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:27.223326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15bd382e-a0ad-4f1e-9141-a6e0605b1b17 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.223782 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15bd382e-a0ad-4f1e-9141-a6e0605b1b17 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.224586 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15bd382e-a0ad-4f1e-9141-a6e0605b1b17 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.225026 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-15bd382e-a0ad-4f1e-9141-a6e0605b1b17 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.357797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-15bd382e-a0ad-4f1e-9141-a6e0605b1b17 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:27.365148 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-15bd382e-a0ad-4f1e-9141-a6e0605b1b17 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1506 microversion: 2.1 time: 0.153174 Feb 19 21:40:27.365717 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3050/6183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:27 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:27.381105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d1ac33f2-3a6f-42a4-b352-4c527c154dfe"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:27.382074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:27.388807 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.389276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.390570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.391019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.418999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:27.424005 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] HTTP exception thrown: Flavor d1ac33f2-3a6f-42a4-b352-4c527c154dfe could not be found. Feb 19 21:40:27.424638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Returning 400 to user: Flavor d1ac33f2-3a6f-42a4-b352-4c527c154dfe could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:40:27.425478 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-37459923-c65d-4759-a30a-3e6ec67b785b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "POST /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558/action" status: 400 len: 107 microversion: 2.1 time: 0.048231 Feb 19 21:40:27.426039 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3134/6184] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:40:27 2022] POST /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558/action => generated 107 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:40:27.434085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4d5bcdca-0b5d-4b83-bccb-b3154f03deb1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:27.434708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4d5bcdca-0b5d-4b83-bccb-b3154f03deb1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:27.440680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d5bcdca-0b5d-4b83-bccb-b3154f03deb1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.441138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d5bcdca-0b5d-4b83-bccb-b3154f03deb1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.441927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d5bcdca-0b5d-4b83-bccb-b3154f03deb1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.442616 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d5bcdca-0b5d-4b83-bccb-b3154f03deb1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.576307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4d5bcdca-0b5d-4b83-bccb-b3154f03deb1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:27.584240 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4d5bcdca-0b5d-4b83-bccb-b3154f03deb1 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1506 microversion: 2.1 time: 0.153835 Feb 19 21:40:27.584879 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3051/6185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:27 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:27.602083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1dc2e47a-b45f-48e0-bc56-d95bd592d5e0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:27.602706 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1dc2e47a-b45f-48e0-bc56-d95bd592d5e0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:27.609145 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dc2e47a-b45f-48e0-bc56-d95bd592d5e0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.609639 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dc2e47a-b45f-48e0-bc56-d95bd592d5e0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.610427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dc2e47a-b45f-48e0-bc56-d95bd592d5e0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.610876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1dc2e47a-b45f-48e0-bc56-d95bd592d5e0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.749127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1dc2e47a-b45f-48e0-bc56-d95bd592d5e0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:27.756531 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1dc2e47a-b45f-48e0-bc56-d95bd592d5e0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1506 microversion: 2.1 time: 0.158126 Feb 19 21:40:27.757108 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3135/6186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:27 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:27.772246 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-922fd7df-caa1-49c3-8f4c-4ed5fb77e88b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:27.773385 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-922fd7df-caa1-49c3-8f4c-4ed5fb77e88b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:40:27.774170 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-922fd7df-caa1-49c3-8f4c-4ed5fb77e88b tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "POST /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558/action" status: 400 len: 113 microversion: 2.1 time: 0.005699 Feb 19 21:40:27.774680 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3052/6187] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:40:27 2022] POST /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 21:40:27.782631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6eb9c8c3-d1df-49d4-8e79-70c36e79acde tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:27.783188 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6eb9c8c3-d1df-49d4-8e79-70c36e79acde tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:27.789046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb9c8c3-d1df-49d4-8e79-70c36e79acde tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.789504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb9c8c3-d1df-49d4-8e79-70c36e79acde tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.790282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb9c8c3-d1df-49d4-8e79-70c36e79acde tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.790727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eb9c8c3-d1df-49d4-8e79-70c36e79acde tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.923677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6eb9c8c3-d1df-49d4-8e79-70c36e79acde tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:27.931071 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6eb9c8c3-d1df-49d4-8e79-70c36e79acde tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1506 microversion: 2.1 time: 0.152556 Feb 19 21:40:27.931641 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3136/6188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:27 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:27.951855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9cb6fcf6-13e7-4790-958e-99feee24fdbd tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:27.952495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9cb6fcf6-13e7-4790-958e-99feee24fdbd tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:27.959357 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cb6fcf6-13e7-4790-958e-99feee24fdbd tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.959800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cb6fcf6-13e7-4790-958e-99feee24fdbd tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.960601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cb6fcf6-13e7-4790-958e-99feee24fdbd tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.961041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9cb6fcf6-13e7-4790-958e-99feee24fdbd tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.974354 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9cb6fcf6-13e7-4790-958e-99feee24fdbd tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] HTTP exception thrown: Instance f1f39dcc-810f-4ce5-b59e-1390ab334d67 could not be found. Feb 19 21:40:27.974935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9cb6fcf6-13e7-4790-958e-99feee24fdbd tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Returning 404 to user: Instance f1f39dcc-810f-4ce5-b59e-1390ab334d67 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:40:27.975863 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9cb6fcf6-13e7-4790-958e-99feee24fdbd tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 404 len: 111 microversion: 2.1 time: 0.028465 Feb 19 21:40:27.976423 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3053/6189] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:40:27 2022] DELETE /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:40:27.984777 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-69799da8-1329-4f41-b88b-d1e811afdaca tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:27.985393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-69799da8-1329-4f41-b88b-d1e811afdaca tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: f1f39dcc-810f-4ce5-b59e-1390ab334d67] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:27.991243 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69799da8-1329-4f41-b88b-d1e811afdaca tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.991702 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69799da8-1329-4f41-b88b-d1e811afdaca tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:27.992518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69799da8-1329-4f41-b88b-d1e811afdaca tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:27.992963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69799da8-1329-4f41-b88b-d1e811afdaca tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:28.006146 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-69799da8-1329-4f41-b88b-d1e811afdaca tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] HTTP exception thrown: Instance f1f39dcc-810f-4ce5-b59e-1390ab334d67 could not be found. Feb 19 21:40:28.006724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-69799da8-1329-4f41-b88b-d1e811afdaca tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Returning 404 to user: Instance f1f39dcc-810f-4ce5-b59e-1390ab334d67 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:40:28.007540 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-69799da8-1329-4f41-b88b-d1e811afdaca tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67" status: 404 len: 111 microversion: 2.1 time: 0.027141 Feb 19 21:40:28.008061 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3137/6190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:27 2022] GET /compute/v2.1/servers/f1f39dcc-810f-4ce5-b59e-1390ab334d67 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:40:28.015844 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0488f93f-3656-44e7-9405-10ee2ecc2ee0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:28.016398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0488f93f-3656-44e7-9405-10ee2ecc2ee0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:28.022315 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0488f93f-3656-44e7-9405-10ee2ecc2ee0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:28.022762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0488f93f-3656-44e7-9405-10ee2ecc2ee0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:28.023529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0488f93f-3656-44e7-9405-10ee2ecc2ee0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:28.023966 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0488f93f-3656-44e7-9405-10ee2ecc2ee0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:28.049429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0488f93f-3656-44e7-9405-10ee2ecc2ee0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:40:28.122091 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0488f93f-3656-44e7-9405-10ee2ecc2ee0 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 204 len: 0 microversion: 2.1 time: 0.109617 Feb 19 21:40:28.122711 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3054/6191] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:40:28 2022] DELETE /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 21:40:28.130619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ccc69de4-98f2-4807-a0ec-f44ffe6c82f5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:28.131269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ccc69de4-98f2-4807-a0ec-f44ffe6c82f5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:28.137216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccc69de4-98f2-4807-a0ec-f44ffe6c82f5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:28.137681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccc69de4-98f2-4807-a0ec-f44ffe6c82f5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:28.138472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccc69de4-98f2-4807-a0ec-f44ffe6c82f5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:28.138951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ccc69de4-98f2-4807-a0ec-f44ffe6c82f5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:28.276149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ccc69de4-98f2-4807-a0ec-f44ffe6c82f5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:28.284232 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ccc69de4-98f2-4807-a0ec-f44ffe6c82f5 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1512 microversion: 2.1 time: 0.157340 Feb 19 21:40:28.284838 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3138/6192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:28 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:29.300862 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f8af453e-bc02-4e17-a0c7-6ce9185173f2 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:29.301570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f8af453e-bc02-4e17-a0c7-6ce9185173f2 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:29.308191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8af453e-bc02-4e17-a0c7-6ce9185173f2 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:29.308678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8af453e-bc02-4e17-a0c7-6ce9185173f2 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:29.309465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8af453e-bc02-4e17-a0c7-6ce9185173f2 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:29.309943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f8af453e-bc02-4e17-a0c7-6ce9185173f2 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:29.446412 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f8af453e-bc02-4e17-a0c7-6ce9185173f2 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0166be843e8446df80616100c521aaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7722259605b44471bf91ed3ba30b3373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:40:29.454391 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f8af453e-bc02-4e17-a0c7-6ce9185173f2 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 200 len: 1512 microversion: 2.1 time: 0.157785 Feb 19 21:40:29.454977 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3055/6193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:29 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:40:29.974894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f8dad27a-2c5a-40c2-a89f-b7f0c20b4ca2 req-32a9cf5d-f834-4c04-b65e-795762d0cf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf8912b-192b-46c7-b38b-db082ae96558", "name": "network-vif-deleted", "tag": "b7858cee-794e-47af-a57f-4610eafb9d6d"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:40:29.976533 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:40:29.976533 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:40:29.986084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f8dad27a-2c5a-40c2-a89f-b7f0c20b4ca2 req-32a9cf5d-f834-4c04-b65e-795762d0cf94 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:29.986538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f8dad27a-2c5a-40c2-a89f-b7f0c20b4ca2 req-32a9cf5d-f834-4c04-b65e-795762d0cf94 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:29.998308 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f8dad27a-2c5a-40c2-a89f-b7f0c20b4ca2 req-32a9cf5d-f834-4c04-b65e-795762d0cf94 service nova] Creating event network-vif-deleted:b7858cee-794e-47af-a57f-4610eafb9d6d for instance abf8912b-192b-46c7-b38b-db082ae96558 on nch1-master-1 Feb 19 21:40:30.003214 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f8dad27a-2c5a-40c2-a89f-b7f0c20b4ca2 req-32a9cf5d-f834-4c04-b65e-795762d0cf94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031982 Feb 19 21:40:30.003805 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3139/6194] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:40:30.471404 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c6094be-b839-4f05-a7eb-5fd7d9f7b5d8 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:40:30.472006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c6094be-b839-4f05-a7eb-5fd7d9f7b5d8 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] [instance: abf8912b-192b-46c7-b38b-db082ae96558] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:40:30.478793 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6094be-b839-4f05-a7eb-5fd7d9f7b5d8 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:30.479248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6094be-b839-4f05-a7eb-5fd7d9f7b5d8 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:30.480035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6094be-b839-4f05-a7eb-5fd7d9f7b5d8 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:40:30.480524 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6094be-b839-4f05-a7eb-5fd7d9f7b5d8 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:40:30.493633 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-2c6094be-b839-4f05-a7eb-5fd7d9f7b5d8 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] HTTP exception thrown: Instance abf8912b-192b-46c7-b38b-db082ae96558 could not be found. Feb 19 21:40:30.494221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c6094be-b839-4f05-a7eb-5fd7d9f7b5d8 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] Returning 404 to user: Instance abf8912b-192b-46c7-b38b-db082ae96558 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:40:30.495076 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c6094be-b839-4f05-a7eb-5fd7d9f7b5d8 tempest-ServersNegativeTestJSON-10854928 tempest-ServersNegativeTestJSON-10854928-project] 10.222.0.30 "GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558" status: 404 len: 111 microversion: 2.1 time: 0.028034 Feb 19 21:40:30.495609 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3056/6195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:40:30 2022] GET /compute/v2.1/servers/abf8912b-192b-46c7-b38b-db082ae96558 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:41:08.216918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2e3bd2dd-838b-4fa2-bf2b-bc91f89b22db tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Action: 'create', calling method: .version_select at 0x7f6467c76940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1994244299"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:41:08.230496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-2e3bd2dd-838b-4fa2-bf2b-bc91f89b22db tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Getting quotas for project 5ff3f023fc254bbea87959ce0e95a1ae. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:41:08.235483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-2e3bd2dd-838b-4fa2-bf2b-bc91f89b22db tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Getting quotas for user 9e9155525bc1486da02f94f41e30fc4e and project 5ff3f023fc254bbea87959ce0e95a1ae. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:41:08.248735 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2e3bd2dd-838b-4fa2-bf2b-bc91f89b22db tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [7ef6f57c-af33-4f3d-bc45-3fbd6fb6066c] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 21:41:09.256187 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [None req-2e3bd2dd-838b-4fa2-bf2b-bc91f89b22db tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [7ef6f57c-af33-4f3d-bc45-3fbd6fb6066c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41232. Feb 19 21:41:09.605954 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-2e3bd2dd-838b-4fa2-bf2b-bc91f89b22db tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Getting quotas for project 5ff3f023fc254bbea87959ce0e95a1ae. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:41:09.612160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-2e3bd2dd-838b-4fa2-bf2b-bc91f89b22db tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Getting quotas for user 9e9155525bc1486da02f94f41e30fc4e and project 5ff3f023fc254bbea87959ce0e95a1ae. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:41:09.627840 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2e3bd2dd-838b-4fa2-bf2b-bc91f89b22db tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.416061 Feb 19 21:41:09.628501 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3140/6196] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:41:08 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:09.704100 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1410932889", "imageRef": "097d2fe1-3334-4f11-be44-05e307d31f31", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1994244299", "networks": [{"uuid": "65cc808f-a4a1-4b18-8229-ccf94ad140a8"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:41:09.886266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] validate_networks() for [('65cc808f-a4a1-4b18-8229-ccf94ad140a8', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:41:10.254538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:41:10.254927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:41:10.255396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:41:10.255807 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:41:10.256218 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:41:10.264939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:10.265393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:10.266234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:10.266672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:10.283757 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Getting quotas for project 5ff3f023fc254bbea87959ce0e95a1ae. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:41:10.288858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Getting quotas for user 9e9155525bc1486da02f94f41e30fc4e and project 5ff3f023fc254bbea87959ce0e95a1ae. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:41:10.301196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:41:10.303427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='097d2fe1-3334-4f11-be44-05e307d31f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:41:10.347227 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b8348a78-1c06-4a85-893b-dcc42794bdec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647773 Feb 19 21:41:10.347879 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3057/6197] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:41:10.358503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c31f2122-5c95-433a-bafe-e13bb6ba0176 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:10.359351 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c31f2122-5c95-433a-bafe-e13bb6ba0176 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:10.526389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c31f2122-5c95-433a-bafe-e13bb6ba0176 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:10.539796 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c31f2122-5c95-433a-bafe-e13bb6ba0176 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1259 microversion: 2.1 time: 0.185864 Feb 19 21:41:10.549356 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3141/6198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:10 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:11.558659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-179148c6-fa1e-4e39-ad5b-895d8fe9274b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:11.559261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-179148c6-fa1e-4e39-ad5b-895d8fe9274b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:11.565650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-179148c6-fa1e-4e39-ad5b-895d8fe9274b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:11.566057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-179148c6-fa1e-4e39-ad5b-895d8fe9274b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:11.566855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-179148c6-fa1e-4e39-ad5b-895d8fe9274b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:11.567596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-179148c6-fa1e-4e39-ad5b-895d8fe9274b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:11.649735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-179148c6-fa1e-4e39-ad5b-895d8fe9274b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:11.660202 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-179148c6-fa1e-4e39-ad5b-895d8fe9274b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1317 microversion: 2.1 time: 0.106853 Feb 19 21:41:11.661856 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3058/6199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:11 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:12.679852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c48535bc-b901-4fb1-a94a-a253dcadfdc4 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:12.680516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c48535bc-b901-4fb1-a94a-a253dcadfdc4 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:12.689538 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c48535bc-b901-4fb1-a94a-a253dcadfdc4 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:12.690002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c48535bc-b901-4fb1-a94a-a253dcadfdc4 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:12.690811 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c48535bc-b901-4fb1-a94a-a253dcadfdc4 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:12.691263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c48535bc-b901-4fb1-a94a-a253dcadfdc4 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:12.838561 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c48535bc-b901-4fb1-a94a-a253dcadfdc4 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:12.846954 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c48535bc-b901-4fb1-a94a-a253dcadfdc4 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.170815 Feb 19 21:41:12.847652 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3142/6200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:12 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:13.864481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2ed9a8d5-3333-4b56-86ae-ad2fecfa4525 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:13.865177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2ed9a8d5-3333-4b56-86ae-ad2fecfa4525 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:13.872414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ed9a8d5-3333-4b56-86ae-ad2fecfa4525 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:13.872948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ed9a8d5-3333-4b56-86ae-ad2fecfa4525 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:13.874381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ed9a8d5-3333-4b56-86ae-ad2fecfa4525 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:13.874954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ed9a8d5-3333-4b56-86ae-ad2fecfa4525 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:14.024853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2ed9a8d5-3333-4b56-86ae-ad2fecfa4525 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:14.035260 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2ed9a8d5-3333-4b56-86ae-ad2fecfa4525 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.174587 Feb 19 21:41:14.045590 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3059/6201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:13 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:15.052121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e635f4a-325d-47dd-ab9a-e2529bee5fbd tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:15.052802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e635f4a-325d-47dd-ab9a-e2529bee5fbd tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:15.059726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e635f4a-325d-47dd-ab9a-e2529bee5fbd tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:15.060207 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e635f4a-325d-47dd-ab9a-e2529bee5fbd tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:15.061023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e635f4a-325d-47dd-ab9a-e2529bee5fbd tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:15.061470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e635f4a-325d-47dd-ab9a-e2529bee5fbd tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:15.207590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6e635f4a-325d-47dd-ab9a-e2529bee5fbd tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:15.215406 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6e635f4a-325d-47dd-ab9a-e2529bee5fbd tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.166984 Feb 19 21:41:15.218826 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3143/6202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:15 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:16.232895 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-05817d8d-bcaf-4ba9-9973-4aaf8f322ec1 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:16.234142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-05817d8d-bcaf-4ba9-9973-4aaf8f322ec1 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:16.241593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05817d8d-bcaf-4ba9-9973-4aaf8f322ec1 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:16.242375 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05817d8d-bcaf-4ba9-9973-4aaf8f322ec1 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:16.243382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05817d8d-bcaf-4ba9-9973-4aaf8f322ec1 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:16.244014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-05817d8d-bcaf-4ba9-9973-4aaf8f322ec1 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:16.408054 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-05817d8d-bcaf-4ba9-9973-4aaf8f322ec1 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:16.415816 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-05817d8d-bcaf-4ba9-9973-4aaf8f322ec1 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.187078 Feb 19 21:41:16.416825 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3060/6203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:16 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:17.433631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-76ee9618-3fe8-4826-a367-90febcb49055 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:17.434297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-76ee9618-3fe8-4826-a367-90febcb49055 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:17.441840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76ee9618-3fe8-4826-a367-90febcb49055 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:17.442312 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76ee9618-3fe8-4826-a367-90febcb49055 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:17.443177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76ee9618-3fe8-4826-a367-90febcb49055 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:17.443573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76ee9618-3fe8-4826-a367-90febcb49055 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:17.606698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-76ee9618-3fe8-4826-a367-90febcb49055 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:17.614462 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-76ee9618-3fe8-4826-a367-90febcb49055 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.184641 Feb 19 21:41:17.615051 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3144/6204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:17 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:18.631809 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b66d3810-1d9b-4f26-8d57-2abbeea26337 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:18.632465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b66d3810-1d9b-4f26-8d57-2abbeea26337 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:18.640840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b66d3810-1d9b-4f26-8d57-2abbeea26337 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:18.640840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b66d3810-1d9b-4f26-8d57-2abbeea26337 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:18.640840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b66d3810-1d9b-4f26-8d57-2abbeea26337 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:18.641324 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b66d3810-1d9b-4f26-8d57-2abbeea26337 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:18.779667 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b66d3810-1d9b-4f26-8d57-2abbeea26337 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:18.787345 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b66d3810-1d9b-4f26-8d57-2abbeea26337 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.159314 Feb 19 21:41:18.787922 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3061/6205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:18 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:19.804674 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-68cbcb90-532b-4e8c-afe8-98bda572b7ca tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:19.805313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-68cbcb90-532b-4e8c-afe8-98bda572b7ca tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:19.813166 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68cbcb90-532b-4e8c-afe8-98bda572b7ca tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:19.813641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68cbcb90-532b-4e8c-afe8-98bda572b7ca tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:19.814438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68cbcb90-532b-4e8c-afe8-98bda572b7ca tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:19.814895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-68cbcb90-532b-4e8c-afe8-98bda572b7ca tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:19.951565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-68cbcb90-532b-4e8c-afe8-98bda572b7ca tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:19.959865 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-68cbcb90-532b-4e8c-afe8-98bda572b7ca tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.158809 Feb 19 21:41:19.960394 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3145/6206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:19 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:20.976367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5f8faa58-b428-4ba2-a422-07d2746a1a2b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:20.976923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5f8faa58-b428-4ba2-a422-07d2746a1a2b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:20.983825 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f8faa58-b428-4ba2-a422-07d2746a1a2b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:20.984282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f8faa58-b428-4ba2-a422-07d2746a1a2b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:20.985101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f8faa58-b428-4ba2-a422-07d2746a1a2b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:20.985547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5f8faa58-b428-4ba2-a422-07d2746a1a2b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:21.122439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5f8faa58-b428-4ba2-a422-07d2746a1a2b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:21.130794 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5f8faa58-b428-4ba2-a422-07d2746a1a2b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.158215 Feb 19 21:41:21.131390 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3062/6207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:20 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:22.148892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-de235b26-b587-4b6e-bfd7-c63353092638 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:22.149535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-de235b26-b587-4b6e-bfd7-c63353092638 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:22.156656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de235b26-b587-4b6e-bfd7-c63353092638 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:22.157140 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de235b26-b587-4b6e-bfd7-c63353092638 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:22.157980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de235b26-b587-4b6e-bfd7-c63353092638 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:22.158439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-de235b26-b587-4b6e-bfd7-c63353092638 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:22.399014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-de235b26-b587-4b6e-bfd7-c63353092638 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:22.407543 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-de235b26-b587-4b6e-bfd7-c63353092638 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.262562 Feb 19 21:41:22.408365 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3146/6208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:22 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:22.653883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ffea18fd-5b98-4694-83d3-5a94ae0e9e6f req-f121e69f-6d5b-4a20-bc66-8048516ae860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba32efe8-cf68-4c51-a3c0-7721e93c1c14", "tag": "0f23e791-9bb0-42a6-9da6-4afbefebbf70"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:41:22.656120 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:41:22.656120 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:41:22.665173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ffea18fd-5b98-4694-83d3-5a94ae0e9e6f req-f121e69f-6d5b-4a20-bc66-8048516ae860 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:22.665615 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ffea18fd-5b98-4694-83d3-5a94ae0e9e6f req-f121e69f-6d5b-4a20-bc66-8048516ae860 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:22.682365 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ffea18fd-5b98-4694-83d3-5a94ae0e9e6f req-f121e69f-6d5b-4a20-bc66-8048516ae860 service nova] Creating event network-changed:0f23e791-9bb0-42a6-9da6-4afbefebbf70 for instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 on nch2-master-1 Feb 19 21:41:22.688107 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ffea18fd-5b98-4694-83d3-5a94ae0e9e6f req-f121e69f-6d5b-4a20-bc66-8048516ae860 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037931 Feb 19 21:41:22.689332 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3063/6209] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:41:23.427876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6e9d0d34-87f1-42e2-82b3-e6aa307c0e1b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:23.428589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6e9d0d34-87f1-42e2-82b3-e6aa307c0e1b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:23.435313 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e9d0d34-87f1-42e2-82b3-e6aa307c0e1b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:23.435770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e9d0d34-87f1-42e2-82b3-e6aa307c0e1b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:23.436588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e9d0d34-87f1-42e2-82b3-e6aa307c0e1b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:23.437037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6e9d0d34-87f1-42e2-82b3-e6aa307c0e1b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:23.653859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6e9d0d34-87f1-42e2-82b3-e6aa307c0e1b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:23.661804 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6e9d0d34-87f1-42e2-82b3-e6aa307c0e1b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.237671 Feb 19 21:41:23.662380 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3147/6210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:23 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:24.679169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2bd094c3-c5bb-4501-baeb-714f49f57d4e tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:24.679873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2bd094c3-c5bb-4501-baeb-714f49f57d4e tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:24.686477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2bd094c3-c5bb-4501-baeb-714f49f57d4e tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:24.686927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2bd094c3-c5bb-4501-baeb-714f49f57d4e tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:24.687742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2bd094c3-c5bb-4501-baeb-714f49f57d4e tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:24.688163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2bd094c3-c5bb-4501-baeb-714f49f57d4e tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:24.825730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2bd094c3-c5bb-4501-baeb-714f49f57d4e tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:24.833732 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2bd094c3-c5bb-4501-baeb-714f49f57d4e tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.159556 Feb 19 21:41:24.834310 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3064/6211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:24 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:25.849824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec7afec3-6fcb-4d5f-a144-e3a4e7228a73 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:25.850449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ec7afec3-6fcb-4d5f-a144-e3a4e7228a73 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:25.857318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec7afec3-6fcb-4d5f-a144-e3a4e7228a73 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:25.857789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec7afec3-6fcb-4d5f-a144-e3a4e7228a73 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:25.858588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec7afec3-6fcb-4d5f-a144-e3a4e7228a73 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:25.859043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec7afec3-6fcb-4d5f-a144-e3a4e7228a73 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:25.993841 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec7afec3-6fcb-4d5f-a144-e3a4e7228a73 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:26.001187 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec7afec3-6fcb-4d5f-a144-e3a4e7228a73 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.155144 Feb 19 21:41:26.001761 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3148/6212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:25 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:27.018322 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-309c36c7-3a2f-4925-95f2-86d8f0654226 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:27.018946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-309c36c7-3a2f-4925-95f2-86d8f0654226 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:27.025792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-309c36c7-3a2f-4925-95f2-86d8f0654226 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:27.026251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-309c36c7-3a2f-4925-95f2-86d8f0654226 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:27.027049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-309c36c7-3a2f-4925-95f2-86d8f0654226 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:27.027494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-309c36c7-3a2f-4925-95f2-86d8f0654226 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:27.159517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-309c36c7-3a2f-4925-95f2-86d8f0654226 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:27.166786 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-309c36c7-3a2f-4925-95f2-86d8f0654226 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.152160 Feb 19 21:41:27.167365 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3065/6213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:27 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:28.183039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-34790fc9-433c-4791-8791-f0cf33bc64ba tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:28.183680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-34790fc9-433c-4791-8791-f0cf33bc64ba tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:28.190559 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34790fc9-433c-4791-8791-f0cf33bc64ba tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:28.191015 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34790fc9-433c-4791-8791-f0cf33bc64ba tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:28.191799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34790fc9-433c-4791-8791-f0cf33bc64ba tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:28.192244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-34790fc9-433c-4791-8791-f0cf33bc64ba tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:28.337216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-34790fc9-433c-4791-8791-f0cf33bc64ba tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:28.345010 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-34790fc9-433c-4791-8791-f0cf33bc64ba tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.165803 Feb 19 21:41:28.345581 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3149/6214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:28 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:28.798463 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-58e1e328-ae01-441f-a0d3-5eb21414a087 req-73dd038a-0596-4dc3-a5ab-9d69a409ef58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba32efe8-cf68-4c51-a3c0-7721e93c1c14", "name": "network-vif-plugged", "status": "completed", "tag": "0f23e791-9bb0-42a6-9da6-4afbefebbf70"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:41:28.800070 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:41:28.800070 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:41:28.808408 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-58e1e328-ae01-441f-a0d3-5eb21414a087 req-73dd038a-0596-4dc3-a5ab-9d69a409ef58 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:28.808867 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-58e1e328-ae01-441f-a0d3-5eb21414a087 req-73dd038a-0596-4dc3-a5ab-9d69a409ef58 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:28.820911 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-58e1e328-ae01-441f-a0d3-5eb21414a087 req-73dd038a-0596-4dc3-a5ab-9d69a409ef58 service nova] Creating event network-vif-plugged:0f23e791-9bb0-42a6-9da6-4afbefebbf70 for instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 on nch2-master-1 Feb 19 21:41:28.825820 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-58e1e328-ae01-441f-a0d3-5eb21414a087 req-73dd038a-0596-4dc3-a5ab-9d69a409ef58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031581 Feb 19 21:41:28.826524 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3066/6215] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:41:29.362437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f2fc7fe-a702-4e51-bd37-aa830d80a6bf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:29.363068 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f2fc7fe-a702-4e51-bd37-aa830d80a6bf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:29.369866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f2fc7fe-a702-4e51-bd37-aa830d80a6bf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:29.370352 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f2fc7fe-a702-4e51-bd37-aa830d80a6bf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:29.371147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f2fc7fe-a702-4e51-bd37-aa830d80a6bf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:29.371603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f2fc7fe-a702-4e51-bd37-aa830d80a6bf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:29.506157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f2fc7fe-a702-4e51-bd37-aa830d80a6bf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:29.513496 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f2fc7fe-a702-4e51-bd37-aa830d80a6bf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1359 microversion: 2.1 time: 0.154831 Feb 19 21:41:29.514061 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3150/6216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:29 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:30.531320 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb89f03e-7ec1-4ceb-b813-61467ff447e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:30.532024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb89f03e-7ec1-4ceb-b813-61467ff447e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:30.538269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb89f03e-7ec1-4ceb-b813-61467ff447e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:30.538728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb89f03e-7ec1-4ceb-b813-61467ff447e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:30.539511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb89f03e-7ec1-4ceb-b813-61467ff447e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:30.539954 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb89f03e-7ec1-4ceb-b813-61467ff447e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:30.673933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cb89f03e-7ec1-4ceb-b813-61467ff447e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:30.681398 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb89f03e-7ec1-4ceb-b813-61467ff447e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1548 microversion: 2.1 time: 0.154938 Feb 19 21:41:30.681974 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3067/6217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:30 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:30.697985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e716ecfe-49e7-4e92-aed3-9a7c762b4898 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:30.698612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e716ecfe-49e7-4e92-aed3-9a7c762b4898 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:30.705827 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e716ecfe-49e7-4e92-aed3-9a7c762b4898 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:30.706295 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e716ecfe-49e7-4e92-aed3-9a7c762b4898 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:30.707093 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e716ecfe-49e7-4e92-aed3-9a7c762b4898 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:30.707544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e716ecfe-49e7-4e92-aed3-9a7c762b4898 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:30.842993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e716ecfe-49e7-4e92-aed3-9a7c762b4898 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:30.851182 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e716ecfe-49e7-4e92-aed3-9a7c762b4898 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1548 microversion: 2.1 time: 0.157087 Feb 19 21:41:30.851764 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3151/6218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:30 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:30.866996 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-298e6ec0-bc41-4598-a385-443b70d11e61 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:30.870263 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:41:30.870263 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:41:30.871293 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-298e6ec0-bc41-4598-a385-443b70d11e61 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:30.872045 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-298e6ec0-bc41-4598-a385-443b70d11e61 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Searching by: {'deleted': False, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae'} {{(pid=136095) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 19 21:41:30.877393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-298e6ec0-bc41-4598-a385-443b70d11e61 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:30.877838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-298e6ec0-bc41-4598-a385-443b70d11e61 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:30.878642 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-298e6ec0-bc41-4598-a385-443b70d11e61 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:30.879079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-298e6ec0-bc41-4598-a385-443b70d11e61 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:30.901441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.multi_cell_list [None req-298e6ec0-bc41-4598-a385-443b70d11e61 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136095) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 19 21:41:30.927747 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-298e6ec0-bc41-4598-a385-443b70d11e61 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.064357 Feb 19 21:41:30.928337 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3068/6219] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Feb 19 21:41:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:41:30.938230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f0ba7824-3e08-4af5-8481-5849878546ae tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:30.938895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f0ba7824-3e08-4af5-8481-5849878546ae tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:30.944653 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ba7824-3e08-4af5-8481-5849878546ae tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:30.945362 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ba7824-3e08-4af5-8481-5849878546ae tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:30.946135 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ba7824-3e08-4af5-8481-5849878546ae tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:30.946584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f0ba7824-3e08-4af5-8481-5849878546ae tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:31.077772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f0ba7824-3e08-4af5-8481-5849878546ae tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:31.085051 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f0ba7824-3e08-4af5-8481-5849878546ae tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1548 microversion: 2.1 time: 0.150607 Feb 19 21:41:31.085621 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3152/6220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:30 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:32.568871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0917b9de-7f28-499b-8836-aa0ebe87910d"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:41:32.570181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:32.577390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:32.577841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:32.578625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:32.579062 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:32.810153 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1a97b876-4aa4-4ed0-8342-cb741f0aac7d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "POST /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244818 Feb 19 21:41:32.810818 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3069/6221] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Feb 19 21:41:32 2022] POST /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:41:36.115467 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e568e2ed-f043-4e43-b20e-9cd4b9531dbb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:36.116086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e568e2ed-f043-4e43-b20e-9cd4b9531dbb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:36.123260 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e568e2ed-f043-4e43-b20e-9cd4b9531dbb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:36.123716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e568e2ed-f043-4e43-b20e-9cd4b9531dbb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:36.124526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e568e2ed-f043-4e43-b20e-9cd4b9531dbb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:36.124973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e568e2ed-f043-4e43-b20e-9cd4b9531dbb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:36.258550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e568e2ed-f043-4e43-b20e-9cd4b9531dbb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:36.266859 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e568e2ed-f043-4e43-b20e-9cd4b9531dbb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1594 microversion: 2.1 time: 0.155100 Feb 19 21:41:36.267426 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3153/6222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:36 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:38.359065 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-64ab913a-d064-4841-b1ea-f76063ab0c87 req-e24f26ab-ffd4-49e6-bc03-dc08302be647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba32efe8-cf68-4c51-a3c0-7721e93c1c14", "tag": "0f23e791-9bb0-42a6-9da6-4afbefebbf70"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:41:38.360742 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:41:38.360742 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:41:38.368943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-64ab913a-d064-4841-b1ea-f76063ab0c87 req-e24f26ab-ffd4-49e6-bc03-dc08302be647 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:38.369694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-64ab913a-d064-4841-b1ea-f76063ab0c87 req-e24f26ab-ffd4-49e6-bc03-dc08302be647 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:38.386158 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-64ab913a-d064-4841-b1ea-f76063ab0c87 req-e24f26ab-ffd4-49e6-bc03-dc08302be647 service nova] Creating event network-changed:0f23e791-9bb0-42a6-9da6-4afbefebbf70 for instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 on nch2-master-1 Feb 19 21:41:38.392248 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-64ab913a-d064-4841-b1ea-f76063ab0c87 req-e24f26ab-ffd4-49e6-bc03-dc08302be647 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137443 Feb 19 21:41:38.393418 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3070/6223] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:41:39.259650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7509c39-49c5-4157-b833-fb980cbf1afb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1910419511"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:41:39.260209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f7509c39-49c5-4157-b833-fb980cbf1afb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:39.268121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7509c39-49c5-4157-b833-fb980cbf1afb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:39.268904 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7509c39-49c5-4157-b833-fb980cbf1afb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:39.269885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7509c39-49c5-4157-b833-fb980cbf1afb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:39.270525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7509c39-49c5-4157-b833-fb980cbf1afb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:39.404159 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.network.security_group_api [None req-f7509c39-49c5-4157-b833-fb980cbf1afb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Adding security group 8b5686bf-ea59-4c77-85b0-b55ea36b9879 to port 0f23e791-9bb0-42a6-9da6-4afbefebbf70 Feb 19 21:41:39.753496 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7509c39-49c5-4157-b833-fb980cbf1afb tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "POST /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/action" status: 202 len: 0 microversion: 2.1 time: 0.498591 Feb 19 21:41:39.754123 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3154/6224] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:41:39 2022] POST /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:41:39.765662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43210aa7-b1ee-40df-a105-c997e817b121 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:41:39.767170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-43210aa7-b1ee-40df-a105-c997e817b121 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:41:39.775135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43210aa7-b1ee-40df-a105-c997e817b121 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:39.775800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43210aa7-b1ee-40df-a105-c997e817b121 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:39.777445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43210aa7-b1ee-40df-a105-c997e817b121 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:39.778188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43210aa7-b1ee-40df-a105-c997e817b121 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:39.944664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-43210aa7-b1ee-40df-a105-c997e817b121 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:41:39.953883 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-43210aa7-b1ee-40df-a105-c997e817b121 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1760 microversion: 2.1 time: 0.194718 Feb 19 21:41:39.954582 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3071/6225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:41:39 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1760 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:41:40.410350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3a551bb2-be71-4171-84ad-66c1a788fee5 req-66aa6d6f-0e1d-41d6-bdcd-fd78d1028cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba32efe8-cf68-4c51-a3c0-7721e93c1c14", "tag": "0f23e791-9bb0-42a6-9da6-4afbefebbf70"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:41:40.413099 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:41:40.413099 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:41:40.420046 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3a551bb2-be71-4171-84ad-66c1a788fee5 req-66aa6d6f-0e1d-41d6-bdcd-fd78d1028cfc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:41:40.420541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3a551bb2-be71-4171-84ad-66c1a788fee5 req-66aa6d6f-0e1d-41d6-bdcd-fd78d1028cfc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:41:40.431585 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3a551bb2-be71-4171-84ad-66c1a788fee5 req-66aa6d6f-0e1d-41d6-bdcd-fd78d1028cfc service nova] Creating event network-changed:0f23e791-9bb0-42a6-9da6-4afbefebbf70 for instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 on nch2-master-1 Feb 19 21:41:40.437324 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3a551bb2-be71-4171-84ad-66c1a788fee5 req-66aa6d6f-0e1d-41d6-bdcd-fd78d1028cfc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031458 Feb 19 21:41:40.437925 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3155/6226] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:42:40.487170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c00a9c5-ba72-44c8-96f4-ab880bfb4880 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:42:40.488132 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3c00a9c5-ba72-44c8-96f4-ab880bfb4880 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:40.494140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c00a9c5-ba72-44c8-96f4-ab880bfb4880 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:40.494593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c00a9c5-ba72-44c8-96f4-ab880bfb4880 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:40.495378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c00a9c5-ba72-44c8-96f4-ab880bfb4880 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:40.495813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c00a9c5-ba72-44c8-96f4-ab880bfb4880 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:40.563495 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c00a9c5-ba72-44c8-96f4-ab880bfb4880 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "POST /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/action" status: 202 len: 0 microversion: 2.1 time: 0.081594 Feb 19 21:42:40.567081 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3072/6227] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:42:40 2022] POST /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:42:40.575541 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-002b52da-6035-4e58-b908-110dd0efd87d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:40.576292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-002b52da-6035-4e58-b908-110dd0efd87d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:40.583105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-002b52da-6035-4e58-b908-110dd0efd87d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:40.583680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-002b52da-6035-4e58-b908-110dd0efd87d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:40.585174 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-002b52da-6035-4e58-b908-110dd0efd87d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:40.585649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-002b52da-6035-4e58-b908-110dd0efd87d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:40.840961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-002b52da-6035-4e58-b908-110dd0efd87d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:40.849415 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-002b52da-6035-4e58-b908-110dd0efd87d tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1752 microversion: 2.1 time: 0.280821 Feb 19 21:42:40.853344 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3156/6228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:40 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1752 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:41.868204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-42f5a9d7-2d19-4593-ba91-155070d91d13 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:41.868939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-42f5a9d7-2d19-4593-ba91-155070d91d13 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:41.875094 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42f5a9d7-2d19-4593-ba91-155070d91d13 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:41.875553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42f5a9d7-2d19-4593-ba91-155070d91d13 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:41.876348 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42f5a9d7-2d19-4593-ba91-155070d91d13 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:41.876802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-42f5a9d7-2d19-4593-ba91-155070d91d13 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:42.029541 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-42f5a9d7-2d19-4593-ba91-155070d91d13 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:42.038053 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-42f5a9d7-2d19-4593-ba91-155070d91d13 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1757 microversion: 2.1 time: 0.174955 Feb 19 21:42:42.038630 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3073/6229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:41 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:43.057090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8788c724-bd32-45b8-9ea7-36eada87879b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:43.057715 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8788c724-bd32-45b8-9ea7-36eada87879b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:43.065337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8788c724-bd32-45b8-9ea7-36eada87879b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:43.065800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8788c724-bd32-45b8-9ea7-36eada87879b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:43.066593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8788c724-bd32-45b8-9ea7-36eada87879b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:43.067047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8788c724-bd32-45b8-9ea7-36eada87879b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:43.220870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8788c724-bd32-45b8-9ea7-36eada87879b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:43.228764 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8788c724-bd32-45b8-9ea7-36eada87879b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1757 microversion: 2.1 time: 0.175430 Feb 19 21:42:43.229334 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3157/6230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:43 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:44.245763 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8c656e0c-88af-470e-baf2-e636deffbd88 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:44.246367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8c656e0c-88af-470e-baf2-e636deffbd88 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:44.253669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c656e0c-88af-470e-baf2-e636deffbd88 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:44.254124 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c656e0c-88af-470e-baf2-e636deffbd88 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:44.254912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c656e0c-88af-470e-baf2-e636deffbd88 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:44.255343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8c656e0c-88af-470e-baf2-e636deffbd88 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:44.405265 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8c656e0c-88af-470e-baf2-e636deffbd88 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:44.413083 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8c656e0c-88af-470e-baf2-e636deffbd88 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1757 microversion: 2.1 time: 0.171097 Feb 19 21:42:44.413652 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3074/6231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:44 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:45.430716 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98ac619f-6f6c-4053-b36a-96fbe7caeb14 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:45.431345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98ac619f-6f6c-4053-b36a-96fbe7caeb14 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:45.438143 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98ac619f-6f6c-4053-b36a-96fbe7caeb14 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:45.438607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98ac619f-6f6c-4053-b36a-96fbe7caeb14 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:45.439397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98ac619f-6f6c-4053-b36a-96fbe7caeb14 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:45.439849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98ac619f-6f6c-4053-b36a-96fbe7caeb14 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:45.588168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-98ac619f-6f6c-4053-b36a-96fbe7caeb14 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:45.596124 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-98ac619f-6f6c-4053-b36a-96fbe7caeb14 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1757 microversion: 2.1 time: 0.169187 Feb 19 21:42:45.596730 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3158/6232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:45 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:46.614154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-04b5f35a-58d6-4ef0-8415-1c20647eabaf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:46.614767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-04b5f35a-58d6-4ef0-8415-1c20647eabaf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:46.622104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04b5f35a-58d6-4ef0-8415-1c20647eabaf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:46.622594 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04b5f35a-58d6-4ef0-8415-1c20647eabaf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:46.623378 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04b5f35a-58d6-4ef0-8415-1c20647eabaf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:46.623822 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-04b5f35a-58d6-4ef0-8415-1c20647eabaf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:46.773886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-04b5f35a-58d6-4ef0-8415-1c20647eabaf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:46.781688 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-04b5f35a-58d6-4ef0-8415-1c20647eabaf tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1757 microversion: 2.1 time: 0.171587 Feb 19 21:42:46.782259 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3075/6233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:46 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:47.799213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-17a90a90-9a84-4ce1-84c0-d0ea304ca999 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:47.799868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17a90a90-9a84-4ce1-84c0-d0ea304ca999 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:47.806684 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17a90a90-9a84-4ce1-84c0-d0ea304ca999 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:47.807152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17a90a90-9a84-4ce1-84c0-d0ea304ca999 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:47.807951 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17a90a90-9a84-4ce1-84c0-d0ea304ca999 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:47.808430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17a90a90-9a84-4ce1-84c0-d0ea304ca999 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:47.955023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17a90a90-9a84-4ce1-84c0-d0ea304ca999 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:47.963662 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-17a90a90-9a84-4ce1-84c0-d0ea304ca999 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1757 microversion: 2.1 time: 0.168337 Feb 19 21:42:47.964228 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3159/6234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:47 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:48.980651 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5465bdec-01bb-4680-b517-a11224d57d25 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:48.981338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5465bdec-01bb-4680-b517-a11224d57d25 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:48.987905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5465bdec-01bb-4680-b517-a11224d57d25 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:48.988381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5465bdec-01bb-4680-b517-a11224d57d25 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:48.989158 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5465bdec-01bb-4680-b517-a11224d57d25 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:48.989590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5465bdec-01bb-4680-b517-a11224d57d25 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:49.224640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5465bdec-01bb-4680-b517-a11224d57d25 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:49.232616 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5465bdec-01bb-4680-b517-a11224d57d25 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1757 microversion: 2.1 time: 0.255611 Feb 19 21:42:49.233186 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3076/6235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:48 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1757 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:50.248818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1279314b-2744-4d56-b289-f47d64f1b494 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:50.249449 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1279314b-2744-4d56-b289-f47d64f1b494 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:50.256225 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1279314b-2744-4d56-b289-f47d64f1b494 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:50.256730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1279314b-2744-4d56-b289-f47d64f1b494 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:50.257524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1279314b-2744-4d56-b289-f47d64f1b494 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:50.257978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1279314b-2744-4d56-b289-f47d64f1b494 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:50.432256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1279314b-2744-4d56-b289-f47d64f1b494 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:50.440264 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1279314b-2744-4d56-b289-f47d64f1b494 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1757 microversion: 2.1 time: 0.195193 Feb 19 21:42:50.440876 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3160/6236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:50 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:51.457529 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-877038a0-34ac-4933-bba1-1a3aedaf54ec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:51.458150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-877038a0-34ac-4933-bba1-1a3aedaf54ec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:51.464889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-877038a0-34ac-4933-bba1-1a3aedaf54ec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:51.465338 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-877038a0-34ac-4933-bba1-1a3aedaf54ec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:51.466108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-877038a0-34ac-4933-bba1-1a3aedaf54ec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:51.466546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-877038a0-34ac-4933-bba1-1a3aedaf54ec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:51.611964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-877038a0-34ac-4933-bba1-1a3aedaf54ec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:51.619761 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-877038a0-34ac-4933-bba1-1a3aedaf54ec tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1757 microversion: 2.1 time: 0.165943 Feb 19 21:42:51.620344 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3077/6237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:51 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:42:52.637977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c01e8191-1544-45b1-86b6-31336b2d694c tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:42:52.638822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c01e8191-1544-45b1-86b6-31336b2d694c tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:42:52.645161 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c01e8191-1544-45b1-86b6-31336b2d694c tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:52.645623 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c01e8191-1544-45b1-86b6-31336b2d694c tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:52.646413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c01e8191-1544-45b1-86b6-31336b2d694c tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:42:52.646859 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c01e8191-1544-45b1-86b6-31336b2d694c tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:42:52.796224 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c01e8191-1544-45b1-86b6-31336b2d694c tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:42:52.804542 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c01e8191-1544-45b1-86b6-31336b2d694c tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1760 microversion: 2.1 time: 0.171539 Feb 19 21:42:52.805118 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3161/6238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:42:52 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:43:56.108144 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5dc9f8e6-181f-4ad3-8fc5-41227467b8e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1910419511"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:43:56.108806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5dc9f8e6-181f-4ad3-8fc5-41227467b8e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:43:56.114833 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5dc9f8e6-181f-4ad3-8fc5-41227467b8e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:56.115308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5dc9f8e6-181f-4ad3-8fc5-41227467b8e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:56.116074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5dc9f8e6-181f-4ad3-8fc5-41227467b8e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:56.117245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5dc9f8e6-181f-4ad3-8fc5-41227467b8e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:56.253053 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.network.security_group_api [None req-5dc9f8e6-181f-4ad3-8fc5-41227467b8e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Removing security group 8b5686bf-ea59-4c77-85b0-b55ea36b9879 from port 0f23e791-9bb0-42a6-9da6-4afbefebbf70 Feb 19 21:43:56.597760 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5dc9f8e6-181f-4ad3-8fc5-41227467b8e9 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "POST /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/action" status: 202 len: 0 microversion: 2.1 time: 0.494312 Feb 19 21:43:56.598596 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3078/6239] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:43:56 2022] POST /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:43:56.616707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-00df5b0b-42e5-45f2-9466-c7a6e7daf6e5 req-9caa8f37-1dfa-4fa5-9eb7-df21634e8de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba32efe8-cf68-4c51-a3c0-7721e93c1c14", "tag": "0f23e791-9bb0-42a6-9da6-4afbefebbf70"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:43:56.618514 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:43:56.618514 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:43:56.634305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-00df5b0b-42e5-45f2-9466-c7a6e7daf6e5 req-9caa8f37-1dfa-4fa5-9eb7-df21634e8de5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:56.635030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-00df5b0b-42e5-45f2-9466-c7a6e7daf6e5 req-9caa8f37-1dfa-4fa5-9eb7-df21634e8de5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:56.652198 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-00df5b0b-42e5-45f2-9466-c7a6e7daf6e5 req-9caa8f37-1dfa-4fa5-9eb7-df21634e8de5 service nova] Creating event network-changed:0f23e791-9bb0-42a6-9da6-4afbefebbf70 for instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 on nch2-master-1 Feb 19 21:43:56.657978 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-00df5b0b-42e5-45f2-9466-c7a6e7daf6e5 req-9caa8f37-1dfa-4fa5-9eb7-df21634e8de5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049611 Feb 19 21:43:56.658947 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3162/6240] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:43:58.367633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-72269831-200c-4339-a1c0-fb609a77ea10 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:43:58.368210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-72269831-200c-4339-a1c0-fb609a77ea10 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:43:58.374336 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72269831-200c-4339-a1c0-fb609a77ea10 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:58.375009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72269831-200c-4339-a1c0-fb609a77ea10 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:58.375798 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72269831-200c-4339-a1c0-fb609a77ea10 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:58.376248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-72269831-200c-4339-a1c0-fb609a77ea10 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:58.455874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-72269831-200c-4339-a1c0-fb609a77ea10 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lazy-loading 'services' on Instance uuid ba32efe8-cf68-4c51-a3c0-7721e93c1c14 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:43:58.524273 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-72269831-200c-4339-a1c0-fb609a77ea10 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments/0917b9de-7f28-499b-8836-aa0ebe87910d" status: 202 len: 0 microversion: 2.1 time: 0.161403 Feb 19 21:43:58.525020 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3079/6241] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:43:58 2022] DELETE /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments/0917b9de-7f28-499b-8836-aa0ebe87910d => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:43:58.533877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a9fb4371-d496-45e6-be57-999bee0f6f30 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:43:58.535054 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a9fb4371-d496-45e6-be57-999bee0f6f30 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:43:58.544244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9fb4371-d496-45e6-be57-999bee0f6f30 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:58.544897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9fb4371-d496-45e6-be57-999bee0f6f30 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:58.545722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9fb4371-d496-45e6-be57-999bee0f6f30 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:58.546181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a9fb4371-d496-45e6-be57-999bee0f6f30 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:58.584853 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a9fb4371-d496-45e6-be57-999bee0f6f30 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055029 Feb 19 21:43:58.585870 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3163/6242] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:43:58 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:43:58.676936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-6f1def41-9815-4643-b678-8e402b3a117b req-f165a267-71ba-4758-8851-8dc686ad2bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba32efe8-cf68-4c51-a3c0-7721e93c1c14", "tag": "0f23e791-9bb0-42a6-9da6-4afbefebbf70"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:43:58.678625 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:43:58.678625 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:43:58.686523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6f1def41-9815-4643-b678-8e402b3a117b req-f165a267-71ba-4758-8851-8dc686ad2bde service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:58.686922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-6f1def41-9815-4643-b678-8e402b3a117b req-f165a267-71ba-4758-8851-8dc686ad2bde service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:58.698934 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-6f1def41-9815-4643-b678-8e402b3a117b req-f165a267-71ba-4758-8851-8dc686ad2bde service nova] Creating event network-changed:0f23e791-9bb0-42a6-9da6-4afbefebbf70 for instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 on nch2-master-1 Feb 19 21:43:58.705051 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-6f1def41-9815-4643-b678-8e402b3a117b req-f165a267-71ba-4758-8851-8dc686ad2bde service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031755 Feb 19 21:43:58.705671 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3080/6243] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:43:59.596459 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-38ff0c64-034a-4e05-9937-5389d627d949 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:43:59.597378 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-38ff0c64-034a-4e05-9937-5389d627d949 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:43:59.604151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38ff0c64-034a-4e05-9937-5389d627d949 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:59.604644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38ff0c64-034a-4e05-9937-5389d627d949 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:59.605429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38ff0c64-034a-4e05-9937-5389d627d949 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:59.605875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38ff0c64-034a-4e05-9937-5389d627d949 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:59.633699 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-38ff0c64-034a-4e05-9937-5389d627d949 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041083 Feb 19 21:43:59.634247 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3164/6244] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Feb 19 21:43:59 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 21:43:59.644673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58e6719e-e8e1-4059-b6f3-d096c42e9359 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:43:59.645204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-58e6719e-e8e1-4059-b6f3-d096c42e9359 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:43:59.652904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58e6719e-e8e1-4059-b6f3-d096c42e9359 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:59.653477 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58e6719e-e8e1-4059-b6f3-d096c42e9359 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:59.654266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58e6719e-e8e1-4059-b6f3-d096c42e9359 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:43:59.654709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-58e6719e-e8e1-4059-b6f3-d096c42e9359 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:43:59.728889 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-58e6719e-e8e1-4059-b6f3-d096c42e9359 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] HTTP exception thrown: Instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 is not attached to volume 0917b9de-7f28-499b-8836-aa0ebe87910d Feb 19 21:43:59.729499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-58e6719e-e8e1-4059-b6f3-d096c42e9359 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Returning 404 to user: Instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 is not attached to volume 0917b9de-7f28-499b-8836-aa0ebe87910d {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:43:59.730355 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-58e6719e-e8e1-4059-b6f3-d096c42e9359 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments/0917b9de-7f28-499b-8836-aa0ebe87910d" status: 404 len: 154 microversion: 2.1 time: 0.090043 Feb 19 21:43:59.730921 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3081/6245] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Feb 19 21:43:59 2022] DELETE /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14/os-volume_attachments/0917b9de-7f28-499b-8836-aa0ebe87910d => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:44:00.857200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d04c6be9-6396-4e68-b540-577055e80090 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:00.857987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d04c6be9-6396-4e68-b540-577055e80090 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:00.864569 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d04c6be9-6396-4e68-b540-577055e80090 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:00.865031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d04c6be9-6396-4e68-b540-577055e80090 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:00.865851 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d04c6be9-6396-4e68-b540-577055e80090 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:00.866815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d04c6be9-6396-4e68-b540-577055e80090 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:00.891656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d04c6be9-6396-4e68-b540-577055e80090 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Going to try to terminate instance {{(pid=136094) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:44:00.962877 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d04c6be9-6396-4e68-b540-577055e80090 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 204 len: 0 microversion: 2.1 time: 0.109398 Feb 19 21:44:00.963495 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3165/6246] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:44:00 2022] DELETE /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:44:00.971959 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-27c9e246-dc90-496d-9289-2ba16bf7d11b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:00.972861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-27c9e246-dc90-496d-9289-2ba16bf7d11b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:00.980088 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27c9e246-dc90-496d-9289-2ba16bf7d11b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:00.980562 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27c9e246-dc90-496d-9289-2ba16bf7d11b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:00.981641 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27c9e246-dc90-496d-9289-2ba16bf7d11b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:00.982138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-27c9e246-dc90-496d-9289-2ba16bf7d11b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:01.122116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-27c9e246-dc90-496d-9289-2ba16bf7d11b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:01.129521 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-27c9e246-dc90-496d-9289-2ba16bf7d11b tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1554 microversion: 2.1 time: 0.161649 Feb 19 21:44:01.130091 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3082/6247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:00 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:02.147156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-dcf31ad0-3557-49d8-a8d6-c53234b29994 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:02.148487 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-dcf31ad0-3557-49d8-a8d6-c53234b29994 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:02.155086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcf31ad0-3557-49d8-a8d6-c53234b29994 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:02.155543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcf31ad0-3557-49d8-a8d6-c53234b29994 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:02.156321 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcf31ad0-3557-49d8-a8d6-c53234b29994 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:02.156788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-dcf31ad0-3557-49d8-a8d6-c53234b29994 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:02.300108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-dcf31ad0-3557-49d8-a8d6-c53234b29994 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:02.308027 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-dcf31ad0-3557-49d8-a8d6-c53234b29994 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1554 microversion: 2.1 time: 0.164964 Feb 19 21:44:02.308634 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3166/6248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:02 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:03.326219 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-29ac7bf0-a239-4f90-bbbb-a0622285a5fa tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:03.326845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-29ac7bf0-a239-4f90-bbbb-a0622285a5fa tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:03.332753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-cefec25d-bb52-4142-a0d8-76e824c0ac77 req-26711f0d-4517-43de-9755-d32e29bf0f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba32efe8-cf68-4c51-a3c0-7721e93c1c14", "name": "network-vif-deleted", "tag": "0f23e791-9bb0-42a6-9da6-4afbefebbf70"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:44:03.336878 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:44:03.336878 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:44:03.338759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29ac7bf0-a239-4f90-bbbb-a0622285a5fa tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:03.339222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29ac7bf0-a239-4f90-bbbb-a0622285a5fa tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:03.340120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29ac7bf0-a239-4f90-bbbb-a0622285a5fa tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:03.344688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-29ac7bf0-a239-4f90-bbbb-a0622285a5fa tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:03.347939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cefec25d-bb52-4142-a0d8-76e824c0ac77 req-26711f0d-4517-43de-9755-d32e29bf0f1b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:03.348435 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-cefec25d-bb52-4142-a0d8-76e824c0ac77 req-26711f0d-4517-43de-9755-d32e29bf0f1b service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:03.364402 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-cefec25d-bb52-4142-a0d8-76e824c0ac77 req-26711f0d-4517-43de-9755-d32e29bf0f1b service nova] Creating event network-vif-deleted:0f23e791-9bb0-42a6-9da6-4afbefebbf70 for instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 on nch2-master-1 Feb 19 21:44:03.372214 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-cefec25d-bb52-4142-a0d8-76e824c0ac77 req-26711f0d-4517-43de-9755-d32e29bf0f1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047483 Feb 19 21:44:03.372873 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3167/6249] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:44:03.421350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-29ac7bf0-a239-4f90-bbbb-a0622285a5fa tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9155525bc1486da02f94f41e30fc4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff3f023fc254bbea87959ce0e95a1ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:03.430770 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-29ac7bf0-a239-4f90-bbbb-a0622285a5fa tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 200 len: 1512 microversion: 2.1 time: 0.109165 Feb 19 21:44:03.431359 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3083/6250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:03 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 1512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:04.449386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f0f17bf-8014-43cd-9c55-0245d3683c37 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:04.450099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f0f17bf-8014-43cd-9c55-0245d3683c37 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] [instance: ba32efe8-cf68-4c51-a3c0-7721e93c1c14] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:04.456413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f0f17bf-8014-43cd-9c55-0245d3683c37 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:04.456880 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f0f17bf-8014-43cd-9c55-0245d3683c37 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:04.457669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f0f17bf-8014-43cd-9c55-0245d3683c37 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:04.458120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f0f17bf-8014-43cd-9c55-0245d3683c37 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:04.471798 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-1f0f17bf-8014-43cd-9c55-0245d3683c37 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] HTTP exception thrown: Instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 could not be found. Feb 19 21:44:04.472419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f0f17bf-8014-43cd-9c55-0245d3683c37 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Returning 404 to user: Instance ba32efe8-cf68-4c51-a3c0-7721e93c1c14 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:44:04.473258 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f0f17bf-8014-43cd-9c55-0245d3683c37 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14" status: 404 len: 111 microversion: 2.1 time: 0.029254 Feb 19 21:44:04.473792 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3168/6251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:04 2022] GET /compute/v2.1/servers/ba32efe8-cf68-4c51-a3c0-7721e93c1c14 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:44:04.482596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8eec0e6b-b35c-41c7-ac86-f9665b1a37c3 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] Calling method '.version_select at 0x7f6467e87ee0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:04.501181 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8eec0e6b-b35c-41c7-ac86-f9665b1a37c3 tempest-TestMinimumBasicScenario-58086540 tempest-TestMinimumBasicScenario-58086540-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1994244299" status: 202 len: 0 microversion: 2.1 time: 0.022237 Feb 19 21:44:04.501752 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3084/6252] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Feb 19 21:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1994244299 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:44:13.518043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-71f69712-45f2-4b64-a68c-19ca19292002 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: .version_select at 0x7f6467bb20d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-814642753"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:44:13.531826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-71f69712-45f2-4b64-a68c-19ca19292002 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:44:13.537617 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-71f69712-45f2-4b64-a68c-19ca19292002 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:44:13.887865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-71f69712-45f2-4b64-a68c-19ca19292002 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:44:13.892713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-71f69712-45f2-4b64-a68c-19ca19292002 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:44:13.906583 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-71f69712-45f2-4b64-a68c-19ca19292002 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.547944 Feb 19 21:44:13.907191 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3169/6253] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:44:13 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:19.950350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1581944085", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "fd6df326-75e6-4442-a18f-324be2b98076"}], "key_name": "tempest-TestNetworkAdvancedServerOps-814642753", "security_groups": [{"name": "tempest-secgroup-smoke-1003725255"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:44:20.107345 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] validate_networks() for [('fd6df326-75e6-4442-a18f-324be2b98076', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:44:20.543732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:44:20.544242 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:44:20.544848 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:44:20.545540 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:44:20.546028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:44:20.555070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:20.555649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:20.556644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:20.557349 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:20.574731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:44:20.580640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:44:20.593829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:44:20.596208 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:44:20.642216 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-208043b4-9ea7-4d1f-b093-eb98d0efa170 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.696910 Feb 19 21:44:20.642883 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3085/6254] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:44:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 21:44:20.658848 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7e3ce3f6-c0dc-4ea7-a764-7ccc199206ba tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:20.660572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7e3ce3f6-c0dc-4ea7-a764-7ccc199206ba tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:20.737536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7e3ce3f6-c0dc-4ea7-a764-7ccc199206ba tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:20.745403 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7e3ce3f6-c0dc-4ea7-a764-7ccc199206ba tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1266 microversion: 2.1 time: 0.093810 Feb 19 21:44:20.746013 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3170/6255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:20 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:21.765244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f88809f-d3e4-4b0d-b84e-4d0e8de7a4e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:21.766611 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f88809f-d3e4-4b0d-b84e-4d0e8de7a4e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:21.790580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f88809f-d3e4-4b0d-b84e-4d0e8de7a4e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:21.791682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f88809f-d3e4-4b0d-b84e-4d0e8de7a4e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:21.796143 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f88809f-d3e4-4b0d-b84e-4d0e8de7a4e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:21.797160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f88809f-d3e4-4b0d-b84e-4d0e8de7a4e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:21.873977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f88809f-d3e4-4b0d-b84e-4d0e8de7a4e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:21.882787 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f88809f-d3e4-4b0d-b84e-4d0e8de7a4e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1326 microversion: 2.1 time: 0.123107 Feb 19 21:44:21.883925 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3086/6256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:21 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:22.901016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2a1e7784-78cf-426f-b486-df6e7ff5e587 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:22.901645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2a1e7784-78cf-426f-b486-df6e7ff5e587 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:22.910158 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a1e7784-78cf-426f-b486-df6e7ff5e587 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:22.910853 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a1e7784-78cf-426f-b486-df6e7ff5e587 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:22.911861 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a1e7784-78cf-426f-b486-df6e7ff5e587 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:22.912529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a1e7784-78cf-426f-b486-df6e7ff5e587 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:23.070640 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2a1e7784-78cf-426f-b486-df6e7ff5e587 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:23.080359 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2a1e7784-78cf-426f-b486-df6e7ff5e587 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1392 microversion: 2.1 time: 0.182152 Feb 19 21:44:23.090549 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3171/6257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:22 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:23.658460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-40f5f866-be68-4bf8-81f5-c01106256fed req-2a80b69a-ff4a-4ade-b7b8-a83b9ddbc0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2", "tag": "03766eda-f351-4e03-ac57-96077a8d9555"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:44:23.660011 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:44:23.660011 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:44:23.668216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-40f5f866-be68-4bf8-81f5-c01106256fed req-2a80b69a-ff4a-4ade-b7b8-a83b9ddbc0ba service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:23.668785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-40f5f866-be68-4bf8-81f5-c01106256fed req-2a80b69a-ff4a-4ade-b7b8-a83b9ddbc0ba service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:23.680665 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-40f5f866-be68-4bf8-81f5-c01106256fed req-2a80b69a-ff4a-4ade-b7b8-a83b9ddbc0ba service nova] Creating event network-changed:03766eda-f351-4e03-ac57-96077a8d9555 for instance aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 on nch1-master-1 Feb 19 21:44:23.686355 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-40f5f866-be68-4bf8-81f5-c01106256fed req-2a80b69a-ff4a-4ade-b7b8-a83b9ddbc0ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110010 Feb 19 21:44:23.686967 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3087/6258] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:44:24.097837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-07045d37-41aa-450e-a26b-a75916965c99 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:24.098475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-07045d37-41aa-450e-a26b-a75916965c99 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:24.106657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07045d37-41aa-450e-a26b-a75916965c99 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:24.107403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07045d37-41aa-450e-a26b-a75916965c99 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:24.108417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07045d37-41aa-450e-a26b-a75916965c99 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:24.109099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-07045d37-41aa-450e-a26b-a75916965c99 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:24.249395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-07045d37-41aa-450e-a26b-a75916965c99 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:24.256746 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-07045d37-41aa-450e-a26b-a75916965c99 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1392 microversion: 2.1 time: 0.162910 Feb 19 21:44:24.257346 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3172/6259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:24 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:25.274770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-13070213-a817-433a-af87-44716999439d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:25.275469 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-13070213-a817-433a-af87-44716999439d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:25.282499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13070213-a817-433a-af87-44716999439d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:25.282950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13070213-a817-433a-af87-44716999439d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:25.283734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13070213-a817-433a-af87-44716999439d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:25.284176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-13070213-a817-433a-af87-44716999439d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:25.422442 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-13070213-a817-433a-af87-44716999439d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:25.430209 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-13070213-a817-433a-af87-44716999439d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1392 microversion: 2.1 time: 0.159475 Feb 19 21:44:25.430809 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3088/6260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:25 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:26.447315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6eed4acf-bc1d-4359-81a5-6e8a41f25729 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:26.447913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6eed4acf-bc1d-4359-81a5-6e8a41f25729 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:26.454840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eed4acf-bc1d-4359-81a5-6e8a41f25729 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:26.455300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eed4acf-bc1d-4359-81a5-6e8a41f25729 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:26.456086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eed4acf-bc1d-4359-81a5-6e8a41f25729 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:26.456565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6eed4acf-bc1d-4359-81a5-6e8a41f25729 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:26.595433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6eed4acf-bc1d-4359-81a5-6e8a41f25729 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:26.603032 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6eed4acf-bc1d-4359-81a5-6e8a41f25729 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1392 microversion: 2.1 time: 0.159819 Feb 19 21:44:26.603617 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3173/6261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:26 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:27.620252 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c37d8daa-78b2-4c14-870d-d8d9a92d2792 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:27.620840 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c37d8daa-78b2-4c14-870d-d8d9a92d2792 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:27.627655 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c37d8daa-78b2-4c14-870d-d8d9a92d2792 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:27.628097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c37d8daa-78b2-4c14-870d-d8d9a92d2792 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:27.628893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c37d8daa-78b2-4c14-870d-d8d9a92d2792 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:27.629330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c37d8daa-78b2-4c14-870d-d8d9a92d2792 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:27.765133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c37d8daa-78b2-4c14-870d-d8d9a92d2792 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:27.772287 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c37d8daa-78b2-4c14-870d-d8d9a92d2792 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1392 microversion: 2.1 time: 0.156374 Feb 19 21:44:27.772924 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3089/6262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:27 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:28.790047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-004e14b3-c87e-4d48-aa59-950e6e62a866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:28.790668 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-004e14b3-c87e-4d48-aa59-950e6e62a866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:28.797485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-004e14b3-c87e-4d48-aa59-950e6e62a866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:28.797953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-004e14b3-c87e-4d48-aa59-950e6e62a866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:28.798773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-004e14b3-c87e-4d48-aa59-950e6e62a866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:28.799229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-004e14b3-c87e-4d48-aa59-950e6e62a866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:28.937300 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-004e14b3-c87e-4d48-aa59-950e6e62a866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:28.944816 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-004e14b3-c87e-4d48-aa59-950e6e62a866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1392 microversion: 2.1 time: 0.158743 Feb 19 21:44:28.945566 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3174/6263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:28 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:29.515452 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4e5f8b88-7280-444e-8aaf-0d44703789ce req-17ff1d06-7ed6-474e-9b08-19ed7f155d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2", "name": "network-vif-plugged", "status": "completed", "tag": "03766eda-f351-4e03-ac57-96077a8d9555"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:44:29.516997 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:44:29.516997 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:44:29.525297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4e5f8b88-7280-444e-8aaf-0d44703789ce req-17ff1d06-7ed6-474e-9b08-19ed7f155d2c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:29.525737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4e5f8b88-7280-444e-8aaf-0d44703789ce req-17ff1d06-7ed6-474e-9b08-19ed7f155d2c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:29.537199 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4e5f8b88-7280-444e-8aaf-0d44703789ce req-17ff1d06-7ed6-474e-9b08-19ed7f155d2c service nova] Creating event network-vif-plugged:03766eda-f351-4e03-ac57-96077a8d9555 for instance aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 on nch1-master-1 Feb 19 21:44:29.542116 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4e5f8b88-7280-444e-8aaf-0d44703789ce req-17ff1d06-7ed6-474e-9b08-19ed7f155d2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030339 Feb 19 21:44:29.542710 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3090/6264] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:44:29.962488 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4faeed49-4c8b-46b7-97e6-2b0d2d3cedf9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:29.963012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4faeed49-4c8b-46b7-97e6-2b0d2d3cedf9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:29.969766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4faeed49-4c8b-46b7-97e6-2b0d2d3cedf9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:29.970235 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4faeed49-4c8b-46b7-97e6-2b0d2d3cedf9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:29.971053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4faeed49-4c8b-46b7-97e6-2b0d2d3cedf9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:29.971484 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4faeed49-4c8b-46b7-97e6-2b0d2d3cedf9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:30.106219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4faeed49-4c8b-46b7-97e6-2b0d2d3cedf9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:30.113626 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4faeed49-4c8b-46b7-97e6-2b0d2d3cedf9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1392 microversion: 2.1 time: 0.155789 Feb 19 21:44:30.114231 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3175/6265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:29 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:31.132040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6c04d916-1b4b-44a6-aac3-00a6f09df56a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:31.132768 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6c04d916-1b4b-44a6-aac3-00a6f09df56a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:31.138982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c04d916-1b4b-44a6-aac3-00a6f09df56a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:31.139434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c04d916-1b4b-44a6-aac3-00a6f09df56a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:31.140210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c04d916-1b4b-44a6-aac3-00a6f09df56a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:31.140747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6c04d916-1b4b-44a6-aac3-00a6f09df56a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:31.282773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6c04d916-1b4b-44a6-aac3-00a6f09df56a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:31.290788 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6c04d916-1b4b-44a6-aac3-00a6f09df56a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1563 microversion: 2.1 time: 0.163582 Feb 19 21:44:31.291398 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3091/6266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:31 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:31.307529 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-041efaea-41b8-4088-b8db-fb2b96e4c821 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:31.308146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-041efaea-41b8-4088-b8db-fb2b96e4c821 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:31.314749 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-041efaea-41b8-4088-b8db-fb2b96e4c821 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:31.315210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-041efaea-41b8-4088-b8db-fb2b96e4c821 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:31.315991 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-041efaea-41b8-4088-b8db-fb2b96e4c821 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:31.316474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-041efaea-41b8-4088-b8db-fb2b96e4c821 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:31.450659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-041efaea-41b8-4088-b8db-fb2b96e4c821 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:31.457986 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-041efaea-41b8-4088-b8db-fb2b96e4c821 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1563 microversion: 2.1 time: 0.154939 Feb 19 21:44:31.458561 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3176/6267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:31 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:44:33.081058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6f671d2e-37bc-4ef2-814a-5a68fab792c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:44:33.084136 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-d12adecd-4213-4a97-b793-c39481d89262 req-056fb120-187e-4bac-8988-4717caa72394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2", "tag": "03766eda-f351-4e03-ac57-96077a8d9555"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:44:33.085794 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:44:33.085794 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:44:33.086727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6f671d2e-37bc-4ef2-814a-5a68fab792c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:33.097177 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d12adecd-4213-4a97-b793-c39481d89262 req-056fb120-187e-4bac-8988-4717caa72394 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:33.098061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-d12adecd-4213-4a97-b793-c39481d89262 req-056fb120-187e-4bac-8988-4717caa72394 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:33.098290 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f671d2e-37bc-4ef2-814a-5a68fab792c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:33.098813 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f671d2e-37bc-4ef2-814a-5a68fab792c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:33.099688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f671d2e-37bc-4ef2-814a-5a68fab792c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:33.100215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6f671d2e-37bc-4ef2-814a-5a68fab792c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:33.111615 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-d12adecd-4213-4a97-b793-c39481d89262 req-056fb120-187e-4bac-8988-4717caa72394 service nova] Creating event network-changed:03766eda-f351-4e03-ac57-96077a8d9555 for instance aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 on nch1-master-1 Feb 19 21:44:33.117150 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-d12adecd-4213-4a97-b793-c39481d89262 req-056fb120-187e-4bac-8988-4717caa72394 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040175 Feb 19 21:44:33.118484 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3177/6268] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:44:33.253372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6f671d2e-37bc-4ef2-814a-5a68fab792c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:44:33.263084 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6f671d2e-37bc-4ef2-814a-5a68fab792c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1563 microversion: 2.1 time: 0.188145 Feb 19 21:44:33.263690 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3092/6269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:44:33 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:44:56.532505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c66c50f3-0f22-48f9-934f-c623cbc1b9c9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:44:56.533429 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c66c50f3-0f22-48f9-934f-c623cbc1b9c9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:44:56.540101 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c66c50f3-0f22-48f9-934f-c623cbc1b9c9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:56.540603 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c66c50f3-0f22-48f9-934f-c623cbc1b9c9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:56.541393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c66c50f3-0f22-48f9-934f-c623cbc1b9c9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:44:56.541837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c66c50f3-0f22-48f9-934f-c623cbc1b9c9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:44:56.595968 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c66c50f3-0f22-48f9-934f-c623cbc1b9c9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action" status: 200 len: 24570 microversion: 2.1 time: 0.068556 Feb 19 21:44:56.596679 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3178/6270] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:44:56 2022] POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action => generated 24570 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:45:03.033630 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-595c06ae-2854-4fcd-8820-b67f99cce4a7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:03.034210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-595c06ae-2854-4fcd-8820-b67f99cce4a7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:03.040364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-595c06ae-2854-4fcd-8820-b67f99cce4a7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:03.040818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-595c06ae-2854-4fcd-8820-b67f99cce4a7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:03.041596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-595c06ae-2854-4fcd-8820-b67f99cce4a7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:03.042039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-595c06ae-2854-4fcd-8820-b67f99cce4a7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:03.105547 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-595c06ae-2854-4fcd-8820-b67f99cce4a7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action" status: 202 len: 0 microversion: 2.1 time: 0.075579 Feb 19 21:45:03.106215 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3093/6271] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:45:03 2022] POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:45:03.115514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a945d11e-19ce-465f-bd9d-ad7e034a5645 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:03.116228 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a945d11e-19ce-465f-bd9d-ad7e034a5645 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:03.124611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a945d11e-19ce-465f-bd9d-ad7e034a5645 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:03.125095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a945d11e-19ce-465f-bd9d-ad7e034a5645 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:03.125870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a945d11e-19ce-465f-bd9d-ad7e034a5645 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:03.126350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a945d11e-19ce-465f-bd9d-ad7e034a5645 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:03.268063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a945d11e-19ce-465f-bd9d-ad7e034a5645 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:03.275735 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a945d11e-19ce-465f-bd9d-ad7e034a5645 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1687 microversion: 2.1 time: 0.164340 Feb 19 21:45:03.276311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3179/6272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:03 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:04.295066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-34d72319-52e1-4136-a3b7-0be55abec2a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:04.295760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-34d72319-52e1-4136-a3b7-0be55abec2a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:04.302229 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34d72319-52e1-4136-a3b7-0be55abec2a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:04.302678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34d72319-52e1-4136-a3b7-0be55abec2a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:04.303480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34d72319-52e1-4136-a3b7-0be55abec2a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:04.303917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-34d72319-52e1-4136-a3b7-0be55abec2a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:04.442700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-34d72319-52e1-4136-a3b7-0be55abec2a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:04.452701 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-34d72319-52e1-4136-a3b7-0be55abec2a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1667 microversion: 2.1 time: 0.162324 Feb 19 21:45:04.453755 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3094/6273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:04 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:05.542043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-75c23023-c685-4480-97ae-5af30584cda7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:05.542965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-75c23023-c685-4480-97ae-5af30584cda7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:05.550468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75c23023-c685-4480-97ae-5af30584cda7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:05.550933 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75c23023-c685-4480-97ae-5af30584cda7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:05.551712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75c23023-c685-4480-97ae-5af30584cda7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:05.552157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-75c23023-c685-4480-97ae-5af30584cda7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:05.599564 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-75c23023-c685-4480-97ae-5af30584cda7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action" status: 200 len: 32640 microversion: 2.1 time: 0.061101 Feb 19 21:45:05.600189 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3180/6274] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:45:05 2022] POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:45:05.610883 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-167ad344-b254-4722-9380-7784a5dd3c3d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:05.611415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-167ad344-b254-4722-9380-7784a5dd3c3d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:05.617974 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-167ad344-b254-4722-9380-7784a5dd3c3d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:05.618420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-167ad344-b254-4722-9380-7784a5dd3c3d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:05.619191 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-167ad344-b254-4722-9380-7784a5dd3c3d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:05.619623 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-167ad344-b254-4722-9380-7784a5dd3c3d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:05.683735 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-167ad344-b254-4722-9380-7784a5dd3c3d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action" status: 202 len: 0 microversion: 2.1 time: 0.076325 Feb 19 21:45:05.684400 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3095/6275] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:45:05 2022] POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:45:05.693037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-008c3d1f-3e20-4c8c-b6fe-6a11167e4802 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:05.693748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-008c3d1f-3e20-4c8c-b6fe-6a11167e4802 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:05.702113 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-008c3d1f-3e20-4c8c-b6fe-6a11167e4802 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:05.702532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-008c3d1f-3e20-4c8c-b6fe-6a11167e4802 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:05.703342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-008c3d1f-3e20-4c8c-b6fe-6a11167e4802 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:05.703842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-008c3d1f-3e20-4c8c-b6fe-6a11167e4802 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:05.845343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-008c3d1f-3e20-4c8c-b6fe-6a11167e4802 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:05.853287 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-008c3d1f-3e20-4c8c-b6fe-6a11167e4802 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1674 microversion: 2.1 time: 0.164234 Feb 19 21:45:05.854057 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3181/6276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:05 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:45:06.872424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-eec2e2a9-a5ce-4b2d-bdb9-5af868d1e856 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:06.873119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-eec2e2a9-a5ce-4b2d-bdb9-5af868d1e856 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:06.879310 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec2e2a9-a5ce-4b2d-bdb9-5af868d1e856 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:06.879769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec2e2a9-a5ce-4b2d-bdb9-5af868d1e856 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:06.880579 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec2e2a9-a5ce-4b2d-bdb9-5af868d1e856 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:06.881024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-eec2e2a9-a5ce-4b2d-bdb9-5af868d1e856 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:07.021102 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-eec2e2a9-a5ce-4b2d-bdb9-5af868d1e856 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:07.028924 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-eec2e2a9-a5ce-4b2d-bdb9-5af868d1e856 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1682 microversion: 2.1 time: 0.161393 Feb 19 21:45:07.029500 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3096/6277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:06 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:07.122943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1fba90e4-2d7f-4a39-a7a7-01264ab6ae7d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:07.123867 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1fba90e4-2d7f-4a39-a7a7-01264ab6ae7d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:07.130338 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fba90e4-2d7f-4a39-a7a7-01264ab6ae7d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:07.130794 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fba90e4-2d7f-4a39-a7a7-01264ab6ae7d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:07.131573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fba90e4-2d7f-4a39-a7a7-01264ab6ae7d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:07.132014 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1fba90e4-2d7f-4a39-a7a7-01264ab6ae7d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:07.182331 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1fba90e4-2d7f-4a39-a7a7-01264ab6ae7d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action" status: 200 len: 35763 microversion: 2.1 time: 0.062901 Feb 19 21:45:07.182973 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3182/6278] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:45:07 2022] POST /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2/action => generated 35763 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:45:08.577512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6e76b930-f650-443a-8a96-58012bed87c3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:08.583299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-35ade1a6-33a6-4c35-8129-387a170a3c32 req-ae1f7415-b99e-413d-a144-5001fc750739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2", "tag": "03766eda-f351-4e03-ac57-96077a8d9555"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:08.583826 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6e76b930-f650-443a-8a96-58012bed87c3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:08.589357 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:45:08.589357 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:45:08.596818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e76b930-f650-443a-8a96-58012bed87c3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:08.597277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e76b930-f650-443a-8a96-58012bed87c3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:08.598067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e76b930-f650-443a-8a96-58012bed87c3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:08.598506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e76b930-f650-443a-8a96-58012bed87c3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:08.607085 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-35ade1a6-33a6-4c35-8129-387a170a3c32 req-ae1f7415-b99e-413d-a144-5001fc750739 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:08.607539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-35ade1a6-33a6-4c35-8129-387a170a3c32 req-ae1f7415-b99e-413d-a144-5001fc750739 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:08.621710 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-35ade1a6-33a6-4c35-8129-387a170a3c32 req-ae1f7415-b99e-413d-a144-5001fc750739 service nova] Creating event network-changed:03766eda-f351-4e03-ac57-96077a8d9555 for instance aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 on nch1-master-1 Feb 19 21:45:08.626653 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-35ade1a6-33a6-4c35-8129-387a170a3c32 req-ae1f7415-b99e-413d-a144-5001fc750739 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047231 Feb 19 21:45:08.627430 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3183/6279] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:45:08.630941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6e76b930-f650-443a-8a96-58012bed87c3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:45:08.725779 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6e76b930-f650-443a-8a96-58012bed87c3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 204 len: 0 microversion: 2.1 time: 0.151676 Feb 19 21:45:08.729250 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3097/6280] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:45:08 2022] DELETE /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:45:08.739816 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-155fce54-8de9-4b4a-8607-7bd46f04de52 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:08.740965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-155fce54-8de9-4b4a-8607-7bd46f04de52 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:08.750031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-155fce54-8de9-4b4a-8607-7bd46f04de52 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:08.751244 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-155fce54-8de9-4b4a-8607-7bd46f04de52 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:08.752134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-155fce54-8de9-4b4a-8607-7bd46f04de52 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:08.752858 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-155fce54-8de9-4b4a-8607-7bd46f04de52 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:08.911019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-155fce54-8de9-4b4a-8607-7bd46f04de52 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:08.920963 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-155fce54-8de9-4b4a-8607-7bd46f04de52 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1688 microversion: 2.1 time: 0.186244 Feb 19 21:45:08.923264 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3184/6281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:08 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:09.939382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c9f6c74-2ec1-4a50-a978-7ec893ae7991 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:09.940001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3c9f6c74-2ec1-4a50-a978-7ec893ae7991 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:09.950308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c9f6c74-2ec1-4a50-a978-7ec893ae7991 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:09.950766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c9f6c74-2ec1-4a50-a978-7ec893ae7991 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:09.951568 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c9f6c74-2ec1-4a50-a978-7ec893ae7991 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:09.952017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c9f6c74-2ec1-4a50-a978-7ec893ae7991 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:10.090555 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c9f6c74-2ec1-4a50-a978-7ec893ae7991 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:10.097852 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c9f6c74-2ec1-4a50-a978-7ec893ae7991 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1569 microversion: 2.1 time: 0.162688 Feb 19 21:45:10.098432 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3098/6282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:09 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:10.830699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-1c74e476-41c7-40a1-ae16-19576646b186 req-774c4985-533a-4a04-910f-d4f086d3dbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2", "name": "network-vif-deleted", "tag": "03766eda-f351-4e03-ac57-96077a8d9555"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:10.832680 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:45:10.832680 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:45:10.842744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1c74e476-41c7-40a1-ae16-19576646b186 req-774c4985-533a-4a04-910f-d4f086d3dbc1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:10.843199 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-1c74e476-41c7-40a1-ae16-19576646b186 req-774c4985-533a-4a04-910f-d4f086d3dbc1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:10.858000 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-1c74e476-41c7-40a1-ae16-19576646b186 req-774c4985-533a-4a04-910f-d4f086d3dbc1 service nova] Creating event network-vif-deleted:03766eda-f351-4e03-ac57-96077a8d9555 for instance aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 on nch1-master-1 Feb 19 21:45:10.863528 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-1c74e476-41c7-40a1-ae16-19576646b186 req-774c4985-533a-4a04-910f-d4f086d3dbc1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036749 Feb 19 21:45:10.864322 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3185/6283] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:45:11.114879 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:11.115480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:11.122759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:11.123216 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:11.124017 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:11.124488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:11.158547 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:11.159009 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:11.159466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lazy-loading 'fault' on Instance uuid aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:45:11.208970 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:11.216796 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9622e4ea-0ba5-4708-9926-fa56b15f384e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 200 len: 1356 microversion: 2.1 time: 0.105527 Feb 19 21:45:11.217637 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3099/6284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:11 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:12.235392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7d67f959-4ff4-4adc-b09b-317a30f4db17 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:12.236099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7d67f959-4ff4-4adc-b09b-317a30f4db17 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:12.242273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d67f959-4ff4-4adc-b09b-317a30f4db17 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:12.242735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d67f959-4ff4-4adc-b09b-317a30f4db17 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:12.243517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d67f959-4ff4-4adc-b09b-317a30f4db17 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:12.243965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7d67f959-4ff4-4adc-b09b-317a30f4db17 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:12.257526 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-7d67f959-4ff4-4adc-b09b-317a30f4db17 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] HTTP exception thrown: Instance aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 could not be found. Feb 19 21:45:12.258120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7d67f959-4ff4-4adc-b09b-317a30f4db17 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Returning 404 to user: Instance aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:45:12.259050 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7d67f959-4ff4-4adc-b09b-317a30f4db17 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2" status: 404 len: 111 microversion: 2.1 time: 0.028665 Feb 19 21:45:12.259581 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3186/6285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:12 2022] GET /compute/v2.1/servers/aee0a50e-d0ae-4fe4-b7a9-ce1e754bb2b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:45:15.301243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-aa0ce000-a437-494b-8cda-244fae1560e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '.version_select at 0x7f6466a28670>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:15.323540 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-aa0ce000-a437-494b-8cda-244fae1560e6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-814642753" status: 202 len: 0 microversion: 2.1 time: 0.025858 Feb 19 21:45:15.324394 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3100/6286] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Feb 19 21:45:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-814642753 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:45:15.344891 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0494116d-4d01-495b-978c-c236e2b994cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: .version_select at 0x7f6474454d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-716236325"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:15.359233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0494116d-4d01-495b-978c-c236e2b994cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:45:15.364939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0494116d-4d01-495b-978c-c236e2b994cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:45:15.892288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0494116d-4d01-495b-978c-c236e2b994cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:45:15.897160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-0494116d-4d01-495b-978c-c236e2b994cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:45:15.910873 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0494116d-4d01-495b-978c-c236e2b994cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.569772 Feb 19 21:45:15.911480 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3187/6287] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:45:15 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:17.769856 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:45:17.770515 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 21:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:45:21.708557 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-384418935", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "ded74d88-36b9-4d91-bfa9-2f85143b9835"}], "key_name": "tempest-TestNetworkAdvancedServerOps-716236325", "security_groups": [{"name": "tempest-secgroup-smoke-414824375"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:21.820893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] validate_networks() for [('ded74d88-36b9-4d91-bfa9-2f85143b9835', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:45:22.324754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:45:22.325184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:45:22.325665 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:45:22.326075 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:45:22.326681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:45:22.336237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:22.336727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:22.337551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:22.337992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:22.357456 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:45:22.361925 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:45:22.381657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:45:22.383593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:45:22.450054 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-20f3c359-836e-4dbf-bc23-0fbbbd96af15 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747599 Feb 19 21:45:22.450824 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3101/6288] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:45:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:45:22.463628 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-762e8701-208a-4372-a1b8-f9b9cd299a8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:22.464320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-762e8701-208a-4372-a1b8-f9b9cd299a8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:22.575400 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-762e8701-208a-4372-a1b8-f9b9cd299a8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:22.582189 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-762e8701-208a-4372-a1b8-f9b9cd299a8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1265 microversion: 2.1 time: 0.123954 Feb 19 21:45:22.593166 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3188/6289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:22 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:23.614626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-edeaf868-1976-4347-a7f7-3cb7f82682e8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:23.615285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-edeaf868-1976-4347-a7f7-3cb7f82682e8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:23.631080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edeaf868-1976-4347-a7f7-3cb7f82682e8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:23.637069 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edeaf868-1976-4347-a7f7-3cb7f82682e8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:23.638245 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edeaf868-1976-4347-a7f7-3cb7f82682e8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:23.638864 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-edeaf868-1976-4347-a7f7-3cb7f82682e8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:23.752034 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-edeaf868-1976-4347-a7f7-3cb7f82682e8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:23.763835 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-edeaf868-1976-4347-a7f7-3cb7f82682e8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1325 microversion: 2.1 time: 0.158644 Feb 19 21:45:23.764445 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3102/6290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:23 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1325 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:24.781361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b41010e3-2be8-4878-be94-c7b4f6ab141b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:24.782727 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b41010e3-2be8-4878-be94-c7b4f6ab141b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:24.790542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b41010e3-2be8-4878-be94-c7b4f6ab141b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:24.791013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b41010e3-2be8-4878-be94-c7b4f6ab141b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:24.792210 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b41010e3-2be8-4878-be94-c7b4f6ab141b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:24.792764 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b41010e3-2be8-4878-be94-c7b4f6ab141b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:25.040233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b41010e3-2be8-4878-be94-c7b4f6ab141b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:25.050480 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b41010e3-2be8-4878-be94-c7b4f6ab141b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1390 microversion: 2.1 time: 0.272653 Feb 19 21:45:25.051232 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3189/6291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:24 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1390 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:25.279222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-0404dd54-aac6-4bb4-866d-0fac7dff2426 req-3f590659-382f-4529-a730-93c6cd5689f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e10bc9-026f-472f-b405-8a8dc3dd8e49", "tag": "01c99b91-c36a-417d-8b9a-33b64aa91c00"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:25.281724 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:45:25.281724 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:45:25.303421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0404dd54-aac6-4bb4-866d-0fac7dff2426 req-3f590659-382f-4529-a730-93c6cd5689f8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:25.304478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0404dd54-aac6-4bb4-866d-0fac7dff2426 req-3f590659-382f-4529-a730-93c6cd5689f8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:25.318117 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-0404dd54-aac6-4bb4-866d-0fac7dff2426 req-3f590659-382f-4529-a730-93c6cd5689f8 service nova] Creating event network-changed:01c99b91-c36a-417d-8b9a-33b64aa91c00 for instance 62e10bc9-026f-472f-b405-8a8dc3dd8e49 on nch2-master-1 Feb 19 21:45:25.323603 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-0404dd54-aac6-4bb4-866d-0fac7dff2426 req-3f590659-382f-4529-a730-93c6cd5689f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048160 Feb 19 21:45:25.324223 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3103/6292] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:45:26.068182 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-466a5b9e-b7dd-468a-af97-939e307b900a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:26.068770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-466a5b9e-b7dd-468a-af97-939e307b900a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:26.076105 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-466a5b9e-b7dd-468a-af97-939e307b900a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:26.076607 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-466a5b9e-b7dd-468a-af97-939e307b900a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:26.077418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-466a5b9e-b7dd-468a-af97-939e307b900a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:26.077900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-466a5b9e-b7dd-468a-af97-939e307b900a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:26.294539 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-466a5b9e-b7dd-468a-af97-939e307b900a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:26.301791 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-466a5b9e-b7dd-468a-af97-939e307b900a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1390 microversion: 2.1 time: 0.237445 Feb 19 21:45:26.302371 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3190/6293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:26 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1390 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:27.320670 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5761253f-0aae-4efb-b727-746857f3e175 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:27.321285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5761253f-0aae-4efb-b727-746857f3e175 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:27.327460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5761253f-0aae-4efb-b727-746857f3e175 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:27.327908 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5761253f-0aae-4efb-b727-746857f3e175 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:27.328712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5761253f-0aae-4efb-b727-746857f3e175 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:27.329148 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5761253f-0aae-4efb-b727-746857f3e175 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:27.469390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5761253f-0aae-4efb-b727-746857f3e175 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:27.477292 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5761253f-0aae-4efb-b727-746857f3e175 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1390 microversion: 2.1 time: 0.161983 Feb 19 21:45:27.477891 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3104/6294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:27 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:28.493931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a7be260b-9d94-44e5-9e8f-0d99fbac7f1d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:28.494516 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a7be260b-9d94-44e5-9e8f-0d99fbac7f1d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:28.501259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7be260b-9d94-44e5-9e8f-0d99fbac7f1d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:28.501723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7be260b-9d94-44e5-9e8f-0d99fbac7f1d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:28.502820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7be260b-9d94-44e5-9e8f-0d99fbac7f1d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:28.503272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a7be260b-9d94-44e5-9e8f-0d99fbac7f1d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:28.640863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a7be260b-9d94-44e5-9e8f-0d99fbac7f1d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:28.648123 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a7be260b-9d94-44e5-9e8f-0d99fbac7f1d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1390 microversion: 2.1 time: 0.158485 Feb 19 21:45:28.648723 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3191/6295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:28 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:29.665346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-75e08a94-88e0-434a-8173-d7ba7f307d4f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:29.666049 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-75e08a94-88e0-434a-8173-d7ba7f307d4f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:29.677960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e08a94-88e0-434a-8173-d7ba7f307d4f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:29.678424 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e08a94-88e0-434a-8173-d7ba7f307d4f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:29.679226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e08a94-88e0-434a-8173-d7ba7f307d4f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:29.680046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-75e08a94-88e0-434a-8173-d7ba7f307d4f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:29.820381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-75e08a94-88e0-434a-8173-d7ba7f307d4f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:29.827691 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-75e08a94-88e0-434a-8173-d7ba7f307d4f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1390 microversion: 2.1 time: 0.166728 Feb 19 21:45:29.828264 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3105/6296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:29 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:30.844959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-069897e2-a5ad-4949-8d39-805c1264322d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:30.845613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-069897e2-a5ad-4949-8d39-805c1264322d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:30.853169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-069897e2-a5ad-4949-8d39-805c1264322d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:30.853580 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-069897e2-a5ad-4949-8d39-805c1264322d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:30.854376 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-069897e2-a5ad-4949-8d39-805c1264322d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:30.854832 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-069897e2-a5ad-4949-8d39-805c1264322d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:30.991299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-069897e2-a5ad-4949-8d39-805c1264322d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:30.998674 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-069897e2-a5ad-4949-8d39-805c1264322d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1390 microversion: 2.1 time: 0.157502 Feb 19 21:45:30.999397 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3192/6297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:30 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:31.779255 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-b268a6f8-366a-4fdc-bb38-2fa9007f1c7a req-bf660165-a20b-423c-a30f-a17455dabc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e10bc9-026f-472f-b405-8a8dc3dd8e49", "name": "network-vif-plugged", "status": "completed", "tag": "01c99b91-c36a-417d-8b9a-33b64aa91c00"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:31.780915 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:45:31.780915 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:45:31.788187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b268a6f8-366a-4fdc-bb38-2fa9007f1c7a req-bf660165-a20b-423c-a30f-a17455dabc2d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:31.788672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-b268a6f8-366a-4fdc-bb38-2fa9007f1c7a req-bf660165-a20b-423c-a30f-a17455dabc2d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:31.799579 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-b268a6f8-366a-4fdc-bb38-2fa9007f1c7a req-bf660165-a20b-423c-a30f-a17455dabc2d service nova] Creating event network-vif-plugged:01c99b91-c36a-417d-8b9a-33b64aa91c00 for instance 62e10bc9-026f-472f-b405-8a8dc3dd8e49 on nch2-master-1 Feb 19 21:45:31.804674 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-b268a6f8-366a-4fdc-bb38-2fa9007f1c7a req-bf660165-a20b-423c-a30f-a17455dabc2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096304 Feb 19 21:45:31.805292 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3106/6298] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:45:32.016152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e95cd2e2-ebdb-4623-ad74-95b656bbdd6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:32.016795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e95cd2e2-ebdb-4623-ad74-95b656bbdd6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:32.024254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e95cd2e2-ebdb-4623-ad74-95b656bbdd6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:32.024766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e95cd2e2-ebdb-4623-ad74-95b656bbdd6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:32.025575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e95cd2e2-ebdb-4623-ad74-95b656bbdd6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:32.026028 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e95cd2e2-ebdb-4623-ad74-95b656bbdd6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:32.166694 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e95cd2e2-ebdb-4623-ad74-95b656bbdd6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:32.173955 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e95cd2e2-ebdb-4623-ad74-95b656bbdd6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1390 microversion: 2.1 time: 0.161750 Feb 19 21:45:32.174543 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3193/6299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:32 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:33.192319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3fc3e718-a399-4f2b-a1d8-e827429a77ad tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:33.193072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3fc3e718-a399-4f2b-a1d8-e827429a77ad tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:33.199632 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fc3e718-a399-4f2b-a1d8-e827429a77ad tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:33.200083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fc3e718-a399-4f2b-a1d8-e827429a77ad tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:33.200894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fc3e718-a399-4f2b-a1d8-e827429a77ad tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:33.201335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3fc3e718-a399-4f2b-a1d8-e827429a77ad tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:33.340878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3fc3e718-a399-4f2b-a1d8-e827429a77ad tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:33.348243 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3fc3e718-a399-4f2b-a1d8-e827429a77ad tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1390 microversion: 2.1 time: 0.160775 Feb 19 21:45:33.348975 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3107/6300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:33 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:34.365543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-716bd762-6083-42d0-b58d-765995f4f7cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:34.366705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-716bd762-6083-42d0-b58d-765995f4f7cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:34.373371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-716bd762-6083-42d0-b58d-765995f4f7cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:34.373836 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-716bd762-6083-42d0-b58d-765995f4f7cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:34.374631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-716bd762-6083-42d0-b58d-765995f4f7cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:34.375081 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-716bd762-6083-42d0-b58d-765995f4f7cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:34.509121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-716bd762-6083-42d0-b58d-765995f4f7cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:34.516477 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-716bd762-6083-42d0-b58d-765995f4f7cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1563 microversion: 2.1 time: 0.154701 Feb 19 21:45:34.517060 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3194/6301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:34 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:34.532550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-770fb441-785d-4776-ae98-fc31de6be299 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:34.533167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-770fb441-785d-4776-ae98-fc31de6be299 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:34.540590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-770fb441-785d-4776-ae98-fc31de6be299 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:34.541074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-770fb441-785d-4776-ae98-fc31de6be299 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:34.541859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-770fb441-785d-4776-ae98-fc31de6be299 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:34.542301 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-770fb441-785d-4776-ae98-fc31de6be299 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:34.678732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-770fb441-785d-4776-ae98-fc31de6be299 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:34.685966 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-770fb441-785d-4776-ae98-fc31de6be299 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1563 microversion: 2.1 time: 0.157032 Feb 19 21:45:34.686540 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3108/6302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:34 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:45:36.635949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3c41b913-9038-4dbc-b0f5-1c268b01efaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:45:36.636703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3c41b913-9038-4dbc-b0f5-1c268b01efaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:45:36.639041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-a285bc98-7e1e-48e6-85c8-003320571d58 req-4a36b799-d94c-4f1b-a8f7-51d33d833761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e10bc9-026f-472f-b405-8a8dc3dd8e49", "tag": "01c99b91-c36a-417d-8b9a-33b64aa91c00"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:45:36.640620 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:45:36.640620 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:45:36.645918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c41b913-9038-4dbc-b0f5-1c268b01efaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:36.646476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c41b913-9038-4dbc-b0f5-1c268b01efaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:36.647947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c41b913-9038-4dbc-b0f5-1c268b01efaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:36.648579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3c41b913-9038-4dbc-b0f5-1c268b01efaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:36.649047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a285bc98-7e1e-48e6-85c8-003320571d58 req-4a36b799-d94c-4f1b-a8f7-51d33d833761 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:45:36.649504 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-a285bc98-7e1e-48e6-85c8-003320571d58 req-4a36b799-d94c-4f1b-a8f7-51d33d833761 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:45:36.662126 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-a285bc98-7e1e-48e6-85c8-003320571d58 req-4a36b799-d94c-4f1b-a8f7-51d33d833761 service nova] Creating event network-changed:01c99b91-c36a-417d-8b9a-33b64aa91c00 for instance 62e10bc9-026f-472f-b405-8a8dc3dd8e49 on nch2-master-1 Feb 19 21:45:36.669122 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-a285bc98-7e1e-48e6-85c8-003320571d58 req-4a36b799-d94c-4f1b-a8f7-51d33d833761 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034225 Feb 19 21:45:36.670049 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3109/6303] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:45:36.892263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3c41b913-9038-4dbc-b0f5-1c268b01efaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:45:36.900580 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3c41b913-9038-4dbc-b0f5-1c268b01efaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1563 microversion: 2.1 time: 0.268410 Feb 19 21:45:36.901265 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3195/6304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:45:36 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1563 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:08.226781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-757e05e8-bcc1-483b-aef0-6ed76b3cd456 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:46:08.227777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-757e05e8-bcc1-483b-aef0-6ed76b3cd456 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:08.234011 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-757e05e8-bcc1-483b-aef0-6ed76b3cd456 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:08.234472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-757e05e8-bcc1-483b-aef0-6ed76b3cd456 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:08.235257 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-757e05e8-bcc1-483b-aef0-6ed76b3cd456 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:08.235697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-757e05e8-bcc1-483b-aef0-6ed76b3cd456 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:08.293005 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-757e05e8-bcc1-483b-aef0-6ed76b3cd456 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49/action" status: 200 len: 24570 microversion: 2.1 time: 0.071229 Feb 19 21:46:08.293587 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3110/6305] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:46:08 2022] POST /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:46:38.760981 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8e9b77a1-8f80-44ab-ab65-32a844f07d85 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:46:38.761992 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8e9b77a1-8f80-44ab-ab65-32a844f07d85 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:38.767977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e9b77a1-8f80-44ab-ab65-32a844f07d85 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:38.768476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e9b77a1-8f80-44ab-ab65-32a844f07d85 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:38.769277 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e9b77a1-8f80-44ab-ab65-32a844f07d85 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:38.769733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8e9b77a1-8f80-44ab-ab65-32a844f07d85 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:38.842550 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8e9b77a1-8f80-44ab-ab65-32a844f07d85 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49/action" status: 202 len: 0 microversion: 2.1 time: 0.086483 Feb 19 21:46:38.843192 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3196/6306] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:46:38 2022] POST /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:46:38.853702 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-73e8dda5-837d-4269-895b-d5b82652e3a8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:38.854421 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-73e8dda5-837d-4269-895b-d5b82652e3a8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:38.862413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73e8dda5-837d-4269-895b-d5b82652e3a8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:38.862904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73e8dda5-837d-4269-895b-d5b82652e3a8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:38.864425 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73e8dda5-837d-4269-895b-d5b82652e3a8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:38.864882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-73e8dda5-837d-4269-895b-d5b82652e3a8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:39.187129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-73e8dda5-837d-4269-895b-d5b82652e3a8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:39.195372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-73e8dda5-837d-4269-895b-d5b82652e3a8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1674 microversion: 2.1 time: 0.346633 Feb 19 21:46:39.196143 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3111/6307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:38 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1674 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:40.215157 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e75cb60f-0648-436f-aa0d-a8c080f83029 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:40.215871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e75cb60f-0648-436f-aa0d-a8c080f83029 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:40.222387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e75cb60f-0648-436f-aa0d-a8c080f83029 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:40.222866 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e75cb60f-0648-436f-aa0d-a8c080f83029 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:40.223666 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e75cb60f-0648-436f-aa0d-a8c080f83029 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:40.224123 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e75cb60f-0648-436f-aa0d-a8c080f83029 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:40.415433 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e75cb60f-0648-436f-aa0d-a8c080f83029 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:40.422910 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e75cb60f-0648-436f-aa0d-a8c080f83029 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1679 microversion: 2.1 time: 0.213747 Feb 19 21:46:40.423485 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3197/6308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:40 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:41.440192 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7a09abfc-0844-4fa8-9a99-b26c368d8f91 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:41.440827 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7a09abfc-0844-4fa8-9a99-b26c368d8f91 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:41.449125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a09abfc-0844-4fa8-9a99-b26c368d8f91 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:41.449610 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a09abfc-0844-4fa8-9a99-b26c368d8f91 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:41.450394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a09abfc-0844-4fa8-9a99-b26c368d8f91 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:41.450838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7a09abfc-0844-4fa8-9a99-b26c368d8f91 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:41.586355 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7a09abfc-0844-4fa8-9a99-b26c368d8f91 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:41.593725 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7a09abfc-0844-4fa8-9a99-b26c368d8f91 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1679 microversion: 2.1 time: 0.157224 Feb 19 21:46:41.594307 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3112/6309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:41 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:42.611318 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c91c2654-7a91-4162-ba21-ce2749191020 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:42.611942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c91c2654-7a91-4162-ba21-ce2749191020 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:42.625945 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c91c2654-7a91-4162-ba21-ce2749191020 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:42.626407 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c91c2654-7a91-4162-ba21-ce2749191020 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:42.627205 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c91c2654-7a91-4162-ba21-ce2749191020 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:42.627664 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c91c2654-7a91-4162-ba21-ce2749191020 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:42.766659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c91c2654-7a91-4162-ba21-ce2749191020 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:42.774007 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c91c2654-7a91-4162-ba21-ce2749191020 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1679 microversion: 2.1 time: 0.166447 Feb 19 21:46:42.774612 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3198/6310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:42 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:43.790855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3e197490-dca5-45f4-9a0f-e484bf63876d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:43.791466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3e197490-dca5-45f4-9a0f-e484bf63876d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:43.798141 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e197490-dca5-45f4-9a0f-e484bf63876d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:43.798593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e197490-dca5-45f4-9a0f-e484bf63876d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:43.799402 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e197490-dca5-45f4-9a0f-e484bf63876d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:43.799842 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e197490-dca5-45f4-9a0f-e484bf63876d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:43.935656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3e197490-dca5-45f4-9a0f-e484bf63876d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:43.943192 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3e197490-dca5-45f4-9a0f-e484bf63876d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1679 microversion: 2.1 time: 0.156132 Feb 19 21:46:43.943782 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3113/6311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:43 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:44.961164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fda3a443-47e1-4708-99ab-0f4a8a61f27b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:44.961704 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fda3a443-47e1-4708-99ab-0f4a8a61f27b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:44.968463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fda3a443-47e1-4708-99ab-0f4a8a61f27b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:44.968931 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fda3a443-47e1-4708-99ab-0f4a8a61f27b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:44.969717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fda3a443-47e1-4708-99ab-0f4a8a61f27b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:44.970171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fda3a443-47e1-4708-99ab-0f4a8a61f27b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:45.108907 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fda3a443-47e1-4708-99ab-0f4a8a61f27b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:45.116210 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fda3a443-47e1-4708-99ab-0f4a8a61f27b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1679 microversion: 2.1 time: 0.158856 Feb 19 21:46:45.117300 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3199/6312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:44 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:46.132911 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bbcd175a-e14f-44dc-a1d5-f97d117082ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:46.133560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bbcd175a-e14f-44dc-a1d5-f97d117082ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:46.140284 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbcd175a-e14f-44dc-a1d5-f97d117082ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:46.140765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbcd175a-e14f-44dc-a1d5-f97d117082ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:46.141550 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbcd175a-e14f-44dc-a1d5-f97d117082ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:46.141992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbcd175a-e14f-44dc-a1d5-f97d117082ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:46.277580 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bbcd175a-e14f-44dc-a1d5-f97d117082ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:46.284987 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bbcd175a-e14f-44dc-a1d5-f97d117082ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1679 microversion: 2.1 time: 0.155775 Feb 19 21:46:46.285567 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3114/6313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:46 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:47.302630 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-32f6df05-8117-4671-8bff-14886e009315 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:47.303282 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-32f6df05-8117-4671-8bff-14886e009315 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:47.310660 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32f6df05-8117-4671-8bff-14886e009315 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:47.311127 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32f6df05-8117-4671-8bff-14886e009315 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:47.311914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32f6df05-8117-4671-8bff-14886e009315 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:47.312387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-32f6df05-8117-4671-8bff-14886e009315 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:47.455078 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-32f6df05-8117-4671-8bff-14886e009315 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:47.462307 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-32f6df05-8117-4671-8bff-14886e009315 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1679 microversion: 2.1 time: 0.163359 Feb 19 21:46:47.462876 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3200/6314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:47 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:48.478777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4cd1297a-e170-43c8-b123-1cda4e7cfed8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:48.479390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4cd1297a-e170-43c8-b123-1cda4e7cfed8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:48.486096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4cd1297a-e170-43c8-b123-1cda4e7cfed8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:48.486545 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4cd1297a-e170-43c8-b123-1cda4e7cfed8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:48.487339 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4cd1297a-e170-43c8-b123-1cda4e7cfed8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:48.487762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4cd1297a-e170-43c8-b123-1cda4e7cfed8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:48.622664 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4cd1297a-e170-43c8-b123-1cda4e7cfed8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:48.629984 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4cd1297a-e170-43c8-b123-1cda4e7cfed8 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1679 microversion: 2.1 time: 0.154953 Feb 19 21:46:48.630555 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3115/6315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:48 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:49.646584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ca45b6e5-c71d-4f7e-880a-ff9b0afaa5e0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:49.647213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ca45b6e5-c71d-4f7e-880a-ff9b0afaa5e0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:49.654651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca45b6e5-c71d-4f7e-880a-ff9b0afaa5e0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:49.655118 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca45b6e5-c71d-4f7e-880a-ff9b0afaa5e0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:49.655913 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca45b6e5-c71d-4f7e-880a-ff9b0afaa5e0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:49.656389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ca45b6e5-c71d-4f7e-880a-ff9b0afaa5e0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:49.799116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ca45b6e5-c71d-4f7e-880a-ff9b0afaa5e0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:49.806515 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ca45b6e5-c71d-4f7e-880a-ff9b0afaa5e0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1679 microversion: 2.1 time: 0.163723 Feb 19 21:46:49.807089 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3201/6316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:49 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:46:50.823672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-53aecb48-ab0d-45e8-8f49-839511c54daa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:46:50.824209 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-53aecb48-ab0d-45e8-8f49-839511c54daa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:46:50.830963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53aecb48-ab0d-45e8-8f49-839511c54daa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:50.831418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53aecb48-ab0d-45e8-8f49-839511c54daa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:50.832188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53aecb48-ab0d-45e8-8f49-839511c54daa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:46:50.832657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53aecb48-ab0d-45e8-8f49-839511c54daa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:46:50.966528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-53aecb48-ab0d-45e8-8f49-839511c54daa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:46:50.973765 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-53aecb48-ab0d-45e8-8f49-839511c54daa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1682 microversion: 2.1 time: 0.154168 Feb 19 21:46:50.974642 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3116/6317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:46:50 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:47:23.182994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-82e575f9-738f-453c-ab83-4ad71475f890 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:47:23.183920 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-82e575f9-738f-453c-ab83-4ad71475f890 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:23.189952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82e575f9-738f-453c-ab83-4ad71475f890 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:23.190411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82e575f9-738f-453c-ab83-4ad71475f890 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:23.191198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82e575f9-738f-453c-ab83-4ad71475f890 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:23.191650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-82e575f9-738f-453c-ab83-4ad71475f890 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:23.247221 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-82e575f9-738f-453c-ab83-4ad71475f890 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49/action" status: 200 len: 69148 microversion: 2.1 time: 0.068211 Feb 19 21:47:23.248204 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3202/6318] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:47:23 2022] POST /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49/action => generated 69148 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:47:40.572367 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a43af7de-e907-4d64-9da1-886ce273336e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:40.572921 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a43af7de-e907-4d64-9da1-886ce273336e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:40.581480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43af7de-e907-4d64-9da1-886ce273336e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:40.582074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43af7de-e907-4d64-9da1-886ce273336e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:40.582931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43af7de-e907-4d64-9da1-886ce273336e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:40.583626 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a43af7de-e907-4d64-9da1-886ce273336e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:40.612985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a43af7de-e907-4d64-9da1-886ce273336e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:47:40.644868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-478915fd-dbc8-46ba-bafd-831ae1d8a3e1 req-1c8396d6-42a7-493b-b82d-a5e95d41835e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e10bc9-026f-472f-b405-8a8dc3dd8e49", "tag": "01c99b91-c36a-417d-8b9a-33b64aa91c00"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:47:40.647044 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:47:40.647044 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:47:40.657254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-478915fd-dbc8-46ba-bafd-831ae1d8a3e1 req-1c8396d6-42a7-493b-b82d-a5e95d41835e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:40.658104 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-478915fd-dbc8-46ba-bafd-831ae1d8a3e1 req-1c8396d6-42a7-493b-b82d-a5e95d41835e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:40.669787 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-478915fd-dbc8-46ba-bafd-831ae1d8a3e1 req-1c8396d6-42a7-493b-b82d-a5e95d41835e service nova] Creating event network-changed:01c99b91-c36a-417d-8b9a-33b64aa91c00 for instance 62e10bc9-026f-472f-b405-8a8dc3dd8e49 on nch2-master-1 Feb 19 21:47:40.675798 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-478915fd-dbc8-46ba-bafd-831ae1d8a3e1 req-1c8396d6-42a7-493b-b82d-a5e95d41835e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104954 Feb 19 21:47:40.676730 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3203/6319] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:47:40.701946 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a43af7de-e907-4d64-9da1-886ce273336e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 204 len: 0 microversion: 2.1 time: 0.133043 Feb 19 21:47:40.702784 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3117/6320] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:47:40 2022] DELETE /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:47:40.712570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7ad4cee2-b82e-4e30-b8ea-2b22350fd784 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:40.713771 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7ad4cee2-b82e-4e30-b8ea-2b22350fd784 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:40.721238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ad4cee2-b82e-4e30-b8ea-2b22350fd784 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:40.721721 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ad4cee2-b82e-4e30-b8ea-2b22350fd784 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:40.722717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ad4cee2-b82e-4e30-b8ea-2b22350fd784 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:40.723350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ad4cee2-b82e-4e30-b8ea-2b22350fd784 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:40.980833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7ad4cee2-b82e-4e30-b8ea-2b22350fd784 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:47:40.989367 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7ad4cee2-b82e-4e30-b8ea-2b22350fd784 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1688 microversion: 2.1 time: 0.281028 Feb 19 21:47:40.990245 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3204/6321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:47:40 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1688 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:47:42.006589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cd1a69e1-e8e3-4d5a-9f01-b89d8d1790a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:42.007282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cd1a69e1-e8e3-4d5a-9f01-b89d8d1790a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:42.014761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd1a69e1-e8e3-4d5a-9f01-b89d8d1790a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:42.015211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd1a69e1-e8e3-4d5a-9f01-b89d8d1790a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:42.015984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd1a69e1-e8e3-4d5a-9f01-b89d8d1790a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:42.016449 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cd1a69e1-e8e3-4d5a-9f01-b89d8d1790a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:42.151251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cd1a69e1-e8e3-4d5a-9f01-b89d8d1790a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:47:42.158564 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cd1a69e1-e8e3-4d5a-9f01-b89d8d1790a4 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1569 microversion: 2.1 time: 0.156029 Feb 19 21:47:42.159142 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3118/6322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:47:42 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:47:42.849657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3bbee831-28f9-459c-80b3-d6ebd3307f29 req-9d9c52da-b67b-48d6-8961-4e67d1dff7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e10bc9-026f-472f-b405-8a8dc3dd8e49", "name": "network-vif-deleted", "tag": "01c99b91-c36a-417d-8b9a-33b64aa91c00"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:47:42.851843 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:47:42.851843 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:47:42.860061 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3bbee831-28f9-459c-80b3-d6ebd3307f29 req-9d9c52da-b67b-48d6-8961-4e67d1dff7cd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:42.860555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3bbee831-28f9-459c-80b3-d6ebd3307f29 req-9d9c52da-b67b-48d6-8961-4e67d1dff7cd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:42.872912 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3bbee831-28f9-459c-80b3-d6ebd3307f29 req-9d9c52da-b67b-48d6-8961-4e67d1dff7cd service nova] Creating event network-vif-deleted:01c99b91-c36a-417d-8b9a-33b64aa91c00 for instance 62e10bc9-026f-472f-b405-8a8dc3dd8e49 on nch2-master-1 Feb 19 21:47:42.877720 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3bbee831-28f9-459c-80b3-d6ebd3307f29 req-9d9c52da-b67b-48d6-8961-4e67d1dff7cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031902 Feb 19 21:47:42.878324 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3205/6323] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:47:43.175956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:43.176607 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:43.184448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:43.184912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:43.185770 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:43.186215 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:43.224875 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:43.225333 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:43.225946 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lazy-loading 'fault' on Instance uuid 62e10bc9-026f-472f-b405-8a8dc3dd8e49 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:47:43.606730 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:47:43.613530 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-65d7d755-1764-4677-8782-602511c229ea tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 200 len: 1355 microversion: 2.1 time: 0.441298 Feb 19 21:47:43.614098 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3119/6324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:47:43 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 1355 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:47:44.632317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4f62a6e-e8b5-4564-b1f2-bbb8949733f5 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:44.633087 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e4f62a6e-e8b5-4564-b1f2-bbb8949733f5 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 62e10bc9-026f-472f-b405-8a8dc3dd8e49] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:44.639928 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4f62a6e-e8b5-4564-b1f2-bbb8949733f5 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:44.640434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4f62a6e-e8b5-4564-b1f2-bbb8949733f5 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:44.641230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4f62a6e-e8b5-4564-b1f2-bbb8949733f5 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:44.641682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e4f62a6e-e8b5-4564-b1f2-bbb8949733f5 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:44.654779 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-e4f62a6e-e8b5-4564-b1f2-bbb8949733f5 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] HTTP exception thrown: Instance 62e10bc9-026f-472f-b405-8a8dc3dd8e49 could not be found. Feb 19 21:47:44.655372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e4f62a6e-e8b5-4564-b1f2-bbb8949733f5 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Returning 404 to user: Instance 62e10bc9-026f-472f-b405-8a8dc3dd8e49 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:47:44.656199 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e4f62a6e-e8b5-4564-b1f2-bbb8949733f5 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49" status: 404 len: 111 microversion: 2.1 time: 0.028845 Feb 19 21:47:44.656760 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3206/6325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:47:44 2022] GET /compute/v2.1/servers/62e10bc9-026f-472f-b405-8a8dc3dd8e49 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:47:47.672609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d4ec1831-fdc2-4f08-b756-c31b3c729a86 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '.version_select at 0x7f6467abb310>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:47.707840 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d4ec1831-fdc2-4f08-b756-c31b3c729a86 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-716236325" status: 202 len: 0 microversion: 2.1 time: 0.038980 Feb 19 21:47:47.708657 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3120/6326] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Feb 19 21:47:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-716236325 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:47:47.736214 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1fd18099-84cb-4cf2-a66e-ba80518ef89e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: .version_select at 0x7f646791f1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-901258666"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:47:47.752456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1fd18099-84cb-4cf2-a66e-ba80518ef89e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:47:47.757699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1fd18099-84cb-4cf2-a66e-ba80518ef89e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:47:48.090979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1fd18099-84cb-4cf2-a66e-ba80518ef89e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:47:48.095956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-1fd18099-84cb-4cf2-a66e-ba80518ef89e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:47:48.109937 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1fd18099-84cb-4cf2-a66e-ba80518ef89e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.377501 Feb 19 21:47:48.110543 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3207/6327] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:47:47 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:47:53.573910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1362240880", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "fca0a1b5-3205-484d-8a75-5441e46acc30"}], "key_name": "tempest-TestNetworkAdvancedServerOps-901258666", "security_groups": [{"name": "tempest-secgroup-smoke-1656745986"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:47:54.043589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] validate_networks() for [('fca0a1b5-3205-484d-8a75-5441e46acc30', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:47:54.430197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:47:54.430700 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:47:54.431484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:47:54.432084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:47:54.432671 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:47:54.442115 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:54.442889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:54.443711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:54.444173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:54.463511 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:47:54.468796 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:47:54.481816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:47:54.484155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:47:54.539368 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f71a7e26-adc8-4e52-8496-c8ce09b85174 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.969733 Feb 19 21:47:54.570797 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3121/6328] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:47:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:47:54.576016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-44885acf-a389-46e8-92e7-4d8a114b279e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:54.576792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-44885acf-a389-46e8-92e7-4d8a114b279e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:54.645320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-44885acf-a389-46e8-92e7-4d8a114b279e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:47:54.653613 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-44885acf-a389-46e8-92e7-4d8a114b279e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1266 microversion: 2.1 time: 0.081200 Feb 19 21:47:54.654556 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3208/6329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:47:54 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:47:55.672701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1cdb1b48-bf4d-4ca3-8b4e-ca00fa5e2592 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:55.674473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1cdb1b48-bf4d-4ca3-8b4e-ca00fa5e2592 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:55.684707 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cdb1b48-bf4d-4ca3-8b4e-ca00fa5e2592 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:55.685738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cdb1b48-bf4d-4ca3-8b4e-ca00fa5e2592 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:55.687361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cdb1b48-bf4d-4ca3-8b4e-ca00fa5e2592 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:55.688160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1cdb1b48-bf4d-4ca3-8b4e-ca00fa5e2592 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:55.801080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1cdb1b48-bf4d-4ca3-8b4e-ca00fa5e2592 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:47:55.820366 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1cdb1b48-bf4d-4ca3-8b4e-ca00fa5e2592 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1324 microversion: 2.1 time: 0.152003 Feb 19 21:47:55.821553 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3122/6330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:47:55 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:47:56.839072 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-13b75a0a-2041-4ce8-89a9-161506a6877c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:56.840316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-13b75a0a-2041-4ce8-89a9-161506a6877c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:56.850386 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13b75a0a-2041-4ce8-89a9-161506a6877c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:56.850947 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13b75a0a-2041-4ce8-89a9-161506a6877c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:56.852184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13b75a0a-2041-4ce8-89a9-161506a6877c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:56.853382 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-13b75a0a-2041-4ce8-89a9-161506a6877c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:57.021268 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-13b75a0a-2041-4ce8-89a9-161506a6877c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:47:57.031355 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-13b75a0a-2041-4ce8-89a9-161506a6877c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1392 microversion: 2.1 time: 0.196673 Feb 19 21:47:57.032546 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3209/6331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:47:56 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:47:57.057532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-0310e167-dc10-4c85-b279-a17e9046b6a0 req-e5c11eae-6c22-45d2-9ef9-156d0a263bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459f7e82-32e2-44b4-9477-eeb5ccaccbca", "tag": "e631e9bd-5480-4b5e-aa9a-895b67fc1acd"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:47:57.059889 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:47:57.059889 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:47:57.070432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0310e167-dc10-4c85-b279-a17e9046b6a0 req-e5c11eae-6c22-45d2-9ef9-156d0a263bed service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:57.071598 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-0310e167-dc10-4c85-b279-a17e9046b6a0 req-e5c11eae-6c22-45d2-9ef9-156d0a263bed service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:57.085364 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-0310e167-dc10-4c85-b279-a17e9046b6a0 req-e5c11eae-6c22-45d2-9ef9-156d0a263bed service nova] Creating event network-changed:e631e9bd-5480-4b5e-aa9a-895b67fc1acd for instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca on nch1-master-1 Feb 19 21:47:57.091292 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-0310e167-dc10-4c85-b279-a17e9046b6a0 req-e5c11eae-6c22-45d2-9ef9-156d0a263bed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038130 Feb 19 21:47:57.092557 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3123/6332] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:47:58.047912 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-330b8157-f25f-4ab9-860e-d07a61428c71 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:58.048574 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-330b8157-f25f-4ab9-860e-d07a61428c71 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:58.055278 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-330b8157-f25f-4ab9-860e-d07a61428c71 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:58.055746 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-330b8157-f25f-4ab9-860e-d07a61428c71 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:58.056572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-330b8157-f25f-4ab9-860e-d07a61428c71 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:58.057084 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-330b8157-f25f-4ab9-860e-d07a61428c71 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:58.194722 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-330b8157-f25f-4ab9-860e-d07a61428c71 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:47:58.202021 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-330b8157-f25f-4ab9-860e-d07a61428c71 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1392 microversion: 2.1 time: 0.158075 Feb 19 21:47:58.202596 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3210/6333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:47:58 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:47:59.222266 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-acdfedab-5ff4-470a-af2f-78dd439896cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:47:59.222958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-acdfedab-5ff4-470a-af2f-78dd439896cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:47:59.230429 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acdfedab-5ff4-470a-af2f-78dd439896cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:59.230873 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acdfedab-5ff4-470a-af2f-78dd439896cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:59.231680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acdfedab-5ff4-470a-af2f-78dd439896cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:47:59.232121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-acdfedab-5ff4-470a-af2f-78dd439896cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:47:59.372732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-acdfedab-5ff4-470a-af2f-78dd439896cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:47:59.379991 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-acdfedab-5ff4-470a-af2f-78dd439896cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1392 microversion: 2.1 time: 0.161858 Feb 19 21:47:59.380590 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3124/6334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:47:59 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:00.396903 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-becf7acf-62d7-4d67-b3fe-bdb2fae70f80 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:00.397513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-becf7acf-62d7-4d67-b3fe-bdb2fae70f80 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:00.404190 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-becf7acf-62d7-4d67-b3fe-bdb2fae70f80 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:00.404687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-becf7acf-62d7-4d67-b3fe-bdb2fae70f80 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:00.405485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-becf7acf-62d7-4d67-b3fe-bdb2fae70f80 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:00.405939 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-becf7acf-62d7-4d67-b3fe-bdb2fae70f80 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:00.543624 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-becf7acf-62d7-4d67-b3fe-bdb2fae70f80 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:00.551735 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-becf7acf-62d7-4d67-b3fe-bdb2fae70f80 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1392 microversion: 2.1 time: 0.158526 Feb 19 21:48:00.552443 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3211/6335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:00 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:01.568263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-43f64ed3-2ee3-453c-8b93-276aaafc8b01 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:01.568829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-43f64ed3-2ee3-453c-8b93-276aaafc8b01 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:01.576287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43f64ed3-2ee3-453c-8b93-276aaafc8b01 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:01.576771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43f64ed3-2ee3-453c-8b93-276aaafc8b01 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:01.577581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43f64ed3-2ee3-453c-8b93-276aaafc8b01 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:01.578046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-43f64ed3-2ee3-453c-8b93-276aaafc8b01 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:01.717570 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-43f64ed3-2ee3-453c-8b93-276aaafc8b01 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:01.725643 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-43f64ed3-2ee3-453c-8b93-276aaafc8b01 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1392 microversion: 2.1 time: 0.161133 Feb 19 21:48:01.726241 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3125/6336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:01 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:02.509739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-6cbfd339-8475-4dee-82d6-8989775061b0 req-170be8ec-89a0-45ee-adf1-68a5777e4e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459f7e82-32e2-44b4-9477-eeb5ccaccbca", "name": "network-vif-plugged", "status": "completed", "tag": "e631e9bd-5480-4b5e-aa9a-895b67fc1acd"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:48:02.511301 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:48:02.511301 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:48:02.519830 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6cbfd339-8475-4dee-82d6-8989775061b0 req-170be8ec-89a0-45ee-adf1-68a5777e4e50 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:02.520799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-6cbfd339-8475-4dee-82d6-8989775061b0 req-170be8ec-89a0-45ee-adf1-68a5777e4e50 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:02.533437 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-6cbfd339-8475-4dee-82d6-8989775061b0 req-170be8ec-89a0-45ee-adf1-68a5777e4e50 service nova] Creating event network-vif-plugged:e631e9bd-5480-4b5e-aa9a-895b67fc1acd for instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca on nch1-master-1 Feb 19 21:48:02.539345 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-6cbfd339-8475-4dee-82d6-8989775061b0 req-170be8ec-89a0-45ee-adf1-68a5777e4e50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033394 Feb 19 21:48:02.540991 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3212/6337] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:48:02.742917 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0707687b-0a54-46d6-95d8-9f552980c522 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:02.743565 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0707687b-0a54-46d6-95d8-9f552980c522 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:02.750636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0707687b-0a54-46d6-95d8-9f552980c522 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:02.751097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0707687b-0a54-46d6-95d8-9f552980c522 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:02.751889 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0707687b-0a54-46d6-95d8-9f552980c522 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:02.752370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0707687b-0a54-46d6-95d8-9f552980c522 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:02.893225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0707687b-0a54-46d6-95d8-9f552980c522 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:02.901215 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0707687b-0a54-46d6-95d8-9f552980c522 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1392 microversion: 2.1 time: 0.162286 Feb 19 21:48:02.901797 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3126/6338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:02 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:03.918772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1f2ff07e-1c6d-4e14-abdb-3416aa5be24f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:03.919477 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1f2ff07e-1c6d-4e14-abdb-3416aa5be24f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:03.926564 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f2ff07e-1c6d-4e14-abdb-3416aa5be24f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:03.927027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f2ff07e-1c6d-4e14-abdb-3416aa5be24f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:03.927802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f2ff07e-1c6d-4e14-abdb-3416aa5be24f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:03.928247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1f2ff07e-1c6d-4e14-abdb-3416aa5be24f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:04.066263 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1f2ff07e-1c6d-4e14-abdb-3416aa5be24f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:04.074306 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1f2ff07e-1c6d-4e14-abdb-3416aa5be24f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1563 microversion: 2.1 time: 0.160038 Feb 19 21:48:04.074872 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3213/6339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:03 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:04.090297 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2c6d20db-e56c-4f4e-80d7-48b0ea96e1ed tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:04.090906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2c6d20db-e56c-4f4e-80d7-48b0ea96e1ed tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:04.097553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6d20db-e56c-4f4e-80d7-48b0ea96e1ed tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:04.098005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6d20db-e56c-4f4e-80d7-48b0ea96e1ed tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:04.098781 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6d20db-e56c-4f4e-80d7-48b0ea96e1ed tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:04.099222 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2c6d20db-e56c-4f4e-80d7-48b0ea96e1ed tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:04.232502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2c6d20db-e56c-4f4e-80d7-48b0ea96e1ed tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:04.242562 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2c6d20db-e56c-4f4e-80d7-48b0ea96e1ed tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1563 microversion: 2.1 time: 0.156177 Feb 19 21:48:04.242997 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3127/6340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:04 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:05.868553 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1b0bdf07-3e5e-403f-ac52-7772736f6569 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:05.869170 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1b0bdf07-3e5e-403f-ac52-7772736f6569 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:05.871147 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-29670d9a-fbdf-4704-b47d-ae6ae00771c3 req-a3388c98-441b-44ba-9014-fb609ea21627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459f7e82-32e2-44b4-9477-eeb5ccaccbca", "tag": "e631e9bd-5480-4b5e-aa9a-895b67fc1acd"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:48:05.873013 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:48:05.873013 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:48:05.876897 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b0bdf07-3e5e-403f-ac52-7772736f6569 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:05.877572 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b0bdf07-3e5e-403f-ac52-7772736f6569 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:05.878638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b0bdf07-3e5e-403f-ac52-7772736f6569 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:05.879253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b0bdf07-3e5e-403f-ac52-7772736f6569 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:05.880947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-29670d9a-fbdf-4704-b47d-ae6ae00771c3 req-a3388c98-441b-44ba-9014-fb609ea21627 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:05.881473 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-29670d9a-fbdf-4704-b47d-ae6ae00771c3 req-a3388c98-441b-44ba-9014-fb609ea21627 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:05.893840 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-29670d9a-fbdf-4704-b47d-ae6ae00771c3 req-a3388c98-441b-44ba-9014-fb609ea21627 service nova] Creating event network-changed:e631e9bd-5480-4b5e-aa9a-895b67fc1acd for instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca on nch1-master-1 Feb 19 21:48:05.899623 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-29670d9a-fbdf-4704-b47d-ae6ae00771c3 req-a3388c98-441b-44ba-9014-fb609ea21627 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031720 Feb 19 21:48:05.900672 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3128/6341] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:48:06.046557 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1b0bdf07-3e5e-403f-ac52-7772736f6569 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:06.055612 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1b0bdf07-3e5e-403f-ac52-7772736f6569 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1563 microversion: 2.1 time: 0.191057 Feb 19 21:48:06.056487 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3214/6342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:05 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:29.301924 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4c50bf5f-e4b7-403e-8e81-7c46760f9814 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:48:29.302912 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4c50bf5f-e4b7-403e-8e81-7c46760f9814 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:29.308962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c50bf5f-e4b7-403e-8e81-7c46760f9814 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:29.309413 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c50bf5f-e4b7-403e-8e81-7c46760f9814 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:29.310194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c50bf5f-e4b7-403e-8e81-7c46760f9814 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:29.310633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4c50bf5f-e4b7-403e-8e81-7c46760f9814 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:29.359539 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4c50bf5f-e4b7-403e-8e81-7c46760f9814 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca/action" status: 200 len: 24567 microversion: 2.1 time: 0.062375 Feb 19 21:48:29.360173 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3129/6343] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:48:29 2022] POST /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca/action => generated 24567 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:48:35.728418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:48:35.729394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:35.735415 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:35.735889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:35.736730 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:35.737159 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:35.836432 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:35.843515 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Old instance type m1.heat2, new instance type m1.heat {{(pid=136094) resize /opt/stack/nova/nova/compute/api.py:4097}} Feb 19 21:48:35.849588 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:48:35.850016 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:48:35.850494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:48:35.850908 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:48:35.851322 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:48:35.909747 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [f79b9f5e-52a0-436d-9204-7cef700a80bf] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 21:48:36.918369 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [f79b9f5e-52a0-436d-9204-7cef700a80bf] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42294. Feb 19 21:48:36.921985 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a0c47fd-766d-4e58-a8fb-26aa7266c842 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca/action" status: 202 len: 0 microversion: 2.1 time: 1.197708 Feb 19 21:48:36.922905 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3215/6344] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:48:35 2022] POST /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca/action => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:48:36.931082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bdee7447-2f18-4917-8520-0d8f69669c13 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:36.931778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bdee7447-2f18-4917-8520-0d8f69669c13 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:36.938945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdee7447-2f18-4917-8520-0d8f69669c13 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:36.939393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdee7447-2f18-4917-8520-0d8f69669c13 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:36.940167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdee7447-2f18-4917-8520-0d8f69669c13 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:36.940628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bdee7447-2f18-4917-8520-0d8f69669c13 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:37.244010 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-bdee7447-2f18-4917-8520-0d8f69669c13 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:37.252305 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bdee7447-2f18-4917-8520-0d8f69669c13 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1690 microversion: 2.1 time: 0.325266 Feb 19 21:48:37.253217 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3130/6345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:36 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1690 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:38.270961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5d7af255-e1a9-4a01-b043-09fa25143f50 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:38.271712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5d7af255-e1a9-4a01-b043-09fa25143f50 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:38.280022 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d7af255-e1a9-4a01-b043-09fa25143f50 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:38.280513 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d7af255-e1a9-4a01-b043-09fa25143f50 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:38.281335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d7af255-e1a9-4a01-b043-09fa25143f50 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:38.281789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5d7af255-e1a9-4a01-b043-09fa25143f50 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:38.548733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5d7af255-e1a9-4a01-b043-09fa25143f50 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:38.556581 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5d7af255-e1a9-4a01-b043-09fa25143f50 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1690 microversion: 2.1 time: 0.289077 Feb 19 21:48:38.557180 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3216/6346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:38 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1690 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:39.574064 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b2146a1b-6545-4711-950c-4e3850032238 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:39.574681 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b2146a1b-6545-4711-950c-4e3850032238 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:39.582142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2146a1b-6545-4711-950c-4e3850032238 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:39.582601 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2146a1b-6545-4711-950c-4e3850032238 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:39.583387 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2146a1b-6545-4711-950c-4e3850032238 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:39.583832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2146a1b-6545-4711-950c-4e3850032238 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:39.723133 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b2146a1b-6545-4711-950c-4e3850032238 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:39.732861 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b2146a1b-6545-4711-950c-4e3850032238 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.162448 Feb 19 21:48:39.733463 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3131/6347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:39 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:40.750582 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aba1e24a-7acf-4828-bd8f-d4319658d269 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:40.751219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aba1e24a-7acf-4828-bd8f-d4319658d269 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:40.757885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aba1e24a-7acf-4828-bd8f-d4319658d269 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:40.758342 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aba1e24a-7acf-4828-bd8f-d4319658d269 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:40.759148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aba1e24a-7acf-4828-bd8f-d4319658d269 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:40.759593 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aba1e24a-7acf-4828-bd8f-d4319658d269 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:40.899134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aba1e24a-7acf-4828-bd8f-d4319658d269 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:40.906499 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aba1e24a-7acf-4828-bd8f-d4319658d269 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.159672 Feb 19 21:48:40.907065 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3217/6348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:40 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:41.923957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2da332a8-02bd-432f-8d84-f0302873dc0e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:41.924628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2da332a8-02bd-432f-8d84-f0302873dc0e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:41.931819 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2da332a8-02bd-432f-8d84-f0302873dc0e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:41.932275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2da332a8-02bd-432f-8d84-f0302873dc0e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:41.933083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2da332a8-02bd-432f-8d84-f0302873dc0e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:41.933531 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2da332a8-02bd-432f-8d84-f0302873dc0e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:42.067254 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2da332a8-02bd-432f-8d84-f0302873dc0e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:42.075513 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2da332a8-02bd-432f-8d84-f0302873dc0e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.155282 Feb 19 21:48:42.076082 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3132/6349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:41 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:43.093117 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-98f72db7-21ff-42e9-89be-3b8c0ea25d35 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:43.093742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-98f72db7-21ff-42e9-89be-3b8c0ea25d35 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:43.100486 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98f72db7-21ff-42e9-89be-3b8c0ea25d35 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:43.100952 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98f72db7-21ff-42e9-89be-3b8c0ea25d35 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:43.101745 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98f72db7-21ff-42e9-89be-3b8c0ea25d35 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:43.102200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-98f72db7-21ff-42e9-89be-3b8c0ea25d35 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:43.243802 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-98f72db7-21ff-42e9-89be-3b8c0ea25d35 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:43.251206 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-98f72db7-21ff-42e9-89be-3b8c0ea25d35 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.161816 Feb 19 21:48:43.251781 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3218/6350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:43 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:44.268098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-becd1404-4e56-4ca2-8fcb-ed7c0f80c866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:44.268729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-becd1404-4e56-4ca2-8fcb-ed7c0f80c866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:44.276039 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-becd1404-4e56-4ca2-8fcb-ed7c0f80c866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:44.276519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-becd1404-4e56-4ca2-8fcb-ed7c0f80c866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:44.277296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-becd1404-4e56-4ca2-8fcb-ed7c0f80c866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:44.277729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-becd1404-4e56-4ca2-8fcb-ed7c0f80c866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:44.412732 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-becd1404-4e56-4ca2-8fcb-ed7c0f80c866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:44.420795 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-becd1404-4e56-4ca2-8fcb-ed7c0f80c866 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.156310 Feb 19 21:48:44.421371 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3133/6351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:44 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:45.437930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c26cd9a-f886-4687-afbb-e7ba74f801ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:45.438547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c26cd9a-f886-4687-afbb-e7ba74f801ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:45.445729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c26cd9a-f886-4687-afbb-e7ba74f801ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:45.446200 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c26cd9a-f886-4687-afbb-e7ba74f801ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:45.446998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c26cd9a-f886-4687-afbb-e7ba74f801ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:45.447452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c26cd9a-f886-4687-afbb-e7ba74f801ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:45.587892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8c26cd9a-f886-4687-afbb-e7ba74f801ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:45.595284 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c26cd9a-f886-4687-afbb-e7ba74f801ce tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.161068 Feb 19 21:48:45.595870 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3219/6352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:45 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:46.612644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-95ba5311-b7e6-4a75-b2ad-ced9c4f3cd97 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:46.613248 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-95ba5311-b7e6-4a75-b2ad-ced9c4f3cd97 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:46.620382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95ba5311-b7e6-4a75-b2ad-ced9c4f3cd97 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:46.620861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95ba5311-b7e6-4a75-b2ad-ced9c4f3cd97 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:46.621635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95ba5311-b7e6-4a75-b2ad-ced9c4f3cd97 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:46.622070 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-95ba5311-b7e6-4a75-b2ad-ced9c4f3cd97 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:46.758455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-95ba5311-b7e6-4a75-b2ad-ced9c4f3cd97 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:46.765727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-95ba5311-b7e6-4a75-b2ad-ced9c4f3cd97 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.156730 Feb 19 21:48:46.766303 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3134/6353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:46 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:47.782998 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f80d9f99-5037-477c-976e-b9c050981abc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:47.783622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f80d9f99-5037-477c-976e-b9c050981abc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:47.790414 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f80d9f99-5037-477c-976e-b9c050981abc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:47.790879 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f80d9f99-5037-477c-976e-b9c050981abc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:47.791673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f80d9f99-5037-477c-976e-b9c050981abc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:47.792119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f80d9f99-5037-477c-976e-b9c050981abc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:47.926239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f80d9f99-5037-477c-976e-b9c050981abc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:47.934093 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f80d9f99-5037-477c-976e-b9c050981abc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.154890 Feb 19 21:48:47.934667 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3220/6354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:47 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:48.951950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b2239ce1-dcc6-4c9a-b887-1858101c086d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:48.952613 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b2239ce1-dcc6-4c9a-b887-1858101c086d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:48.959294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2239ce1-dcc6-4c9a-b887-1858101c086d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:48.959743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2239ce1-dcc6-4c9a-b887-1858101c086d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:48.960554 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2239ce1-dcc6-4c9a-b887-1858101c086d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:48.960992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b2239ce1-dcc6-4c9a-b887-1858101c086d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:49.097988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b2239ce1-dcc6-4c9a-b887-1858101c086d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:49.105995 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b2239ce1-dcc6-4c9a-b887-1858101c086d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.158646 Feb 19 21:48:49.106590 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3135/6355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:48 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:50.123230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-74bde1a1-b1c5-407b-8908-e30655f5f919 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:50.124266 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-74bde1a1-b1c5-407b-8908-e30655f5f919 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:50.130573 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74bde1a1-b1c5-407b-8908-e30655f5f919 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:50.131035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74bde1a1-b1c5-407b-8908-e30655f5f919 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:50.131818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74bde1a1-b1c5-407b-8908-e30655f5f919 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:50.132264 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-74bde1a1-b1c5-407b-8908-e30655f5f919 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:50.269549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-74bde1a1-b1c5-407b-8908-e30655f5f919 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:50.276910 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-74bde1a1-b1c5-407b-8908-e30655f5f919 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1695 microversion: 2.1 time: 0.157873 Feb 19 21:48:50.277493 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3221/6356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:50 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:51.293784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-374ae0cd-1e4e-4534-9d43-210a59ab64d0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:51.294397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-374ae0cd-1e4e-4534-9d43-210a59ab64d0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:51.301128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-374ae0cd-1e4e-4534-9d43-210a59ab64d0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:51.301590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-374ae0cd-1e4e-4534-9d43-210a59ab64d0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:51.302373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-374ae0cd-1e4e-4534-9d43-210a59ab64d0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:51.302816 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-374ae0cd-1e4e-4534-9d43-210a59ab64d0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:51.519361 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-374ae0cd-1e4e-4534-9d43-210a59ab64d0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:51.527240 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-374ae0cd-1e4e-4534-9d43-210a59ab64d0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1694 microversion: 2.1 time: 0.237222 Feb 19 21:48:51.527825 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3136/6357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:51 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:51.691129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-bd437387-a5cd-4cc1-b20c-794c2609a148 req-e0ee162e-8fc9-4fc3-b633-61a125e7ba77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459f7e82-32e2-44b4-9477-eeb5ccaccbca", "name": "network-vif-unplugged", "status": "completed", "tag": "e631e9bd-5480-4b5e-aa9a-895b67fc1acd"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:48:51.692682 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:48:51.692682 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:48:51.703272 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bd437387-a5cd-4cc1-b20c-794c2609a148 req-e0ee162e-8fc9-4fc3-b633-61a125e7ba77 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:51.703554 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-bd437387-a5cd-4cc1-b20c-794c2609a148 req-e0ee162e-8fc9-4fc3-b633-61a125e7ba77 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:51.716203 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-bd437387-a5cd-4cc1-b20c-794c2609a148 req-e0ee162e-8fc9-4fc3-b633-61a125e7ba77 service nova] Creating event network-vif-unplugged:e631e9bd-5480-4b5e-aa9a-895b67fc1acd for instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca on nch2-master-1 Feb 19 21:48:51.722381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [req-bd437387-a5cd-4cc1-b20c-794c2609a148 req-e0ee162e-8fc9-4fc3-b633-61a125e7ba77 service nova] Instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136094) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:48:51.743373 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-bd437387-a5cd-4cc1-b20c-794c2609a148 req-e0ee162e-8fc9-4fc3-b633-61a125e7ba77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113113 Feb 19 21:48:51.743373 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3222/6358] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:48:52.544303 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8d935224-71fd-4f16-bec9-a5c05cb57545 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:52.544987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8d935224-71fd-4f16-bec9-a5c05cb57545 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:52.552571 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d935224-71fd-4f16-bec9-a5c05cb57545 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:52.553032 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d935224-71fd-4f16-bec9-a5c05cb57545 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:52.553832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d935224-71fd-4f16-bec9-a5c05cb57545 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:52.554278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8d935224-71fd-4f16-bec9-a5c05cb57545 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:52.699640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8d935224-71fd-4f16-bec9-a5c05cb57545 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:52.707096 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8d935224-71fd-4f16-bec9-a5c05cb57545 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1694 microversion: 2.1 time: 0.167335 Feb 19 21:48:52.707686 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3137/6359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:52 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:53.725856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fd51fbc6-c233-4d7a-a7c6-42fb16ebe864 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:53.726612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fd51fbc6-c233-4d7a-a7c6-42fb16ebe864 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:53.733754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd51fbc6-c233-4d7a-a7c6-42fb16ebe864 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:53.734219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd51fbc6-c233-4d7a-a7c6-42fb16ebe864 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:53.735009 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd51fbc6-c233-4d7a-a7c6-42fb16ebe864 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:53.735456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fd51fbc6-c233-4d7a-a7c6-42fb16ebe864 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:53.787440 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-02a2e6c1-0af2-46a4-bd57-06289334a47d req-019190e6-dc68-44ba-a16b-9926adf39622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459f7e82-32e2-44b4-9477-eeb5ccaccbca", "tag": "e631e9bd-5480-4b5e-aa9a-895b67fc1acd"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:48:53.788960 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:48:53.788960 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:48:53.797051 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-02a2e6c1-0af2-46a4-bd57-06289334a47d req-019190e6-dc68-44ba-a16b-9926adf39622 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:53.798820 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-02a2e6c1-0af2-46a4-bd57-06289334a47d req-019190e6-dc68-44ba-a16b-9926adf39622 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:53.810722 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-02a2e6c1-0af2-46a4-bd57-06289334a47d req-019190e6-dc68-44ba-a16b-9926adf39622 service nova] Creating event network-changed:e631e9bd-5480-4b5e-aa9a-895b67fc1acd for instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca on nch2-master-1 Feb 19 21:48:53.816146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [req-02a2e6c1-0af2-46a4-bd57-06289334a47d req-019190e6-dc68-44ba-a16b-9926adf39622 service nova] Instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136095) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5731}} Feb 19 21:48:53.827599 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-02a2e6c1-0af2-46a4-bd57-06289334a47d req-019190e6-dc68-44ba-a16b-9926adf39622 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043806 Feb 19 21:48:53.828217 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3138/6360] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:48:53.907613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fd51fbc6-c233-4d7a-a7c6-42fb16ebe864 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:53.915736 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fd51fbc6-c233-4d7a-a7c6-42fb16ebe864 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1692 microversion: 2.1 time: 0.194029 Feb 19 21:48:53.916639 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3223/6361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:53 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1692 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:48:54.934503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-146633dc-33b9-421e-9fbd-800302559a6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:54.935199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-146633dc-33b9-421e-9fbd-800302559a6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:54.943197 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-146633dc-33b9-421e-9fbd-800302559a6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:54.943650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-146633dc-33b9-421e-9fbd-800302559a6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:54.944718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-146633dc-33b9-421e-9fbd-800302559a6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:54.945170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-146633dc-33b9-421e-9fbd-800302559a6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:55.195217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-146633dc-33b9-421e-9fbd-800302559a6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:55.202996 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-146633dc-33b9-421e-9fbd-800302559a6d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1692 microversion: 2.1 time: 0.273443 Feb 19 21:48:55.203585 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3139/6362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:54 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1692 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:56.219994 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-33a7c27d-e64a-4e12-827b-bb09d5410f42 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:56.220669 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-33a7c27d-e64a-4e12-827b-bb09d5410f42 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:56.227363 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33a7c27d-e64a-4e12-827b-bb09d5410f42 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:56.227826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33a7c27d-e64a-4e12-827b-bb09d5410f42 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:56.228677 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33a7c27d-e64a-4e12-827b-bb09d5410f42 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:56.229739 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-33a7c27d-e64a-4e12-827b-bb09d5410f42 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:56.373385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-33a7c27d-e64a-4e12-827b-bb09d5410f42 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:56.381135 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-33a7c27d-e64a-4e12-827b-bb09d5410f42 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1689 microversion: 2.1 time: 0.164719 Feb 19 21:48:56.381820 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3224/6363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:56 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:56.397659 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-53b2c87e-5184-42bc-ac8c-ade91c474b1f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:48:56.398190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-53b2c87e-5184-42bc-ac8c-ade91c474b1f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:56.405373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53b2c87e-5184-42bc-ac8c-ade91c474b1f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:56.405821 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53b2c87e-5184-42bc-ac8c-ade91c474b1f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:56.406592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53b2c87e-5184-42bc-ac8c-ade91c474b1f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:56.407028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-53b2c87e-5184-42bc-ac8c-ade91c474b1f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:56.469436 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-53b2c87e-5184-42bc-ac8c-ade91c474b1f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca/action" status: 204 len: 0 microversion: 2.1 time: 0.075380 Feb 19 21:48:56.470092 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3140/6364] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:48:56 2022] POST /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:48:56.478211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c7fdd992-e814-45f6-bf9c-15aaf01a571d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:56.479373 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c7fdd992-e814-45f6-bf9c-15aaf01a571d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:56.485355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7fdd992-e814-45f6-bf9c-15aaf01a571d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:56.485870 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7fdd992-e814-45f6-bf9c-15aaf01a571d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:56.486733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7fdd992-e814-45f6-bf9c-15aaf01a571d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:56.487259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c7fdd992-e814-45f6-bf9c-15aaf01a571d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:56.642655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c7fdd992-e814-45f6-bf9c-15aaf01a571d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:56.650791 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c7fdd992-e814-45f6-bf9c-15aaf01a571d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1689 microversion: 2.1 time: 0.176214 Feb 19 21:48:56.652057 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3225/6365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:56 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:56.669090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-59b1eaf8-b41e-4c16-8718-a84348ee5f27 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:56.670035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-59b1eaf8-b41e-4c16-8718-a84348ee5f27 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:56.676729 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59b1eaf8-b41e-4c16-8718-a84348ee5f27 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:56.677503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59b1eaf8-b41e-4c16-8718-a84348ee5f27 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:56.678400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59b1eaf8-b41e-4c16-8718-a84348ee5f27 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:56.678950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-59b1eaf8-b41e-4c16-8718-a84348ee5f27 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:56.836746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-59b1eaf8-b41e-4c16-8718-a84348ee5f27 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:56.844965 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-59b1eaf8-b41e-4c16-8718-a84348ee5f27 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1689 microversion: 2.1 time: 0.180574 Feb 19 21:48:56.845668 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3141/6366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:56 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:57.864073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-38bd08ce-cd56-4913-90a2-93120e687f2e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:48:57.865503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-38bd08ce-cd56-4913-90a2-93120e687f2e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:48:57.872923 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38bd08ce-cd56-4913-90a2-93120e687f2e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:57.873392 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38bd08ce-cd56-4913-90a2-93120e687f2e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:57.874189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38bd08ce-cd56-4913-90a2-93120e687f2e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:57.874675 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-38bd08ce-cd56-4913-90a2-93120e687f2e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:58.025462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-38bd08ce-cd56-4913-90a2-93120e687f2e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:48:58.032859 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-38bd08ce-cd56-4913-90a2-93120e687f2e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1681 microversion: 2.1 time: 0.172944 Feb 19 21:48:58.033430 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3226/6367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:48:57 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:48:58.922422 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-08f0a02b-8ec9-438e-a3b8-40d2012ecd9b req-f269f723-d3e4-44ed-83fe-01042c6c6ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459f7e82-32e2-44b4-9477-eeb5ccaccbca", "name": "network-vif-plugged", "status": "completed", "tag": "e631e9bd-5480-4b5e-aa9a-895b67fc1acd"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:48:58.924147 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:48:58.924147 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:48:58.931514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-08f0a02b-8ec9-438e-a3b8-40d2012ecd9b req-f269f723-d3e4-44ed-83fe-01042c6c6ac5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:48:58.932084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-08f0a02b-8ec9-438e-a3b8-40d2012ecd9b req-f269f723-d3e4-44ed-83fe-01042c6c6ac5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:48:58.942727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-08f0a02b-8ec9-438e-a3b8-40d2012ecd9b req-f269f723-d3e4-44ed-83fe-01042c6c6ac5 service nova] Creating event network-vif-plugged:e631e9bd-5480-4b5e-aa9a-895b67fc1acd for instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca on nch2-master-1 Feb 19 21:48:58.948560 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-08f0a02b-8ec9-438e-a3b8-40d2012ecd9b req-f269f723-d3e4-44ed-83fe-01042c6c6ac5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084271 Feb 19 21:48:58.949157 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3142/6368] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:49:28.289680 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4860af8a-a90e-4dbd-94aa-88a1af9e1399 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:49:28.290647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4860af8a-a90e-4dbd-94aa-88a1af9e1399 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:49:28.296698 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4860af8a-a90e-4dbd-94aa-88a1af9e1399 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:28.297169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4860af8a-a90e-4dbd-94aa-88a1af9e1399 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:28.297969 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4860af8a-a90e-4dbd-94aa-88a1af9e1399 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:28.298424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4860af8a-a90e-4dbd-94aa-88a1af9e1399 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:28.351251 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4860af8a-a90e-4dbd-94aa-88a1af9e1399 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca/action" status: 200 len: 24582 microversion: 2.1 time: 0.109863 Feb 19 21:49:28.351867 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3227/6369] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:49:28 2022] POST /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca/action => generated 24582 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:49:45.635701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bac242f9-51a5-4a74-9653-6ad6cb135193 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:49:45.636948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bac242f9-51a5-4a74-9653-6ad6cb135193 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:49:45.643479 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac242f9-51a5-4a74-9653-6ad6cb135193 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:45.644040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac242f9-51a5-4a74-9653-6ad6cb135193 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:45.644931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac242f9-51a5-4a74-9653-6ad6cb135193 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:45.645446 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bac242f9-51a5-4a74-9653-6ad6cb135193 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:45.676179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bac242f9-51a5-4a74-9653-6ad6cb135193 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:49:45.742148 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ae810078-a672-4777-b008-4734d0ddd7a9 req-77b95682-1b1c-45bb-a2d1-335cd5f9fd93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459f7e82-32e2-44b4-9477-eeb5ccaccbca", "tag": "e631e9bd-5480-4b5e-aa9a-895b67fc1acd"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:49:45.743660 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:49:45.743660 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:49:45.754320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ae810078-a672-4777-b008-4734d0ddd7a9 req-77b95682-1b1c-45bb-a2d1-335cd5f9fd93 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:45.755026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ae810078-a672-4777-b008-4734d0ddd7a9 req-77b95682-1b1c-45bb-a2d1-335cd5f9fd93 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:45.768264 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bac242f9-51a5-4a74-9653-6ad6cb135193 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 204 len: 0 microversion: 2.1 time: 0.137566 Feb 19 21:49:45.768995 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3143/6370] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:49:45 2022] DELETE /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:49:45.770014 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ae810078-a672-4777-b008-4734d0ddd7a9 req-77b95682-1b1c-45bb-a2d1-335cd5f9fd93 service nova] Creating event network-changed:e631e9bd-5480-4b5e-aa9a-895b67fc1acd for instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca on nch2-master-1 Feb 19 21:49:45.776984 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ae810078-a672-4777-b008-4734d0ddd7a9 req-77b95682-1b1c-45bb-a2d1-335cd5f9fd93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100623 Feb 19 21:49:45.777888 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3228/6371] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:49:45.781121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d7272334-ddfe-44e7-9154-1f71f0aa8e7b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:49:45.781829 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d7272334-ddfe-44e7-9154-1f71f0aa8e7b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:49:45.788522 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d7272334-ddfe-44e7-9154-1f71f0aa8e7b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:45.788987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d7272334-ddfe-44e7-9154-1f71f0aa8e7b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:45.789791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d7272334-ddfe-44e7-9154-1f71f0aa8e7b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:45.790514 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d7272334-ddfe-44e7-9154-1f71f0aa8e7b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:45.973259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d7272334-ddfe-44e7-9154-1f71f0aa8e7b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:49:45.981189 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d7272334-ddfe-44e7-9154-1f71f0aa8e7b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1687 microversion: 2.1 time: 0.204033 Feb 19 21:49:45.981813 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3144/6372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:49:45 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1687 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:49:47.000792 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9cb50bf9-0f6c-4ce7-a860-be463b77b52e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:49:47.001464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9cb50bf9-0f6c-4ce7-a860-be463b77b52e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:49:47.009734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cb50bf9-0f6c-4ce7-a860-be463b77b52e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:47.010202 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cb50bf9-0f6c-4ce7-a860-be463b77b52e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:47.010990 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cb50bf9-0f6c-4ce7-a860-be463b77b52e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:47.011441 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9cb50bf9-0f6c-4ce7-a860-be463b77b52e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:47.149018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9cb50bf9-0f6c-4ce7-a860-be463b77b52e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:49:47.156895 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9cb50bf9-0f6c-4ce7-a860-be463b77b52e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1569 microversion: 2.1 time: 0.161085 Feb 19 21:49:47.157468 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3229/6373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:49:46 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:49:47.845221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-14d820fe-f5ff-4f06-924e-565cb36ff4dd req-cefdef40-3af3-4bff-8834-5ac41758a14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459f7e82-32e2-44b4-9477-eeb5ccaccbca", "name": "network-vif-deleted", "tag": "e631e9bd-5480-4b5e-aa9a-895b67fc1acd"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:49:47.846927 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:49:47.846927 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:49:47.855098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-14d820fe-f5ff-4f06-924e-565cb36ff4dd req-cefdef40-3af3-4bff-8834-5ac41758a14a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:47.855544 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-14d820fe-f5ff-4f06-924e-565cb36ff4dd req-cefdef40-3af3-4bff-8834-5ac41758a14a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:47.867400 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-14d820fe-f5ff-4f06-924e-565cb36ff4dd req-cefdef40-3af3-4bff-8834-5ac41758a14a service nova] Creating event network-vif-deleted:e631e9bd-5480-4b5e-aa9a-895b67fc1acd for instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca on nch2-master-1 Feb 19 21:49:47.873154 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-14d820fe-f5ff-4f06-924e-565cb36ff4dd req-cefdef40-3af3-4bff-8834-5ac41758a14a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Feb 19 21:49:47.873992 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3145/6374] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:49:48.175444 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:49:48.176083 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:49:48.184212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:48.184709 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:48.185579 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:48.186032 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:48.220558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:48.221021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:48.221865 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lazy-loading 'fault' on Instance uuid 459f7e82-32e2-44b4-9477-eeb5ccaccbca {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:49:48.277186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:49:48.285533 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7ffe9acd-7717-43aa-8851-3bd15a68c7da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 200 len: 1356 microversion: 2.1 time: 0.114001 Feb 19 21:49:48.286493 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3230/6375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:49:48 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 1356 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:49:49.304749 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5ef30abc-f108-4471-b4be-7267655a4a1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:49:49.305439 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5ef30abc-f108-4471-b4be-7267655a4a1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: 459f7e82-32e2-44b4-9477-eeb5ccaccbca] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:49:49.312206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ef30abc-f108-4471-b4be-7267655a4a1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:49.312688 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ef30abc-f108-4471-b4be-7267655a4a1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:49.313460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ef30abc-f108-4471-b4be-7267655a4a1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:49.313898 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ef30abc-f108-4471-b4be-7267655a4a1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:49.327593 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-5ef30abc-f108-4471-b4be-7267655a4a1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] HTTP exception thrown: Instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca could not be found. Feb 19 21:49:49.328181 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5ef30abc-f108-4471-b4be-7267655a4a1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Returning 404 to user: Instance 459f7e82-32e2-44b4-9477-eeb5ccaccbca could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:49:49.329014 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5ef30abc-f108-4471-b4be-7267655a4a1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca" status: 404 len: 111 microversion: 2.1 time: 0.029161 Feb 19 21:49:49.329554 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3146/6376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:49:49 2022] GET /compute/v2.1/servers/459f7e82-32e2-44b4-9477-eeb5ccaccbca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:49:52.389077 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a6fe6a37-ed61-4cfc-88b1-945b801b76d9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '.version_select at 0x7f6467b8baf0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:49:52.411551 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a6fe6a37-ed61-4cfc-88b1-945b801b76d9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-901258666" status: 202 len: 0 microversion: 2.1 time: 0.026792 Feb 19 21:49:52.412663 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3231/6377] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Feb 19 21:49:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-901258666 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:49:52.437942 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-11c96558-aa5c-42c7-84d4-08a0ff2f624a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: .version_select at 0x7f64669c8c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1017452295"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:49:52.455005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-11c96558-aa5c-42c7-84d4-08a0ff2f624a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:49:52.460737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-11c96558-aa5c-42c7-84d4-08a0ff2f624a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:49:52.706329 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-11c96558-aa5c-42c7-84d4-08a0ff2f624a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:49:52.711155 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-11c96558-aa5c-42c7-84d4-08a0ff2f624a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:49:52.725016 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-11c96558-aa5c-42c7-84d4-08a0ff2f624a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.291819 Feb 19 21:49:52.725631 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3147/6378] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:49:52 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:49:58.605460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-970689266", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "4d32c0bd-be4a-496b-9c6f-15ca0a9cb98c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1017452295", "security_groups": [{"name": "tempest-secgroup-smoke-1396626404"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:49:58.720925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] validate_networks() for [('4d32c0bd-be4a-496b-9c6f-15ca0a9cb98c', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:49:59.287485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:49:59.287924 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:49:59.288468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:49:59.289226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:49:59.289820 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:49:59.303819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:59.304547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:59.305589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:49:59.306037 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:49:59.329568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:49:59.335262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:49:59.360165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:49:59.362946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:49:59.415751 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b726bb53-35ee-41d6-a7a2-76d097834d0f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.815651 Feb 19 21:49:59.417743 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3232/6379] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:49:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:49:59.428461 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-edd84777-93aa-4be6-b217-3b2d270c5007 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:49:59.429163 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-edd84777-93aa-4be6-b217-3b2d270c5007 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:49:59.499366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-edd84777-93aa-4be6-b217-3b2d270c5007 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:49:59.508702 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-edd84777-93aa-4be6-b217-3b2d270c5007 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1266 microversion: 2.1 time: 0.084877 Feb 19 21:49:59.519233 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3148/6380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:49:59 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:00.529013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-76777c8d-3a06-430f-b9ad-9dbbefba0641 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:00.529647 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-76777c8d-3a06-430f-b9ad-9dbbefba0641 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:00.551394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76777c8d-3a06-430f-b9ad-9dbbefba0641 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:00.551871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76777c8d-3a06-430f-b9ad-9dbbefba0641 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:00.557742 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76777c8d-3a06-430f-b9ad-9dbbefba0641 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:00.558710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-76777c8d-3a06-430f-b9ad-9dbbefba0641 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:00.659687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-76777c8d-3a06-430f-b9ad-9dbbefba0641 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:00.668697 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-76777c8d-3a06-430f-b9ad-9dbbefba0641 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1326 microversion: 2.1 time: 0.145096 Feb 19 21:50:00.671104 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3233/6381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:00 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:01.687498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4d8eb78a-50ce-4658-8096-9a48a7305a67 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:01.688173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4d8eb78a-50ce-4658-8096-9a48a7305a67 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:01.695881 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d8eb78a-50ce-4658-8096-9a48a7305a67 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:01.696400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d8eb78a-50ce-4658-8096-9a48a7305a67 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:01.697157 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d8eb78a-50ce-4658-8096-9a48a7305a67 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:01.697631 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4d8eb78a-50ce-4658-8096-9a48a7305a67 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:01.851005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4d8eb78a-50ce-4658-8096-9a48a7305a67 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:01.859353 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4d8eb78a-50ce-4658-8096-9a48a7305a67 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1392 microversion: 2.1 time: 0.175435 Feb 19 21:50:01.859884 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3149/6382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:01 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:50:02.044634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9aef4612-136d-4da4-8ad2-1ab4f50886ba req-54856b70-55bc-4769-84cf-f000dca4a4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9432011-b927-4967-b68c-033a1472241e", "tag": "f920e703-56d3-4d22-901c-7e1619431ffc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:50:02.046590 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:50:02.046590 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:50:02.056387 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9aef4612-136d-4da4-8ad2-1ab4f50886ba req-54856b70-55bc-4769-84cf-f000dca4a4cc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:02.057656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9aef4612-136d-4da4-8ad2-1ab4f50886ba req-54856b70-55bc-4769-84cf-f000dca4a4cc service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:02.079031 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9aef4612-136d-4da4-8ad2-1ab4f50886ba req-54856b70-55bc-4769-84cf-f000dca4a4cc service nova] Creating event network-changed:f920e703-56d3-4d22-901c-7e1619431ffc for instance a9432011-b927-4967-b68c-033a1472241e on nch1-master-1 Feb 19 21:50:02.085444 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9aef4612-136d-4da4-8ad2-1ab4f50886ba req-54856b70-55bc-4769-84cf-f000dca4a4cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044428 Feb 19 21:50:02.086440 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3234/6383] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:50:02.876390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a05a84fb-7208-4823-b9c0-751b3ad8c322 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:02.877156 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a05a84fb-7208-4823-b9c0-751b3ad8c322 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:02.884090 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a05a84fb-7208-4823-b9c0-751b3ad8c322 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:02.884590 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a05a84fb-7208-4823-b9c0-751b3ad8c322 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:02.885958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a05a84fb-7208-4823-b9c0-751b3ad8c322 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:02.886409 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a05a84fb-7208-4823-b9c0-751b3ad8c322 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:03.027114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a05a84fb-7208-4823-b9c0-751b3ad8c322 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:03.034503 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a05a84fb-7208-4823-b9c0-751b3ad8c322 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1392 microversion: 2.1 time: 0.161856 Feb 19 21:50:03.035069 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3150/6384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:02 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:04.053323 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-af26bd6c-21f0-4b1a-802e-73abe586f394 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:04.054042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-af26bd6c-21f0-4b1a-802e-73abe586f394 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:04.060039 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af26bd6c-21f0-4b1a-802e-73abe586f394 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:04.060547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af26bd6c-21f0-4b1a-802e-73abe586f394 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:04.061339 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af26bd6c-21f0-4b1a-802e-73abe586f394 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:04.061791 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-af26bd6c-21f0-4b1a-802e-73abe586f394 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:04.202788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-af26bd6c-21f0-4b1a-802e-73abe586f394 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:04.210069 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-af26bd6c-21f0-4b1a-802e-73abe586f394 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1392 microversion: 2.1 time: 0.161673 Feb 19 21:50:04.210648 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3235/6385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:04 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:05.226778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4a60471e-1434-4bb1-8921-83d82fb530e1 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:05.227330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4a60471e-1434-4bb1-8921-83d82fb530e1 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:05.234753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a60471e-1434-4bb1-8921-83d82fb530e1 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:05.235204 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a60471e-1434-4bb1-8921-83d82fb530e1 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:05.235991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a60471e-1434-4bb1-8921-83d82fb530e1 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:05.236448 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4a60471e-1434-4bb1-8921-83d82fb530e1 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:05.375288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4a60471e-1434-4bb1-8921-83d82fb530e1 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:05.382651 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4a60471e-1434-4bb1-8921-83d82fb530e1 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1392 microversion: 2.1 time: 0.159571 Feb 19 21:50:05.383230 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3151/6386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:05 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:06.406961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e0dc1446-2686-4130-96d7-e84a42b3f50c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:06.407533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e0dc1446-2686-4130-96d7-e84a42b3f50c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:06.414187 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0dc1446-2686-4130-96d7-e84a42b3f50c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:06.414652 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0dc1446-2686-4130-96d7-e84a42b3f50c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:06.415452 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0dc1446-2686-4130-96d7-e84a42b3f50c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:06.415901 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e0dc1446-2686-4130-96d7-e84a42b3f50c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:06.552195 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-e0dc1446-2686-4130-96d7-e84a42b3f50c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:06.559580 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e0dc1446-2686-4130-96d7-e84a42b3f50c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1392 microversion: 2.1 time: 0.156516 Feb 19 21:50:06.560174 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3236/6387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:06 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:06.997294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f278fae1-8325-4082-8663-8ad4b2b1cae7 req-b7b3fc34-fc7a-49c2-8721-9d5a5965cbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9432011-b927-4967-b68c-033a1472241e", "name": "network-vif-plugged", "status": "completed", "tag": "f920e703-56d3-4d22-901c-7e1619431ffc"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:50:06.998948 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:50:06.998948 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:50:07.007507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f278fae1-8325-4082-8663-8ad4b2b1cae7 req-b7b3fc34-fc7a-49c2-8721-9d5a5965cbe5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:07.007994 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f278fae1-8325-4082-8663-8ad4b2b1cae7 req-b7b3fc34-fc7a-49c2-8721-9d5a5965cbe5 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:07.019582 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-f278fae1-8325-4082-8663-8ad4b2b1cae7 req-b7b3fc34-fc7a-49c2-8721-9d5a5965cbe5 service nova] Creating event network-vif-plugged:f920e703-56d3-4d22-901c-7e1619431ffc for instance a9432011-b927-4967-b68c-033a1472241e on nch1-master-1 Feb 19 21:50:07.024721 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f278fae1-8325-4082-8663-8ad4b2b1cae7 req-b7b3fc34-fc7a-49c2-8721-9d5a5965cbe5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031012 Feb 19 21:50:07.026248 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3152/6388] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:50:07.576987 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2a62308c-ea7a-4315-ad98-4a11d1945f81 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:07.577610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2a62308c-ea7a-4315-ad98-4a11d1945f81 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:07.584656 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a62308c-ea7a-4315-ad98-4a11d1945f81 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:07.585126 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a62308c-ea7a-4315-ad98-4a11d1945f81 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:07.585979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a62308c-ea7a-4315-ad98-4a11d1945f81 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:07.586413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2a62308c-ea7a-4315-ad98-4a11d1945f81 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:07.723246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2a62308c-ea7a-4315-ad98-4a11d1945f81 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:07.731865 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2a62308c-ea7a-4315-ad98-4a11d1945f81 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1392 microversion: 2.1 time: 0.159133 Feb 19 21:50:07.739275 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3237/6389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:07 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:08.750396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-233396a5-48c3-41f7-8ffb-0faf318f4804 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:08.751129 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-233396a5-48c3-41f7-8ffb-0faf318f4804 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:08.757546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-233396a5-48c3-41f7-8ffb-0faf318f4804 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:08.758006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-233396a5-48c3-41f7-8ffb-0faf318f4804 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:08.758787 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-233396a5-48c3-41f7-8ffb-0faf318f4804 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:08.759233 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-233396a5-48c3-41f7-8ffb-0faf318f4804 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:08.900177 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-233396a5-48c3-41f7-8ffb-0faf318f4804 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:08.907796 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-233396a5-48c3-41f7-8ffb-0faf318f4804 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1563 microversion: 2.1 time: 0.162287 Feb 19 21:50:08.908429 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3153/6390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:08 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:08.923665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0d606469-0ded-4449-86a1-54ea8efc8e9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:08.924292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0d606469-0ded-4449-86a1-54ea8efc8e9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:08.930963 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d606469-0ded-4449-86a1-54ea8efc8e9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:08.931958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d606469-0ded-4449-86a1-54ea8efc8e9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:08.932773 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d606469-0ded-4449-86a1-54ea8efc8e9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:08.933231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0d606469-0ded-4449-86a1-54ea8efc8e9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:09.068480 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-0d606469-0ded-4449-86a1-54ea8efc8e9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:09.076665 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0d606469-0ded-4449-86a1-54ea8efc8e9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1563 microversion: 2.1 time: 0.156716 Feb 19 21:50:09.077244 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3238/6391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:08 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:11.017418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e1236487-218b-4995-8e07-d8c97c9f9aa3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:11.018044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e1236487-218b-4995-8e07-d8c97c9f9aa3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:11.022171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e4fe4c72-77ba-4157-9063-700de04b81b4 req-a09772b9-6ae8-4889-9a2b-72c3d755ced9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9432011-b927-4967-b68c-033a1472241e", "tag": "f920e703-56d3-4d22-901c-7e1619431ffc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:50:11.024454 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:50:11.024454 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:50:11.024857 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1236487-218b-4995-8e07-d8c97c9f9aa3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:11.025802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1236487-218b-4995-8e07-d8c97c9f9aa3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:11.026701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1236487-218b-4995-8e07-d8c97c9f9aa3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:11.027142 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e1236487-218b-4995-8e07-d8c97c9f9aa3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:11.033265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e4fe4c72-77ba-4157-9063-700de04b81b4 req-a09772b9-6ae8-4889-9a2b-72c3d755ced9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:11.033729 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e4fe4c72-77ba-4157-9063-700de04b81b4 req-a09772b9-6ae8-4889-9a2b-72c3d755ced9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:11.046791 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e4fe4c72-77ba-4157-9063-700de04b81b4 req-a09772b9-6ae8-4889-9a2b-72c3d755ced9 service nova] Creating event network-changed:f920e703-56d3-4d22-901c-7e1619431ffc for instance a9432011-b927-4967-b68c-033a1472241e on nch1-master-1 Feb 19 21:50:11.052311 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e4fe4c72-77ba-4157-9063-700de04b81b4 req-a09772b9-6ae8-4889-9a2b-72c3d755ced9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033648 Feb 19 21:50:11.056432 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3239/6392] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:50:11.168269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e1236487-218b-4995-8e07-d8c97c9f9aa3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:11.176641 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e1236487-218b-4995-8e07-d8c97c9f9aa3 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1563 microversion: 2.1 time: 0.163139 Feb 19 21:50:11.178015 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3154/6393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:11 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:20.629639 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:50:20.630298 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 21:50:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:50:32.424162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-596f5abd-258b-43c4-9cee-b1563511a858 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:50:32.425256 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-596f5abd-258b-43c4-9cee-b1563511a858 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:32.431577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-596f5abd-258b-43c4-9cee-b1563511a858 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:32.432558 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-596f5abd-258b-43c4-9cee-b1563511a858 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:32.433355 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-596f5abd-258b-43c4-9cee-b1563511a858 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:32.433815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-596f5abd-258b-43c4-9cee-b1563511a858 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:32.482922 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-596f5abd-258b-43c4-9cee-b1563511a858 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action" status: 200 len: 24566 microversion: 2.1 time: 0.063730 Feb 19 21:50:32.483564 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3240/6394] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:50:32 2022] POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action => generated 24566 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:50:43.546947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-da270d77-1883-4ff0-b1f6-ac0d4301f85e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:50:43.553134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da270d77-1883-4ff0-b1f6-ac0d4301f85e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:43.553585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-da270d77-1883-4ff0-b1f6-ac0d4301f85e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:43.575370 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-da270d77-1883-4ff0-b1f6-ac0d4301f85e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Going to try to stop instance {{(pid=136095) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 19 21:50:43.616802 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-da270d77-1883-4ff0-b1f6-ac0d4301f85e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action" status: 202 len: 0 microversion: 2.1 time: 0.073497 Feb 19 21:50:43.617447 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3155/6395] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:50:43 2022] POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:50:43.626296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7aabd934-83e7-4ee0-89a0-19d47169f70e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:43.627018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7aabd934-83e7-4ee0-89a0-19d47169f70e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:43.637510 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aabd934-83e7-4ee0-89a0-19d47169f70e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:43.638002 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aabd934-83e7-4ee0-89a0-19d47169f70e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:43.638797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aabd934-83e7-4ee0-89a0-19d47169f70e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:43.639273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7aabd934-83e7-4ee0-89a0-19d47169f70e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:43.788320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7aabd934-83e7-4ee0-89a0-19d47169f70e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:43.796124 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7aabd934-83e7-4ee0-89a0-19d47169f70e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.173926 Feb 19 21:50:43.796738 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3241/6396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:43 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:44.814859 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dcda91f1-cce7-4ed0-b54b-00d382e5d437 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:44.816164 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dcda91f1-cce7-4ed0-b54b-00d382e5d437 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:44.824746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcda91f1-cce7-4ed0-b54b-00d382e5d437 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:44.825206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcda91f1-cce7-4ed0-b54b-00d382e5d437 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:44.825997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcda91f1-cce7-4ed0-b54b-00d382e5d437 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:44.826441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dcda91f1-cce7-4ed0-b54b-00d382e5d437 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:44.964839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dcda91f1-cce7-4ed0-b54b-00d382e5d437 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:44.972838 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dcda91f1-cce7-4ed0-b54b-00d382e5d437 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.162827 Feb 19 21:50:44.973414 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3156/6397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:44 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:45.990276 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a2b4d40-879c-463f-8689-dd32cfc4270a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:45.990823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a2b4d40-879c-463f-8689-dd32cfc4270a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:45.998285 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a2b4d40-879c-463f-8689-dd32cfc4270a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:45.998748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a2b4d40-879c-463f-8689-dd32cfc4270a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:45.999526 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a2b4d40-879c-463f-8689-dd32cfc4270a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:45.999971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a2b4d40-879c-463f-8689-dd32cfc4270a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:46.132670 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a2b4d40-879c-463f-8689-dd32cfc4270a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:46.140583 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a2b4d40-879c-463f-8689-dd32cfc4270a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.154045 Feb 19 21:50:46.141154 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3242/6398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:45 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:47.157188 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-373d0400-957d-487e-bccd-43bf6d4e8d7a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:47.157805 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-373d0400-957d-487e-bccd-43bf6d4e8d7a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:47.164843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-373d0400-957d-487e-bccd-43bf6d4e8d7a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:47.165300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-373d0400-957d-487e-bccd-43bf6d4e8d7a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:47.166698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-373d0400-957d-487e-bccd-43bf6d4e8d7a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:47.167145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-373d0400-957d-487e-bccd-43bf6d4e8d7a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:47.304606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-373d0400-957d-487e-bccd-43bf6d4e8d7a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:47.311935 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-373d0400-957d-487e-bccd-43bf6d4e8d7a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.158387 Feb 19 21:50:47.312537 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3157/6399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:47 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:48.329575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-37b05a29-3ac5-4522-acc0-2a138fa889c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:48.330198 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-37b05a29-3ac5-4522-acc0-2a138fa889c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:48.336930 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37b05a29-3ac5-4522-acc0-2a138fa889c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:48.337393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37b05a29-3ac5-4522-acc0-2a138fa889c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:48.338183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37b05a29-3ac5-4522-acc0-2a138fa889c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:48.338635 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-37b05a29-3ac5-4522-acc0-2a138fa889c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:48.472570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-37b05a29-3ac5-4522-acc0-2a138fa889c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:48.480701 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-37b05a29-3ac5-4522-acc0-2a138fa889c7 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.155086 Feb 19 21:50:48.481291 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3243/6400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:48 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:49.497803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-157020a8-6cd9-4189-8b0b-c4ece71d3f93 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:49.498495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-157020a8-6cd9-4189-8b0b-c4ece71d3f93 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:49.505368 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-157020a8-6cd9-4189-8b0b-c4ece71d3f93 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:49.505810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-157020a8-6cd9-4189-8b0b-c4ece71d3f93 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:49.506576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-157020a8-6cd9-4189-8b0b-c4ece71d3f93 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:49.507006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-157020a8-6cd9-4189-8b0b-c4ece71d3f93 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:49.664109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-157020a8-6cd9-4189-8b0b-c4ece71d3f93 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:49.672276 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-157020a8-6cd9-4189-8b0b-c4ece71d3f93 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.178453 Feb 19 21:50:49.672883 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3158/6401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:49 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:50.688788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c797158a-8dba-4bdd-81f9-f17c6c3ccc1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:50.689394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c797158a-8dba-4bdd-81f9-f17c6c3ccc1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:50.697523 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c797158a-8dba-4bdd-81f9-f17c6c3ccc1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:50.698004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c797158a-8dba-4bdd-81f9-f17c6c3ccc1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:50.698813 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c797158a-8dba-4bdd-81f9-f17c6c3ccc1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:50.699269 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c797158a-8dba-4bdd-81f9-f17c6c3ccc1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:50.839191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c797158a-8dba-4bdd-81f9-f17c6c3ccc1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:50.846611 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c797158a-8dba-4bdd-81f9-f17c6c3ccc1e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.161475 Feb 19 21:50:50.847186 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3244/6402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:50 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:51.863506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2831b094-a0a0-47ae-ba40-91e4c861de9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:51.864113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2831b094-a0a0-47ae-ba40-91e4c861de9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:51.871307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2831b094-a0a0-47ae-ba40-91e4c861de9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:51.871760 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2831b094-a0a0-47ae-ba40-91e4c861de9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:51.872597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2831b094-a0a0-47ae-ba40-91e4c861de9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:51.873107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2831b094-a0a0-47ae-ba40-91e4c861de9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:52.010172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2831b094-a0a0-47ae-ba40-91e4c861de9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:52.017828 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2831b094-a0a0-47ae-ba40-91e4c861de9a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.157975 Feb 19 21:50:52.018519 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3159/6403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:51 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:53.034815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a39803d9-c55d-45a9-ad71-68aa2e79cd16 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:53.035436 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-a39803d9-c55d-45a9-ad71-68aa2e79cd16 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:53.042999 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a39803d9-c55d-45a9-ad71-68aa2e79cd16 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:53.043462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a39803d9-c55d-45a9-ad71-68aa2e79cd16 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:53.044252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a39803d9-c55d-45a9-ad71-68aa2e79cd16 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:53.044743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-a39803d9-c55d-45a9-ad71-68aa2e79cd16 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:53.183834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-a39803d9-c55d-45a9-ad71-68aa2e79cd16 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:53.191170 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a39803d9-c55d-45a9-ad71-68aa2e79cd16 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.160133 Feb 19 21:50:53.191753 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3245/6404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:53 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:50:54.208275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f65ea94-6ade-4c39-81dc-b2dd5285884b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:54.208943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f65ea94-6ade-4c39-81dc-b2dd5285884b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:54.215644 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f65ea94-6ade-4c39-81dc-b2dd5285884b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:54.216092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f65ea94-6ade-4c39-81dc-b2dd5285884b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:54.216893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f65ea94-6ade-4c39-81dc-b2dd5285884b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:54.217679 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f65ea94-6ade-4c39-81dc-b2dd5285884b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:54.352650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f65ea94-6ade-4c39-81dc-b2dd5285884b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:54.360842 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f65ea94-6ade-4c39-81dc-b2dd5285884b tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.156258 Feb 19 21:50:54.361423 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3160/6405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:54 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:55.378385 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-69fa30d1-1df4-498d-ae34-1ff697c68b6c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:55.379029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-69fa30d1-1df4-498d-ae34-1ff697c68b6c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:55.385846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69fa30d1-1df4-498d-ae34-1ff697c68b6c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:55.386311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69fa30d1-1df4-498d-ae34-1ff697c68b6c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:55.387103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69fa30d1-1df4-498d-ae34-1ff697c68b6c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:55.387549 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-69fa30d1-1df4-498d-ae34-1ff697c68b6c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:55.525995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-69fa30d1-1df4-498d-ae34-1ff697c68b6c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:55.534204 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-69fa30d1-1df4-498d-ae34-1ff697c68b6c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.159522 Feb 19 21:50:55.534778 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3246/6406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:55 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:56.551539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b33d6252-c111-4464-9991-2bfa02364908 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:56.552138 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b33d6252-c111-4464-9991-2bfa02364908 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:56.560041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b33d6252-c111-4464-9991-2bfa02364908 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:56.560526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b33d6252-c111-4464-9991-2bfa02364908 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:56.561347 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b33d6252-c111-4464-9991-2bfa02364908 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:56.562397 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b33d6252-c111-4464-9991-2bfa02364908 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:56.699666 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b33d6252-c111-4464-9991-2bfa02364908 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:56.707151 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b33d6252-c111-4464-9991-2bfa02364908 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.159409 Feb 19 21:50:56.707719 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3161/6407] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:56 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:57.726518 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9877e3e5-e7df-4a99-8f01-5c7d61e0cdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:57.727153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9877e3e5-e7df-4a99-8f01-5c7d61e0cdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:57.734543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9877e3e5-e7df-4a99-8f01-5c7d61e0cdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:57.735011 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9877e3e5-e7df-4a99-8f01-5c7d61e0cdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:57.735984 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9877e3e5-e7df-4a99-8f01-5c7d61e0cdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:57.736634 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9877e3e5-e7df-4a99-8f01-5c7d61e0cdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:57.877818 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9877e3e5-e7df-4a99-8f01-5c7d61e0cdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:57.885167 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9877e3e5-e7df-4a99-8f01-5c7d61e0cdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1692 microversion: 2.1 time: 0.162458 Feb 19 21:50:57.886275 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3247/6408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:57 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:50:58.903614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3c79721d-4544-405f-8998-70df56f54b5a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:50:58.904398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3c79721d-4544-405f-8998-70df56f54b5a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:50:58.912161 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c79721d-4544-405f-8998-70df56f54b5a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:58.912858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c79721d-4544-405f-8998-70df56f54b5a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:58.913845 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c79721d-4544-405f-8998-70df56f54b5a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:50:58.914308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3c79721d-4544-405f-8998-70df56f54b5a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:50:59.060263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3c79721d-4544-405f-8998-70df56f54b5a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:50:59.067721 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3c79721d-4544-405f-8998-70df56f54b5a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1669 microversion: 2.1 time: 0.168816 Feb 19 21:50:59.068346 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3162/6409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:50:58 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:00.158023 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fda4f68c-c3f6-4e39-9a7d-3faf64f9fdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:00.158957 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fda4f68c-c3f6-4e39-9a7d-3faf64f9fdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:00.165874 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fda4f68c-c3f6-4e39-9a7d-3faf64f9fdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:00.166345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fda4f68c-c3f6-4e39-9a7d-3faf64f9fdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:00.167485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fda4f68c-c3f6-4e39-9a7d-3faf64f9fdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:00.167941 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fda4f68c-c3f6-4e39-9a7d-3faf64f9fdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:00.218789 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fda4f68c-c3f6-4e39-9a7d-3faf64f9fdb2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action" status: 200 len: 38339 microversion: 2.1 time: 0.064379 Feb 19 21:51:00.219462 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3248/6410] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:51:00 2022] POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action => generated 38339 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:51:00.230496 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ef35caa8-fab5-45ef-831f-a75c58d64521 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:00.237326 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef35caa8-fab5-45ef-831f-a75c58d64521 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:00.237779 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef35caa8-fab5-45ef-831f-a75c58d64521 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:00.259150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ef35caa8-fab5-45ef-831f-a75c58d64521 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Going to try to start instance {{(pid=136095) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 19 21:51:00.300341 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ef35caa8-fab5-45ef-831f-a75c58d64521 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action" status: 202 len: 0 microversion: 2.1 time: 0.073367 Feb 19 21:51:00.300974 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3163/6411] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:51:00 2022] POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:51:00.309819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1b0de783-b947-4d55-8fc5-9e817fb4ab44 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:00.310546 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1b0de783-b947-4d55-8fc5-9e817fb4ab44 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:00.317800 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b0de783-b947-4d55-8fc5-9e817fb4ab44 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:00.318288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b0de783-b947-4d55-8fc5-9e817fb4ab44 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:00.319165 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b0de783-b947-4d55-8fc5-9e817fb4ab44 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:00.319622 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1b0de783-b947-4d55-8fc5-9e817fb4ab44 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:00.465648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1b0de783-b947-4d55-8fc5-9e817fb4ab44 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:00.473390 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1b0de783-b947-4d55-8fc5-9e817fb4ab44 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1678 microversion: 2.1 time: 0.167628 Feb 19 21:51:00.473952 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3249/6412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:00 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:51:01.491251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a18061b3-0df6-402d-b98c-4e0a998ed121 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:01.491987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a18061b3-0df6-402d-b98c-4e0a998ed121 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:01.498066 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a18061b3-0df6-402d-b98c-4e0a998ed121 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:01.498519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a18061b3-0df6-402d-b98c-4e0a998ed121 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:01.499294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a18061b3-0df6-402d-b98c-4e0a998ed121 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:01.499736 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a18061b3-0df6-402d-b98c-4e0a998ed121 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:01.636971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a18061b3-0df6-402d-b98c-4e0a998ed121 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:01.644292 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a18061b3-0df6-402d-b98c-4e0a998ed121 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1682 microversion: 2.1 time: 0.157996 Feb 19 21:51:01.644896 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3164/6413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:01 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:25.831605 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-581411c0-a681-4fbb-ae70-c8ad413d7670 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:25.832560 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-581411c0-a681-4fbb-ae70-c8ad413d7670 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:25.839027 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-581411c0-a681-4fbb-ae70-c8ad413d7670 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:25.839483 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-581411c0-a681-4fbb-ae70-c8ad413d7670 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:25.841067 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-581411c0-a681-4fbb-ae70-c8ad413d7670 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:25.841649 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-581411c0-a681-4fbb-ae70-c8ad413d7670 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:25.897133 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-581411c0-a681-4fbb-ae70-c8ad413d7670 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action" status: 200 len: 62897 microversion: 2.1 time: 0.068690 Feb 19 21:51:25.898370 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3250/6414] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:51:25 2022] POST /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e/action => generated 62897 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:51:33.002288 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-55d0a770-c332-4eea-bede-5720e9ccf7f6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:33.002850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-55d0a770-c332-4eea-bede-5720e9ccf7f6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:33.006779 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-e0a5e6e5-9078-4fbb-8bb7-e9bb2af8f659 req-0c0e2747-0c07-40e6-a204-e765ba3200c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9432011-b927-4967-b68c-033a1472241e", "tag": "f920e703-56d3-4d22-901c-7e1619431ffc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:33.008488 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:51:33.008488 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:51:33.009307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55d0a770-c332-4eea-bede-5720e9ccf7f6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:33.009765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55d0a770-c332-4eea-bede-5720e9ccf7f6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:33.010559 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55d0a770-c332-4eea-bede-5720e9ccf7f6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:33.011198 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-55d0a770-c332-4eea-bede-5720e9ccf7f6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:33.018242 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e0a5e6e5-9078-4fbb-8bb7-e9bb2af8f659 req-0c0e2747-0c07-40e6-a204-e765ba3200c0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:33.018788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-e0a5e6e5-9078-4fbb-8bb7-e9bb2af8f659 req-0c0e2747-0c07-40e6-a204-e765ba3200c0 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:33.030732 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-e0a5e6e5-9078-4fbb-8bb7-e9bb2af8f659 req-0c0e2747-0c07-40e6-a204-e765ba3200c0 service nova] Creating event network-changed:f920e703-56d3-4d22-901c-7e1619431ffc for instance a9432011-b927-4967-b68c-033a1472241e on nch1-master-1 Feb 19 21:51:33.035862 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-e0a5e6e5-9078-4fbb-8bb7-e9bb2af8f659 req-0c0e2747-0c07-40e6-a204-e765ba3200c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033587 Feb 19 21:51:33.036800 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3251/6415] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:51:33.038035 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-55d0a770-c332-4eea-bede-5720e9ccf7f6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:51:33.126480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-55d0a770-c332-4eea-bede-5720e9ccf7f6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 204 len: 0 microversion: 2.1 time: 0.127530 Feb 19 21:51:33.127089 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3165/6416] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:51:32 2022] DELETE /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:51:33.136247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4573569d-00d8-4846-8f10-bbf627c64513 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:33.137099 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4573569d-00d8-4846-8f10-bbf627c64513 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:33.143797 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4573569d-00d8-4846-8f10-bbf627c64513 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:33.144380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4573569d-00d8-4846-8f10-bbf627c64513 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:33.145463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4573569d-00d8-4846-8f10-bbf627c64513 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:33.145977 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4573569d-00d8-4846-8f10-bbf627c64513 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:33.295328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4573569d-00d8-4846-8f10-bbf627c64513 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:33.303163 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4573569d-00d8-4846-8f10-bbf627c64513 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1688 microversion: 2.1 time: 0.171503 Feb 19 21:51:33.303963 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3252/6417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:33 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:51:34.321538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-06cfd6ac-ebae-478e-84ac-d5ec71f75fe2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:34.322231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-06cfd6ac-ebae-478e-84ac-d5ec71f75fe2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:34.329259 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06cfd6ac-ebae-478e-84ac-d5ec71f75fe2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:34.329711 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06cfd6ac-ebae-478e-84ac-d5ec71f75fe2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:34.330505 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06cfd6ac-ebae-478e-84ac-d5ec71f75fe2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:34.330947 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-06cfd6ac-ebae-478e-84ac-d5ec71f75fe2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:34.483507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-06cfd6ac-ebae-478e-84ac-d5ec71f75fe2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:34.490877 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-06cfd6ac-ebae-478e-84ac-d5ec71f75fe2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1569 microversion: 2.1 time: 0.173762 Feb 19 21:51:34.491458 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3166/6418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:34 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:35.247212 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-c30f3f78-c62b-441a-9006-aebe895546e9 req-49e28fbd-f26a-4926-98e4-c3d95ea266fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9432011-b927-4967-b68c-033a1472241e", "name": "network-vif-deleted", "tag": "f920e703-56d3-4d22-901c-7e1619431ffc"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:35.249187 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:51:35.249187 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:51:35.259534 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c30f3f78-c62b-441a-9006-aebe895546e9 req-49e28fbd-f26a-4926-98e4-c3d95ea266fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:35.260095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-c30f3f78-c62b-441a-9006-aebe895546e9 req-49e28fbd-f26a-4926-98e4-c3d95ea266fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:35.274202 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-c30f3f78-c62b-441a-9006-aebe895546e9 req-49e28fbd-f26a-4926-98e4-c3d95ea266fe service nova] Creating event network-vif-deleted:f920e703-56d3-4d22-901c-7e1619431ffc for instance a9432011-b927-4967-b68c-033a1472241e on nch1-master-1 Feb 19 21:51:35.279934 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-c30f3f78-c62b-441a-9006-aebe895546e9 req-49e28fbd-f26a-4926-98e4-c3d95ea266fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036932 Feb 19 21:51:35.280575 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3253/6419] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:51:35.507836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:35.508521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:35.515223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:35.515684 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:35.516512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:35.516957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:35.551234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:35.551691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:35.552154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lazy-loading 'fault' on Instance uuid a9432011-b927-4967-b68c-033a1472241e {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:51:35.602849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:35.612279 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8fbfcc2a-69de-4e2c-ba92-a5242fab0759 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 200 len: 1356 microversion: 2.1 time: 0.107566 Feb 19 21:51:35.613371 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3167/6420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:35 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:36.633581 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0dd04463-bd51-44fe-8609-e97e94bfa77f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:36.634289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-0dd04463-bd51-44fe-8609-e97e94bfa77f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: a9432011-b927-4967-b68c-033a1472241e] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:36.647970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dd04463-bd51-44fe-8609-e97e94bfa77f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:36.648856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dd04463-bd51-44fe-8609-e97e94bfa77f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:36.650423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dd04463-bd51-44fe-8609-e97e94bfa77f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:36.651043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-0dd04463-bd51-44fe-8609-e97e94bfa77f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:36.666771 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-0dd04463-bd51-44fe-8609-e97e94bfa77f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] HTTP exception thrown: Instance a9432011-b927-4967-b68c-033a1472241e could not be found. Feb 19 21:51:36.667571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-0dd04463-bd51-44fe-8609-e97e94bfa77f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Returning 404 to user: Instance a9432011-b927-4967-b68c-033a1472241e could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:51:36.668468 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-0dd04463-bd51-44fe-8609-e97e94bfa77f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e" status: 404 len: 111 microversion: 2.1 time: 0.041027 Feb 19 21:51:36.669035 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3254/6421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:36 2022] GET /compute/v2.1/servers/a9432011-b927-4967-b68c-033a1472241e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:51:39.697382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-becf8395-283c-4adf-8f52-3685b229eb90 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '.version_select at 0x7f6466962e50>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:39.721555 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-becf8395-283c-4adf-8f52-3685b229eb90 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1017452295" status: 202 len: 0 microversion: 2.1 time: 0.028372 Feb 19 21:51:39.722604 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3168/6422] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Feb 19 21:51:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1017452295 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:51:39.749254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d96e4b4e-cc3c-498a-bf2e-b640c6e7ec74 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: .version_select at 0x7f6467c66c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1826991085"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:39.766380 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d96e4b4e-cc3c-498a-bf2e-b640c6e7ec74 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:51:39.772311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d96e4b4e-cc3c-498a-bf2e-b640c6e7ec74 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:51:40.030283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d96e4b4e-cc3c-498a-bf2e-b640c6e7ec74 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:51:40.034875 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-d96e4b4e-cc3c-498a-bf2e-b640c6e7ec74 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:51:40.050188 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d96e4b4e-cc3c-498a-bf2e-b640c6e7ec74 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.305048 Feb 19 21:51:40.050785 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3255/6423] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:51:39 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:45.536696 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1058398133", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "networks": [{"uuid": "5e8bc60b-8386-40b9-99e3-5678980c6cb6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1826991085", "security_groups": [{"name": "tempest-secgroup-smoke-1159923042"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:45.663662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] validate_networks() for [('5e8bc60b-8386-40b9-99e3-5678980c6cb6', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:51:46.504000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:51:46.504884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:51:46.505591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:51:46.506116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:51:46.506675 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:51:46.516183 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:46.516888 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:46.517850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:46.518364 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:46.537830 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:51:46.543190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Getting quotas for user d4322cc0fa954031bbf07e95c5cf1fb7 and project 0b842c60e89342ae92bbc9f9b568e4c2. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:51:46.555971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:51:46.558956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:51:46.607938 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-26ebfb6c-c2fd-4e69-a539-8c9d8eabbeaf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.074954 Feb 19 21:51:46.613575 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3169/6424] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:51:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:51:46.620021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d3922e53-7475-4eba-8314-9e5add342f61 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:46.621230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d3922e53-7475-4eba-8314-9e5add342f61 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:46.685609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d3922e53-7475-4eba-8314-9e5add342f61 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:46.692821 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d3922e53-7475-4eba-8314-9e5add342f61 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1267 microversion: 2.1 time: 0.077441 Feb 19 21:51:46.693738 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3256/6425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:46 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:47.714221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-4152963a-2d18-4e66-a12f-e4db4d64625e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:47.716509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-4152963a-2d18-4e66-a12f-e4db4d64625e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:47.728508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4152963a-2d18-4e66-a12f-e4db4d64625e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:47.729773 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4152963a-2d18-4e66-a12f-e4db4d64625e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:47.731159 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4152963a-2d18-4e66-a12f-e4db4d64625e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:47.742977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-4152963a-2d18-4e66-a12f-e4db4d64625e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:47.852839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-4152963a-2d18-4e66-a12f-e4db4d64625e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:47.862809 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-4152963a-2d18-4e66-a12f-e4db4d64625e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1337 microversion: 2.1 time: 0.153306 Feb 19 21:51:47.863686 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3170/6426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:47 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1337 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:48.880967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4cc0345e-6d0b-4f4d-82e2-5e882c88f988 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:48.882058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4cc0345e-6d0b-4f4d-82e2-5e882c88f988 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:48.890697 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc0345e-6d0b-4f4d-82e2-5e882c88f988 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:48.891180 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc0345e-6d0b-4f4d-82e2-5e882c88f988 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:48.892393 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc0345e-6d0b-4f4d-82e2-5e882c88f988 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:48.892869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4cc0345e-6d0b-4f4d-82e2-5e882c88f988 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:49.158073 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4cc0345e-6d0b-4f4d-82e2-5e882c88f988 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:49.166084 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4cc0345e-6d0b-4f4d-82e2-5e882c88f988 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1393 microversion: 2.1 time: 0.288745 Feb 19 21:51:49.166741 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3257/6427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:48 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1393 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:49.286445 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-d491996a-5228-4d3f-b47e-eb1869726e5c req-b7630554-646a-42e2-a3a8-20f89901c9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd38defa-6621-45d4-b115-88cb988aa535", "tag": "94b0283e-94f3-4b0b-a566-2a2990c4dd74"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:49.288058 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:51:49.288058 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:51:49.306712 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d491996a-5228-4d3f-b47e-eb1869726e5c req-b7630554-646a-42e2-a3a8-20f89901c9a2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:49.312261 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-d491996a-5228-4d3f-b47e-eb1869726e5c req-b7630554-646a-42e2-a3a8-20f89901c9a2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:49.329212 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-d491996a-5228-4d3f-b47e-eb1869726e5c req-b7630554-646a-42e2-a3a8-20f89901c9a2 service nova] Creating event network-changed:94b0283e-94f3-4b0b-a566-2a2990c4dd74 for instance bd38defa-6621-45d4-b115-88cb988aa535 on nch2-master-1 Feb 19 21:51:49.334600 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-d491996a-5228-4d3f-b47e-eb1869726e5c req-b7630554-646a-42e2-a3a8-20f89901c9a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052536 Feb 19 21:51:49.335092 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3171/6428] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:51:50.183397 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b1d86026-7b0b-4e36-9141-37f2b5aea509 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:50.184036 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b1d86026-7b0b-4e36-9141-37f2b5aea509 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:50.190826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1d86026-7b0b-4e36-9141-37f2b5aea509 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:50.191288 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1d86026-7b0b-4e36-9141-37f2b5aea509 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:50.192100 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1d86026-7b0b-4e36-9141-37f2b5aea509 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:50.192611 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b1d86026-7b0b-4e36-9141-37f2b5aea509 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:50.351869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b1d86026-7b0b-4e36-9141-37f2b5aea509 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:50.359721 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b1d86026-7b0b-4e36-9141-37f2b5aea509 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1393 microversion: 2.1 time: 0.180518 Feb 19 21:51:50.360311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3258/6429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:50 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:51:51.377609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-084e0e78-6a18-4214-b966-23e05549091d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:51.378308 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-084e0e78-6a18-4214-b966-23e05549091d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:51.384430 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-084e0e78-6a18-4214-b966-23e05549091d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:51.384886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-084e0e78-6a18-4214-b966-23e05549091d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:51.386230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-084e0e78-6a18-4214-b966-23e05549091d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:51.386635 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-084e0e78-6a18-4214-b966-23e05549091d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:51.520057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-084e0e78-6a18-4214-b966-23e05549091d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:51.527836 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-084e0e78-6a18-4214-b966-23e05549091d tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1393 microversion: 2.1 time: 0.154903 Feb 19 21:51:51.528602 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3172/6430] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:51 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:52.544788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2548a4e3-535a-4182-ab26-ca022edbe897 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:52.545418 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2548a4e3-535a-4182-ab26-ca022edbe897 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:52.552440 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2548a4e3-535a-4182-ab26-ca022edbe897 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:52.552916 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2548a4e3-535a-4182-ab26-ca022edbe897 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:52.553737 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2548a4e3-535a-4182-ab26-ca022edbe897 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:52.554191 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2548a4e3-535a-4182-ab26-ca022edbe897 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:52.698770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2548a4e3-535a-4182-ab26-ca022edbe897 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:52.705127 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2548a4e3-535a-4182-ab26-ca022edbe897 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1393 microversion: 2.1 time: 0.164004 Feb 19 21:51:52.705725 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3259/6431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:52 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:53.722150 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b6417061-dd71-4d39-8aba-06904076aa0c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:53.722759 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b6417061-dd71-4d39-8aba-06904076aa0c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:53.730476 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6417061-dd71-4d39-8aba-06904076aa0c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:53.730928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6417061-dd71-4d39-8aba-06904076aa0c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:53.731735 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6417061-dd71-4d39-8aba-06904076aa0c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:53.732173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b6417061-dd71-4d39-8aba-06904076aa0c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:53.882742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b6417061-dd71-4d39-8aba-06904076aa0c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:53.891389 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b6417061-dd71-4d39-8aba-06904076aa0c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1393 microversion: 2.1 time: 0.173085 Feb 19 21:51:53.892011 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3173/6432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:53 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:54.908550 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5010286b-dc62-4ac4-afea-a93987f443aa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:54.909173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5010286b-dc62-4ac4-afea-a93987f443aa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:54.916103 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5010286b-dc62-4ac4-afea-a93987f443aa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:54.916604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5010286b-dc62-4ac4-afea-a93987f443aa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:54.917417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5010286b-dc62-4ac4-afea-a93987f443aa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:54.917863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5010286b-dc62-4ac4-afea-a93987f443aa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:55.054479 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5010286b-dc62-4ac4-afea-a93987f443aa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:55.061992 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5010286b-dc62-4ac4-afea-a93987f443aa tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1393 microversion: 2.1 time: 0.157284 Feb 19 21:51:55.062564 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3260/6433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:54 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:55.561978 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-8fcabb9f-aa63-4991-8336-2d2117994c02 req-dc7ae210-617d-4a30-9323-06dd02b8d423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd38defa-6621-45d4-b115-88cb988aa535", "name": "network-vif-plugged", "status": "completed", "tag": "94b0283e-94f3-4b0b-a566-2a2990c4dd74"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:55.563862 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:51:55.563862 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:51:55.571680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8fcabb9f-aa63-4991-8336-2d2117994c02 req-dc7ae210-617d-4a30-9323-06dd02b8d423 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:55.572478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-8fcabb9f-aa63-4991-8336-2d2117994c02 req-dc7ae210-617d-4a30-9323-06dd02b8d423 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:55.585286 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-8fcabb9f-aa63-4991-8336-2d2117994c02 req-dc7ae210-617d-4a30-9323-06dd02b8d423 service nova] Creating event network-vif-plugged:94b0283e-94f3-4b0b-a566-2a2990c4dd74 for instance bd38defa-6621-45d4-b115-88cb988aa535 on nch2-master-1 Feb 19 21:51:55.590454 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-8fcabb9f-aa63-4991-8336-2d2117994c02 req-dc7ae210-617d-4a30-9323-06dd02b8d423 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032620 Feb 19 21:51:55.591080 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3174/6434] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:51:56.079394 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-eea9ae38-a0e9-43ab-aa4f-60fbe4b3c9dd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:56.080012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-eea9ae38-a0e9-43ab-aa4f-60fbe4b3c9dd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:56.087029 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eea9ae38-a0e9-43ab-aa4f-60fbe4b3c9dd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:56.087491 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eea9ae38-a0e9-43ab-aa4f-60fbe4b3c9dd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:56.088262 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eea9ae38-a0e9-43ab-aa4f-60fbe4b3c9dd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:56.088744 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-eea9ae38-a0e9-43ab-aa4f-60fbe4b3c9dd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:56.225316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-eea9ae38-a0e9-43ab-aa4f-60fbe4b3c9dd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:56.232894 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-eea9ae38-a0e9-43ab-aa4f-60fbe4b3c9dd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1393 microversion: 2.1 time: 0.157155 Feb 19 21:51:56.233478 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3261/6435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:56 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:57.250783 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-102c8e96-41d9-4411-b328-d7e70d00c1a2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:57.251534 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-102c8e96-41d9-4411-b328-d7e70d00c1a2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:57.259441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-102c8e96-41d9-4411-b328-d7e70d00c1a2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:57.259893 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-102c8e96-41d9-4411-b328-d7e70d00c1a2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:57.261225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-102c8e96-41d9-4411-b328-d7e70d00c1a2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:57.261662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-102c8e96-41d9-4411-b328-d7e70d00c1a2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:57.402312 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-102c8e96-41d9-4411-b328-d7e70d00c1a2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:57.409788 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-102c8e96-41d9-4411-b328-d7e70d00c1a2 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1566 microversion: 2.1 time: 0.163833 Feb 19 21:51:57.410370 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3175/6436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:57 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:57.425751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-50f4838a-07e6-4f01-be63-93eab4ab43b9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:57.426372 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-50f4838a-07e6-4f01-be63-93eab4ab43b9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:57.433648 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50f4838a-07e6-4f01-be63-93eab4ab43b9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:57.434164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50f4838a-07e6-4f01-be63-93eab4ab43b9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:57.434899 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50f4838a-07e6-4f01-be63-93eab4ab43b9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:57.435353 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-50f4838a-07e6-4f01-be63-93eab4ab43b9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:57.572468 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-50f4838a-07e6-4f01-be63-93eab4ab43b9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:57.580491 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-50f4838a-07e6-4f01-be63-93eab4ab43b9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1566 microversion: 2.1 time: 0.158389 Feb 19 21:51:57.581073 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3262/6437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:57 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:51:59.591350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76b61789-a59a-45a8-b7eb-84214b4c5d7e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:51:59.591971 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-76b61789-a59a-45a8-b7eb-84214b4c5d7e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:51:59.594663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f3070e51-6333-4784-a39f-8031a0b1b475 req-19a70b63-25e5-428b-9d45-6cae9b1f0a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd38defa-6621-45d4-b115-88cb988aa535", "tag": "94b0283e-94f3-4b0b-a566-2a2990c4dd74"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:51:59.600883 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:51:59.600883 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:51:59.601224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76b61789-a59a-45a8-b7eb-84214b4c5d7e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:59.601224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76b61789-a59a-45a8-b7eb-84214b4c5d7e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:59.602056 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76b61789-a59a-45a8-b7eb-84214b4c5d7e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:59.602843 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76b61789-a59a-45a8-b7eb-84214b4c5d7e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:59.607600 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f3070e51-6333-4784-a39f-8031a0b1b475 req-19a70b63-25e5-428b-9d45-6cae9b1f0a9d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:51:59.608168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f3070e51-6333-4784-a39f-8031a0b1b475 req-19a70b63-25e5-428b-9d45-6cae9b1f0a9d service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:51:59.627997 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f3070e51-6333-4784-a39f-8031a0b1b475 req-19a70b63-25e5-428b-9d45-6cae9b1f0a9d service nova] Creating event network-changed:94b0283e-94f3-4b0b-a566-2a2990c4dd74 for instance bd38defa-6621-45d4-b115-88cb988aa535 on nch2-master-1 Feb 19 21:51:59.633584 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f3070e51-6333-4784-a39f-8031a0b1b475 req-19a70b63-25e5-428b-9d45-6cae9b1f0a9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043279 Feb 19 21:51:59.634390 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3263/6438] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:51:59.862119 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-76b61789-a59a-45a8-b7eb-84214b4c5d7e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:51:59.870204 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-76b61789-a59a-45a8-b7eb-84214b4c5d7e tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1566 microversion: 2.1 time: 0.283183 Feb 19 21:51:59.881624 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3176/6439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:51:59 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1566 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:52:33.172532 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-40df7da6-ea1b-4d9b-a376-95c5dd7e04cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:52:33.173562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-40df7da6-ea1b-4d9b-a376-95c5dd7e04cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:52:33.180115 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40df7da6-ea1b-4d9b-a376-95c5dd7e04cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:52:33.180606 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40df7da6-ea1b-4d9b-a376-95c5dd7e04cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:52:33.181423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40df7da6-ea1b-4d9b-a376-95c5dd7e04cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:52:33.181881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40df7da6-ea1b-4d9b-a376-95c5dd7e04cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:52:33.239254 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-40df7da6-ea1b-4d9b-a376-95c5dd7e04cd tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action" status: 200 len: 24563 microversion: 2.1 time: 0.071801 Feb 19 21:52:33.240212 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3264/6440] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:52:33 2022] POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action => generated 24563 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 21:53:03.449903 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9073bb5-6626-4214-be9f-5818a5a8bfb0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:03.450520 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9073bb5-6626-4214-be9f-5818a5a8bfb0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:03.456957 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9073bb5-6626-4214-be9f-5818a5a8bfb0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:03.457414 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9073bb5-6626-4214-be9f-5818a5a8bfb0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:03.458190 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9073bb5-6626-4214-be9f-5818a5a8bfb0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:03.458628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9073bb5-6626-4214-be9f-5818a5a8bfb0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:03.481530 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-a9073bb5-6626-4214-be9f-5818a5a8bfb0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lazy-loading 'flavor' on Instance uuid bd38defa-6621-45d4-b115-88cb988aa535 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:53:03.547110 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9073bb5-6626-4214-be9f-5818a5a8bfb0 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action" status: 202 len: 0 microversion: 2.1 time: 0.101948 Feb 19 21:53:03.547762 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3177/6441] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:53:03 2022] POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:53:03.556695 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7b170d2a-260f-49b6-8ca6-a4c8026f9bcf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:03.557403 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7b170d2a-260f-49b6-8ca6-a4c8026f9bcf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:03.565462 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b170d2a-260f-49b6-8ca6-a4c8026f9bcf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:03.565993 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b170d2a-260f-49b6-8ca6-a4c8026f9bcf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:03.566927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b170d2a-260f-49b6-8ca6-a4c8026f9bcf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:03.567451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7b170d2a-260f-49b6-8ca6-a4c8026f9bcf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:03.706609 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7b170d2a-260f-49b6-8ca6-a4c8026f9bcf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:03.714147 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7b170d2a-260f-49b6-8ca6-a4c8026f9bcf tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1693 microversion: 2.1 time: 0.161711 Feb 19 21:53:03.714744 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3265/6442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:03 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:04.736764 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-908698d6-7b72-433f-ad9b-6c9fbc5e7c20 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:04.737472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-908698d6-7b72-433f-ad9b-6c9fbc5e7c20 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:04.744466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-908698d6-7b72-433f-ad9b-6c9fbc5e7c20 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:04.745151 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-908698d6-7b72-433f-ad9b-6c9fbc5e7c20 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:04.745941 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-908698d6-7b72-433f-ad9b-6c9fbc5e7c20 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:04.746380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-908698d6-7b72-433f-ad9b-6c9fbc5e7c20 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:04.883067 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-908698d6-7b72-433f-ad9b-6c9fbc5e7c20 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:04.890436 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-908698d6-7b72-433f-ad9b-6c9fbc5e7c20 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1693 microversion: 2.1 time: 0.162480 Feb 19 21:53:04.891012 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3178/6443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:04 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:05.908053 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8ccfd4d6-ee84-4e2d-8140-fde896a1a51f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:05.908756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8ccfd4d6-ee84-4e2d-8140-fde896a1a51f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:05.919667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ccfd4d6-ee84-4e2d-8140-fde896a1a51f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:05.920132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ccfd4d6-ee84-4e2d-8140-fde896a1a51f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:05.920972 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ccfd4d6-ee84-4e2d-8140-fde896a1a51f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:05.921427 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8ccfd4d6-ee84-4e2d-8140-fde896a1a51f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:06.076543 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8ccfd4d6-ee84-4e2d-8140-fde896a1a51f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:06.090202 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8ccfd4d6-ee84-4e2d-8140-fde896a1a51f tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1676 microversion: 2.1 time: 0.185812 Feb 19 21:53:06.090803 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3266/6444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:05 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:07.181154 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-683d2f22-a21e-4f0f-bf16-010cecc71ea6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:07.182101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-683d2f22-a21e-4f0f-bf16-010cecc71ea6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:07.188656 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-683d2f22-a21e-4f0f-bf16-010cecc71ea6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:07.189116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-683d2f22-a21e-4f0f-bf16-010cecc71ea6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:07.189900 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-683d2f22-a21e-4f0f-bf16-010cecc71ea6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:07.190943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-683d2f22-a21e-4f0f-bf16-010cecc71ea6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:07.242611 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-683d2f22-a21e-4f0f-bf16-010cecc71ea6 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action" status: 200 len: 38403 microversion: 2.1 time: 0.064978 Feb 19 21:53:07.243473 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3179/6445] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:53:07 2022] POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action => generated 38403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:53:07.255494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2ac2d65c-03a7-453b-ab52-42d28fbba8fc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:07.256090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2ac2d65c-03a7-453b-ab52-42d28fbba8fc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:07.262683 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ac2d65c-03a7-453b-ab52-42d28fbba8fc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:07.263144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ac2d65c-03a7-453b-ab52-42d28fbba8fc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:07.263927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ac2d65c-03a7-453b-ab52-42d28fbba8fc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:07.264401 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2ac2d65c-03a7-453b-ab52-42d28fbba8fc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:07.330612 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2ac2d65c-03a7-453b-ab52-42d28fbba8fc tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action" status: 202 len: 0 microversion: 2.1 time: 0.079552 Feb 19 21:53:07.331333 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3267/6446] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:53:07 2022] POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:53:07.340076 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-af82d621-06ce-45c3-bf34-ad6a7d5d1f8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:07.340814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-af82d621-06ce-45c3-bf34-ad6a7d5d1f8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:07.348304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af82d621-06ce-45c3-bf34-ad6a7d5d1f8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:07.348797 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af82d621-06ce-45c3-bf34-ad6a7d5d1f8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:07.349597 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af82d621-06ce-45c3-bf34-ad6a7d5d1f8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:07.350036 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-af82d621-06ce-45c3-bf34-ad6a7d5d1f8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:07.603185 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-af82d621-06ce-45c3-bf34-ad6a7d5d1f8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:07.610898 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-af82d621-06ce-45c3-bf34-ad6a7d5d1f8c tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1682 microversion: 2.1 time: 0.274855 Feb 19 21:53:07.611574 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3180/6447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:07 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1682 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:08.630682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3dd28650-3b66-4aaf-8942-f8ab1fcc3ec9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:08.631324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3dd28650-3b66-4aaf-8942-f8ab1fcc3ec9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:08.638741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3dd28650-3b66-4aaf-8942-f8ab1fcc3ec9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:08.639223 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3dd28650-3b66-4aaf-8942-f8ab1fcc3ec9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:08.640047 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3dd28650-3b66-4aaf-8942-f8ab1fcc3ec9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:08.640542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3dd28650-3b66-4aaf-8942-f8ab1fcc3ec9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:08.786819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3dd28650-3b66-4aaf-8942-f8ab1fcc3ec9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:08.794643 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3dd28650-3b66-4aaf-8942-f8ab1fcc3ec9 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1682 microversion: 2.1 time: 0.169703 Feb 19 21:53:08.795220 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3268/6448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:08 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:09.812428 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5138acce-3fa0-4b59-aaea-68b6265f54da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:09.813031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5138acce-3fa0-4b59-aaea-68b6265f54da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:09.819420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5138acce-3fa0-4b59-aaea-68b6265f54da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:09.819882 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5138acce-3fa0-4b59-aaea-68b6265f54da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:09.820956 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5138acce-3fa0-4b59-aaea-68b6265f54da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:09.821401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5138acce-3fa0-4b59-aaea-68b6265f54da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:09.955212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5138acce-3fa0-4b59-aaea-68b6265f54da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:09.962754 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5138acce-3fa0-4b59-aaea-68b6265f54da tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1685 microversion: 2.1 time: 0.154180 Feb 19 21:53:09.963358 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3181/6449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:09 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:10.057925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f1f421eb-a262-460c-8cef-46a79eace90a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:10.058876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f1f421eb-a262-460c-8cef-46a79eace90a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:10.065599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1f421eb-a262-460c-8cef-46a79eace90a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:10.066063 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1f421eb-a262-460c-8cef-46a79eace90a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:10.066846 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1f421eb-a262-460c-8cef-46a79eace90a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:10.067305 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f1f421eb-a262-460c-8cef-46a79eace90a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:10.107390 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f1f421eb-a262-460c-8cef-46a79eace90a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action" status: 200 len: 38403 microversion: 2.1 time: 0.052954 Feb 19 21:53:10.108074 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3269/6450] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:53:10 2022] POST /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535/action => generated 38403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 21:53:11.497244 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d3a1ce85-08eb-4e03-a741-1f3ad78d8c34 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:11.497835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d3a1ce85-08eb-4e03-a741-1f3ad78d8c34 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:11.498089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8629eb82-9d9c-4e1d-9512-fef7f69c85f8 req-dfbcd31f-e366-4026-8b6e-7386ab687e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd38defa-6621-45d4-b115-88cb988aa535", "tag": "94b0283e-94f3-4b0b-a566-2a2990c4dd74"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:11.499605 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:53:11.499605 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:53:11.505221 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3a1ce85-08eb-4e03-a741-1f3ad78d8c34 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:11.505680 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3a1ce85-08eb-4e03-a741-1f3ad78d8c34 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:11.506502 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3a1ce85-08eb-4e03-a741-1f3ad78d8c34 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:11.506943 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3a1ce85-08eb-4e03-a741-1f3ad78d8c34 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:11.508247 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8629eb82-9d9c-4e1d-9512-fef7f69c85f8 req-dfbcd31f-e366-4026-8b6e-7386ab687e0f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:11.508751 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8629eb82-9d9c-4e1d-9512-fef7f69c85f8 req-dfbcd31f-e366-4026-8b6e-7386ab687e0f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:11.521153 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8629eb82-9d9c-4e1d-9512-fef7f69c85f8 req-dfbcd31f-e366-4026-8b6e-7386ab687e0f service nova] Creating event network-changed:94b0283e-94f3-4b0b-a566-2a2990c4dd74 for instance bd38defa-6621-45d4-b115-88cb988aa535 on nch2-master-1 Feb 19 21:53:11.526205 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8629eb82-9d9c-4e1d-9512-fef7f69c85f8 req-dfbcd31f-e366-4026-8b6e-7386ab687e0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032051 Feb 19 21:53:11.526817 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3270/6451] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:53:11.540765 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d3a1ce85-08eb-4e03-a741-1f3ad78d8c34 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:53:11.639654 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d3a1ce85-08eb-4e03-a741-1f3ad78d8c34 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 204 len: 0 microversion: 2.1 time: 0.145556 Feb 19 21:53:11.640232 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3182/6452] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:53:11 2022] DELETE /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:53:11.651463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c406bb0-c68d-4e65-9c80-41df41259342 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:11.652371 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7c406bb0-c68d-4e65-9c80-41df41259342 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:11.660153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c406bb0-c68d-4e65-9c80-41df41259342 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:11.660710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c406bb0-c68d-4e65-9c80-41df41259342 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:11.661540 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c406bb0-c68d-4e65-9c80-41df41259342 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:11.662001 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c406bb0-c68d-4e65-9c80-41df41259342 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:11.909986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7c406bb0-c68d-4e65-9c80-41df41259342 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:11.918661 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c406bb0-c68d-4e65-9c80-41df41259342 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1691 microversion: 2.1 time: 0.272953 Feb 19 21:53:11.919255 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3271/6453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:11 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1691 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:53:12.937105 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-fc7ae3f7-c055-4d0e-88f4-ec5038a4fe43 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:12.937799 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-fc7ae3f7-c055-4d0e-88f4-ec5038a4fe43 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:12.944499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc7ae3f7-c055-4d0e-88f4-ec5038a4fe43 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:12.944950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc7ae3f7-c055-4d0e-88f4-ec5038a4fe43 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:12.945975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc7ae3f7-c055-4d0e-88f4-ec5038a4fe43 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:12.946411 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-fc7ae3f7-c055-4d0e-88f4-ec5038a4fe43 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:13.088200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-fc7ae3f7-c055-4d0e-88f4-ec5038a4fe43 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:13.095552 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-fc7ae3f7-c055-4d0e-88f4-ec5038a4fe43 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1572 microversion: 2.1 time: 0.162784 Feb 19 21:53:13.096166 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3183/6454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:12 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:13.855050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ced7e687-9473-4bdf-b424-f23a651502b9 req-b5f14227-8c47-4a1f-b461-b0b4e907d097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd38defa-6621-45d4-b115-88cb988aa535", "name": "network-vif-deleted", "tag": "94b0283e-94f3-4b0b-a566-2a2990c4dd74"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:13.856599 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:53:13.856599 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:53:13.866045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ced7e687-9473-4bdf-b424-f23a651502b9 req-b5f14227-8c47-4a1f-b461-b0b4e907d097 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:13.866511 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ced7e687-9473-4bdf-b424-f23a651502b9 req-b5f14227-8c47-4a1f-b461-b0b4e907d097 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:13.877462 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ced7e687-9473-4bdf-b424-f23a651502b9 req-b5f14227-8c47-4a1f-b461-b0b4e907d097 service nova] Creating event network-vif-deleted:94b0283e-94f3-4b0b-a566-2a2990c4dd74 for instance bd38defa-6621-45d4-b115-88cb988aa535 on nch2-master-1 Feb 19 21:53:13.883032 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ced7e687-9473-4bdf-b424-f23a651502b9 req-b5f14227-8c47-4a1f-b461-b0b4e907d097 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031648 Feb 19 21:53:13.883639 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3272/6455] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:53:14.114194 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:14.114746 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:14.121393 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:14.121850 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:14.122622 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:14.123057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:14.154871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:14.155321 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:14.155775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lazy-loading 'fault' on Instance uuid bd38defa-6621-45d4-b115-88cb988aa535 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:53:14.200187 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4322cc0fa954031bbf07e95c5cf1fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b842c60e89342ae92bbc9f9b568e4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:14.209354 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-dc849102-5cf7-48a6-a621-c3b3d0aa232a tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 200 len: 1357 microversion: 2.1 time: 0.099273 Feb 19 21:53:14.210077 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3184/6456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:14 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:15.228026 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8611d6cb-41d7-4ed4-977b-6164ec2b8444 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:15.228754 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8611d6cb-41d7-4ed4-977b-6164ec2b8444 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] [instance: bd38defa-6621-45d4-b115-88cb988aa535] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:15.235012 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8611d6cb-41d7-4ed4-977b-6164ec2b8444 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:15.235475 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8611d6cb-41d7-4ed4-977b-6164ec2b8444 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:15.236265 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8611d6cb-41d7-4ed4-977b-6164ec2b8444 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:15.236741 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8611d6cb-41d7-4ed4-977b-6164ec2b8444 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:15.250417 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-8611d6cb-41d7-4ed4-977b-6164ec2b8444 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] HTTP exception thrown: Instance bd38defa-6621-45d4-b115-88cb988aa535 could not be found. Feb 19 21:53:15.251010 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8611d6cb-41d7-4ed4-977b-6164ec2b8444 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Returning 404 to user: Instance bd38defa-6621-45d4-b115-88cb988aa535 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:53:15.251839 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8611d6cb-41d7-4ed4-977b-6164ec2b8444 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535" status: 404 len: 111 microversion: 2.1 time: 0.028807 Feb 19 21:53:15.252418 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3273/6457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:15 2022] GET /compute/v2.1/servers/bd38defa-6621-45d4-b115-88cb988aa535 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:53:18.387014 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-51c4c599-1b8e-4e60-81de-a9ae17a8ac18 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] Calling method '.version_select at 0x7f64669c9ca0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:18.407100 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-51c4c599-1b8e-4e60-81de-a9ae17a8ac18 tempest-TestNetworkAdvancedServerOps-737521249 tempest-TestNetworkAdvancedServerOps-737521249-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1826991085" status: 202 len: 0 microversion: 2.1 time: 0.023765 Feb 19 21:53:18.407706 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3185/6458] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Feb 19 21:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1826991085 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:53:30.880978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8ee7d2fe-5523-47e4-878e-03e90a650338 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Action: 'create', calling method: .version_select at 0x7f6466f7bca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1277738319"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:30.899828 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8ee7d2fe-5523-47e4-878e-03e90a650338 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:53:30.905273 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8ee7d2fe-5523-47e4-878e-03e90a650338 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for user e56dfa82fd8f439fabb876411484f2fc and project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:53:31.165346 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8ee7d2fe-5523-47e4-878e-03e90a650338 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:53:31.170892 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-8ee7d2fe-5523-47e4-878e-03e90a650338 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for user e56dfa82fd8f439fabb876411484f2fc and project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:53:31.186504 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8ee7d2fe-5523-47e4-878e-03e90a650338 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.542245 Feb 19 21:53:31.192913 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3274/6459] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:53:30 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:32.289778 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2043284991", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1277738319", "security_groups": [{"name": "tempest-secgroup-smoke-1689903659"}], "networks": [{"uuid": "15a1c9e8-368f-4444-8b18-de8bd3a7cbbf"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:32.429126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] validate_networks() for [('15a1c9e8-368f-4444-8b18-de8bd3a7cbbf', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:53:32.855553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:53:32.855987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:53:32.856509 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:53:32.856928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:53:32.857406 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:53:32.867567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:32.867932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:32.868788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:32.869234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:32.889724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:53:32.895935 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for user e56dfa82fd8f439fabb876411484f2fc and project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:53:32.909073 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:53:32.911474 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:53:32.962242 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2ac86657-bc35-423e-95f3-f4d259233bf5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.676739 Feb 19 21:53:32.963267 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3186/6460] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:53:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:53:32.973743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f744dd1b-3af1-4be0-abb3-8bfb37b5b10d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:32.974406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f744dd1b-3af1-4be0-abb3-8bfb37b5b10d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:33.039043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f744dd1b-3af1-4be0-abb3-8bfb37b5b10d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:33.047940 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f744dd1b-3af1-4be0-abb3-8bfb37b5b10d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1247 microversion: 2.1 time: 0.077393 Feb 19 21:53:33.048629 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3275/6461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:32 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1247 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:34.075108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b8d5afff-eada-4d40-a0f0-be03f4734d4f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:34.075728 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b8d5afff-eada-4d40-a0f0-be03f4734d4f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:34.091247 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8d5afff-eada-4d40-a0f0-be03f4734d4f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:34.091832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8d5afff-eada-4d40-a0f0-be03f4734d4f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:34.092697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8d5afff-eada-4d40-a0f0-be03f4734d4f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:34.093125 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b8d5afff-eada-4d40-a0f0-be03f4734d4f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:34.193993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b8d5afff-eada-4d40-a0f0-be03f4734d4f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:34.202870 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b8d5afff-eada-4d40-a0f0-be03f4734d4f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1299 microversion: 2.1 time: 0.131321 Feb 19 21:53:34.208728 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3187/6462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:34 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1299 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:35.229919 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c20ef5fa-ee5f-409f-946f-eff289588bb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:35.230453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c20ef5fa-ee5f-409f-946f-eff289588bb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:35.239213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c20ef5fa-ee5f-409f-946f-eff289588bb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:35.240018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c20ef5fa-ee5f-409f-946f-eff289588bb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:35.240894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c20ef5fa-ee5f-409f-946f-eff289588bb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:35.241536 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c20ef5fa-ee5f-409f-946f-eff289588bb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:35.402080 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c20ef5fa-ee5f-409f-946f-eff289588bb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:35.410166 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c20ef5fa-ee5f-409f-946f-eff289588bb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1373 microversion: 2.1 time: 0.184101 Feb 19 21:53:35.410759 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3276/6463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:35 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:35.918327 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-3127b8b2-3026-442c-972e-828c8d44ee6f req-5b014498-95a4-4564-81d8-5c064d5f8d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55efb7a9-de53-43af-a75e-23bf2dea8a46", "tag": "3dbb2536-587e-40e3-a8ac-7bf6320069ce"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:35.925505 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:53:35.925505 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:53:35.958264 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3127b8b2-3026-442c-972e-828c8d44ee6f req-5b014498-95a4-4564-81d8-5c064d5f8d71 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:35.960104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-3127b8b2-3026-442c-972e-828c8d44ee6f req-5b014498-95a4-4564-81d8-5c064d5f8d71 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:35.974863 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-3127b8b2-3026-442c-972e-828c8d44ee6f req-5b014498-95a4-4564-81d8-5c064d5f8d71 service nova] Creating event network-changed:3dbb2536-587e-40e3-a8ac-7bf6320069ce for instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 on nch1-master-1 Feb 19 21:53:35.980385 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-3127b8b2-3026-442c-972e-828c8d44ee6f req-5b014498-95a4-4564-81d8-5c064d5f8d71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074900 Feb 19 21:53:35.981000 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3188/6464] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:53:36.429509 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-29d0a031-dd28-458d-87ea-d5dc8385bbc1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:36.430211 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-29d0a031-dd28-458d-87ea-d5dc8385bbc1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:36.437336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29d0a031-dd28-458d-87ea-d5dc8385bbc1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:36.437803 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29d0a031-dd28-458d-87ea-d5dc8385bbc1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:36.438763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29d0a031-dd28-458d-87ea-d5dc8385bbc1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:36.439232 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-29d0a031-dd28-458d-87ea-d5dc8385bbc1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:36.639725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-29d0a031-dd28-458d-87ea-d5dc8385bbc1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:36.648130 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-29d0a031-dd28-458d-87ea-d5dc8385bbc1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1373 microversion: 2.1 time: 0.223059 Feb 19 21:53:36.648847 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3277/6465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:36 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1373 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:37.672344 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3dc59608-37b2-486e-a56e-a3e84cfef9e3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:37.673108 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3dc59608-37b2-486e-a56e-a3e84cfef9e3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:37.679672 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dc59608-37b2-486e-a56e-a3e84cfef9e3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:37.680162 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dc59608-37b2-486e-a56e-a3e84cfef9e3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:37.681047 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dc59608-37b2-486e-a56e-a3e84cfef9e3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:37.681494 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3dc59608-37b2-486e-a56e-a3e84cfef9e3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:37.959513 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3dc59608-37b2-486e-a56e-a3e84cfef9e3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:37.967349 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3dc59608-37b2-486e-a56e-a3e84cfef9e3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1373 microversion: 2.1 time: 0.300039 Feb 19 21:53:37.967959 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3189/6466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:37 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1373 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:38.984946 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ec3e0518-8790-4859-be06-4a312ed8c949 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:38.985788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ec3e0518-8790-4859-be06-4a312ed8c949 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:38.992289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec3e0518-8790-4859-be06-4a312ed8c949 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:38.992786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec3e0518-8790-4859-be06-4a312ed8c949 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:38.993596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec3e0518-8790-4859-be06-4a312ed8c949 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:38.994045 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ec3e0518-8790-4859-be06-4a312ed8c949 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:39.213098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ec3e0518-8790-4859-be06-4a312ed8c949 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:39.220826 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ec3e0518-8790-4859-be06-4a312ed8c949 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1373 microversion: 2.1 time: 0.239726 Feb 19 21:53:39.221427 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3278/6467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:38 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1373 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:40.237744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-09cdf691-e79b-4f23-953b-986d2a8b2d38 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:40.238294 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-09cdf691-e79b-4f23-953b-986d2a8b2d38 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:40.245372 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09cdf691-e79b-4f23-953b-986d2a8b2d38 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:40.245874 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09cdf691-e79b-4f23-953b-986d2a8b2d38 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:40.246871 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09cdf691-e79b-4f23-953b-986d2a8b2d38 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:40.247390 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-09cdf691-e79b-4f23-953b-986d2a8b2d38 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:40.409870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-09cdf691-e79b-4f23-953b-986d2a8b2d38 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:40.419874 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-09cdf691-e79b-4f23-953b-986d2a8b2d38 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1373 microversion: 2.1 time: 0.185803 Feb 19 21:53:40.420922 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3190/6468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:40 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:41.442552 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c2bd4b2f-9e2b-447a-9d16-451ebd9c46b9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:41.443213 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c2bd4b2f-9e2b-447a-9d16-451ebd9c46b9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:41.450966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2bd4b2f-9e2b-447a-9d16-451ebd9c46b9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:41.451430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2bd4b2f-9e2b-447a-9d16-451ebd9c46b9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:41.452239 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2bd4b2f-9e2b-447a-9d16-451ebd9c46b9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:41.452724 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c2bd4b2f-9e2b-447a-9d16-451ebd9c46b9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:41.621152 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c2bd4b2f-9e2b-447a-9d16-451ebd9c46b9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:41.628889 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c2bd4b2f-9e2b-447a-9d16-451ebd9c46b9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1373 microversion: 2.1 time: 0.189999 Feb 19 21:53:41.629490 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3279/6469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:41 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:42.015984 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-58245a97-50ea-4124-babb-28823e394102 req-790480d3-b854-4846-9986-1fb9bd0f874a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55efb7a9-de53-43af-a75e-23bf2dea8a46", "name": "network-vif-plugged", "status": "completed", "tag": "3dbb2536-587e-40e3-a8ac-7bf6320069ce"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:42.019047 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:53:42.019047 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:53:42.030126 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-58245a97-50ea-4124-babb-28823e394102 req-790480d3-b854-4846-9986-1fb9bd0f874a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:42.030927 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-58245a97-50ea-4124-babb-28823e394102 req-790480d3-b854-4846-9986-1fb9bd0f874a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:42.046387 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-58245a97-50ea-4124-babb-28823e394102 req-790480d3-b854-4846-9986-1fb9bd0f874a service nova] Creating event network-vif-plugged:3dbb2536-587e-40e3-a8ac-7bf6320069ce for instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 on nch1-master-1 Feb 19 21:53:42.053740 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-58245a97-50ea-4124-babb-28823e394102 req-790480d3-b854-4846-9986-1fb9bd0f874a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041341 Feb 19 21:53:42.054645 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3191/6470] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:53:42.652464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cde43dba-f909-4970-b3c6-5a30caf6a4c2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:42.653079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cde43dba-f909-4970-b3c6-5a30caf6a4c2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:42.660610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cde43dba-f909-4970-b3c6-5a30caf6a4c2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:42.661147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cde43dba-f909-4970-b3c6-5a30caf6a4c2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:42.661943 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cde43dba-f909-4970-b3c6-5a30caf6a4c2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:42.662389 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cde43dba-f909-4970-b3c6-5a30caf6a4c2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:42.815612 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cde43dba-f909-4970-b3c6-5a30caf6a4c2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:42.826083 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cde43dba-f909-4970-b3c6-5a30caf6a4c2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1373 microversion: 2.1 time: 0.177266 Feb 19 21:53:42.826672 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3280/6471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:42 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:43.844231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3a1d11f8-4a1b-4c56-8456-e16c659f56f8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:43.844963 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3a1d11f8-4a1b-4c56-8456-e16c659f56f8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:43.851815 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a1d11f8-4a1b-4c56-8456-e16c659f56f8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:43.852267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a1d11f8-4a1b-4c56-8456-e16c659f56f8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:43.853080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a1d11f8-4a1b-4c56-8456-e16c659f56f8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:43.853526 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3a1d11f8-4a1b-4c56-8456-e16c659f56f8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:43.990878 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3a1d11f8-4a1b-4c56-8456-e16c659f56f8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:43.998549 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3a1d11f8-4a1b-4c56-8456-e16c659f56f8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1558 microversion: 2.1 time: 0.159145 Feb 19 21:53:43.999136 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3192/6472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:43 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:44.014383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-49feef9a-694b-4f0f-9593-e77fdf8221ab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:53:44.015005 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-49feef9a-694b-4f0f-9593-e77fdf8221ab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:53:44.022535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49feef9a-694b-4f0f-9593-e77fdf8221ab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:44.022996 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49feef9a-694b-4f0f-9593-e77fdf8221ab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:44.023790 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49feef9a-694b-4f0f-9593-e77fdf8221ab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:44.024233 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49feef9a-694b-4f0f-9593-e77fdf8221ab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:44.181119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-49feef9a-694b-4f0f-9593-e77fdf8221ab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:53:44.188987 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-49feef9a-694b-4f0f-9593-e77fdf8221ab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1558 microversion: 2.1 time: 0.178154 Feb 19 21:53:44.190072 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3281/6473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:53:44 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:53:45.944784 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-88497a5c-ee4a-4a45-a855-e773b0da419e req-85229268-fba9-4a45-860b-677d6808050a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55efb7a9-de53-43af-a75e-23bf2dea8a46", "tag": "3dbb2536-587e-40e3-a8ac-7bf6320069ce"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:53:45.946538 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:53:45.946538 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:53:45.955698 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-88497a5c-ee4a-4a45-a855-e773b0da419e req-85229268-fba9-4a45-860b-677d6808050a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:53:45.956060 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-88497a5c-ee4a-4a45-a855-e773b0da419e req-85229268-fba9-4a45-860b-677d6808050a service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:53:45.967908 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-88497a5c-ee4a-4a45-a855-e773b0da419e req-85229268-fba9-4a45-860b-677d6808050a service nova] Creating event network-changed:3dbb2536-587e-40e3-a8ac-7bf6320069ce for instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 on nch1-master-1 Feb 19 21:53:45.973275 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-88497a5c-ee4a-4a45-a855-e773b0da419e req-85229268-fba9-4a45-860b-677d6808050a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031906 Feb 19 21:53:45.973985 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3193/6474] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:55:17.786950 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:55:17.787559 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 21:55:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:55:35.457289 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:55:35.457946 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 21:55:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:55:41.359033 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 21:55:41.362795 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f785f7ae-be12-4811-82df-d4accce154aa tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:55:41.363347 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f785f7ae-be12-4811-82df-d4accce154aa tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:41.369420 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f785f7ae-be12-4811-82df-d4accce154aa tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:41.369852 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f785f7ae-be12-4811-82df-d4accce154aa tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:41.370637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f785f7ae-be12-4811-82df-d4accce154aa tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:41.371106 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f785f7ae-be12-4811-82df-d4accce154aa tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:41.395120 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.objects.instance [None req-f785f7ae-be12-4811-82df-d4accce154aa tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lazy-loading 'flavor' on Instance uuid 55efb7a9-de53-43af-a75e-23bf2dea8a46 {{(pid=136094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 21:55:41.651312 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f785f7ae-be12-4811-82df-d4accce154aa tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "POST /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46/action" status: 202 len: 0 microversion: 2.1 time: 0.294140 Feb 19 21:55:41.652689 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3282/6475] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:55:41 2022] POST /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:55:41.658355 ncdv-master-1 devstack@n-api.service[136095]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02a8a3ca-f500-48fe-b8eb-c416084a9cb7] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 21:55:41.659188 ncdv-master-1 devstack@n-api.service[136095]: ERROR oslo.messaging._drivers.impl_rabbit [-] [106724db-adde-4356-8365-ad1f06dea86f] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 21:55:41.663173 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-93f3bec9-e16d-46a0-9c36-0121ce5e7edc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:41.663877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-93f3bec9-e16d-46a0-9c36-0121ce5e7edc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:41.670472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93f3bec9-e16d-46a0-9c36-0121ce5e7edc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:41.671420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93f3bec9-e16d-46a0-9c36-0121ce5e7edc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:41.672213 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93f3bec9-e16d-46a0-9c36-0121ce5e7edc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:41.672686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-93f3bec9-e16d-46a0-9c36-0121ce5e7edc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:41.814614 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-93f3bec9-e16d-46a0-9c36-0121ce5e7edc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:41.822629 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-93f3bec9-e16d-46a0-9c36-0121ce5e7edc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.165999 Feb 19 21:55:41.823308 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3194/6476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:41 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:42.844219 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-863b5aed-3b60-4297-b85f-8d4c7adb6a94 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:42.845018 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-863b5aed-3b60-4297-b85f-8d4c7adb6a94 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:42.852144 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-863b5aed-3b60-4297-b85f-8d4c7adb6a94 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:42.852644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-863b5aed-3b60-4297-b85f-8d4c7adb6a94 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:42.853505 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-863b5aed-3b60-4297-b85f-8d4c7adb6a94 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:42.853956 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-863b5aed-3b60-4297-b85f-8d4c7adb6a94 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:42.857421 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43230. Feb 19 21:55:42.995428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-863b5aed-3b60-4297-b85f-8d4c7adb6a94 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:43.003429 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-863b5aed-3b60-4297-b85f-8d4c7adb6a94 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.165550 Feb 19 21:55:43.003991 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3283/6477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:42 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:44.020958 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-97597cf6-388e-4eb2-a404-44b02cfab84d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:44.021596 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-97597cf6-388e-4eb2-a404-44b02cfab84d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:44.031149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97597cf6-388e-4eb2-a404-44b02cfab84d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:44.031604 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97597cf6-388e-4eb2-a404-44b02cfab84d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:44.032432 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97597cf6-388e-4eb2-a404-44b02cfab84d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:44.032877 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-97597cf6-388e-4eb2-a404-44b02cfab84d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:44.037673 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] [106724db-adde-4356-8365-ad1f06dea86f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43236. Feb 19 21:55:44.039735 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] [02a8a3ca-f500-48fe-b8eb-c416084a9cb7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43234. Feb 19 21:55:44.171751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-97597cf6-388e-4eb2-a404-44b02cfab84d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:44.179402 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-97597cf6-388e-4eb2-a404-44b02cfab84d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.162084 Feb 19 21:55:44.179986 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3195/6478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:44 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:45.196251 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-222e776a-eb53-406d-8fe9-c74ab52b2c56 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:45.196900 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-222e776a-eb53-406d-8fe9-c74ab52b2c56 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:45.203733 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-222e776a-eb53-406d-8fe9-c74ab52b2c56 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:45.204192 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-222e776a-eb53-406d-8fe9-c74ab52b2c56 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:45.205008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-222e776a-eb53-406d-8fe9-c74ab52b2c56 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:45.205453 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-222e776a-eb53-406d-8fe9-c74ab52b2c56 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:45.349413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-222e776a-eb53-406d-8fe9-c74ab52b2c56 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:45.356933 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-222e776a-eb53-406d-8fe9-c74ab52b2c56 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.164654 Feb 19 21:55:45.357505 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3284/6479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:45 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:46.374839 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-76fc6ba2-99a7-476f-90ca-060fc2d8cc0d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:46.375475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-76fc6ba2-99a7-476f-90ca-060fc2d8cc0d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:46.382420 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76fc6ba2-99a7-476f-90ca-060fc2d8cc0d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:46.382860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76fc6ba2-99a7-476f-90ca-060fc2d8cc0d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:46.383637 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76fc6ba2-99a7-476f-90ca-060fc2d8cc0d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:46.384071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-76fc6ba2-99a7-476f-90ca-060fc2d8cc0d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:46.519298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-76fc6ba2-99a7-476f-90ca-060fc2d8cc0d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:46.526643 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-76fc6ba2-99a7-476f-90ca-060fc2d8cc0d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.156570 Feb 19 21:55:46.527223 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3196/6480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:46 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:47.543162 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d4dca82c-8810-41c2-8fb3-c86a3155bc89 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:47.543776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d4dca82c-8810-41c2-8fb3-c86a3155bc89 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:47.551033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4dca82c-8810-41c2-8fb3-c86a3155bc89 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:47.551493 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4dca82c-8810-41c2-8fb3-c86a3155bc89 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:47.552267 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4dca82c-8810-41c2-8fb3-c86a3155bc89 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:47.552735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d4dca82c-8810-41c2-8fb3-c86a3155bc89 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:47.688189 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d4dca82c-8810-41c2-8fb3-c86a3155bc89 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:47.695687 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d4dca82c-8810-41c2-8fb3-c86a3155bc89 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.156240 Feb 19 21:55:47.696524 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3285/6481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:47 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:48.712169 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-141e14b4-3fe3-4284-9602-4ae0d81c1f1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:48.712801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-141e14b4-3fe3-4284-9602-4ae0d81c1f1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:48.719536 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-141e14b4-3fe3-4284-9602-4ae0d81c1f1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:48.719983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-141e14b4-3fe3-4284-9602-4ae0d81c1f1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:48.720780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-141e14b4-3fe3-4284-9602-4ae0d81c1f1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:48.721211 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-141e14b4-3fe3-4284-9602-4ae0d81c1f1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:48.860904 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-141e14b4-3fe3-4284-9602-4ae0d81c1f1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:48.868270 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-141e14b4-3fe3-4284-9602-4ae0d81c1f1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.159825 Feb 19 21:55:48.868945 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3197/6482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:48 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:49.885551 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-11f297af-1a77-4230-806f-20381fb6bfd7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:49.886302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-11f297af-1a77-4230-806f-20381fb6bfd7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:49.893599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11f297af-1a77-4230-806f-20381fb6bfd7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:49.894065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11f297af-1a77-4230-806f-20381fb6bfd7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:49.894893 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11f297af-1a77-4230-806f-20381fb6bfd7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:49.895343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-11f297af-1a77-4230-806f-20381fb6bfd7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:50.031687 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-11f297af-1a77-4230-806f-20381fb6bfd7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:50.039073 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-11f297af-1a77-4230-806f-20381fb6bfd7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.157198 Feb 19 21:55:50.039647 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3286/6483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:49 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:51.055140 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5cea3be9-7d0c-4b6a-ac89-60a865fa87ef tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:51.055748 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5cea3be9-7d0c-4b6a-ac89-60a865fa87ef tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:51.062394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cea3be9-7d0c-4b6a-ac89-60a865fa87ef tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:51.062836 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cea3be9-7d0c-4b6a-ac89-60a865fa87ef tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:51.063608 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cea3be9-7d0c-4b6a-ac89-60a865fa87ef tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:51.064041 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5cea3be9-7d0c-4b6a-ac89-60a865fa87ef tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:51.203109 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5cea3be9-7d0c-4b6a-ac89-60a865fa87ef tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:51.210586 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5cea3be9-7d0c-4b6a-ac89-60a865fa87ef tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.159154 Feb 19 21:55:51.211164 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3198/6484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:51 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:52.227978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bdeb438b-c010-49ea-8b9a-7a94c794dfdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:52.228719 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bdeb438b-c010-49ea-8b9a-7a94c794dfdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:52.235705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bdeb438b-c010-49ea-8b9a-7a94c794dfdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:52.236168 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bdeb438b-c010-49ea-8b9a-7a94c794dfdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:52.236980 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bdeb438b-c010-49ea-8b9a-7a94c794dfdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:52.237422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bdeb438b-c010-49ea-8b9a-7a94c794dfdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:52.382986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bdeb438b-c010-49ea-8b9a-7a94c794dfdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:52.390480 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bdeb438b-c010-49ea-8b9a-7a94c794dfdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1703 microversion: 2.1 time: 0.166247 Feb 19 21:55:52.391051 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3287/6485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:52 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1703 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:53.409548 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-81c11948-70cd-4e16-91ca-88e443b2acb9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:53.410489 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-81c11948-70cd-4e16-91ca-88e443b2acb9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:53.418467 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81c11948-70cd-4e16-91ca-88e443b2acb9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:53.418922 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81c11948-70cd-4e16-91ca-88e443b2acb9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:53.419724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81c11948-70cd-4e16-91ca-88e443b2acb9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:53.420240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-81c11948-70cd-4e16-91ca-88e443b2acb9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:53.557990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-81c11948-70cd-4e16-91ca-88e443b2acb9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:53.566057 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-81c11948-70cd-4e16-91ca-88e443b2acb9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1703 microversion: 2.1 time: 0.161904 Feb 19 21:55:53.566636 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3199/6486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:53 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1703 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:55:54.583249 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7886f381-3b1a-4e6e-a1aa-fb1dde414ac0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:54.584017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7886f381-3b1a-4e6e-a1aa-fb1dde414ac0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:54.590997 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7886f381-3b1a-4e6e-a1aa-fb1dde414ac0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:54.591456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7886f381-3b1a-4e6e-a1aa-fb1dde414ac0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:54.592868 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7886f381-3b1a-4e6e-a1aa-fb1dde414ac0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:54.593319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7886f381-3b1a-4e6e-a1aa-fb1dde414ac0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:54.744514 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7886f381-3b1a-4e6e-a1aa-fb1dde414ac0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:54.754847 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7886f381-3b1a-4e6e-a1aa-fb1dde414ac0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1698 microversion: 2.1 time: 0.175282 Feb 19 21:55:54.755454 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3288/6487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:54 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:55:55.773400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e29a9077-fa60-4ec7-8014-a16e632dfcb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:55.776117 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e29a9077-fa60-4ec7-8014-a16e632dfcb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:55.783362 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e29a9077-fa60-4ec7-8014-a16e632dfcb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:55.783808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e29a9077-fa60-4ec7-8014-a16e632dfcb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:55.784806 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e29a9077-fa60-4ec7-8014-a16e632dfcb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:55.785427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e29a9077-fa60-4ec7-8014-a16e632dfcb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:55.948650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e29a9077-fa60-4ec7-8014-a16e632dfcb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:55.957899 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e29a9077-fa60-4ec7-8014-a16e632dfcb1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1698 microversion: 2.1 time: 0.188189 Feb 19 21:55:55.958714 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3200/6488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:55 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1698 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:56.689138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-9e402fe8-f3b1-4fb5-860f-7db10ed9d8de req-b7c1b518-4768-4236-8085-5b7bee0c7334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55efb7a9-de53-43af-a75e-23bf2dea8a46", "name": "network-vif-plugged", "status": "completed", "tag": "3dbb2536-587e-40e3-a8ac-7bf6320069ce"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:55:56.692301 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:55:56.692301 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:55:56.709291 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9e402fe8-f3b1-4fb5-860f-7db10ed9d8de req-b7c1b518-4768-4236-8085-5b7bee0c7334 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:56.709988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-9e402fe8-f3b1-4fb5-860f-7db10ed9d8de req-b7c1b518-4768-4236-8085-5b7bee0c7334 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:56.722212 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-9e402fe8-f3b1-4fb5-860f-7db10ed9d8de req-b7c1b518-4768-4236-8085-5b7bee0c7334 service nova] Creating event network-vif-plugged:3dbb2536-587e-40e3-a8ac-7bf6320069ce for instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 on nch1-master-1 Feb 19 21:55:56.733872 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-9e402fe8-f3b1-4fb5-860f-7db10ed9d8de req-b7c1b518-4768-4236-8085-5b7bee0c7334 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118177 Feb 19 21:55:56.735120 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3289/6489] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:55:56.975050 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-906409d6-e16d-49fe-9448-00c56aafd03b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:56.976389 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-906409d6-e16d-49fe-9448-00c56aafd03b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:56.983727 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-906409d6-e16d-49fe-9448-00c56aafd03b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:56.984475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-906409d6-e16d-49fe-9448-00c56aafd03b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:56.985493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-906409d6-e16d-49fe-9448-00c56aafd03b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:56.986033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-906409d6-e16d-49fe-9448-00c56aafd03b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:57.152487 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-906409d6-e16d-49fe-9448-00c56aafd03b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:57.160681 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-906409d6-e16d-49fe-9448-00c56aafd03b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1698 microversion: 2.1 time: 0.189378 Feb 19 21:55:57.161971 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3201/6490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:56 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1698 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:58.178654 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-fdc2549f-7a3e-4e8c-83b3-de483acc0bc8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:58.180034 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-fdc2549f-7a3e-4e8c-83b3-de483acc0bc8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:58.187692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fdc2549f-7a3e-4e8c-83b3-de483acc0bc8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:58.188474 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fdc2549f-7a3e-4e8c-83b3-de483acc0bc8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:58.189982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fdc2549f-7a3e-4e8c-83b3-de483acc0bc8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:58.190743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-fdc2549f-7a3e-4e8c-83b3-de483acc0bc8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:58.345547 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-fdc2549f-7a3e-4e8c-83b3-de483acc0bc8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:58.353868 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-fdc2549f-7a3e-4e8c-83b3-de483acc0bc8 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1698 microversion: 2.1 time: 0.179416 Feb 19 21:55:58.354884 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3290/6491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:58 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:55:59.375381 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-791d494b-36b8-4db3-9a63-a70b3940b7ce tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:55:59.376737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-791d494b-36b8-4db3-9a63-a70b3940b7ce tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:55:59.387788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-791d494b-36b8-4db3-9a63-a70b3940b7ce tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:59.388380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-791d494b-36b8-4db3-9a63-a70b3940b7ce tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:59.389785 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-791d494b-36b8-4db3-9a63-a70b3940b7ce tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:55:59.390236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-791d494b-36b8-4db3-9a63-a70b3940b7ce tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:55:59.551022 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-791d494b-36b8-4db3-9a63-a70b3940b7ce tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:55:59.559450 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-791d494b-36b8-4db3-9a63-a70b3940b7ce tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1698 microversion: 2.1 time: 0.188267 Feb 19 21:55:59.571269 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3202/6492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:55:59 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1698 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:00.577804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-aee8c19f-867d-4a8e-9d19-69d86991108a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:00.578430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-aee8c19f-867d-4a8e-9d19-69d86991108a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:00.585686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aee8c19f-867d-4a8e-9d19-69d86991108a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:00.586576 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aee8c19f-867d-4a8e-9d19-69d86991108a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:00.587565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aee8c19f-867d-4a8e-9d19-69d86991108a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:00.588193 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-aee8c19f-867d-4a8e-9d19-69d86991108a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:00.746508 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-aee8c19f-867d-4a8e-9d19-69d86991108a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:00.754106 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-aee8c19f-867d-4a8e-9d19-69d86991108a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1698 microversion: 2.1 time: 0.180923 Feb 19 21:56:00.754726 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3291/6493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:00 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1698 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:56:01.774092 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-70aa5d26-591b-48a1-a271-a5868b4dd0b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:01.774804 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-70aa5d26-591b-48a1-a271-a5868b4dd0b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:01.782354 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70aa5d26-591b-48a1-a271-a5868b4dd0b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:01.782915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70aa5d26-591b-48a1-a271-a5868b4dd0b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:01.784044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70aa5d26-591b-48a1-a271-a5868b4dd0b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:01.785894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-70aa5d26-591b-48a1-a271-a5868b4dd0b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:01.952380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-70aa5d26-591b-48a1-a271-a5868b4dd0b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:01.965447 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-70aa5d26-591b-48a1-a271-a5868b4dd0b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1698 microversion: 2.1 time: 0.197725 Feb 19 21:56:01.966641 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3203/6494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:01 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1698 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:02.984978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-facac173-0f5a-4422-b440-de317a0f8154 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:02.985533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-facac173-0f5a-4422-b440-de317a0f8154 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:02.992629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-facac173-0f5a-4422-b440-de317a0f8154 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:02.993056 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-facac173-0f5a-4422-b440-de317a0f8154 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:02.993877 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-facac173-0f5a-4422-b440-de317a0f8154 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:02.994334 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-facac173-0f5a-4422-b440-de317a0f8154 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:03.142416 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-facac173-0f5a-4422-b440-de317a0f8154 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:03.150111 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-facac173-0f5a-4422-b440-de317a0f8154 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1698 microversion: 2.1 time: 0.169597 Feb 19 21:56:03.150705 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3292/6495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:02 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:04.167382 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b3205096-6524-4ef8-a1cd-969582003dd9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:04.167932 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b3205096-6524-4ef8-a1cd-969582003dd9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:04.174853 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3205096-6524-4ef8-a1cd-969582003dd9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:04.175299 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3205096-6524-4ef8-a1cd-969582003dd9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:04.176068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3205096-6524-4ef8-a1cd-969582003dd9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:04.176527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b3205096-6524-4ef8-a1cd-969582003dd9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:04.310398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b3205096-6524-4ef8-a1cd-969582003dd9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:04.318003 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b3205096-6524-4ef8-a1cd-969582003dd9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1698 microversion: 2.1 time: 0.154315 Feb 19 21:56:04.318602 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3204/6496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:04 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:05.335678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3590ca20-4cab-41fc-9911-f90b2c016392 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:05.336280 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3590ca20-4cab-41fc-9911-f90b2c016392 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:05.343587 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3590ca20-4cab-41fc-9911-f90b2c016392 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:05.344048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3590ca20-4cab-41fc-9911-f90b2c016392 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:05.344876 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3590ca20-4cab-41fc-9911-f90b2c016392 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:05.345329 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3590ca20-4cab-41fc-9911-f90b2c016392 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:05.483915 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3590ca20-4cab-41fc-9911-f90b2c016392 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:05.491505 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3590ca20-4cab-41fc-9911-f90b2c016392 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1680 microversion: 2.1 time: 0.159517 Feb 19 21:56:05.492073 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3293/6497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:05 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:06.509846 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6663171f-ddcb-4120-8519-260df0fa49d0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:06.511029 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6663171f-ddcb-4120-8519-260df0fa49d0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:06.519650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6663171f-ddcb-4120-8519-260df0fa49d0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:06.520111 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6663171f-ddcb-4120-8519-260df0fa49d0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:06.521241 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6663171f-ddcb-4120-8519-260df0fa49d0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:06.521794 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6663171f-ddcb-4120-8519-260df0fa49d0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:06.666791 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6663171f-ddcb-4120-8519-260df0fa49d0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:06.674789 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6663171f-ddcb-4120-8519-260df0fa49d0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1680 microversion: 2.1 time: 0.168561 Feb 19 21:56:06.675358 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3205/6498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:06 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:07.691524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-d763b947-1c77-40c3-aeb2-39f6ad768b0f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:07.692146 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-d763b947-1c77-40c3-aeb2-39f6ad768b0f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:07.699172 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d763b947-1c77-40c3-aeb2-39f6ad768b0f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:07.699638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d763b947-1c77-40c3-aeb2-39f6ad768b0f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:07.700472 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d763b947-1c77-40c3-aeb2-39f6ad768b0f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:07.700925 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-d763b947-1c77-40c3-aeb2-39f6ad768b0f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:07.842110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-d763b947-1c77-40c3-aeb2-39f6ad768b0f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:07.849556 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-d763b947-1c77-40c3-aeb2-39f6ad768b0f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1623 microversion: 2.1 time: 0.161763 Feb 19 21:56:07.850142 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3294/6499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:07 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1623 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:07.866346 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2fef999a-769d-4633-bb27-88f8aa054a1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:56:07.866988 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2fef999a-769d-4633-bb27-88f8aa054a1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:07.874193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fef999a-769d-4633-bb27-88f8aa054a1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:07.874640 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fef999a-769d-4633-bb27-88f8aa054a1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:07.875417 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fef999a-769d-4633-bb27-88f8aa054a1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:07.875849 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2fef999a-769d-4633-bb27-88f8aa054a1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:07.972880 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2fef999a-769d-4633-bb27-88f8aa054a1c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "POST /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46/action" status: 202 len: 0 microversion: 2.1 time: 0.110149 Feb 19 21:56:07.976559 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3206/6500] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 21:56:07 2022] POST /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 21:56:07.981439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5c0c4872-d4c2-48bd-91ca-ee0b6fc9a0b3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:07.982074 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5c0c4872-d4c2-48bd-91ca-ee0b6fc9a0b3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:07.988497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c0c4872-d4c2-48bd-91ca-ee0b6fc9a0b3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:07.988967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c0c4872-d4c2-48bd-91ca-ee0b6fc9a0b3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:07.989770 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c0c4872-d4c2-48bd-91ca-ee0b6fc9a0b3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:07.990230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5c0c4872-d4c2-48bd-91ca-ee0b6fc9a0b3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:08.132681 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5c0c4872-d4c2-48bd-91ca-ee0b6fc9a0b3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:08.139980 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5c0c4872-d4c2-48bd-91ca-ee0b6fc9a0b3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1631 microversion: 2.1 time: 0.162247 Feb 19 21:56:08.140591 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3295/6501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:07 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1631 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:56:08.634929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-f638e1bb-6397-4126-98e4-7d1c09532f2e req-41e13901-ad7c-4693-bf68-e2c340bf3ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55efb7a9-de53-43af-a75e-23bf2dea8a46", "name": "network-vif-unplugged", "status": "completed", "tag": "3dbb2536-587e-40e3-a8ac-7bf6320069ce"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:56:08.636453 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:56:08.636453 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:56:08.643953 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f638e1bb-6397-4126-98e4-7d1c09532f2e req-41e13901-ad7c-4693-bf68-e2c340bf3ae9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:08.644441 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-f638e1bb-6397-4126-98e4-7d1c09532f2e req-41e13901-ad7c-4693-bf68-e2c340bf3ae9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:08.658423 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.compute.server_external_events [req-f638e1bb-6397-4126-98e4-7d1c09532f2e req-41e13901-ad7c-4693-bf68-e2c340bf3ae9 service nova] Unable to find a host for instance 55efb7a9-de53-43af-a75e-23bf2dea8a46. Dropping event network-vif-unplugged {{(pid=136095) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 19 21:56:08.659612 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-f638e1bb-6397-4126-98e4-7d1c09532f2e req-41e13901-ad7c-4693-bf68-e2c340bf3ae9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028517 Feb 19 21:56:08.660691 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3207/6502] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 19 21:56:09.158383 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27d45f91-e5cf-4e2a-9e01-7d58809203f3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:09.159033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-27d45f91-e5cf-4e2a-9e01-7d58809203f3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:09.165871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27d45f91-e5cf-4e2a-9e01-7d58809203f3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:09.166316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27d45f91-e5cf-4e2a-9e01-7d58809203f3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:09.167098 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27d45f91-e5cf-4e2a-9e01-7d58809203f3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:09.167571 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27d45f91-e5cf-4e2a-9e01-7d58809203f3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:09.312678 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-27d45f91-e5cf-4e2a-9e01-7d58809203f3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:09.319953 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-27d45f91-e5cf-4e2a-9e01-7d58809203f3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1631 microversion: 2.1 time: 0.165369 Feb 19 21:56:09.320551 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3296/6503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:09 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1631 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:10.336975 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2b4416d6-2740-408b-b801-4ac4d9c3e8a7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:10.337585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2b4416d6-2740-408b-b801-4ac4d9c3e8a7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:10.345031 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2b4416d6-2740-408b-b801-4ac4d9c3e8a7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:10.345484 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2b4416d6-2740-408b-b801-4ac4d9c3e8a7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:10.346262 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2b4416d6-2740-408b-b801-4ac4d9c3e8a7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:10.346694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2b4416d6-2740-408b-b801-4ac4d9c3e8a7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:10.559982 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2b4416d6-2740-408b-b801-4ac4d9c3e8a7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:10.568717 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2b4416d6-2740-408b-b801-4ac4d9c3e8a7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.235295 Feb 19 21:56:10.569314 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3208/6504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:10 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:11.595782 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c3fcbea8-bd4c-41f4-ad08-53ee90bddeab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:11.596463 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-c3fcbea8-bd4c-41f4-ad08-53ee90bddeab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:11.607388 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3fcbea8-bd4c-41f4-ad08-53ee90bddeab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:11.607871 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3fcbea8-bd4c-41f4-ad08-53ee90bddeab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:11.608713 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3fcbea8-bd4c-41f4-ad08-53ee90bddeab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:11.609156 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-c3fcbea8-bd4c-41f4-ad08-53ee90bddeab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:11.681742 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-4e517924-44fa-4bed-a78a-9a4c82b4d425 req-35ff7b5d-a9ca-49db-8a84-785668fcbbaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55efb7a9-de53-43af-a75e-23bf2dea8a46", "tag": "3dbb2536-587e-40e3-a8ac-7bf6320069ce"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:56:11.683404 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:56:11.683404 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:56:11.690991 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4e517924-44fa-4bed-a78a-9a4c82b4d425 req-35ff7b5d-a9ca-49db-8a84-785668fcbbaa service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:11.691985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-4e517924-44fa-4bed-a78a-9a4c82b4d425 req-35ff7b5d-a9ca-49db-8a84-785668fcbbaa service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:11.707022 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-4e517924-44fa-4bed-a78a-9a4c82b4d425 req-35ff7b5d-a9ca-49db-8a84-785668fcbbaa service nova] Creating event network-changed:3dbb2536-587e-40e3-a8ac-7bf6320069ce for instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 on nch2-master-1 Feb 19 21:56:11.712357 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-4e517924-44fa-4bed-a78a-9a4c82b4d425 req-35ff7b5d-a9ca-49db-8a84-785668fcbbaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123478 Feb 19 21:56:11.713003 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3209/6505] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:56:11.845856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-c3fcbea8-bd4c-41f4-ad08-53ee90bddeab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:11.865224 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c3fcbea8-bd4c-41f4-ad08-53ee90bddeab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.280386 Feb 19 21:56:11.865840 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3297/6506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:11 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:12.885114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f61fadd8-5272-4d64-b970-ece230e505b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:12.886628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f61fadd8-5272-4d64-b970-ece230e505b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:12.893985 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f61fadd8-5272-4d64-b970-ece230e505b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:12.895298 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f61fadd8-5272-4d64-b970-ece230e505b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:12.896400 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f61fadd8-5272-4d64-b970-ece230e505b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:12.897085 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f61fadd8-5272-4d64-b970-ece230e505b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:13.056706 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f61fadd8-5272-4d64-b970-ece230e505b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:13.066016 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f61fadd8-5272-4d64-b970-ece230e505b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.186353 Feb 19 21:56:13.082297 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3210/6507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:12 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:14.091008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-bad10698-a313-4d89-a979-c7fd1d66242b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:14.091796 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-bad10698-a313-4d89-a979-c7fd1d66242b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:14.098404 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bad10698-a313-4d89-a979-c7fd1d66242b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:14.098869 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bad10698-a313-4d89-a979-c7fd1d66242b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:14.099655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bad10698-a313-4d89-a979-c7fd1d66242b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:14.100110 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-bad10698-a313-4d89-a979-c7fd1d66242b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:14.271430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-bad10698-a313-4d89-a979-c7fd1d66242b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:14.279678 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-bad10698-a313-4d89-a979-c7fd1d66242b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.191827 Feb 19 21:56:14.280594 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3298/6508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:14 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:15.298418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f4004a8e-4e8b-4d41-a87d-c4f10804ce73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:15.300004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f4004a8e-4e8b-4d41-a87d-c4f10804ce73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:15.307020 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4004a8e-4e8b-4d41-a87d-c4f10804ce73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:15.307743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4004a8e-4e8b-4d41-a87d-c4f10804ce73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:15.308855 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4004a8e-4e8b-4d41-a87d-c4f10804ce73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:15.310337 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4004a8e-4e8b-4d41-a87d-c4f10804ce73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:15.478196 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f4004a8e-4e8b-4d41-a87d-c4f10804ce73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:15.486970 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f4004a8e-4e8b-4d41-a87d-c4f10804ce73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.193438 Feb 19 21:56:15.496634 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3211/6509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:15 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:16.505762 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-ce662794-3bd1-4296-8a92-ae3d92e4038e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:16.506548 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-ce662794-3bd1-4296-8a92-ae3d92e4038e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:16.513395 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce662794-3bd1-4296-8a92-ae3d92e4038e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:16.514627 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce662794-3bd1-4296-8a92-ae3d92e4038e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:16.515464 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce662794-3bd1-4296-8a92-ae3d92e4038e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:16.515917 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-ce662794-3bd1-4296-8a92-ae3d92e4038e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:16.670340 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-ce662794-3bd1-4296-8a92-ae3d92e4038e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:16.680718 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-ce662794-3bd1-4296-8a92-ae3d92e4038e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.179485 Feb 19 21:56:16.681377 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3299/6510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:16 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:17.698200 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2591c7f9-b120-4601-9013-d1ef10ab9ab6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:17.698801 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2591c7f9-b120-4601-9013-d1ef10ab9ab6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:17.705962 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2591c7f9-b120-4601-9013-d1ef10ab9ab6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:17.706444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2591c7f9-b120-4601-9013-d1ef10ab9ab6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:17.707230 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2591c7f9-b120-4601-9013-d1ef10ab9ab6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:17.707662 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2591c7f9-b120-4601-9013-d1ef10ab9ab6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:17.863973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2591c7f9-b120-4601-9013-d1ef10ab9ab6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:17.871447 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2591c7f9-b120-4601-9013-d1ef10ab9ab6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.177408 Feb 19 21:56:17.872004 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3212/6511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:17 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:18.889069 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-452b6402-bb47-464c-80f5-3cd8ec6c712e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:18.889686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-452b6402-bb47-464c-80f5-3cd8ec6c712e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:18.896769 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-452b6402-bb47-464c-80f5-3cd8ec6c712e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:18.897594 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-452b6402-bb47-464c-80f5-3cd8ec6c712e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:18.898973 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-452b6402-bb47-464c-80f5-3cd8ec6c712e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:18.899753 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-452b6402-bb47-464c-80f5-3cd8ec6c712e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:19.063699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-452b6402-bb47-464c-80f5-3cd8ec6c712e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:19.080507 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-452b6402-bb47-464c-80f5-3cd8ec6c712e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.195076 Feb 19 21:56:19.081302 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3300/6512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:18 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:56:20.098777 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5ba1ec1f-d9cd-40af-a96f-988b874686dd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:20.099669 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5ba1ec1f-d9cd-40af-a96f-988b874686dd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:20.106716 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ba1ec1f-d9cd-40af-a96f-988b874686dd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:20.107258 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ba1ec1f-d9cd-40af-a96f-988b874686dd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:20.108130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ba1ec1f-d9cd-40af-a96f-988b874686dd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:20.108803 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5ba1ec1f-d9cd-40af-a96f-988b874686dd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:20.253788 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5ba1ec1f-d9cd-40af-a96f-988b874686dd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:20.261727 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5ba1ec1f-d9cd-40af-a96f-988b874686dd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.166659 Feb 19 21:56:20.272255 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3213/6513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:20 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:21.279837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-186526b4-fb4d-422e-98e0-a6c86d0fa883 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:21.280613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-186526b4-fb4d-422e-98e0-a6c86d0fa883 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:21.286864 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-186526b4-fb4d-422e-98e0-a6c86d0fa883 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:21.287320 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-186526b4-fb4d-422e-98e0-a6c86d0fa883 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:21.288097 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-186526b4-fb4d-422e-98e0-a6c86d0fa883 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:21.288565 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-186526b4-fb4d-422e-98e0-a6c86d0fa883 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:21.423438 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-186526b4-fb4d-422e-98e0-a6c86d0fa883 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:21.430899 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-186526b4-fb4d-422e-98e0-a6c86d0fa883 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.155514 Feb 19 21:56:21.431473 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3301/6514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:21 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:56:22.447949 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e7e0eaf-55fb-4f5a-99cf-a6f5640fe1b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:22.448609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1e7e0eaf-55fb-4f5a-99cf-a6f5640fe1b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:22.455480 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e7e0eaf-55fb-4f5a-99cf-a6f5640fe1b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:22.457314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e7e0eaf-55fb-4f5a-99cf-a6f5640fe1b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:22.457314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e7e0eaf-55fb-4f5a-99cf-a6f5640fe1b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:22.457314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e7e0eaf-55fb-4f5a-99cf-a6f5640fe1b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:22.606722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1e7e0eaf-55fb-4f5a-99cf-a6f5640fe1b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:22.614994 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e7e0eaf-55fb-4f5a-99cf-a6f5640fe1b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.170996 Feb 19 21:56:22.615573 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3214/6515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:22 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:23.630978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-27744be1-795d-4185-a332-b498f63f921e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:23.631542 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-27744be1-795d-4185-a332-b498f63f921e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:23.638183 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27744be1-795d-4185-a332-b498f63f921e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:23.638650 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27744be1-795d-4185-a332-b498f63f921e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:23.639437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27744be1-795d-4185-a332-b498f63f921e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:23.639886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-27744be1-795d-4185-a332-b498f63f921e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:23.778496 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-27744be1-795d-4185-a332-b498f63f921e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:23.786267 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-27744be1-795d-4185-a332-b498f63f921e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.158952 Feb 19 21:56:23.786825 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3302/6516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:23 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:24.804235 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-caaa6845-7567-45c7-9f43-8dbcd35aca2d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:24.804915 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-caaa6845-7567-45c7-9f43-8dbcd35aca2d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:24.812471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-caaa6845-7567-45c7-9f43-8dbcd35aca2d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:24.812928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-caaa6845-7567-45c7-9f43-8dbcd35aca2d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:24.813754 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-caaa6845-7567-45c7-9f43-8dbcd35aca2d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:24.814195 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-caaa6845-7567-45c7-9f43-8dbcd35aca2d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:24.954444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-caaa6845-7567-45c7-9f43-8dbcd35aca2d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:24.962006 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-caaa6845-7567-45c7-9f43-8dbcd35aca2d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.161595 Feb 19 21:56:24.962605 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3215/6517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:24 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:25.979031 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7a601cf7-eccf-4c69-971c-a9a308a16357 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:25.979591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7a601cf7-eccf-4c69-971c-a9a308a16357 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:25.987231 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a601cf7-eccf-4c69-971c-a9a308a16357 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:25.987699 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a601cf7-eccf-4c69-971c-a9a308a16357 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:25.988521 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a601cf7-eccf-4c69-971c-a9a308a16357 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:25.988978 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7a601cf7-eccf-4c69-971c-a9a308a16357 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:26.168365 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7a601cf7-eccf-4c69-971c-a9a308a16357 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:26.175879 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7a601cf7-eccf-4c69-971c-a9a308a16357 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.200627 Feb 19 21:56:26.176491 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3303/6518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:25 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:56:27.193304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a4af75c5-0da1-4eb1-a9cc-bcbb5af5432d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:27.193909 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a4af75c5-0da1-4eb1-a9cc-bcbb5af5432d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:27.200928 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a4af75c5-0da1-4eb1-a9cc-bcbb5af5432d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:27.201380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a4af75c5-0da1-4eb1-a9cc-bcbb5af5432d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:27.202153 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a4af75c5-0da1-4eb1-a9cc-bcbb5af5432d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:27.203089 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a4af75c5-0da1-4eb1-a9cc-bcbb5af5432d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:27.338841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a4af75c5-0da1-4eb1-a9cc-bcbb5af5432d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:27.346833 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a4af75c5-0da1-4eb1-a9cc-bcbb5af5432d tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.157253 Feb 19 21:56:27.347408 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3216/6519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:27 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:56:28.363562 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4f94f630-3c0c-4864-8762-6dca5178a114 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:28.364226 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4f94f630-3c0c-4864-8762-6dca5178a114 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:28.371153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f94f630-3c0c-4864-8762-6dca5178a114 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:28.371776 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f94f630-3c0c-4864-8762-6dca5178a114 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:28.372665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f94f630-3c0c-4864-8762-6dca5178a114 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:28.373116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-4f94f630-3c0c-4864-8762-6dca5178a114 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:28.519336 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4f94f630-3c0c-4864-8762-6dca5178a114 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:28.526683 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4f94f630-3c0c-4864-8762-6dca5178a114 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.166835 Feb 19 21:56:28.527283 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3304/6520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:28 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:29.544068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2dfa81a8-2b3d-41a6-941a-9f206355db65 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:29.544690 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2dfa81a8-2b3d-41a6-941a-9f206355db65 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:29.551890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dfa81a8-2b3d-41a6-941a-9f206355db65 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:29.552350 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dfa81a8-2b3d-41a6-941a-9f206355db65 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:29.553176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dfa81a8-2b3d-41a6-941a-9f206355db65 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:29.554751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2dfa81a8-2b3d-41a6-941a-9f206355db65 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:29.698394 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2dfa81a8-2b3d-41a6-941a-9f206355db65 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:29.707025 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2dfa81a8-2b3d-41a6-941a-9f206355db65 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.166621 Feb 19 21:56:29.707617 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3217/6521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:29 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:30.724448 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-17c95555-603b-47a7-8a24-53689777b792 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:30.725092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17c95555-603b-47a7-8a24-53689777b792 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:30.732227 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17c95555-603b-47a7-8a24-53689777b792 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:30.732723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17c95555-603b-47a7-8a24-53689777b792 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:30.733520 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17c95555-603b-47a7-8a24-53689777b792 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:30.734530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17c95555-603b-47a7-8a24-53689777b792 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:30.872986 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17c95555-603b-47a7-8a24-53689777b792 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:30.880704 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-17c95555-603b-47a7-8a24-53689777b792 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.159997 Feb 19 21:56:30.881279 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3305/6522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:30 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:31.179990 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-ef75d4a9-3771-4e68-8256-ac992e8e0d22 req-b8d30378-0722-4b65-98eb-f1a5ae6b0edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55efb7a9-de53-43af-a75e-23bf2dea8a46", "name": "network-vif-plugged", "status": "completed", "tag": "3dbb2536-587e-40e3-a8ac-7bf6320069ce"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:56:31.181586 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:56:31.181586 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:56:31.190166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ef75d4a9-3771-4e68-8256-ac992e8e0d22 req-b8d30378-0722-4b65-98eb-f1a5ae6b0edd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:31.190617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-ef75d4a9-3771-4e68-8256-ac992e8e0d22 req-b8d30378-0722-4b65-98eb-f1a5ae6b0edd service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:31.202057 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-ef75d4a9-3771-4e68-8256-ac992e8e0d22 req-b8d30378-0722-4b65-98eb-f1a5ae6b0edd service nova] Creating event network-vif-plugged:3dbb2536-587e-40e3-a8ac-7bf6320069ce for instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 on nch2-master-1 Feb 19 21:56:31.207642 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-ef75d4a9-3771-4e68-8256-ac992e8e0d22 req-b8d30378-0722-4b65-98eb-f1a5ae6b0edd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031543 Feb 19 21:56:31.208263 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3218/6523] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:56:31.898133 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-5f46e806-754e-4521-b40a-de60abcdcb0c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:31.898760 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-5f46e806-754e-4521-b40a-de60abcdcb0c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:31.905663 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f46e806-754e-4521-b40a-de60abcdcb0c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:31.906439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f46e806-754e-4521-b40a-de60abcdcb0c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:31.907530 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f46e806-754e-4521-b40a-de60abcdcb0c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:31.907988 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-5f46e806-754e-4521-b40a-de60abcdcb0c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:32.048065 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-5f46e806-754e-4521-b40a-de60abcdcb0c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:32.055764 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-5f46e806-754e-4521-b40a-de60abcdcb0c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.161495 Feb 19 21:56:32.056371 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3306/6524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:31 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:33.075351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-cb861333-9efe-46aa-b524-3b1664b47a3f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:33.076057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-cb861333-9efe-46aa-b524-3b1664b47a3f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:33.084174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb861333-9efe-46aa-b524-3b1664b47a3f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:33.085046 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb861333-9efe-46aa-b524-3b1664b47a3f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:33.085837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb861333-9efe-46aa-b524-3b1664b47a3f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:33.086377 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-cb861333-9efe-46aa-b524-3b1664b47a3f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:33.247001 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-cb861333-9efe-46aa-b524-3b1664b47a3f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:33.256417 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-cb861333-9efe-46aa-b524-3b1664b47a3f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1689 microversion: 2.1 time: 0.186115 Feb 19 21:56:33.257016 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3219/6525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:33 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:56:34.273822 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-89f13c5f-43c0-44ee-ae86-01b92fb6507f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:56:34.274430 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-89f13c5f-43c0-44ee-ae86-01b92fb6507f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:56:34.283004 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89f13c5f-43c0-44ee-ae86-01b92fb6507f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:34.283461 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89f13c5f-43c0-44ee-ae86-01b92fb6507f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:34.284259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89f13c5f-43c0-44ee-ae86-01b92fb6507f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:56:34.284743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-89f13c5f-43c0-44ee-ae86-01b92fb6507f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:56:34.439108 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-89f13c5f-43c0-44ee-ae86-01b92fb6507f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:56:34.453109 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-89f13c5f-43c0-44ee-ae86-01b92fb6507f tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1676 microversion: 2.1 time: 0.181797 Feb 19 21:56:34.454382 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3307/6526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:56:34 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:19.616363 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0108c8-c050-43de-855a-b8b7569dfe09] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 21:58:19.618386 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9844344d-8066-4b46-bc2c-44c84a8cabb2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:19.618961 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9844344d-8066-4b46-bc2c-44c84a8cabb2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:19.620409 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-8decb3fb-7812-4a2a-a9dd-1dd4b8682da2 req-44a3d8ed-d42c-43cd-917b-f4b559847daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55efb7a9-de53-43af-a75e-23bf2dea8a46", "tag": "3dbb2536-587e-40e3-a8ac-7bf6320069ce"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:58:19.622037 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:58:19.622037 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:58:19.626079 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9844344d-8066-4b46-bc2c-44c84a8cabb2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:19.626694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9844344d-8066-4b46-bc2c-44c84a8cabb2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:19.627715 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9844344d-8066-4b46-bc2c-44c84a8cabb2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:19.628199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9844344d-8066-4b46-bc2c-44c84a8cabb2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:19.630985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8decb3fb-7812-4a2a-a9dd-1dd4b8682da2 req-44a3d8ed-d42c-43cd-917b-f4b559847daf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:19.630985 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-8decb3fb-7812-4a2a-a9dd-1dd4b8682da2 req-44a3d8ed-d42c-43cd-917b-f4b559847daf service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:19.642248 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-8decb3fb-7812-4a2a-a9dd-1dd4b8682da2 req-44a3d8ed-d42c-43cd-917b-f4b559847daf service nova] Creating event network-changed:3dbb2536-587e-40e3-a8ac-7bf6320069ce for instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 on nch2-master-1 Feb 19 21:58:19.647530 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-8decb3fb-7812-4a2a-a9dd-1dd4b8682da2 req-44a3d8ed-d42c-43cd-917b-f4b559847daf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032882 Feb 19 21:58:19.648226 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3308/6527] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:58:19.663083 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9844344d-8066-4b46-bc2c-44c84a8cabb2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 21:58:19.762086 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9844344d-8066-4b46-bc2c-44c84a8cabb2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "DELETE /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 204 len: 0 microversion: 2.1 time: 0.149470 Feb 19 21:58:19.763199 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3220/6528] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 21:58:19 2022] DELETE /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 21:58:19.775662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f42dd28-87b8-4230-b7e9-1b7cae44f750 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:19.777134 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2f42dd28-87b8-4230-b7e9-1b7cae44f750 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:19.785230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f42dd28-87b8-4230-b7e9-1b7cae44f750 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:19.785834 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f42dd28-87b8-4230-b7e9-1b7cae44f750 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:19.786662 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f42dd28-87b8-4230-b7e9-1b7cae44f750 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:19.787121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f42dd28-87b8-4230-b7e9-1b7cae44f750 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:20.089503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f42dd28-87b8-4230-b7e9-1b7cae44f750 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:20.099684 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f42dd28-87b8-4230-b7e9-1b7cae44f750 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1682 microversion: 2.1 time: 0.329691 Feb 19 21:58:20.100592 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3309/6529] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:19 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1682 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:21.117527 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-588701f1-161f-44bc-be86-43ce88460b87 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:21.118434 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-588701f1-161f-44bc-be86-43ce88460b87 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:21.127033 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-588701f1-161f-44bc-be86-43ce88460b87 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:21.127488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-588701f1-161f-44bc-be86-43ce88460b87 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:21.128276 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-588701f1-161f-44bc-be86-43ce88460b87 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:21.128744 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-588701f1-161f-44bc-be86-43ce88460b87 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:21.298992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-588701f1-161f-44bc-be86-43ce88460b87 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:21.307659 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-588701f1-161f-44bc-be86-43ce88460b87 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1564 microversion: 2.1 time: 0.194267 Feb 19 21:58:21.308259 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3221/6530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:21 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1564 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:58:22.326315 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-7c99fddb-9e48-4952-ba14-4bc5dfb78f16 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:22.327230 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-7c99fddb-9e48-4952-ba14-4bc5dfb78f16 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:22.338839 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c99fddb-9e48-4952-ba14-4bc5dfb78f16 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:22.339434 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c99fddb-9e48-4952-ba14-4bc5dfb78f16 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:22.340130 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c99fddb-9e48-4952-ba14-4bc5dfb78f16 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:22.340613 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-7c99fddb-9e48-4952-ba14-4bc5dfb78f16 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:22.367266 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0108c8-c050-43de-855a-b8b7569dfe09] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43584. Feb 19 21:58:22.399272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-290d35bc-3c11-40dc-aa08-75df8fa5787e req-46ee975d-d8a7-47d5-9b46-d1e4554cd6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55efb7a9-de53-43af-a75e-23bf2dea8a46", "name": "network-vif-deleted", "tag": "3dbb2536-587e-40e3-a8ac-7bf6320069ce"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:58:22.401430 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:58:22.401430 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 21:58:22.414193 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-290d35bc-3c11-40dc-aa08-75df8fa5787e req-46ee975d-d8a7-47d5-9b46-d1e4554cd6fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:22.414964 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-290d35bc-3c11-40dc-aa08-75df8fa5787e req-46ee975d-d8a7-47d5-9b46-d1e4554cd6fe service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:22.431615 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-290d35bc-3c11-40dc-aa08-75df8fa5787e req-46ee975d-d8a7-47d5-9b46-d1e4554cd6fe service nova] Creating event network-vif-deleted:3dbb2536-587e-40e3-a8ac-7bf6320069ce for instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 on nch2-master-1 Feb 19 21:58:22.441129 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-290d35bc-3c11-40dc-aa08-75df8fa5787e req-46ee975d-d8a7-47d5-9b46-d1e4554cd6fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048625 Feb 19 21:58:22.443123 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3222/6531] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 21:58:22.449345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-7c99fddb-9e48-4952-ba14-4bc5dfb78f16 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:22.464380 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-7c99fddb-9e48-4952-ba14-4bc5dfb78f16 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 200 len: 1496 microversion: 2.1 time: 0.142325 Feb 19 21:58:22.465142 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3310/6532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:22 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 1496 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:23.482650 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-993e3bf6-0d69-4f6f-8b36-aaf58290f9a5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:23.483458 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-993e3bf6-0d69-4f6f-8b36-aaf58290f9a5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: 55efb7a9-de53-43af-a75e-23bf2dea8a46] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:23.491174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-993e3bf6-0d69-4f6f-8b36-aaf58290f9a5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:23.491628 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-993e3bf6-0d69-4f6f-8b36-aaf58290f9a5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:23.492465 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-993e3bf6-0d69-4f6f-8b36-aaf58290f9a5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:23.492944 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-993e3bf6-0d69-4f6f-8b36-aaf58290f9a5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:23.507272 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-993e3bf6-0d69-4f6f-8b36-aaf58290f9a5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] HTTP exception thrown: Instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 could not be found. Feb 19 21:58:23.508018 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-993e3bf6-0d69-4f6f-8b36-aaf58290f9a5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Returning 404 to user: Instance 55efb7a9-de53-43af-a75e-23bf2dea8a46 could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 21:58:23.508913 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-993e3bf6-0d69-4f6f-8b36-aaf58290f9a5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46" status: 404 len: 111 microversion: 2.1 time: 0.031170 Feb 19 21:58:23.509489 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3223/6533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:23 2022] GET /compute/v2.1/servers/55efb7a9-de53-43af-a75e-23bf2dea8a46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 21:58:23.705284 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-a49081b3-2201-4d29-806d-aa70846b2f1b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '.version_select at 0x7f6467ed33a0>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:23.708968 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a49081b3-2201-4d29-806d-aa70846b2f1b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [7ef6f57c-af33-4f3d-bc45-3fbd6fb6066c] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 21:58:24.719173 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [None req-a49081b3-2201-4d29-806d-aa70846b2f1b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [7ef6f57c-af33-4f3d-bc45-3fbd6fb6066c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43594. Feb 19 21:58:24.744222 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-a49081b3-2201-4d29-806d-aa70846b2f1b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1277738319" status: 202 len: 0 microversion: 2.1 time: 1.042610 Feb 19 21:58:24.744886 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3311/6534] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 21:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1277738319 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 21:58:24.774186 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c71865b3-1797-4276-92f0-d40b05b8906c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Action: 'create', calling method: .version_select at 0x7f64669fe040>, body: {"keypair": {"name": "tempest-TestShelveInstance-2032168510"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:58:24.799838 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c71865b3-1797-4276-92f0-d40b05b8906c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:58:24.805948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c71865b3-1797-4276-92f0-d40b05b8906c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for user e56dfa82fd8f439fabb876411484f2fc and project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:58:24.820217 ncdv-master-1 devstack@n-api.service[136095]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c71865b3-1797-4276-92f0-d40b05b8906c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [3018c9cb-960e-4a78-bf94-6d8ca815d752] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 21:58:25.827869 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [None req-c71865b3-1797-4276-92f0-d40b05b8906c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [3018c9cb-960e-4a78-bf94-6d8ca815d752] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43598. Feb 19 21:58:26.060766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c71865b3-1797-4276-92f0-d40b05b8906c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:58:26.066217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-c71865b3-1797-4276-92f0-d40b05b8906c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for user e56dfa82fd8f439fabb876411484f2fc and project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'key_pairs'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:58:26.082050 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c71865b3-1797-4276-92f0-d40b05b8906c tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.314667 Feb 19 21:58:26.082674 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3224/6535] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 21:58:24 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:58:30.045584 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1347182579", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2032168510", "security_groups": [{"name": "tempest-secgroup-smoke-206707975"}], "networks": [{"uuid": "15a1c9e8-368f-4444-8b18-de8bd3a7cbbf"}], "block_device_mapping_v2": [{"uuid": "fa69f814-9e36-4b8f-984f-b625d340f350", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:58:30.166319 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] validate_networks() for [('15a1c9e8-368f-4444-8b18-de8bd3a7cbbf', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 21:58:30.610642 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 21:58:30.611082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 21:58:30.611577 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 21:58:30.612034 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 21:58:30.612502 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 21:58:30.621645 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:30.622132 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:30.622968 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:30.623424 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:30.640361 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 21:58:30.647261 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Getting quotas for user e56dfa82fd8f439fabb876411484f2fc and project 8f56cec0383d41f097d9ec75bbddc499. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 21:58:30.705555 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 21:58:30.707714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa69f814-9e36-4b8f-984f-b625d340f350',volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 21:58:30.850988 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [f79b9f5e-52a0-436d-9204-7cef700a80bf] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 21:58:31.859637 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [f79b9f5e-52a0-436d-9204-7cef700a80bf] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43714. Feb 19 21:58:31.863551 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9570e031-ecf8-4685-bf42-f440f5a02c21 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.822549 Feb 19 21:58:31.864268 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3312/6536] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 21:58:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 21:58:31.926061 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-183a7434-83b6-4e3e-ba34-c7158a314172 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:31.926710 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-183a7434-83b6-4e3e-ba34-c7158a314172 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:31.983886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-183a7434-83b6-4e3e-ba34-c7158a314172 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:31.994136 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-183a7434-83b6-4e3e-ba34-c7158a314172 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1089 microversion: 2.1 time: 0.123347 Feb 19 21:58:31.994727 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3225/6537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:31 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1089 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:33.012252 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-01f92698-db78-4799-9baf-90404393ab6a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:33.013826 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-01f92698-db78-4799-9baf-90404393ab6a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:33.078641 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-01f92698-db78-4799-9baf-90404393ab6a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:33.088880 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-01f92698-db78-4799-9baf-90404393ab6a tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1089 microversion: 2.1 time: 0.080986 Feb 19 21:58:33.089479 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3313/6538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:33 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1089 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:34.113960 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-00bfab31-792d-4f38-a8ad-770eabb87ea1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:34.115202 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-00bfab31-792d-4f38-a8ad-770eabb87ea1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:34.180042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-00bfab31-792d-4f38-a8ad-770eabb87ea1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:34.192312 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-00bfab31-792d-4f38-a8ad-770eabb87ea1 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1089 microversion: 2.1 time: 0.082307 Feb 19 21:58:34.193141 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3226/6539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:34 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:35.213421 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f5f26475-c346-49e6-886b-29806321fa13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:35.214058 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f5f26475-c346-49e6-886b-29806321fa13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:35.288979 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f5f26475-c346-49e6-886b-29806321fa13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:35.298666 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f5f26475-c346-49e6-886b-29806321fa13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1089 microversion: 2.1 time: 0.091027 Feb 19 21:58:35.299567 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3314/6540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:35 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1089 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:36.320240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-e0cc4271-dea8-4bf7-bc9d-8f10dd94fc73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:36.321113 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-e0cc4271-dea8-4bf7-bc9d-8f10dd94fc73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:36.329418 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0cc4271-dea8-4bf7-bc9d-8f10dd94fc73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:36.329876 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0cc4271-dea8-4bf7-bc9d-8f10dd94fc73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:36.330683 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0cc4271-dea8-4bf7-bc9d-8f10dd94fc73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:36.331121 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-e0cc4271-dea8-4bf7-bc9d-8f10dd94fc73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:36.396950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-e0cc4271-dea8-4bf7-bc9d-8f10dd94fc73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:36.404843 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-e0cc4271-dea8-4bf7-bc9d-8f10dd94fc73 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1139 microversion: 2.1 time: 0.089305 Feb 19 21:58:36.405438 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3227/6541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:36 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:58:37.430254 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-069b55b5-4b09-42be-8132-ebeb2a843058 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:37.431629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-069b55b5-4b09-42be-8132-ebeb2a843058 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:37.446396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-069b55b5-4b09-42be-8132-ebeb2a843058 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:37.447470 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-069b55b5-4b09-42be-8132-ebeb2a843058 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:37.448838 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-069b55b5-4b09-42be-8132-ebeb2a843058 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:37.449345 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-069b55b5-4b09-42be-8132-ebeb2a843058 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:37.538324 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-069b55b5-4b09-42be-8132-ebeb2a843058 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:37.550454 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-069b55b5-4b09-42be-8132-ebeb2a843058 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1205 microversion: 2.1 time: 0.129455 Feb 19 21:58:37.551960 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3315/6542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:37 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1205 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:38.571780 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-092f285a-db23-4758-bdbf-1db35e3b6395 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:38.572567 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-092f285a-db23-4758-bdbf-1db35e3b6395 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:38.579931 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-092f285a-db23-4758-bdbf-1db35e3b6395 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:38.580433 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-092f285a-db23-4758-bdbf-1db35e3b6395 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:38.581415 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-092f285a-db23-4758-bdbf-1db35e3b6395 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:38.581657 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-092f285a-db23-4758-bdbf-1db35e3b6395 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:38.909723 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-092f285a-db23-4758-bdbf-1db35e3b6395 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:38.918730 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-092f285a-db23-4758-bdbf-1db35e3b6395 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1260 microversion: 2.1 time: 0.353047 Feb 19 21:58:38.919343 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3228/6543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:38 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 21:58:39.043563 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-85c75e5c-5895-42ae-9060-cb3da7a0757e req-a1e95b3d-37d0-4097-a43b-4c30c6e17450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cebcb4d2-c2b0-482f-883f-1797f01ace17", "tag": "c327b26c-57d0-46c4-99e2-f3e9ee2db741"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:58:39.045799 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:58:39.045799 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:58:39.053596 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-85c75e5c-5895-42ae-9060-cb3da7a0757e req-a1e95b3d-37d0-4097-a43b-4c30c6e17450 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:39.054184 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-85c75e5c-5895-42ae-9060-cb3da7a0757e req-a1e95b3d-37d0-4097-a43b-4c30c6e17450 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:39.067922 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-85c75e5c-5895-42ae-9060-cb3da7a0757e req-a1e95b3d-37d0-4097-a43b-4c30c6e17450 service nova] Creating event network-changed:c327b26c-57d0-46c4-99e2-f3e9ee2db741 for instance cebcb4d2-c2b0-482f-883f-1797f01ace17 on nch1-master-1 Feb 19 21:58:39.074844 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-85c75e5c-5895-42ae-9060-cb3da7a0757e req-a1e95b3d-37d0-4097-a43b-4c30c6e17450 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130304 Feb 19 21:58:39.075959 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3316/6544] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:58:39.944044 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-6e81a80d-7fba-42c2-a690-6d8b6532ac41 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:39.945304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-6e81a80d-7fba-42c2-a690-6d8b6532ac41 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:39.957097 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e81a80d-7fba-42c2-a690-6d8b6532ac41 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:39.957761 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e81a80d-7fba-42c2-a690-6d8b6532ac41 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:39.958709 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e81a80d-7fba-42c2-a690-6d8b6532ac41 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:39.959160 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-6e81a80d-7fba-42c2-a690-6d8b6532ac41 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:40.161082 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-6e81a80d-7fba-42c2-a690-6d8b6532ac41 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:40.173116 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-6e81a80d-7fba-42c2-a690-6d8b6532ac41 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1260 microversion: 2.1 time: 0.235722 Feb 19 21:58:40.173732 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3229/6545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:39 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:40.642974 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 21:58:40.643246 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 21:58:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 21:58:41.194222 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2f232d2b-26e7-417a-ad50-703e92afcc3e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:41.194965 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2f232d2b-26e7-417a-ad50-703e92afcc3e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:41.202824 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f232d2b-26e7-417a-ad50-703e92afcc3e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:41.203411 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f232d2b-26e7-417a-ad50-703e92afcc3e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:41.204364 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f232d2b-26e7-417a-ad50-703e92afcc3e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:41.204944 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2f232d2b-26e7-417a-ad50-703e92afcc3e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:41.427755 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2f232d2b-26e7-417a-ad50-703e92afcc3e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:41.437522 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2f232d2b-26e7-417a-ad50-703e92afcc3e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1260 microversion: 2.1 time: 0.249883 Feb 19 21:58:41.438191 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3317/6546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:41 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:42.456905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d570534c-a1c5-4436-bd38-568da87be49b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:42.457880 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d570534c-a1c5-4436-bd38-568da87be49b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:42.468145 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d570534c-a1c5-4436-bd38-568da87be49b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:42.469872 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d570534c-a1c5-4436-bd38-568da87be49b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:42.471697 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d570534c-a1c5-4436-bd38-568da87be49b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:42.472475 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d570534c-a1c5-4436-bd38-568da87be49b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:42.631275 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d570534c-a1c5-4436-bd38-568da87be49b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:42.640087 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d570534c-a1c5-4436-bd38-568da87be49b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1260 microversion: 2.1 time: 0.188163 Feb 19 21:58:42.640711 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3230/6547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:42 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:43.659817 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cc90aa8d-7320-47e3-bccd-96e61019ee54 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:43.660651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cc90aa8d-7320-47e3-bccd-96e61019ee54 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:43.667185 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc90aa8d-7320-47e3-bccd-96e61019ee54 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:43.667686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc90aa8d-7320-47e3-bccd-96e61019ee54 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:43.669033 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc90aa8d-7320-47e3-bccd-96e61019ee54 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:43.669506 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cc90aa8d-7320-47e3-bccd-96e61019ee54 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:43.833955 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cc90aa8d-7320-47e3-bccd-96e61019ee54 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:43.846279 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cc90aa8d-7320-47e3-bccd-96e61019ee54 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1260 microversion: 2.1 time: 0.190765 Feb 19 21:58:43.847244 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3318/6548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:43 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:44.863989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e0c5fd5-7896-488c-934c-e10c054ee987 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:44.864743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1e0c5fd5-7896-488c-934c-e10c054ee987 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:44.872110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e0c5fd5-7896-488c-934c-e10c054ee987 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:44.872703 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e0c5fd5-7896-488c-934c-e10c054ee987 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:44.873508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e0c5fd5-7896-488c-934c-e10c054ee987 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:44.873977 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e0c5fd5-7896-488c-934c-e10c054ee987 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:45.030466 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1e0c5fd5-7896-488c-934c-e10c054ee987 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:45.038132 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e0c5fd5-7896-488c-934c-e10c054ee987 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1260 microversion: 2.1 time: 0.178401 Feb 19 21:58:45.038722 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3231/6549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:44 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:45.515229 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f3784d53-d544-45fb-a067-080d6f12b521 req-b1f7eef7-f74a-4aec-9350-d0605645948c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebcb4d2-c2b0-482f-883f-1797f01ace17", "name": "network-vif-plugged", "status": "completed", "tag": "c327b26c-57d0-46c4-99e2-f3e9ee2db741"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:58:45.517758 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:58:45.517758 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:58:45.527042 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f3784d53-d544-45fb-a067-080d6f12b521 req-b1f7eef7-f74a-4aec-9350-d0605645948c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:45.527497 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f3784d53-d544-45fb-a067-080d6f12b521 req-b1f7eef7-f74a-4aec-9350-d0605645948c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:45.541809 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f3784d53-d544-45fb-a067-080d6f12b521 req-b1f7eef7-f74a-4aec-9350-d0605645948c service nova] Creating event network-vif-plugged:c327b26c-57d0-46c4-99e2-f3e9ee2db741 for instance cebcb4d2-c2b0-482f-883f-1797f01ace17 on nch1-master-1 Feb 19 21:58:45.548247 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f3784d53-d544-45fb-a067-080d6f12b521 req-b1f7eef7-f74a-4aec-9350-d0605645948c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039997 Feb 19 21:58:45.548948 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3319/6550] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 21:58:46.056918 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-52e506ef-64a5-49ad-b65e-372335eb57c3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:46.057673 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-52e506ef-64a5-49ad-b65e-372335eb57c3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:46.066939 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52e506ef-64a5-49ad-b65e-372335eb57c3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:46.067751 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52e506ef-64a5-49ad-b65e-372335eb57c3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:46.069224 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52e506ef-64a5-49ad-b65e-372335eb57c3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:46.069993 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-52e506ef-64a5-49ad-b65e-372335eb57c3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:46.237306 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-52e506ef-64a5-49ad-b65e-372335eb57c3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:46.244857 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-52e506ef-64a5-49ad-b65e-372335eb57c3 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1260 microversion: 2.1 time: 0.191709 Feb 19 21:58:46.245424 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3232/6551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:46 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:47.267090 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-1e758972-6bfe-4353-9d60-41c39b9e44b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:47.267953 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-1e758972-6bfe-4353-9d60-41c39b9e44b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:47.274481 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e758972-6bfe-4353-9d60-41c39b9e44b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:47.274936 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e758972-6bfe-4353-9d60-41c39b9e44b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:47.275725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e758972-6bfe-4353-9d60-41c39b9e44b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:47.276169 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-1e758972-6bfe-4353-9d60-41c39b9e44b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:47.431289 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-1e758972-6bfe-4353-9d60-41c39b9e44b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:47.439282 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-1e758972-6bfe-4353-9d60-41c39b9e44b0 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1444 microversion: 2.1 time: 0.181783 Feb 19 21:58:47.439870 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3320/6552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:47 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1444 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:47.459380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-b77497c9-6060-4c40-b677-e44bd47adb13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 21:58:47.460356 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-b77497c9-6060-4c40-b677-e44bd47adb13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 21:58:47.471734 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b77497c9-6060-4c40-b677-e44bd47adb13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:47.472589 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b77497c9-6060-4c40-b677-e44bd47adb13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:47.473860 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b77497c9-6060-4c40-b677-e44bd47adb13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:47.474314 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-b77497c9-6060-4c40-b677-e44bd47adb13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:47.657460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-b77497c9-6060-4c40-b677-e44bd47adb13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 21:58:47.665188 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-b77497c9-6060-4c40-b677-e44bd47adb13 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1444 microversion: 2.1 time: 0.212255 Feb 19 21:58:47.665795 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3233/6553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 21:58:47 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1444 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 21:58:49.769044 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-3ccbdb1c-973d-43bf-ac9e-277add98b102 req-102d0708-9b37-4e35-afcf-1a1948de72d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cebcb4d2-c2b0-482f-883f-1797f01ace17", "tag": "c327b26c-57d0-46c4-99e2-f3e9ee2db741"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 21:58:49.770947 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 21:58:49.770947 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 21:58:49.785455 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3ccbdb1c-973d-43bf-ac9e-277add98b102 req-102d0708-9b37-4e35-afcf-1a1948de72d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 21:58:49.786443 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-3ccbdb1c-973d-43bf-ac9e-277add98b102 req-102d0708-9b37-4e35-afcf-1a1948de72d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 21:58:49.803433 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-3ccbdb1c-973d-43bf-ac9e-277add98b102 req-102d0708-9b37-4e35-afcf-1a1948de72d9 service nova] Creating event network-changed:c327b26c-57d0-46c4-99e2-f3e9ee2db741 for instance cebcb4d2-c2b0-482f-883f-1797f01ace17 on nch1-master-1 Feb 19 21:58:49.810689 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-3ccbdb1c-973d-43bf-ac9e-277add98b102 req-102d0708-9b37-4e35-afcf-1a1948de72d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048194 Feb 19 21:58:49.812092 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3321/6554] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 21:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:01:03.488521 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-bbbd83a7-a4c9-420d-9a73-3df718a03689 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:01:03.489120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-bbbd83a7-a4c9-420d-9a73-3df718a03689 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:03.491690 ncdv-master-1 devstack@n-api.service[136095]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02a8a3ca-f500-48fe-b8eb-c416084a9cb7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 22:01:03.492701 ncdv-master-1 devstack@n-api.service[136095]: ERROR oslo.messaging._drivers.impl_rabbit [-] [106724db-adde-4356-8365-ad1f06dea86f] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 22:01:03.497251 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbbd83a7-a4c9-420d-9a73-3df718a03689 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:03.497704 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbbd83a7-a4c9-420d-9a73-3df718a03689 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:03.498481 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbbd83a7-a4c9-420d-9a73-3df718a03689 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:03.498930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-bbbd83a7-a4c9-420d-9a73-3df718a03689 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:03.521205 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-bbbd83a7-a4c9-420d-9a73-3df718a03689 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lazy-loading 'flavor' on Instance uuid cebcb4d2-c2b0-482f-883f-1797f01ace17 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 22:01:03.592639 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-bbbd83a7-a4c9-420d-9a73-3df718a03689 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "POST /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17/action" status: 202 len: 0 microversion: 2.1 time: 0.108073 Feb 19 22:01:03.593230 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3234/6555] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 22:01:03 2022] POST /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 22:01:03.599594 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 22:01:03.600569 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0108c8-c050-43de-855a-b8b7569dfe09] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 19 22:01:03.604437 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-45b64753-4428-4cd4-b89d-d7560d8b752e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:03.605151 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-45b64753-4428-4cd4-b89d-d7560d8b752e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:03.612958 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45b64753-4428-4cd4-b89d-d7560d8b752e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:03.613417 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45b64753-4428-4cd4-b89d-d7560d8b752e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:03.614451 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45b64753-4428-4cd4-b89d-d7560d8b752e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:03.614918 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-45b64753-4428-4cd4-b89d-d7560d8b752e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:03.761147 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-45b64753-4428-4cd4-b89d-d7560d8b752e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:03.768846 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-45b64753-4428-4cd4-b89d-d7560d8b752e tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.171088 Feb 19 22:01:03.769425 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3322/6556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:03 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:04.788592 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2719b303-8e08-489b-acc0-72b4b260bccf tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:04.789217 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2719b303-8e08-489b-acc0-72b4b260bccf tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:04.800043 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2719b303-8e08-489b-acc0-72b4b260bccf tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:04.800569 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2719b303-8e08-489b-acc0-72b4b260bccf tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:04.801330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2719b303-8e08-489b-acc0-72b4b260bccf tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:04.801769 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2719b303-8e08-489b-acc0-72b4b260bccf tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:04.812965 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] [02a8a3ca-f500-48fe-b8eb-c416084a9cb7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43882. Feb 19 22:01:04.814046 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] [106724db-adde-4356-8365-ad1f06dea86f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43884. Feb 19 22:01:04.969919 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2719b303-8e08-489b-acc0-72b4b260bccf tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:04.978238 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2719b303-8e08-489b-acc0-72b4b260bccf tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.195103 Feb 19 22:01:04.979155 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3235/6557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:04 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:05.995932 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f168730d-c9e8-4fd0-9b45-de6df6b303ec tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:05.997030 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f168730d-c9e8-4fd0-9b45-de6df6b303ec tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:06.005637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f168730d-c9e8-4fd0-9b45-de6df6b303ec tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:06.006096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f168730d-c9e8-4fd0-9b45-de6df6b303ec tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:06.006885 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f168730d-c9e8-4fd0-9b45-de6df6b303ec tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:06.007332 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f168730d-c9e8-4fd0-9b45-de6df6b303ec tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:06.026138 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43888. Feb 19 22:01:06.026863 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0108c8-c050-43de-855a-b8b7569dfe09] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43890. Feb 19 22:01:06.152638 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f168730d-c9e8-4fd0-9b45-de6df6b303ec tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:06.160142 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f168730d-c9e8-4fd0-9b45-de6df6b303ec tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.168239 Feb 19 22:01:06.160771 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3323/6558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:05 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:07.177454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7250d678-7ac9-44a7-a618-2996b17d7626 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:07.178091 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7250d678-7ac9-44a7-a618-2996b17d7626 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:07.185004 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7250d678-7ac9-44a7-a618-2996b17d7626 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:07.185462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7250d678-7ac9-44a7-a618-2996b17d7626 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:07.186558 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7250d678-7ac9-44a7-a618-2996b17d7626 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:07.187237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7250d678-7ac9-44a7-a618-2996b17d7626 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:07.333538 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7250d678-7ac9-44a7-a618-2996b17d7626 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:07.341172 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7250d678-7ac9-44a7-a618-2996b17d7626 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.167448 Feb 19 22:01:07.341748 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3236/6559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:07 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:08.358665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-2651ff18-a7e9-498a-892c-d8df899b2d98 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:08.359296 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-2651ff18-a7e9-498a-892c-d8df899b2d98 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:08.366024 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2651ff18-a7e9-498a-892c-d8df899b2d98 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:08.366485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2651ff18-a7e9-498a-892c-d8df899b2d98 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:08.367274 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2651ff18-a7e9-498a-892c-d8df899b2d98 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:08.367723 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-2651ff18-a7e9-498a-892c-d8df899b2d98 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:08.502013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-2651ff18-a7e9-498a-892c-d8df899b2d98 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:08.509426 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-2651ff18-a7e9-498a-892c-d8df899b2d98 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.155121 Feb 19 22:01:08.510014 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3324/6560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:08 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:09.526884 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-92fd1e59-c0d8-4b64-b053-dcfd30578a27 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:09.528135 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-92fd1e59-c0d8-4b64-b053-dcfd30578a27 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:09.535724 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92fd1e59-c0d8-4b64-b053-dcfd30578a27 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:09.536167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92fd1e59-c0d8-4b64-b053-dcfd30578a27 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:09.537024 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92fd1e59-c0d8-4b64-b053-dcfd30578a27 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:09.537457 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-92fd1e59-c0d8-4b64-b053-dcfd30578a27 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:09.696950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-92fd1e59-c0d8-4b64-b053-dcfd30578a27 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:09.705084 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-92fd1e59-c0d8-4b64-b053-dcfd30578a27 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.181489 Feb 19 22:01:09.705323 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3237/6561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:09 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:10.730328 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8c84ac2f-ad70-4dbb-89d6-7531ea081905 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:10.731823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8c84ac2f-ad70-4dbb-89d6-7531ea081905 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:10.744423 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c84ac2f-ad70-4dbb-89d6-7531ea081905 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:10.745021 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c84ac2f-ad70-4dbb-89d6-7531ea081905 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:10.747013 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c84ac2f-ad70-4dbb-89d6-7531ea081905 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:10.747711 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8c84ac2f-ad70-4dbb-89d6-7531ea081905 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:10.950060 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8c84ac2f-ad70-4dbb-89d6-7531ea081905 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:10.962230 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8c84ac2f-ad70-4dbb-89d6-7531ea081905 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.237768 Feb 19 22:01:10.962961 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3325/6562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:10 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:11.985471 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-1e02cd5a-c2e3-4ca3-b614-4d9943fb71ae tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:11.986503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-1e02cd5a-c2e3-4ca3-b614-4d9943fb71ae tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:11.995351 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e02cd5a-c2e3-4ca3-b614-4d9943fb71ae tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:11.995802 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e02cd5a-c2e3-4ca3-b614-4d9943fb71ae tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:11.997120 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e02cd5a-c2e3-4ca3-b614-4d9943fb71ae tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:11.997561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-1e02cd5a-c2e3-4ca3-b614-4d9943fb71ae tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:12.153910 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-1e02cd5a-c2e3-4ca3-b614-4d9943fb71ae tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:12.162350 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-1e02cd5a-c2e3-4ca3-b614-4d9943fb71ae tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.184155 Feb 19 22:01:12.162966 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3238/6563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:11 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:13.180419 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-b58d2e0d-0bed-4602-8b98-705659563203 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:13.181050 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-b58d2e0d-0bed-4602-8b98-705659563203 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:13.187881 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b58d2e0d-0bed-4602-8b98-705659563203 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:13.188408 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b58d2e0d-0bed-4602-8b98-705659563203 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:13.189216 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b58d2e0d-0bed-4602-8b98-705659563203 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:13.189673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-b58d2e0d-0bed-4602-8b98-705659563203 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:13.340048 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-b58d2e0d-0bed-4602-8b98-705659563203 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:13.349624 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-b58d2e0d-0bed-4602-8b98-705659563203 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.172815 Feb 19 22:01:13.350219 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3326/6564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:13 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:14.366491 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3e04175c-d803-4551-a070-e52bba8d3d34 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:14.367086 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3e04175c-d803-4551-a070-e52bba8d3d34 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:14.373945 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e04175c-d803-4551-a070-e52bba8d3d34 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:14.374388 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e04175c-d803-4551-a070-e52bba8d3d34 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:14.375179 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e04175c-d803-4551-a070-e52bba8d3d34 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:14.375762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3e04175c-d803-4551-a070-e52bba8d3d34 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:14.531995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3e04175c-d803-4551-a070-e52bba8d3d34 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:14.539664 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3e04175c-d803-4551-a070-e52bba8d3d34 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.176875 Feb 19 22:01:14.540254 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3239/6565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:14 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:15.555889 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-9f3c6bb5-d188-429a-9b07-7f953fab46f9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:15.556604 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-9f3c6bb5-d188-429a-9b07-7f953fab46f9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:15.563310 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f3c6bb5-d188-429a-9b07-7f953fab46f9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:15.563774 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f3c6bb5-d188-429a-9b07-7f953fab46f9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:15.564589 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f3c6bb5-d188-429a-9b07-7f953fab46f9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:15.565040 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-9f3c6bb5-d188-429a-9b07-7f953fab46f9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:15.706688 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-9f3c6bb5-d188-429a-9b07-7f953fab46f9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:15.714241 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-9f3c6bb5-d188-429a-9b07-7f953fab46f9 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.162111 Feb 19 22:01:15.714840 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3327/6566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:15 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:16.734818 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-0bd2ad52-a6d5-4865-9529-b31a385c70f6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:16.735512 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-0bd2ad52-a6d5-4865-9529-b31a385c70f6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:16.742525 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bd2ad52-a6d5-4865-9529-b31a385c70f6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:16.742973 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bd2ad52-a6d5-4865-9529-b31a385c70f6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:16.743795 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bd2ad52-a6d5-4865-9529-b31a385c70f6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:16.744237 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-0bd2ad52-a6d5-4865-9529-b31a385c70f6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:16.884572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-0bd2ad52-a6d5-4865-9529-b31a385c70f6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:16.894759 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-0bd2ad52-a6d5-4865-9529-b31a385c70f6 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1509 microversion: 2.1 time: 0.164532 Feb 19 22:01:16.895371 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3240/6567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:16 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:16.914020 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-61a75d87-623b-4990-aeef-5c5019ec4c72 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:01:16.914590 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-61a75d87-623b-4990-aeef-5c5019ec4c72 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:16.921842 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61a75d87-623b-4990-aeef-5c5019ec4c72 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:16.922316 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61a75d87-623b-4990-aeef-5c5019ec4c72 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:16.923125 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61a75d87-623b-4990-aeef-5c5019ec4c72 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:16.923575 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-61a75d87-623b-4990-aeef-5c5019ec4c72 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:17.014705 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-61a75d87-623b-4990-aeef-5c5019ec4c72 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "POST /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17/action" status: 202 len: 0 microversion: 2.1 time: 0.104570 Feb 19 22:01:17.015422 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3328/6568] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 22:01:16 2022] POST /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 22:01:17.023296 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-3f56ef82-bee3-47ec-bc0c-4644ca53c9b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:17.023905 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-3f56ef82-bee3-47ec-bc0c-4644ca53c9b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:17.030319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f56ef82-bee3-47ec-bc0c-4644ca53c9b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:17.030771 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f56ef82-bee3-47ec-bc0c-4644ca53c9b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:17.031676 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f56ef82-bee3-47ec-bc0c-4644ca53c9b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:17.032116 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-3f56ef82-bee3-47ec-bc0c-4644ca53c9b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:17.223071 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-3f56ef82-bee3-47ec-bc0c-4644ca53c9b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:17.230841 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-3f56ef82-bee3-47ec-bc0c-4644ca53c9b5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1517 microversion: 2.1 time: 0.211142 Feb 19 22:01:17.231413 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3241/6569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:17 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1517 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:18.250743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-8f8a9cdb-9056-4c34-a34a-826dd6388835 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:18.250743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-8f8a9cdb-9056-4c34-a34a-826dd6388835 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:18.257089 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f8a9cdb-9056-4c34-a34a-826dd6388835 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:18.257629 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f8a9cdb-9056-4c34-a34a-826dd6388835 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:18.258524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f8a9cdb-9056-4c34-a34a-826dd6388835 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:18.259043 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-8f8a9cdb-9056-4c34-a34a-826dd6388835 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:18.428292 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-8f8a9cdb-9056-4c34-a34a-826dd6388835 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:18.436476 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-8f8a9cdb-9056-4c34-a34a-826dd6388835 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1517 microversion: 2.1 time: 0.192167 Feb 19 22:01:18.437045 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3329/6570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:18 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:19.454498 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-17c0f85a-0474-4add-ad30-4e8600150390 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:19.455127 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-17c0f85a-0474-4add-ad30-4e8600150390 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:19.461837 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17c0f85a-0474-4add-ad30-4e8600150390 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:19.462287 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17c0f85a-0474-4add-ad30-4e8600150390 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:19.463068 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17c0f85a-0474-4add-ad30-4e8600150390 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:19.463506 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-17c0f85a-0474-4add-ad30-4e8600150390 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:19.618992 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-17c0f85a-0474-4add-ad30-4e8600150390 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:19.633763 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-17c0f85a-0474-4add-ad30-4e8600150390 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1517 microversion: 2.1 time: 0.183512 Feb 19 22:01:19.634389 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3242/6571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:19 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:20.258610 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-fca1f8d2-2a02-4f08-9121-6d2766b8c81b req-b93ecea9-faf3-4aa8-84d8-4e724b9b0fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebcb4d2-c2b0-482f-883f-1797f01ace17", "name": "network-vif-unplugged", "status": "completed", "tag": "c327b26c-57d0-46c4-99e2-f3e9ee2db741"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:01:20.260465 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:01:20.260465 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:01:20.267570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fca1f8d2-2a02-4f08-9121-6d2766b8c81b req-b93ecea9-faf3-4aa8-84d8-4e724b9b0fc1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:20.268121 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-fca1f8d2-2a02-4f08-9121-6d2766b8c81b req-b93ecea9-faf3-4aa8-84d8-4e724b9b0fc1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:20.281412 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.compute.server_external_events [req-fca1f8d2-2a02-4f08-9121-6d2766b8c81b req-b93ecea9-faf3-4aa8-84d8-4e724b9b0fc1 service nova] Unable to find a host for instance cebcb4d2-c2b0-482f-883f-1797f01ace17. Dropping event network-vif-unplugged {{(pid=136094) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 19 22:01:20.282743 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-fca1f8d2-2a02-4f08-9121-6d2766b8c81b req-b93ecea9-faf3-4aa8-84d8-4e724b9b0fc1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089525 Feb 19 22:01:20.283391 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3330/6572] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 19 22:01:20.654455 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d3b88b7c-1352-4d29-8e75-3658cad5e2a2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:20.655114 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-d3b88b7c-1352-4d29-8e75-3658cad5e2a2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:20.663280 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3b88b7c-1352-4d29-8e75-3658cad5e2a2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:20.663668 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3b88b7c-1352-4d29-8e75-3658cad5e2a2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:20.664516 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3b88b7c-1352-4d29-8e75-3658cad5e2a2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:20.664987 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-d3b88b7c-1352-4d29-8e75-3658cad5e2a2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:20.829767 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-d3b88b7c-1352-4d29-8e75-3658cad5e2a2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:20.837751 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d3b88b7c-1352-4d29-8e75-3658cad5e2a2 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1519 microversion: 2.1 time: 0.190322 Feb 19 22:01:20.838333 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3243/6573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:20 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:21.855297 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-67047086-d586-4dd4-8966-1e01572e8bac tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:21.855840 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-67047086-d586-4dd4-8966-1e01572e8bac tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:21.862914 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67047086-d586-4dd4-8966-1e01572e8bac tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:21.863384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67047086-d586-4dd4-8966-1e01572e8bac tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:21.864186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67047086-d586-4dd4-8966-1e01572e8bac tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:21.864671 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-67047086-d586-4dd4-8966-1e01572e8bac tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:22.014283 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-67047086-d586-4dd4-8966-1e01572e8bac tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:22.022164 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-67047086-d586-4dd4-8966-1e01572e8bac tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1575 microversion: 2.1 time: 0.170907 Feb 19 22:01:22.022764 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3331/6574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:21 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:23.039774 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-208926a8-7164-46eb-bffe-022bcef45a35 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:23.040431 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-208926a8-7164-46eb-bffe-022bcef45a35 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:23.047752 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208926a8-7164-46eb-bffe-022bcef45a35 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:23.048206 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208926a8-7164-46eb-bffe-022bcef45a35 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:23.049040 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208926a8-7164-46eb-bffe-022bcef45a35 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:23.049472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-208926a8-7164-46eb-bffe-022bcef45a35 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:23.196130 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-208926a8-7164-46eb-bffe-022bcef45a35 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:23.207903 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-208926a8-7164-46eb-bffe-022bcef45a35 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1575 microversion: 2.1 time: 0.171714 Feb 19 22:01:23.208543 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3244/6575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:23 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:24.231731 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-071c01e4-02a6-446d-8576-018f88f445bc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:24.232426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-071c01e4-02a6-446d-8576-018f88f445bc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:24.239173 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-071c01e4-02a6-446d-8576-018f88f445bc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:24.239682 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-071c01e4-02a6-446d-8576-018f88f445bc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:24.240595 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-071c01e4-02a6-446d-8576-018f88f445bc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:24.241082 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-071c01e4-02a6-446d-8576-018f88f445bc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:24.407286 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-071c01e4-02a6-446d-8576-018f88f445bc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:24.414793 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-071c01e4-02a6-446d-8576-018f88f445bc tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1575 microversion: 2.1 time: 0.186844 Feb 19 22:01:24.415366 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3332/6576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:24 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 22:01:25.432658 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-469283c4-13ed-4190-8c7a-8f8543b4224b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:25.433300 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-469283c4-13ed-4190-8c7a-8f8543b4224b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:25.441243 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-469283c4-13ed-4190-8c7a-8f8543b4224b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:25.441691 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-469283c4-13ed-4190-8c7a-8f8543b4224b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:25.442472 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-469283c4-13ed-4190-8c7a-8f8543b4224b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:25.442906 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-469283c4-13ed-4190-8c7a-8f8543b4224b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:25.581223 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-469283c4-13ed-4190-8c7a-8f8543b4224b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:25.588915 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-469283c4-13ed-4190-8c7a-8f8543b4224b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1575 microversion: 2.1 time: 0.160298 Feb 19 22:01:25.589498 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3245/6577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:25 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 22:01:26.250637 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f5a2539d-982e-496b-a92a-9c99e13e9e64 req-c92ea78d-d3ae-49a8-839a-3b47842b32d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebcb4d2-c2b0-482f-883f-1797f01ace17", "name": "network-vif-plugged", "status": "completed", "tag": "c327b26c-57d0-46c4-99e2-f3e9ee2db741"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:01:26.252053 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:01:26.252053 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:01:26.260971 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f5a2539d-982e-496b-a92a-9c99e13e9e64 req-c92ea78d-d3ae-49a8-839a-3b47842b32d8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:26.261428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f5a2539d-982e-496b-a92a-9c99e13e9e64 req-c92ea78d-d3ae-49a8-839a-3b47842b32d8 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:26.273396 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f5a2539d-982e-496b-a92a-9c99e13e9e64 req-c92ea78d-d3ae-49a8-839a-3b47842b32d8 service nova] Creating event network-vif-plugged:c327b26c-57d0-46c4-99e2-f3e9ee2db741 for instance cebcb4d2-c2b0-482f-883f-1797f01ace17 on nch1-master-1 Feb 19 22:01:26.278617 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f5a2539d-982e-496b-a92a-9c99e13e9e64 req-c92ea78d-d3ae-49a8-839a-3b47842b32d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032174 Feb 19 22:01:26.279287 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3333/6578] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:01:26.608199 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-f4de63df-ad87-4c33-b2ff-00cf5550e5e5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:26.609128 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-f4de63df-ad87-4c33-b2ff-00cf5550e5e5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:26.615891 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4de63df-ad87-4c33-b2ff-00cf5550e5e5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:26.616380 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4de63df-ad87-4c33-b2ff-00cf5550e5e5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:26.617174 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4de63df-ad87-4c33-b2ff-00cf5550e5e5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:26.617617 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-f4de63df-ad87-4c33-b2ff-00cf5550e5e5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:26.768269 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-f4de63df-ad87-4c33-b2ff-00cf5550e5e5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:26.777439 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-f4de63df-ad87-4c33-b2ff-00cf5550e5e5 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1575 microversion: 2.1 time: 0.173430 Feb 19 22:01:26.778044 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3246/6579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:26 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:01:27.797092 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-40079bc1-b46d-4852-8866-e94d96f03c30 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:01:27.797805 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-40079bc1-b46d-4852-8866-e94d96f03c30 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:01:27.804003 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40079bc1-b46d-4852-8866-e94d96f03c30 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:27.804504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40079bc1-b46d-4852-8866-e94d96f03c30 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:27.805298 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40079bc1-b46d-4852-8866-e94d96f03c30 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:01:27.805743 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-40079bc1-b46d-4852-8866-e94d96f03c30 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:01:27.949725 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-40079bc1-b46d-4852-8866-e94d96f03c30 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:01:27.957701 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-40079bc1-b46d-4852-8866-e94d96f03c30 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1562 microversion: 2.1 time: 0.166153 Feb 19 22:01:27.958209 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3334/6580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:01:27 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:02:00.652295 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:02:00.652947 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 22:02:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:02:53.449627 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-087a3573-d144-4f42-8927-4720658701b7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:02:53.451104 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-087a3573-d144-4f42-8927-4720658701b7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:02:53.456515 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-087a3573-d144-4f42-8927-4720658701b7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:53.456950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-087a3573-d144-4f42-8927-4720658701b7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:53.457989 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-087a3573-d144-4f42-8927-4720658701b7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:53.458633 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-087a3573-d144-4f42-8927-4720658701b7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:53.490058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-087a3573-d144-4f42-8927-4720658701b7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 22:02:53.554171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-874ef790-0473-46a3-83a2-cb488e444e76 req-e94de1b3-1a4c-4be3-becc-5d347ece68bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cebcb4d2-c2b0-482f-883f-1797f01ace17", "tag": "c327b26c-57d0-46c4-99e2-f3e9ee2db741"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:02:53.555854 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:02:53.555854 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:02:53.564517 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-874ef790-0473-46a3-83a2-cb488e444e76 req-e94de1b3-1a4c-4be3-becc-5d347ece68bb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:53.564970 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-874ef790-0473-46a3-83a2-cb488e444e76 req-e94de1b3-1a4c-4be3-becc-5d347ece68bb service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:53.577685 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-874ef790-0473-46a3-83a2-cb488e444e76 req-e94de1b3-1a4c-4be3-becc-5d347ece68bb service nova] Creating event network-changed:c327b26c-57d0-46c4-99e2-f3e9ee2db741 for instance cebcb4d2-c2b0-482f-883f-1797f01ace17 on nch1-master-1 Feb 19 22:02:53.583599 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-874ef790-0473-46a3-83a2-cb488e444e76 req-e94de1b3-1a4c-4be3-becc-5d347ece68bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137092 Feb 19 22:02:53.584644 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3335/6581] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 22:02:53.632949 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-087a3573-d144-4f42-8927-4720658701b7 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 204 len: 0 microversion: 2.1 time: 0.188643 Feb 19 22:02:53.634108 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3247/6582] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 22:02:53 2022] DELETE /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 22:02:53.646819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-93c89b5b-48da-4e34-adf6-8ea3f2600eab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:02:53.647949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-93c89b5b-48da-4e34-adf6-8ea3f2600eab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:02:53.661705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93c89b5b-48da-4e34-adf6-8ea3f2600eab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:53.661705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93c89b5b-48da-4e34-adf6-8ea3f2600eab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:53.661705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93c89b5b-48da-4e34-adf6-8ea3f2600eab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:53.661705 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-93c89b5b-48da-4e34-adf6-8ea3f2600eab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:53.841763 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-93c89b5b-48da-4e34-adf6-8ea3f2600eab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:02:53.851380 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-93c89b5b-48da-4e34-adf6-8ea3f2600eab tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1568 microversion: 2.1 time: 0.210614 Feb 19 22:02:53.851993 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3336/6583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:02:53 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:02:54.870072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57180362-20ac-496b-833d-bffa2ace6cdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:02:54.870997 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57180362-20ac-496b-833d-bffa2ace6cdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:02:54.879212 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57180362-20ac-496b-833d-bffa2ace6cdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:54.879663 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57180362-20ac-496b-833d-bffa2ace6cdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:54.880493 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57180362-20ac-496b-833d-bffa2ace6cdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:54.880933 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57180362-20ac-496b-833d-bffa2ace6cdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:55.327137 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-57180362-20ac-496b-833d-bffa2ace6cdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:02:55.339676 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57180362-20ac-496b-833d-bffa2ace6cdd tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1450 microversion: 2.1 time: 0.473650 Feb 19 22:02:55.340282 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3248/6584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:02:54 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1450 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 22:02:55.769428 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-15cc9b68-72a5-4d76-b397-57e8ec432578 req-3843c0bd-053a-4911-a0d6-de59844e8894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebcb4d2-c2b0-482f-883f-1797f01ace17", "name": "network-vif-deleted", "tag": "c327b26c-57d0-46c4-99e2-f3e9ee2db741"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:02:55.772055 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:02:55.772055 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:02:55.784710 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-15cc9b68-72a5-4d76-b397-57e8ec432578 req-3843c0bd-053a-4911-a0d6-de59844e8894 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:55.785167 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-15cc9b68-72a5-4d76-b397-57e8ec432578 req-3843c0bd-053a-4911-a0d6-de59844e8894 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:55.798530 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-15cc9b68-72a5-4d76-b397-57e8ec432578 req-3843c0bd-053a-4911-a0d6-de59844e8894 service nova] Creating event network-vif-deleted:c327b26c-57d0-46c4-99e2-f3e9ee2db741 for instance cebcb4d2-c2b0-482f-883f-1797f01ace17 on nch1-master-1 Feb 19 22:02:55.805804 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-15cc9b68-72a5-4d76-b397-57e8ec432578 req-3843c0bd-053a-4911-a0d6-de59844e8894 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043396 Feb 19 22:02:55.806414 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3337/6585] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:02:56.360661 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:02:56.361885 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:02:56.371006 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:56.371462 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:56.372272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:56.372841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:56.422682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:56.424167 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:56.425134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lazy-loading 'fault' on Instance uuid cebcb4d2-c2b0-482f-883f-1797f01ace17 {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 22:02:56.498539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56dfa82fd8f439fabb876411484f2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f56cec0383d41f097d9ec75bbddc499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:02:56.515130 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-279ffdfb-fa1f-4347-aca7-a883fe896294 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 200 len: 1179 microversion: 2.1 time: 0.158138 Feb 19 22:02:56.528872 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3249/6586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:02:56 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 1179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:02:57.540442 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-58b8774c-dba2-435d-ab2d-c6e942117a69 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:02:57.541153 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-58b8774c-dba2-435d-ab2d-c6e942117a69 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [instance: cebcb4d2-c2b0-482f-883f-1797f01ace17] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:02:57.547910 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58b8774c-dba2-435d-ab2d-c6e942117a69 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:57.548405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58b8774c-dba2-435d-ab2d-c6e942117a69 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:57.549259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58b8774c-dba2-435d-ab2d-c6e942117a69 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:02:57.549655 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-58b8774c-dba2-435d-ab2d-c6e942117a69 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:02:57.563722 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-58b8774c-dba2-435d-ab2d-c6e942117a69 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] HTTP exception thrown: Instance cebcb4d2-c2b0-482f-883f-1797f01ace17 could not be found. Feb 19 22:02:57.564849 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-58b8774c-dba2-435d-ab2d-c6e942117a69 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Returning 404 to user: Instance cebcb4d2-c2b0-482f-883f-1797f01ace17 could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 22:02:57.565697 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-58b8774c-dba2-435d-ab2d-c6e942117a69 tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17" status: 404 len: 111 microversion: 2.1 time: 0.030662 Feb 19 22:02:57.566248 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3338/6587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:02:57 2022] GET /compute/v2.1/servers/cebcb4d2-c2b0-482f-883f-1797f01ace17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 22:02:57.753890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-d7efd3d2-b4f5-4988-b924-9cbab2caaa8b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] Calling method '.version_select at 0x7f646692c1f0>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:02:57.761068 ncdv-master-1 devstack@n-api.service[136095]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d7efd3d2-b4f5-4988-b924-9cbab2caaa8b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [3018c9cb-960e-4a78-bf94-6d8ca815d752] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 22:02:58.768098 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [None req-d7efd3d2-b4f5-4988-b924-9cbab2caaa8b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] [3018c9cb-960e-4a78-bf94-6d8ca815d752] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44082. Feb 19 22:02:58.789372 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-d7efd3d2-b4f5-4988-b924-9cbab2caaa8b tempest-TestShelveInstance-2110534879 tempest-TestShelveInstance-2110534879-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2032168510" status: 202 len: 0 microversion: 2.1 time: 1.040058 Feb 19 22:02:58.790183 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3250/6588] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Feb 19 22:02:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2032168510 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 22:03:18.710927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-c9347a63-29b1-4a7e-ac5b-d547da080a90 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Action: 'create', calling method: .version_select at 0x7f6466f7bf70>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2115511971"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:03:18.726504 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c9347a63-29b1-4a7e-ac5b-d547da080a90 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Getting quotas for project 57600659895e4232b2c6533b3c277c0c. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 22:03:18.733095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c9347a63-29b1-4a7e-ac5b-d547da080a90 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Getting quotas for user ac4eb10318e6452cbe3ccaa35ac40e92 and project 57600659895e4232b2c6533b3c277c0c. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 22:03:18.746618 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c9347a63-29b1-4a7e-ac5b-d547da080a90 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [7ef6f57c-af33-4f3d-bc45-3fbd6fb6066c] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 22:03:19.754074 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [None req-c9347a63-29b1-4a7e-ac5b-d547da080a90 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [7ef6f57c-af33-4f3d-bc45-3fbd6fb6066c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44174. Feb 19 22:03:19.973096 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c9347a63-29b1-4a7e-ac5b-d547da080a90 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Getting quotas for project 57600659895e4232b2c6533b3c277c0c. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 22:03:19.977949 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-c9347a63-29b1-4a7e-ac5b-d547da080a90 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Getting quotas for user ac4eb10318e6452cbe3ccaa35ac40e92 and project 57600659895e4232b2c6533b3c277c0c. Resources: {'key_pairs'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 22:03:19.993514 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-c9347a63-29b1-4a7e-ac5b-d547da080a90 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.480120 Feb 19 22:03:19.994118 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3339/6589] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Feb 19 22:03:18 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:21.116096 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1822115731", "imageRef": "f75529b9-2911-475e-b974-4af06053c17c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2115511971", "security_groups": [{"name": "tempest-secgroup-smoke-745701803"}], "networks": [{"uuid": "c0cb96b0-0fc0-445b-9efa-dc2ca068848a"}]}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:03:21.227682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.network.neutron [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] validate_networks() for [('c0cb96b0-0fc0-445b-9efa-dc2ca068848a', None, None, None, None, None)] {{(pid=136095) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 22:03:21.736940 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Flavor limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 22:03:21.737373 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Image limits 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 22:03:21.737890 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Flavor pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 22:03:21.738307 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Image pref 0:0:0 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 22:03:21.738948 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.virt.hardware [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 22:03:21.749572 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:21.750304 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:21.751363 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:21.752008 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:21.772278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Getting quotas for project 57600659895e4232b2c6533b3c277c0c. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 22:03:21.778686 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.quota [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Getting quotas for user ac4eb10318e6452cbe3ccaa35ac40e92 and project 57600659895e4232b2c6533b3c277c0c. Resources: {'instances', 'cores', 'ram'} {{(pid=136095) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 22:03:21.794503 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Going to run 1 instances... {{(pid=136095) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 22:03:21.797101 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f75529b9-2911-475e-b974-4af06053c17c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136095) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 22:03:21.853746 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-825ad8af-b802-4703-8c35-8dc0d0d9d4b0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.742232 Feb 19 22:03:21.859494 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3251/6590] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 22:03:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 22:03:21.866644 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-4a067b8d-e6f5-47db-9460-c1d9be136447 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:21.867959 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-4a067b8d-e6f5-47db-9460-c1d9be136447 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:21.928927 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-4a067b8d-e6f5-47db-9460-c1d9be136447 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:21.935855 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-4a067b8d-e6f5-47db-9460-c1d9be136447 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1249 microversion: 2.1 time: 0.073967 Feb 19 22:03:21.940149 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3340/6591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:21 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:22.966478 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-02a2f698-43fc-48c3-a462-a5906b405e15 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:22.971366 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-02a2f698-43fc-48c3-a462-a5906b405e15 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:23.000166 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02a2f698-43fc-48c3-a462-a5906b405e15 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:23.004747 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02a2f698-43fc-48c3-a462-a5906b405e15 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:23.006371 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02a2f698-43fc-48c3-a462-a5906b405e15 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:23.008591 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-02a2f698-43fc-48c3-a462-a5906b405e15 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:23.117861 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-02a2f698-43fc-48c3-a462-a5906b405e15 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:23.126489 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-02a2f698-43fc-48c3-a462-a5906b405e15 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1309 microversion: 2.1 time: 0.171668 Feb 19 22:03:23.137122 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3252/6592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:22 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1309 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:24.143748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-3a6fa345-5e15-420e-adbc-9265e8efb5fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:24.144396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-3a6fa345-5e15-420e-adbc-9265e8efb5fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:24.151837 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a6fa345-5e15-420e-adbc-9265e8efb5fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:24.152302 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a6fa345-5e15-420e-adbc-9265e8efb5fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:24.153138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a6fa345-5e15-420e-adbc-9265e8efb5fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:24.153586 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-3a6fa345-5e15-420e-adbc-9265e8efb5fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:24.313019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-3a6fa345-5e15-420e-adbc-9265e8efb5fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:24.327800 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-3a6fa345-5e15-420e-adbc-9265e8efb5fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1374 microversion: 2.1 time: 0.188137 Feb 19 22:03:24.328471 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3341/6593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:24 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 22:03:24.801453 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-02e44200-4bba-4729-8c1c-647229a63616 req-f35c0989-c064-4f2b-824e-3b5f6aead8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97457988-b02a-43ef-a775-7faa6cc9268d", "tag": "bf13c8cc-d258-49d5-b65e-01b293faaa06"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:03:24.804274 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:03:24.804274 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 22:03:24.817074 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-02e44200-4bba-4729-8c1c-647229a63616 req-f35c0989-c064-4f2b-824e-3b5f6aead8f4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:24.817886 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-02e44200-4bba-4729-8c1c-647229a63616 req-f35c0989-c064-4f2b-824e-3b5f6aead8f4 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:24.838081 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-02e44200-4bba-4729-8c1c-647229a63616 req-f35c0989-c064-4f2b-824e-3b5f6aead8f4 service nova] Creating event network-changed:bf13c8cc-d258-49d5-b65e-01b293faaa06 for instance 97457988-b02a-43ef-a775-7faa6cc9268d on nch1-master-1 Feb 19 22:03:24.844016 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-02e44200-4bba-4729-8c1c-647229a63616 req-f35c0989-c064-4f2b-824e-3b5f6aead8f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048013 Feb 19 22:03:24.851362 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3253/6594] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:03:25.349049 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-414d0712-fbd6-4d3a-b9ad-1e8887f5d1c7 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:25.349707 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-414d0712-fbd6-4d3a-b9ad-1e8887f5d1c7 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:25.356636 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-414d0712-fbd6-4d3a-b9ad-1e8887f5d1c7 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:25.357095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-414d0712-fbd6-4d3a-b9ad-1e8887f5d1c7 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:25.357895 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-414d0712-fbd6-4d3a-b9ad-1e8887f5d1c7 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:25.358337 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-414d0712-fbd6-4d3a-b9ad-1e8887f5d1c7 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:25.518619 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-414d0712-fbd6-4d3a-b9ad-1e8887f5d1c7 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:25.526442 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-414d0712-fbd6-4d3a-b9ad-1e8887f5d1c7 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1374 microversion: 2.1 time: 0.181650 Feb 19 22:03:25.527024 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3342/6595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:25 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:26.548084 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ee458b13-d8de-4c19-87c2-6a08507d559c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:26.549341 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ee458b13-d8de-4c19-87c2-6a08507d559c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:26.556107 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee458b13-d8de-4c19-87c2-6a08507d559c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:26.556593 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee458b13-d8de-4c19-87c2-6a08507d559c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:26.557391 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee458b13-d8de-4c19-87c2-6a08507d559c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:26.557835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ee458b13-d8de-4c19-87c2-6a08507d559c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:26.703072 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ee458b13-d8de-4c19-87c2-6a08507d559c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:26.710042 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ee458b13-d8de-4c19-87c2-6a08507d559c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1374 microversion: 2.1 time: 0.168371 Feb 19 22:03:26.710620 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3254/6596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:26 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:27.728149 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-20d63fbc-74a7-45d8-ae4d-f4b630b91518 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:27.728886 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-20d63fbc-74a7-45d8-ae4d-f4b630b91518 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:27.736238 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20d63fbc-74a7-45d8-ae4d-f4b630b91518 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:27.736726 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20d63fbc-74a7-45d8-ae4d-f4b630b91518 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:27.737524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20d63fbc-74a7-45d8-ae4d-f4b630b91518 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:27.737966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20d63fbc-74a7-45d8-ae4d-f4b630b91518 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:27.877686 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-20d63fbc-74a7-45d8-ae4d-f4b630b91518 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:27.885104 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-20d63fbc-74a7-45d8-ae4d-f4b630b91518 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1374 microversion: 2.1 time: 0.160619 Feb 19 22:03:27.885720 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3343/6597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:27 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:28.902058 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9521ee4f-ba4a-4c14-bcef-e46bf3d652b1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:28.902792 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9521ee4f-ba4a-4c14-bcef-e46bf3d652b1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:28.909995 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9521ee4f-ba4a-4c14-bcef-e46bf3d652b1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:28.910454 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9521ee4f-ba4a-4c14-bcef-e46bf3d652b1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:28.911267 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9521ee4f-ba4a-4c14-bcef-e46bf3d652b1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:28.911718 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9521ee4f-ba4a-4c14-bcef-e46bf3d652b1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:28.964535 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-a727b8ad-2783-4695-b1ed-6fe7c344c41c req-144989c3-c0ca-4d7c-8aa1-a1da8ed7dbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97457988-b02a-43ef-a775-7faa6cc9268d", "name": "network-vif-plugged", "status": "completed", "tag": "bf13c8cc-d258-49d5-b65e-01b293faaa06"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:03:28.967187 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:03:28.967187 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:03:28.976789 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a727b8ad-2783-4695-b1ed-6fe7c344c41c req-144989c3-c0ca-4d7c-8aa1-a1da8ed7dbe1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:28.977413 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-a727b8ad-2783-4695-b1ed-6fe7c344c41c req-144989c3-c0ca-4d7c-8aa1-a1da8ed7dbe1 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:28.990071 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-a727b8ad-2783-4695-b1ed-6fe7c344c41c req-144989c3-c0ca-4d7c-8aa1-a1da8ed7dbe1 service nova] Creating event network-vif-plugged:bf13c8cc-d258-49d5-b65e-01b293faaa06 for instance 97457988-b02a-43ef-a775-7faa6cc9268d on nch1-master-1 Feb 19 22:03:28.996616 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-a727b8ad-2783-4695-b1ed-6fe7c344c41c req-144989c3-c0ca-4d7c-8aa1-a1da8ed7dbe1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035780 Feb 19 22:03:28.997864 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3344/6598] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 22:03:29.071731 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9521ee4f-ba4a-4c14-bcef-e46bf3d652b1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:29.081450 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9521ee4f-ba4a-4c14-bcef-e46bf3d652b1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1374 microversion: 2.1 time: 0.183035 Feb 19 22:03:29.082075 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3255/6599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:28 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:30.100460 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-17046f17-547e-44a8-a09d-9321f33b8bd8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:30.101381 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-17046f17-547e-44a8-a09d-9321f33b8bd8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:30.110734 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17046f17-547e-44a8-a09d-9321f33b8bd8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:30.111203 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17046f17-547e-44a8-a09d-9321f33b8bd8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:30.112692 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17046f17-547e-44a8-a09d-9321f33b8bd8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:30.113164 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-17046f17-547e-44a8-a09d-9321f33b8bd8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:30.270524 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-17046f17-547e-44a8-a09d-9321f33b8bd8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:30.278539 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-17046f17-547e-44a8-a09d-9321f33b8bd8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1374 microversion: 2.1 time: 0.183449 Feb 19 22:03:30.279434 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3345/6600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:30 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:31.296983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-745c41bb-9775-43ed-b4f8-552dded26736 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:31.297923 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-745c41bb-9775-43ed-b4f8-552dded26736 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:31.305775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-745c41bb-9775-43ed-b4f8-552dded26736 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:31.306225 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-745c41bb-9775-43ed-b4f8-552dded26736 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:31.307057 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-745c41bb-9775-43ed-b4f8-552dded26736 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:31.307492 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-745c41bb-9775-43ed-b4f8-552dded26736 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:31.455870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-745c41bb-9775-43ed-b4f8-552dded26736 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:31.464747 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-745c41bb-9775-43ed-b4f8-552dded26736 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1559 microversion: 2.1 time: 0.171742 Feb 19 22:03:31.465531 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3256/6601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:31 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:31.482844 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-180cf2f1-0fbc-4d8f-8dff-16d9bfb40e6a tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:03:31.483494 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-180cf2f1-0fbc-4d8f-8dff-16d9bfb40e6a tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:03:31.490384 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-180cf2f1-0fbc-4d8f-8dff-16d9bfb40e6a tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:31.490855 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-180cf2f1-0fbc-4d8f-8dff-16d9bfb40e6a tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:31.491667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-180cf2f1-0fbc-4d8f-8dff-16d9bfb40e6a tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:31.492131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-180cf2f1-0fbc-4d8f-8dff-16d9bfb40e6a tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:31.635847 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-180cf2f1-0fbc-4d8f-8dff-16d9bfb40e6a tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:03:31.644039 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-180cf2f1-0fbc-4d8f-8dff-16d9bfb40e6a tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1559 microversion: 2.1 time: 0.165784 Feb 19 22:03:31.644665 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3346/6602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:03:31 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:03:33.570858 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-34c17bfb-0410-460c-9694-24ae8887e24b req-4d08d314-aee5-4e7a-b285-34c9c9845457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97457988-b02a-43ef-a775-7faa6cc9268d", "tag": "bf13c8cc-d258-49d5-b65e-01b293faaa06"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:03:33.572478 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:03:33.572478 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 22:03:33.580869 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-34c17bfb-0410-460c-9694-24ae8887e24b req-4d08d314-aee5-4e7a-b285-34c9c9845457 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:03:33.581318 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-34c17bfb-0410-460c-9694-24ae8887e24b req-4d08d314-aee5-4e7a-b285-34c9c9845457 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:03:33.592773 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-34c17bfb-0410-460c-9694-24ae8887e24b req-4d08d314-aee5-4e7a-b285-34c9c9845457 service nova] Creating event network-changed:bf13c8cc-d258-49d5-b65e-01b293faaa06 for instance 97457988-b02a-43ef-a775-7faa6cc9268d on nch1-master-1 Feb 19 22:03:33.598480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-34c17bfb-0410-460c-9694-24ae8887e24b req-4d08d314-aee5-4e7a-b285-34c9c9845457 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031339 Feb 19 22:03:33.599294 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3257/6603] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:03:37.800526 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:03:37.801111 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 22:03:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:05:27.992387 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0108c8-c050-43de-855a-b8b7569dfe09] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 22:05:27.993940 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 22:05:27.997659 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-e3dd043d-719a-4e64-9923-f81627ae7a8c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1450446830"}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:05:27.998712 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-e3dd043d-719a-4e64-9923-f81627ae7a8c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:28.005482 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3dd043d-719a-4e64-9923-f81627ae7a8c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:28.006128 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3dd043d-719a-4e64-9923-f81627ae7a8c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:28.007335 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3dd043d-719a-4e64-9923-f81627ae7a8c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:28.007786 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-e3dd043d-719a-4e64-9923-f81627ae7a8c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:28.441095 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-e3dd043d-719a-4e64-9923-f81627ae7a8c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "POST /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d/action" status: 202 len: 0 microversion: 2.1 time: 0.450353 Feb 19 22:05:28.441738 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3347/6604] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 22:05:27 2022] POST /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Feb 19 22:05:33.628416 ncdv-master-1 devstack@n-api.service[136095]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02a8a3ca-f500-48fe-b8eb-c416084a9cb7] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 22:05:33.630012 ncdv-master-1 devstack@n-api.service[136095]: ERROR oslo.messaging._drivers.impl_rabbit [-] [106724db-adde-4356-8365-ad1f06dea86f] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 22:05:33.634210 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [req-43d52445-65b8-4127-a7af-26302007c3e5 req-bbcbbab1-d392-4eb2-9bbe-5ee2ba50cf4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97457988-b02a-43ef-a775-7faa6cc9268d", "name": "network-vif-plugged", "status": "completed", "tag": "bf13c8cc-d258-49d5-b65e-01b293faaa06"}]} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:05:33.636086 ncdv-master-1 devstack@n-api.service[136095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:05:33.636086 ncdv-master-1 devstack@n-api.service[136095]: warnings.warn(msg) Feb 19 22:05:33.658648 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-43d52445-65b8-4127-a7af-26302007c3e5 req-bbcbbab1-d392-4eb2-9bbe-5ee2ba50cf4e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:33.659110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [req-43d52445-65b8-4127-a7af-26302007c3e5 req-bbcbbab1-d392-4eb2-9bbe-5ee2ba50cf4e service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:33.674872 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.compute.server_external_events [req-43d52445-65b8-4127-a7af-26302007c3e5 req-bbcbbab1-d392-4eb2-9bbe-5ee2ba50cf4e service nova] Creating event network-vif-plugged:bf13c8cc-d258-49d5-b65e-01b293faaa06 for instance 97457988-b02a-43ef-a775-7faa6cc9268d on nch1-master-1 Feb 19 22:05:33.680654 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [req-43d52445-65b8-4127-a7af-26302007c3e5 req-bbcbbab1-d392-4eb2-9bbe-5ee2ba50cf4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053910 Feb 19 22:05:33.681539 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3258/6605] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 22:05:42.069748 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1511687616", "imageRef": "5e37dc63-5990-4c1b-a70b-590b40eda316", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2115511971", "security_groups": [{"name": "tempest-secgroup-smoke-745701803"}], "networks": [{"uuid": "c0cb96b0-0fc0-445b-9efa-dc2ca068848a"}]}} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:05:42.092543 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44452. Feb 19 22:05:42.092775 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0108c8-c050-43de-855a-b8b7569dfe09] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44450. Feb 19 22:05:42.182246 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.network.neutron [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] validate_networks() for [('c0cb96b0-0fc0-445b-9efa-dc2ca068848a', None, None, None, None, None)] {{(pid=136094) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 19 22:05:42.622390 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Flavor limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 19 22:05:42.622819 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Image limits 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 22:05:42.623299 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Flavor pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 19 22:05:42.623714 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Image pref 0:0:0 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 22:05:42.624131 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.virt.hardware [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 19 22:05:42.633703 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:42.634160 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:42.635008 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:42.635456 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:42.652544 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Getting quotas for project 57600659895e4232b2c6533b3c277c0c. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 19 22:05:42.657766 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.quota [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Getting quotas for user ac4eb10318e6452cbe3ccaa35ac40e92 and project 57600659895e4232b2c6533b3c277c0c. Resources: {'instances', 'cores', 'ram'} {{(pid=136094) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 19 22:05:42.669735 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Going to run 1 instances... {{(pid=136094) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 19 22:05:42.672833 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5e37dc63-5990-4c1b-a70b-590b40eda316',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 19 22:05:42.722473 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-49ff130b-428b-4a19-9fb6-2a8e4a0fa407 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.660738 Feb 19 22:05:42.723429 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3348/6606] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Feb 19 22:05:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 22:05:42.737396 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-8ba61501-27ef-4900-a426-cf21559a7c1f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:42.738775 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-8ba61501-27ef-4900-a426-cf21559a7c1f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:42.752626 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] [106724db-adde-4356-8365-ad1f06dea86f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44470. Feb 19 22:05:42.753834 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] [02a8a3ca-f500-48fe-b8eb-c416084a9cb7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44468. Feb 19 22:05:42.857499 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-8ba61501-27ef-4900-a426-cf21559a7c1f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:42.865447 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-8ba61501-27ef-4900-a426-cf21559a7c1f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1249 microversion: 2.1 time: 0.134529 Feb 19 22:05:42.866257 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3259/6607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:42 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1249 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 22:05:43.884665 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7be61f7-e71e-4e37-a7ca-0af96a43bdca tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:43.885545 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-f7be61f7-e71e-4e37-a7ca-0af96a43bdca tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:43.892396 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7be61f7-e71e-4e37-a7ca-0af96a43bdca tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:43.893035 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7be61f7-e71e-4e37-a7ca-0af96a43bdca tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:43.893966 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7be61f7-e71e-4e37-a7ca-0af96a43bdca tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:43.895079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-f7be61f7-e71e-4e37-a7ca-0af96a43bdca tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:43.978439 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-f7be61f7-e71e-4e37-a7ca-0af96a43bdca tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:43.999137 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7be61f7-e71e-4e37-a7ca-0af96a43bdca tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1307 microversion: 2.1 time: 0.119917 Feb 19 22:05:44.011143 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3349/6608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:43 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:45.016551 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-077a31b8-c2bd-4cd9-a461-82c84eb2f0ae tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:45.017936 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-077a31b8-c2bd-4cd9-a461-82c84eb2f0ae tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:45.025800 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-077a31b8-c2bd-4cd9-a461-82c84eb2f0ae tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:45.026401 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-077a31b8-c2bd-4cd9-a461-82c84eb2f0ae tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:45.027682 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-077a31b8-c2bd-4cd9-a461-82c84eb2f0ae tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:45.028894 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-077a31b8-c2bd-4cd9-a461-82c84eb2f0ae tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:45.226576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-077a31b8-c2bd-4cd9-a461-82c84eb2f0ae tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:45.235582 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-077a31b8-c2bd-4cd9-a461-82c84eb2f0ae tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.222858 Feb 19 22:05:45.246815 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3260/6609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:45 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:45.584399 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-b5955e08-4d92-498d-be8c-38aa11dda63f req-932aa665-9c50-4b69-87e2-d9e5f42d5014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97457988-b02a-43ef-a775-7faa6cc9268d", "name": "network-vif-unplugged", "status": "completed", "tag": "bf13c8cc-d258-49d5-b65e-01b293faaa06"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:05:45.586349 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:05:45.586349 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:05:45.614772 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b5955e08-4d92-498d-be8c-38aa11dda63f req-932aa665-9c50-4b69-87e2-d9e5f42d5014 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:45.615348 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-b5955e08-4d92-498d-be8c-38aa11dda63f req-932aa665-9c50-4b69-87e2-d9e5f42d5014 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:45.642420 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-b5955e08-4d92-498d-be8c-38aa11dda63f req-932aa665-9c50-4b69-87e2-d9e5f42d5014 service nova] Creating event network-vif-unplugged:bf13c8cc-d258-49d5-b65e-01b293faaa06 for instance 97457988-b02a-43ef-a775-7faa6cc9268d on nch1-master-1 Feb 19 22:05:45.653803 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-b5955e08-4d92-498d-be8c-38aa11dda63f req-932aa665-9c50-4b69-87e2-d9e5f42d5014 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073960 Feb 19 22:05:45.655524 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3350/6610] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:05:46.257835 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7499faee-5cb8-4ced-9bfc-37edd609868b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:46.258967 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7499faee-5cb8-4ced-9bfc-37edd609868b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:46.270553 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7499faee-5cb8-4ced-9bfc-37edd609868b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:46.271343 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7499faee-5cb8-4ced-9bfc-37edd609868b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:46.272758 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7499faee-5cb8-4ced-9bfc-37edd609868b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:46.273576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7499faee-5cb8-4ced-9bfc-37edd609868b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:46.437560 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7499faee-5cb8-4ced-9bfc-37edd609868b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:46.446156 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7499faee-5cb8-4ced-9bfc-37edd609868b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.194980 Feb 19 22:05:46.447059 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3261/6611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:46 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:47.465533 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-02b62dc6-1b8e-4c20-94a8-2c0a763777fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:47.466350 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-02b62dc6-1b8e-4c20-94a8-2c0a763777fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:47.476657 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-02b62dc6-1b8e-4c20-94a8-2c0a763777fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:47.477568 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-02b62dc6-1b8e-4c20-94a8-2c0a763777fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:47.478810 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-02b62dc6-1b8e-4c20-94a8-2c0a763777fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:47.479503 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-02b62dc6-1b8e-4c20-94a8-2c0a763777fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:47.663592 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-02b62dc6-1b8e-4c20-94a8-2c0a763777fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:47.671116 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-02b62dc6-1b8e-4c20-94a8-2c0a763777fd tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.210414 Feb 19 22:05:47.684283 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3351/6612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:47 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:48.686810 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-ef88eb62-0313-4740-aa0c-ab940a83d105 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:48.687427 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-ef88eb62-0313-4740-aa0c-ab940a83d105 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:48.696149 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef88eb62-0313-4740-aa0c-ab940a83d105 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:48.700236 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef88eb62-0313-4740-aa0c-ab940a83d105 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:48.701576 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef88eb62-0313-4740-aa0c-ab940a83d105 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:48.702263 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-ef88eb62-0313-4740-aa0c-ab940a83d105 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:48.888986 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-ef88eb62-0313-4740-aa0c-ab940a83d105 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:48.896683 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-ef88eb62-0313-4740-aa0c-ab940a83d105 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.213506 Feb 19 22:05:48.897480 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3262/6613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:48 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:49.918349 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-987e6170-bc19-4d23-81dd-e75dbedc28c2 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:49.918995 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-987e6170-bc19-4d23-81dd-e75dbedc28c2 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:49.930570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-987e6170-bc19-4d23-81dd-e75dbedc28c2 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:49.930570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-987e6170-bc19-4d23-81dd-e75dbedc28c2 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:49.930570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-987e6170-bc19-4d23-81dd-e75dbedc28c2 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:49.930570 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-987e6170-bc19-4d23-81dd-e75dbedc28c2 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:50.083492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-987e6170-bc19-4d23-81dd-e75dbedc28c2 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:50.091100 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-987e6170-bc19-4d23-81dd-e75dbedc28c2 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.176409 Feb 19 22:05:50.091692 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3352/6614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:49 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:51.108517 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2a4e66cf-dc67-4630-94df-2b7ecb483583 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:51.109482 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2a4e66cf-dc67-4630-94df-2b7ecb483583 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:51.117508 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a4e66cf-dc67-4630-94df-2b7ecb483583 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:51.118273 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a4e66cf-dc67-4630-94df-2b7ecb483583 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:51.119087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a4e66cf-dc67-4630-94df-2b7ecb483583 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:51.119532 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2a4e66cf-dc67-4630-94df-2b7ecb483583 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:51.299636 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2a4e66cf-dc67-4630-94df-2b7ecb483583 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:51.308359 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2a4e66cf-dc67-4630-94df-2b7ecb483583 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.203623 Feb 19 22:05:51.309287 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3263/6615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:51 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:52.325894 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-20bf10a4-ca57-4e8c-ab6f-831b3edf4653 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:52.326525 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-20bf10a4-ca57-4e8c-ab6f-831b3edf4653 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:52.333942 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20bf10a4-ca57-4e8c-ab6f-831b3edf4653 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:52.334406 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20bf10a4-ca57-4e8c-ab6f-831b3edf4653 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:52.335220 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20bf10a4-ca57-4e8c-ab6f-831b3edf4653 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:52.335667 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-20bf10a4-ca57-4e8c-ab6f-831b3edf4653 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:52.475253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-20bf10a4-ca57-4e8c-ab6f-831b3edf4653 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:52.482685 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-20bf10a4-ca57-4e8c-ab6f-831b3edf4653 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.160844 Feb 19 22:05:52.483260 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3353/6616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:52 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:53.499110 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-2aa2a709-7937-4bc9-9cfd-0b7523bba728 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:53.499737 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-2aa2a709-7937-4bc9-9cfd-0b7523bba728 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:53.512832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2aa2a709-7937-4bc9-9cfd-0b7523bba728 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:53.513609 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2aa2a709-7937-4bc9-9cfd-0b7523bba728 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:53.514976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2aa2a709-7937-4bc9-9cfd-0b7523bba728 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:53.515753 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-2aa2a709-7937-4bc9-9cfd-0b7523bba728 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:53.789444 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-2aa2a709-7937-4bc9-9cfd-0b7523bba728 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:53.797675 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-2aa2a709-7937-4bc9-9cfd-0b7523bba728 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.302464 Feb 19 22:05:53.798259 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3264/6617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:53 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:54.218314 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-422c24af-caf8-4421-ae03-3ece44886d77 req-a8be2bac-cdc3-4cc3-a62c-ac97a35ede1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a9ae31-b680-406e-9d75-7729af9608cf", "tag": "02f41f67-7f8c-49fb-893d-166e83f29947"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:05:54.220561 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:05:54.220561 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:05:54.230799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-422c24af-caf8-4421-ae03-3ece44886d77 req-a8be2bac-cdc3-4cc3-a62c-ac97a35ede1c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:54.231186 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-422c24af-caf8-4421-ae03-3ece44886d77 req-a8be2bac-cdc3-4cc3-a62c-ac97a35ede1c service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:54.250707 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-422c24af-caf8-4421-ae03-3ece44886d77 req-a8be2bac-cdc3-4cc3-a62c-ac97a35ede1c service nova] Creating event network-changed:02f41f67-7f8c-49fb-893d-166e83f29947 for instance e1a9ae31-b680-406e-9d75-7729af9608cf on nch2-master-1 Feb 19 22:05:54.256056 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-422c24af-caf8-4421-ae03-3ece44886d77 req-a8be2bac-cdc3-4cc3-a62c-ac97a35ede1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041459 Feb 19 22:05:54.256740 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3354/6618] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:05:54.816892 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-5a268a69-01b9-4cb6-95ab-7ef8603313ea tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:54.817708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-5a268a69-01b9-4cb6-95ab-7ef8603313ea tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:54.824542 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a268a69-01b9-4cb6-95ab-7ef8603313ea tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:54.825005 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a268a69-01b9-4cb6-95ab-7ef8603313ea tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:54.825828 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a268a69-01b9-4cb6-95ab-7ef8603313ea tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:54.826277 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-5a268a69-01b9-4cb6-95ab-7ef8603313ea tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:55.092649 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-5a268a69-01b9-4cb6-95ab-7ef8603313ea tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:55.100838 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-5a268a69-01b9-4cb6-95ab-7ef8603313ea tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.289423 Feb 19 22:05:55.102463 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3265/6619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:54 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:56.119129 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-cb8c0191-1c37-4bdf-a247-2ae8555e3f88 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:56.119863 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-cb8c0191-1c37-4bdf-a247-2ae8555e3f88 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:56.127498 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb8c0191-1c37-4bdf-a247-2ae8555e3f88 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:56.127967 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb8c0191-1c37-4bdf-a247-2ae8555e3f88 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:56.128804 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb8c0191-1c37-4bdf-a247-2ae8555e3f88 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:56.129259 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-cb8c0191-1c37-4bdf-a247-2ae8555e3f88 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:56.280086 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-cb8c0191-1c37-4bdf-a247-2ae8555e3f88 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:56.288604 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-cb8c0191-1c37-4bdf-a247-2ae8555e3f88 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.174097 Feb 19 22:05:56.289058 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3355/6620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:56 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:57.305146 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-7104425d-4834-4802-8a75-15d360aea395 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:57.305738 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-7104425d-4834-4802-8a75-15d360aea395 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:57.313038 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7104425d-4834-4802-8a75-15d360aea395 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:57.313495 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7104425d-4834-4802-8a75-15d360aea395 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:57.314282 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7104425d-4834-4802-8a75-15d360aea395 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:57.314722 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-7104425d-4834-4802-8a75-15d360aea395 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:57.462701 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-7104425d-4834-4802-8a75-15d360aea395 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:57.470392 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-7104425d-4834-4802-8a75-15d360aea395 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.168895 Feb 19 22:05:57.470977 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3266/6621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:57 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:58.486911 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-31868d67-1b0f-471b-8ca9-5873b9e0e693 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:58.487651 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-31868d67-1b0f-471b-8ca9-5873b9e0e693 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:58.494343 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31868d67-1b0f-471b-8ca9-5873b9e0e693 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:58.494823 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31868d67-1b0f-471b-8ca9-5873b9e0e693 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:58.495601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31868d67-1b0f-471b-8ca9-5873b9e0e693 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:58.496051 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-31868d67-1b0f-471b-8ca9-5873b9e0e693 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:58.641631 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-31868d67-1b0f-471b-8ca9-5873b9e0e693 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:58.649308 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-31868d67-1b0f-471b-8ca9-5873b9e0e693 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.166147 Feb 19 22:05:58.649891 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3356/6622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:58 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:59.670443 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a9ff71c1-1fa5-426b-bc99-748b6806f0ee tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:05:59.671256 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a9ff71c1-1fa5-426b-bc99-748b6806f0ee tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:05:59.679134 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9ff71c1-1fa5-426b-bc99-748b6806f0ee tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:59.679585 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9ff71c1-1fa5-426b-bc99-748b6806f0ee tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:59.680398 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9ff71c1-1fa5-426b-bc99-748b6806f0ee tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:59.680841 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a9ff71c1-1fa5-426b-bc99-748b6806f0ee tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:59.844808 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a9ff71c1-1fa5-426b-bc99-748b6806f0ee tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:05:59.854346 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a9ff71c1-1fa5-426b-bc99-748b6806f0ee tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.190222 Feb 19 22:05:59.855184 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3267/6623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:05:59 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:05:59.930287 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-0550226d-751e-488e-890f-ca0590edc497 req-ddd9e16a-f9be-4dd1-a8e7-03d47db95fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a9ae31-b680-406e-9d75-7729af9608cf", "name": "network-vif-plugged", "status": "completed", "tag": "02f41f67-7f8c-49fb-893d-166e83f29947"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:05:59.932290 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:05:59.932290 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:05:59.941138 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0550226d-751e-488e-890f-ca0590edc497 req-ddd9e16a-f9be-4dd1-a8e7-03d47db95fa2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:05:59.941601 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-0550226d-751e-488e-890f-ca0590edc497 req-ddd9e16a-f9be-4dd1-a8e7-03d47db95fa2 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:05:59.957205 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-0550226d-751e-488e-890f-ca0590edc497 req-ddd9e16a-f9be-4dd1-a8e7-03d47db95fa2 service nova] Creating event network-vif-plugged:02f41f67-7f8c-49fb-893d-166e83f29947 for instance e1a9ae31-b680-406e-9d75-7729af9608cf on nch2-master-1 Feb 19 22:05:59.962465 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-0550226d-751e-488e-890f-ca0590edc497 req-ddd9e16a-f9be-4dd1-a8e7-03d47db95fa2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038335 Feb 19 22:05:59.963087 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3357/6624] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:06:00.878523 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9599a943-8613-467a-89f6-899c6b8b679b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:06:00.879643 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9599a943-8613-467a-89f6-899c6b8b679b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:06:00.892098 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9599a943-8613-467a-89f6-899c6b8b679b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:06:00.892930 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9599a943-8613-467a-89f6-899c6b8b679b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:06:00.894240 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9599a943-8613-467a-89f6-899c6b8b679b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:06:00.895000 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9599a943-8613-467a-89f6-899c6b8b679b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:06:01.118743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-9599a943-8613-467a-89f6-899c6b8b679b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:06:01.128800 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9599a943-8613-467a-89f6-899c6b8b679b tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1374 microversion: 2.1 time: 0.258509 Feb 19 22:06:01.129620 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3268/6625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:06:00 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1374 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:06:02.150253 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-91dcdb0d-6ac1-4117-b414-390f86dc955e tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:06:02.150961 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-91dcdb0d-6ac1-4117-b414-390f86dc955e tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:06:02.158019 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91dcdb0d-6ac1-4117-b414-390f86dc955e tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:06:02.158485 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91dcdb0d-6ac1-4117-b414-390f86dc955e tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:06:02.159304 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91dcdb0d-6ac1-4117-b414-390f86dc955e tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:06:02.159756 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-91dcdb0d-6ac1-4117-b414-390f86dc955e tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:06:02.319422 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-91dcdb0d-6ac1-4117-b414-390f86dc955e tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:06:02.327362 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-91dcdb0d-6ac1-4117-b414-390f86dc955e tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1560 microversion: 2.1 time: 0.182175 Feb 19 22:06:02.328466 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3358/6626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:06:02 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:06:02.346814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-a93128aa-4247-412e-9396-4a73a84b3439 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:06:02.346814 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-a93128aa-4247-412e-9396-4a73a84b3439 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:06:02.355766 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a93128aa-4247-412e-9396-4a73a84b3439 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:06:02.356234 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a93128aa-4247-412e-9396-4a73a84b3439 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:06:02.357103 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a93128aa-4247-412e-9396-4a73a84b3439 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:06:02.357546 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-a93128aa-4247-412e-9396-4a73a84b3439 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:06:02.512410 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-a93128aa-4247-412e-9396-4a73a84b3439 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:06:02.521336 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-a93128aa-4247-412e-9396-4a73a84b3439 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1560 microversion: 2.1 time: 0.181365 Feb 19 22:06:02.521939 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3269/6627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:06:02 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:06:04.488119 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-23a92936-4eff-47a2-8a7c-bc8fc374ba50 req-128716f0-9481-4ff2-a6e8-153bb29ab4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a9ae31-b680-406e-9d75-7729af9608cf", "tag": "02f41f67-7f8c-49fb-893d-166e83f29947"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:06:04.489887 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:06:04.489887 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:06:04.498599 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-23a92936-4eff-47a2-8a7c-bc8fc374ba50 req-128716f0-9481-4ff2-a6e8-153bb29ab4a3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:06:04.499209 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-23a92936-4eff-47a2-8a7c-bc8fc374ba50 req-128716f0-9481-4ff2-a6e8-153bb29ab4a3 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:06:04.513569 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-23a92936-4eff-47a2-8a7c-bc8fc374ba50 req-128716f0-9481-4ff2-a6e8-153bb29ab4a3 service nova] Creating event network-changed:02f41f67-7f8c-49fb-893d-166e83f29947 for instance e1a9ae31-b680-406e-9d75-7729af9608cf on nch2-master-1 Feb 19 22:06:04.519375 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-23a92936-4eff-47a2-8a7c-bc8fc374ba50 req-128716f0-9481-4ff2-a6e8-153bb29ab4a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101822 Feb 19 22:06:04.520249 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3359/6628] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:08:17.937980 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-57fb60b4-5a40-4597-b3ca-0620c63d9c2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-993804770"}} {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:08:17.939042 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-57fb60b4-5a40-4597-b3ca-0620c63d9c2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:17.945694 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57fb60b4-5a40-4597-b3ca-0620c63d9c2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:17.946184 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57fb60b4-5a40-4597-b3ca-0620c63d9c2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:17.946983 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57fb60b4-5a40-4597-b3ca-0620c63d9c2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:17.947435 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-57fb60b4-5a40-4597-b3ca-0620c63d9c2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:18.225425 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-57fb60b4-5a40-4597-b3ca-0620c63d9c2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "POST /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf/action" status: 202 len: 0 microversion: 2.1 time: 0.342080 Feb 19 22:08:18.226216 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3270/6629] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Feb 19 22:08:17 2022] POST /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 19 22:08:24.736400 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d0108c8-c050-43de-855a-b8b7569dfe09] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 19 22:08:24.740308 ncdv-master-1 devstack@n-api.service[136094]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 19 22:08:24.803890 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-ccd4d832-0bcd-41ef-a007-e50c87247228 req-54c2f533-9f22-4bec-88b1-176f1d9d22d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a9ae31-b680-406e-9d75-7729af9608cf", "name": "network-vif-plugged", "status": "completed", "tag": "02f41f67-7f8c-49fb-893d-166e83f29947"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:08:24.805413 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:08:24.805413 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:08:24.813358 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ccd4d832-0bcd-41ef-a007-e50c87247228 req-54c2f533-9f22-4bec-88b1-176f1d9d22d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:24.813815 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-ccd4d832-0bcd-41ef-a007-e50c87247228 req-54c2f533-9f22-4bec-88b1-176f1d9d22d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:24.825170 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-ccd4d832-0bcd-41ef-a007-e50c87247228 req-54c2f533-9f22-4bec-88b1-176f1d9d22d9 service nova] Creating event network-vif-plugged:02f41f67-7f8c-49fb-893d-166e83f29947 for instance e1a9ae31-b680-406e-9d75-7729af9608cf on nch2-master-1 Feb 19 22:08:24.830358 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-ccd4d832-0bcd-41ef-a007-e50c87247228 req-54c2f533-9f22-4bec-88b1-176f1d9d22d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097627 Feb 19 22:08:24.830956 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3360/6630] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 22:08:37.108278 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-49e78346-276e-4757-97b8-5f4bdbe8a59f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:37.112248 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-7a5df6d1-027f-4b47-b449-a56620c9fd52 req-b76130f5-5679-434b-b96d-aa83d4eee01f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a9ae31-b680-406e-9d75-7729af9608cf", "tag": "02f41f67-7f8c-49fb-893d-166e83f29947"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:08:37.113739 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:08:37.113739 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:08:37.117950 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-49e78346-276e-4757-97b8-5f4bdbe8a59f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:37.128539 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49e78346-276e-4757-97b8-5f4bdbe8a59f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:37.129015 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49e78346-276e-4757-97b8-5f4bdbe8a59f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:37.129171 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7a5df6d1-027f-4b47-b449-a56620c9fd52 req-b76130f5-5679-434b-b96d-aa83d4eee01f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:37.129788 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-7a5df6d1-027f-4b47-b449-a56620c9fd52 req-b76130f5-5679-434b-b96d-aa83d4eee01f service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:37.129929 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49e78346-276e-4757-97b8-5f4bdbe8a59f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:37.130272 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-49e78346-276e-4757-97b8-5f4bdbe8a59f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:37.142737 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d0108c8-c050-43de-855a-b8b7569dfe09] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44848. Feb 19 22:08:37.144911 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-7a5df6d1-027f-4b47-b449-a56620c9fd52 req-b76130f5-5679-434b-b96d-aa83d4eee01f service nova] Creating event network-changed:02f41f67-7f8c-49fb-893d-166e83f29947 for instance e1a9ae31-b680-406e-9d75-7729af9608cf on nch2-master-1 Feb 19 22:08:37.149115 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba0bcee2-0271-482e-97e9-30538ba49168] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44850. Feb 19 22:08:37.150832 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-7a5df6d1-027f-4b47-b449-a56620c9fd52 req-b76130f5-5679-434b-b96d-aa83d4eee01f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050475 Feb 19 22:08:37.152050 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3361/6631] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:08:37.164528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-49e78346-276e-4757-97b8-5f4bdbe8a59f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 22:08:37.290025 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-49e78346-276e-4757-97b8-5f4bdbe8a59f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 204 len: 0 microversion: 2.1 time: 0.191449 Feb 19 22:08:37.294091 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3271/6632] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 22:08:37 2022] DELETE /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 22:08:37.301626 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-6a49fb10-07a7-4ccb-b41d-c8bd972b43e0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:37.302888 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-6a49fb10-07a7-4ccb-b41d-c8bd972b43e0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:37.312017 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a49fb10-07a7-4ccb-b41d-c8bd972b43e0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:37.312809 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a49fb10-07a7-4ccb-b41d-c8bd972b43e0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:37.314000 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a49fb10-07a7-4ccb-b41d-c8bd972b43e0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:37.314717 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-6a49fb10-07a7-4ccb-b41d-c8bd972b43e0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:37.771670 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:08:37.771916 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 22:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf (ip 10.222.0.30) !!! Feb 19 22:08:37.812044 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:08:37.812363 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 22:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf (ip 10.222.0.30) !!! Feb 19 22:08:37.897799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-6a49fb10-07a7-4ccb-b41d-c8bd972b43e0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:08:37.905882 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-6a49fb10-07a7-4ccb-b41d-c8bd972b43e0 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1685 microversion: 2.1 time: 0.610054 Feb 19 22:08:37.906672 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3362/6633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:08:37 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1685 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:08:38.924625 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-798b12e7-0698-49c9-9302-fc20194f86a4 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:38.925330 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-798b12e7-0698-49c9-9302-fc20194f86a4 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:38.932832 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-798b12e7-0698-49c9-9302-fc20194f86a4 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:38.933289 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-798b12e7-0698-49c9-9302-fc20194f86a4 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:38.934087 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-798b12e7-0698-49c9-9302-fc20194f86a4 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:38.934528 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-798b12e7-0698-49c9-9302-fc20194f86a4 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:39.092470 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-798b12e7-0698-49c9-9302-fc20194f86a4 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:08:39.100632 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-798b12e7-0698-49c9-9302-fc20194f86a4 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1566 microversion: 2.1 time: 0.180045 Feb 19 22:08:39.101230 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3272/6634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:08:38 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 22:08:39.627488 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:08:39.627715 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 22:08:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:08:39.735311 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f4b29d20-dc62-465c-84bd-6d3f921e242f req-318fd221-7659-40f4-ac45-d228a57e10d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a9ae31-b680-406e-9d75-7729af9608cf", "name": "network-vif-deleted", "tag": "02f41f67-7f8c-49fb-893d-166e83f29947"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:08:39.737468 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:08:39.737468 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:08:39.746982 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f4b29d20-dc62-465c-84bd-6d3f921e242f req-318fd221-7659-40f4-ac45-d228a57e10d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:39.747426 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f4b29d20-dc62-465c-84bd-6d3f921e242f req-318fd221-7659-40f4-ac45-d228a57e10d9 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:39.759566 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f4b29d20-dc62-465c-84bd-6d3f921e242f req-318fd221-7659-40f4-ac45-d228a57e10d9 service nova] Creating event network-vif-deleted:02f41f67-7f8c-49fb-893d-166e83f29947 for instance e1a9ae31-b680-406e-9d75-7729af9608cf on nch2-master-1 Feb 19 22:08:39.765633 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f4b29d20-dc62-465c-84bd-6d3f921e242f req-318fd221-7659-40f4-ac45-d228a57e10d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117260 Feb 19 22:08:39.766281 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3363/6635] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:08:40.118708 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:40.119507 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:40.127606 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:40.128053 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:40.128897 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:40.129335 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:40.167870 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:40.168226 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:40.169176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lazy-loading 'fault' on Instance uuid e1a9ae31-b680-406e-9d75-7729af9608cf {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 22:08:40.214172 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:08:40.221480 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-363523a9-ad72-44f2-96e0-86ad09372cfc tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 200 len: 1339 microversion: 2.1 time: 0.107473 Feb 19 22:08:40.222087 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3273/6636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:08:40 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:08:40.666211 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:08:40.666383 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 22:08:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:08:41.244466 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-597286fa-8cdc-4b22-ae04-17ba0a21d1aa tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:41.245181 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-597286fa-8cdc-4b22-ae04-17ba0a21d1aa tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: e1a9ae31-b680-406e-9d75-7729af9608cf] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:41.254856 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-597286fa-8cdc-4b22-ae04-17ba0a21d1aa tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:41.255317 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-597286fa-8cdc-4b22-ae04-17ba0a21d1aa tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:41.256116 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-597286fa-8cdc-4b22-ae04-17ba0a21d1aa tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:41.256591 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-597286fa-8cdc-4b22-ae04-17ba0a21d1aa tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:41.271509 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.wsgi [None req-597286fa-8cdc-4b22-ae04-17ba0a21d1aa tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] HTTP exception thrown: Instance e1a9ae31-b680-406e-9d75-7729af9608cf could not be found. Feb 19 22:08:41.272095 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-597286fa-8cdc-4b22-ae04-17ba0a21d1aa tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Returning 404 to user: Instance e1a9ae31-b680-406e-9d75-7729af9608cf could not be found. {{(pid=136094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 22:08:41.272979 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-597286fa-8cdc-4b22-ae04-17ba0a21d1aa tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf" status: 404 len: 111 microversion: 2.1 time: 0.037341 Feb 19 22:08:41.273548 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3364/6637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:08:41 2022] GET /compute/v2.1/servers/e1a9ae31-b680-406e-9d75-7729af9608cf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 22:08:42.803488 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9da35203-b5f7-4108-ab56-cb419d6c625c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:42.804231 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9da35203-b5f7-4108-ab56-cb419d6c625c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:42.805275 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-f67da2ce-d89f-4a3a-bad2-65c5688d76db req-3cecdf27-fc53-48a0-b561-ce3c312cba79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97457988-b02a-43ef-a775-7faa6cc9268d", "tag": "bf13c8cc-d258-49d5-b65e-01b293faaa06"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:08:42.807141 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:08:42.807141 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:08:42.810612 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da35203-b5f7-4108-ab56-cb419d6c625c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:42.811080 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da35203-b5f7-4108-ab56-cb419d6c625c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:42.812581 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da35203-b5f7-4108-ab56-cb419d6c625c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:42.813037 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9da35203-b5f7-4108-ab56-cb419d6c625c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:42.815431 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f67da2ce-d89f-4a3a-bad2-65c5688d76db req-3cecdf27-fc53-48a0-b561-ce3c312cba79 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:42.815799 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-f67da2ce-d89f-4a3a-bad2-65c5688d76db req-3cecdf27-fc53-48a0-b561-ce3c312cba79 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:42.828096 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-f67da2ce-d89f-4a3a-bad2-65c5688d76db req-3cecdf27-fc53-48a0-b561-ce3c312cba79 service nova] Creating event network-changed:bf13c8cc-d258-49d5-b65e-01b293faaa06 for instance 97457988-b02a-43ef-a775-7faa6cc9268d on nch1-master-1 Feb 19 22:08:42.834835 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-f67da2ce-d89f-4a3a-bad2-65c5688d76db req-3cecdf27-fc53-48a0-b561-ce3c312cba79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033115 Feb 19 22:08:42.835571 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3365/6638] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 22:08:42.844460 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9da35203-b5f7-4108-ab56-cb419d6c625c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Going to try to terminate instance {{(pid=136095) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 19 22:08:42.941358 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9da35203-b5f7-4108-ab56-cb419d6c625c tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "DELETE /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 204 len: 0 microversion: 2.1 time: 0.141632 Feb 19 22:08:42.942070 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3274/6639] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Feb 19 22:08:42 2022] DELETE /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 22:08:42.951370 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-12770c34-dc13-40c0-8be3-9cbd5b8cac2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:42.952079 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.compute.api [None req-12770c34-dc13-40c0-8be3-9cbd5b8cac2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136094) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:42.958492 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12770c34-dc13-40c0-8be3-9cbd5b8cac2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:42.958884 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12770c34-dc13-40c0-8be3-9cbd5b8cac2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:42.959673 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12770c34-dc13-40c0-8be3-9cbd5b8cac2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:42.960307 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [None req-12770c34-dc13-40c0-8be3-9cbd5b8cac2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:43.139405 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.policy [None req-12770c34-dc13-40c0-8be3-9cbd5b8cac2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136094) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:08:43.147244 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-12770c34-dc13-40c0-8be3-9cbd5b8cac2f tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1684 microversion: 2.1 time: 0.200717 Feb 19 22:08:43.147987 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3366/6640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:08:42 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1684 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:08:44.170285 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:44.171319 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:44.178705 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:44.179170 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:44.179951 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:44.180447 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:44.217907 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:44.218561 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:44.219028 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.objects.instance [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lazy-loading 'fault' on Instance uuid 97457988-b02a-43ef-a775-7faa6cc9268d {{(pid=136095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 19 22:08:44.265549 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.policy [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4eb10318e6452cbe3ccaa35ac40e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57600659895e4232b2c6533b3c277c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136095) authorize /opt/stack/nova/nova/policy.py:199}} Feb 19 22:08:44.273108 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-c4fdc8c7-e6ba-4c4a-a8fa-1622e6ca34b8 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 200 len: 1339 microversion: 2.1 time: 0.107037 Feb 19 22:08:44.273684 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3275/6641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:08:44 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 22:08:44.850476 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [req-72ea5db4-99bb-421e-8feb-1e27075e92e4 req-7047c99f-9303-464a-ab83-3ba2602b9ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97457988-b02a-43ef-a775-7faa6cc9268d", "name": "network-vif-deleted", "tag": "bf13c8cc-d258-49d5-b65e-01b293faaa06"}]} {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 19 22:08:44.852056 ncdv-master-1 devstack@n-api.service[136094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 22:08:44.852056 ncdv-master-1 devstack@n-api.service[136094]: warnings.warn(msg) Feb 19 22:08:44.860478 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-72ea5db4-99bb-421e-8feb-1e27075e92e4 req-7047c99f-9303-464a-ab83-3ba2602b9ee7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:44.860935 ncdv-master-1 devstack@n-api.service[136094]: DEBUG oslo_concurrency.lockutils [req-72ea5db4-99bb-421e-8feb-1e27075e92e4 req-7047c99f-9303-464a-ab83-3ba2602b9ee7 service nova] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:44.871635 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.compute.server_external_events [req-72ea5db4-99bb-421e-8feb-1e27075e92e4 req-7047c99f-9303-464a-ab83-3ba2602b9ee7 service nova] Creating event network-vif-deleted:bf13c8cc-d258-49d5-b65e-01b293faaa06 for instance 97457988-b02a-43ef-a775-7faa6cc9268d on nch1-master-1 Feb 19 22:08:44.876689 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [req-72ea5db4-99bb-421e-8feb-1e27075e92e4 req-7047c99f-9303-464a-ab83-3ba2602b9ee7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030226 Feb 19 22:08:44.877311 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3367/6642] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Feb 19 22:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 22:08:45.293176 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b47a0cf-b478-4d7a-a62c-8375db959614 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '>' {{(pid=136095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:45.293743 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.compute.api [None req-9b47a0cf-b478-4d7a-a62c-8375db959614 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] [instance: 97457988-b02a-43ef-a775-7faa6cc9268d] Fetching instance by UUID {{(pid=136095) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 19 22:08:45.300519 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b47a0cf-b478-4d7a-a62c-8375db959614 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:45.300976 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b47a0cf-b478-4d7a-a62c-8375db959614 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:45.301762 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b47a0cf-b478-4d7a-a62c-8375db959614 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 19 22:08:45.302207 ncdv-master-1 devstack@n-api.service[136095]: DEBUG oslo_concurrency.lockutils [None req-9b47a0cf-b478-4d7a-a62c-8375db959614 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Lock "661a85a5-95ec-46b3-ad66-d3bc04fb7064" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 19 22:08:45.316062 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.wsgi [None req-9b47a0cf-b478-4d7a-a62c-8375db959614 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] HTTP exception thrown: Instance 97457988-b02a-43ef-a775-7faa6cc9268d could not be found. Feb 19 22:08:45.316678 ncdv-master-1 devstack@n-api.service[136095]: DEBUG nova.api.openstack.wsgi [None req-9b47a0cf-b478-4d7a-a62c-8375db959614 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Returning 404 to user: Instance 97457988-b02a-43ef-a775-7faa6cc9268d could not be found. {{(pid=136095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 19 22:08:45.317514 ncdv-master-1 devstack@n-api.service[136095]: INFO nova.api.openstack.requestlog [None req-9b47a0cf-b478-4d7a-a62c-8375db959614 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d" status: 404 len: 111 microversion: 2.1 time: 0.028330 Feb 19 22:08:45.318062 ncdv-master-1 devstack@n-api.service[136095]: [pid: 136095|app: 0|req: 3276/6643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Feb 19 22:08:45 2022] GET /compute/v2.1/servers/97457988-b02a-43ef-a775-7faa6cc9268d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 22:08:45.482690 ncdv-master-1 devstack@n-api.service[136094]: DEBUG nova.api.openstack.wsgi [None req-f7cab901-97ff-4ad9-87c7-1a37d80fb2d1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] Calling method '.version_select at 0x7f6466fa2820>' {{(pid=136094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 22:08:45.516708 ncdv-master-1 devstack@n-api.service[136094]: INFO nova.api.openstack.requestlog [None req-f7cab901-97ff-4ad9-87c7-1a37d80fb2d1 tempest-TestSnapshotPattern-1845269784 tempest-TestSnapshotPattern-1845269784-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2115511971" status: 202 len: 0 microversion: 2.1 time: 0.037987 Feb 19 22:08:45.517313 ncdv-master-1 devstack@n-api.service[136094]: [pid: 136094|app: 0|req: 3368/6644] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Feb 19 22:08:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2115511971 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 22:11:57.781211 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:11:57.782024 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 22:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:11:57.821565 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:11:57.821775 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 22:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:11:59.643089 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:11:59.643734 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 22:11:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:12:00.674274 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:12:00.674997 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 22:12:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:13:55.481101 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:13:55.481751 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 22:13:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:14:19.290419 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:14:19.291083 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 22:14:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:15:17.789551 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:15:17.790205 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 22:15:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:15:17.829566 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:15:17.829780 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 22:15:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:15:19.651987 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:15:19.652686 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 22:15:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:15:20.682528 ncdv-master-1 devstack@n-api.service[136095]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:15:20.683209 ncdv-master-1 devstack@n-api.service[136095]: Sat Feb 19 22:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 22:17:15.489436 ncdv-master-1 devstack@n-api.service[136094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 22:17:15.490073 ncdv-master-1 devstack@n-api.service[136094]: Sat Feb 19 22:17:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!